What is LFM2.5-2.6B?

LFM2.5-2.6B is a game-changer in the AI world, especially when it comes to edge devices - you know, the kind of hardware we use every day, from laptops to phones. This model is designed to power some pretty capable agents, all from the device itself, which is huge. It supports tool calling, multi-step workflows, and it's still small and fast, so it won't slow you down. The implications are massive - developers can now deploy agents just about anywhere, keeping data private and avoiding those hefty cloud inference costs.

The performance of LFM2.5-2.6B is no joke, either. Benchmark results show it's competitive with models up to four times its size, which is impressive, in tasks like STEM, instruction following, tool use, and agentic tasks. And when it comes to inference, it's a speed demon - we're talking 220 tokens per second on an Apple M5 Max, and 113 tokens per second on an AMD Ryzen CPU. That makes it perfect for all sorts of applications.

Developers, take note: LFM2.5-2.6B is a great choice if you need instruction following and tool use in your apps. The model's strengths in these areas make it a no-brainer for building agents that can operate effectively, right on the device. To get started, just install the latest version of transformers and load the model using the provided code snippet - easy peasy. With day-one support across the inference ecosystem, LFM2.5-2.6B is all set to revolutionize how we build and deploy AI-powered agents.

Source: Hugging Face