We've officially entered the era of pocket-sized intelligence. Over the last three years, AI models have only gotten smarter and smaller. Techniques like speculative decoding have sped-up local infere…
We've officially entered the era of pocket-sized intelligence. Over the last three years, AI models have only gotten smarter and smaller. Techniques like speculative decoding have sped-up local inference, while smart quantization allowed massive models to run on modest hardware. With modern inference engines offering simple APIs, cutting-edge AI is running locally on laptops everywhere. Join Merve as she breaks down the current local AI ecosystem and shows you how to bring these powerful tools into your own workflow.
Sobre Merve Noyan: Merve is an open-source advocate, and machine learning engineer at Hugging Face. She's also author of Vision Language Models book published by O'Reilly.
We've officially entered the era of pocket-sized intelligence. Over the last three years, AI models have only gotten smarter and smaller. Techniques like speculative decoding have sped-up local infere…
We've officially entered the era of pocket-sized intelligence. Over the last three years, AI models have only gotten smarter and smaller. Techniques like speculative decoding have sped-up local inference, while smart quantization allowed massive models to run on modest hardware. With modern inference engines offering simple APIs, cutting-edge AI is running locally on laptops everywhere. Join Merve as she breaks down the current local AI ecosystem and shows you how to bring these powerful tools into your own workflow.
Sobre Merve Noyan: Merve is an open-source advocate, and machine learning engineer at Hugging Face. She's also author of Vision Language Models book published by O'Reilly.
Watch talk