Tech talk

Efficient AI with Nebuly: tech talk with Emile Courthoud

Bio

Emile Courthoudis the co-founder at Nebuly and maintainer of Nebuly’s open-source projects. Emile has an engineering background acquired at ETH Zurich and work experience in the healthcare and space sectors. He loves the mountains, where he enjoys hiking in the summer and skiing or snowboarding in the winter.

Abstract

Nebuly is an open-source AI company helping enterprises to build efficient AI models, slashing computing costs, reducing complexity and moving models into production faster. Our relentless focus on software to low-level hardware optimization allows us to accelerate deep-learning computational speed during training/inference and improve model accuracy. We have a dual presence in the US and Europe, a strong team from the world’s best universities (MIT, ETH, etc.) and a fast-growing community with members in 40+ countries that support us in our mission to build the fastest AI ever.

In the talk, we explored the challenges developers often encounter during model deployment and strategies to address them and accelerate inference. We discussed the performance that can be achieved with post-training optimizations and presented Nebullvm, Nebuly’s open-source inference accelerator.