ML Model Serving Engineer

Sesame Job Opportunity

Sesame believes in a future where computers are lifelike - with the ability to see, hear, and collaborate with us in ways that feel natural and human. With this vision, we're designing a new kind of computer, focused on making voice companions part of our daily lives. Our team brings together founders from Oculus and Ubiquity6, alongside proven leaders from Meta, Google, and Apple, with deep expertise spanning hardware and software. Join us in shaping a future where computers truly come alive.

Responsibilities :

• Turbocharge our serving layer, consisting of a variety of LLM, speech, and vision models.
• Partner with ML infrastructure and training engineers to build a fast, cost-effective, accurate, and reliable serving layer to power a new consumer product category.
• Modify and extend LLM serving frameworks like VLLM and SGLang to take advantage of the latest techniques in high-performance model serving.
• Experiment with new compilers to support running models on a variety of hardware compute platforms.
• Work with the training team to identify opportunities to produce faster models without sacrificing quality.
• Use techniques like in-flight batching, caching, and custom kernels to speed up inference.
• Find ways to reduce model initialization times without sacrificing quality.

Required Qualifications :

Preferred Qualifications :

Sesame is committed to a workplace where everyone feels valued, respected, and empowered. We welcome all qualified applicants, embracing diversity in race, gender, identity, orientation, ability, and more. We provide reasonable accommodations for applicants with disabilitiescontact careers@ for assistance.

Full-time Employee Benefits :

Benefits do not apply to contingent / contract workers