Member of Technical Staff, Local Inference & Kernels

Sonder • New York, NY, US • published 2026-09-19 05:37:23.187000

Description

**About Sonder** ---------------- Sonder is an applied AI lab building models that learn how people work. Today, AI largely depends on people explaining what they are doing and remembering when to ask for help. We are building private models that live on your computer, understand work as it happens, and learn the patterns, preferences, and judgment behind how you operate. Our first product, Twin, brings this intelligence to the Mac. It builds a memory of your work and uses that context to offer help at the right moment. **The Role** ------------ We are looking for an inference and performance engineer to own the systems layer between our models and the hardware they run on. You will make our models faster, smaller, and more power\-efficient, working from model execution and quantization down to memory layouts and custom GPU kernels. We are starting with Apple Silicon and macOS, using MLX and Metal. Our models run throughout the working day, sharing memory and compute with the applications someone is using. Sustained power draw, memory bandwidth, and responsiveness under contention matter as much as peak throughput. A faster kernel matters when it makes the whole system better. You ...

Get jobs like this daily in Telegram: @careeri_bot