Together AI
Senior or Staff Software Engineer, Inference / Compute Infrastructure Engineering
Interested in this opportunity? Apply through the protected RemoteKraft flow.
Log in to ApplyFull Time
Principal / Staff / Lead · 2 years
India
Remote
2026-10-23
greenhouse
Requirements Summary
Strong software engineering background, experience with durable workflow orchestration tools, experience building software control planes, experience with event-driven systems, product mindset
Full Job Description
Role Overview We're looking for a software engineer to build the Kubernetes-native control plane that provisions and runs our GPU inference fleet. You'll design a manifest-driven API where the inference team declares what they need, and our controllers handle the reconciliation, provider/runtime selection, and lifecycle management underneath. What You Will Do Build the provisioning state machine, build the self-service API, automate self-healing, own reliability of the pipeline, partner with the inference/ML platform team, engineer it like software. Why It Might Be a Fit Strong candidates have hands-on experience with Kubernetes controller/CRD patterns, have built or operated a platform API that abstracts multiple backends behind one interface, understand GPU scheduling and capacity efficiency, and think about GPU infrastructure as software to be engineered. Requirements Strong software engineering background in Go, Python, Rust, or similar Experience with durable workflow orchestration tools such as Temporal, Cadence, or equivalent Experience building software control planes or orchestration systems that model state and reconcile it over time Experience with event-driven systems — designing and building software around message queues, event streams, or pub/sub A product mindset. You’ve built internal platforms or APIs consumed by other engineering teams and care about the developer experience of what you ship
Skills and Technologies
Visa sponsorship is indicated for this role.