Together AI
Staff Software Engineer, Inference / Compute Infrastructure Engineering
Interested in this opportunity? Apply through the protected Remote Kraft flow.
Log in to ApplyFull Time
Principal / Staff / Lead · 1–3 years
India
Remote
2026-08-19
greenhouse
Research and Inference team
Benefits
Full Job Description
Role Overview The role owns the software state machines that provision hardware, bring it into service, and manage its full lifecycle. The Research and Inference team is the customer, and the target state is that they issue a single API call to stand up, scale, or tear down a cluster, and the system takes care of the rest. What You Will Do Write production code that models infrastructure state and reconciles it, eliminating manual provisioning work. Design declarative APIs and a control plane for self-service, automate self-healing, and own reliability of the pipeline. Why It Might Be a Fit A product mindset, experience with durable workflow orchestration tools, and event-driven systems are required. Experience with bare-metal provisioning, GPU cluster software stacks, and systems programming in Rust or Go are nice to have. Requirements Strong software engineering background in Go, Python, Rust, or similar Experience with durable workflow orchestration tools Experience building software control planes or orchestration systems Experience with event-driven systems A product mindset Exposure to bare-metal provisioning and/or networking fundamentals Experience with GPU cluster software stacks Prior work at a hyperscaler, GPU cloud, or datacenter-scale infrastructure organization Systems programming in Rust or Go Benefits Equal Opportunity Employer Equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more