← Back to Remote Jobs

Together AI

Senior or Staff Software Engineer, Inference / Compute Infrastructure Engineering

Interested in this opportunity? Apply through the protected RemoteKraft flow.

Log in to Apply
Job type

Full Time

Experience

Principal / Staff / Lead · 2 years

Location

India

Workplace

Remote

Posted

2026-10-23

Job board

greenhouse

GeneralEngineering JobsInformation Technology JobsSoftware Engineer Jobs

Requirements Summary

Strong software engineering background, experience with durable workflow orchestration tools, experience building software control planes, experience with event-driven systems, product mindset

Full Job Description

Role Overview We're looking for a software engineer to build the Kubernetes-native control plane that provisions and runs our GPU inference fleet. You'll design a manifest-driven API where the inference team declares what they need, and our controllers handle the reconciliation, provider/runtime selection, and lifecycle management underneath. What You Will Do Build the provisioning state machine, build the self-service API, automate self-healing, own reliability of the pipeline, partner with the inference/ML platform team, engineer it like software. Why It Might Be a Fit Strong candidates have hands-on experience with Kubernetes controller/CRD patterns, have built or operated a platform API that abstracts multiple backends behind one interface, understand GPU scheduling and capacity efficiency, and think about GPU infrastructure as software to be engineered. Requirements Strong software engineering background in Go, Python, Rust, or similar Experience with durable workflow orchestration tools such as Temporal, Cadence, or equivalent Experience building software control planes or orchestration systems that model state and reconcile it over time Experience with event-driven systems — designing and building software around message queues, event streams, or pub/sub A product mindset. You’ve built internal platforms or APIs consumed by other engineering teams and care about the developer experience of what you ship

Skills and Technologies

Software engineeringDurable workflow orchestrationEvent-driven systemsProduct mindsetKubernetesGoPythonRustTemporalCadenceKafkaNATSSQSEngineering JobsInformation Technology JobsSoftware Engineer Jobs

Visa sponsorship is indicated for this role.