← Back to Remote Jobs

Together AI

Staff Software Engineer, Inference / Compute Infrastructure Engineering

Interested in this opportunity? Apply through the protected Remote Kraft flow.

Log in to Apply
Job type

Full Time

Experience

Principal / Staff / Lead · 1–3 years

Location

India

Workplace

Remote

Posted

2026-08-19

Job board

greenhouse

Team

Research and Inference team

GeneralSoftware Engineer JobsInformation Technology JobsEngineering Jobs

Benefits

Equal Opportunity EmployerEqual employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran

Full Job Description

Role Overview The role owns the software state machines that provision hardware, bring it into service, and manage its full lifecycle. The Research and Inference team is the customer, and the target state is that they issue a single API call to stand up, scale, or tear down a cluster, and the system takes care of the rest. What You Will Do Write production code that models infrastructure state and reconciles it, eliminating manual provisioning work. Design declarative APIs and a control plane for self-service, automate self-healing, and own reliability of the pipeline. Why It Might Be a Fit A product mindset, experience with durable workflow orchestration tools, and event-driven systems are required. Experience with bare-metal provisioning, GPU cluster software stacks, and systems programming in Rust or Go are nice to have. Requirements Strong software engineering background in Go, Python, Rust, or similar Experience with durable workflow orchestration tools Experience building software control planes or orchestration systems Experience with event-driven systems A product mindset Exposure to bare-metal provisioning and/or networking fundamentals Experience with GPU cluster software stacks Prior work at a hyperscaler, GPU cloud, or datacenter-scale infrastructure organization Systems programming in Rust or Go Benefits Equal Opportunity Employer Equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more

Skills and Technologies

Software engineeringDurable workflow orchestrationEvent-driven systemsProduct mindsetGoPythonRustTemporalCadenceKubernetesKafkaNATSSQSSoftware Engineer JobsInformation Technology JobsEngineering Jobs