Senior Software Engineer - Together Cloud Infrastructure at Together AI


Company Logo

Together AI is Hiring

Job Info:
  • Company Together AI
  • Position Senior Software Engineer - Together Cloud Infrastructure
  • Location San Francisco
  • Source Empllo
  • Published July 25, 2026
  • Category Development
  • Type Full-Time
  • Experience Senior
  • Salary $160k - $230k


Job Description

📋 Description

  • Design, build, and maintain backend services in data centers.
  • Automate hardware management like Infiniband, storage, and VM provisioning.
  • Build IaaS software for GB200 data center with GPUs.
  • Develop a global high-performance object store for large datasets.
  • Create observability stacks with automated node lifecycle.
  • Work on the core Together AI platform and open-source projects.

🎯 Requirements

  • 5+ years software dev with Go proficiency
  • 5+ years high-performance, production-quality code
  • Experience building microservices across AWS/Azure/GCP
  • Deep Kubernetes internals and operators experience
  • Infra automation and observability (Terraform, Ansible, Prometheus, Grafana)
  • CI/CD with GitHub Actions and ArgoCD; scale IaaS/PaaS

🎁 Benefits

  • Startup equity and health insurance.
  • Remote-friendly, flexible work options.
  • Collaborative, research-driven environment.