Auto-apply is a Pro feature

Let Findyet apply to this job for you:

  • Your CV is tailored to this posting.
  • The application form's questions are answered from your profile.
  • You review everything and approve before anything is sent.
  • Findyet submits the application and adds it to your tracker.

Available on Greenhouse postings today, up to 3 applications a day on Pro.

The first 100 verified accounts get Pro free for 90 days.

See plans

Together AI

Senior Software Engineer (Infra Agent Systems)

Posted Updated
Discussion
  • You’ll work on two hard problems at the same time: making AI agents trustworthy enough to operate production infrastructure, and building the knowledge, retrieval, and distributed systems that make those agents effective
  • You’ll have the opportunity to build foundational systems from the ground up, work on infrastructure at massive scale, and help define how self-improving AI agents operate real-world AI infrastructure
  • Design and build production AI agent systems that diagnose, investigate, and remediate infrastructure issues across one of the world’s largest GPU fleets
  • Build the distributed services, orchestration framework, knowledge graph, and retrieval systems that power infrastructure agents
  • Develop fleet intelligence systems that combine telemetry, infrastructure state, operational knowledge, and historical incidents to help agents make better decisions
  • Integrate with observability, incident management, ticketing, fleet inventory, source control, chat, and internal infrastructure systems through well-designed APIs
  • Own services end to end, including architecture, implementation, testing, deployment, observability, and production operations
  • Improve agent performance through evaluations, retrieval improvements, better tools, and production feedback loops
  • Turn what agents learn in production into reliable, reviewed software and automation

Benefits

  • Competitive health insurance plans
  • Pre-tax flexible spending accounts
  • Dental and vision insurance
  • Income protection & retirement
  • Mental health support and services
  • AD&D insurance
  • 401(k) plan
  • Life insurance
  • STD & LTD insurance
  • Monthly commuting stipend + pre-tax bene
  • Flexible time off policy
  • Monthly team lunches
  • Team-driven celebrations and events
  • Depth in at least one of the following:
  • Experience with Kubernetes, GitOps such as ArgoCD, infrastructure-as-code, and cloud platforms
  • AI agent systems, orchestration, tool use, evaluation, or grounding
  • Search, retrieval, ranking, RAG, or semantic search systems
  • Knowledge graphs or graph data modeling
  • Strong backend engineering experience, including API design, service boundaries, data modeling, and integrations across complex systems
  • Comfortable working across languages such as Go, TypeScript, Python, or Rust
  • 5+ years of experience building production backend systems, distributed systems, or infrastructure platforms
  • Strong systems design skills and experience owning significant systems from design through production
  • Observability platforms such as Prometheus and Grafana
  • Building evaluation frameworks or improving the quality and reliability of LLM-powered systems
  • Event-driven systems and messaging platforms such as NATS or Kafka
  • Graph databases
  • GPU infrastructure, datacenters, bare-metal systems, hardware failure modes, BMC/IPMI, or cluster schedulers

Skills

What Senior Software Engineering jobs ask for — and how much of it you have →
Apply

See also

Software Engineering jobs by country — openings, pay and top skills →

Tailor your CV for this role?

We couldn't check your fit for this role — add a CV to your profile to see it next time.