Senior Software Engineer (Observability)
Posted Updated
- The AI Infrastructure team at Together AI is at the forefront of building and scaling the foundational systems that power our generative AI platform. The storage and observability team is crucial for designing, implementing, and maintaining robust distributed storage solutions, ensuring seamless data access and management. They are also responsible for developing comprehensive observability platforms, providing critical insights into system performance and GPU utilization, and proactively identifying and resolving issues
- Identify, design, and develop foundational backend services that power Together’s cloud platform
- Analyze and improve the robustness and scalability of existing distributed systems, APIs, databases, and infrastructure
- Partner with product teams to understand functional requirements and deliver solutions that meet business needs
- Write clear, well-tested, and maintainable software and IaC for both new and existing systems
- Conduct design and code reviews, create developer documentation, and develop testing strategies for robustness and fault tolerance
- Participate in an on-call rotation to address critical incidents when necessary
Benefits
- Competitive health insurance plans
- Pre-tax flexible spending accounts
- Dental and vision insurance
- Income protection & retirement
- Mental health support and services
- AD&D insurance
- 401(k) plan
- Life insurance
- STD & LTD insurance
- Monthly commuting stipend + pre-tax bene
- Flexible time off policy
- Monthly team lunches
- Team-driven celebrations and events
- Experience designing, analyzing and improving efficiency, scalability, and stability of various system resources
- Demonstrated experience with building and operating high-performance and/or globally distributed microservice architectures across one or more cloud providers (AWS, Azure, GCP)
- Excellent communication skills – able to write clear design docs and work effectively with both technical and non-technical team members
- 5+ years of demonstrated experience in building large scale, fault tolerant, distributed systems and API microservices
- Together AI is an Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more