Infrastructure Software Engineer

• As an Infrastructure Software Engineer at Baseten, you’ll build and maintain components of our ML inference platform that powers production AI applications
• You’ll contribute to the core infrastructure, enabling developers to deploy, scale, and monitor ML models with high performance
• Develop infrastructure components for our ML inference platform using Python and Go
• Implement and maintain Kubernetes deployments for model serving
• Contribute to our inference orchestration layer for model deployments
• Build and enhance monitoring systems for model performance metrics
• Implement efficient resource management solutions for ML workloads
• Support infrastructure automation to improve ML deployment workflows
• Work closely with team members to implement technical solutions
• Help balance performance optimization with system reliability
• Participate in technical discussions around infrastructure improvements
• Learn and apply infrastructure best practices

Benefits

• Remote-first work environment. The Baseten team is welcome to work from wherever they want; fully remote, in our San Francisco office, or a mix of both. Today, our team (including our founding team) is spread across the United States, Canada, and Armenia. We provide a $1,000 stipend for you to make your home-office comfortable and productive
• Regular in-person team summits. We get together as a team three times a year to plan, workshop, and most importantly, get to know each other better
• Unlimited PTO. We ask that everyone take at least 4 weeks of vacation. And we have a company-wide break between Christmas and New Year’s Day
• Full healthcare coverage. Medical, dental and vision insurance for you and your family
• Paid parental leave. 16-weeks fully paid parental leave (adoptive and non-birth parents included) and flexibility with schedules while returning to work
• Company-sponsored 401(k) for you to contribute to
• Learning and development budget. We encourage you to take classes, attend conferences, and invest in your craft and we’ll cover expenses to make it happen

• Experience with basic monitoring and logging tools
• Working knowledge of Kubernetes and containerization
• Proficient coding abilities in one or more popular programming or scripting languages; Go proficiency is a plus
• Familiarity with distributed systems concepts
• Bachelor’s degree or higher in Computer Science or related field
• Basic understanding of machine learning concepts and model serving
• Interest in ML/AI infrastructure and willingness to learn
• Strong collaboration and communication skills
• If you are a motivated individual with a passion for machine learning and a desire to be part of a collaborative and forward-thinking team, we would love to hear from you