Staff Software Engineer (Batch Processing Platform)
Posted Updated
Summary
Staff Software Engineer to design, optimize, and lead Pinterest's batch processing platform using Spark, Presto/Trino, and Iceberg at petabyte scale, mentoring engineers and ensuring data system reliability.
- We’re looking for a Staff Software Engineer to help us build a high-performance, efficient, and easy to use batch processing platform and infrastructure at Pinterest
- You’ll be working on some of the most exciting big data open source technologies such as Spark, Presto/Trino, Iceberg, etc. at the scale of hundreds of petabytes of data to bring everyone the inspiration to create a life they love
- Design, implement, and optimize Pinterest’s batch processing infrastructure
- Collaborate with cross-functional teams to understand data needs
- Lead technical projects and initiatives, driving them to completion
- Mentor and guide junior engineers on best practices and architecture
- Ensure the reliability, scalability, and efficiency of data systems
- 6+ years of experience building and supporting large scalable big data infrastructure/platforms
- Bachelor’s degree in a relevant field such as Computer Science or Engineering, or equivalent experience
- Proficiency in programming languages like Java, Scala, or Python
- Strong problem-solving abilities and a drive for innovation
- Excellent communication skills and the ability to collaborate across teams
- Proven skills in designing and maintaining scalable data infrastructure
- Extensive experience with big data query technologies such as Spark SQL or Presto/Trino