Senior Software Engineer (Streaming Infrastructure)
Posted Updated
Summary
Designs, builds, and operates large-scale CDC and batch export systems for Airbnb's unified data movement platform, working hands-on with streaming systems like Kafka and databases such as MySQL/Aurora. Participates in on-call and collaborates with partner teams to deliver multi-month infrastructure projects.
- Airbnb’s Data Infrastructure organization builds the systems that store, move, and transform data across the company
- Our Data Movement & Transformation (DMT) group is building a single, unified platform for moving data between Airbnb’s storage systems, replacing dozens of one-off tools with one reliable, well-supported way to get data where it needs to go
- This platform is the foundation for Data as a Service, a top-level infrastructure initiative at Airbnb
- Be hands-on (code, design, test) and work with partner teams, internal customers, and leadership to deliver multi-month projects on time
- Design, build, and operate large-scale CDC and batch export systems that run across every online database at Airbnb
- Help shape the architecture of DMT’s unified data movement platform while it’s being built
- Improve the reliability, performance, and efficiency of systems that critical business functions depend on
- Make it easier for engineers at Airbnb to get their data into offline systems without needing to be database or pipeline experts
- Take part in on-call and raise the operational bar for a platform that other teams build on
Benefits
- Paid volunteer time
- Health food and snacks
- Generous parental and family leave
- Learning and development
- Annual travel and experiences credit
- Hands-on experience with streaming systems like Kafka, and with how databases capture and publish changes (binlogs, Debezium, or similar)
- Experience maintaining, analyzing, and debugging production systems at scale
- Strong collaboration and communication skills in a remote-working environment
- Ability to own and go deep in a complex codebase
- Strong ownership and a track record of delivering on time
- 5+ years of experience building and operating large-scale backend distributed systems, such as data ingestion, streaming, CDC, storage, or data platforms
- Clean, readable, testable, and maintainable code
- Familiarity with MySQL/Aurora, schema evolution, or large-scale batch data processing
- Experience building managed or multi-tenant platforms used by other engineering teams