Staff Software Engineer (Data Systems, Python)
Posted Updated
- Northbeam is fundamentally a data product - the whole company. We don’t sell shoes, or ads, or games. We sell data: quality integrations with a variety of platforms, fresh and reliable data pulls, robust data ingest APIs, correct aggregations and algorithmic insights on top of that data, all packaged up in a user-facing application
- What this means for you is that high-quality, robust data integration is at the core of what we do, and your work will have a direct connection to the company’s success
- As a Data Engineer working at Northbeam, you will work with a cross-functional team of product managers, product engineers, and business leaders to translate our customers’ feedback into scalable data pipelines and products
- The work involves creating, maintaining, and improving a labyrinth of integrations and transformations in a complex network of touchpoints to keep everything running smoothly. The system is powered by data that spans numerous ad platforms, a variety of order management systems (such as Shopify and Amazon), as well as our own real-time events that we collect as our customers navigate their online stores
- Work with our customers, product managers, product engineers, and customer support, to scope, build, and iterate high value solutions
- Provide technical leadership to various software engineers and drive the long term technical strategy with scalable architecture and best practices
- Build and maintain data ingestion pathways spanning APIs, file processing, and configurable inputs
- Own and Implement the data/infrastructure engineering aspects end-to-end from idea to solution as part of a cross functional effort with your peers
- Work on the data pipeline architecture and optimize it for readability, maintainability, as well as cost
- Integrate with our machine learning and data science systems to deliver insights to our customers
- Maintain and augment the necessary infrastructure to scale our platform
- Write technical documentation for internal and external stakeholders
- Curiosity, experience, and a desire to build data pipelines and applications at scale will be the key to success in this role
- Experience with SQL / Java / Scala / Spark / Python
- 8+ plus years of experience
- Experience with data pipeline orchestration tools and practices
- Solid understanding of data processing needs of real-time and batch systems for transactional and analytical processing
- Experience designing and deploying high performance systems with reliable monitoring and logging practices
- Experience in data engineering solutions such as Bigquery, Airflow, dbt, Kafka, Pinot
- Prior experience working in marketing, e-commerce, or ad-tech
- Experience working with cloud infrastructure such as Google Cloud Platform, Azure, or AWS
- Experience or a desire to leverage infrastructure-as-code
- The interview process varies by role but typically begins with a 30-minute interview with a Northbeam recruiter, followed by a video interview with the hiring manager
- Next, candidates complete a role-specific video interview followed by video or onsite interviews with several team members. The final step is a video interview with our CEO/Co-founder. The entire interview process is usually 5-7 interviews total and requires around 5-8 hours of your time
- We accept applications on an ongoing basis