Senior Software Engineer (Data Engineering)

• We are dedicated to leveraging data to drive strategic decision-making and operational efficiency. Our team is passionate about harnessing the power of data to solve complex problems and deliver impactful insights
• We are seeking a highly skilled and motivated Data Engineer to join our team. The ideal candidate will be responsible for designing, building, and maintaining robust data architectures and engineering data models and pipelines
• This role will play a critical part in ensuring the integrity, scalability, and performance of our data processing and products
• Data Architecture: Design, develop, and implement scalable, secure, and efficient data solutions that meet the needs of the organization
• Data Modeling: Create and maintain logical and physical data models to support business intelligence, analytics, and reporting requirements
• Pipeline Engineering: Design, build, and optimize ETL (Extract, Transform, Load) processes and data pipelines to ensure smooth and efficient data flow from various sources
• Data Integration: Integrate diverse data sources, including APIs, databases, and third-party data, into a unified data platform
• Performance Optimization: Monitor and optimize the performance of data systems and pipelines to ensure low latency and high throughput
• Data Quality and Governance: Implement data quality checks, validation processes, and governance frameworks to ensure the accuracy and reliability of data
• Collaboration: Partner closely with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions that meet their needs
• Documentation: Maintain comprehensive documentation of data architectures, models, and pipelines for ongoing maintenance and knowledge sharing
• Training: You’ll train and collaborate with teammates effectively in data engineering best practices
• Technical Influence/Leadership: Recommends policy changes and establishes department-wide procedures. Uses extensive experience and knowledge to resolve complex problems
• Monitor and manage production environment to deliver data within defined SLAs
• You’ll evaluate, benchmark, and improve the scalability, robustness, and performance of our data platform and applications
• You’ll make significant contributions to the architecture and design of our data processing platform
• You’ll implement scalable, fault tolerant, and accurate ETLs frameworks
• You’ll gather and process raw data at scale from diverse sources
• You’ll collaborate with product management, data scientists, analysts, and other engineers on technical vision, design, and planning
• You’ll implement and maintain a high level of data quality monitoring in our analytics & ML ecosystem
• You’ll train and collaborate with teammates effectively in data engineering best practices
• You will be responsible for leading, documenting, and collaborating across teams for technical projects

Benefits

• Remote first
• Flexible vacation
• Wellness days
• Parental leave
• Omada program
• Resources to thrive
• Meeting-free days

• Experience working with sensitive data i.e. PHI / PII & security best practices
• Experience applying a variety of integration patterns for different use cases
• Exceptional Problem solving and analytical skills
• Experience in backend software development to contribute to distributed computing development and data technologies, with broad experience across systems, contexts, and ideas
• Familiarity with data governance practices and principles
• Experience implementing data pipelines and improving the performance of ETL processes and related SQL queries
• Familiarity with workflow management tools (Airflow preferred)
• Experience with Cloud platforms such as Amazon AWS
• 3+ years of experience as a data engineer developing or maintaining integration with software such as Airflow or any Python-based data pipeline codebase
• Familiarity with cloud-based data warehouses (Amazon Redshift preferred)
• Experience in data modeling for OLTP and OLAP applications
• 5+ years of experience building, maintaining, and orchestrating scalable data pipelines
• Software engineering mindset and an ability to write elegant, maintainable code while following engineering best practices
• Self-Directed: Leading projects and tasks effectively with cross functional stakeholders minimal guidance. You care about writing quality software and recognize that there are often many right answers. Ability to lead tasks and projects effectively
• Familiarity with big data technologies (e.g., Lambda, Iceberg or Delta Lake, Spark, or Kafka)
• Education: Bachelor’s degree in Computer Science or a similar discipline preferred
• Familiarity with business intelligence tools and environments
• Technologies we use: Ruby on Rails, Redshift, Athena, Postgres, SQL, Python, Apache Airflow, Appflow, S3, SNS, SQS, Kafka, Docker, Kubernetes, AWS infrastructure, Lambda, Serverless, Tableau, Bugsnag, Datadog, GitLabCI, Cursor, OpenMetadata, Databricks
• Proficiency in SQL and experience with relational databases (e.g., MySQL, PostgreSQL)
• Proficiency in programming languages such as Python, Java, or Scala
• Proficiency in Analytical SQL (e.g. Analytics Queries, Distributed database queries) and experience working with massive parallel processing (MPP) databases (e.g., Redshift, BigQuery, Snowflake)
• Software Engineering Mindset: Apply best practices to write elegant, maintainable code and understand automated testing concepts
• Knowledge of data modeling techniques (3NF) and tools (e.g., ER/Studio, ERwin)
• Communication Skills: Excellent communication and collaboration skills, both written and verbal, with the ability to convey complex technical concepts to non-technical stakeholders
• Experience with NoSQL databases (e.g., document and graph databases)
• Experience building internal frameworks or development productivity tools would be a big plus
• Experience building data infrastructure, frameworks and automation is a big plus
• Experience using Generative AI tools or technologies to improve engineering workflows, automation, analytics, or data platform capabilities