Senior Software Engineer (Data & AI Platform)
Posted Updated
- We are seeking a Senior Software Engineer to help design, build, and scale modern data platform capabilities using cloud-native technologies and AI-driven solutions
- In this role, you will develop reusable frameworks, platform services, and engineering patterns that enable teams to build reliable, scalable data-products and AI-powered workflows
- You will also leverage Generative AI to enhance data discovery, governance, developer productivity, and self-service access to trusted data
- Working closely with cross-functional teams, you will help shape a modern data platform that accelerates innovation while ensuring security, reliability, and operational excellence
- Design, build, and operate scalable Data & AI platform capabilities for analytics, data science, and Generative AI use cases with strong practices around data quality, lineage, observability, security, and governance
- Develop reusable abstractions, templates, services, and workflows that standardize how teams build and manage data pipelines and data products
- Partner with Analytics, Applied-AI, Data-engineering and application teams to deliver platform capabilities that support business and clinical decision-making
- Evaluate and integrate modern data and AI technologies with a focus on scalability, reliability, developer experience, and cost efficiency
- Apply Generative AI technologies to improve data enablement, documentation, discovery, workflow automation, and platform usability
- Promote software engineering best practices, including clean code, automated testing, CI/CD, infrastructure-as-code, monitoring, and secure data handling
Benefits
- Remote first
- Flexible vacation
- Wellness days
- Parental leave
- Omada program
- Resources to thrive
- Meeting-free days
- Hands-on experience with Infrastructure as Code using Terraform (or a similar tool such as Pulumi, CloudFormation/CDK) to provision and manage cloud infrastructure
- Experience applying data engineering best practices around data quality, lineage, governance, reliability, observability, and operational excellence
- Strong programming skills in Python and SQL, with experience building production-grade data systems
- Working knowledge of distributed computing and cloud-native technologies such as Spark, Kubernetes etc
- Hands-on experience with modern data architectures, including data lakes, lakehouses, warehouses, analytical datastores, and batch or real-time processing systems
- Strong problem-solving, communication, and collaboration skills, with the ability to work effectively across technical and non-technical teams
- Practical experience using Generative AI tools or technologies to improve engineering workflows, automation, analytics, or data platform capabilities
- 5+ years of professional software engineering or data engineering experience building scalable data platforms, services, pipelines, or analytics infrastructure
- Self-directed, pragmatic, and comfortable working through ambiguity in a fast-moving environment
- Hands-on experience with Databricks, including Delta Lake, Unity Catalog, Workflows, Delta Live Tables, MLflow, Model Serving
- Experience with Generative AI application patterns such as RAG, knowledge-graph, etc
- Experience with NoSQL datastores, including document databases, graph databases, key-value stores, wide-column stores, or search-oriented systems
- Experience working with sensitive data in regulated environments such as healthcare, privacy, fintech, or other compliance-heavy industries
Skills
- AI
- Analytics
- Automation
- CDK
- CI/CD
- Cloud
- Cloud Native
- CloudFormation
- Data Engineering
- Data Pipelines
- Data Quality
- Data Science
- Databricks
- Delta Lake
- Developer Experience
- Distributed Computing
- Fintech
- Generative AI
- Infrastructure as Code
- Kubernetes
- MLflow
- NoSQL
- Observability
- Pulumi
- Python
- Spark
- SQL
- Terraform
- Test Automation
- Unity
