Snowflake Data Engineer - R01568220
As a Data Engineer at Brillio, you will be at the forefront of building robust, scalable data architectures that power complex business intelligence and AI initiatives. You will work closely with cross-functional teams, including AI/ML engineers and product stakeholders, to transform raw data into reliable, high-quality assets. Your day-to-day will involve architecting sophisticated data pipelines, implementing advanced modeling techniques, and ensuring the seamless flow of information across the enterprise, directly influencing the data-driven decision-making capabilities of our clients.
Primary Skills
- Snowflake, Airflow, DBT
- SQL
- Python/PySpark
- ETL
- CDC
Specialization
- Snowflake
- SnowPro
Job requirements
Key Responsibilities
Project Type: L3 Support
Flexibility to shift working is Mandatory.
Development Responsibilities
- Design and develop scalable data pipelines and modern data architectures using Snowflake.
- Lead migration initiatives from legacy databases to Snowflake.
- Build and optimize ELT frameworks using DBT.
- Develop and orchestrate workflows using Apache Airflow.
- Design and implement data models, including Star Schema and Snowflake Schema.
- Develop ingestion pipelines for structured and semi-structured data.
- Create reusable frameworks for data validation, reconciliation, auditing, and monitoring.
- Optimize Snowflake objects, including:
- Virtual Warehouses
- Clustering Keys
- Materialized Views
- Streams & Tasks
- Dynamic Tables
- Develop technical design documents and migration runbooks.
- Perform code reviews and enforce engineering best practices.
Migration Responsibilities
- Assess and migrate data from legacy platforms, including:
- Oracle
- SQL Server
- Teradata
- Netezza
- DB2
- SAP HANA
- On-Prem Data Warehouses
- Perform source system analysis and database rationalization.
- Design migration strategies, including:
- Full Data Loads
- Incremental Loads
- CDC (Change Data Capture)
- Historical Data Migration
- Conduct data reconciliation and validation during migration.
- Optimize transformed workloads for Snowflake architecture.
- Execute cutover planning and post-migration stabilization.
Good to have:
AMS / Production Support Responsibilities
- Provide L3 support for Snowflake data platforms and pipelines.
- Monitor and manage production data workloads.
- Troubleshoot data failures, performance issues, and pipeline disruptions.
- Perform root cause analysis (RCA) and implement permanent fixes.
- Support incident, problem, change, and release management activities.
- Work closely with business users and stakeholders to resolve production issues.
- Ensure adherence to SLA and operational support commitments.
- Participate in production releases and deployment activities.
Skills
As published by lever · 1 question · 1 written answer
Which location are you applying for?, Resume/CV, Full name, Email, Phone, Current location, Current company, LinkedIn URL, Twitter URL, GitHub URL, Portfolio URL, Other website, What is your age range?, I identify my ethnicity asSelect all that apply, What gender do you identify as?
- Will you now or in the future require sponsorship for employment visa status (e.g., H-1B or other employment-based visa sponsorship) to work legally in the United States?