Software Developer/Data Engineer

Software Developer/Data Engineer - 12 Month Contract

Educational Qualifications

• BSc Computer Science / BEng

Professional Qualifications

• AWS Professional Certification

Years of Experience

• 4 to 8 years of Data Engineering or Software Development experience working on Data-Driven ecosystems

Skills / Requirements

• 4 to 8 years of Data Engineering or Software Development experience working on Data-Driven ecosystems
• Required to code complex transformations using loader specifications provided by the BA
• Experience working with Big Data sets and solving data-related challenges
• Ability to automate ingestion by building ingestion pipelines using AWS Lambda or Glue
• Proficiency in coding languages: PySpark, Python, SQL
• Hands-on experience with AWS services, including S3, Athena, Lambda Functions, GLUE, EC2
• AWS experience and AWS certification required
• Experience in data modeling and data architecture design

Key Responsibilities

• Implement scalable data pipelines and architectures using PySpark, Python, SQL
• Build distributed data pipelines and compute tiers operating on AWS Lambda and Glue
• Serve as a technical resource for team members and mentor junior engineers
• Collaborate with the team to deliver high-quality solutions that meet business requirements
• Ensure code is well-designed, maintainable, and follows best practices and standards
• Play a key role in shaping engineering practices by working in a scrum team to ensure sprint deliverables are met
• Utilize project development tools such as JIRA, Confluence, and GIT
• Assist DEVOPS Engineer in automation and CI/CD practices
• Evaluate and recommend new technologies to improve performance, scalability, and reliability of software systems.