Senior Data Engineer (GenAI / AWS) | Claude Agent SDK | Amazon Bedrock | Python
Posted Updated
Summary
Designs and builds AWS data pipelines and document-processing workflows using Python, Step Functions, Lambda, S3, Textract, and Comprehend. Implements RAG systems with vector databases and builds AI agents using Claude Agent SDK on Amazon Bedrock, with CI/CD via GitHub Actions.
Senior Data Engineer (GenAI / AWS)
Duration: 3+ Months (Extension Possible)
Experience: 14+ years Cloud Platform: AWS Primary Language: Python
Key Responsibilities
- Design and develop data pipelines using AWS Step Functions, Lambda, S3, Textract, and Comprehend.
- Build automated document-processing workflows for extracting, transforming, and processing structured and unstructured data.
- Implement document chunking, embeddings, vector indexing, and semantic search.
- Develop and maintain vector databases and knowledge bases to support Retrieval-Augmented Generation (RAG).
- Integrate knowledge bases with AI agents for contextual information retrieval.
- Build AI agents using Claude Agent SDK and deploy them on Amazon Bedrock AgentCore Runtime.
- Develop CI/CD pipelines using GitHub Actions to automate builds, testing, and deployments.
- Optimize data pipelines for scalability, reliability, security, and performance.
All your information will be kept confidential according to EEO guidelines.