Senior Python Developer (AI-Assisted Application Evaluation)
Posted
Summary
Senior Python Developer building scalable evaluation platforms and tooling for AI-assisted applications, primarily using Python on Azure. Collaborates with data scientists to create frameworks measuring AI quality, reliability, and safety, while mentoring engineers and promoting best practices.
- Design, develop, and maintain scalable software solutions and services, primarily in Python, which measure the quality, reliability, performance, and safety of AI-assisted applications
- Build reusable platforms, frameworks, and tooling that enable teams across the organisation to evaluate AI-assisted applications consistently and efficiently
- Partner closely with data scientists and engineers to understand evaluation methodologies, translate requirements into technical solutions, and enable data-driven insights
- Support deployment and operational activities within Azure, collaborating with DevOps and platform teams where appropriate
- Own the technical direction, promote engineering best practices, mentor colleagues, and help raise technical standards across the team
- Leverage AI-assisted development tools responsibly and effectively to improve productivity, software quality, and delivery outcomes
- Experience designing and delivering robust, scalable systems and services in cloud environments
- Experience building platforms, frameworks, or shared services that support multiple users or teams
- Strong understanding of software engineering principles, including code quality, maintainability, security, and operational excellence
- Experience influencing technical direction, driving engineering improvements, or mentoring other engineers
- Curiosity about AI technologies and a commitment to using AI tools responsibly and effectively within the software development lifecycle
- Strong professional experience developing production software, with significant experience in Python
- Practical knowledge of DevOps practices, including CI/CD pipelines, automated testing, source control workflows, and application monitoring
- Experience working with cloud platforms, ideally Azure, including deploying and operating applications and services