Member of Technical Staff (Agentic Environments)

• At Cohere, we’re pushing the boundaries of what these technologies can achieve for production environments, and we’re seeking a senior engineer who understands the practical challenges of making AI systems work at scale
• This role demands deep technical expertise in production environments and the ability to bridge research concepts with real-world implementations
• This position is hands-on and engineering-driven
• You’ll focus on production systems, experiment with frontier models, and collaborate with talented engineers to build scalable, production ready solutions
• We strive for excellence in both engineering and science by meticulously designing experiments and design docs
• We blend engineering and research seamlessly
• Everyone contributes to both, depending on organizational needs
• We provide access to world class compute resources, data, and talent to ensure you can do your best work
• Design and write high-performing and scalable software for training models
• Develop new tools to support and accelerate research and LLM training
• Coordinate with other engineering teams (Infrastructure, Efficiency, Serving) and the scientific teams (Agent, Multimodal, Multilingual, etc.)
• Research, implement, and experiment with ideas on our cluster and data infrastructure
• Collaborate, Collaborate, and Collaborate with other scientists, engineers, and teams!

Benefits

• Six weeks’ paid vacation
• Equity / stock options
• RRSP, 401(k), and Pension Scheme contributions
• Coverage for 100% of your insurance premiums across health, dental, vision, and travel
• Additional coverage for accessing mental health providers/services
• Six months of fully paid parental leave, including adoption and surrogacy
• Financial support for egg freezing and IVF in Canada and the UK
• A monthly fitness and wellness allowance
• Globally dispersed company that supports a remote work culture
• A $2,000 annual education benefit for professional development
• A weekly stipend for meals when working remotely and catered lunch when working from one of our global offices
• A monthly arts and culture allowance
• A monthly quality time allowance

• Experience with distributed training infrastructures (Kubernetes) and associated frameworks (Ray)
• Proficiency in Python and related ML frameworks such as JAX, Pytorch and/or XLA/MLIR
• Value test-driven development methods, clean code, and strive to reduce technical debts at all levels
• Experience using and debugging large-scale distributed training strategies (memory/speed profiling)
• Experience in ML and LLM academic research
• Extremely strong software engineering skills
• Enjoy tuning and optimising large LLM models
• Thrive in a fast-paced, technically challenging environment, where you can contribute your innovative ideas and solutions
• Have a deep passion for quality work
• Comfortable working with people with different levels of software engineering skills, from beginner to more advanced
• Comfortable diving into complex ML codebases to identify and resolve issues, ensuring the smooth operation of our systems
• If any of the above doesn’t line up exactly with your experience, we still encourage you to apply