Senior Principal Runtime Engineer

• The Runtime Team builds a high-performance, distributed and scalable software execution environment for SambaNova SambaStack and Cloud platforms to support data-flow applications such as ML training and inference and HPC applications
• We are searching for a software engineer who will work on all parts of the runtime stacks, supporting AI, ML, and scientific applications in high-performance distributed systems
• You will participate in building, testing and deploying next-generation high-performance compute systems for AI applications at scale
• In this role, you’ll design and implement new features across the runtime stack including:
• New and enhanced features to support high-performance, scalable ML inference and training applications
• Drivers and kernels for next generation silicon
• Eliminate networking bottlenecks to enable high performance distributed systems
• User-space libraries for high performance and high utilization of HW resources
• User-facing tools (analysis, job and HW management, profiling, debugging, etc) for Datascale systems
• Cross-functional collaboration including Hardware, ML Application, Compiler, and DevOps

Benefits

• Flexible PTO in US
• Parental Leave
• Benefits (medical, dental and vision)
• Flexible Spending Accounts
• 401k/Pensions
• Gym Access
• Flexible Working Hours

• Solid understanding of Switching and Routing and ability to configure and debug switches and routers for maximum application performance
• Bachelor’s or higher degree in Computer Science, Engineering, or related field (or equivalent experience)
• Hands-on experience with kernel drivers and system-level software that directly interfaces with hardware
• Familiarity with distributed systems architecture, including networking, communication protocols, and the challenges of scaling compute resources efficiently
• Significant experience with RDMA and RoCE networking stacks, such as RDMA based verbs and congestion management
• Hands-on experience with software development tools such as Git, Jenkins, and Jira, with an ability to drive automation and continuous integration efforts
• Expertise in designing and optimizing systems that handle massive parallel workloads, including machine learning training and inference tasks that involve billions of operations per second
• Proven experience building, testing, and tuning software for distributed, high-performance systems. In-depth knowledge of user libraries, and runtime stacks
• Deep understanding of hardware-software interaction, including registers, device memory management, and the intricacies of accelerator design. Experience working with ASIC accelerators is highly desirable
• 5+ years of software engineering experience, often with emphasis on distributed systems, networking, or cloud infrastructure
• Ability to work at the intersection of hardware and software, designing systems that optimize both performance and reliability
• Experience designing or working closely with custom hardware accelerators (ASICs, FPGAs, etc.) and understanding low-level interactions
• Knowledge of SDN, DPDK, SONiC, or modern networking frameworks and background with distributed communication libraries (e.g., UCX, MPI, NCCL)
• Familiarity with deploying high-performance systems in distributed, cloud, or data center environment