Senior Software Engineer (Evaluation)
Posted Updated
- Design and build end-to-end data processing pipelines and toolchains to support large-scale data collection, batch processing, curation, and multi-dimensional evaluation
- Design and implement high-performance backend services and distributed architectures , capable of handling large-scale real-time event processing
- Collaborate across complex business components to lead the design of targeted system-level evaluation metrics, testing frameworks, and advanced simulation environments
- Leverage and improve industry-leading, open-source distributed technologies to continuously advance infrastructure capabilities and processing efficiency
- Drive critical architectural decisions and technology selection, ensuring rigorous standards for security, stability, scalability, and high performance
- Establish and maintain comprehensive system monitoring, fine-grained observability metrics, and automated alerting frameworks to ensure low latency and reliable production operations
- Build and optimize downstream engineering workflows for Large Language Models (LLMs), programmatically steering model reasoning, establishing guardrails, and mitigating hallucinations to ensure reliable outputs
Benefits
- Comprehensive medical, dental, and vision insurance
- Generous PTO and paid holidays
- Daily meals and bi-weekly happy hours
- Equity opportunity
- Retirement plans
- Frequent tech talks
- Pursueing a BS/MS or Ph.D in Computer Science or a related field
- Possessing solid engineering discipline, or demonstrating strong interest and potential in building large-scale systems, with the ability to maximize performance while keeping complexity and cost to a minimum
- Experience in large data set processing and familiarity with real time systems
- Solid experience in a fast-paced and structured engineering environment
- Full stack experience including both front end and back end is preferred
- Strong programming skills in C/C++, Python, and software design
- Statistics analysis experience is preferred
- Strong foundation in mathematics and theoretical computer science, such as linear algebra, calculus, graph theory, computational geometry, combinatorial optimization algorithms, stochastic processes, and complexity analysis