Staff Engineer, Platform (R6019)
Job Description:
We are looking for a Staff Platform Engineer to contribute to the Platform solutions and infrastructure that power Forge, the AI Factory. These components provide distributed runtime capabilities that enable teams to reliably orchestrate workloads, process data, and underpin the workflows of building an AI Pilot.
The Forge Platform Engineering team provides Kubernetes-native capabilities that support autonomy development, simulation, testing, training, evaluation, deployment, and operational workflows across commercial cloud, on-premises infrastructure, sovereign deployments, edge environments, and fully air-gapped systems.
This is a hands-on technical leadership role. You will define platform architecture, implement production software, establish reusable operational patterns, and partner with teams across autonomy, ML, simulation, test, infrastructure, and product engineering. Success requires balancing developer productivity, reliability, extensibility, performance, portability, and long-term operational maintainability.
What you'll do:
- Build Kubernetes-native platform services: Develop and operate Kubernetes-based services, controllers, operators, deployment patterns, and runtime integrations that support distributed workloads across multiple environments.
- Develop distributed orchestration capabilities: Design and build reusable primitives for authoring, scheduling, and scaling pipeline work.
- Build reliable data-processing infrastructure: Develop platform capabilities for data storage, ingestion, validation, transformation, and governance.
- Develop highly extensible platform components: The Forge Platform base provides standardized tooling around authentication, authorization, observation, networking, routing, secret management, and more to the services that are integrated on top of the ecosystem.
- Create reference architectures: Establish recommended deployment patterns, operating profiles, capacity guidance, benchmarks, reliability practices, and distribution approaches across cloud providers, on-prem, edge, and air-gapped environments.
- Advance observability and operability: Establish end-to-end metrics, logs, traces, structured events, dashboards, alerting, service-level objectives, operational diagnostics, and runbooks for workflows, pipelines, event streams, and platform services.
- Partner with downstream teams: Work directly with autonomy, ML Ops, simulation, test, infrastructure, product, and customer-facing teams to turn recurring distributed-systems problems into reusable platform capabilities.
Key Outcomes:
- The Forge Platform continues to improve in KPIs around reliability, scalability, operational use cases, and customer adoption.
- New services from downstream teams are guided to successful platform integration. Shared distributed services have clear ownership, repeatable deployment patterns, tested recovery procedures, practical observability, and well-defined operational standards.
- The Platform is demonstrated, evaluated, and benchmarked across a wide variety of operational environments.
- Interfaces are maintained for long periods of time to instill customer confidence and reduce upgrade burdens.
Required qualifications:
- Significant experience designing and operating production distributed systems, cloud-native platforms, backend infrastructure, or data-intensive services.
- Strong software engineering skills and a record of delivering production systems in Go and Python.
- Deep understanding of distributed-systems fundamentals, including failure handling, idempotency, consistency tradeoffs, retries, ordering, delivery semantics, backpressure, partitioning, state management, and fault tolerance.
- Experience designing or operating workflow orchestration, distributed job execution, asynchronous processing, event-driven systems, or long-running service workflows.
- Ability to define architecture and technical standards while remaining hands-on in implementation, production troubleshooting, performance analysis, and reliability improvement.
- Experience working across multiple teams to turn recurring infrastructure needs into reusable, well-documented platform capabilities.
- Clear technical communication and the ability to make complex distributed-systems architecture understandable to both specialists and downstream users.
Preferred qualifications:
- Kubernetes controllers, operators, Custom Resource Definitions, admission control, scheduling extensions, KubeRay, or workload-management systems.
- Distributed execution and workflow technologies such as Ray, Temporal, Argo Workflows, Flyte, Dagster, Airflow, Prefect, Kubernetes Jobs, or comparable systems.
- Durable messaging and event-streaming technologies such as NATS JetStream, Kafka, Redpanda, Pulsar, RabbitMQ, SQS/SNS, or comparable systems.
- ETL/ELT, batch processing, event-driven data pipelines, CDC, schema evolution, data validation, artifact processing, or large-file transfer workflows.
- Service networking technologies and practices such as Envoy, service meshes, Kubernetes networking, and CNI plugins.
- Observability software such as OpenTelemetry, Prometheus, Grafana, Loki, Tempo, Jaeger, distributed tracing, structured logging, SLOs, service-level indicators, alerting, and incident-management practices.
- Terraform, Helm, ArgoCD, GitOps, Kubernetes package management, repeatable platform distribution, and Infrastructure as Code.
Why join us:
Platform Engineering is foundational to how Shield AI develops, tests, evaluates, deploys, and operates autonomy systems. This role offers the opportunity to shape the distributed systems foundation used by engineering teams across the company and delivered into demanding customer environments.
Your work will determine how reliably data moves through the organization, how services coordinate across complex environments, how teams execute and recover long-running workflows, and how operators understand the health of mission-critical systems. You will work at the intersection of Kubernetes, distributed computing, event-driven architecture, data processing, networking, observability, and autonomy.
You will help establish reusable platform capabilities that allow specialized teams—including autonomy, simulation, test, ML Ops, and application engineering—to move faster while building on dependable operational foundations.
Skills
- AI
- Airflow
- Argo CD
- Authentication
- Cloud
- Cloud Native
- Dagster
- Data Pipelines
- Distributed Computing
- Distributed Systems
- ELT
- Envoy
- ETL
- Event Driven Architecture
- GitOps
- Grafana
- Helm
- Infrastructure as Code
- Kafka
- Kubernetes
- Loki
- Machine Learning
- NATS
- Networking
- Observability
- OpenTelemetry
- Prefect
- Prometheus
- Pulsar
- Python
- RabbitMQ
- SNS
- SQS
- Terraform
- Workflow Orchestration
As published by lever · 17 questions · 8 written answers
Basics
Which location are you applying for?, Resume/CV, Full name, Email, Phone, Current location, Current company, LinkedIn URL, Twitter URL, GitHub URL, Portfolio URL, Other website
Short answers (1)
- Please state your full legal name:
Pick from a list (8)
- Are you authorized to work in the United States?
- Will you require sponsorship for employment now or in the future?
- Shield AI provides technology, services, and support to the United States military and allied forces with their various missions. If selected for employment with Shield AI, your contributions will directly relate to and/or support these missions. Are there any reasons why you would not be able to fully contribute in support of the U.S. military and allied forces?
- How did you hear about us?
- Are you a transitioning service member?
- If yes, what partnership program are you working with? optional
- Are you local to or willing to relocate? optional
- What office(s) would you be willing to relocate to? (Select all that apply) optional
Written answers (8)
- If yes, what type of sponsorship? optional
- (Optional) If you selected other or would like to expand on the above, feel free to do so below: optional
- If "Industry Conference" or "Other," please provide more details: optional
- If other, please provide further details optional
- When are you available to start your fellowship? optional
- When are you available for full time work? optional
- What full time job(s) are you applying for?
- If you selected international, what location(s)? optional
