Perception Engineer - Multimodal & Embodied AI (R6022)
Job Description:
Bring promising AI research into autonomous systems that operate in the real world. Shield AI’s Perception team is looking for an engineer who enjoys exploring new ideas and making them work on real hardware. You’ll help turn advances in multimodal computer vision, visual foundation models, and embodied AI into useful capabilities for autonomous aircraft and vehicles.
Working alongside researchers and autonomy engineers, you’ll evaluate promising approaches, build prototypes, and carry successful ideas into the Hivemind product. You’ll combine learned methods with established perception techniques, working through the sensor, software, and compute challenges that make edge robotics different from a benchmark.
What you'll do:
-
Evaluate emerging models and methods against representative sensor data and autonomy needs.
-
Build prototypes and experiments that reveal strengths, limitations, and practical deployment opportunities.
-
Combine learned and classical approaches to improve detection, tracking, geometric vision, or sensor fusion.
-
Optimize and integrate capabilities for edge deployment, contributing Python and C++ software with support from experienced product engineers.
-
Help deliver tested, documented capabilities and stay involved as other teams adopt them.
Required qualifications:
-
A PhD in computer vision, machine learning (ML/DL), robotics, or a related field, or an equivalent record of advanced research and hands-on engineering.
-
Research depth in an area such as multimodal vision, visual foundation models, video understanding, open-vocabulary perception, or embodied learning.
-
Strong Python skills and experience with PyTorch or a comparable ML framework.
-
A thoughtful approach to experiments, evaluation data, and understanding why models fail.
-
Experience building substantial research software, an interest in developing production-quality C++, and a collaborative approach to solving problems.
Preferred qualifications:
-
Experience bringing a research prototype into sustained use.
-
Experience with robotics, real sensors, temporal data, or multi-sensor perception.
-
Familiarity with vision-language models, vision-language-action models, or embodied AI.
-
Experience with C++, edge inference, or model optimization using tools such as ONNX, TensorRT, or CUDA.
You don’t need to meet every preferred qualification or arrive as an expert C++ engineer. We welcome recent PhD graduates and early-career researchers, and we value technical depth, curiosity, and enthusiasm to transfer research to business value more than publication count alone.
Skills
As published by lever · 20 questions · 9 written answers
Basics
Which location are you applying for?, Resume/CV, Full name, Email, Phone, Current location, Current company, LinkedIn URL, Twitter URL, GitHub URL, Portfolio URL, Other website
Short answers (1)
- Please state your full legal name:
Pick from a list (10)
- Are you authorized to work in the United States?
- Will you require sponsorship for employment now or in the future?
- This position may require access to information and technology that is subject to export controls, such as EAR. Are you any of the following?
- Shield AI provides technology, services, and support to the United States military and allied forces with their various missions. If selected for employment with Shield AI, your contributions will directly relate to and/or support these missions. Are there any reasons why you would not be able to fully contribute in support of the U.S. military and allied forces?
- How did you hear about us?
- Are you a transitioning service member?
- If yes, what partnership program are you working with? optional
- Are you local to or willing to relocate? optional
- What office(s) would you be willing to relocate to? (Select all that apply) optional
- Success in this role requires daily engagement with advanced C++ features and software design concepts. Please assess your comfort level with C++11 (or above). optional
Written answers (9)
- If yes, what type of sponsorship? optional
- If you selected "A protected Individual" OR "Other" to the above question, please explain further. optional
- (Optional) If you selected other or would like to expand on the above, feel free to do so below: optional
- If "Industry Conference" or "Other," please provide more details: optional
- If other, please provide further details optional
- When are you available to start your fellowship? optional
- When are you available for full time work? optional
- What full time job(s) are you applying for?
- If you selected international, what location(s)? optional
