Applied Research Engineer — Real-time Voice AI (Open Models)
Compensation: $70k – $100k • 0.5% – 2.0%
Location: High preference for engineers based in Dallas or Austin, Texas. We are also open to remote candidates in India.
About us
Voicy builds AI voice assistants that answer calls and messages for businesses: taking orders, booking appointments, and handling customer conversations at scale. We're now building a developer platform for real-time voice AI on open models, so developers can ship voice agents that are fast, affordable, and fully under their control. We're an early-stage team, which means you'll work directly with the founder, turn research into production quickly, and see your work reach real users in weeks rather than years.
The role
This is an applied research engineer role: you will build production voice AI systems and research the improvements that make them better. You'll read the latest speech and LLM literature, reproduce what matters, prototype it on open models, and harden what works into shipped systems. You should be equally comfortable reimplementing a paper from scratch and debugging a latency spike on a GPU server.
What you'll work on
- Real-time voice pipelines: streaming ASR → LLM → TTS and speech-to-speech systems with sub-second turn latency, including interruptions (barge-in), turn-taking, voice activity detection, and endpointing.
- Open models: evaluating, fine-tuning, and distilling open-weight speech and language models (e.g., Whisper-family ASR, Llama/Qwen/Mistral LLMs, open TTS and speech-to-speech models) for noisy phone audio, accents, and new domains.
- GPU inference and infrastructure: serving with vLLM, TensorRT-LLM, Triton, or similar; quantization, batching, KV-cache management, and streaming; driving down latency and cost per minute of conversation.
- Research improvements: turning new ideas in speech, LLMs, and real-time inference into measurable gains in quality, latency, and cost.
- Evaluation: building benchmarks and regression harnesses for WER, latency, voice quality, and task success, so we know a change actually helped.
- Developer experience: APIs, SDKs, and open-source components that make it easy for developers to build on our voice stack.
Qualifications
Texas (Dallas / Austin), preferred:
- MS or PhD in Computer Science, Electrical Engineering, Machine Learning, or a related field.
- Research experience: publications, preprints, industry research lab work, a thesis, or a substantial open-source research project you can walk us through.
India (remote):
- An advanced degree with research experience is preferred, or
- A Bachelor's degree in engineering (B.E./B.Tech) is fine, as long as you have hands-on experience with voice/speech or LLM systems and GPU infrastructure (training or serving models on GPUs).
Everyone should have:
- Strong Python and hands-on experience with PyTorch and the Hugging Face ecosystem.
- Practical experience with speech (ASR/TTS) and/or LLMs, in research or production.
- Comfort working with GPUs: CUDA environments, Linux, Docker, and profiling inference performance.
- The ability to go from paper to prototype independently. We'll give you a problem and context, not a spec.
Nice to have
- Real-time and telephony experience: WebRTC, SIP, WebSockets, or frameworks such as Pipecat and LiveKit.
- Speech-to-speech or full-duplex conversational models.
- Custom CUDA or Triton kernels, or deep inference optimization work.
- Multilingual speech, including Indian languages.
- Open-source maintainership or a strong public GitHub presence.
- Prior startup experience, or evidence that you thrive without much structure.
Compensation
- Texas: $70,000 – $100,000 per year + equity (0.5% – 2%).
- India (remote): ₹10,00,000 – ₹20,00,000 per year + equity (0.5% – 2%).
- We are unable to offer visa sponsorship for this role.
What we offer
- Direct work with the founder and real influence over the technical direction.
- A fast path from research idea to production, with no handoff wall.
- Meaningful equity and support for publishing and open-sourcing your work.
