About the Role

As a Senior AI/LLM Engineer, you will lead our efforts to train, align, and optimize large language models. You will own the full post-training pipeline from supervised fine-tuning through reward modeling and RL optimization, while also ensuring models run efficiently in production. This is a role that bridges alignment research and systems engineering.

What You'll Own

Own and drive the full RLHF pipeline: data collection, reward model training, and RL fine-tuning using PPO, DPO, GRPO, and RLAIF
Design and run Supervised Fine-Tuning (SFT) pipelines on open-weight models (LLaMA, Mistral, Qwen) as the foundation for RLHF
Build and train reward models that accurately capture human preferences from annotation data
Design human feedback collection pipelines: labeling rubrics, annotator calibration, and preference dataset curation
Implement Constitutional AI and RLAIF techniques to reduce reliance on costly human annotation
Red team models post-training — probing for jailbreaks, regressions, unsafe outputs, and alignment failures
Design and maintain evaluation benchmarks to measure alignment, safety, and capability before and after RL training
Optimize inference pipelines and runtimes (llama.cpp, vLLM, TensorRT) to serve aligned models efficiently at scale
Implement quantization strategies (INT4/INT8/FP8, LoRA, QLoRA) to deploy fine-tuned models on target hardware
Write and tune low-level C/C++ and Rust code for inference performance where Python cannot reach
Diagnose and resolve training instabilities, reward hacking, and production inference bugs under pressure
Stay at the frontier — read alignment and RL papers weekly and translate findings into working experiments

What You'll Bring

Bachelor's degree in IT, Computer Science, Engineering or a related field
6+ years of professional software/ML engineering experience
3+ years hands-on with production ML/DL systems and 2+ years building with LLMs; a proven track record of shipping AI/ML systems to production at scale.
2+ years in a tech lead (or equivalent) role on AI/ML projects — leading the technical delivery of a team or workstream, owning architecture decisions, running design reviews, and mentoring engineers (with or without formal people-management responsibility).

What You'll Bring

Deep familiarity with policy gradient methods: PPO stability, KL divergence constraints, reward shaping
Experience with Direct Preference Optimization (DPO) and its variants as an RLHF alternative
Understanding of reward hacking, Goodhart's Law, and mitigation strategies in RL training
Familiarity with RLAIF (RL from AI Feedback) and Constitutional AI approaches
Ability to design preference datasets and annotation rubrics that produce high-quality reward signal
Experience diagnosing training instabilities: reward collapse, mode collapse, KL divergence blowup
Python as the primary language for all training, fine-tuning, and evaluation pipelines
Strong mathematical foundation: RL theory, probability, linear algebra, optimization — deep enough to derive loss functions and debug training dynamics
C and C++ for systems-level inference work, runtime contributions, and performance-critical paths
Rust experience with ML tooling.
Familiarity with transformer architecture, attention, tokenization, and how post-training interacts with pretraining
Experience with distributed training frameworks for large-scale fine-tuning
Experience with vector databases such as FAISS or Milvus
Familiarity with retrieval-augmented generation (RAG) pipelines
Experience integrating LLMs with external tools, APIs, and agent-based systems
Exposure to Rapid Application Development (RAD) approaches for building and iterating AI solutions efficiently

Our Commitment to Diversity, Equity, Inclusion & Belonging

At Innodata, we believe the best teams are built from a wide range of backgrounds, perspectives, and lived experiences — and that diverse teams build better data, better products, and a better workplace. We are committed to fostering an environment where everyone feels welcomed, respected, valued, and empowered to do their best work.

We are an equal opportunity employer. We make all employment decisions on the basis of merit, qualifications, and business need, and we do not discriminate on the basis of race, ethnicity, color, religion, sex, gender identity or expression, sexual orientation, age, disability, marital or family status, national origin, or any other characteristic protected by applicable law.

We are committed to building an inclusive and accessible hiring process.

If you require any accommodation to participate fully in our recruitment process, please let us know; we're glad to support you.

How to Apply

Apply directly through this posting, and our team will be in touch.