AI Research Engineer

Deloitte is seeking an AI Research Engineer to join their AI and Data practice in Toronto. The role involves designing, evaluating, and deploying generative AI systems, combining cutting-edge research with software engineering. Responsibilities include building evaluation frameworks, fine-tuning LLMs, and contributing to scalable MLOps pipelines.

• Research, prototype, and develop generative AI applications by combining LLMs with deterministic software engineering.
• Build evaluation frameworks and benchmarks to measure model quality, reliability, and business impact.
• Debug, optimize, and enhance GenAI applications using prompt engineering, RL, fine-tuning, and software engineering best practices.
• Train and fine-tune large language models using Hugging Face Transformers and TRL.
• Manage distributed training with DeepSpeed, Accelerate, FSDP, and optimize multi-GPU inference with vLLM.
• Contribute to designing scalable MLOps/DevOps pipelines for model deployment and monitoring.

• 3+ years of experience in AI/ML engineering or research.
• Proficiency in Python and deep learning frameworks (e.g., PyTorch).
• Hands-on experience with large language models and generative AI techniques.
• Experience with distributed training and model serving (DeepSpeed, vLLM).