Applied Scientist II / Senior Applied Scientist - Responsible AI (CoreAI)

Sourced from oceanofjobs.com

Microsoft's CoreAI Platform and Tools organization is hiring Applied Scientists to build Responsible AI service components used by hundreds of millions of consumers. The role focuses on supervised fine-tuning of LLMs with RLHF, thorough model evaluation, and designing agent adversarial evaluations and safety mitigations. You will collaborate with the Responsible AI engineering team to deliver mitigations at scale and resolve end-to-end issues.

• Conduct supervised fine-tuning of LLMs with RLHF and perform thorough evaluation
• Design and implement agent adversarial evaluations and safety mitigations
• Collaborate with the Responsible AI engineering team to deliver mitigations at scale
• Refine implementations based on operational performance and troubleshoot end-to-end issues

• Bachelor's in Computer Science, Computational Linguistics, or related field with 2+ years experience, or Master's with 1+ year, or Doctorate, or equivalent experience
• Ability to pass Microsoft Cloud background check
• Proficiency in Python and C#
• Familiarity with PyTorch and Triton
• Experience with data processing and large datasets
• Engineering methodologies: unit testing, TDD, DevOps

• Master's with 6+ years or Doctorate with 3+ years experience
• 2+ years owning feature design, model development, evaluation and deployment
• Full stack (client-to-service) development experience
• Experience with language model training and evaluation
• Research experience in Responsible AI