Summary by AIEngineer.careers
Staff Machine Learning Engineer, SecureAI is a Machine Learning Engineer role (full-time). with Okta. in TORONTO, CA. Compensation shown: $124K–$170K (est.). Imported listing (source: infosecjobboard.com). Apply on the employer's site (infosecjobboard.com).
Imported listing (source: infosecjobboard.com) · Apply on infosecjobboard.com
How our listings work
The sections below reproduce the third-party job description for reference. AIEngineer.careers does not write or control this text.
Imported job description
Sourced from infosecjobboard.com
Okta is hiring a Staff Machine Learning Engineer for its SecureAI team in Toronto to build identity security infrastructure for autonomous AI agents. The role focuses on intent-based enforcement, LLM reasoning, and semantic evaluation to ensure agents operate safely within defined bounds. You will architect scalable ML and Generative AI systems, including retrieval, inference, and evaluation pipelines, and integrate low-latency semantic engines into the API gateway request path.
Responsibilities
- Implement intent-based enforcement to verify agent runtime requests match their intended purpose
- Apply LLM reasoning and prompt parsing to interpret prompts, tool payloads, and intent in real time
- Integrate low-latency inference or semantic evaluation engines into the API gateway request path
- Use embeddings, vector search, or zero-shot classification to score alignment between agent intent and executed actions
- Design confidence-scored decision engines that feed semantic verification results into policy frameworks such as Cedar
- Establish evaluation benchmarks, prompt injection defenses, and guardrails to prevent bypasses or false positives
- Architect scalable ML and Generative AI systems integrating retrieval, inference, and evaluation pipelines
- Optimize prompting, context retrieval, and RAG workflows for accuracy, safety, and efficiency in Claude-based systems
- Build automated evaluation pipelines to measure model quality, correctness, groundedness, and safety in production
- Implement schema validation, structured output enforcement, and guardrails to ensure reliable, compliant AI outputs
Requirements
- 8+ years of software development experience
- Strong programming expertise in Python
- Hands-on experience with applied machine learning, from feature engineering to training and fine-tuning models
- Hands-on experience with modern Generative AI platforms such as AWS Bedrock, OpenAI, or Anthropic
- Deep understanding of retrieval-augmented generation (RAG), embeddings, and knowledge-base workflows
- Hands-on experience with LiteLLM, LangGraph, LangChain, LlamaIndex, MCP, or related AI agent frameworks
- Familiarity with ML frameworks such as FastAPI, PyTorch, TensorFlow, and Spark ML, and orchestration tools like Airflow
- Experience defining evaluation metrics, pipelines, and feedback loops for ML/GenAI systems
- Bachelor's or Master's degree in Computer Science or a related field
Nice to Have
- Familiarity with Go or TypeScript
- Experience integrating AI-driven systems with identity, authentication, or security products
- Exposure to ethical AI, model risk, or compliance frameworks
- Familiarity with evaluation datasets, synthetic data generation, or LLM-as-a-judge methods
Benefits
Health insurancedental insurancevision insuranceretirement planEquity / stock optionspaid time offParental leave
Tech Stack
AirflowAnthropicAWS BedrockClaudeEmbeddingsFastAPIGoLangChainLangGraphLiteLLMLlamaIndexLLM-as-a-JudgeMCPOpenAIPythonPyTorchRAGSpark MLTensorFlowTypeScriptVector Search