AI Engineer

BDO Canada is seeking an experienced AI Engineer to design, build, and deploy production-grade AI solutions with a focus on large language models (LLMs), retrieval-augmented generation (RAG), and agentic workflows. The role involves integrating AI into enterprise environments and operating within established governance frameworks.

• Design, build, and deploy robust, scalable, production-grade AI applications using frameworks such as LangChain, LlamaIndex, AutoGPT, and related LLM orchestration tools.
• Develop, refine, and optimize complex prompt strategies; manage model context windows; and fine-tune models to maximize performance, accuracy, and cost efficiency.
• Integrate AI capabilities into enterprise environments through RESTful APIs, microservices, and cloud-native architectures.
• Build, maintain, and optimize vector databases (e.g., Pinecone, Milvus, Weaviate) and design data ingestion and embedding pipelines for RAG solutions.
• Monitor AI systems in production, addressing issues such as hallucinations, latency, reliability, scalability, and token-cost optimization.
• Collaborate with AI Architects, ML Engineers, Data Scientists, and other teams on firm-wide initiatives.
• Support AI system documentation, lifecycle management, and control processes in alignment with ISO/IEC 42001 and NIST AI RMF.
• Adhere to AI risk management, data governance, and security policies; assist with model inventories and traceability.