AI/ML Engineer responsible for architecting and deploying production-grade AI models and agents, developing prompt-engineering and LLM evaluation strategies, and managing GPU infrastructure. The role involves building CI/CD pipelines, automated testing frameworks, and model benchmarking to support scalable AI systems.
Responsibilities
Architect, deploy, and scale open-source AI models using Kubernetes, Ray, or Slurm.
Design and deploy production-grade AI models and AI agents.
Develop prompt-engineering strategies and evaluate model performance.
Build model benchmarking frameworks and perform error and gap analysis.
Create analytics dashboards to communicate AI system performance.
Develop automated testing frameworks for traditional software and stochastic AI outputs.
Build and maintain secure GitLab CI/CD pipelines.
Automate vulnerability scanning and remediation within GitLab Merge Requests.
Optimize GPU utilization, memory management, throughput, and inference latency.
Own features end-to-end from architecture and development through production deployment.
Requirements
4+ years of professional production-grade Python development, including asynchronous Python.
Strong software architecture, design patterns, and systems engineering experience.
NMK Global Inc. is an IT staffing and services firm that provides workforce solutions, contingent staffing, project-based IT services, and professional consulting. The company focuses on connecting enterprises with technology professionals and helping organizations modernize their IT infrastructure, applications, and security.