Skip to main content AIEngineer.careers AIEngineer.careers Real AI engineering roles. Top companies. Zero noise.
Browse Popular roles
Top locations
© 2026 AIEngineer.careers
Machine Learning Engineer II - Inference Platform at Beatdapp | AIEngineer.careers
Home / Jobs / Machine Learning Engineer II - Inference PlatformMachine Learning Engineer II - Inference Platform VANCOUVER · CA
—
Full-time
MID
Apply Now About the Role Beatdapp is building advanced streaming integrity technology, focusing on ML inference systems for audio at scale. This role blends ML engineering, platform/infrastructure work, and inference systems to bridge audio processing and production deployment. You'll optimize GPU-bound inference containers, manage multi-cloud infrastructure, and ensure low-latency, high-throughput services.
Responsibilities Build and tune inference containers (Dockerfile, GPU access, multi-cloud orchestration with ECS, Cloud Run, GKE, EKS). Optimize GPU instance performance: concurrency tuning, VRAM accounting, rate limiting, multi-GPU distribution. Conduct scale/stress testing and translate results into autoscaling and instance-sizing decisions. Operate Terraform stack across GCP and AWS (networking, identity, GPU nodes, autoscaling). Build and maintain customer-facing API layer (authentication, rate limiting, data isolation, metering). Maintain data orchestration pipelines for model evaluation, reporting, and dashboards. Set up observability metrics, dashboards, logging, and alarms for inference service, instances, and models. Requirements Related STEM degree (BSc, MSc or higher) with 3+ years experience in platform/infra/backend/ML/applied-ML/data engineering. Strong engineering skills: write clean, scalable, production-grade code in Python, Go, Rust, or C++. Report this listing
Architectural fluency in data stores, distributed systems, caching, and data transfer protocols.
Data engineering skills: comfort with data pipelines and SQL (Airflow, BigQuery, Postgres).
Deep cloud infrastructure and networking experience across GCP and AWS.
Experience with ML platform tooling (MLflow or similar) and model lifecycle processes.
Terraform proficiency: write/modify modules, understand state and backends.
CI/CD discipline and experience with containerization (Docker). Tech Stack Python CI/CD AWS Go GCP Airflow Docker MLflow Terraform C++ GPU Postgres BigQuery Rust
Machine Learning Engineer Sanctuary AI