We are seeking a Senior Data Engineer with expertise in Big Data and MLOps for an onsite contract role in Pittsburgh, PA. You will develop scalable ETL/ETL solutions, deploy applications in Kubernetes/OpenShift, and collaborate with ML teams to operationalize machine learning models. The role requires optimizing data processing frameworks and implementing DataOps/MLOps best practices.
Responsibilities
Develop scalable ETL/ELT solutions using Python, PySpark, Spark, SQL, and Hive.
Deploy and manage applications in OpenShift/Kubernetes container environments.
Collaborate with Data Scientists and ML Engineers to operationalize machine learning models.
Optimize Big Data processing frameworks and improve data platform performance.
Troubleshoot and resolve issues in Linux/Unix environments.
Implement best practices for DataOps and MLOps, including CI/CD for data and ML workflows.
Ensure data quality, reliability, scalability, and security across data platforms.
Requirements
Bachelor's degree in Computer Science, Engineering, Information Technology, or related field.
5+ years of experience as a Data Engineer, Senior Data Engineer, Big Data Engineer, MLOps Engineer, or related role.
Hands-on experience building Machine Learning pipelines and supporting model deployment and training.