Data Engineer

Perch Group is seeking a Data Engineer to design and implement ETL/ELT pipelines using Azure Data Factory, Azure Databricks, and T-SQL. The role involves coaching junior team members and ensuring data quality. The company focuses on ethical debt resolution using data-driven technology.

• Using best practice to create ETL/ELT processes using ADF/SQL and Azure Databricks
• Creating or guiding the low-level design of data solutions
• Monitoring the quality of the overall data platform(s)
• Developing high complexity, secure, governed data ETL from various sources
• Designing and building data observability and data quality
• Checking junior team members outputs and providing feedback
• Coaching junior members around Data Engineering and the Data Development Lifecycle
• Taking accountability for peer review, testing and deployment of junior team members' code

• 3 years experience designing and deploying ETL/ELT solutions with Azure Data Factory (ADF)
• 3 years experience with T-SQL, including Functions, CTEs, complex joins and query optimisation
• 1 year experience of Azure Databricks/notebooks
• Strong analytical and problem-solving skills
• Strong data quality and governance skills