Senior Data Engineer (Azure, Spark, SQL) - London (Chiswick) - 2 days in office - up to £80k
We have partnered with one of the largest real estate companies in London who are looking for an experienced Data Engineer to join the the Digital & Product Department.
As the Senior Data Engineer (Azure, Spark, SQL) you will be designing and creating pipelines, automating processes and migrating from on premise to Azure Cloud.
RESPONSIBILITIES
- Understand, build and develop ETL and data integration solutions using a wide array of technologies and data sources
- Analyse and organise raw data
- Combine raw information from different sources
- Explore ways to enhance data quality and reliability
- Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, etc.
- Work with cloud-based infrastructure (Azure) for hosting data solutions and applications
- Collaborate with architects, data analysts and data scientists to help meet the business goals
SKILLS REQUIRED
- Good knowledge of the Azure data engineering stack - Azure Data Factory, Azure Synapse, Azure Data Lake
- Previous experience with Apache Spark including PySpark scripting
- development and maintenance of ETL/ELT processes within a medallion architecture
- Strong experience with SQL and relational databases
- Analytical skills related to working with structured and unstructured datasets
- Previous experience with Azure DevOps and understanding of CI/CD
If this sounds like you and you are an experienced Data Engineer (Azure, Spark, SQL) then please click the apply button now.
Senior Data Engineer (Azure, Spark, SQL) - London (Chiswick) - 2 days in office - up to £80k