Senior Data Engineer.

  • technology
  • permanent
  • London

Senior Data Engineer (Azure, Spark, SQL) - London (Chiswick) - 2 days in office - up to £80k

We have partnered with one of the largest real estate companies in London who are looking for an experienced Data Engineer to join the the Digital & Product Department.

As the Senior Data Engineer (Azure, Spark, SQL) you will be designing and creating pipelines, automating processes and migrating from on premise to Azure Cloud.



RESPONSIBILITIES

  • Understand, build and develop ETL and data integration solutions using a wide array of technologies and data sources
  • Analyse and organise raw data
  • Combine raw information from different sources
  • Explore ways to enhance data quality and reliability
  • Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, etc.
  • Work with cloud-based infrastructure (Azure) for hosting data solutions and applications
  • Collaborate with architects, data analysts and data scientists to help meet the business goals


SKILLS REQUIRED

  • Good knowledge of the Azure data engineering stack - Azure Data Factory, Azure Synapse, Azure Data Lake
  • Previous experience with Apache Spark including PySpark scripting
  • development and maintenance of ETL/ELT processes within a medallion architecture
  • Strong experience with SQL and relational databases
  • Analytical skills related to working with structured and unstructured datasets
  • Previous experience with Azure DevOps and understanding of CI/CD

If this sounds like you and you are an experienced Data Engineer (Azure, Spark, SQL) then please click the apply button now.

Senior Data Engineer (Azure, Spark, SQL) - London (Chiswick) - 2 days in office - up to £80k

Ellen Gentry