Lead Consultant - Python Data Platforms - London (1-2 days onsite, hybrid) - Inside IR35 negotiable
Role Summary
We are looking for an experienced Lead Consultant with strong expertise in Python development and data platforms to join a strategic programme building a new AWS-based data platform for financial markets.
This role combines hands-on technical leadership with client-facing responsibilities. You will guide technical direction, ensure delivery quality, and oversee the design and build of scalable, cloud-native data solutions.
Key Responsibilities
- Lead the design and delivery of a new data platform in AWS, ensuring scalability, performance, and resilience
- Provide technical leadership and consultancy across multiple workstreams, guiding Python development and data engineering practices
- Oversee the integration and processing of financial market data feeds (transactions, trading, asset management, FX)
- Work with teams to design and maintain distributed data pipelines using Spark and Aurora PostgreSQL
- Act as a trusted advisor to business and technology stakeholders, translating business requirements into technical solutions
- Drive adoption of best practices in testing, CI/CD, Agile delivery, and cloud engineering
- Mentor and support engineering teams, ensuring delivery quality and alignment with the programme roadmap
Skills & Experience Required
- Proven track record as a Lead Consultant, Lead Engineer, or Technical Lead in financial services data platform projects
- Strong expertise in Python for data-intensive systems
- Deep understanding of financial market data (transaction feeds, asset management systems, trading platforms, FX)
- Experience with Apache Spark for distributed data processing
- Hands-on knowledge of Aurora PostgreSQL (or equivalent relational databases)
- Extensive experience with AWS cloud services for data platform builds
- Strong stakeholder engagement and consultancy skills, able to influence at senior levels
- Excellent communication, leadership, and mentoring abilities