7th April 2022
Big Data Engineer
Big Data
London
Up to £80,000 per annum
Big Data Engineer
Docklands/Remote
Up to £80,000 per annum
On behalf of an industry leading organisation within the travel industry, I’m seeking a Data Engineer to join their Data Science team. The Data Engineer will evolve the design and development of data and machine learning products to support business strategies, as well as ensuring their data and machine learning services are scalable, reliable and robust.
The Data Engineer will work closely with other data and machine learning engineers, as well as product owners and other teams to deliver solutions and insights for the business.
Responsibilities:
- Build pipelines for data cleansing, transformation and aggregation to deliver business- and
- client-facing insights and reports
- Develop AWS serverless solutions for data services within the business
- Work closely with Data Scientists/Machine Learning Engineers to build feature engineering, machine learning training and deployment pipelines
- Develop and manage new data source ingestion pipelines when they are occasionally required.
- Rotational responsibility to monitoring production pipelines and AWS EMR clusters owned by the team.
Skills/Experience required:
- At least 2 years of experience in Scala/Python programming
- Degree in computer science, information technology, engineering or equivalent
- Comfortable working with Linux and bash Scripting
- Familiarity with distributed systems
- Familiarity with data structures and algorithms.
Consultant - Brendan Connolly
Telephone: 0207 392 7512
Email: brendan.connolly@spencer-rose.com
Share This Position
