13th June 2022
Data Engineer
Big Data
London
£50,000
My client is looking for a Data Engineer to join their Data Science team. The Data Engineer will evolve the design and development of data and machine learning products to support business strategies, as well as ensuring that data and machine learning services are scalable, reliable and robust. The Data Engineer will work closely with other data and machine learning engineers, as well as product owners and other teams to deliver solutions and insights for the business.
Responsibilities:
- Build pipelines for data cleansing, transformation and aggregation to deliver business, client-facing insights and reports.
- Develop AWS serverless solutions for data services.
- Work closely with Data Scientists/Machine Learning Engineers to build feature engineering, machine learning training and deployment pipelines.
- Develop and manage new data source ingestion pipelines when they are occasionally required.
- Rotational responsibility to monitoring production pipelines and AWS EMR clusters owned by the team.
Skills:
- Degree in computer science, information technology, engineering or equivalent
- 2 years of experience in Scala/Python programming
- Comfortable working with Linux and bash Scripting
- Familiarity with distributed systems, data structures and algorithms
- Experience with AWS
- Familiarity with Apache Spark, Apache Kafka
- Experience in Microservice development
- Experience in machine learning or data engineering
- Familiarity with SQL
- Exposure to Terraforms
Consultant -
Telephone:
Share This Position