My Shortlist

Your shortlisted jobs will appear here. To view your shortlist, please login or register

More Jobs Like This
DATE ADDED: Mon 17/02/2020

Senior Data Engineer - Python, Hadoop, AWS

London, UK


JOB TYPE: Permanent, Full Time

Are you a skilled Data Engineer who has helped deploy production ready Big Data or Cloud systems?

Can you implement technologies optimised for access patterns, with focus on how consumers use the platform?

Are you interested in building on your existing Big Data or Cloud ingestion experience ?

If so, this could be the perfect role for you! I am looking for a number of Data Engineers for an award winning consultancy company in London. In this role you will help to deploy data pipelines and processes in a production-safe manner, using the latest technologies. 

They need an excellent data specialist with strong knowledge of Data Development, ETL, Data Warehousing and dealing with large sets of structured, semi-structured and unstructured data. You need to be able to ingest Real Time data from various sources and design new data platforms as well.

This is an autonomous role that will run alongside the existing Big Data, Data Science and Cloud teams. It will allow you the chance to really shape the Data Engineering proposition whilst being an integral part of the growth.

You will ideally have some or most of these skills...
  • Python/ Scala/ Java
  • Spark   (both batch and stream processing)
  • Hadoop ecosystem exposure (YARN, HDFS, HBase, custom MapReduce jobs, Hive/ Impala)
  • At least one distributed NoSQL storage (HBase, Cassandra)
  • Understanding of cluster resource management tools (YARN, Mesos)
  • Stream processing tools like Kafka, Storm
  • Cloud architecture (i.e. AWS Kinesis, Data Pipeline, EMR, Glue, Redshift, Athena)
  • General SQL skills
  • ELK stack (desirable)If you are interested in finding out more then please get in touch with Chris Mayers at Evolution Recruitment Solutions.
    Role: Senior Data Engineer - Python, Hadoop, AWS
    Job Type: Permanent, Full Time
    Location: London, Greater London, Greater London

    Apply for this job now.