Senior Data Engineer | 3-6 month Contract |£700 per day| Remote

Senior Data Engineer | 3-6 month Contract |£700 per day| Remote

  • Location

    London, England

  • Sector:

    IT & Technology

  • Job type:


  • Salary:

    Up to £700 per day

  • Contact:

    John Petrella

  • Email:


  • Job ref:


  • Published:

    about 1 month ago

  • Duration:

    3 months

  • Expiry date:


  • Consultant:


Senior Data Engineer | 3-6 month Contract |£700 per day(Outside IR35)| Remote

Job Title: Senior Data Engineer
Day Rate: £700 per day (Outside IR35)
Location: Remote
Contract Length: 3 - 6 months
Send your CV to: jpetrella@understandingrecruitment.co.uk
SC Clearance: Valid SC Clearance or willing to undergo SC Clearance review(must have lived and worked within the UK for 5 years)

Understanding Recruitment are currently looking for a Senior Data Engineer for a contract assignment working fully remotely to start with and as the government regulations loosen, he/she would be in the office a few day's a month/every few weeks.

As the Senior Data Engineer, your role is to provide technical capabilities and skills with the view to supporting a mission-critical data platform change programme within our client's On-Premise infrastructure.

You will be assisting with a subset of tasks which may include performance tuning /performance testing for a new on-premise HDP cluster and will be responsible for providing design & installation knowledge and know-how for the implementation of Apache Airflow, which is to be used as an extension of the existing platform.

Core experience needed:
In-depth working experience in Big data specifically Hadoop based solutions along with installing Apache Airflow or conducted Hadoop performance testing/ tuning for at least one project.

Performance testing:
* SparkBench

* HiveBench

* TeraGen/TeraSort/TeraValidate


Performance monitoring:
* Grafana



* Ambari

* Linux OS

Performance tuning experience:
* Yarn and Yarn resource allocation architecture

* Factors affecting resource utilization of Hadoop clusters

* Spark Job tuning/parameters

* HIVE LLAP Queue capacity

If you feel you match the above then please apply below with your up to date CV or alternatively reach out to me jpetrella@understandingrecruitment.co.uk

Senior Data Engineer | 3-6 month Contract |£700 per day(Outside IR35)| Remote