Integration and Operations Lead /Senior Data Engineer / Contract / 6 Months / Titchfield - Hampshire

Shall provide SC Clearance

As the senior data engineer within the Processing team you will play a leading role in developing the technical capability of your team, building the data adjustment methodology and operational pipelines needed to transform the data from the largest single collection exercise into useable outputs. The system you will be developing will be based primarily on new technologies and platforms using open source software packages such as PySpark and Python on a Hadoop ecosystem

Requirements

• Strong programming ability in PySpark and Python on a Hadoop ecosystem
• Data engineering - design of algorithms, multicore/distributed processing, SQL (Hive & Impala) and noSQL (HBase) database systems, statistical analysis languages and tools
• Data engineering - development of ETL routines for slowly changing dimensions
• Systems engineering - applied to data/information/intelligence challenges in complex environments
• Data management - such as the manipulation and analysis of complex, high volume and high dimension data, data management, interoperability, standardisation of data, metadata

Parity Professionals - Source, Develop, Transform

Parity Professionals Ltd acts in the capacity of an Employment Agency when providing permanent recruitment services.

We welcome applications from all sections of society and applicants will be considered on the basis of their suitability for the position

At Parity, we are committed to protecting your privacy, we will process and hold your CV and use the information you have provided lawfully and in accordance with our Terms and Conditions and our Privacy Policy.