Expert Data Engineer (Hadoop/Spark)

Om jobbet

About the Company

Avaron AB is a growing consultancy focused on technology, finance, and business support. We match your expertise with the market's most interesting assignments, offering a platform where your professional development is central.

About the Assignment

For a client in the banking sector, we are looking for an Expert Data Engineer to support the delivery and movement of risk- and recovery-related data across platforms. You will work in a big data environment where reliable pipelines, integrations and transformations are key to enabling downstream analytics and data marts.

Job DescriptionDeliver requested data elements for risk models

Change the target for recovery data to the Recoveries Datamart

Transfer application scorecard data from legacy systems

Design, build and maintain data pipelines, integrations and transformations

Test, build and deploy data engineering solutions

RequirementsExpert-level experience with the Hadoop stack (YARN, EMR, Sqoop, Hive, Oozie)

Expert-level experience with Spark (PySpark)

Strong skills in Python and Java

Strong SQL skills, including query writing and package creation

Hands-on experience with data pipelines, integrations and transformations

Experience with testing, building and deploying

Clear credit record

Nice to haveKafka

Experience automating data collection from source systems

Data warehousing

Deployment and release planning

Application

Selections are made on an ongoing basis, so we recommend that you apply as soon as possible.