Azure Data Engineer 17668

Om jobbet

Veritaz is a leading IT staffing solutions provider in Sweden, committed to advancing individual careers and aiding employers in ensuring the perfect talent fit. With a proven track record of successful partnerships with top companies, we have rapidly grown our presence in the USA, Europe, and Sweden as a dependable and trusted resource within the IT industry.

Assignment Description

We are looking for an experienced Azure Databricks Data Engineer to support the development and delivery of production-grade data platforms within modern cloud-native environments.

What You Will Work On

Develop and maintain production-grade Azure Databricks data platforms

Build scalable batch and streaming data pipelines

Design and implement bronze/silver/gold data architectures

Develop reusable transformation frameworks and data processing workflows

Work with Apache Spark, PySpark/Scala, and Spark SQL solutions

Implement and optimize Delta Lake capabilities including schema evolution and incremental processing

Configure governance, permissions, lineage, and auditability using Unity Catalog

Support platform observability, monitoring, and operational optimization

Perform Spark performance tuning and optimization activities

Work with Azure integrations including ADLS, ADF/Synapse, Key Vault, and Entra ID

Contribute to CI/CD pipelines and deployment automation processes

Collaborate with cross-functional teams within enterprise data platform initiatives

What You Bring

Strong experience in Azure Databricks engineering

Proven experience delivering production-grade data platforms

Advanced expertise in Apache Spark technologies

Strong experience with PySpark and/or Scala

Solid understanding of Spark SQL and distributed data processing

Deep expertise in Delta Lake including:

ACID transactions

Partitioning strategies

Schema evolution

OPTIMIZE/ZORDER

Incremental and CDC patterns

Experience building scalable batch and streaming pipelines

Strong knowledge of bronze/silver/gold data architectures

Experience with governance and security in multi-team environments

Knowledge of Unity Catalog permissions, lineage, and auditability

Experience with service principals and managed identities

Strong understanding of Spark performance tuning and observability

Experience integrating Azure services such as ADLS, ADF/Synapse, Key Vault, and Entra ID

Experience with CI/CD practices using Azure DevOps or GitHub Actions

Strong analytical and problem-solving skills