Data Engineer

Om jobbet

Job Description:

Our client is seeking a skilled Senior Data Engineer to establish and enhance the core data infrastructure supporting performance evaluation and CMP (Customer Meeting Point) insights. This role focuses on designing and maintaining scalable data platforms that unify and streamline data from multiple operational sources.

The selected candidate will be responsible for building robust data pipelines that ingest, transform, and organize complex datasets into a centralized environment. These datasets include sales, cost-to-serve, customer experience insights, brand metrics, and range-related information. The objective is to eliminate fragmented and inconsistent data by implementing reliable, automated, and high-quality data solutions.

The role also involves developing scalable data models and frameworks that ensure accuracy, consistency, and availability of data across systems. By introducing automated validation mechanisms and performance optimizations, the engineer will enable faster reporting, improved decision-making, and a seamless omnichannel experience.

This position requires active participation throughout the full data engineering lifecycle, from initial concept and architecture design to development, deployment, and operational support. The candidate will collaborate closely with both technical and non-technical stakeholders, acting as a key contributor to building a strong CMP data foundation.

Key Responsibilities:

Architect, develop, and maintain end-to-end data pipelines for batch and streaming data processing

Consolidate and integrate diverse datasets into a unified and scalable data platform

Design efficient data models aligned with lakehouse architecture principles

Implement automated data validation, monitoring, and quality assurance mechanisms

Optimize performance and ensure reliability of data pipelines in production environments

Contribute to solution design, including high-level and low-level architecture and technical specifications

Manage data ingestion, transformation, and serving layers using modern data engineering practices

Work extensively with Databricks (Apache Spark, Delta Lake) for data processing and orchestration

Utilize Microsoft Azure services, including Data Lake Storage, for scalable data solutions

Apply DevOps practices such as version control, CI/CD pipelines, automated testing, and infrastructure as code

Collaborate with stakeholders to translate business requirements into technical data solutions

Support deployment, monitoring, troubleshooting, and continuous improvement of data platforms

Total Years of Experience:

Senior-level experience required

Education:

Bachelor's or Master's degree in Computer Science, Data Engineering, Information Technology, or a related field

Required Skills:

Strong expertise in end-to-end data engineering

Hands-on experience with Databricks, Apache Spark, and Delta Lake

In-depth knowledge of Microsoft Azure data platform services (e.g., Azure Data Lake Storage)

Proficiency in data modeling and lakehouse architecture

Experience in data quality, validation, and reliability engineering

Solid understanding of DevOps practices, including CI/CD and infrastructure as code

Strong problem-solving and analytical capabilities

Effective communication and stakeholder collaboration skills

Languages:

English - Proficient

Job Mode:

Hybrid (25% Remote - Onsite presence required 3 days/week) | Full-time (40 hours per week)

Application Method: Interested candidates can apply by sending their profile to hr@semiconservicenordic.com