Senior Data Engineer IRC302280

Description

You will join the Data Solutions and Products team as part of a Cloud Platform and Data.

The team is now aiming to build and operate a strategic B2B API platform to monetize vehicle and connected car data externally. The platform will support secure data sharing with various external data aggregators and fleet customers and 3rd party partners such as insurance and charging companies directly to monetize the data value as well as enhance the market competitiveness of Geely Auto brands in Europe. You will play a crucial role in not only developing and deploying the latest data products on data platform, but also performing proper verification after the deployment to minimize the risk of system disruptions, data loss, and security vulnerabilities, ensuring business continuity and user satisfaction. Your expertise will guide and assist our stakeholders to access the necessary dataset they need to perform their work in the secure manner. This role demands knowledge of data warehousing and ETL processes, along with good knowledge of AWS platform and data platform Databricks

Requirements

• At least 5 years continuous experience in data engineering area.

• E. B.Sc. or M.Sc. in Computer Science, Engineering, Information Technology or equivalent work experience.

• Strong knowledge and hands on experience of big data technologies such as data lakes, Apache Spark, Flink, Kafka etc.

• Good knowledge of data warehousing concepts and ETL processes, DevOps, CI/CD and software testing.

• Expertise with one of programming languages such as SQL, or Python.

• Have working experience of AWS (Redshift, EMR, S3) and Azure (Data Factory, Power BI service) data analytics services.

• Experience with Data platform tools like Databricks and/or Snowflake.

• Be able to use Power BI for data analytics and visualization.

• Be able to manage data platform with IaC (Infrastructure as Code) will be preferred.

• Experience with connectivity data in automotive industry will be preferred.

• Fluent in English with Chinese skill as a plus

#LI-LY1 #LI-Onsite

Job responsibilities

Responsibilities and Deliveries

• Design, develop and maintain scalable batch and stream data pipelines to ingest data into platform from various sources, use tools to automate and orchestrate data pipelines

• Develop and implement data processing workflows of cleansing, deduplication, and transformation processes to prepare data for data services

• Operate and maintain platform with infrastructure team.

• Perform data platform upgrade test including regression test, security test, functional test.

• Implement checks and measures to ensure the security, accuracy, completeness, and consistency of data

• Set up tools to monitor pipeline performance, data quality, and system health

• Diagnose and resolve issues with data pipelines, storage systems, or integrations

• Collaborate with stakeholders to define data models and ensure the data meets their needs

• Provide technical guidance and data access support to data consumers and addressing technical challenges.

• Document data pipelines, architectures, and workflows to ensure clarity and ease of maintenance

• Design and maintain data models for reporting and analytics in BI tools

• Develop simple dashboard with Power BI

Personal attributes

• Pragmatic, self-driven, and solution-oriented

• Comfortable working in ambiguous and evolving environments

• Curious, flexible, and eager to learn new technologies

• Proactive, self-starting, and able to manage multiple tasks effectively

• Strong sense of ownership and accountability

• Team-oriented with a collaborative mindset

What we offer

Empowering Projects: With 500+ clients spanning diverse industries and domains, we provide an exciting opportunity to contribute to groundbreaking projects that leverage cutting-edge technologies. As a team, we engineer digital products that positively impact people's lives.

Empowering Growth: We foster a culture of continuous learning and professional development. Our dedication is to provide timely and comprehensive assistance for every consultant through our dedicated Learning & Development team, ensuring their continuous growth and success.

DE&I Matters: At GlobalLogic, we deeply value and embrace diversity. We are dedicated to providing equal opportunities for all individuals, fostering an inclusive and empowering work environment.

Career Development: Our corporate culture places a strong emphasis on career development, offering abundant opportunities for growth. Regular interactions with our teams ensure their engagement, motivation, and recognition. We empower our team members to pursue their career goals with confidence and enthusiasm.

Comprehensive Benefits: In addition to equitable compensation, we provide a comprehensive benefits package that prioritizes the overall well-being of our consultants. We genuinely care about their health and strive to create a positive work environment.

Flexible Opportunities: At GlobalLogic, we prioritize work-life balance by offering flexible opportunities tailored to your lifestyle. Explore relocation and rotation options for diverse cultural and professional experiences in different countries with our company.

About GlobalLogic

GlobalLogic, a Hitachi Group Company, is a trusted digital engineering partner to the world's largest and most forward-thinking companies. Since 2000, we've been at the forefront of the digital revolution - helping create some of the most innovative and widely used digital products and experiences. Today we continue to collaborate with clients in transforming businesses and redefining industries through intelligent products, platforms, and services.