ICT Data Engineer

Komatsu is the 2nd largest worldwide manufacturer of construction, mining  and utility equipment, and also delivers forest machines and logistics. 

Currently there are almost 300 people working at the Komatsu Europe Headquarters and Parts distribution center in Vilvoorde (Belgium): technical experts, sales profiles, logistic and administrative staff, etc. These people come from wide-ranging backgrounds and jobs, and share common characteristics such as perseverance, commitment, analytical skills, efficiency and trustworthiness: the very image of Komatsu machines.

ICT Data Engineer

About the Role

As a Data Engineer within the EAI and BI team, you will be responsible for designing, implementing, testing, and maintaining data pipelines to ensure reliable and secure ingestion and transformation of data from operational systems into the central data warehouse (Snowflake).

The pipelines you develop will safeguard data quality, provide lineage observability, and build trust in the data. You will work in close collaboration with BI/Data Analysts (within ICT and business departments) and Business Data Owners, under the technical guidance of the ICT Data Architect.

Key responsibilities

Design

• Analyse requests from BI/Data Analysts for new data sources to be implemented in Snowflake.
• Identify logical inconsistencies, redundancies, and unclear requirements, ensuring a well-documented and agreed request before implementation starts.
• Design data pipelines that:
  - Comply with the Data Architect’s guidelines and best practices.
  - Meet the Security Officer’s data and information security requirements.
  - Fulfil the data needs of BI/Data Analysts.
• Produce and maintain detailed design documentation.

Solution Design & Implementation

• Collaborate with ICT engineers and external vendors to ensure technical solutions meet business needs.
• Maintain traceability of all requirements throughout the project lifecycle.
• Define non-functional requirements, including security, performance, scalability, and compliance.
• Propose, validate, and integrate solutions within the existing ICT architecture.

Implementation

• Develop pipelines using tools defined by the Data Architect, including but not limited to:
  - Snowflake on Azure (data warehouse platform)
  - Snowpipes for streaming and semi-structured data ingestion
  - Qlik Talend Cloud for data replication from operational databases
  - Azure DevOps with CI/CD pipelines
• Optimize data warehouse performance, including models and queries, to ensure efficiency and cost-effectiveness.
• Make data available for BI/FPA tools (Qlik Sense, Board, Power BI) and as a non-real-time source for other business applications.
• Store code and CI/CD pipelines securely in the Komatsu DevOps repository.

Testing

• Perform unit and integration testing before handing over to BI/Data Analysts for acceptance testing.
• Conduct regression testing for updated pipelines or in response to changes in underlying technologies.
• Provide evidence that developed pipelines meet all requirements and function correctly.
• Evaluate and establish a framework for continuous integration testing of pipelines.

Deployment

• Deploy pipelines into the production environment.
• Develop procedures for automated deployment and/or deployment by the ICT Service & Operations team.

ICT Operations

• Monitor the data platform proactively, implementing alerts and resolving bottlenecks or performance issues.
• Act as second-line support for data-related issues.
• Train ICT Service & Operations staff in first-line troubleshooting of data pipelines.

Your Focus

Education:

• Bachelor’s or Master’s degree in Computer Science, Information Systems, or a related field, or equivalent professional experience.

Experience:

• Minimum of 2 years’ experience in data warehousing, data analytics, and database systems.

Technical Expertise:

• Strong knowledge of the Software Development Lifecycle (SDLC).
• Expertise in SQL, data modelling, ETL/ELT processes, and data warehousing concepts (multi-dimensional modelling, star schema, snowflake schema, denormalisation).
• Knowledge of Python is an asset.
• Experience with Snowflake and at least one of the listed ingestion tools is advantageous.
• Familiarity with cloud data storage solutions (AWS, Azure, Google Cloud).
• Practical experience with BI tools such as Qlik Sense, Power BI, or Tableau.

Practical Skills:

• Complex problem solving, critical thinking, decision-making, coordination and negotiation, statistical and mathematical analysis, logical reasoning.

Attitude:

• Open-minded, constructive, proactive, self-driven, service-oriented, and eager to learn.

Languages:

• Fluent English (spoken and written) is mandatory.
• Mastery of the local language at the place of employment is an asset.

Your Benefits

• Fixed contract with an attractive salary package and performance bonus
• Work / life balance: flexible hours & working from home (3days/week) including allowance
• Legal holidays + 12 compensation days
• Many training opportunities and possibilities to grow within our company

Are you the professional we are looking for?
If so, please send your CV and cover letter to jobs.be@komatsu.eu to the attention of the HR Talent Advisor.

Don’t meet every single requirement? At Komatsu we are dedicated to building a diverse, inclusive and authentic workplace, so if you’re excited about this role but your past experience doesn’t align perfectly with every qualification in the job description, we encourage you to apply anyways. You may be just the right candidate for this or other roles.