Career Area:

Job Description:

Your Work Shapes the World at Caterpillar Inc.

When you join Caterpillar yourejoining a global team who cares not just about the work we do but also about each other. We are the makers problem solvers and future world builders who are creating stronger more sustainable communities. We dontjust talk about progress and innovation here we make it happen with our customers where we work and live. Together we are building a better world so we can all enjoy living in it.

Job Description: Sr. Data Engineer

Overview

We are seeking a highly motivated and detail-oriented Junior Data Engineer to join our dynamic team. The ideal candidate will have a good foundation in data engineering principles a keen analytical mindset and the ability to work collaboratively in a fast-paced environment. As a Junior Data Engineer you will play a critical role in designing developing and maintaining data pipelines and infrastructure to support our organizations data needs.

Key Responsibilities

Data Pipeline Development

• Design develop and maintain scalable and reliable data pipelines to ingest process and store large volumes of data from various sources.
• Implement data workflows using ETL (Extract Transform Load) processes to ensure data quality and integrity.

Data Integration and Management

• Collaborate with data architects product owners business analysts and other stakeholders to understand data requirements and deliver data solutions that meet their needs.
• Integrate data from multiple sources including databases APIs and external data providers into a unified data platform.
• Manage and optimize data storage solutions ensuring efficient data retrieval and processing.

Data Quality and Governance

• Implement data quality checks and validation processes to ensure the accuracy and consistency of data.
• Adhere to data governance policies and best practices to maintain data security and compliance.

Performance Optimization

• Monitor and optimize data pipeline performance to ensure timely and efficient data processing.
• Identify and resolve performance bottlenecks and system issues to maintain data pipeline reliability.

Documentation and Collaboration

• Document data engineering processes workflows and solutions for future reference and knowledge sharing.
• Collaborate with cross-functional teams to support data-driven decision-making and project initiatives.

Qualifications

Education and Experience

• Bachelors degree in computer science Information Technology Data Science or a related field.
• 5-8 years of experience in data engineering data analysis or software development.

Technical Skills

• Strong experience on advanced SQL any Database. (Oracle Teradata snowflake).
• Experience in data integration area and hands on experience in any of the ETL tools like Datastage Informatica Snaplogic etc.
• Able to transform technical requirements into data collection query.
• Should be capable of working with business and other IT teams and convert the requirements into queries.
• Good understanding of ETL architecture and design.
• Good knowledge in Databases SQL or PL/SQL
• Good experience with CI/CD tools such as Github Actions (AzDO pipelines)
• Good to have knowledge on Unix commands
• Good to have an experience on AWS Glue
• Good to have knowledge on Qlik replication tool

Soft Skills

• Good analytical and problem-solving skills with attention to detail.
• Excellent communication and interpersonal skills to collaborate effectively with cross-functional teams.
• Ability to manage multiple tasks and prioritize workload in a fast-paced environment.
• Eagerness to learn new technologies and stay updated with industry trends.

Posting Dates:

Caterpillar is an Equal Opportunity Employer. Qualified applicants of any age are encouraged to apply

Not ready to apply Join our Talent Community.