Senior Software Engineer - Data Platform
Senior Software Engineer - Data Platform
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Job Description
Career Area:
EngineeringJob Description:
Your Work Shapes the World at Caterpillar Inc.
When you join Caterpillar yourejoining a global team who cares not just about the work we do but also about each other. We are the makers problem solvers and future world builders who are creating stronger more sustainable communities. We dontjust talk about progress and innovation here we make it happen with our customers where we work and live. Together we are building a better world so we can all enjoy living in it.
Caterpillar products generate and process large amounts of data from sensors on-board models and control algorithms in real-time creating real-world machine usage information.
As part of the overall digital strategy Caterpillar has developed an integrated family of machine-based information technology products that interconnect machines to provide real time guidance tracking monitoring and supervisory control of the operational mining fleet. This family of products is branded MineStar.
The MineStar product range links with other mining and business information systems and is an integral part of the Mining Technology Enabled Solutions vision.
About the position:
Were seeking an experiencedSenior Engineer to join a specialist team focused on building a scalable data platform which ingests high-frequency telemetry data from mobile field machines and supportsdata science and machine learning workloads.
Youll be instrumental in transforming a legacy Java Spring Boot monolith into acontainerized scalable cloud-ready architecture while enablingstream and batch data processinglakehouse persistence andlow-latency predictive model hosting.
Responsibilities:
Design and implement robust scalable components for ingesting processing and persisting high-frequency telemetry data.
Collaborate with data scientists to host orchestrate and optimize workloads in Python Scala and Java.
Design and build components using technologies likeApache SparkDelta LakeRedis/ValkeyMQTT andPostgreSQL.
Drive modernization efforts including:
Containerization and deployment onKubernetes
Integration withS3-compatible object stores(e.g. Ceph)
Evaluate and integrate emerging technologies (e.g.FlinkTrinoKafkaDuckDBDaskDaft) to optimize performance and scalability.
Use your experience to contribute to architectural decisions involvingevent sourcingCQRS and hybrid cloud deployments.
Ideal Candidate Profile
Extensive experiencein backend development withlanguages such as Java Scala and Python.
Proven track record working in teams to develop large complex applications.
Deep understanding ofstreaming and batch data processing ideally withApache Sparkor similar.
Experience withcontainerization (Docker)andorchestration (Kubernetes).
Familiarity withdata lake/lakehouse architectures especiallyDelta Lake.
Strong knowledge ofmessage brokers(MQTT Kafka) andcaching systems(Redis/Valkey).
Comfortable working acrossmultiple languages(Java Python Scala).
Experience in designing systems forscalabilitymulti-tenancy andhybrid deployments.
Prior experience in Data Engineering roles and expertise in machine learning algorithms and statistical modelling will be highly regarded
Mining Industry knowledge will be desirable however not mandatory
Why Join Us
Work on a technically challenging and meaningful application in the mining domain.
Be part of a forward-thinking team driving innovation in data-centric systems.
Influence architectural direction and technology choices.
Collaborate with experts in autonomy data science and distributed systems.
Compensation & Benefits:
Competitive salary based on degree and professional industry working experience. The Total Rewards package includes:
Competitive remuneration package
Attractive Bonus and Share options
Career development with global prospects
A strong commitment to safety and your wellbeing
An inclusive workplace culture focused on quality customer service and the environment
A commitment to diversity and inclusion equal opportunity and equal outcome
SMART spending APP
The opportunity to do truly meaningful work in a supportive constructive culture that encourages you to make the most of your talents.
Additional Information:
Caterpillar of Australia is not currently hiring individuals for this position who now or in future require sponsorship for employment-based non-immigrant and immigrant visas. However as a global company Caterpillar offers many job opportunities outside of Australia which can be found through our employment website position is not offering hybrid working arrangements the successful candidate must be available to work 5 days from the office.
Your road to success begins with a Caterpillar career. By joining the Caterpillar team youll discover that working for a global leader creates endless opportunities for you.
Posting Dates:
August 21 2025 - September 11 2025Caterpillar is an Equal Opportunity Employer. Qualified applicants of any age are encouraged to apply
Not ready to apply Join our Talent Community.
Required Experience:
Senior IC
Employment Type
Full-Time
