We are looking for a talented and driven Platform Engineer to join our dynamic team focusing on building and maintaining our data platform. Reporting to the Manager of Platform Engineering you will play a key role in designing developing and optimizing the infrastructure and tools that power our datadriven products and services. This position offers the opportunity to work on challenging projects collaborate with crossfunctional teams and contribute to the success of our data initiatives.
Responsibilities:
1. **Data Engineering:**
Develop test and maintain processes to integrate and manage data from various sources.
Work closely with data scientists analysts and other stakeholders to understand data requirements and ensure data quality and integrity.
Implement data governance best practices including data lineage metadata management and versioning.
2. **Platform Development and Maintenance:**
Design implement and maintain scalable and reliable data platforms and systems.
Collaborate with the development team to build and deploy new features ensuring they meet performance and reliability standards.
Monitor and optimize the performance security and availability of data platforms addressing issues proactively.
3. **Automation and Tooling:**
Create and maintain automation scripts and tools to streamline data processing and platform management tasks.
Implement continuous integration and continuous delivery (CI/CD) pipelines to ensure smooth and efficient deployments.
Contribute to the development of internal tools and frameworks that enhance productivity and standardize operations.
4. **Continuous Improvement:**
Stay current with industry trends emerging technologies and best practices in data engineering and platform management.
Identify opportunities to improve existing systems processes and tools driving continuous improvement initiatives.
Contribute to the documentation of systems processes and best practices to ensure knowledge sharing across the team.
**Requirements:**
Bachelors degree in Computer Science Engineering or a related field.
Proven experience as a platform engineer data engineer or similar role with a strong focus on data infrastructure and automation.
Proficiency in programming languages such as Python with experience in scripting and automation.
Handson experience with data technologies and cloud platforms (e.g. AWS EdgeX TimescaleDB).
Strong understanding of data pipelines and data governance principles.
Familiarity with CI/CD pipelines and version control systems (e.g. Git).
Excellent problemsolving skills with the ability to troubleshoot complex technical issues.
Strong communication and collaboration skills with a focus on teamwork and knowledge sharing.
**Preferred Qualifications:**
Experience with containerization technologies (e.g. Docker Kubernetes).
Knowledge of big data technologies (e.g. Hadoop Spark) and their integration into data platforms.