Data Engineer - Contract - Canberra

Requirements

• Collaborate with team members and stakeholders to design data integration solutions that meet business requirements utilising Microsoft Azure tools such as Azure Data Factory and SQL.
  
• Develop implement and maintain ETL pipelines to ensure efficient and secure data transfer between various systems adhering to best practices for data processing and transformation.
  
• Design and maintain data models ensuring data accuracy consistency and availability while considering scalability and performance optimisations.
  
• Implement data validation and quality checks to identify and rectify data anomalies errors and inconsistencies within integrated systems.
  
• Continuously monitor and optimise data integration processes to enhance performance reduce latency and minimise resource consumption.
  
• Create and maintain comprehensive documentation for data integration solutions including technical specifications data flow diagrams and operational procedures.
  
• Work closely with crossfunctional teams including developers and system analysts to understand data requirements and ensure integrations align with business objectives.
  
• Troubleshoot and resolve data integration issues working collaboratively with the team to implement effective solutions and prevent recurrence.
  
• Stay updated on emerging technologies and industry trends related to data engineering and integration applying this knowledge to improve integration processes and tools.