Urgent requirement of Data Migration Architect - Contract - Sydney
Requirements
- Seeking a highly experienced Data Migration Architect to lead the end-to-end migration of enterprise data workloads from Greenplum to Databricks.
- The ideal candidate will have deep expertise in legacy data warehouse systems modern cloud data platforms and data migration strategies.
- This role involves architecture design planning execution and optimization of scalable data pipelines and transformation logic.
Key Responsibilities:
- Design and implement a robust data migration strategy from Greenplum to Databricks.
- Assess existing Greenplum schemas workloads and performance characteristics.
- Define target architecture in Databricks including Lakehouse design Delta tables and optimized storage formats.
- Develop scalable ETL/ELT pipelines using PySpark SQL and Databricks workflows.
- Ensure data integrity consistency and performance during migration.
- Collaborate with data engineers analysts and business stakeholders to validate migrated data.
- Implement monitoring logging and rollback mechanisms for migration processes.
- Document migration processes architecture decisions and operational runbooks.
- Lead large scale data migration with complex workflows & varied data types complexity for migration.
Required Skills and Qualifications:
- 10 years of experience in data engineering or data architecture roles.
- Proven experience with Greenplum (PostgreSQL-based MPP systems) to Databricks experience 2 or more projects.
- Strong hands-on experience with Databricks Apache Spark and Delta Lake.
- Proficiency in SQL Python and PySpark.
- Experience with AWS cloud platform.
- Familiarity with data governance security and compliance in cloud environments.
- Excellent problem-solving and communication skills.
- Certifications in Databricks or cloud platforms (Azure/AWS/GCP) is preferable
- Experience with orchestration tools like Airflow is preferred
Duration: 06 Months and possible extension
Eligibility: Australian/NZ Citizens/PR Holders only
Must have SAP Basis. S4 Hana experience Upgrade experience Any SAP Certification is an added advantage Able to join 2 weeks Duration: Permanent / 06 Months and possible extension Eligibility: Australian/NZ Citizens/PR Holders only Email: