Data Migration Platform Engineer

Job description

Job Description

Job Title: Data Migration Engineer

Summary

The Data Migration Engineer is responsible for designing implementing and supporting data replication migration and integration solutions across cloud and on-prem environments. This role ensures secure reliable and high-performance data movement between heterogeneous systems leveraging modern ETL tools lakehouse technologies and DevOps practices. The role carries platform and administration responsibilities for the Snowflake environment and the AWS data platform services that support it and requires 24x7 operational support for mission-critical data pipelines.

Key Responsibilities Data replication and migration

• Design and implement data replication and migration solutions across multiple platforms (AWS DocumentDB PostgreSQL DB2 Snowflake).
• Develop and maintain ETL workflows using AWS services (DMS Glue) and other integration tools.
• Ensure data integrity latency and SLA compliance for replication and migration processes.
• Plan and execute migrations off legacy on-prem estates into AWS including validation reconciliation cutover and rollback planning.
• Provide 24x7 support for data replication platforms including incident management and root cause analysis.
• Monitor and optimize replication performance ensuring scalability and cost efficiency.

Platform and DevOps engineering

• Build and operate data platform services on AWS including AWS Glue (ETL jobs crawlers Data Catalog) AWS Lambda S3 Step Functions and EventBridge.
• Develop and maintain lakehouse ingestion patterns using Apache Hudi (upserts incremental processing compaction clustering schema evolution) with awareness of comparable open table formats (Iceberg Delta Lake).
• Implement DevOps practices for automation CI/CD pipelines and infrastructure-as-code (Terraform CloudFormation) including automated testing and promotion between environments.
• Deploy and support Windows and Linux compute in AWS (EC2 clustering networking IAM) in support of replication and migration workloads.
• Implement observability across the platform: logging metrics alerting and dashboarding (CloudWatch Prometheus Grafana).

Snowflake administration

• Administer the Snowflake platform as day-to-day operational owner: account database schema and warehouse management.
• Design and manage role-based access control (RBAC) including role hierarchies and integration with enterprise identity (SSO/SCIM).
• Manage warehouse sizing auto-suspend/auto-resume resource monitors and query optimization to control cost and performance.
• Operate ingestion into Snowflake via bulk loading (COPY INTO) Snowpipe tasks streams and S3-based staging alongside third-party replication tooling.
• Implement platform governance: data masking row access policies tagging time travel/retention configuration and usage monitoring.
• Establish and maintain runbooks standards and documentation for Snowflake administration and support knowledge transfer across the team.

Security governance and collaboration

• Maintain compliance with security standards including encryption in transit and at rest IAM roles and policies and vulnerability management.
• Collaborate with architecture and security teams to validate designs and ensure adherence to governance policies.
• Partner with business units and vendors (including vendor engineering/professional services teams) to deliver strategic data integration solutions.

Skills & Qualifications Core Expertise

• Minimum 3 years in data replication migration and integration engineering.
• Hands-on experience with AWS Data Migration Service (DMS) AWS Glue AWS Lambda and S3-based staging for Snowflake.
• Practical experience with Apache Hudi or a comparable open table format (Iceberg Delta Lake) in a production environment.
• Strong knowledge of Snowflake architecture and administration: RBAC warehouse and cost management bulk loading (COPY INTO) and Snowpipe.
• Proficiency in PostgreSQL DB2 and other relational databases.
• Experience migrating or re-platforming legacy Windows Server workloads into cloud environments.

Programming & Automation

• Scripting skills in Python and Shell; PySpark experience advantageous.
• Hands-on experience with Terraform or similar IaC tools.
• Familiarity with CI/CD pipelines and DevOps tools (Jenkins Git Docker).

Security & Compliance

• Understanding of TLS/SSL encryption standards IAM policies and vulnerability management.

Additional Skills

• Experience with ETL/replication tools (Qlik Replicate Matillion Fivetran) is a plus.
• Knowledge of monitoring and alerting tools (CloudWatch Prometheus Grafana).
• Experience supporting the handover or transition of platform services between teams.

Certifications (Preferred)

• AWS Certified Solutions Architect Data Engineer Associate or Data Analytics Specialty.
• Snowflake SnowPro Core or Administrator Certification.
• DevOps-related certifications.

Other Requirements

• Ability to work in a 24x7 operational support model.
• Strong problem-solving and communication skills.
• Experience in Agile environments and ITSM tools (ServiceNow).

Qualifications

• Appropriate degree level or equivalent qualification.
• AWS experience.
• Snowflake administration.
• Database technology experience.

Qualifications :

Qualifications

• Snowflake Administration Experience (Min 3 years)
• Cloud Patform Experience ( AWS Min 3 years)

Additional Information :

Our uniqueness is that we celebrate yours. Experians people first inclusive and purpose driven culture is multi award-winning; Worlds Best Workplaces 2025 (Fortune Global Top 25) Great Place To Work in 26 countries to name a few. Check out Experian Life on social or explore our Careers Site to understand why. Experian is also proud to be an Equal Opportunity and Affirmative Action employer. If you have a disability or special need that requires accommodation please let us know at the earliest opportunity.

Recruitment Fraud Awareness - Experians recruitment process is conducted only through authorised channels. Recruitment communications will only be sent from an @ email address. 
Experian will never ask candidates to make any payment as part of an application interview assessment onboarding or recruitment process. To apply for roles or verify opportunities please visit Careers - Creating a better tomorrow together

Find out what its like to work for Experian by clicking here

Remote Work :

No

Employment Type :

Full-time