Data Engineer – MSSQL to PostgreSQL Migration (AWS RDS)

Jersey, NJ - USA

Monthly Salary: Not Disclosed

Posted on: 7 hours ago

Vacancies: 1 Vacancy

Job Summary

Job Title: Data Engineer MSSQL to PostgreSQL Migration (AWS RDS)

New Jersey Onsite

Contract

Experience: 7 years Overview We are looking for a highly skilled Data Engineer with strong expertise in MSSQL and PostgreSQL to lead the migration of over 20000 stored procedures from legacy MSSQL databases to AWS RDS (PostgreSQL). The ideal candidate will have in-depth experience in analyzing complex stored procedures optimizing SQL logic and ensuring seamless integration Core based microservices that rely on these data operations. This role requires strong hands-on experience with AWS data services database migration tools and the ability to ensure data compatibility for microservices deployed on AWS.

Key Responsibilities

Analyze and understand the existing MSSQL database structure including 20K stored procedures triggers and functions.

Design and implement migration frameworks using AWS Schema Conversion Tool (SCT) and AWS Database Migration Service (DMS).

Translate T-SQL scripts to PL/pgSQL handling data type conversions control flows cursors temporary tables and set-based logic.

Identify redundant or obsolete procedures and optimize SQL logic during the migration.

Work closely with application and microservices teams to ensure the translated procedures maintain business logic integrity and API compatibility.

Perform data validation performance tuning and benchmarking to ensure the new PostgreSQL environment meets or exceeds legacy performance.

Develop monitoring scripts and dashboards for migration progress data validation and post-migration health checks.

Collaborate with DevOps for AWS RDS configuration backup and scaling best practices.

Contribute to infrastructure automation (Terraform / CloudFormation) for data environments on AWS. Technical Skills Required

Database Platforms: o Strong expertise in MSSQL - complex stored procedures views triggers functions and query optimization. o Advanced proficiency in PostgreSQL with experience in PL/pgSQL indexing partitioning and performance tuning. o Hands-on experience with AWS RDS for PostgreSQL (provisioning scaling security and maintenance). AWS Expertise: o Proficiency in AWS RDS S3 Lambda Glue DMS SCT and CloudWatch. o Strong understanding of AWS networking IAM and data security best practices. Migration Tools: AWS Schema Conversion Tool (SCT) AWS Database Migration Service (DMS) pgLoader or similar.

Scripting & Automation: Python Shell or PowerShell for migration automation and data validation.

Cloud & DevOps: Familiarity with AWS services (EC2 S3 CloudWatch Lambda) for data pipelines and automation.

Version Control: Git / Bitbucket for maintaining SQL scripts and migration versions.

Monitoring & Validation: Strong SQL profiling logging and audit trail design. Preferred:

AWS Certified Data Engineer / Database Specialty.

Experience working with microservices-based systems and aligning data with APIs

. Familiarity with data modelling normalization and schema optimization for performance and scalability.

Exposure to ETL pipelines and data transformation workflows. Exposure to containerized or serverless data workflows (ECS Lambda).

Understanding Core applications data access patterns (EF Core Dapper etc.) for alignment with backend teams.

Knowledge of Agile methodologies and CI/CD integration for database deployments. Soft Skills:

Strong analytical ability to refactor complex SQL logic and ensure business logic parity post-migration.

High attention to detail with data integrity and performance focus.

Proactive approach toward identifying performance issues and improving query efficiency

. Excellent documentation and collaboration skills to work across application DevOps and data teams.

Job Title: Data Engineer MSSQL to PostgreSQL Migration (AWS RDS) New Jersey Onsite Contract Experience: 7 years Overview We are looking for a highly skilled Data Engineer with strong expertise in MSSQL and PostgreSQL to lead the migration of over 20000 stored procedures from legacy MSSQL...