Data Engineer

SUMMARY:

The client Fidelity is initiating a migration project to enhance and update their current reporting infrastructure aiming to move away from the existing ecosystem of Oracle Business Intelligence Enterprise Edition (OBIEE) and Oracle Exadata towards a new setup involving Snowflake and Power BI hosted on AWS and Azure platforms respectively. The migration is driven by the need to address various challenges including data quality issues lack of selfservice capabilities and alignment with Enterprise Information (EI) and Workplace Investing (WI) cloud strategies. The transition aims to provide a better reporting experience faster time to market and support the decommissioning of legacy hardware and data warehouses.

Responsibilities: Focus on designing implementing and optimizing data pipelines specifically for AWS. Manage ETL processes and data integration from Snowflake to AWS RDS. Ensure data quality consistency and security throughout the migration process. Collaborate with data modelers to ensure the database structure meets reporting and analysis requirements.

Qualifications: Proficient in data engineering practices with a strong emphasis on AWS services. Experience with Snowflake ETL tools (e.g. Apache Airflow) and data migration projects. Strong programming skills in SQL Python or other relevant languages. Familiarity with data warehousing and database performance tuning.