Position Overview:
We are seeking a skilled and motivated Data Engineer / Database Engineer to support our growing team providing an enterprise data warehouse and visualization environment. The ideal candidate will have hands-on experience with Microsoft SQL Server ETL pipelines and cloud-based data ingestion toolsespecially AWS Glue. You will be responsible for maintaining and enhancing our database systems enabling near real-time data pipelines from source databases (Oracle SQL etc) to Microsoft SQL Server and ensuring secure efficient and scalable data access.
Key Responsibilities:
- Support and maintain Microsoft SQL Server environments with flexibility to adapt to alternative database platforms as the architecture evolves.
- Design and implement data pipelines using AWS Glue for efficient and scalable data ingestion.
- Build and maintain a near real-time data ingestion framework from Oracle databases to Microsoft SQL Server.
- Develop and manage ETL processes including incremental/delta-based extraction of raw data from source systems.
- Build and optimize relational database schemas ensuring performance scalability and data integrity.
- Implement and manage fine-grained roles and permissions in SQL Server to enforce data security and access control policies.
- Work closely with Data Analysts Software Engineers and other stakeholders to ensure data systems meet business requirements.
- Monitor and troubleshoot data pipelines and workflows to ensure reliability and consistency.
Qualifications:
- Proven experience with Microsoft SQL Server administration and development.
- Proficiency in ETL/ELT concepts and experience with tools like AWS Glue Apache Spark or equivalent.
- Solid understanding of Oracle database systems and data extraction methodologies (especially delta/change data capture techniques).
- Experience with cloud data platforms particularly AWS (S3 Glue RDS etc.).
- Strong SQL skills and experience with role-based access control in database systems.
- Familiarity with scripting or programming languages (e.g. Python Shell) for automation and data processing.
- Ability to work independently and communicate effectively in a collaborative team environment.
Preferred Skills (Not Required):
- Proficiency with Oracle GoldenGate or equivalent CDC (Change Data Capture) tools for real-time replication.
- Experience with modern data architectures (e.g. Data Vault 2.0).
- Knowledge of CI/CD practices for data engineering.
- Exposure to data cataloging and metadata management tools.
Required Experience:
Manager
Position Overview:We are seeking a skilled and motivated Data Engineer / Database Engineer to support our growing team providing an enterprise data warehouse and visualization environment. The ideal candidate will have hands-on experience with Microsoft SQL Server ETL pipelines and cloud-based data ...
Position Overview:
We are seeking a skilled and motivated Data Engineer / Database Engineer to support our growing team providing an enterprise data warehouse and visualization environment. The ideal candidate will have hands-on experience with Microsoft SQL Server ETL pipelines and cloud-based data ingestion toolsespecially AWS Glue. You will be responsible for maintaining and enhancing our database systems enabling near real-time data pipelines from source databases (Oracle SQL etc) to Microsoft SQL Server and ensuring secure efficient and scalable data access.
Key Responsibilities:
- Support and maintain Microsoft SQL Server environments with flexibility to adapt to alternative database platforms as the architecture evolves.
- Design and implement data pipelines using AWS Glue for efficient and scalable data ingestion.
- Build and maintain a near real-time data ingestion framework from Oracle databases to Microsoft SQL Server.
- Develop and manage ETL processes including incremental/delta-based extraction of raw data from source systems.
- Build and optimize relational database schemas ensuring performance scalability and data integrity.
- Implement and manage fine-grained roles and permissions in SQL Server to enforce data security and access control policies.
- Work closely with Data Analysts Software Engineers and other stakeholders to ensure data systems meet business requirements.
- Monitor and troubleshoot data pipelines and workflows to ensure reliability and consistency.
Qualifications:
- Proven experience with Microsoft SQL Server administration and development.
- Proficiency in ETL/ELT concepts and experience with tools like AWS Glue Apache Spark or equivalent.
- Solid understanding of Oracle database systems and data extraction methodologies (especially delta/change data capture techniques).
- Experience with cloud data platforms particularly AWS (S3 Glue RDS etc.).
- Strong SQL skills and experience with role-based access control in database systems.
- Familiarity with scripting or programming languages (e.g. Python Shell) for automation and data processing.
- Ability to work independently and communicate effectively in a collaborative team environment.
Preferred Skills (Not Required):
- Proficiency with Oracle GoldenGate or equivalent CDC (Change Data Capture) tools for real-time replication.
- Experience with modern data architectures (e.g. Data Vault 2.0).
- Knowledge of CI/CD practices for data engineering.
- Exposure to data cataloging and metadata management tools.
Required Experience:
Manager
View more
View less