RQ07225 - Software Developer - ETL - Senior

ETL Development Expertise

• Understanding of specific approaches used to analyze and develop data integration pipelines including relevant unit testing documentation of artefacts
  
• Ability to develop complex data pipelines including development of scripts using Python and Unix Shell
  
• Understanding of Azure Data Lake Storage (ADLS) and Dedicated Pool (formerly SQL DW) in Azure Synapse
  
• Understanding of database concepts for SQL Server and/or Oracle such as PL/SQLprocedures triggers packages views.
  
• Knowledge of the Technology Stack
  
• Direct experience using the following tools / technologies:
  
• Informatica Intelligent Cloud Services (IICS)
  
• Informatica PowerCenter
  
• Microsoft Azure Synapse: ADLS Gen2 Dedicated Pool
  
• SQL Server and Oracle
  
• Linux command line
  
• Azure DevOps Server or similar ALM tool.
  

ETL/ELT Development Experience with Public Health Information Systems

• Experience in developing ETL/ELT pipelines on public sector health information systems holding Personal Health Information (PHI) is a strong asset.
  
  

Deliverables include designing and development using IICS and Azure Synapse following priorities:

• Development (ETL/ELT processes) priority projects related to COVID19 initiatives.
  
• Development (ETL/ELT processes) priority projects/assets in Analytics Data Hub (ADH) platform enhancements and maintenance support
  

Responsibilities:

• Collaborating with team members (Data Architect Quality Assurance Business Analysts Project and Product managers) to review available documentation and build a common understanding of the target state of the system under design and development.
  
• Analyze the business requirements to design develop and implement highly efficient highly scalable ETL/ELT processes.
  
• Create processes for datamovement within various zones of the Data Lake and Cloud infrastructure as well as existing relational stores.
  
• Work closely with application teams business analysts data designers/architects database administrators and BI (Business Intelligence) reporting teams to ensure the ETL/ELT solution meets business requirements.
  
• Sizing breaking down and estimating development activities in user points or hours depending on the SDLC methodology used (Agile Waterfall).
  
• Lead the creation of best development practices and standards on cloud platform for code maintenance enhancement version upgrades and testing.
  
• Work closely with analysts methodologists and data scientists to develop fitforpurpose data products.
  
• Writing and managing code to develop data products including analytics concepts cohorts and patient identification algorithms.
  
• Prepare maintain and publish documentation including sourcetotarget mappings and businessdriven transformation rules.
  
• Participate and facilitate walkthrough reviews of technical specifications and unit test plans.
  
• Assist with technical investigations and impact analysis; Identify document and perform root cause analysis to prevent Production Issues from reoccurring.
  
• Analyze datarelated systems integration opportunities and challenges
  
• Make recommendations for ETL/ELT design and performance enhancements for large data volume loads and processing.
  
• Collaborating with Quality Assurance DBAs and Release management teams for implementation
  
• Developing and maintaining data management standards and conventions data dictionaries data element naming standards and metadata standards
  
• Provides practical solutions based on industry best practices to a wide range of complex problems.
  
• Provides work estimates for their own development tasks and verifies works estimates of others development tasks on project plans.
  
• Provides updates on tasks via discussions and status reports.
  
• Identifies risks and escalates to project leadership on a timely basis.
  
• Maintain uptodate knowledge of emerging tools including investigation and guidance with new/emerging technologies (POCs) and applying them to data engineering solutions as appropriate.
  
• Responsible for creating detailed technical documentation for end users.
  

Desired Skills:

• Solid understanding of specific approaches used to analyze and develop ELT/ETL processes and artefacts.
  
• Good understanding of designing developing and implementing data solutions in Microsoft Azure Synapse Databricks including storage in Azure Data Lake (Gen 2)
  
• Good understanding of database concepts for SQL Server and/or Oracle such as PL/SQL procedures triggers packages views.
  
• Ability to write complex SQL scripts including joins and aggregations to analyze backend data and verify behavior of ETL processes.
  
• Ability to work in a fastpaced with emphasis on responding to change rather than following the plan.
  
• Good understanding of how User Stories Business Requirements Definition (BRD) Data Models translate to Source to Target Mappings and Design document to support development and downstream processes using SDLC methodology.
  
• Excellent data analysis and problemsolving skills are necessary.
  
• A team player capable of working independently on assigned tasks and ability to meet tight deadlines.
  
• Working understanding of agile methodologies and concepts is a strong asset.
  
• Strong knowledge of PowerShell and Unix/Linux scripting.
  
• Practical knowledge of scripting language (Bash Perl and Python) to develop and orchestrate processes is an asset.
  
• Experience with Azure DevOps Server or similar ALM tool is an asset.
  
• Ability to communicate technical jargons into laymans term.
  
• Strong analytic and problemsolving capability with excellent attention to detail
  
• Demonstrated excellent written and verbal communication skills.
  
  

Requirements

Must Haves:

• Understanding and experience in specific approaches used to analyze and develop ETL/ELT processes using IICS and Microsoft Azure Synapse
  
• Good understanding of database concepts for SQL Server and/or Oracle such as PL/SQL procedures triggers packages views.
  
• Recent direct experience using the following tools / technologies: IICS Microsoft Azure Synapse Informatica PowerCenter and SQL Server
  
• Practical knowledge of at least one scripting language (Bash Perl or Python) is a strong asset
  
• Experience working using IICS and Microsoft Azure on public sector health information systems holding personal health information (PHI) is a strong asset.