RQ09207 - Software Developer - Senior

Scope:

• The Justice Technology Services Digital Design Branch requires a technical specialist with analysis / design / development / quality assurance and production operation experience of high sensitive high performance large scale enterprise database (e.g. SQL Server) database performance modelling ongoing administration monitoring and tuning database transformation (ETL) / cleansing / migration (e.g. Oracle to SQL server) as part of building enhancing and sustaining digital products for Criminal Justice Digital Design (CJDD) modernization program. Successful candidate will work on various applications and integration endpoints including Criminal eIntake Digital Information Repository (DIR) and ICON Integration workstreams.
  

Assignment Deliverables:

• As a member of the development team you will be responsible to migrate highsensitive and large volume data from the existing Oracle database to the new Azure SQL Server DataOps / Pipeline and ongoing Database Administration.
  
• A highlevel list of deliverables follows:
  

• Data Analysis: analyze the existing data in the applications understand its structure quality and relationships and help in designing an appropriate migration strategy;
  
• Data Mapping and Transformation: map the data elements from the application to the corresponding entities and fields in Azure SQL Database. Handle necessary data transformations ensuring compatibility and consistency between the legacy data and the target system;
  
• Data Extraction: help extract the required data from the application develop and implement extraction processes to retrieve data from various sources such as databases files APIs or other relevant systems;
  
• Data Cleansing and Validation: cleanse and validate the extracted data to ensure its accuracy completeness and consistency. Help with identifying and resolving data quality issues performing deduplication and applying business rules to ensure the integrity of the migrated data;
  
• Data Migration Strategy and : review the present migration strategy that outlines the overall approach sequence and timeline for migrating the data from Oracle database to Azure SQL Database using a deltaload approach; execute the migration plan efficiently managing data transfers and ensuring minimal disruption to ongoing operations;
  
• Data Testing and Quality Assurance: conduct thorough testing to verify the accuracy and integrity of the migrated data; define test cases perform data reconciliation and address any issues or discrepancies that arise during the testing phase; develop KPIs to report on the progress completeness and quality of the data migration effort;
  
• Documentation: document the entire data migration process including data mapping rules transformation logic migration scripts and any specific configurations;
  
• Ongoing Support: provide postmigration support analyze and address datarelated issues or questions; help optimize data management processes in the new environment ongoing Database Administration
  
• Implement ongoing Database Administration procedures process and guidebook
  
• Implement relevant DataOps / pipeline
  
• Other duties as assigned;
  

Requirements

Experience and Skill Set Requirements:

Must Haves:

• 5 year experience working with RDBMS Azure SQL Server Database Administration security management for highsensitive database database performance management query performance analysis & tuning database quality practice good understanding of Azure storage concepts and technologies.
  
• 5 years of working experience in an ETL role; strong understanding of ETL principles including data extraction transformation and loading processes; knowledge of common ETL design patterns. Understanding of data pipeline architectures Azure workflow orchestration tools and concepts related to data ingestion transformation and movement.
  
• Proficiency in Azure Data Factory SSMA Database Migration Services including knowledge of pipeline creation data flows integration runtimes triggers and monitoring.
  
• Proficiency in scripting languages relational data models data manipulation languages (TSQL PL/SQL) data definition languages physical database design and experience with Azurespecific scripting using PowerShell or Azure CLI.
  
• Experience with continuous integration/continuous deployment (CI/CD) processes around DevOps data workflows Synapse workspaces.
  

Nice to Have Requirements:

• Azure cloud certifications (e.g. Azure fundamentals Azure Data Engineer associate Azure Database Administrator associate)
  
• Proficiency in Oracle database administration
  

Desired Skills and Experience:

• Experience in integrating various data sources and systems both onpremises and in the cloud using Azure ETL services or other ETL tools (e.g. Azure ADF SSMA).
  
• Expertise in data transformation techniques such as data cleansing aggregation enrichment and normalization using Azure cloud technologies.
  
• Understanding of data quality management practices including data profiling data validation and error handling within ETL processes.
  
• Understanding of data governance principles data privacy regulations and experience working with highsensitivity data and knowledge of best practices for data security and compliance in Azure.
  
• Ability to monitor and troubleshoot ETL processes optimize query performance and implement efficient data processing techniques in Azure.
  
• Familiarity with version control systems (e.g. Azure Repos) and collaboration tools (e.g. Azure DevOps) for managing code tracking changes and collaborating with team members.
  
• Experience with SQL Server Management Studio Azure data management tools XRM toolbox data modeling tools (e.g. PowerDesigner ERWIN).
  

Data Migration ETL:

• Demonstrated experience with ETL development data pipelines workflow orchestration and data ingestion transformation and movement
  
• Demonstrated experience in integrating various data sources and systems both onpremises and in the cloud using Azure ETL services or other ETL tools (e.g. ADF SSMA etc)
  
• Demonstrated experience working with Azure Data Factory including knowledge of pipeline creation data flows integration runtimes triggers and monitoring.
  
• Demonstrated experience with data manipulation languages (TSQL PL/SQL) data definition languages query performance analysis & tuning
  
• Demonstrated experience with SQL Server Oracle Azure SQL Databases
  
• Demonstrated experience with data modeling tools (e.g. PowerDesigner ERWIN)
  
• Demonstrated experience in scripting languages like Python and with Azurespecific scripting using PowerShell or Azure CLI.
  
• Experience with software development lifecycle
  
• Experience with data modeling physical database design data flow diagrams
  

Database Tuning and Administration:

• Demonstrated experience finetuning Azure SQL database for security cost performance availability and reliability.
  
• Demonstrated experience setting up monitors and alerts on critical database metrics to ensure high availability.
  
• Demonstrated experience to automate operations.
  
• Experience with supporting a large database in a production environment.
  

Azure Platform and Security:

• Experience with Azure Data Factory (ADF) and Database Migration services and tools.
  
• Demonstrated experience Azure data management tools DevOps
  
• Experience in Azure resource configuration and administration such as Azure SQL Database Blob Storage Key Vault Application Insight resources resource groups and subscriptions.
  
• Familiar with Azure cloud platform
  
• Familiar with database security concepts and practices
  
• (Nice to have) Azure cloud certifications
  

DevOps and CI/CD:

• Demonstrated experience with continuous integration/continuous deployment (CI/CD) tools and processes around DevOps data workflows Synapse workspaces.