PL- VDOT SR Cloud ETL Developer
Share
Job Location:
Richmond, VA - USA
Monthly Salary:
Not Disclosed
Posted on:
30+ days ago
Vacancies:
1 Vacancy
Job Summary
VDOT Data Analyst / SR Cloud ETL Developer.
*Local Richmond VA candidates ONLY required due to onsite requirement
**This position requires onsite 3 days a week with 2 remote
**Contractor will be responsible for purchasing parking through VDOTs Parking Management Office or procuring their own parking
Questions
*Local Richmond VA candidates ONLY required due to onsite requirement
**This position requires onsite 3 days a week with 2 remote
**Contractor will be responsible for purchasing parking through VDOTs Parking Management Office or procuring their own parking
JOB DESCRIPTION: SR ETL Developer
The Virginia Department of Transportation (VDOT) Information Technology Division is seeking a senior ETL developer to ingest/transform and load Data Assets and implement a cloud-based data management platform that will support the agency.
ETL developer to extract business data and load it into a data warehousing environment. Design program and test the performance of the system. Consult with various teams to understand the agencys data storage needs and develop data warehousing options. Deep knowledge of coding languages such as Azure Data Factory Databricks python XML and SQL. Well-versed in warehousing architecture techniques such as MOLAP ROLAP ODS DM and EDW.
Responsibilities:
Designs and develops integrations for the Enterprise Data Asset program ETL processes and business intelligence.
Develop data engineering processes that leverage a cloud architecture and will extend or migrate our existing data pipelines to this architecture as needed.
Design and supports the DW database and table schemas for new and existent data sources for the data hub and warehouse. Design and development of Data Marts.
Work closely with data analysts data scientists and other data consumers within the business in an attempt to gather and populate data hub and data warehouse table structure which is optimized for reporting.
The Data developers partners with Data modeler and Data architect in an attempt to refine the businesss data requirements which must be met for building and maintaining Data Assets.
Understanding of Agile methodologies and processes
Preferred Skills:
Advanced understanding of data integrations.
Strong knowledge of database architectures
Strong analytical and problem solving skills
Ability to build strong relationships both internally and externally
Ability to negotiate and resolve conflicts
Ability to effectively prioritize and handle multiple tasks and projects
Strong written and verbal communication skills
Desire to learn innovate and evolve technology
Computer Skills/Ms Office/Software:
Excellent computer skills and be highly proficient in the use of Ms Word PowerPoint Ms Excel MS Project MS Visio and MS Team Foundation Server which will all be necessary in the creation of visually and verbally engaging ETL data designs and tables as well as the communication of documentation and reporting.
Deep passion for data analytics technologies as well as analytical and dimensional modeling. The candidate must be extensively familiar with ETL (Extraction Transformation & Load) data warehousing and business intelligence tools such as business objectsPowerBI and Tableau.
The candidate must also have vast knowledge of database design and modeling in the context of data warehousing.
Experience with key data warehousing architectures including Kimball and Inmon and has a broad experience designing solutions using a broad set of data stores (e.g. HDFS Azure Data Lake Store Azure Blob Storage Azure SQL Data Warehouse Databricks
Technologies Required:
Data Factory v2Data Lake Store Data Lake Analytics Azure Analysis Services Azure Synapse Snowflake
IBM Datastage Erwin SQL Server (SSIS SSRS SSAS) ORACLE T-SQL Azure SQL Database Azure SQL Datawarehouse.
Operating System Environments (Windows Unix etc.).
Scripting experience with Windows and/or Python Linux Shell scripting
Required/Desired Skills The Virginia Department of Transportation (VDOT) Information Technology Division is seeking a senior ETL developer to ingest/transform and load Data Assets and implement a cloud-based data management platform that will support the agency.
ETL developer to extract business data and load it into a data warehousing environment. Design program and test the performance of the system. Consult with various teams to understand the agencys data storage needs and develop data warehousing options. Deep knowledge of coding languages such as Azure Data Factory Databricks python XML and SQL. Well-versed in warehousing architecture techniques such as MOLAP ROLAP ODS DM and EDW.
Responsibilities:
Designs and develops integrations for the Enterprise Data Asset program ETL processes and business intelligence.
Develop data engineering processes that leverage a cloud architecture and will extend or migrate our existing data pipelines to this architecture as needed.
Design and supports the DW database and table schemas for new and existent data sources for the data hub and warehouse. Design and development of Data Marts.
Work closely with data analysts data scientists and other data consumers within the business in an attempt to gather and populate data hub and data warehouse table structure which is optimized for reporting.
The Data developers partners with Data modeler and Data architect in an attempt to refine the businesss data requirements which must be met for building and maintaining Data Assets.
Understanding of Agile methodologies and processes
Preferred Skills:
Advanced understanding of data integrations.
Strong knowledge of database architectures
Strong analytical and problem solving skills
Ability to build strong relationships both internally and externally
Ability to negotiate and resolve conflicts
Ability to effectively prioritize and handle multiple tasks and projects
Strong written and verbal communication skills
Desire to learn innovate and evolve technology
Computer Skills/Ms Office/Software:
Excellent computer skills and be highly proficient in the use of Ms Word PowerPoint Ms Excel MS Project MS Visio and MS Team Foundation Server which will all be necessary in the creation of visually and verbally engaging ETL data designs and tables as well as the communication of documentation and reporting.
Deep passion for data analytics technologies as well as analytical and dimensional modeling. The candidate must be extensively familiar with ETL (Extraction Transformation & Load) data warehousing and business intelligence tools such as business objectsPowerBI and Tableau.
The candidate must also have vast knowledge of database design and modeling in the context of data warehousing.
Experience with key data warehousing architectures including Kimball and Inmon and has a broad experience designing solutions using a broad set of data stores (e.g. HDFS Azure Data Lake Store Azure Blob Storage Azure SQL Data Warehouse Databricks
Technologies Required:
Data Factory v2Data Lake Store Data Lake Analytics Azure Analysis Services Azure Synapse Snowflake
IBM Datastage Erwin SQL Server (SSIS SSRS SSAS) ORACLE T-SQL Azure SQL Database Azure SQL Datawarehouse.
Operating System Environments (Windows Unix etc.).
Scripting experience with Windows and/or Python Linux Shell scripting
| Skill | Required /Desired | Amount of Exp in yrs | Consultant Experience | Consultant Last Used |
|---|---|---|---|---|
| Designs and develops systems for the maintenance of the Data Asset Program ETL processes and business intelligence. | Required | 10 | ||
| Design and supports the DW database and table schemas for new and existent data sources for the data hub and warehouse. Design and development of Data | Required | 10 | ||
| Work closely with data analysts data scientists and other data consumers within the business in an attempt to gather and populate data hub and data | Required | 10 | ||
| Advanced understanding of data integrations. Strong knowledge of database architectures strong understanding of ingesting spatial data | Required | 10 | ||
| Ability to negotiate and resolve conflicts Ability to effectively prioritize and handle multiple tasks and projects | Required | 10 | ||
| Excellent computer skills and be highly proficient in the use of Ms Word PowerPoint Ms Excel MS Project MS Visio and MS Team Foundation Server | Required | 10 | ||
| Experience with key data warehousing architectures including Kimball and Inmon and has a broad experience designing solutions using a broad set of da | Required | 10 | ||
| expertise in Data Factory v2Data Lake Store Data Lake Analytics Azure Analysis Services Azure Synapse | Required | 10 | ||
| IBM Datastage Erwin SQL Server (SSIS SSRS SSAS) ORACLE T-SQL Azure SQL Database Azure SQL Datawarehouse. | Required | 10 | ||
| Operating System Environments (Windows Unix etc.). Scripting experience with Windows and/or Python Linux Shell scripting | Required | 10 | ||
| Experience in AZURE Cloud engineering | Required | 10 | ||
| Experience with Snowflake | Desired | 5 |
| No. | Question | Consultant Answer |
|---|---|---|
| Question1 | Commonwealth of Virginia security policies prohibit the use of offshore IT contractors. Do you attest to the fact that your candidate will physically reside within the US for the duration of the assignment | |
| Question2 | Please list candidates email address. | |
| Question3 | In what city and state does your candidate PERMANENTLY reside | |
| Question4 | Is the candidate available to work in Richmond VA at least 3 days/wk This is REQUIRED. | |
| Question5 | How soon after an offer can your candidate start |
Key Skills
- SQL
- Pentaho
- PL/SQL
- Microsoft SQL Server
- SSIS
- Informatica
- Shell Scripting
- T Sql
- Teradata
- Data Modeling
- Data Warehouse
- Oracle
