The Data Engineer Senior is responsible for designing developing architecting and enhancing data platforms and pipelines ensuring robust data models and system integrations for enterprise operations. The incumbent will oversee advanced data warehouse maintenance drive strategic data initiatives and perform comprehensive analysis while actively contributing to Agile team activities. This position will proactively collaborate with the Data Engineering Team IT staff other enterprise stakeholders and agency employees.
In addition to the above the Data Engineer will have expertise in DevOps principle and experience in CI/CD Azure services Kubernetes and scripting skills (SQL Python PowerShell) along with testing automation. Terraform knowledge and Azure certifications are preferred.
WHAT WILL YOU DO
Data Engineering
Develop and manage data platforms.
Design and maintain ETL processes and perform advanced data lake management.
Oversee and manage the implementation of CI/CD pipelines utilizing advanced DevOps practices.
Create and maintain advanced data models to ensure structured data storage and accessibility.
Enhance data catalogs to maintain an organized and easily accessible repository of data resources.
Enhance the efficiency of data warehouses and oversee complex warehousing.
Optimize system performance and manage complex systems improving ease of management and reliability of systems.
Maintain complex data permissions ensuring proper access control and data security.
Improve the maintenance and optimization of data warehouses ensuring data integrity and availability.
Develop datadriven applications contributing to the creation of data solutions that support business needs.
Conduct advanced data analysis and lead larger data analysis projects providing insights and support to business stakeholders.
Lead scrum activities ensuring team adherence to Agile practices.
Automate reports using reporting tools and provide support for more advanced reporting tasks as required.
Partner with stakeholders to align data strategies with business goals.
Develop visually appealing and intuitive dashboards that provide visibility into key performance risk and control indicators across agency divisions and departments.
Performs related work as assigned.
WHAT WILL YOU BRING
Required Education
Bachelors degree from an accredited college or university in computer information systems computer science data management information systems information science mathematics or a closely related field.
High School diploma or equivalent and additional fulltime experience in data pipeline builds and implementation may be substituted on an equivalent yearforyear basis.
Required Experience
Five (5) years of fulltime directly related progressively responsible experience in data pipeline builds and implementation; utilizing ETL tools for creating ETL scripts; Power BI or equivalent modern data visualization package or related experience.
Experience may be concurrent.
A masters degree or doctoral degree in a closely related field may be substituted on an equivalent yearforyear basis.
Required Registration Certification or Licensure
None.
Preferred Qualifications
Advanced experience with data architecture and modeling.
Advanced experience with Microsoft Fabric Databricks Snowflake Spark SQL Python and cloud platforms.
Advanced experience with data encryption (REST SOAP XML JSON) and web services (SSL SSH SFTP Certificates).
Knowledge Skills and Abilities
Knowledge of:
Strong knowledge of business intelligence tools databases SQL and objectoriented programming languages to support data analysis and predictive analytics.
Database modeling and data warehousing principles.
System development life cycle concepts.
Advanced knowledge of data platforms assist in platform management.
Advanced knowledge of ETL concepts assist in building pipelines.
Advanced knowledge of data architecture and modeling.
Advanced knowledge of Microsoft Fabric Databricks Snowflake Spark and cloud platforms.
Advanced knowledge of data encryption (REST SOAP XML JSON) and web services (SSL SSH SFTP Certificates).
Advanced proficiency in Python and SQL.
Skills in:
Experience using technical and statistical analysis skills to deliver clear concise and visually appealing management metrics and reports to inform decision making and actions.
Writing report queries including an understanding of relational databases.
Business process analysis and problem solving.
Completing detailed work with a high degree of accuracy.
Planning organizing and prioritizing work assignments to manage a highvolume workload in a fastpaced and changing environment.
Using a computer in a Windows environment with Microsoft Office word processing spreadsheet and other business software.
Effective written and verbal communications including explaining complex information to others in an understandable manner and writing clear and precise policies procedures and training or other materials.
Working in a team environment and influence a diverse group of stakeholders.
Ability to:
Operate effectively in a fastpaced environment with competing and shifting priorities.
Continually learn new concepts and tools to support job needs and strive for ongoing professional development.
Establish and maintain harmonious working relationships with coworkers agency staff and external contacts.
Work effectively in a professional team environment.
Participate in Scrum activities advanced understanding of Agile.
Military Occupational Specialty (MOS) Codes:
Veterans Reservists or Guardsmen with experience in the Military Occupational Specialty ( ) along with the minimum qualifications listed above may meet the minimum requirements and are highly encouraged to apply. Please contact Talent Acquisition at with questions or for additional information.
To view all job vacancies visit or more information visit.