Client Name: City of New York
Start Date: December 30 2024
End Date: December 28 2025
Contract Length (in weeks): 52
SCOPE OF SERVICES
Clients Office of Data Analytics (ODA) works with City agencies and their data to help serve New Yorkers more equitably and effectively. This work takes three main forms: analyzing data to improve City agency operations; making Open Data more accessible to all New Yorkers; and advancing citywide data infrastructure integration and sharing.
ODA seeks a Data Engineer role to ensure the efficient and successful implementation and support of complex data engineering solutions for City agencies. This resource should demonstrate a solid understanding of industrystandard implementation methodologies using data engineering technologies tools and processes.
TASKS:
- Create and maintain optimal data pipeline architecture that is coherent and scalable based on best practices of integrating data into a consolidated repository.
- Perform the technical design development and component testing of repository changes.
- Build analytics tools that utilize the data pipeline to provide actionable insights into customer engagement and experience operational efficiency and other key business performance metrics.
- Build the infrastructure required for optimal extraction transformation and loading (ETL) of data from a wide variety of data sources using SQL cloud and big data technologies.
- Develop ETLs to move data securely from source to target systems.
- Create update and maintain system documentation.
- Develop new or build against existing APIs for data access or landing data as output for further downstream consumption in the appropriate target data store.
- Perform special projects and initiatives as assigned.
Requirements
MANDATORY SKILLS/EXPERIENCE
Note: Candidates who do not have the mandatory skills will not be considered
- At least 8 years of experience in writing SQL.
- A minimum of 8 years of experience in copying transferring manipulating and automating data operations that were manual processes.
- Experience with tools and components of data architecture such as Informatica Power Center IICS SSIS or similar ETL tools.
- Experience working with Amazon Web Services or Microsoft Azure cloud computing platform and services.
- Indepth knowledge of SQL and other database solutions.
- Experience with data warehousing (Snowflake Redshift etc..
- Knowledge of modeling database schemas for large datasets.
- Experience developing cloudready applications.
- Experience working with programming languages like Python Java and Perl
DESIRABLE SKILLS/EXPERIENCE:
- Hands on experience developing Microsoft PowerBI solutions.
- 5 years handson experience in development with the suite of tools from Informatica PowerCenter and B2B Data Transformation.
- Experience using Oracle 10g/11g SQL Server and/or a database appliance.
- Knowledge of metadatadriven enterprise reporting platforms.
Required Experience:
Senior IC