Title: ETL Developer Consultant
Duration: 18 Months
Client: New York City Department of City Planning
Location: 120 Broadway 30th Floor New York NY 10271
Note: Onsite role.
PROJECT SCOPE:
DCP seeks an experienced consultant that can:
- Extract geographic and non-geographic data from Oracle and SQL Server databases ensuring the integrity and quality of the data.
- Transform raw data into structured formats suitable for analysis reporting and system integration.
- Design and implement data pipelines for efficient handling of large datasets.
- Automate ETL integrations using SQL Server Integration Services (SSIS).
- Perform data analysis to drive key business objectives.
- Document ETL processes data models and API specifications for transparency and knowledge sharing.
- Develop test and maintain ETL workflows and scripts to automate data processing.
- Monitor ETL processes to ensure reliability scalability and performance.
- Perform data modeling and database design for application development and product implementation initiatives under the guidance of Database Administrator and Architect.
- Create reporting solutions using SQL Server Reporting Services (SSRS) by analyzing user needs and information availability.
- Troubleshoot and resolve data-related issues promptly.
- Create APIs to enable data access and integration with various applications and systems.
- Ensure APIs are secure performant and adhere to industry standards.
- Collaborate with developers and analysts to design API endpoints that meet business requirements.
- Work with GIS analysts developers and stakeholders to understand data requirements.
- Participate in requirements definition analysis and design.
- Work closely with business analysts subject matter experts and development teams in design
- development testing implementation and support of application projects.
- Facilitate creation migration and maintenance of database objects across development/ QA/ production environments.
- Follow best practices in data modeling including use of standard naming conventions processes and templates to ensure consistency of data models.
- Monitor and optimize database performance and capacity utilization to provide high availability and redundancy.
- Take ownership of database performance scalability and security.
- Define and implement data testing strategies with business stakeholders application development teams and QA groups.
- Participate in the software testing process including identification and resolution of defects.
- Contribute to and support roll-out strategies.
- Participate in and contribute to formal/informal technical reviews and presentations.
- Accurately estimate time required to complete development tasks.
- Demonstrate the ability to cooperate with a variety of people and achieve results.
- Mentor and guide development team members on database-related tasks.
- Provide technical support and knowledge transition to team members and end users as needed.
- Communicate effectively with team members stakeholders and project managers to gather requirements provide updates and manage expectations.
- Create and maintain technical documentation including system designs workflows and user guides.
- Ensure solutions comply with industry best practices standards and security protocols.
- Prepare documentation and conduct knowledge transition to support adoption across the organization and other city agencies.
- Stay current with industry trends and emerging technologies to propose innovative solutions and improve development processes.
REQUIRED QUALIFICATIONS SKILLS AND EXPERIENCE
Note: candidates who do not have the required skills will not be considered.
- Bachelors degree in Computer Science Software Engineering Information Systems Geographic Information Systems (GIS) or a related field. Masters degree is a plus.
- Minimum of 4 years as ETL Developer Data Engineer or similar role with a focus on geographic data.
- Proficiency in T-SQL and PL/SQL with experience working with Microsoft SQL Server Oracle and PostgreSQL databases.
- Familiarity with SSRS SSAS SSIS and data warehousing concepts like ETL Dimensions Facts Cubes.
- Demonstrated knowledge of designing developing and integrating databases data warehouses and multidimensional databases in MS-SQL Server.
- Knowledge of data integration patterns database design and data modeling principles.
- Strong programming skills in Python C# or other relevant languages for ETL and API development.
- Experience with API frameworks (e.g. Flask FastAPI or Django REST Framework).
- Experience with geographic data formats (e.g. shapefiles GeoJSON) and geospatial tools (e.g. ArcGIS QGIS).
- Experience with cloud platforms (e.g. AWS Azure GCP) and related data services.
- Familiarity with ETL tools like Talend Apache Nifi or Informatica.
- Ability to write and optimize complex SQL queries stored procedures triggers and functions.
- Experience in code migration database change management and data management through the
- various stages of the development life cycle.
- Familiarity with application lifecycle management (ALM) tools such as Azure DevOps and GitHub.
- Experience with version control and release management practices.
- Excellent problem-solving collaboration and communication skills.
- Experience with MS-SQL Server PostgreSQL Oracle and/or other geospatial databases.
- Ability to collaborate effectively within a team environment.
- Strong knowledge of software architecture principles design patterns and best practices.
- Familiarity with DevOps practices and tools for continuous integration and delivery.
- Familiarity with application lifecycle management (ALM) tools such as Azure DevOps and GitHub extensions.
- Experience with version control using Git and GitHub and release management practices.
- Excellent problem-solving skills and ability to work effectively in a collaborative team environment.
- Strong communication skills both written and verbal.
- ETL certifications on Microsoft SQL Server or Oracle will be a plus.
- Demonstrated experience working with technical and non-technical staff.
"If you are: bright motivated skilled a difference-maker able to get things done work with minimum direction enthusiastic a thinker able to juggle and multi-task communicate effectively and lead then we would like to hear from you. We need exceptionally capable people for this role for our client so get back to us and tell us why you think you are a fit."
About Us:
Required Skills:
Minimum of 4 years as ETL Developer Data Engineer or similar role with a focus on geographic data. Proficiency in T-SQL and PL/SQL with experience working with Microsoft SQL Server Oracle and PostgreSQL databases. Familiarity with SSRS SSAS SSIS and data warehousing concepts like ETL Dimensions Facts Cubes. Demonstrated knowledge of designing developing and integrating databases data warehouses and multidimensional databases in MS-SQL Server. Knowledge of data integration patterns database design and data modeling principles. Strong programming skills in Python C# or other relevant languages for ETL and API development. Experience with API frameworks (e.g. Flask FastAPI or Django REST Framework). Experience with geographic data formats (e.g. shapefiles GeoJSON) and geospatial tools (e.g. ArcGIS QGIS). Experience with cloud platforms (e.g. AWS Azure GCP) and related data services. Familiarity with ETL tools like Talend Apache Nifi or Informatica. Ability to write and optimize complex SQL queries stored procedures triggers and functions. Experience in code migration database change management and data management through the various stages of the development life cycle. Familiarity with application lifecycle management (ALM) tools such as Azure DevOps and GitHub. Experience with version control and release management practices. Excellent problem-solving collaboration and communication skills. Experience with MS-SQL Server PostgreSQL Oracle and/or other geospatial databases. Ability to collaborate effectively within a team environment. Strong knowledge of software architecture principles design patterns and best practices. Familiarity with DevOps practices and tools for continuous integration and delivery. Familiarity with application lifecycle management (ALM) tools such as Azure DevOps and GitHub extensions. Experience with version control using Git and GitHub and release management practices. Excellent problem-solving skills and ability to work effectively in a collaborative team environment. Strong communication skills both written and verbal. ETL certifications on Microsoft SQL Server or Oracle will be a plus.
Required Education:
Bachelors degree in Computer Science Software Engineering Information Systems Geographic Information Systems (GIS) or a related field. Masters degree is a plus.
Title: ETL Developer ConsultantDuration: 18 MonthsClient: New York City Department of City PlanningLocation: 120 Broadway 30th Floor New York NY 10271Note: Onsite role.PROJECT SCOPE:DCP seeks an experienced consultant that can:Extract geographic and non-geographic data from Oracle and SQL Server dat...
Title: ETL Developer Consultant
Duration: 18 Months
Client: New York City Department of City Planning
Location: 120 Broadway 30th Floor New York NY 10271
Note: Onsite role.
PROJECT SCOPE:
DCP seeks an experienced consultant that can:
- Extract geographic and non-geographic data from Oracle and SQL Server databases ensuring the integrity and quality of the data.
- Transform raw data into structured formats suitable for analysis reporting and system integration.
- Design and implement data pipelines for efficient handling of large datasets.
- Automate ETL integrations using SQL Server Integration Services (SSIS).
- Perform data analysis to drive key business objectives.
- Document ETL processes data models and API specifications for transparency and knowledge sharing.
- Develop test and maintain ETL workflows and scripts to automate data processing.
- Monitor ETL processes to ensure reliability scalability and performance.
- Perform data modeling and database design for application development and product implementation initiatives under the guidance of Database Administrator and Architect.
- Create reporting solutions using SQL Server Reporting Services (SSRS) by analyzing user needs and information availability.
- Troubleshoot and resolve data-related issues promptly.
- Create APIs to enable data access and integration with various applications and systems.
- Ensure APIs are secure performant and adhere to industry standards.
- Collaborate with developers and analysts to design API endpoints that meet business requirements.
- Work with GIS analysts developers and stakeholders to understand data requirements.
- Participate in requirements definition analysis and design.
- Work closely with business analysts subject matter experts and development teams in design
- development testing implementation and support of application projects.
- Facilitate creation migration and maintenance of database objects across development/ QA/ production environments.
- Follow best practices in data modeling including use of standard naming conventions processes and templates to ensure consistency of data models.
- Monitor and optimize database performance and capacity utilization to provide high availability and redundancy.
- Take ownership of database performance scalability and security.
- Define and implement data testing strategies with business stakeholders application development teams and QA groups.
- Participate in the software testing process including identification and resolution of defects.
- Contribute to and support roll-out strategies.
- Participate in and contribute to formal/informal technical reviews and presentations.
- Accurately estimate time required to complete development tasks.
- Demonstrate the ability to cooperate with a variety of people and achieve results.
- Mentor and guide development team members on database-related tasks.
- Provide technical support and knowledge transition to team members and end users as needed.
- Communicate effectively with team members stakeholders and project managers to gather requirements provide updates and manage expectations.
- Create and maintain technical documentation including system designs workflows and user guides.
- Ensure solutions comply with industry best practices standards and security protocols.
- Prepare documentation and conduct knowledge transition to support adoption across the organization and other city agencies.
- Stay current with industry trends and emerging technologies to propose innovative solutions and improve development processes.
REQUIRED QUALIFICATIONS SKILLS AND EXPERIENCE
Note: candidates who do not have the required skills will not be considered.
- Bachelors degree in Computer Science Software Engineering Information Systems Geographic Information Systems (GIS) or a related field. Masters degree is a plus.
- Minimum of 4 years as ETL Developer Data Engineer or similar role with a focus on geographic data.
- Proficiency in T-SQL and PL/SQL with experience working with Microsoft SQL Server Oracle and PostgreSQL databases.
- Familiarity with SSRS SSAS SSIS and data warehousing concepts like ETL Dimensions Facts Cubes.
- Demonstrated knowledge of designing developing and integrating databases data warehouses and multidimensional databases in MS-SQL Server.
- Knowledge of data integration patterns database design and data modeling principles.
- Strong programming skills in Python C# or other relevant languages for ETL and API development.
- Experience with API frameworks (e.g. Flask FastAPI or Django REST Framework).
- Experience with geographic data formats (e.g. shapefiles GeoJSON) and geospatial tools (e.g. ArcGIS QGIS).
- Experience with cloud platforms (e.g. AWS Azure GCP) and related data services.
- Familiarity with ETL tools like Talend Apache Nifi or Informatica.
- Ability to write and optimize complex SQL queries stored procedures triggers and functions.
- Experience in code migration database change management and data management through the
- various stages of the development life cycle.
- Familiarity with application lifecycle management (ALM) tools such as Azure DevOps and GitHub.
- Experience with version control and release management practices.
- Excellent problem-solving collaboration and communication skills.
- Experience with MS-SQL Server PostgreSQL Oracle and/or other geospatial databases.
- Ability to collaborate effectively within a team environment.
- Strong knowledge of software architecture principles design patterns and best practices.
- Familiarity with DevOps practices and tools for continuous integration and delivery.
- Familiarity with application lifecycle management (ALM) tools such as Azure DevOps and GitHub extensions.
- Experience with version control using Git and GitHub and release management practices.
- Excellent problem-solving skills and ability to work effectively in a collaborative team environment.
- Strong communication skills both written and verbal.
- ETL certifications on Microsoft SQL Server or Oracle will be a plus.
- Demonstrated experience working with technical and non-technical staff.
"If you are: bright motivated skilled a difference-maker able to get things done work with minimum direction enthusiastic a thinker able to juggle and multi-task communicate effectively and lead then we would like to hear from you. We need exceptionally capable people for this role for our client so get back to us and tell us why you think you are a fit."
About Us:
Required Skills:
Minimum of 4 years as ETL Developer Data Engineer or similar role with a focus on geographic data. Proficiency in T-SQL and PL/SQL with experience working with Microsoft SQL Server Oracle and PostgreSQL databases. Familiarity with SSRS SSAS SSIS and data warehousing concepts like ETL Dimensions Facts Cubes. Demonstrated knowledge of designing developing and integrating databases data warehouses and multidimensional databases in MS-SQL Server. Knowledge of data integration patterns database design and data modeling principles. Strong programming skills in Python C# or other relevant languages for ETL and API development. Experience with API frameworks (e.g. Flask FastAPI or Django REST Framework). Experience with geographic data formats (e.g. shapefiles GeoJSON) and geospatial tools (e.g. ArcGIS QGIS). Experience with cloud platforms (e.g. AWS Azure GCP) and related data services. Familiarity with ETL tools like Talend Apache Nifi or Informatica. Ability to write and optimize complex SQL queries stored procedures triggers and functions. Experience in code migration database change management and data management through the various stages of the development life cycle. Familiarity with application lifecycle management (ALM) tools such as Azure DevOps and GitHub. Experience with version control and release management practices. Excellent problem-solving collaboration and communication skills. Experience with MS-SQL Server PostgreSQL Oracle and/or other geospatial databases. Ability to collaborate effectively within a team environment. Strong knowledge of software architecture principles design patterns and best practices. Familiarity with DevOps practices and tools for continuous integration and delivery. Familiarity with application lifecycle management (ALM) tools such as Azure DevOps and GitHub extensions. Experience with version control using Git and GitHub and release management practices. Excellent problem-solving skills and ability to work effectively in a collaborative team environment. Strong communication skills both written and verbal. ETL certifications on Microsoft SQL Server or Oracle will be a plus.
Required Education:
Bachelors degree in Computer Science Software Engineering Information Systems Geographic Information Systems (GIS) or a related field. Masters degree is a plus.
View more
View less