Data EngineerIntegration Specialist

Data Engineering at the City is a unique opportunity for meaningful exciting work and professional development using state-of-the art technologies and software development best practices. This is a position on a diverse team of engineers analysts and GIS specialists contributing to developing maintaining and optimizing our data pipelines and integration strategies assisting departments and agencies in innovating and enhancing the Citys service to its residents.

The data engineer/integration specialist will develop an intimate understanding of the Citys diverse data and contribute to improving the Citys data engineering infrastructure pipelines models and integrations. The team uses a blend of open source custom developed and off-the-shelf tools including Python Bash SQL DBT GIS Docker Terraform Apache Airflow Jenkins Postgres PostGIS AWS GitHub MuleSoft as an iPaaS and SAS API provides like ArcGIS Online and CARTO.

Some prominent services the team is responsible for include DataBridge OITs enterprise data warehouse AIS the Citys custom address information systems which supports public address search and internal geocoding and Databridge-Airflow a custom workflow generator and orchestrator for departmental integrations ( and open data publishing ( Some examples of OITs commitment to serving the public through the effective and innovative integration of City open data include:

are looking for a candidate who is not only technically skilled but also passionate about leveraging data to improve City operations and community life. This team is fundamental to the innovation of City services that directly affect residents. If you are eager to contribute to a team that values innovation efficiency service-oriented work and data-driven decision-making we encourage you to apply.

Essential Functions

• Working with business partners of varying technical ability to understand how their data is produced stored and updated designing enhancements to optimize enterprise integrations and public data accessibility.
• Design and develop new and expand and refine existing data pipelines using Apache Airflow custom Python-based software and other tools to connect diverse systems of record centralized databases and SaaS environments improving data platform components data governance master data management data standardization enrichment and quality assurance.
• Play a key role in enterprise integration and open data initiatives developing and supporting critical systems like the Citys DataBridge Databridge-Airflow and AIS.
• Write clear descriptive technical documentation for systems/applications partner with data stewards of various technical levels and communicate technical details to non-technical stakeholders.

Competencies Knowledge Skills and Abilities

Competencies:

• Clear and concise writing and communication skills.
• Creative problem-solving and critical thinking.
• Ability to work with data from diverse domains.
• Efficient time management and the ability to manage multiple workflows simultaneously.
• Ability to seek innovative opportunities and continuous improvement.

Knowledge and Skills:

• Proficient in Python
• Strong SQL skills and experience with databases (Postgres preferred).
• Familiarity with Docker bash and minimal Linux server administration.
• Experience with cloud services (AWS preferred).
• Understanding of Git/GitHub for version control and CI/CD pipelines.
• Experience or ability to learn Airflow DBT Terraform Kubernetes Mulesoft.
• Experience working with spatial datasets a plus.
• Experience using command line interfaces.

Abilities:

• To reason about model and manipulate complex datasets.
• To maintain clean and secure data environments.
• To work effectively in a hybrid (on-premises and cloud) environment.
• To communicate complex technical concepts in understandable terms.

Qualifications :

• Bachelors degree in Computer Science Information Systems or a related field. Equivalent work experience may be considered.
• Demonstrated experience in data engineering or a similar role with a focus on data management/integration/ETL/ELT.
• Proven track record with Python SQL and database management.
• Experience with working with modern data engineering tech stack.
• Familiarity with development of custom ETL/CI/CD tools and the ability to learn and adapt to new technologies.

Previous work in a public sector or large organization setting is a plus.

Additional Information :

Salary Range: $65000 - $80000

Did you know
We are a Public Service Loan Forgiveness Program qualified employer : 25% tuition discount program for City employees (and sometimes spouses and dependents as well) in partnership with area colleges and universities

We offer Comprehensive health coverage for employees and their eligible dependents
Our wellness program offers eligibility into the discounted medical plan
Employees receive paid vacation sick leave and holidays
Generous retirement savings options are available

*The successful candidate must be a city of Philadelphia resident within six months of hire
Please note that effective September 1 2021 the City of Philadelphia is requiring all new employees to
present proof of vaccination against COVID-19.

The City of Philadelphia is an Equal Opportunity employer and does not permit discrimination based on race
ethnicity color sex sexual orientation gender identity religion national origin ancestry age disability marital status source of income familial status genetic information or domestic or sexual violence victim status. If you believe you were discriminated against call the Philadelphia Commission on Human Relations at or send an email to faqpchr @. For more information go to: Human Relations Website:
Work :

No

Employment Type :

Full-time