Data Engineer

About Us:

NYSTEC is a nonprofit technology consulting company advising agencies organizations institutions and businesses since 1996. Were independent and vendor-neutral so we have our clients best interests at heart. At NYSTEC we know that we succeed when individuals and teams flourish personally and professionally so our benefits and perks support that mindset.

About the Role:

The Data Engineer designs develops and maintains NYSTECs enterprise data platform and data integration solutions. This role builds scalable secure and high-performing data pipelines data warehouses lakehouses and related data solutions that support reporting analytics artificial intelligence initiatives and data-driven decision-making. The position works closely with the Business Intelligence team internal technology teams and business stakeholders to integrate data from multiple systems improve data quality and governance and support the continued maturity of NYSTECs enterprise data platform.

Key Responsibilities

Design develop and maintain scalable enterprise data pipelines that support the organizations data integration analytics and business intelligence initiatives.
Design implement and support enterprise data architecture including data warehouses lakehouses and other analytical data repositories.
Develop and maintain robust ETL (Extract Transform Load)andELT (Extract Load Transform) processes to ingest transform validate and deliver data from multiple internal and external business systems.
Design and implement logical and physical data models that promote consistency scalability and long-term maintainability.
Develop test deploy and maintain data engineering solutions that leverage SQL Python and PySpark to support enterprise data processing and automation.
Integrate data from enterprise applications APIs relational databases flat files and third-party systems while ensuring data integrity and reliability.
Implement and maintain enterprise data governance standards including data quality metadata management lineage security and access controls.
Monitor troubleshoot and optimize enterprise data pipelines databases and platform performance to ensure reliability scalability and operational efficiency.
Collaborate with business stakeholders application owners and technical teams to translate business requirements into scalable data solutions.
Develop and maintain technical documentation including solution architecture operational procedures and development standards.
Evaluate emerging technologies and recommend improvements that enhance the organizations enterprise data platform data engineering practices and overall data maturity.
Partner with Business Intelligence team members to ensure enterprise data assets effectively support reporting advanced analytics artificial intelligence and self-service data initiatives.
Participate in platform planning architecture reviews and continuous improvement efforts to ensure the enterprise data platform remains secure scalable and aligned with organizational objectives.

About you:

Required Qualifications

Experience developing enterprise data solutions using Microsoft Fabric. Candidates with
equivalent experience using Microsoft Azure Data Factory Azure Data Lake Storage Azure SQL SQL Server Integration Services (SSIS) SQL Server or related Microsoft data services in cloud or on-premises environments will also be considered.
Advanced SQL development skills including query optimization database design and
performance tuning.
Strong proficiency in Python and/or PySpark for data engineering automation and data
transformation.
Experience designing and developing ETL/ELT solutions and enterprise data integration
processes.
Experience designing and supporting relational databases data warehouses lakehouses and enterprise analytical data models.
Experience integrating data from enterprise applications APIs relational databases flat files and cloud services.
Strong understanding of enterprise data architecture data modeling data governance metadata management and security best practices.
Experience implementing source control testing deployment and operational support practices for enterprise data solutions.
Excellent analytical troubleshooting organizational and communication skills.

Preferred/Desired Qualifications

• Experience supporting enterprise Business Intelligence analytics and AI initiatives through modern data engineering practices.
• Experience implementing data governance security and performance optimization within Microsoft enterprise data platforms.
• Microsoft Certified: Fabric Analytics Engineer Associate (DP-600) Azure Data Engineer Associate (DP-203) or similar Microsoft certification preferred.

Education and Experience

• A bachelors degree in computer science information systems data engineering information technology or a related discipline and five years of related experience designing developing and supporting enterprise platforms.
• An equivalent combination of advanced education training and experience will be considered.

The target base salary for this position is $97172.00 to $126323.00 per year. When determining compensation we analyze and carefully consider several factors including skill set experience location and job-related qualifications

It is NYSTECs policy to provide equal employment opportunity (EEO) to all individuals regardless of actual or perceived race color creed religion sex or gender (including pregnancy childbirth and related medical conditions) gender identity or gender expression (including transgender status) age national origin ancestry citizenship status physical or mental disability protected medical condition as defined by applicable state or local law genetic information military service and veteran status sexual orientation marital status or any other characteristic protected by local state or federal laws and ordinances. NYSTEC is strongly committed to this policy and believes in the concept and spirit of the law.

Federal law requires employers to provide reasonable accommodation to qualified individuals with disabilities. Please contact if you require a reasonable accommodation to apply for or to perform this job. Examples of reasonable accommodation include making a change to the application process or work procedures providing documents in an alternate format using a sign language interpreter or using specialized equipment.

Applicants must be authorized to work in the United States without the need for visa sponsorship now or in the future.

Required Experience:

IC