Are you passionate about building scalable data pipelines and working with complex datasets NS2 Mission is seeking a skilled Data Engineer to support mission-focused programs in Chantilly VA. In this role you will design and maintain data pipelines collaborate closely with development teams and help deliver reliable data solutions that enable teams to transform data into actionable insights.
Key Responsibilities
- Design build and maintain scalable data pipelines supporting ingestion transformation and delivery of large datasets
- Collaborate with cross-functional teams to integrate data solutions into applications and mission systems
- Develop and optimize SQL queries for data retrieval transformation and analysis
- Build automation and processing scripts using Python or Javadepending on system needs
- Python-focused work supports modernization and migration efforts
- Java-focused work supports maintenance of legacy systems
- Work with relational databases such as PostgreSQL Oracle and MySQL
- Operate within Linux environments including shell scripting
- Analyze and process datasets across formats such as CSV XML JSON Avro and Parquet
- Write and maintain unit tests to ensure data quality and code reliability
- Monitor troubleshoot and improve performance of data pipelines and workflows
Required Qualifications
- 4 years of experience building and maintaining data pipelines
- Strong experience with SQL (must-have)
- Experience working in Linux environments (must-have)
- Experience with Python and/or Java
- Experience working within collaborative development teams
- Experience working with relational databases (PostgreSQL Oracle MySQL)
- Experience processing and analyzing structured and semi-structured data formats
Desired Qualifications
- Experience with Apache NiFi and/or Apache Airflow (at least one preferred)
- Exposure to AWS environments (nice to have; hybrid on-prem/cloud environment)
- Experience with Spark and related ecosystem tools(nice to have):
- Scala
- EMR
- Hive / Iceberg
- Performance tuning and security within Spark environments
- Experience supporting modernization or data migration efforts
- Familiarity with cloud or data security best practices
- Experience with configuration management and CI/CD processes
Technical Environment
Python Java SQL Linux PostgreSQL Oracle MySQL Apache NiFi Apache Airflow AWS (nice to have) Spark Ecosystem (Scala EMR Hive Iceberg) JSON XML CSV Avro Parquet
Position Clearance Requirement:
TS/SCI with an FSP
Please be aware many of our positions require the ability to obtain or maintain a U.S security clearance which requires U.S citizenship
We win with inclusion
NS2 Missions culture of inclusion focus on health and well-being and flexible working models help ensure that everyone regardless of background feels included and can run at their best. At NS2 Mission we believe we are made stronger by the unique capabilities and qualities that each person brings to our company and we invest in our employees to inspire confidence and help everyone realize their full potential. We ultimately believe in unleashing all talent and creating a better world.
NS2 Mission is committed to the values of Equal Employment Opportunity and provides accessibility accommodations to applicants with physical and/or mental disabilities. If you are interested in applying for employment with NS2 Mission and are in need of accommodation or special assistance to navigate our website or to complete your application please send an e-mail with your request to Recruiting Operations Team:.
Qualified applicants will receive consideration for employment without regard to their age race religion national origin ethnicity age gender (including pregnancy childbirth et al) sexual orientation gender identity or expression protected veteran status or disability in compliance with applicable federal state and local legal requirements.
Required Experience:
IC
Are you passionate about building scalable data pipelines and working with complex datasets NS2 Mission is seeking a skilled Data Engineer to support mission-focused programs in Chantilly VA. In this role you will design and maintain data pipelines collaborate closely with development teams and help...
Are you passionate about building scalable data pipelines and working with complex datasets NS2 Mission is seeking a skilled Data Engineer to support mission-focused programs in Chantilly VA. In this role you will design and maintain data pipelines collaborate closely with development teams and help deliver reliable data solutions that enable teams to transform data into actionable insights.
Key Responsibilities
- Design build and maintain scalable data pipelines supporting ingestion transformation and delivery of large datasets
- Collaborate with cross-functional teams to integrate data solutions into applications and mission systems
- Develop and optimize SQL queries for data retrieval transformation and analysis
- Build automation and processing scripts using Python or Javadepending on system needs
- Python-focused work supports modernization and migration efforts
- Java-focused work supports maintenance of legacy systems
- Work with relational databases such as PostgreSQL Oracle and MySQL
- Operate within Linux environments including shell scripting
- Analyze and process datasets across formats such as CSV XML JSON Avro and Parquet
- Write and maintain unit tests to ensure data quality and code reliability
- Monitor troubleshoot and improve performance of data pipelines and workflows
Required Qualifications
- 4 years of experience building and maintaining data pipelines
- Strong experience with SQL (must-have)
- Experience working in Linux environments (must-have)
- Experience with Python and/or Java
- Experience working within collaborative development teams
- Experience working with relational databases (PostgreSQL Oracle MySQL)
- Experience processing and analyzing structured and semi-structured data formats
Desired Qualifications
- Experience with Apache NiFi and/or Apache Airflow (at least one preferred)
- Exposure to AWS environments (nice to have; hybrid on-prem/cloud environment)
- Experience with Spark and related ecosystem tools(nice to have):
- Scala
- EMR
- Hive / Iceberg
- Performance tuning and security within Spark environments
- Experience supporting modernization or data migration efforts
- Familiarity with cloud or data security best practices
- Experience with configuration management and CI/CD processes
Technical Environment
Python Java SQL Linux PostgreSQL Oracle MySQL Apache NiFi Apache Airflow AWS (nice to have) Spark Ecosystem (Scala EMR Hive Iceberg) JSON XML CSV Avro Parquet
Position Clearance Requirement:
TS/SCI with an FSP
Please be aware many of our positions require the ability to obtain or maintain a U.S security clearance which requires U.S citizenship
We win with inclusion
NS2 Missions culture of inclusion focus on health and well-being and flexible working models help ensure that everyone regardless of background feels included and can run at their best. At NS2 Mission we believe we are made stronger by the unique capabilities and qualities that each person brings to our company and we invest in our employees to inspire confidence and help everyone realize their full potential. We ultimately believe in unleashing all talent and creating a better world.
NS2 Mission is committed to the values of Equal Employment Opportunity and provides accessibility accommodations to applicants with physical and/or mental disabilities. If you are interested in applying for employment with NS2 Mission and are in need of accommodation or special assistance to navigate our website or to complete your application please send an e-mail with your request to Recruiting Operations Team:.
Qualified applicants will receive consideration for employment without regard to their age race religion national origin ethnicity age gender (including pregnancy childbirth et al) sexual orientation gender identity or expression protected veteran status or disability in compliance with applicable federal state and local legal requirements.
Required Experience:
IC
View more
View less