drjobs Senior Data Engineer

Senior Data Engineer

Employer Active

1 Vacancy
drjobs

Job Alert

You will be updated with latest job alerts via email
Valid email field required
Send jobs
Send me jobs like this
drjobs

Job Alert

You will be updated with latest job alerts via email

Valid email field required
Send jobs
Job Location drjobs

Herndon, VA - USA

Monthly Salary drjobs

Not Disclosed

drjobs

Salary Not Disclosed

Vacancy

1 Vacancy

Job Description

Are you ready to turn complex data into powerful mission insight Were seeking a SeniorData Engineer at NS2 Mission with a passion for innovation and impact to join our team inHerndon andChantilly VA. In this role youll design and develop cuttingedge data pipelines tools and services that fuel national security and intelligence efforts. From structured logs to unstructured sensor feeds youll work across the data spectrumenabling realtime analytics and supporting highstakes decisionmaking.

This isnt just another data rolethis is your chance to engineer solutions that truly matter.

Key Responsibilities:

  • Design develop and optimize scalable data pipelines using technologies such as Apache Spark Apache Iceberg Trino OpenSearch AWS EMR NiFi and Kubernetes containers.
  • Ingest and move structured and unstructured data using approved methods into enterprise or local storage systems.
  • Create robust ETL processes and perform ongoing operations and maintenance (O&M) enhancements and documentation aligned with best practices and coding standards.
  • Develop tools and scripts to extract data from various repositories perform required transformations and format the data into reusable data models for exploration and analysis.
  • Collaborate with data scientists and mission stakeholders to analyze source data formats and design appropriate transformations that meet analytical goals.
  • Ensure endtoend data quality lineage and security while maintaining metadata to track data provenance and access controls.
  • Clean and preprocess data to prepare it for use in advanced analytics machine learning models and decision support systems.
  • Work with enterprise data governance and working groups to enhance and align with organizational data standards and practices.
  • Collaborate with software engineers to update configure and maintain integrated data services based on evolving requirements.
  • Contribute to the development of documentation for each project including ETL mappings user guides code access instructions and operational procedures.

Required Skills and Experience:

  • Proficiency in building and maintaining ETL pipelines using modern data engineering tools and frameworks.
  • Strong experience working with cloudbased and containerized environments (e.g. AWS Kubernetes).
  • Deep understanding of working with diverse data types and formats including structured semistructured and unstructured data.
  • Familiarity with data ingestion tools and platforms such as Apache NiFi Spark and related opensource technologies.
  • Demonstrated ability to collaborate across teams including data scientists software engineers data stewards and mission partners.
  • Knowledge of data governance principles metadata management and data quality best practices.
  • Experience with implementing data privacy and access controls to ensure secure data usage.

Position Clearance Requirement:

TS/SCI with an FSP

We win with inclusion

NS2 Missions culture of inclusion focus on health and wellbeing and flexible working models help ensure that everyone regardless of background feels included and can run at their best. At NS2 Mission we believe we are made stronger by the unique capabilities and qualities that each person brings to our company and we invest in our employees to inspire confidence and help everyone realize their full potential. We ultimately believe in unleashing all talent and creating a better world.

NS2 Mission is committed to the values of Equal Employment Opportunity and provides accessibility accommodations to applicants with physical and/or mental disabilities. If you are interested in applying for employment with NS2 Mission and are in need of accommodation or special assistance to navigate our website or to complete your application please send an email with your request to Recruiting Operations Team: .

Qualified applicants will receive consideration for employment without regard to their age race religion national origin ethnicity age gender (including pregnancy childbirth et al) sexual orientation gender identity or expression protected veteran status or disability in compliance with applicable federal state and local legal requirements.


Required Experience:

Senior IC

Employment Type

Full-Time

About Company

Report This Job
Disclaimer: Drjobpro.com is only a platform that connects job seekers and employers. Applicants are advised to conduct their own independent research into the credentials of the prospective employer.We always make certain that our clients do not endorse any request for money payments, thus we advise against sharing any personal or bank-related information with any third party. If you suspect fraud or malpractice, please contact us via contact us page.