Data Engineer

LLNL

Not Interested
Bookmark
Report This Job

profile Job Location:

Livermore, CA - USA

profile Monthly Salary: Not Disclosed
Posted on: 6 hours ago
Vacancies: 1 Vacancy

Job Summary

We have an opening for a Data Engineer to architect and modernize the data lifecycle for Strategic Deterrence (SD). In this role you will move beyond legacy tooling to build robust automated data pipelines that capture characterize and democratize critical test data. By championing DataOps principles and modern software practices you will enable seamless data sharing and real-time decision-making within LLNL and across the NNSA complex. This position is in the Applications Simulations and Quality (ASQ) Division within the Computing Directorate supporting the SD Applications Data Lifecycle Management (DLM) Team.

This position will be filled at the SES.1 or SES.2 level based on knowledge and related experience as assessed by the hiring team. Additional job responsibilities (outlined below) will be assigned if hired at the higher level.

In this role you will

  • Design and implement data pipelines using both scripting and modern orchestration tools to process unstructured test data from diverse sources.
  • Champion DataOps and Software Engineering best practices by implementing version control (Git) CI/CD workflows containerization and automated testing to ensure software and pipeline reliability and reproducibility.
  • Develop interactive dashboards to democratize data access for scientists and engineers working with subject matter experts (SMEs) to define programmatic data needs.
  • Translate scientific requirements into technical specifications for APIs pipelines and visualization tools acting as a bridge between SMEs and the software team.
  • Collaborate with customers to define schemas/ontologies for their data utilizing tools for data quality validation to ensure standardized characterization of experiments.
  • Perform other duties as assigned.

Additional job responsibilities at the SES.2 Level

  • Exercise independent discretion and judgement to define develop and implement original solutions to complex data management across a broad set of disciplines at the team directorate and institutional level. 
  • Provide formal/informal technical leadership and/or domain expertise in researching advising and recommending technical solutions and approaches.

Qualifications :

  • Ability to obtain and maintain a US DOE Q-level security clearance which requires U.S. Citizenship.
  • Bachelors degree in a Computer Engineering or Mathematics related field or equivalent combination of technical training and extensive experience.
  • Experience with Python including modern development practices visualization libraries (Plotly Streamlit) and the scientific stack (pandas numpy).
  • Experience with modern version control (Git) CI/CD platforms and containers.
  • Experience handling structured and unstructured data formats (JSON YAML Parquet XML) and utilizing RESTful APIs.
  • Experience working with scientific or manufacturing data and developing business requirements with customers.
  • Proficient verbal and written communication skills necessary to present technical architectures to non-technical stakeholders and advocate for modern tooling.

Additional Qualifications at the SES.2 Level

  • Comprehensive experience with Python. 
  • Broad experience collaborating with management customers or high-level technical personnel to provide direction in the design evaluation recommendation and implementation of systems services or processes.
  • Broad experience independently analyzing and interpreting complex data/business processes requiring advanced knowledge of materials management manufacturing data management and/or scientific experimentation.

Qualifications We Desire 

  • Knowledge and experience with LLNL process and procedures.
  • Comfortable being an advocate for a new technical product.
  • Knowledge of SD/NNSA data domains and use cases.
  • Experience with workflow orchestration tools (e.g. Airflow Prefect Dagster).
  • Knowledge of S3-compatible object storage and Data Lake architectures.

Additional Information :

All your information will be kept confidential according to EEO guidelines.

Position Information

This is a Career Indefinite position open to Lab employees and external candidates.

Why Lawrence Livermore National Laboratory

We have an opening for a Data Engineer to architect and modernize the data lifecycle for Strategic Deterrence (SD). In this role you will move beyond legacy tooling to build robust automated data pipelines that capture characterize and democratize critical test data. By championing DataOps principle...
View more view more

Key Skills

  • Apache Hive
  • S3
  • Hadoop
  • Redshift
  • Spark
  • AWS
  • Apache Pig
  • NoSQL
  • Big Data
  • Data Warehouse
  • Kafka
  • Scala

About Company

Join us and make YOUR mark on the World!Are you interested in joining some of the brightest talent in the world to strengthen the United States’ security? Come join Lawrence Livermore National Laboratory (LLNL) where our employees apply their expertise to create solutions for BIG idea ... View more

View Profile View Profile