Data Engineer


Job Location:

Columbia, SC - USA

Yearly Salary: $ 159000 - 160000
Posted on: 2 hours ago
Vacancies: 1 Vacancy

Job Summary

Data Engineer requires:

  • Familiarity with Python with experience in unit and integration testing.
  • Experience supporting cyber or network operations environments
  • Familiarity with Agile development environments
  • Experience with Kubernetes Docker or containerized deployments
  • Exposure to Apache Airflow
  • Strong documentation and communication skills
  • NEEDS SECURITY CLEARANCE
  • At least 9 years experience but 14 years of experience is preferred in data engineering software engineering or related technical fields and a Bachelors in a related field. (Additional experience may be considered in lieu of a degree)
  • Strong experience designing and building ETL pipelines and data ingestion frameworks
  • Hands-on experience with Kafka NiFi and AWS (S3 SQS)
  • Proficiency in Java with experience in unit and integration testing
  • Solid understanding of data formats (JSON XML SQL schemas compressed formats)
  • Experience troubleshooting data pipelines system performance and dataflow issues
  • DoD 8570 IAT II certification (or higher)
Data Engineer requires: Familiarity with Python with experience in unit and integration testing. Experience supporting cyber or network operations environments Familiarity with Agile development environments Experience with Kubernetes Docker or containerized deployments Exposure to Apache Airflow S...