Data Engineer
Job Location:
Columbia, SC - USA
Yearly Salary:
$ 159000 - 160000
Posted on:
2 hours ago
Vacancies:
1 Vacancy
Job Summary
Data Engineer requires:
- Familiarity with Python with experience in unit and integration testing.
- Experience supporting cyber or network operations environments
- Familiarity with Agile development environments
- Experience with Kubernetes Docker or containerized deployments
- Exposure to Apache Airflow
- Strong documentation and communication skills
- NEEDS SECURITY CLEARANCE
- At least 9 years experience but 14 years of experience is preferred in data engineering software engineering or related technical fields and a Bachelors in a related field. (Additional experience may be considered in lieu of a degree)
- Strong experience designing and building ETL pipelines and data ingestion frameworks
- Hands-on experience with Kafka NiFi and AWS (S3 SQS)
- Proficiency in Java with experience in unit and integration testing
- Solid understanding of data formats (JSON XML SQL schemas compressed formats)
- Experience troubleshooting data pipelines system performance and dataflow issues
- DoD 8570 IAT II certification (or higher)