Data Engineer

Columbia, IN - USA

Yearly Salary: $ 150000 - 200000

Posted on: 4 hours ago

Vacancies: 1 Vacancy

Job Summary

Data Engineer must have top security clearance with 14 years experience

Data Engineer requires:

Must be certified DoD IAT II or higher

Security Clearance-Current active TS/SCI eligible

At least 14 years of experience in one of the following: Software development/engineering data engineering database engineering etc. (4 additional years relevant experience can substitute for a BS degree)

Experience with Unit and Integration testing.

Fluency with data extraction custom translation development and loading including data prep and labeling to enable data analytics.

Familiarity with various log formats such as JSON XML and others.

Experience with data flow management and storage solutions (i.e. Kafka NiFi and AWS S3 and SQS solutions)

Ability to decompose technical problems and troubleshoot both system and dataflow issues.

Willingness to do a programming challenge during the interview process.

Experience with Zoom/Teams/Meet style team meetings

Prior experience in cyber/network security operations.

Familiarity with Agile environments.

Good communication skills.

Developed documentation and training in areas of expertise.

Amazon S3 SQS/SNS Admin experience

Apache Airflow Workloads via UI or CLI a plus

Experience with Mage AI a plus

Kubernetes Docker

Data Engineer duties

Work with big data systems and complex structured and unstructured data sets.

Support government data acquisition analysis and sharing efforts.

Focus on software infrastructure for big data scaled ingestion including understanding and ingesting new data sources modifying existing data sources implementing testing establishing monitoring and troubleshooting.

Lead the department in achieving strategic goals ensuring data integrity and fostering a collaborative and innovative work

Data Engineer must have top security clearance with 14 years experience Data Engineer requires: Must be certified DoD IAT II or higher Security Clearance-Current active TS/SCI eligible At least 14 years of experience in one of the following: Software development/engineering data engineering data...