Data Integration Engineer

Novul Solutions


Monthly Salary: $ 100000 - 110000
Experience Required: 4-5years
Posted on: 17 days ago
Vacancies: 1 Vacancy

Job Summary

Position Summary

We are seeking a Data Integration Engineer to support data engineering system integration and analytics efforts for DISN network topology and operational data. This role focuses on building and maintaining data pipelines integrating distributed data sources supporting Kafka and Elastic platform workflows and enabling advanced data correlation and visualization.

The ideal candidate will have experience in software or data engineering ETL pipeline development Kafka or Elastic integrations Kibana dashboarding and Agile team collaboration. This position supports a DoD mission environment and requires strong technical documentation communication and security compliance awareness.

Primary Responsibilities:
  • Support the integration enrichment and correlation of DISN network topology data for advanced analytics and operational insight.
  • Develop test and deploy data pipelines and integration solutions across distributed systems and cloud environments.
  • Build and maintain solutions using Python Java JavaScript SQL and related technologies.
  • Gather requirements and collaborate with stakeholders to design data enrichment pipelines.
  • Integrate diverse data sources into Confluent Kafka and Elastic platforms.
  • Develop and maintain Kibana visualizations dashboards and analytics views.
  • Support Kafka integrations between Elasticsearch Logstash and other systems.
  • Participate in technical discussions with internal teams external stakeholders and mission partners.
  • Work within Agile/Scrum teams to support sprint deliverables peer collaboration and project objectives.
  • Communicate effectively with geographically distributed team members.
  • Troubleshoot installation infrastructure integration and system issues.
  • Identify report and help mitigate technical risks.
  • Develop and maintain technical documentation including DoD requirements interface documents security artifacts and system engineering documentation.
  • Ensure solutions align with DoD security standards guidelines and platform sustainment requirements.
  • Support operational reliability by helping resolve platform and integration challenges.



Requirements

Basic Qualifications:
  • Bachelors degree with 48 years of related experience or masters degree with 26 years; equivalent experience may be considered.
  • 4 years of experience in software engineering data engineering business analysis or data analysis.
  • Hands-on experience with Python Java SQL and working knowledge of JavaScript/HTML.
  • Experience with Agile/Scrum teams and tools such as JIRA and Confluence.
  • Experience with Git Bitbucket or similar version control tools.
  • Experience with data analytics and visualization tools such as Kibana Power BI Tableau or ELK.
  • Experience designing developing and optimizing ETL processes data pipelines and data integrations.
  • Experience with Kafka Elastic Elasticsearch Logstash or similar integration platforms.
  • Background in data modeling data enrichment data unification or analytics.
  • Understanding of networking concepts internet protocols and network-centric environments.
  • Experience developing and deploying software on UNIX/Linux command line platforms.
  • Strong communication coordination and cross-functional collaboration skills.
Preferred Qualifications:
  • Experience with CI/CD DevOps automated delivery and containerized deployment pipelines.
  • Experience with Kafka Elastic Spark NiFi ksqlDB or Kafka Streams.
  • Hands-on experience with Kafka connectors and Kafka integrations with Elasticsearch/Logstash.
  • Experience designing streaming data applications and real-time data processing solutions.
  • Experience with Docker Kubernetes AWS or GovCloud environments.
  • Experience configuring cloud infrastructure networking and security policies.
  • Experience with full software lifecycle automation including design testing deployment and production release.
  • Experience building automated testing pipelines using Ansible Selenium JMeter JUnit or similar tools.
  • Experience developing software in DoD or DISA environments.
  • Familiarity with DoD security standards STIGs and security compliance requirements.
  • Ability to support DoD requirements traceability matrices project plans software systems engineering documents and interface documents.
  • Familiarity with AI/ML concepts and data platform integration.
  • Ability to work effectively in remote and geographically dispersed teams.


Benefits

Core Benefits:
  • Paid Time Off PTO):TEN (10) Paid days off & FIVE (5) Floating days off.
  • Holidays: 11 Paid Holidays. Flex time can be utilized instead of holiday time usage.
  • Payroll: Paid Bi-Monthly.
  • 401(k): Partnered with the SECOND LARGEST Retirement plan provider in the U.S. Guaranteed 3% match. Eligibility 21 years of age or older after 3 months of employment
  • Individual or company-wide performance and recognition awards (Quarterly
Health Benefits:
  • UNITED HEALTHCARE PPO extensive national coverage.
  • INCLUDES: Medical/Dental/Vision/HSA.
  • Eligible on the first of the month immediately after the start date.
  • Submit the enrollment form within 30 days of your start date otherwise you will have to wait until October for the new year enrollment.
Quality of Life Benefits:
  • Training & Career Development Reimbursement of Tuition and training needed to support career development.
  • $150 monthly reimbursement contribution paid monthly towards parking expenses.
  • Receipts must be submitted by the close of business on the 25th of each month.
  • Reimbursements will be paid on the first payroll AFTER reimbursements are submitted each month.
Special Benefits:
  • Performance bonus Project-based
  • Yearly bonus Company based


Required Skills:

Experience with CI/CD DevOps automated delivery and containerized deployment pipelines. Experience with Kafka Elastic Spark NiFi ksqlDB or Kafka Streams. Hands-on experience with Kafka connectors and Kafka integrations with Elasticsearch/Logstash. Experience designing streaming data applications and real-time data processing solutions. Experience with Docker Kubernetes AWS or GovCloud environments. Experience configuring cloud infrastructure networking and security policies. Experience with full software lifecycle automation including design testing deployment and production release. Experience building automated testing pipelines using Ansible Selenium JMeter JUnit or similar tools. Experience developing software in DoD or DISA environments. Familiarity with DoD security standards STIGs and security compliance requirements. Ability to support DoD requirements traceability matrices project plans software systems engineering documents and interface documents. Familiarity with AI/ML concepts and data platform integration. Ability to work effectively in remote and geographically dispersed teams.


Required Education:

Bachelors degree with 48 years of related experience or masters degree with 26 years; equivalent experience may be considered.

Position Summary We are seeking a Data Integration Engineer to support data engineering system integration and analytics efforts for DISN network topology and operational data. This role focuses on building and maintaining data pipelines integrating distributed data sources supporting Kafka and Elas...