Data Engineer Software Developer

The Leidos Digital Modernization Group seeks a Data Engineer Software Developer for the Global Solution Management Operations II (GSM-O II) contract under the Global Automations & Intelligent Network Solutions (GAINS) Team. Seeking a Back-End Developer to join the Real-Time Visibility (RTV) team focused on designing building and maintaining the infrastructure and systems that collect store process and analyze large volumes of network operations data for the DISN network. This role is critical for ensuring that data from disparate sourcessuch as logs performance metrics events ticketing ordering and CMDB systemsis readily available reliable and performant for business and mission use. The existing platform is built on Elastic stack and Confluent Kafka platforms. The ideal candidate will have a strong background in data engineering platform operations and integration with experience in large-scale mission-critical environments.

As a key Real-Time Visibility team member you will be conducting design and implementation for a variety of solution capabilities to integrating various data sources into Confluent (Kafka) and Elastic platforms design of robust data integration solutions and adhering to the programs CI/CD processes and data governance practices. You will an integral member of a fast paced Agile development and implementation team to architect design and develop data integration solutions (Extract Transform Load) to support a unified User Experience / User Interface (UX/UI) that provides a holistic single-pane-of-glass interface for an integrated solution on the Elastic platform. You will also work with operational end users and support teams to perform requirements analysis as well as design develop and demonstrate mockups and wireframes.

Candidate must be within driving distance of Scott AFB. At a minimum a Secret clearance is required upon the start of employment and within 14 days following the start date the employee must obtain their Security certification.

Primary Responsibilities:

• Designs builds and maintains scalable reliable data systems and pipelines to ingest process and transform large complex and disparate data sources for analytics and reporting.
• Unifies and integrates data from multiple network operations systems into a consistent accessible platform ensuring data quality accuracy security and compliance with DoD and DISA requirements.
• Implements solutions using Confluent Kafka Elastic Stack AWS and Red Hat OpenShift (Kubernetes) including creating Kafka Elastic and Logstash pipelines and supporting Kibana visualizations and dashboards with React JavaScript and HTML.
• Develops and manages data warehouses and data lakes to support analytics reporting and operational dashboards optimizing infrastructure for performance scalability and cost-effectiveness through automation and best practices.
• Continually analyze and optimize ingestion throughput query performance indexing strategies and storage efficiency across Elastic and Kafka platforms.
• Automates data-related tasks such as ETL/ELT processes data validation cleansing monitoring and supports CI/CD pipelines for automated build test and deployment.
• Collaborates with data analysts visualization engineers and other stakeholders to deliver integrated actionable data solutions and documents data architecture integration patterns and operational procedures.
• Troubleshoots and resolves issues related to data ingestion processing and platform performance storage memory partitioning and cluster performance.

Basic Qualifications:

• Bachelors degree in Computer Science Engineering or related technical discipline and 4 years of relevant experience.
• Hands-on experience designing building and maintaining data pipelines (ETL/ELT) and integrating multiple disparate data sources.
• Experience with data warehouse and/or data lake technologies (e.g. AWS Redshift S3 Hadoop Snowflake or similar).
• Proficiency with data engineering tools and languages such as Python Java SQL and shell scripting.
• Experience with Elastic Stack (Elasticsearch Logstash Kibana) and/or Kafka for data ingestion and processing.
• Familiarity with network operations data (logs metrics events ticketing CMDB) and related data models.
• Experience with Linux/UNIX system administration and automation.
• Knowledge of data security access controls and compliance frameworks (DoD DISA RMF STIGs).
• Experience with CI/CD pipelines containerized pipelines version control (Git Bitbucket) and DevOps practices.
• Strong communication and documentation skills for collaboration and knowledge sharing.
• Must be able to commute to Scott AFB IL for up to full-time onsite support.
• Ability to obtain interim Secret DoD Security clearance before the start date.
• Ability to obtain Security certification or equivalent DoD 8570 IAT II certification within 14 days of the start date.

Preferred Qualifications:

• Experience with DISA DISN or other DoD network environments including developing and deploying software applications that meet DoD security standards (e.g. STIGs) and knowledge of network security encryption and access controls in classified environments.
• Experience with big data technologies and platforms such as Kafka Spark NiFi Hadoop Elasticsearch Logstash Databricks and ELK Stack for text mining summarization search and entity extraction.
• Experience with cloud-based data platforms (AWS Azure GCP AWS GovCloud) cloud-integrated platforms and infrastructure as code including networking and security policies.
• Familiarity with Kubernetes deployment platform upgrades patching configuration management tools (Ansible Puppet Chef) and monitoring alerting and observability tools (Prometheus Grafana Elastic).
• Experience with BI tools like Kibana and developing and maintaining technical documentation and runbooks.
• Strong understanding and practical experience with Agile methodologies (Scrum SAFe) and related tools such as Atlassian JIRA and Confluence.
• Certified Confluent Developer and Certified Elastic Engineer.
• Excellent communication and collaboration skills with experience working remotely with geographically dispersed teams and within a matrixed organization to combine software integration and data engineering practices.
• Apply knowledge of system architecture networks and centralized logging (ELK) to support data transformation initiatives.

If youre looking for comfort keep scrolling. At Leidos we outthink outbuild and outpace the status quo because the mission demands it. Were not hiring followers. Were recruiting the ones who disrupt provoke and refuse to fail. Step 10 is ancient history. Were already at step 30 and moving faster than anyone else dares.

Original Posting:

Pay Range:

The Leidos pay range for this job level is a general guideline onlyand not a guarantee of compensation or salary. Additional factors considered in extending an offer include (but are not limited to) responsibilities of the job education experience knowledge skills and abilities as well as internal equity alignment with market data applicable bargaining agreement (if any) or other law.