Senior Data Engineer (OpAI)
San Diego, CA - USA
Job Summary
The Marlin Alliance Inc. is seeking a Senior Data Engineer (OpAI) to design build and operationalize advanced data pipelines and analytics supporting Naval and DoD mission challenges. This role requires deep experience across data engineering distributed systems event streaming cloud data frameworks and mission-focused analytics. The Senior Data Engineer will support complex data integration efforts collaborate with cross-functional engineering teams and lead data architecture improvements aligned with operational Navy needs.
Incorporated in 2002 The Marlin Alliance is a digital transformation company dedicated to ensuring our clients compete and win in tomorrows digital world. We specialize in creating technical solutions that allow for seamless execution of automated business processes and the generation of governed machine-consumable data. From strategic planning to advanced analytics and cybersecurity our team provides cutting-edge cross-disciplinary solutions. We are seeking motivated professionals who share our agile solution-oriented mindset and are ready to deliver the real practical results relied upon by our clients.
Citizenship and Clearance requirements:
- U.S. Citizenship required
- No dual citizenship
- Active TS security clearance required
- Active TS SCI security clearance preferred
Location - ON-Site near one of the following locations:
- 1st Space Brigade - Fort Carson CO
- Air Force TENCAP - Colorado Springs CO
- NIWC LANT - Charleston SC
- Buckley Space Force Base - Denver CO
- NAVWAR - San Diego CA
Travel:
- 15%
Responsibilities:
- Collaborate with cross-functional teams to understand and address Navy operational challenges using data pipelines and analytics.
- Design develop and implement data pipelines and analytics for naval applications.
- Perform exploratory data analysis algorithm development and testing.
- Normalize and structure data to common standards for interoperability.
- Work with multiple data formats including CSV JSON XML Parquet and ORC.
- Develop and deploy data pipelines and analytics in real-world operational environments.
- Deploy monitor and optimize data pipelines to ensure high performance and reliability.
- Implement event streaming pipelines using Apache Kafka AWS Kinesis RabbitMQ or ZeroMQ.
- Utilize distributed computing platforms such as AWS Lambda Dask or Spark.
- Leverage cloud-native tools including AWS S3 RDS EFS SNS and SQS.
- Utilize data pipeline frameworks such as AirByte Apache Airflow dbt Apache Iceberg and Snowflake.
- Work with GIS data using ArcGIS PostGIS and related tooling.
- Implement containerized environments using Docker or Kubernetes.
- Apply cybersecurity principles in the context of secure DoD data applications.
- Communicate findings and engineering solutions effectively with technical and mission stakeholders.
Required Skills and Experience:
- Strong programming skills in Python G Rust Pandas R SQL or related languages
- 10 years of experience as a business analyst data analyst data scientist data engineer database administrator geospatial analyst/engineer machine learning engineer or software engineer or related field.
- Willingness to travel
- 100% On Site willingness
- Ability to safely carry tools equipment and materials aboard ship including ascending and descending shipboard ladders(stairwells) and navigating confined spaces while maintaining required points of contact. Tools and equipment will weigh no more than 50 lbs.
- Ability to perform required work aboard Navy vessels and in shipboard environments including navigating narrow passageways ascending and descending ladders (stairwells) working on elevated platforms and operating in variable sea conditions.
- Ability to perform activities on a reoccurring basis during shipboard operations or testing evolutions.
- Ability to comply with Navy safety requirements and wear required personal protective equipment (PPE).
- Ability to operate in a DDIL office environment
- Reasonable accommodations may be provided to enable qualified individuals to meet these requirements and perform the essential functions of the position.
- Candidates should be prepared to complete a coding exercise as part of the interview process.
Preferred Skills and Experience:
- Experience with large-scale data architecture across secure DoD or government environments.
- Experience working with NAVWAR NIWC Pacific or naval C2/ISR programs.
- Experience architecting data solutions across multi-domain or cross-domain systems.
- Familiarity with MLOps practices or deploying analytics/ML-enabled pipelines in classified cross-domain or constrained environments
- Experience with cloud-native data architecture and API design.
- Programming experience in Go or Rust.
- Proven experience designing developing and deploying complex data pipelines.
- Experience working with multiple data formats (e.g. CSV JSON XML Parquet ORC).
- Familiarity with event streaming technologies: (e.g. Kafka AWS Kinesis RabbitMQ ZeroMQ).
- Experience deploying monitoring and optimizing operational data pipelines.
- Expertise in Elasticsearch Redis S3 PostgreSQL or related datastores.
- Experience with AWS data services (EFS RDS S3 SNS SQS).
- Experience with distributed computing: AWS Lambda DASK Spark.
- Familiarity with AirByte Airflow dbt Iceberg Snowflake.
- Experience managing integrating and retrieving GIS data (ArcGIS PostGIS).
- Understanding of cybersecurity principles as applied to data applications and operational environments (including DDIL constraints)
- Strong analytical and problem-solving skills.
- Excellent communication skills in a collaborative team environment.
- Previous experience supporting government agencies or military organizations.
Education and Certification Requirements:
- Equivalent years of relevant experience in lieu of degree.
- Master of Science in Computer Science Data Science Geography Math Machine Learning or Statistics.
- Additional certifications in data engineering cloud geospatial or cybersecurity are a plus if required by contract.
Job Classification:
Associate II
$110000 - $180000
Disclaimer:
This job description in no way states or implies that these are the only duties to be performed by the employee(s) incumbent in this position. Employees will be required to follow any other job-related instructions and to perform any other job-related duties requested by any person authorized to give instructions or assignments. All duties and responsibilities are essential functions and requirements and are subject to possible modification to reasonably accommodate individuals with disabilities.
To perform this job successfully the incumbents will possess the skills aptitudes and abilities to perform each duty proficiently. Some requirements may exclude individuals who pose a direct threat or significant risk to the health or safety of themselves or others. The requirements listed in this document are the minimum levels of knowledge skills or abilities.
This document does not create an employment contract implied or otherwise other than an at-will relationship.
An Equal Opportunity Employer/Protected Veterans/Individuals with Disabilities
Required Experience:
Senior IC
About Company
Digital Transformation. The Marlin Alliance delivers premiere digitization, automation and utilization consulting and support services.