Data Engineer

Not Interested
Bookmark
Report This Job

profile Job Location:

Dallas, IA - USA

profile Monthly Salary: $ 115000 - 135000
Posted on: 24 days ago
Vacancies: 1 Vacancy

Job Summary

AboutiCOUNTER

iCOUNTERis a predictive cyber risk intelligence firm; we counter threats before they happen. We partner SIGINT and HUMINT with AI enabling our customers to counter the rising frequency complexity and precision targeting they are facing from adversaries.iCOUNTERhas a related but distinct sister company Apollo Information Systems.

iCOUNTERprovides continuous observation of third parties in the criminal underground going beyond static assessments and security ratings. We triage and deliver thesecollectionsempowering our customers to counter threats before they strike. We reduce the noise that security teams faceby onlydeliveringactionablealerts and mitigation strategies.


Our Culture

We are growing rapidly and have significant expansion plans andgrowthcapital. We foster a collaborative environment where deep cybersecurityexpertisemeets business acumen enabling our professionals to solve complex security challenges while building lasting client partnerships. We pride ourselves on our integrity and ethics.Youllfind smart professional mission-driven hardworking genuinelykindand good colleagues here.

We primarily work remotely but have hubs in Denver and Dallas.


Position Overview:

As a Data Engineer you will play a crucial role in designing developing and optimizing data infrastructure and pipelines. A key part of your role will involve working with OpenSearch to develop search and analytics capabilities that power our products and internal tools.


The ideal candidate has experience owning and managing Data Lakes performing Schema Management and ensuring Data Sanitization. Experience with large unstructured data sets is a must as is experience in the Cybersecurity industry. You will work closely with an LLM team and help to make data more accessible.


This position is part off iCOUNTERs continued growth and plays a crucial role in future company success and performance.

Key Responsibilities:

  • Design build and maintain scalable data pipelines for structured and unstructured data.
  • Implement and manage Elasticsearch clusters to support advanced search functionality and analytics.
  • Develop indexing strategies custom analyzers and optimized queries for performance.
  • Collaborate with data scientists analysts and MLOps engineers to enable data access and usage across the organization.
  • Monitor and troubleshoot data systems to ensure reliability availability and data integrity.
  • Automate data ingestion transformation and orchestration processes using modern tools (e.g. Airflow dbt AWS Data Pipeline AWS Glue).
  • Apply best practices in security monitoring and observability across data infrastructure.
  • Partner with CISO for security policy creating enforcement.
  • Work directly with LLM training and development.
  • Data sanitization including schema management data accuracy and mass data changes.

Qualifications

Required

  • 4 years of professional experience in Data Engineering.
  • 3years building and maintaining lake house architectures using Apache HDFS Apache Iceberg (or Delta Lake) on a distributed file system (Ceph/MinIO/S3).
  • Proven track record designing ingestion pipelines with Kafka / Fluvio / Vector / NiFi that handle >10GB/s of telemetry.
  • Handson expertise with Apache Airflow (or Prefect/Dagster) orchestrating Spark/Flink/Polars ETL workflows including error handling and SLA monitoring.
  • Ability to write and optimize SQL queries against Trino (PrestoSQL) on Iceberg tables and to create Elasticsearch indices for realtime search.
  • Familiarity with metadata & governance tools (Ranger Atlas OpenMetadata) to enforce lineage auditability and RBAC.
  • Knowledge of monitoring/observability stack (Prometheus Grafana ELK) to surface pipeline KPIs and incident alerts.
  • Extensive experience configuring forsecurityscalability andperformancein production environments including features likeshardingandreplicationto ensure data redundancy and fault tolerance.

Preferred

  • Experience with cloud native streaming services (Kinesis Pub/Sub Event Hubs).
  • Skills in GPU accelerated ML pipelines (vLLM SparkMLlib Rust Linfa).
  • Container orchestration on Kubernetes and CI/CD tooling (GitOps ArgoCD).


New Hire Expectations:

  • At 30 days:
    • Become familiar with iCOUNTER Data Environment and Tools
  • Within 60 days:
    • Tune existing processes for production-grade outputs for product deliverable
    • Become familiar with greater iCOUNTER team
  • By 90 days:
    • Continue tuning outputs for expanded product portfolio
    • Support ad hoc requests across greater team


Values

We have created a fantastic corporate culture our values drive our behaviors. Here are the expectations:

  • Passion for cybersecurity and a commitment to maintaining the highest standards of security.
  • Eagerness to learn and stay current with evolving cybersecurity trends.
  • Strong attention to detail and the ability to work under pressure.
  • Ability to work collaboratively in a fast-paced team-oriented environment.
  • Integrity is paramount; honesty is a core value at iCOUNTER.

Completion of a Background Check is required for employment at iCOUNTER


Apollo/iCOUNTERis an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race color religion sex sexual orientation gender identity national origin age disability or veteran status or any other applicable state or federal protected class. Apollo/iCOUNTERprovides affirmative action in employment for qualified Individuals with a Disability and Protected Veterans in compliance with Section 503 of the Rehabilitation Act and the Vietnam Era Veterans Readjustment Assistance Act.


Required Experience:

Manager

AboutiCOUNTERiCOUNTERis a predictive cyber risk intelligence firm; we counter threats before they happen. We partner SIGINT and HUMINT with AI enabling our customers to counter the rising frequency complexity and precision targeting they are facing from adversaries.iCOUNTERhas a related but distinct...
View more view more

Key Skills

  • Apache Hive
  • S3
  • Hadoop
  • Redshift
  • Spark
  • AWS
  • Apache Pig
  • NoSQL
  • Big Data
  • Data Warehouse
  • Kafka
  • Scala

About Company

Company Logo

Apollo Information Systems is a security leader for high-stakes organizations, using a threat intelligence-enabled approach for proactive cybersecurity.

View Profile View Profile