Specialty Software Engineer Lead
Dallas, IA - USA
Job Summary
Tittle: Specialty Software Engineer Lead (72186)
Location: TX - Dallas PA - Pittsburgh OH - Cleveland AL - Birmingham AZ - Phoenix
Work Mode : 5 Days Onsite
Duration: Contract to Hire
Years Of Exp Required: 12 Years
Location: TX - Dallas PA - Pittsburgh OH - Cleveland AL - Birmingham AZ - Phoenix
Work Mode : 5 Days Onsite
Duration: Contract to Hire
Years Of Exp Required: 12 Years
Function of the Group: Implementation of Apache Iceberg file format
Industry background: Dev. Ops Engineering with background in CI/CD Pipeline Integration
Job Responsibilities:
We are seeking a Senior Data Platform Engineer to design build deploy and operate containerized data
workloads supporting Apache Iceberg based lakehouse architectures.
This role focuses on engineering and operating data platform runtimes (Spark Trino Airflow) deployed
on Red Hat OpenShift partnering closely with platform security and infrastructure teams while
remaining primarily focused on data workload enablement not OpenShift administration.
This is a hands-on senior role for an engineer comfortable owning production-grade data pipelines query
engines and orchestration platforms in containerized enterprise environments
Required Skills
Apache Iceberg (at least 7 yrs)
CI/CD Pipeline Integration
Image Creation of opensource tools
Apache Spark
Trino/Presto
Apache Airflow
Docker
Helm
OpenShift/ Kubernetes
Python
SQL
Screening Questions:
1. Describe a scenario where Iceberg solved a problem that traditional Hive tables could not.
2. What performance pitfalls have you seen with Iceberg and how did you mitigate them
3. Walk me through how you typically tune a Spark job that is CPU-bound vs memory-bound.
4. What causes queries to fail or spill in Trino and how do you diagnose that
5. Describe a time Trino became unstable. What was the root cause
6. How do you design Airflow DAGs for reliability and restartability
7. What do you debug first when a Spark or Trino pod is OOMKilled
8. Whats the hardest production incident youve owned involving Spark Trino or Airflow