Data Engineer
Dallas, TX - USA
Job Summary
MUST-HAVE SKILLS
-
Strong hands-on Data Engineeringand datastore migration experience.
-
Experience migrating on-prem Data Lakes to AWS-hosted LakeHouseenvironments.
-
Strong Python or Javaprogramming and advanced SQL troubleshooting.
-
Experience with Apache Spark Snowflake and Apache Iceberg.
-
Data pipeline migration job scheduling and SQL/Spark code conversion.
-
Data reconciliation validation and data quality assurance.
-
Strong data modeling: SCD Type 2 schema evolution partitioning and clustering.
-
Experience with CI/CD SDLC and Kubernetes (K8s).
-
Familiarity with Kafka Hadoop/HDFS Hive JSON Avro Parquet FTP and Sybase IQ.
-
Strong stakeholder communication ownership and cross-team collaboration.