Sr. Data Engineer
Share
Job Location:
Dallas, IA - USA
Monthly Salary:
Not Disclosed
Posted on:
30+ days ago
Vacancies:
1 Vacancy
Job Summary
Role: Sr. Data Engineer
Location: Dallas TX 75219- Hybrid
Duration: 12 Months Contract
Location: Dallas TX 75219- Hybrid
Duration: 12 Months Contract
The Position
We are seeking an experienced Data Engineer with deep expertise in modern data engineering frameworks and cloud-based ecosystems. The ideal candidate will design build and optimize scalable data pipelines and architectures using tools such as Kafka Apache Airflow Apache NiFi Databricks Hadoop Apache Flink and Amazon S3.
Youll collaborate with cross-functional teams - including data science analytics and infrastructure - to ensure the delivery of reliable secure and high-quality data solutions that power data-driven decision-making across the organization.
We are seeking an experienced Data Engineer with deep expertise in modern data engineering frameworks and cloud-based ecosystems. The ideal candidate will design build and optimize scalable data pipelines and architectures using tools such as Kafka Apache Airflow Apache NiFi Databricks Hadoop Apache Flink and Amazon S3.
Youll collaborate with cross-functional teams - including data science analytics and infrastructure - to ensure the delivery of reliable secure and high-quality data solutions that power data-driven decision-making across the organization.
Responsibilities
Design develop and maintain scalable and reliable data pipelines using Apache Airflow NiFi and Databricks to automate data ingestion transformation and delivery.
Implement real-time data streaming and event-driven architectures leveraging Apache Kafka and Flink.
Develop and optimize data storage solutions using Hadoop and Amazon S3 ensuring high performance cost efficiency and scalability.
Ensure data quality governance and security through best practices and robust monitoring frameworks.
Manage ETL/ELT processes and orchestrate complex workflows across hybrid and multi-cloud environments.
Work with various data formats (e.g. Parquet Avro JSON) to optimize data accessibility and interoperability.
Troubleshoot and optimize performance across distributed data processing systems.
Mentor junior engineers and foster a culture of technical excellence and continuous learning.
Design develop and maintain scalable and reliable data pipelines using Apache Airflow NiFi and Databricks to automate data ingestion transformation and delivery.
Implement real-time data streaming and event-driven architectures leveraging Apache Kafka and Flink.
Develop and optimize data storage solutions using Hadoop and Amazon S3 ensuring high performance cost efficiency and scalability.
Ensure data quality governance and security through best practices and robust monitoring frameworks.
Manage ETL/ELT processes and orchestrate complex workflows across hybrid and multi-cloud environments.
Work with various data formats (e.g. Parquet Avro JSON) to optimize data accessibility and interoperability.
Troubleshoot and optimize performance across distributed data processing systems.
Mentor junior engineers and foster a culture of technical excellence and continuous learning.
Requirements
Bachelors degree in Computer Science Engineering or a related field.
7 years of experience in data engineering with strong hands-on experience in data pipeline design development and orchestration.
Expertise in Kafka Airflow NiFi Databricks Spark Hadoop Flink and S3.
Proficiency in Python Scala or Java for data transformation and automation tasks.
Strong SQL skills and familiarity with relational and NoSQL data stores.
Experience with On-Prem Kubernetes based Data Engineering
Familiarity with data modeling data governance and data quality frameworks.
Excellent analytical problem-solving and communication skills.
Experience operating in a multi-cloud or hybrid data environment preferred.
Bachelors degree in Computer Science Engineering or a related field.
7 years of experience in data engineering with strong hands-on experience in data pipeline design development and orchestration.
Expertise in Kafka Airflow NiFi Databricks Spark Hadoop Flink and S3.
Proficiency in Python Scala or Java for data transformation and automation tasks.
Strong SQL skills and familiarity with relational and NoSQL data stores.
Experience with On-Prem Kubernetes based Data Engineering
Familiarity with data modeling data governance and data quality frameworks.
Excellent analytical problem-solving and communication skills.
Experience operating in a multi-cloud or hybrid data environment preferred.
Key Skills
- Apache Hive
- S3
- Hadoop
- Redshift
- Spark
- AWS
- Apache Pig
- NoSQL
- Big Data
- Data Warehouse
- Kafka
- Scala
