Data Engineer with AI Kubernetes
Share
Job Location:
Columbus, NE - USA
Monthly Salary:
Not Disclosed
Posted on:
3 hours ago
Vacancies:
1 Vacancy
Job Summary
Required Skills & Qualifications:
Strong proficiency in Python for data processing and pipeline development
Hands-on experience with Apache Spark (PySpark preferred)
Solid experience with AWS services such as S3 Glue EMR Redshift Athena Lambda
Experience with SQL and relational/non-relational databases
Knowledge of data modeling data warehousing concepts and ETL frameworks
Experience working with large-scale distributed data systems
Familiarity with CI/CD pipelines and version control tools (Git)
Strong problem-solving and communication skills
Preferred / Nice to Have:
Experience with Airflow or other workflow orchestration tools
Knowledge of Kafka Kinesis or streaming data platforms
Experience with Docker/Kubernetes
Exposure to Delta Lake Iceberg or HuD.
Strong proficiency in Python for data processing and pipeline development
Hands-on experience with Apache Spark (PySpark preferred)
Solid experience with AWS services such as S3 Glue EMR Redshift Athena Lambda
Experience with SQL and relational/non-relational databases
Knowledge of data modeling data warehousing concepts and ETL frameworks
Experience working with large-scale distributed data systems
Familiarity with CI/CD pipelines and version control tools (Git)
Strong problem-solving and communication skills
Preferred / Nice to Have:
Experience with Airflow or other workflow orchestration tools
Knowledge of Kafka Kinesis or streaming data platforms
Experience with Docker/Kubernetes
Exposure to Delta Lake Iceberg or HuD.
Key Skills
- Apache Hive
- S3
- Hadoop
- Redshift
- Spark
- AWS
- Apache Pig
- NoSQL
- Big Data
- Data Warehouse
- Kafka
- Scala
