DATA ENGINEER - PALANTIR
موقع الوظيفة:
الراتب شهرياً:
تم النشر:
آخر موعد للتقديم:
عدد الوظائف الشاغرة:
ملخص الوظيفة
Job Description:
We are seeking a talented and experienced Senior Big Data Engineer to join our dynamic team. The ideal candidate will have proficiency in big data technologies strong programming skills and extensive experience in data modeling ETL processes and SQL. Knowledge of cloud services particularly AWS Azure and GCP is preferred. Additionally experience with Palantir Foundry Dataiku Alteryx and Databricks UAP is highly desirable.
Responsibilities:
- Design develop and maintain scalable big data solutions using Spark Python Scala and/or Java.
- Implement efficient ETL processes to extract transform and load data from various sources into our data infrastructure.
- Collaborate with crossfunctional teams to understand data requirements and design appropriate data models.
- Optimize and tune existing data pipelines for performance and reliability.
- Ensure data quality and integrity throughout the data lifecycle.
- Stay uptodate with emerging technologies and best practices in big data engineering.
Requirements:
- Bachelors degree in Computer Science Engineering or a related field.
- Minimum of 3 years of experience in big data engineering.
- Proficiency in Spark is preferred; experience with other big data technologies such as Hadoop Kafka or Flink is a plus.
- Strong programming skills in Python Scala and/or Java.
- Solid understanding of data modeling concepts and techniques.
- Experience with database management systems and SQL.
- Knowledge of cloud services (AWS Azure GCP) is preferred.
- Familiarity with Palantir Foundry Dataiku Alteryx and/or Databricks UAP is a plus.
- Excellent problemsolving and communication skills.
- Ability to work effectively in a fastpaced collaborative environment.
Nice to Have:
- Experience working on projects related to smart city initiatives or government sectors.
Vertical
Technology
المهارات المطلوبة
- Apache Hive
- S3
- Hadoop
- Redshift
- Spark
- AWS
- Apache Pig
- NoSQL
- البيانات الضخمة
- مستودع البيانات
- Kafka
- Scala
عن الشركة
Duncan & Ross Engineering Consulting offers integrated and customer oriented services in the different industries such as Aerospace, Automotive, Construction, Defence, Energy, Life Sciences, Telecom & Transport. We ensure the success of our customers through our long-standing experien ... اعرض المزيد
