drjobs
Big Data Engineer
drjobs Big Data Engineer العربية

Employer Active

1 Vacancy
The job posting is outdated and position may be filled
drjobs

Job Alert

You will be updated with latest job alerts via email
Valid email field required
Send jobs
drjobs

Job Alert

You will be updated with latest job alerts via email

Valid email field required
Send jobs

Jobs by Experience

drjobs

0 - 6 years

Job Location

drjobs

Cairo - Egypt

Monthly Salary

drjobs

EGP 4000 - 6000

Nationality

Egyptian

Gender

N/A

Vacancy

1 Vacancy

Job Description

Req ID : 689708

Job Description

  • Define the architecture, scope and deliver various Big Data solutions.
  • Support other teams by providing guidance on data modeling, data usage, processing and how they can best leverage the platform
  • Build scalable data pipelines to ingest data from a variety of data sources, identify critical data elements and define data quality rules.
  • Leverage Spark/Hadoop ecosystem knowledge to design and develop capabilities to deliver innovative and improved data solutions.
  • Provide insights on area of improvements including Data Governance, best practices, large scale processing
  • Support the bug fixing and performance analysis along the data pipeline

Job Requirements

  • 5+ years of experience of the following
  • Software engineer, with strong skills in at least one programming language is mandatory, preferably Scala or Java or Python
  • Experience with Spark on Hadoop, EMR etc
  • Experience working with real time data processing using Kafka, Spark Streaming or similar technology
  • Experience with NoSQL Databases (Cassandra , Elasticsearch,…etc. ).
  • Experience with distributed systems and design/implementation for reliability, availability, scalability and performance
  • Experience with IoT Enablement Applications & Platforms like (thingsBoard , thingswork , etc) is a huge plus.
  • IoT Wireless Communication Technologies (LoRA, Sigfox, NB-IoT) is a plus.
  • Creative and innovative approach to problem-solving
  • Prefer to Have:
  • Familiarity with containerized platform like Docker and Kubernetes
  • Experience working with Hive, Presto or other querying frameworks

Employment Type

Full Time

Company Industry

IT - Software Services

Department / Functional Area

IT Software

Key Skills

Report This Job
Disclaimer: Drjobpro.com is only a platform that connects job seekers and employers. Applicants are advised to conduct their own independent research into the credentials of the prospective employer.We always make certain that our clients do not endorse any request for money payments, thus we advise against sharing any personal or bank-related information with any third party. If you suspect fraud or malpractice, please contact us via contact us page.