Data Engineer
Data Engineer
Posted on :
10-01-2024
Employer Active
1 Vacancy
The job posting is outdated and position may be filled
Job Alert
You will be updated with latest job alerts via emailValid email field required
Send jobs
Job Alert
You will be updated with latest job alerts via emailValid email field required
Send jobs
Jobs by Experience
5years
Monthly Salary
Not Disclosed
Salary Not Disclosed
Vacancy
1 Vacancy
Posted on :
10-01-2024
Job Description
Req ID : 2444084
Mandatory Skills:
Proficient in Python (Including popular python packages e.g. Pandas NumPy etc.) and SQL
Strong background in distributed data processing and storage (e.g. Apache Spark Apache Hadoop)
Large scale (TBs of data) data engineering skills Model data create production ready ETL pipelines
Development experience with at least one cloud (Azure high preference AWS GCP)
Knowledge of data lake and data lake house patterns
Knowledge of ETL performance tuning and cost optimization
Knowledge of data structures and algorithms and good software engineering practices
Good to have Skills
Experience with Azure Databricks
Knowledge of DevOps ETL pipeline orchestration
Tools: GitHub actions Terraform Databricks workflows Azure DevOps
Certifications: Databricks Azure AWS GCP highly preferred
Knowledge of code version control (e.g. Git)
Education and experience:
Bachelor s or master s degree (or equivalent) in Computer Science Engineering or a related field
3 years of handson experience in data engineering
Thorough understanding of big data principles techniques and best practices.
Mandatory Skills Proficient in Python (Including popular python packages e.g. Pandas, NumPy etc.) and SQL Strong background in distributed data processing and storage (e.g. Apache Spark, Apache Hadoop) Large scale (TBs of data) data engineering skills - Model data, create production ready ETL pipelines Development experience with at least one cloud (Azure high preference, AWS, GCP) Knowledge of data lake and data lake house patterns Knowledge of ETL performance tuning and cost optimization Knowledge of data structures and algorithms and good software engineering practices
Employment Type
Full Time
Key Skills
Report This Job
Disclaimer: Drjobpro.com is only a platform that connects job seekers and employers. Applicants are advised to conduct their own independent research into the credentials of the prospective employer.We always make certain that our clients do not endorse any request for money payments, thus we advise against sharing any personal or bank-related information with any third party. If you suspect fraud or malpractice, please contact us via contact us page.
