Cloudera amp Big Dat....
Cloudera amp Big Data Engineer- Helius Technologies
Posted on :
18-01-2024
Employer Active
1 Vacancy
The job posting is outdated and position may be filled
Job Alert
You will be updated with latest job alerts via emailValid email field required
Send jobs
Job Alert
You will be updated with latest job alerts via emailValid email field required
Send jobs
Monthly Salary
Not Disclosed
Salary Not Disclosed
Vacancy
1 Vacancy
Posted on :
18-01-2024
Job Description
Req ID : 2499767
-
- Design build deployment of ETL/ELT data pipelines within big data ecosystems (Impala Hue Spark Talend and Cloudera)
- Develop technical design and ETL specification documents
- Manage monitor and fine tune Hadoop cluster architecture (HDFS) jobs for performance security and resource management.
- Create detailed designs and POCs to enable new workloads and technical capabilities on the Platform. Work with the platform and infrastructure engineers to implement these capabilities in production
- Minimum 5 years of experience with development to centered around big data applications and transformation of unstructured raw data
- Minimum 5 years Relational DBA experience preferably with experience in SQL server and/or MySQL
- Experience with Talend and Cloudera Manager Navigator and Data Science Workbench
- Design build and maintain Big Data workflows/pipelines to process continuous stream of data with experience in endtoend design and build process of NearRealTime and Batch Data Pipelines
- Demonstrated work experience in the following with Big Data and distributed programming models and technologies
- Development of ETL processes using Spark or other highly parallel technologies and implementing ETL/data pipelines
- Experience with data technologies and Big Data tools like Spark Kafka Hive Hadoop
- Knowledge of database structures theories principles and practices (both SQL and NoSQL)
- Understanding of Map Reduce and other Data Query and Processing and aggregation models
- Understanding of challenges of transforming data across distributed clustered environment
- Experience with techniques for consuming holding and aging out continuous data streams
- Location: WFH and client site
More jobs on
Employment Type
Full Time
Key Skills
- Apache Hive
- S3
- Hadoop
- Redshift
- Spark
- AWS
- Apache Pig
- NoSQL
- Big Data
- Data Warehouse
- Kafka
- Scala
Report This Job
Disclaimer: Drjobpro.com is only a platform that connects job seekers and employers. Applicants are advised to conduct their own independent research into the credentials of the prospective employer.We always make certain that our clients do not endorse any request for money payments, thus we advise against sharing any personal or bank-related information with any third party. If you suspect fraud or malpractice, please contact us via contact us page.
