Data engineer- CDP -....
Data engineer- CDP - Randomtrees
Posted on :
18-01-2024
Employer Active
1 Vacancy
The job posting is outdated and position may be filled
Job Alert
You will be updated with latest job alerts via emailValid email field required
Send jobs
Job Alert
You will be updated with latest job alerts via emailValid email field required
Send jobs
Monthly Salary
Not Disclosed
Salary Not Disclosed
Vacancy
1 Vacancy
Posted on :
18-01-2024
Job Description
Req ID : 2499772
Midlevel Data engineer
Experience 2.5 to 5 years
Bachelors Degree or equivalent experience in Computer Science or related field
Required Immediate or 15 days
Primary skills Python SQL Coding skills Big Query Dataflow Pyspark Airflow Kafka and CDP .
Job Description
2.5 years experience as a data warehouse engineer/architect designing and deploying data systems in a startup environment- Mastery of database and data warehouse methodologies and techniques from transactional databases to dimensional data modeling to wide deformalized data marts
- Deep understanding of SQLbased Big Data systems and experience with modern ETL tools
- Expertise in designing data warehouses using Google Big Query
- Experience developing data pipelines in Python
- Firm believer of data driven decision making and extensive experience developing for high/elastic scalable 24x7x365 high availability digital marketing or ecommerce systems
- Handson experience with data compute storage and security components and using Cloud Platform (preferably GCP) provided Big Data technologies
- Handson experience with real time streaming processing as well as high volume batch processing and skilled in Advanced SQL GCP BigQuery Apache Kafka DataLakes etc.
- Handson Experience in Big Data technologies Hadoop Hive and Spark and in an enterprisescale Customer Data Platform (CDP)
- Experience in at least one programming language (Python strongly preferred) cloud computing platforms (e.g. GCP) big data tools such as Spark/PySpark columnar datastores (BigQuery preferred) DevOps processes/tooling (CI/CD GitHub Actions) infrastructure as code frameworks (Terraform) BI Tools (e.g. DOMO Tableau Looker) pipeline orchestration (eg. Airflow)
- Fluency in data science/machine learning basics (model types data prep training process etc.)
- Experience using version control systems (Git strongly preferred)
- Experience with data governance and data security
- Strong analytical problem solving and interpersonal skills have a hunger to learn and the ability to operate in a selfguided manner in a fastpaced rapidly changing environment
More jobs on
Employment Type
Full Time
Key Skills
- Apache Hive
- S3
- Hadoop
- Redshift
- Spark
- AWS
- Apache Pig
- NoSQL
- Big Data
- Data Warehouse
- Kafka
- Scala
Report This Job
Disclaimer: Drjobpro.com is only a platform that connects job seekers and employers. Applicants are advised to conduct their own independent research into the credentials of the prospective employer.We always make certain that our clients do not endorse any request for money payments, thus we advise against sharing any personal or bank-related information with any third party. If you suspect fraud or malpractice, please contact us via contact us page.
