Sr Data Engineer
Sr Data Engineer
Posted on :
26-03-2024
Employer Active
1 Vacancy
Job Alert
You will be updated with latest job alerts via emailValid email field required
Send jobs
Job Alert
You will be updated with latest job alerts via emailValid email field required
Send jobs
Job Description
Req ID : 2665063
As a Senior Data Engineer you will apply your experience as a data pipeline engineer and Python developer to build and maintain fast reliable pipelines to materialize high quality datasets.
Work with stakeholders to translate requirements into data models.
Use Python SQL or Spark to write data transformations.
Implement data quality frameworks and rules.
Required Skills:
Track record of developing batch or stream processing pipelines using the modern data stack.
At least 5 years of experience as a Python developer.
Proficient in SQL Spark Pandas.
Experience with at least one of the three major cloud providers: AWS Azure GCP.
Understanding of data modeling concepts and the ability to translate requirements and navigate tradeoffs.
Experience using a modern data warehouse such as Snowflake Redshift Presto Dremio etc.
Knowledge of SDLC processes e.g. experience with Git packaging containerization.
Excellent verbal and written communication skills.
Nice to have:
Experience with eventbased technologies like Kafka.
Experience with real time data replication using Change Data Capture.
Experience with the Salesforce ecosystem.
python,spark,aws,azure,sql,pandas
Employment Type
Full Time
Key Skills
Report This Job
Disclaimer: Drjobpro.com is only a platform that connects job seekers and employers. Applicants are advised to conduct their own independent research into the credentials of the prospective employer.We always make certain that our clients do not endorse any request for money payments, thus we advise against sharing any personal or bank-related information with any third party. If you suspect fraud or malpractice, please contact us via contact us page.
