drjobs
Senior Data Engineer
drjobs
Senior Data Engineer
drjobs Senior Data Engineer العربية

Senior Data Engineer

Employer Active

1 Vacancy
drjobs

Job Alert

You will be updated with latest job alerts via email
Valid email field required
Send jobs
drjobs

Job Alert

You will be updated with latest job alerts via email

Valid email field required
Send jobs

Job Location

drjobs

Berlin - Germany

Monthly Salary

drjobs

Not Disclosed

drjobs

Salary Not Disclosed

Vacancy

1 Vacancy

Job Description

Req ID : 2743389

In todays digital age instant information is the norm. But this transparency disappears when it comes to consumer products and their ethical and sustainable production through supply chains. Addressing the global climate challenge and safeguarding both humanity and the planet requires a transformation in food systems.

This is why we built OpenSC.

Cofounded by WWF and The Boston Consulting Group OpenSC is on a mission to revolutionize the way we buy and produce products by providing data on transparency and traceability for supply chains.
We deliver social and environmental impact by providing supply chain transparency that empowers brands to know influence and prove the sustainability of their supply chain practices.

This is achieved through the OpenSC platform which leverages AI Blockchain and Remote Sensing technologies to enable automated ingestion analysis and sharing of a supply chains data.

Tasks

  • Further design and build OpenSCs data platform across all data domains: collection storage transformation and analyses
  • Develop highquality data pipelines that transform structured semistructured and unstructured data from various sources into a standardized data model
  • Expand OpenSCs data model to accommodate a growing number of use cases
  • Assume responsibility for the business interpretation of data and actively contribute to data science and analytics projects
  • Provide support and guidance on data security and cloud infrastructure topics ensuring a secure and efficient handling of data
  • Adhere to software engineering best practices regarding version control testing code reviews deployment etc.
  • Communicate effectively with technical and nontechnical stakeholders
  • Contribute elevating the team through knowledge sharing on data engineering best practices

Requirements

  • 6 years of relevant industry experience building productionlevel data products
  • Proven solid foundation of core data concepts (e.g. integration modeling security lineage governance etc.)
  • Excellent Python skills and advanced competencies with main data ecosystem libraries (pandas great expectations dbt etc.)
  • Advanced knowledge of SQL and relational databases (e.g. PostgreSQL)
  • Extensive experience with data pipeline orchestration tools (e.g. Dagster Airflow etc.)
  • Extensive experience working with cloud infrastructure and services (ideally on AWS)
  • Experience working with different data modeling patterns and ability to abstract complex reallife information into a standardized data model description
  • Demonstrated familiarity with Version control (Git) Containerization (Docker Kubernetes) CI/CD (e.g. CircleCi Github Actions) IaC (Terraform)
  • Strong interpersonal skills and ability to work in a multidisciplinary and multicultural team

Employment Type

Full Time

Company Industry

About Company

Report This Job
Disclaimer: Drjobpro.com is only a platform that connects job seekers and employers. Applicants are advised to conduct their own independent research into the credentials of the prospective employer.We always make certain that our clients do not endorse any request for money payments, thus we advise against sharing any personal or bank-related information with any third party. If you suspect fraud or malpractice, please contact us via contact us page.