drjobs Data Platform Engineer

Data Platform Engineer

Employer Active

1 Vacancy
drjobs

Job Alert

You will be updated with latest job alerts via email
Valid email field required
Send jobs
Send me jobs like this
drjobs

Job Alert

You will be updated with latest job alerts via email

Valid email field required
Send jobs
Job Location drjobs

London - UK

Monthly Salary drjobs

Not Disclosed

drjobs

Salary Not Disclosed

Vacancy

1 Vacancy

Job Description

Octopus Energy is all about clean green energy with transparent pricing and a relentless commitment to customer experience. Join a global team dedicated to sustainability and green tech where energy is good for the planet and your soul Embrace flat hierarchies and an open agile culture that fosters innovation flexibility and creativity. At Octopus great people get stuff done all whilst being themselves.

At Octopus Energy we are passionate about building great technology to change the way customers use and think about energy for the good of the planet. This is a fantastic opportunity to work on data problems that genuinely move us closer to Net Zero and support the energy transition.

We have developed a data platform that is used by all our businesses around the world. The platform empowers users with selfservice data analytics and automates our data processing workflows from simple ETL jobs to ML training and prediction. The Data Platform Team works on anything from natural language understanding of customer communications to processing billions of smart meter readings every day to support creating customised and marketleading smart energy tariffs.

We employ software engineering best practices to design test and deploy our data platform and services. We are looking for an experienced Engineer to join the team to help build and maintain the platform pipelines and reporting tools.

What youll do...

    • Build and optimise the platform used by the data team to transform raw data into business insights
    • Scope and deliver new data engineering projects in collaboration with business stakeholders
    • Develop and deploy ML infrastructure to help build out our evergrowing AI requirements and use cases
    • Research and implement new tooling where appropriate whether its developed inhouse or sourced externally
    • Maintain and expand our existing data infrastructure and tools.
    • Consult the wider business on Engineering best practices and stay up to date with trends within the profession
    • Support the internationalisation of our data infrastructure as we continue to grow globally.

What youll have...

    • Primarily we want our DevOps engineers to have a passion for writing high quality code and building lean processes. It would be helpful to have experience/expertise/knowledge in the following (in rough priority order):

    • AWS
    • Kubernetes (EKS)
    • Data/network security
    • Python
    • Docker
    • Grafana
    • Postgres
    • CDC systems
    • Data related products (airflow jupyter spark etc)

    • The projects will be varied and were looking for someone who can work autonomously and proactively to scope problems and solve and deliver pragmatic solutions

Our Tech Stack...

    • Python as our main programming language
    • Terraform on Spacelift for our infrastructure definition and deployment
    • Kubernetes for data services and task orchestration
    • Airflow for job scheduling and tracking
    • Circle CI for continuous deployment
    • Databricks for our data lake platform
    • Parquet and Delta file formats on S3 for data lake storage
    • Postgres / aurora for our relational databases
    • Spark for data processing
    • dbt for data modelling
    • SparkSQL for analytics
    • Streamlit for data applications

Why else youll love it here




Employment Type

Full-Time

Report This Job
Disclaimer: Drjobpro.com is only a platform that connects job seekers and employers. Applicants are advised to conduct their own independent research into the credentials of the prospective employer.We always make certain that our clients do not endorse any request for money payments, thus we advise against sharing any personal or bank-related information with any third party. If you suspect fraud or malpractice, please contact us via contact us page.