Senior Data Engineer (GCP)
Senior Data Engineer (GCP)
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Job Description
Role Overview:
The Audience Measurement team at Ipsos use deep understanding of peopleto make sense of audiences and how they consume use these to influence media strategy helping clients to answer crucial questions such as how to target audiences maximise attention across platforms enhance audience experience and demonstrate or increase audience value.
We are recruiting a Data Engineer for one of our flagship accounts Out Of Home Route.
Your work will be essential for the Route projects success. Building robust and scalable infrastructure and being the linchpin between the data platform and data science teams in an advisory-like role will enable data scientists to focus on research and innovation in synthetic data enhancing data-driven solutions for clients and Ipsos. You will often support the productionisation and scaling of local ML models guiding the data science teams and providing the guardrails as they develop and iterate.
What will I be doing
As a Data Engineer on the ground-breaking Route project youll develop and maintain the data infrastructure for a first-of-its-kind synthetic travel survey generating audience figures for Out-of-Home media in Great Britain. Reporting to a Principal Data and Platform Engineer you will collaborate with data scientists to design build and optimise data pipelines for high-quality audience measurement data.
Your key responsibilities will include:
- Develop robust scalable data pipelines and optimise data storage solutions on GCP.
- Implement ETL processes and CI/CD pipelines to ensure clean structured data ready for use.
- Work with data scientists to integrate synthetic models into production environments and provide the guardrails and advice as they develop.
- Provide technical support troubleshoot issues and research new technologies to enhance capabilities.
- Document pipelines and the platform including architectures and user guideshelping to enforce data management standards.
- Participate in agile ceremonies and provide occasional client interaction.
- Engage in DataOps practices and improve data delivery performance.
Our Tech Stack:
- GCP: GCS BigQuery GKE Artifact Registry Vertex AI App Engine Data Store Secret Manager Pub/Sub
- Open-Source Tools: Argo Workflows Argo Events dbt Elementary Cerberus Terraform Jupyter Hub Docker Kubernetes
- Coding Languages: Python SQL JavaScript (minimal)
- CI/CD & PM Tools:Azure DevOps Confluence
What do I need to bring with me
It is essential that your personal attributes compliment your technical be successful in this role you will need the following skills and experience:
- A minimum of 3 years relevant commercial experience with experience of scalable data pipelines using Argo on GKE SQL on BigQuery Python libraries like Pandas.
- Comfortable with APIs and Cloud storage systems.
- Basic web application development knowledge using Flask HTML JavaScript.
- Experience with containerisation (Docker) and orchestration (Kubernetes).
- Familiarity with Terraform and data systems optimisation.
- Commitment to data quality and experience in synthetic data AI/ML model deployment.
- Excellent communication skills and a collaborative and positive mindset.
- Willingness to learn.
- GCP certifications are a plus.
Benefits:
We offer a comprehensive benefits package designed to support you as an individual. Our standard benefits include 25 days annual leave pension contribution income protection and life assurance. In addition there are a range health & wellbeing financial benefits and professional development opportunities.
We realise you may have commitments outside of work and will consider flexible working applications - please highlight what you are looking for when you make your application. We have a hybrid approach to work and ask people to be in the office or with clients for 3 days per week.
We are committed to equality treating people fairly promoting a positive and inclusive working environment and ensuring we have diversity of people and views. We recognise that this is important for our business success - a more diverse workforce will enable us to better reflect and understand the world we research and ultimately deliver better research and insight to our clients. We are proud to be a member of the Disability Confident scheme certified as Level 1 Disability Confident Committed. We are dedicated to providing an inclusive and accessible recruitment process.
Required Experience:
Senior IC
Employment Type
Full Time
