Data Engineer Extraction & Ingestion (Python)
Turn raw market noise into Europes most trusted curated foodindustry market intelligence insights
AINSIGHTS turns raw market signals into clear actionable insights for decision makers at names like McCain FrieslandCampina and AholdDelhaize. Our data pipelines are the first mile of that journey. As our next Data Engineer youll play a vital role in the ingestion layer designing resilient scrapers and API connectors that keep fresh highquality data flowing 24/7.
Full-time Amsterdam
What you will be doing
You are co-responsible for the front door of our central data platform
Ingest structured & unstructured data through robust Python scrapers and API connectors.
Orchestrate the early ELT steps: validation normalization schema mapping so downstream teams start with trustworthy tables.
Observe & debug: surface anomalies fast with rich logging metrics and alerting; dive into IDElevel debugging when things break.
Raise the bar: code reviews test coverage and clean architecture; leave every module better than you found it.
Embed AI (Azure OpenAI & Cognitive Services) to autoclassify summarize and deduplicate news documents and web content.
Projects youll tackle in the first year
Migrate legacy scrapers to Azure Functions with retry logic exponential backoff and structured logs.
AIpowered news crawler that tags relevance and generates summaries enriching the curated dataset.
Documenttoinsight pipeline to extract vectorize and summarize PDF/Office files at scale.
Ongoing work you will contribute to
Build & maintain Python ingestion jobs and first-step ELT pipelines.
Deploy and observe services through Azure DevOps and Docker.
Keep our data platform reliable scalable and secure
Follow data engineering best practices for design testing and documentation.
Build and maintain cloud infrastructure in Azure to support scalable and secure data ingestion processes.
Tech stack
Daily tools
Python (including Pandas Selenium and internal SDKs)
API integration (REST GraphQL)
Azure DevOps (Git version control CI/CD pipelines)
Docker & Azure Container Registry
Azure Function Apps & Logic Apps
Youll also touch
Azure AI Services & AI Foundry
SQL (SQL Server Management Studio / Azure Data Studio)
Azure Key Vault
Azure Storage Services (Blob Table Queue)
Azure Monitor / Application Insights
Havent used every tool yet If youve mastered similar tech and love learning well back you.
Who youll be working with:
Martijn
Head of Product & Tech
Wilco
Technical Lead Platform
Jan
Senior Data Engineer
Your Talent
24 years of professional software development (preferably Python).
Proven track record building and maintaining productiongrade codebases.
Git power user branching rebasing PR reviews and CI checks are second nature.
Solid grasp of clean code architectural patterns and debugging.
Comfortable working with datasets dataquality rules formats and transformations.
Bonus points Web scraping Selenium SQL optimization Azure Pandas or NumPy.
Passion beats checklist perfection: if you tick most boxes lets talk.
What we offer:
Competitive salaryannually including 8 % holiday allowance.
Performance bonus up to 10% of gross salary.
Hybrid work: 25 days/week in our Amsterdam HQ
Personal growth plan and budget for both hard & soft skills.
A supportive team of experienced engineers (pairprogramming architecture sparring).
Regular company events dinners BBQs boat trips padel tournaments because fun fuels focus.
Who Youll Be Working With
Jan Senior Data Engineer
Wilco Technical Lead Platform
Martijn Head of Product & Tech
A-INSIGHTS
We enable the worlds biggest food companies like McCain Royal FrieslandCampina Ahold Delhaize Puratos Savencia and more to save time deepen insights and seamlessly share knowledge. With a strong product a clear mission and rapid growth ahead theres never been a better time to join us.
Our Amsterdam team is a vibrant mix of 15 nationalities who blend curiosity with craft (and occasionally turn each other into works of art).
Ready to be our next secret ingredient
Application process
Online Skill-Based Assessment:If we see a match between your profile and our vacancy well invite you to take an online assessment.
Screening Call:If the assessment is successful you will receive a call from us with some follow-up questions.
In-Person Interview:If there is still a match youll be invited to our Amsterdam office for an introductory chat to assess your fit with our team and culture.
Case Preparation:If everybody is still excited youll work on a case to prepare for the next interview.
In-Depth Interview:During this interview we will review your case and discuss your technical skills. We will also leave plenty of space for your questions.
Offer:If everything aligns well make you an offer you cant refuse.
We aim to finalize the hiring process in a period of 3-6 weeks.
Were serious about inclusion
Research shows some groups only apply when they meet every requirement. If youre excited by this role but your experience doesnt line up perfectly please apply anywaywed love to hear your story.
Ready to be our next secret ingredient
Have Questions For any inquiries or additional information please contact Nofar Biran.
FD Gazellen 2018
Nr. 17 van NL
Sprout
Top 25 onder de 25
ECE & RSM
Top 250 Growth Companies
Deloitte - Fast 50
Technology top 50 in NL
