Python Developer (Web scraping)
Share
Job Location:
Monthly Salary:
Posted on:
2 hours ago
Vacancies:
1 Vacancy
Job Summary
As a Python Developer within the scraping team you will be among our talented and passionate team helping us optimize data collection!
Design implement and document robust Scrapy spiders ensuring resilience against future website changes while maintaining existing ones.
Conduct comprehensive code review and data validation to maintain the highest standards of code and data quality.
Leverage in-depth knowledge of the HTTP protocol the mechanisms of modern web browsers and our own internal tools to design sophisticated web crawling solutions that bypass advanced anti-bot countermeasures.
Architect and contribute to significant new developments across multiple codebases providing clear technical documentation and conducting training sessions for relevant teams when necessary.
Qualifications :
Masters degree in Computer Science IT or a related field.
At least 3 years of professional experience in software engineering.
Proficiency in writing production-quality Python code.
Familiarity with HTML and JavaScript with a solid understanding of single-page applications.
Experience with RESTful and/or GraphQL APIs.
Hands-on experience with major Python web frameworks such as Django FastAPI or similar.
Knowledge of the scraping framework Scrapy is a plus.
Experience with time series databases such as InfluxDB is advantageous.
Strong skills in Docker Git pandas regular expressions Linux and bash scripting.
Proven experience with major cloud providers such as AWS GCP or Azure.
You are enthusiastic motivated autonomous.
You like tackling mentally-stimulating software engineering challenges.
You are passionate about tech and learning new things.
Additional Information :
Our Benefits
- Flexible working environment
- Volunteer time off
- LinkedIn Learning
- Employee-Assistance-Program (EAP)
About NIQ
NIQ is the worlds leading consumer intelligence company delivering the most complete understanding of consumer buying behavior and revealing new pathways to 2023 NIQ combined with GfK bringing together the two industry leaders with unparalleled global reach. With a holistic retail read and the most comprehensive consumer insightsdelivered with advanced analytics through state-of-the-art platformsNIQ delivers the Full View. NIQ is an Advent International portfolio company with operations in 100 markets covering more than 90% of the worlds population.
For more information visit
Want to keep up with our latest updates
Follow us on: LinkedIn Instagram Twitter Facebook
Our commitment to Diversity Equity and Inclusion
At NIQ we are steadfast in our commitment to fostering an inclusive workplace that mirrors the rich diversity of the communities and markets we serve. We believe that embracing a wide range of perspectives drives innovation and excellence. All employment decisions at NIQ are made without regard to race color religion sex (including pregnancy sexual orientation or gender identity) national origin age disability genetic information marital status veteran status or any other characteristic protected by applicable laws. We invite individuals who share our dedication to inclusivity and equity to join us in making a meaningful impact. To learn more about our ongoing efforts in diversity and inclusion please visit the Work :
No
Employment Type :
Full-time
Key Skills
- APIs
- Docker
- Jenkins
- REST
- Python
- AWS
- NoSQL
- MySQL
- JavaScript
- Postgresql
- Django
- GIT
About Company
NIQ is the worlds leading consumer intelligence company, delivering the most complete understanding of consumer buying behavior and revealing new pathways to growth. In 2023, NIQ combined with GfK, bringing together the two industry leaders with unparalleled global reach. With a holi ... View more
