Crawler Analyst
Crawler Analyst
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Job Description
The Role
As our Crawler Analyst you will work using our internal tool to automate information extraction from websites. Every site has its own challenges so youll have to collaborate with the Bots (Python) team (and occasionally other teams and departments) to solve them as you learn as well as with the developers of this tool to propose improvements. You also have to check system logs to detect possible errors in production and deduce if something is not well defined in terms of development.
Responsibilities
- Automate information extraction for hundreds of websites using custom templates.
- Keep extraction procedures working as websites change by updating templates (YAML files)
- Validate current templates and escalate the more complex ones to the Python development team.
- Thinking about elegant reliable and long term solutions.
- Provide feedback about the tool so that we can improve it and make the job easier over time.
Qualifications :
You
- Have strong analytical and technical problemsolving skills.
- Have strong communication and organizational skills.
- Be able to work well in a team and autonomously.
- Be flexible and able to adapt easily to changes and learn quickly.
- Be able to learn new skills and tools using documentation and examples.
- Be proactive and propose solutions to detected problems and think about how to improve the process.
Requirements
- Experience in crawling scripting programming or coding is required especially good knowledge of HTML XPATH and regex.
- Experience working with Linux environments (grep awk)
- Basic knowledge of using Docker or similar tools.
- Familiarity with Agile methodologies (Scrum kanban Jira Suite...)
- Some familiarity with Python although you will not use it frequently.
- Knowledge of Git as a version control system.
- Good level of spoken and written English (we are an international team and the official language in the office is English)
Nice to have
- More experience in Python will help you to solve and detect problems easily with our tool.
- Some experience working with Proxies.
- Ability to find solutions by observing logs.
Additional Information :
What we offer
- A friendly diverse and international team.
- Youll have topnotch Private Health Insurance fully covered by the company.
- 23 working days of holidays per year plus the local public holidays.
- Indefinite Contract.
- Fridays we have reduced working hours. And every weekday during August.
- Tax relief/ Retribucin Flexible will also be available for you.
- We offer a discount with the amazing DIR gyms!
- We have a Referral policy with a very sweet Bonus scheme.
- We have a hybrid model with a flexible start time.
- At the office we offer fresh fruit and a huge variety of different kinds of milk coffee tea and cereals.
- We also host monthly after works and internal events that allow us to share good times together and learn something new!
We are an equal opportunity employer and value diversity at our company. We encourage all applicants regardless of race religion or belief (if any) color nationality ethnic or national origin gender gender identity pregnancy and maternity sexual orientation age marital and civil partnership status or disability status.
If you think this is the right move for you and you match the description just apply! Well get in touch with you for an interview if you are one of the selected candidates.
Remote Work :
No
Employment Type :
Fulltime
Employment Type
Full-time
