Web Crawling & Data Extraction Engineer
Web Crawling & Data Extraction Engineer
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Job Description
Job Title: Senior Data Engineer (Web Crawler & Data Extraction)
Job Type: FullTime
About Company
PAysecure is a versatile payments processing company catering to all industries. Our platform is built to handle transactions seamlessly securely and at scaleno matter the sector. Whether youre in retail logistics fintech healthcare or any other vertical our solutions are tailored to deliver reliable and efficient payment infrastructure.
Trust us for seamless payment processing.
With a strong focus on innovation compliance and customercentricity we empower businesses to accept and manage payments effortlessly across digital and physical channels. Join us in shaping the future of commerce one transaction at a time.
Summary
To enhance user profiling and risk assessment we are building web crawlers to collect relevant user data from thirdparty sources forums and the dark web. We are seeking a Senior Web Crawler & Data Extraction Engineer to design and implement these data collection solutions.
Job Responsibilities
Design develop and maintain web crawlers and scrapers to extract data from open web sources forums marketplaces and the dark web.
Implement data extraction pipelines that aggregate clean and structure data for fraud detection and risk profiling.
Use Tor VPNs and other anonymization techniques to safely crawl the dark web while avoiding detection.
Develop realtime monitoring solutions for tracking fraudulent activities data breaches and cybercrime discussions.
Optimize crawling speed and ensure compliance with website terms of service ethical standards and legal frameworks.
Integrate extracted data with fraud detection models risk scoring algorithms and cybersecurity intelligence tools.
Work with data scientists and security analysts to develop threat intelligence dashboards from collected data.
Implement antibot detection evasion techniques and handle CAPTCHAs using AIdriven solvers where necessary.
Stay updated on OSINT (OpenSource Intelligence) techniques web scraping best practices and cybersecurity trends.
Requirements
5 years of experience in web crawling data scraping or cybersecurity data extraction.
Strong proficiency in Python Scrapy Selenium BeautifulSoup Puppeteer or similar frameworks.
Experience working with Tor proxies and VPNs for anonymous web scraping.
Deep understanding of HTTP protocols web security and bot detection mechanisms.
Experience parsing structured and unstructured data from JSON XML and web pages.
Strong knowledge of database management (SQL NoSQL) for storing largescale crawled data.
Familiarity with AI/MLbased fraud detection techniques and data classification methods.
Experience working with cybersecurity intelligence sources dark web monitoring and OSINT tools.
Ability to implement scalable distributed web crawling architectures.
Knowledge of data privacy regulations (GDPR CCPA) and ethical data collection practices.
Nice to Have
Experience in fintech fraud detection or threat intelligence.
Knowledge of natural language processing (NLP) for analyzing cybercrime discussions.
Familiarity with machine learningdriven anomaly detection for fraud prevention.
Handson experience with cloudbased big data solutions (AWS GCP Azure Elasticsearch Kafka).
Required Experience:
Manager
Employment Type
Full-Time
