Senior .NET Developer, Web Scraping & Crawlers
Harphil Software Solutions
AI assistant
Job Description
About the Role
Were hiring a Senior .NET Developer for a hands-on C# web scraping role on an API-first SaaS platform that extracts data from hundreds of external websites and processes millions of records a month. If you have not personally written production scrapers in C#/.NET, this role is not the right fit.
What you do
- Build and maintain C# crawlers that extract structured data from hundreds of external websites
- Handle dynamic, JavaScript-heavy sites, logins, pagination and file downloads (Playwright, Selenium, PuppeteerSharp, HtmlAgilityPack)
- Get past blocking: CAPTCHAs, IP bans, rate limits, browser fingerprinting, proxy rotation
- Fix scrapers quickly when websites change, and monitor scraper health at scale
- Build and evolve REST APIs in C#/.NET and design database tables for high-volume data
- Lead production troubleshooting and root-cause analysis; take part in