Senior .NET Developer, Web Scraping & Crawlers

Harphil Software Solutions

📍 India, India On-Site ⏳ 13h ago
AI assistant

Job Description

About the Role
Were hiring a Senior .NET Developer for a hands-on C# web scraping role on an API-first SaaS platform that extracts data from hundreds of external websites and processes millions of records a month. If you have not personally written production scrapers in C#/.NET, this role is not the right fit.

What you do

  • Build and maintain C# crawlers that extract structured data from hundreds of external websites
  • Handle dynamic, JavaScript-heavy sites, logins, pagination and file downloads (Playwright, Selenium, PuppeteerSharp, HtmlAgilityPack)
  • Get past blocking: CAPTCHAs, IP bans, rate limits, browser fingerprinting, proxy rotation
  • Fix scrapers quickly when websites change, and monitor scraper health at scale
  • Build and evolve REST APIs in C#/.NET and design database tables for high-volume data
  • Lead production troubleshooting and root-cause analysis; take part in