Menu

Copyright © All rights reserved

Web Scraping - Portfolio



  • Web Scraping Projects come in all shapes and sizes. From scraping 1MM+ web pages to supporting JS rendering to even interacting with the DOM via keyboard and mouse.

    I can't post details of all my past scrapes but here are some samples.

    hourlySERP ability to scrape keywords from Google SERP every hour and trigger emails when changes are detected

    bountify.co was a one time use scraper that pulls down authors on seekingalpha

    Puppteer script for scraping 500k+ URLs to extract the article, author, date and # of likes and comments

    Extracted HTML from 135k+ webpage using phantomjs for building a dynamic redirect mapping

    Extract 4k+ Company Details including Name, URL, Career URL and Funding Status

    Script that would take a home address, verify the address and pull down public data of owners, mortgage and details of property