Web Scraping - Portfolio

Web Scraping Projects come in all shapes and sizes. From scraping 1MM+ web pages to supporting JS rendering to even interacting with the DOM via keyboard and mouse.

I can't post details of all my past scrapes but here are some samples.

hourlySERP ability to scrape keywords from Google SERP every hour and trigger emails when changes are detected

bountify.co was a one time use scraper that pulls down authors on seekingalpha

Puppteer script for scraping 500k+ URLs to extract the article, author, date and # of likes and comments

Extracted HTML from 135k+ webpage using phantomjs for building a dynamic redirect mapping

Extract 4k+ Company Details including Name, URL, Career URL and Funding Status

Script that would take a home address, verify the address and pull down public data of owners, mortgage and details of property