May 24, 2019
This talk will share the detailed methodology used to restructure a job aggregator site, which, like many large websites had huge problems with indexability, and the rules used to direct robot crawl, taking the site from over 2.5 million URLs to just 20,000. It will cover crawling and indexing issues and dive into the case study aided by flow charts to explain the full approach used to restructure the site and how to implement it.