Crawling - The Most Underrated Hack
Tom Tunguz
MARCH 4, 2013
But a few weeks ago, one of our entrepreneurs-in-residence, Javier , who joined Redpoint from VMWare, told me about a Ruby gem called Mechanize that makes it really easy to crawl websites, particularly those with username/password logins. All of that information is useful for me. H/t to Lachy Groom who helped me refactor a bit.
Let's personalize your content