The web scraping tool of my choice still has to be WWW::Mechanize for Perl. P.S....

		superasn on March 16, 2017 \| parent \| context \| favorite \| on: Web Scraping: Bypassing “403 Forbidden,” captchas,... The web scraping tool of my choice still has to be WWW::Mechanize for Perl. P.S. I wrote a WWW::Mechanize::Query ext for it so that it supports css selectors etc if anyone is interested. It's on cpan.

Same in Ruby land. That with inspector gadget and you're golden.