Ask HN: How do you earn a living from scraping in 2018?
36 by hoerzu | 21 comments on Hacker News.
I have been scraping housing markets. LinkedIn paired with hunter.io for creating mailing lists of companies. Recently I started MITM and Burp to intercept Apps to get direct api access. I created a docker container using different tor endpoints for different ips. I even used ssh proxying to create my own ip network. To bypass recaptcha I build a container with chrome + puppeteer with anticaptcha preinstalled and pre logged in. Yet I wonder if it is still worth it. Kinda looking for a mentor or inspiration. Been a long time HN reader and I wonder what you think? Why scraping is still worth it in 2018?
Subscribe to:
Post Comments (Atom)
-
Iranian authorities have arrested 67 people in a drive against financial crime, the judiciary said on Sunday, as the country faces renewed U...
-
CAIRO (Reuters) - Arab League Secretary General Ahmed Aboul Gheit said on Thursday that a cut in U.S. funding for a U.N. agency that helps P...
-
At least one explosion rocked a military event where Venezuelan President Nicolas Maduro was giving a speech on Saturday and the government ...
No comments:
Post a Comment