Scraping Websites Is Still Legal

Demon_Skeith

Administrator
Staff member
Administrator
Top Monthly Contributor
Credits
198,418
Steal Penalty
You're Rich Money Bags Award
Profile Music
The U.S. Ninth Circuit of Appeals ruled Monday that scraping personal data from a public website is totally, entirely legal.

For those that haven’t been following the scraping saga until now, the court’s ruling is the latest in a sprawling case first launched by Linkedin in 2017 against hiQ Labs, a rival data science company that was spotted scraping personal details from LinkedIn user’s public profiles, which hiQ would then sell to corporate customers and recruiters interested in knowing, say, which employee might be likely to quit their job in the coming months. While there’s plenty of “corporate intelligence” tools that offer similar scraping services, LinkedIn wanted to make an example of hiQ, in particular, and served the company with a cease-and-desist five years ago.

At the time, LinkedIn’s counsel argued in a letter sent to the company that the professional social network had implemented “technical measures” to keep hiQ’s scraping from taking place, and that by continuing to scrape LinkedIn, hiQ was violating the Federal Computer Fraud and Abuse Act, or CFAA, a 1986 law meant to crack down on cybercriminals. But the fact that the law was written in the 80s means that the law gets invoked to penalize all sorts of cyber-adjacent behavior, from contract violations to terms of service mishaps to scraping publicly available information.

Rather than waiting for that cease-and-desist letter to turn into a full-blown lawsuit, hiQ actually sued LinkedIn—and won. In that original 2019 ruling, the Ninth Circuit found that the CFAA, outdated though it may be, doesn’t technically bar anyone from scraping data that anyone with an internet connection can access.

Naturally, LinkedIn wasn’t too happy about the decision, and tried to get the case taken to the Supreme Court last summer. The high court immediately shot the case down, arguing instead that the appeals court re-examine it in light of some recent tweaks to the CFAA that significantly pared down the definition of “hacking” under U.S. law. According to this new definition, hiQ would need to gain “unauthorized access” to LinkedIn’s systems in order for the company’s scraping to constitute a hack and therefore be punishable under CFAA.

But as the Ninth Circuit pointed out in its second pass at the ruling, “the concept of ‘without authorization’ does not apply to public websites,” because no one needs authorization to access them. That’s what makes them public.

Source
 
I feel the court does have a point in making scraping websites legal since hiQ is scraping a public website which people can publicly view. Search engines are sort of like scraping websites which can scrap websites, and index them for people to search.
 
It was always going to be weird if they said it wasn't legal. I would have assumed that as long as your site doesn't require logging in to view details, people can scrape the content on the site.
 
Seek and you shall find. Knock and the door will be opened to you. Just don't let it get in the way of my well-being and quality of life.
 
Even though it's illegal it's difficult to trace and prosecute so companies still do the practice. I get an offer at least once a month saying they can provide a list of prospects for my company with contact information.
 
Back
Top