Scraping for a leading company in the right to be forgotten

Customer Needs

The customer, an association of Italian freelancers, aimed to protect the right to be forgotten online of its members. With increasing personal information available online, there was concern that some search results could damage the reputation and privacy of professionals. Consequently, the client needed an effective system to identify and manage violations of the right to be forgotten online involving Italian freelancers.

Implemented Solution

Crawling and Scraping Google Results
We developed a crawling and scraping system for Google search results related to Italian freelancers. Using a dynamic keyword composition, we acquired search results through web scraping. Subsequently, we performed a preprocessing process to verify the relevance of the results to the search and clean noise from the collected data.

Text Analysis and Sentiment Analysis
We used a text analytics system to extract and structure text from the collected search results. Next, we applied sentiment analysis to determine if the tone of the article was positive or negative. This step was crucial for identifying potential violations of the right to be forgotten online, as content with a negative sentiment could damage the reputation of freelancers.

Machine Learning System for Determining Right to Be Forgotten Violations
Finally, we implemented a machine learning system to determine if text with negative sentiment was relevant to the right to be forgotten. This system utilized advanced machine learning models to analyze structured data and identify violations of the right to be forgotten effectively and accurately. This way, the client was able to quickly identify and address privacy and reputation violations of its members online.