Archive

Archive for the ‘Data Extraction’ Category

Scraping with Huge Data on Electronic Tools


This job was huge data extracting from ToolsTop and save them into MySQL , CSV and Spreadsheet. Although this website did not have that much security but for better performance of my Scraping Script I did manage anti-blocking strategies – just used proxy inside Scrape , Data Extraction, Data Mining , Data Harvesting.

Here I will show the partial and sample report of that Data Mining.

I have scraped on the following categories of data:

-product_name
-list_price_exclude_vat
-list_price_include_vat
-our_price_exclude_vat
-our_price_include_vat
-your_savings
-product_code
-product_images (images source link and images downloaded)

This partial report has been generated based on the following link:

http://www.toolstop.co.uk/cordless-drills-b210

Electronics product scraped and data mining

Website Page

 

After that I have generated a CSV file on these product list.

Report in CSV

Report in CSV

 

Product images were also downloaded by script:

Downloaded Automatically Product Images by Script

Downloaded Automatically Product Images by Script

 

Advertisements
%d bloggers like this: