Home > Data Extraction, Data Mining, Parse Via Proxy, Scrape > Scraping with Huge Data on Electronic Tools

Scraping with Huge Data on Electronic Tools


This job was huge data extracting from ToolsTop and save them into MySQL , CSV and Spreadsheet. Although this website did not have that much security but for better performance of my Scraping Script I did manage anti-blocking strategies – just used proxy inside Scrape , Data Extraction, Data Mining , Data Harvesting.

Here I will show the partial and sample report of that Data Mining.

I have scraped on the following categories of data:

-product_name
-list_price_exclude_vat
-list_price_include_vat
-our_price_exclude_vat
-our_price_include_vat
-your_savings
-product_code
-product_images (images source link and images downloaded)

This partial report has been generated based on the following link:

http://www.toolstop.co.uk/cordless-drills-b210

Electronics product scraped and data mining

Website Page

 

After that I have generated a CSV file on these product list.

Report in CSV

Report in CSV

 

Product images were also downloaded by script:

Downloaded Automatically Product Images by Script

Downloaded Automatically Product Images by Script

 

Advertisements
  1. No comments yet.
  1. No trackbacks yet.

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s

%d bloggers like this: