WEB DATA EXTRACTION + EXCEL 2013 - large file 100MO+ crashing

laurprague

New Member
Joined
Mar 24, 2014
Messages
4
Hi, I hired a programmer to have a desktop application to extract data from a website containing 160.000 rows and 20 columns.

The programmer can download the entire 160.000 items in one single file. I can't manage to do it and it crashes at the end of the data extraction when it is time to save the file.

I have to run 5 downloads to extract the entire 160.000 items (in 5 different files). If I add up the 5 files, I reach over 400Mo (there is no pictures). the largest file is below 110Mo.

1- Is it normal that the file is so large for such a "small" number of items ?
2- Is it because of the limits of my computer / software. I currently have a notebook i7 - 6GB memory, excel 2013, x32, windows 8.1. I also tried to change the virtual memory. Do I need to change of computer and get a desktop ?
3- When I slide up and down the excel sheet, after (a short) while Excel crashes. I understand that excel 2013 might have some issues with sliding the sheet up and down. I haven't found how to solve this issue.

Regards

Laur
 

Excel Facts

How to total the visible cells?
From the first blank cell below a filtered data set, press Alt+=. Instead of SUM, you will get SUBTOTAL(9,)

Forum statistics

Threads
1,216,222
Messages
6,129,586
Members
449,520
Latest member
TBFrieds

We've detected that you are using an adblocker.

We have a great community of people providing Excel help here, but the hosting costs are enormous. You can help keep this site running by allowing ads on MrExcel.com.
Allow Ads at MrExcel

Which adblocker are you using?

Disable AdBlock

Follow these easy steps to disable AdBlock

1)Click on the icon in the browser’s toolbar.
2)Click on the icon in the browser’s toolbar.
2)Click on the "Pause on this site" option.
Go back

Disable AdBlock Plus

Follow these easy steps to disable AdBlock Plus

1)Click on the icon in the browser’s toolbar.
2)Click on the toggle to disable it for "mrexcel.com".
Go back

Disable uBlock Origin

Follow these easy steps to disable uBlock Origin

1)Click on the icon in the browser’s toolbar.
2)Click on the "Power" button.
3)Click on the "Refresh" button.
Go back

Disable uBlock

Follow these easy steps to disable uBlock

1)Click on the icon in the browser’s toolbar.
2)Click on the "Power" button.
3)Click on the "Refresh" button.
Go back
Back
Top