MrExcel Message Board

Go Back   MrExcel Message Board > Question Forums > Excel Questions

Excel Questions All Excel/VBA questions - formulas, macros, pivot tables, general help, etc. Please post to this forum in English only.

Reply
 
Thread Tools Display Modes
Old Apr 6th, 2002, 12:05 AM   #1
Bukol
Board Regular
 
Join Date: Mar 2002
Location: Philippines
Posts: 55
Default

Hi there
I am using Excel 2000.
I created a workbook with several macros which do the following:
From sheet 1, using a web query it extracts a table of data from an external website and puts it in a range of cells on sheet 1.
It then copies one by one 9 different cells from that range and pastes it into a different order on sheet 3.
Then using a list of keywords stored on sheet 2, it repeats the procedure but going to a different page on the website.
There are alltogether 26 cut or copy or paste actions involved in one run, which apparently slows everything down.
When I first started to run that thing, it extracted about 40 sets of data a minute. Then, after about 1000 runs, it slowed down to 1 set in 3 minutes!
I changed the code by adding a macro to cut the accumulated data on sheet 3 and pasted it into a second workbook. It helped a little, now I extract about 3 sets per minute. The speed is now constant. But not good enough. I have to extract 130000 sets of data, that would take me about a month of permanent running to extract them all!!!
Any idea how to speed that thing up?
If needed I would send you the complete code.
Hans
Bukol is offline   Reply With Quote
Old Apr 6th, 2002, 02:26 AM   #2
Jack in the UK
Board Regular
 
Join Date: Feb 2002
Posts: 3,065
Default

Hi

Always best to post up codes so programers can have a once over..

resources are the key in windows OP enviorments and this will be much of the issues..

check my posts previously from in for on these, or re post on this feed if perticula issues you need to ask
__________________
Free Excel based Web Toolbar available here.

Jack in the UK
J & R Excel Solutions
"making Excel work for you"
Jack in the UK is offline   Reply With Quote
Old Apr 6th, 2002, 05:01 PM   #3
Jay Petrulis
MrExcel MVP
 
Jay Petrulis's Avatar
 
Join Date: Mar 2002
Location: Chicago, IL USA
Posts: 2,042
Default

Hi Hans,

Without seeing your code, it would be hard to determine exactly how to speed the routine.

The standards for calculation speed include:

1. Turn off screen updating
Application.ScreenUpdating = False

2. Turn off auto calc
Application.Calculation = xlCalculationManual

be careful with this one, though and be sure to turn it back to auto when necessary
Application.Calculation = xlCalculationAutomatic

3. Make your code as efficient as possible and never select anything unless required.

Search http://www.decisionmodels.com for a bunch of details about code efficiency.

I agree with Jack, though, on this one in that you'll get a better response if you post the code you are using.

HTH,
Jay
Jay Petrulis is offline   Reply With Quote
Old Apr 7th, 2002, 03:52 AM   #4
Bukol
Board Regular
 
Join Date: Mar 2002
Location: Philippines
Posts: 55
Default

I found out that I get the best speed when I first open the workbook and then extract about 20 addresses. After that it starts slowing down. So if I close the workbook again and open it again, it starts with the same efficient speed. I suppose that the many copy/cut and paste operations will be written somewhere to a back memory and once this is getting filled up the speed slows down. Any idea how I can prevent that or do I have to add a macro to close and reopen the workbook after lets say 20 - 25 runs, and how to do that?
Hans
Bukol is offline   Reply With Quote
Old Apr 7th, 2002, 03:59 AM   #5
Dave Hawley
Banned
 
Join Date: Feb 2002
Posts: 1,582
Default

Hi Hans

I would guess your problem could be due to NOT bypassing the ClipBoard in Excel and hence filling it up..

Sheet1.Range("A1:A100").Copy Desination:=Sheet2.Range("A1")

Is the preffered way of copying/cutting in Excel.

I have many ways and means that can (and should) be used found here:

http://www.ozgrid.com/VBA/SpeedingUpVBACode.htm
Dave Hawley is offline   Reply With Quote
Old Apr 7th, 2002, 06:56 AM   #6
Bukol
Board Regular
 
Join Date: Mar 2002
Location: Philippines
Posts: 55
Default

Dave
Thanks, it works fine. One more line I need though:
Cut and paste into a worksheet in another open workbook by avoiding the clipboard.
Hans
Bukol is offline   Reply With Quote
Old Apr 7th, 2002, 07:34 AM   #7
Dave Hawley
Banned
 
Join Date: Feb 2002
Posts: 1,582
Default

Hi Hans

Try:

Code:
Sheet1.Range("A1:A100").Cut Destination:= _
Workbooks("Book1.xls").Sheets("Sheet2").Range("A1")
_________________
Kind Regards
Dave Hawley
OzGrid Business Applications
Microsoft Excel/VBA Training


[ This Message was edited by: Dave Hawley on 2002-04-07 06:35 ]
Dave Hawley is offline   Reply With Quote
Old Apr 7th, 2002, 09:21 AM   #8
Bukol
Board Regular
 
Join Date: Mar 2002
Location: Philippines
Posts: 55
Default

Thanks Dave,
It works again.
Let me run it overnight (it's now 11:30 PM in the Philippines), and I will see tomorrow whether the speed stay's constant.
Hans
Bukol is offline   Reply With Quote
Old Apr 7th, 2002, 08:04 PM   #9
Dave Hawley
Banned
 
Join Date: Feb 2002
Posts: 1,582
Default

Hi Hans

If it doesn't help, just post your entire code.



Dave Hawley is offline   Reply With Quote
Old Apr 8th, 2002, 11:45 AM   #10
Bukol
Board Regular
 
Join Date: Mar 2002
Location: Philippines
Posts: 55
Default

Hi Guys
Anybody who helped me on this one, THANKS.
Actuall, the solution was to delete the worksheet where the data where coming in after 100 runs, add a new sheet and do the next 100 runs.
It's running now with a speed of 40 sets of data per minute and thats beautiful.
Thanks again
Hans
Bukol is offline   Reply With Quote
Reply

Bookmarks

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is On

Forum Jump


All times are GMT -4. The time now is 08:14 AM.


Powered by vBulletin® Version 3.8.7
Copyright ©2000 - 2012, vBulletin Solutions, Inc.
All contents Copyright 1998-2012 by MrExcel Consulting.
diabetic desserts recipes recipes Diabetic Soups Holiday Pizza Recipes Popcorn Recipes Recipes For Microwave Pasta Recipes Casserole Recipes Chili Recipes Curry Recipes Crockpot Recipes Apples Recipes Bread Recipes Vegetarian Recipes Vegetable recipes Desserts Recipes Appetizers Ethnic Recipes Meat Dishes Barbecue Recipes Sauces Recipes Marinade Recipes Low Fat Recipes Frugal Gourmet Kitchen Classics Recipes On The Grill Cook Books Seafood Recipes Cajun Recipes Breads Low Fat Low Fat Breads Bread Machine Recipes Yeast Breads Quick Breads Fat Free Vegetarian Salad Recipes Eggplant Recipes Radish Recipes Tomato Recipes Jalapeno Recipes Potato Recipes Lettuce Recipes Cabbage Recipes Beans Ambrosia Recipes Biscotti Recipes Desserts Low Fat Cookie Recipes Cheesecake Recipes Cake Recipes Pie Recipes Muffin Recipes Custard Recipes Best Appetizers Appetizers Low Fat Salsa Recipes Dip Recipes International Recipes Afghan Recipes Alaska Recipes French Recipes German Recipes Greek Recipes Italian Recipes Spanish Recipes Thai Recipes Korean Recipes Chinese Recipes Mexican Recipes Indian Recipes Beef Recipes Pork Pork & Ham Pork Butts Pork Chop Recipes Pork Ribs Rulled Pork Poultry Recipes Stews Recipes Ground Beef Barbecue Grill Barbecue Smoker All Purpose Sauce BBQ Sauce Barbecue Sauce Carolina BBQ Sauce Pickle Recipes Marinades Smoking Low Fat Appetizers & Dips Low Fat Breakfast Low Fat Cakes Low Fat Cheesecakes Low Fat Cookies Low Fat Desserts Low Fat Fish & Seafood Low Fat Meats Low Fat Pasta Low Fat Pies Low Fat Salads Low Fat Sandwiches Low Fat Sauces & Condiments Low Fat Sides Low Fat Soups Low Fat Vegetarian Baker's Dozen Taste of Home Recipe Book Bon Appetit Cookbook Blacktie Cookbook Buster Cook Book Cookbook USA Cook Book Cook Book Sara's Cookbook Sara's Cookbook Appetizers and Dips Poultry recipes Diabetic recipes Holiday recipes Miscellaneous recipes 110 recipes 1986 Usenet cookbook 2900 recipes Cyberrealm recipes Great sysops of world Specialty recipes Ceideburg recipes Cheese recipes Chili recipes Fruits recipes Garlic recipes Great chefs of NY Londontowne recipes Raisins recipes Recipes for kids US Food Vegetarian recipes Bread recipes Drinks Meat Dishes Brisket recipes Caribou recipes Chicken recipes Filet mignons recipes Pork recipes Swordfish recipes Turkey recipes Pasta recipes Uncategorized recipes Ethnic recipes Canada recipes English recipes Ethiopia recipes Germany recipes Greece recipes Mexican recipes Philippines recipes Welsh recipes Microwave recipes Soups recipes Vegetable recipes Asparagus recipes Barley recipes Brown rice recipes Lentil recipes Mushrooms recipes Salads recipes Wild rice Desserts recipes Cakes recipes Chocolate recipes Cookies recipes Ice cream recipes