-
If you would like to post, please check out the MrExcel Message Board FAQ and register here. If you forgot your password, you can reset your password.
Getting started with PowerPivot
- Thread starter dugdugdug
- Start date
Bloody well hope so!
Upvote
0
Excel Facts
When they said...
When they said you are going to "Excel at life", they meant you "will be doing Excel your whole life".
I'm confused.
This is where I got the 10GB limit:
SQL Server 2008 R2 Express Database Size Limit Increased to 10GB - SQL Server Express WebLog - Site Home - MSDN Blogs
Upvote
0
Not even the same version, never mind same SKU.
I've got SQL Server Man Studio 2008 R2 so what's its limit?
Upvote
0
You are probably right about the file size, Express is a free verison, therefore there will be some limits, if you have a full Version, those will be removed.
Where do you get your csv files from? I might be easier to get odbc access to that database and load data in smaller chunks below a million rows, as you need them, instead of setting up a new database. And even if you have done that, the million row Limit in Excel will still exist.
Also, have you tried your VBA Code on something Close to a million rows? As far as I remember, this could be really slow/not work at all, maybe because VBA does not take advantage of several processor cores.
Have you ever worked with Excel tables and created your on columns with Excel functions? The if clauses you mentioned above could be created there as well, and whenever the data is refreshed, it would recalculate your columns automatically. If yes, you could do the same with Powerpivot, as I ried to explain above. Maybe you should just give it a try.
Last edited:
Upvote
0
Thanks for your tips.
My csv files are "floating around" at the moment, ie my programs are based on the assumption that such files exists and are stored somewhere on the network drive (which is slow) somy first step involves copying it to my C drive.
For security reasons, I have no direct access to where the data is stored, possibly in a SQL database.
A million rows is not a problem if I only do a few things to it. My method is involves using arrays so Redim myarray(1 to n, 1 to m) As Variant, where n is 200,000, m is 300 is possible (though I am not sure what the limit is) but as I constantly do my manipulation and create further sub arrays, the memory limit will be eventually be reached and the program crashes.
Isn't Excel tables used for formatting purposes? My tasks include more complicated procedures so not sure if that would work.
Upvote
0
Here is another tip, statements like that will not help you to make friends in an Excel forum.
Excel is used in a lot of different ways and can do a lot of different things. You can use it to accidently bring down a whole investment bank, if youl like that sort of thing.
I am not sure what you are trying to achieve, why you have to transform your data in the way you do, what the results should be and who is using them for what purpose.. Maybe someone could help you looking at your code and tell you if this can be achieved in another way, e.g via Excel functions or not. Good luck.
Carsten
Upvote
0
