File linking to power query very large

rich987652

New Member
Joined
May 14, 2002
Messages
29
Hi - I have data that I am using power query to merge by linking to a folder. I have in total about 1.1M rows (I've used larger datasets without this issue).

When I create a query in an empty excel file by just doing the standard Data / New Query / From File / From Folder and just creating a connection to this data, the file is 55MB if I save it at this time (even before creating a pivot table to display any actual data in this file).

For information, I've not actually performed any transformation within power query. I've just loaded the data. There are 3 files in my folder, and I'm using power query in this instance because otherwise it exceeds the maximum number of rows in excel.
 

Excel Facts

Did you know Excel offers Filter by Selection?
Add the AutoFilter icon to the Quick Access Toolbar. Select a cell containing Apple, click AutoFilter, and you will get all rows with Apple
Hi, did you even start with a blank query with this formula

= Csv.Document(File.Contents("C:\Users\JO_HOME\Documents\My Data Sources\Test Data\1500000 Sales Records.csv"), null), it took me less than 5 seconds to load 1.5 millions records into Power Query Editor

try it
 
Upvote 0

Forum statistics

Threads
1,214,958
Messages
6,122,475
Members
449,087
Latest member
RExcelSearch

We've detected that you are using an adblocker.

We have a great community of people providing Excel help here, but the hosting costs are enormous. You can help keep this site running by allowing ads on MrExcel.com.
Allow Ads at MrExcel

Which adblocker are you using?

Disable AdBlock

Follow these easy steps to disable AdBlock

1)Click on the icon in the browser’s toolbar.
2)Click on the icon in the browser’s toolbar.
2)Click on the "Pause on this site" option.
Go back

Disable AdBlock Plus

Follow these easy steps to disable AdBlock Plus

1)Click on the icon in the browser’s toolbar.
2)Click on the toggle to disable it for "mrexcel.com".
Go back

Disable uBlock Origin

Follow these easy steps to disable uBlock Origin

1)Click on the icon in the browser’s toolbar.
2)Click on the "Power" button.
3)Click on the "Refresh" button.
Go back

Disable uBlock

Follow these easy steps to disable uBlock

1)Click on the icon in the browser’s toolbar.
2)Click on the "Power" button.
3)Click on the "Refresh" button.
Go back
Back
Top