Importing data from Folder through Power Query

earthworm

Well-known Member
Joined
May 19, 2009
Messages
769
Office Version
  1. 2019
  2. 2016
Platform
  1. Windows
I have 30 files . Each files contains data of approx 6 Million. I imported the folder through Power query. Then I get and transform data and then I used the formula Excel.Workbook(Content). When I am expanding the column power query is taking too much time in loading file before I move to next step of expanding the column to show data. Is there any faster way ? Because I have to wait for hours before moving to next step. Please advice
 
Here are some thoughts:
  1. are you merging or appending? Appending is generally faster than merging but you may not have a choice
  2. I suggest you use the UI, not manually written queries. Usually the UI knows best
  3. You say it is "too slow" but you don't specify how long it is taking. I would expect such a query to take about 3-5 mins assuming pure append.
  4. What is the file extension? if it is XLSX it will probably be faster than XLSB
I am appending in power query through formula. I thought binary is faster . Are you sure binary is slower ? . UI suggest is noted
 
Upvote 0

Excel Facts

Can you sort left to right?
To sort left-to-right, use the Sort dialog box. Click Options. Choose "Sort left to right"
I have a vague recollection that Miguel Llopis told me that XLSB uses the ACE Jet Engine (of MS Access infamy) to connect and load the data, and that it's slower. No, I am not 100% sure, but that is my recollection.
 
Upvote 0
In my view and experience binary is faster and smaller in size.
 
Upvote 0

Forum statistics

Threads
1,217,359
Messages
6,136,101
Members
449,991
Latest member
IslandofBDA

We've detected that you are using an adblocker.

We have a great community of people providing Excel help here, but the hosting costs are enormous. You can help keep this site running by allowing ads on MrExcel.com.
Allow Ads at MrExcel

Which adblocker are you using?

Disable AdBlock

Follow these easy steps to disable AdBlock

1)Click on the icon in the browser’s toolbar.
2)Click on the icon in the browser’s toolbar.
2)Click on the "Pause on this site" option.
Go back

Disable AdBlock Plus

Follow these easy steps to disable AdBlock Plus

1)Click on the icon in the browser’s toolbar.
2)Click on the toggle to disable it for "mrexcel.com".
Go back

Disable uBlock Origin

Follow these easy steps to disable uBlock Origin

1)Click on the icon in the browser’s toolbar.
2)Click on the "Power" button.
3)Click on the "Refresh" button.
Go back

Disable uBlock

Follow these easy steps to disable uBlock

1)Click on the icon in the browser’s toolbar.
2)Click on the "Power" button.
3)Click on the "Refresh" button.
Go back
Back
Top