Power Query - daily data in individual files = slow refresh

sandwichgirl

New Member
Joined
Aug 13, 2007
Messages
31
Office Version
  1. 365
Platform
  1. Windows
Hello

I receive a daily email with a file that contains our dispatch data by customer/product. I save each file down in a folder named by date so todays file is call 24112022.

I have a PQ that sources from the sharepoint folder the files are stored in to produce a big chunk of data that sits in a data model so I can pivot the details and trend our dispatches. At the end of this year i'll end up with 365 files and then I can merge them all into 1 table, but in the meantime i need a solution to the shear amount of data the query has to refresh each day which is approx 2800 rows and 8 columns.

What I am looking for is a way that when I refresh the data it doesn't have to refresh all the data as it takes a while - what would be the best solution?

I've considered chunking up the data to monthly/quarterly tables, but is there another way?

thanks
 

Excel Facts

What is =ROMAN(40) in Excel?
The Roman numeral for 40 is XL. Bill "MrExcel" Jelen's 40th book was called MrExcel XL.

Forum statistics

Threads
1,181,171
Messages
5,928,522
Members
436,607
Latest member
MMCP15

We've detected that you are using an adblocker.

We have a great community of people providing Excel help here, but the hosting costs are enormous. You can help keep this site running by allowing ads on MrExcel.com.
Allow Ads at MrExcel

Which adblocker are you using?

Disable AdBlock

Follow these easy steps to disable AdBlock

1)Click on the icon in the browser’s toolbar.
2)Click on the icon in the browser’s toolbar.
2)Click on the "Pause on this site" option.
Go back

Disable AdBlock Plus

Follow these easy steps to disable AdBlock Plus

1)Click on the icon in the browser’s toolbar.
2)Click on the toggle to disable it for "mrexcel.com".
Go back

Disable uBlock Origin

Follow these easy steps to disable uBlock Origin

1)Click on the icon in the browser’s toolbar.
2)Click on the "Power" button.
3)Click on the "Refresh" button.
Go back

Disable uBlock

Follow these easy steps to disable uBlock

1)Click on the icon in the browser’s toolbar.
2)Click on the "Power" button.
3)Click on the "Refresh" button.
Go back
Top