Power Query is importing 16,000 columns and its slowing my process...

Guitarmageddon

Board Regular
Joined
Dec 22, 2014
Messages
159
Hey folks, hopefully this is a quick fix. I have a little survey tool that only has several columns on the input file. For some reason, when bringing into power query, its bringing in all columns known to man. I have some snips from the advanced editor below...

In the expand columns step here, you can see it starts to identify EVERYTHING....

COLUMNS 1.JPG

And here is where it finally finishes...after identifying over 16,000 columns. Without directly modifying the source template that I have the users dumping into the directory, is there a way to increase the query speed by not letting it identify all these columns? Im assuming its what is causing importing these several dozen files to take ridiculously slow. I only need to bring in up to column 6. the rest is junk, as you can see from the "remove other columns" step.

COLUMNS 2.JPG
 

Excel Facts

What does custom number format of ;;; mean?
Three semi-colons will hide the value in the cell. Although most people use white font instead.
Put a list of the column names you want into the Table.ExpandTableColumn step instead of the Table.ColumnNames function. Then delete that changed type step and redo it with just the columns you want.
 
Upvote 0
Solution
Put a list of the column names you want into the Table.ExpandTableColumn step instead of the Table.ColumnNames function. Then delete that changed type step and redo it with just the columns you want.
Yep this did the trick! Thanks for pointing that out.
 
Upvote 0

Forum statistics

Threads
1,215,156
Messages
6,123,339
Members
449,098
Latest member
thnirmitha

We've detected that you are using an adblocker.

We have a great community of people providing Excel help here, but the hosting costs are enormous. You can help keep this site running by allowing ads on MrExcel.com.
Allow Ads at MrExcel

Which adblocker are you using?

Disable AdBlock

Follow these easy steps to disable AdBlock

1)Click on the icon in the browser’s toolbar.
2)Click on the icon in the browser’s toolbar.
2)Click on the "Pause on this site" option.
Go back

Disable AdBlock Plus

Follow these easy steps to disable AdBlock Plus

1)Click on the icon in the browser’s toolbar.
2)Click on the toggle to disable it for "mrexcel.com".
Go back

Disable uBlock Origin

Follow these easy steps to disable uBlock Origin

1)Click on the icon in the browser’s toolbar.
2)Click on the "Power" button.
3)Click on the "Refresh" button.
Go back

Disable uBlock

Follow these easy steps to disable uBlock

1)Click on the icon in the browser’s toolbar.
2)Click on the "Power" button.
3)Click on the "Refresh" button.
Go back
Back
Top