Power Query Course in Spanish
Thanks Thanks:  0
Likes Likes:  0
Results 1 to 3 of 3

Thread: Power Query - does it iterate the data set for every command?

  1. #1
    Board Regular
    Join Date
    Apr 2014
    Location
    Mitten State
    Posts
    156
    Post Thanks / Like
    Mentioned
    2 Post(s)
    Tagged
    0 Thread(s)

    Default Power Query - does it iterate the data set for every command?


    Power Query - does it iterate the data set for every command?
    I have a performance question on how Power Query works. I'm hoping someone has an answer rather than me having to test on my 12-million row dataset and slow laptop.

    If I have (say) three Table.AddColumn commands, does PQ iterate through the entire dataset 3 times, or is it "smart enough" to know it can add those three columns on a single pass?

    If I were to nest the commands Table.AddColumn(Table.AddColumn(Table.AddColumn(... would that ensure PQ added the columns on a single pass?

  2. #2
    New Member
    Join Date
    Sep 2016
    Posts
    28
    Post Thanks / Like
    Mentioned
    0 Post(s)
    Tagged
    0 Thread(s)

    Default Re: Power Query - does it iterate the data set for every command?

    Hi macfuller,

    Thought this might help:

    https://www.mssqltips.com/sqlservert...e-performance/

  3. #3
    Board Regular
    Join Date
    Apr 2014
    Location
    Mitten State
    Posts
    156
    Post Thanks / Like
    Mentioned
    2 Post(s)
    Tagged
    0 Thread(s)

    Default Re: Power Query - does it iterate the data set for every command?

    Thanks. The article appears to be about query folding. My sources are (unfortunately?) usually flat files where it says folding doesn't take place, so I guess my situation applies to performance within PQ itself. In more general terms an AddColumn function appears to be something that can be represented in a SQL statement, so if PQ itself mimics SQL activities for its internal engine then maybe the same situation applies? I just don't know.

Some videos you may like

User Tag List

Tags for this Thread

Like this thread? Share it with others

Like this thread? Share it with others

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •