Import from folder but append new data only (avoid duplicates)

Melimob

Active Member
Joined
Oct 16, 2011
Messages
362
Hi - I'm very new to G&T/Power BI.

I've managed to create a set of queries based on importing a file from a folder. This is currently YTD up to 8Nov19.
Each week the same file will be dropped in for the user to refresh all queries however, in case the period of data overlaps, I want to only ensure the new records are added and avoid having duplicates.

I want to account for these scenarios:
1) if they replace the original YTD file with later data than original (think this is fine as it is how it should work)
2) if they add in a new YTD file without removing the original (this shouldn't be added as would be dupes)
3) if they add a weekly file an then at end of month, add a monthly file, want to ensure it only adds the new records

Any ideas on best practice for this as I'm sure it's common scenario?
(I've already filtered to ensure only the correct file extensions are imported)

many thanks in advance
 

Forum statistics

Threads
1,077,907
Messages
5,337,096
Members
399,125
Latest member
manibiotech

Some videos you may like

This Week's Hot Topics

Top