Best Way to Deduplicate Records but leave one

jscranton

Well-known Member
Joined
May 30, 2011
Messages
707
I have an extremely large table (4.8MM records) that is the result of users importing excels with the same format into this table. From what I can tell, there are a significant number of duplicates within this population (likely from users importing the same excel twice). The tricky part is that I want to remove duplicates where all fields are the same but leave at least one record. In Excel, I would just concatenate all the fields into a new column and then deduplicate the table on that concatenated field. Is there a way to do this in access?

Thanks,

J
 

Some videos you may like

Excel Facts

Which lookup functions find a value equal or greater than the lookup value?
MATCH uses -1 to find larger value (lookup table must be sorted ZA). XLOOKUP uses 1 to find values greater and does not need to be sorted.

alansidman

Well-known Member
Joined
Feb 26, 2007
Messages
5,436
Office Version
2019
Platform
Windows
It would create a query result that only lists unique rows. If you then need that somewhere else, you could do a MakeTable query, export to Excel, include in a report, etc. which only have the unique information.
 

jscranton

Well-known Member
Joined
May 30, 2011
Messages
707
Thanks. The problem is that even deduplicated it is over 2MM rows. I ended up building a new table and appending the uniques to it.
 

Watch MrExcel Video

Forum statistics

Threads
1,095,989
Messages
5,447,765
Members
405,463
Latest member
milindighe

This Week's Hot Topics

Top