Best Way to Deduplicate Records but leave one

jscranton

Well-known Member
Joined
May 30, 2011
Messages
707
I have an extremely large table (4.8MM records) that is the result of users importing excels with the same format into this table. From what I can tell, there are a significant number of duplicates within this population (likely from users importing the same excel twice). The tricky part is that I want to remove duplicates where all fields are the same but leave at least one record. In Excel, I would just concatenate all the fields into a new column and then deduplicate the table on that concatenated field. Is there a way to do this in access?

Thanks,

J
 

Excel Facts

What does custom number format of ;;; mean?
Three semi-colons will hide the value in the cell. Although most people use white font instead.
It would create a query result that only lists unique rows. If you then need that somewhere else, you could do a MakeTable query, export to Excel, include in a report, etc. which only have the unique information.
 
Upvote 0
Thanks. The problem is that even deduplicated it is over 2MM rows. I ended up building a new table and appending the uniques to it.
 
Upvote 0

Forum statistics

Threads
1,213,524
Messages
6,114,117
Members
448,549
Latest member
brianhfield

We've detected that you are using an adblocker.

We have a great community of people providing Excel help here, but the hosting costs are enormous. You can help keep this site running by allowing ads on MrExcel.com.
Allow Ads at MrExcel

Which adblocker are you using?

Disable AdBlock

Follow these easy steps to disable AdBlock

1)Click on the icon in the browser’s toolbar.
2)Click on the icon in the browser’s toolbar.
2)Click on the "Pause on this site" option.
Go back

Disable AdBlock Plus

Follow these easy steps to disable AdBlock Plus

1)Click on the icon in the browser’s toolbar.
2)Click on the toggle to disable it for "mrexcel.com".
Go back

Disable uBlock Origin

Follow these easy steps to disable uBlock Origin

1)Click on the icon in the browser’s toolbar.
2)Click on the "Power" button.
3)Click on the "Refresh" button.
Go back

Disable uBlock

Follow these easy steps to disable uBlock

1)Click on the icon in the browser’s toolbar.
2)Click on the "Power" button.
3)Click on the "Refresh" button.
Go back
Back
Top