Identifying duplicate data

[Aby]

Hi everybody,
I'm migrating a table that has above 20,000 records and lot of duplication.Let's say an Employee table with multiple records having slight
diference in the EmployeeName field.Now nobody would like to sit and manually identify them with such hugh number of records.
Is there any way which would help me identify most of them and
reduce the redundancy.


Thanx
Aby...

Well, do you have something like an EmployeeSSN (soc security number) associated with these records? Or even a street address or phone number? These sort of secondary keys can help you eliminate duplicates.


------------
Aby at 3/9/01 3:05:08 PM


Hi everybody,
I'm migrating a table that has above 20,000 records and lot of duplication.Let's say an Employee table with multiple records having slight
diference in the EmployeeName field.Now nobody would like to sit and manually identify them with such hugh number of records.
Is there any way which would help me identify most of them and
reduce the redundancy.


Thanx
Aby...

[K]

Email me & let me know if u've sorted the problem out yet...otherwise I could give u a script which will create a new table which will remove all duplicates
referencing to any type of column....I had the same problem and it works

K