Normalised records

Normalised records (silver)

Each raw row is parsed into consistently formatted fields. Every change from the raw value is recorded as a data-quality flag.

Normalised rows

99,495

usable in matching

Flagged rows

99,881

99.9% carry at least one flag

Junk quarantined

505

no usable last name

Average quality score

0.75

1.00 = no corrections needed

Quality flags

What normalisation had to do, and how often. Select a flag to filter the table.

Placeholder values cleared71,257
Placeholder tokens such as NULL, N/A, UNKNOWN or "-" treated as empty
Whitespace trimmed57,061
Leading or trailing whitespace removed from one or more fields
Address re-cased56,490
Street line re-cased and punctuation removed
Street suffix standardised55,824
Street suffix standardised to USPS abbreviation (Street to St, Avenue to Ave, and so on)
Phone reformatted50,244
Phone reduced to ten digits, punctuation and leading country code removed
Name re-cased39,996
Name letter-case rewritten to Title Case and stray characters removed
Date of birth reformatted32,400
Date of birth rewritten to ISO 8601 from a source format (MM/DD/YYYY, YYYYMMDD, Mon D, YYYY)
City re-cased17,850
City re-cased to Title Case
Gender normalised16,828
Gender mapped to F or M from a longer or variant value
Email lower-cased11,635
Email lower-cased
Name split from “Last, First”9,980
First-name field held "LAST, FIRST"; the two parts were split into their own fields
State name converted to code9,084
Full state name replaced by its two-letter USPS code
ZIP+4 trimmed8,263
ZIP+4 trimmed to the five-digit ZIP
Member ID reformatted7,723
Member ID re-hyphenated and upper-cased to the UHC-#####-## pattern
ZIP missing7,146
Street address present but no ZIP supplied
Unit split from street6,994
Apartment, suite or unit designator split from street line and re-appended in standard form
Two-digit birth year6,661
Date of birth carried a two-digit year; century inferred by pivot
State code upper-cased4,010
Two-letter state code upper-cased
Plan code upper-cased3,278
Plan code upper-cased
SSN last four extracted2,817
Last four digits of SSN extracted from a longer or punctuated value
Date of birth unreadable2,274
Date of birth did not match any known format or was out of range; cleared
Phone missing area code2,021
Phone had only seven digits (no area code); cleared
Middle initial moved out of first name1,125
A single middle initial was embedded in the first-name field and moved to middle name
Date of birth missing990
Date of birth absent or a null token; left empty
No usable name (quarantined)505
No usable last name; record quarantined as junk and excluded from matching

Normalised records

Claims, flag “Email lower-cased”, lowest dq score first

All ENR CLM TPA PRV

Junk onlyFlagEmail lower-casedClear

Record	Source	Name	DOB	Member ID	Phone	Address	Quality score	Flags
CLM-416702	CLM	Douglas A Vargas	1955-09-10	UHC-95650-14	—	750 Broadway, Minneapolis, MN, 55459	0.94	Member ID reformatted Email lower-cased Placeholder values cleared
CLM-426537	CLM	Evelyn M Graham	1973-05-13	UHC-11403-48	—	—	0.94	Email lower-cased Whitespace trimmed Placeholder values cleared
CLM-400897	CLM	Olivia Wells	1950-06-10	—	7897034604	—	0.94	Phone reformatted Email lower-cased Placeholder values cleared
CLM-406943	CLM	Priya Cole	1938-06-23	—	—	—	0.94	Email lower-cased Whitespace trimmed Placeholder values cleared
CLM-418761	CLM	Cheryl Silva	1960-05-07	UHC-61430-78	3079752556	—	0.94	Date of birth reformatted Email lower-cased Whitespace trimmed
CLM-413436	CLM	Alan Sanchez	1966-11-25	UHC-35719-69	9125137199	—	0.94	Date of birth reformatted Phone reformatted Email lower-cased
CLM-426260	CLM	Russell C Mitchell	1999-04-06	UHC-20750-76	—	—	0.94	Date of birth reformatted Email lower-cased Whitespace trimmed
CLM-416621	CLM	Wayne Bailey	2007-07-10	—	7077290054	—	0.94	Email lower-cased Whitespace trimmed Placeholder values cleared
CLM-402778	CLM	Jacob Myers	1991-07-11	UHC-18643-77	—	—	0.94	Email lower-cased Whitespace trimmed Placeholder values cleared
CLM-401598	CLM	Brandon Porter	1947-04-22	—	—	—	0.94	Email lower-cased Whitespace trimmed Placeholder values cleared
CLM-404587	CLM	Mei O Morales	1960-02-17	—	2672999559	—	0.94	Phone reformatted Email lower-cased Placeholder values cleared
CLM-418966	CLM	Lori Valdez	1977-02-20	UHC-27056-91	—	—	0.94	Email lower-cased Whitespace trimmed Placeholder values cleared
CLM-420197	CLM	Maria Petterson	1961-12-26	UHC-50763-19	—	—	0.94	Date of birth reformatted Email lower-cased Placeholder values cleared
CLM-431287	CLM	Nicholas Perkins	1956-11-05	UHC-71520-80	4993429935	—	0.94	Phone reformatted Email lower-cased Placeholder values cleared
CLM-407294	CLM	Kimberly White	1944-07-03	UHC-64583-03	—	—	0.94	Email lower-cased Whitespace trimmed Placeholder values cleared
CLM-419370	CLM	Gregory Fields	1956-07-04	UHC-50997-76	4255590010	606 Sage Ct, Tempe, AZ, 85211	0.94	Email lower-cased Whitespace trimmed Placeholder values cleared
CLM-409241	CLM	Brian Contreras	1961-03-10	—	—	—	0.94	Date of birth reformatted Email lower-cased Placeholder values cleared
CLM-421990	CLM	Elijah Greene	1988-08-10	UHC-82662-56	—	8413 Church St, Phoenix, AZ, 85050	0.94	Email lower-cased Whitespace trimmed Placeholder values cleared
CLM-421989	CLM	Elijah Greene	1988-08-10	UHC-82662-56	—	8413 Church St, Phoenix, AZ, 85050	0.94	Email lower-cased Whitespace trimmed Placeholder values cleared
CLM-411580	CLM	Samuel Williamson	1960-08-28	—	—	1245 Sage Ct, Orlando, FL, 32837	0.94	Name re-cased Email lower-cased Placeholder values cleared
CLM-428280	CLM	Emily Montgomery	2004-03-03	—	—	233 Oak St, Denver, CO, 80292	0.94	Email lower-cased Whitespace trimmed Placeholder values cleared
CLM-427907	CLM	Emma Clarrk	2005-11-07	UHC-74207-75	—	8762 River Rd, Phoenix, AZ, 85083	0.94	Date of birth reformatted Email lower-cased Placeholder values cleared
CLM-431066	CLM	Carl Lynch	2003-02-23	UHC-43141-12	—	9073 River Rd, Tempe, AZ, 85212	0.94	Name re-cased Email lower-cased Placeholder values cleared
CLM-408435	CLM	Ryan Diaz	1991-04-01	UHC-85118-52	3212105174	—	0.94	Name re-cased Email lower-cased Placeholder values cleared
CLM-404539	CLM	Lisa Silva	2002-04-16	UHC-88580-44	—	—	0.94	Name re-cased Email lower-cased Placeholder values cleared
CLM-412118	CLM	Aaron Daniels	2004-01-07	—	—	—	0.94	Email lower-cased Whitespace trimmed Placeholder values cleared
CLM-422343	CLM	Martha Dixon	1980-12-27	UHC-22273-83	7392825747	6794 Park Pl, Atlanta, GA, 30377	0.94	Date of birth reformatted Phone reformatted Email lower-cased
CLM-427024	CLM	Wayne Boyd	1966-06-01	UHC-37084-54	—	—	0.94	Name re-cased Email lower-cased Placeholder values cleared
CLM-402493	CLM	Mei Torres	1955-05-20	UHC-14646-55	—	—	0.94	Email lower-cased Whitespace trimmed Placeholder values cleared
CLM-410427	CLM	Jerry Woods	1995-08-03	—	—	2742 Oak St, Minneapolis, MN, 55406	0.94	Date of birth reformatted Email lower-cased Placeholder values cleared
CLM-401807	CLM	Joyce Carlson	1956-07-15	—	4963618160	—	0.94	Name re-cased Email lower-cased Placeholder values cleared
CLM-407105	CLM	Emma Harrison	1966-03-10	—	—	344 Grand Ave, Tampa, FL, 33626	0.94	Name re-cased Email lower-cased Whitespace trimmed
CLM-414430	CLM	Justin Snyder	1941-02-25	—	—	—	0.94	Email lower-cased Whitespace trimmed Placeholder values cleared
CLM-431603	CLM	Nicholas Cooper	2003-05-19	UHC-45127-30	—	—	0.94	Email lower-cased Whitespace trimmed Placeholder values cleared
CLM-408765	CLM	Linda Wang	1951-03-02	UHC-62194-36	—	—	0.94	Name re-cased Email lower-cased Placeholder values cleared
CLM-412981	CLM	Michelle Gibson	1978-12-19	—	—	6564 Indian School Rd, Glendale, AZ, 85349	0.94	State code upper-cased Email lower-cased Placeholder values cleared
CLM-402115	CLM	Priya Bradley	1940-08-10	UHC-02485-02	2195524475	553 Highland Ave, Fresno, CA, 93795	0.94	Email lower-cased Whitespace trimmed Placeholder values cleared
CLM-409087	CLM	Keith Marquez	1955-10-10	UHC-58160-46	—	7217 Spring St, Seattle, WA, 98195	0.94	Date of birth reformatted Email lower-cased Placeholder values cleared
CLM-422192	CLM	Alexander Wells	1997-01-06	UHC-49517-10	—	5592 Broadway, Los Angeles, CA, 90067	0.94	Email lower-cased Whitespace trimmed Placeholder values cleared
CLM-432515	CLM	Isabella Gordon	2007-08-24	UHC-44059-85	—	—	0.94	Email lower-cased Whitespace trimmed Placeholder values cleared
CLM-413482	CLM	Austin Hannson	1974-09-09	UHC-99877-94	—	1610 Church St, Phoenix, AZ, 85030	0.94	Email lower-cased Whitespace trimmed Placeholder values cleared
CLM-431192	CLM	Austin Lcas	1968-09-07	UHC-75664-62	—	4175 Broadway, Seattle, WA, 98137	0.94	Email lower-cased Whitespace trimmed Placeholder values cleared
CLM-413085	CLM	Hiroshi Rogers	1986-08-07	UHC-98848-91	—	—	0.94	Email lower-cased Whitespace trimmed Placeholder values cleared
CLM-416039	CLM	Eugene Hall	1955-04-03	—	3839135842	8430 Palm Dr, Orlando, FL, 32868	0.94	Email lower-cased Whitespace trimmed Placeholder values cleared
CLM-428989	CLM	Arjun M Valdez	1972-04-27	UHC-77194-97	9607254835	—	0.94	Email lower-cased Whitespace trimmed Placeholder values cleared
CLM-419350	CLM	Marilyn Ray	1980-11-13	—	—	—	0.94	Date of birth reformatted Email lower-cased Placeholder values cleared
CLM-412582	CLM	Richard Simmons	1979-11-13	UHC-95902-92	—	7176 Market St, Houston, TX, 77050	0.94	Name re-cased Email lower-cased Placeholder values cleared
CLM-411779	CLM	Natalie Morris	2000-10-13	UHC-66123-66	—	8480 Desert Sky Blvd, Seattle, WA, 98125	0.94	Email lower-cased Whitespace trimmed Placeholder values cleared
CLM-416794	CLM	Mson Garcia	2005-05-04	UHC-90864-72	7774349539	—	0.94	Phone reformatted Email lower-cased Placeholder values cleared
CLM-403822	CLM	Gerald F Miller	1983-04-03	UHC-84890-95	8506331760	—	0.94	Date of birth reformatted Email lower-cased Whitespace trimmed

989 rows, page 19 of 20Previous Next