Normalised records

Normalised records (silver)

Each raw row is parsed into consistently formatted fields. Every change from the raw value is recorded as a data-quality flag.

Normalised rows

99,495

usable in matching

Flagged rows

99,881

99.9% carry at least one flag

Junk quarantined

505

no usable last name

Average quality score

0.75

1.00 = no corrections needed

Quality flags

What normalisation had to do, and how often. Select a flag to filter the table.

Placeholder values cleared71,257
Placeholder tokens such as NULL, N/A, UNKNOWN or "-" treated as empty
Whitespace trimmed57,061
Leading or trailing whitespace removed from one or more fields
Address re-cased56,490
Street line re-cased and punctuation removed
Street suffix standardised55,824
Street suffix standardised to USPS abbreviation (Street to St, Avenue to Ave, and so on)
Phone reformatted50,244
Phone reduced to ten digits, punctuation and leading country code removed
Name re-cased39,996
Name letter-case rewritten to Title Case and stray characters removed
Date of birth reformatted32,400
Date of birth rewritten to ISO 8601 from a source format (MM/DD/YYYY, YYYYMMDD, Mon D, YYYY)
City re-cased17,850
City re-cased to Title Case
Gender normalised16,828
Gender mapped to F or M from a longer or variant value
Email lower-cased11,635
Email lower-cased
Name split from “Last, First”9,980
First-name field held "LAST, FIRST"; the two parts were split into their own fields
State name converted to code9,084
Full state name replaced by its two-letter USPS code
ZIP+4 trimmed8,263
ZIP+4 trimmed to the five-digit ZIP
Member ID reformatted7,723
Member ID re-hyphenated and upper-cased to the UHC-#####-## pattern
ZIP missing7,146
Street address present but no ZIP supplied
Unit split from street6,994
Apartment, suite or unit designator split from street line and re-appended in standard form
Two-digit birth year6,661
Date of birth carried a two-digit year; century inferred by pivot
State code upper-cased4,010
Two-letter state code upper-cased
Plan code upper-cased3,278
Plan code upper-cased
SSN last four extracted2,817
Last four digits of SSN extracted from a longer or punctuated value
Date of birth unreadable2,274
Date of birth did not match any known format or was out of range; cleared
Phone missing area code2,021
Phone had only seven digits (no area code); cleared
Middle initial moved out of first name1,125
A single middle initial was embedded in the first-name field and moved to middle name
Date of birth missing990
Date of birth absent or a null token; left empty
No usable name (quarantined)505
No usable last name; record quarantined as junk and excluded from matching

Normalised records

Third-party administrator, flag “State name converted to code”, lowest dq score first

All ENR CLM TPA PRV

Junk onlyFlagState name converted to codeClear

Record	Source	Name	DOB	Member ID	Phone	Address	Quality score	Flags
TPA-52465	TPA	Sandra Smith	1977-06-05	—	4095011127	2383 Park Pl, Chandler, AZ, 85204	0.52	Phone reformatted Street suffix standardised Address re-cased State name converted to code+2 more
TPA-50028	TPA	Fatima Lynnch	2001-08-22	—	—	7675 Harbor Blvd, Columbus, OH, 43200	0.52	Street suffix standardised Address re-cased City re-cased State name converted to code+2 more
TPA-59147	TPA	Jacob Jensen	—	—	—	5608 Meadow Ln, Denver, CO, 80260	0.52	Name re-cased Date of birth unreadable Street suffix standardised Address re-cased+2 more
TPA-58436	TPA	Gerald Little	1996-11-14	UHC-94042-51	—	3476 Ocean Ave, Columbus, OH, 43297	0.52	Street suffix standardised Address re-cased State name converted to code Gender normalised+2 more
TPA-58438	TPA	Rebecca Williams	1980-04-20	—	—	1967 Union St, Charlotte, NC, 28278	0.54	Name re-cased SSN last four extracted State name converted to code ZIP+4 trimmed+1 more
TPA-59307	TPA	Frances Diaz	1972-11-19	—	—	5477 Hillcrest Rd, Houston, TX, 77071	0.54	Name split from “Last, First”Date of birth reformatted State name converted to code ZIP+4 trimmed+1 more
TPA-58371	TPA	Sofia Garrett	1987-05-08	UHC-60736-86	6707143325	256 Ocean Ave, Seattle, WA, 98197	0.54	Two-digit birth year Phone reformatted State name converted to code Gender normalised+1 more
TPA-53929	TPA	Cheryl Dunn	1987-12-14	—	—	6313 Highland Ave, Eden Prairie, MN, 55363	0.54	Name split from “Last, First”Two-digit birth year City re-cased State name converted to code+1 more
TPA-54545	TPA	Frank S Garrett	1984-11-11	—	—	9229 Sunset Blvd, Tampa, FL, 33618	0.54	Two-digit birth year Street suffix standardised Address re-cased State name converted to code+1 more
TPA-56809	TPA	Katherine Hawkins	2002-12-12	—	—	7014 Valley View Dr, Austin, TX, 78788	0.54	Name split from “Last, First”State name converted to code Gender normalised Whitespace trimmed+1 more
TPA-62231	TPA	Wayne Fernandez	1941-12-03	—	—	6873 Canyon Rd, Jacksonville, FL, 32269	0.54	Two-digit birth year Street suffix standardised Address re-cased State name converted to code+1 more
TPA-58670	TPA	Sarah Nelson	—	—	—	2553 Canyon Rd Apt 19, Eden Prairie, MN, 55345	0.54	Name re-cased Date of birth unreadable Unit split from street State name converted to code+1 more
TPA-50646	TPA	Robert Alexander	1959-03-08	UHC-08776-21	2725843105	814 Camelback Rd, Orlando, FL, 32866	0.54	Name re-cased Two-digit birth year State name converted to code Gender normalised+1 more
TPA-56223	TPA	Fatima Y Nunez	—	—	—	9002 Maple Ave, Glendale, AZ, 85307	0.54	Date of birth missing State name converted to code ZIP+4 trimmed Whitespace trimmed+1 more
TPA-52929	TPA	Pamela Q Black	1969-01-06	—	—	8059 Park Pl, Denver, CO, 80257	0.54	Name split from “Last, First”Phone missing area code State name converted to code Whitespace trimmed+1 more
TPA-61299	TPA	Peter G Fox	2000-02-11	UHC-43855-32	3789476021	5462 Forest Ave, Houston, TX, 77083	0.54	Two-digit birth year Street suffix standardised Address re-cased State name converted to code+1 more
TPA-60932	TPA	Charles Reid	1996-06-14	—	—	3202 Lincoln Way, Tempe, AZ, 85211	0.54	Name split from “Last, First”State name converted to code Gender normalised Whitespace trimmed+1 more
TPA-61024	TPA	Julia Wright	1994-05-15	—	—	5217 Main St, Dallas, TX, 75241	0.54	Street suffix standardised Address re-cased State name converted to code ZIP+4 trimmed+1 more
TPA-51711	TPA	Brayn Saners	1968-09-27	—	4757742185	4575 Broadway # 865, Los Angeles, CA, 90013	0.54	Name re-cased Unit split from street State name converted to code Gender normalised+1 more
TPA-60845	TPA	Ashley Perry	1968-03-26	UHC-37171-05	2574365078	697 Park Pl, Fresno, CA	0.54	Name split from “Last, First”Phone reformatted State name converted to code ZIP missing+1 more
TPA-50988	TPA	Ann Perez	1999-12-05	—	—	352 Elm St, Denver, CO, 80229	0.54	Name split from “Last, First”Street suffix standardised Address re-cased State name converted to code+1 more
TPA-52234	TPA	Arthur Greene	2006-06-20	—	—	4014 Cedar Ln, Atlanta, GA	0.54	Name split from “Last, First”Date of birth reformatted State name converted to code ZIP missing+1 more
TPA-57097	TPA	Amanda I Hayes	1991-04-02	—	4415156189	5103 River Rd, Denver, CO, 80204	0.54	Street suffix standardised Address re-cased State name converted to code Gender normalised+1 more
TPA-54890	TPA	Camila Jones	2007-03-06	—	—	4149 Bayshore Dr, Tampa, FL, 33633	0.54	Name split from “Last, First”Street suffix standardised Address re-cased State name converted to code+1 more
TPA-56352	TPA	Douglas Mendez	1947-12-11	UHC-96845-13	—	5921 Washington St, Miami, FL, 33188	0.54	Two-digit birth year State name converted to code ZIP+4 trimmed Whitespace trimmed+1 more
TPA-58558	TPA	Diane Schmidt	1938-12-10	—	—	2641 Broadway, Miami, FL, 33166	0.54	State name converted to code ZIP+4 trimmed Gender normalised Whitespace trimmed+1 more
TPA-58823	TPA	Steen Turner	1940-04-27	—	—	7023 River Rd, Gilbert, AZ	0.54	Street suffix standardised Address re-cased State name converted to code ZIP missing+1 more
TPA-56464	TPA	Susan Carr	2005-06-19	—	—	8577 Spring St # 747, Charlotte, NC, 28263	0.54	Unit split from street Street suffix standardised Address re-cased State name converted to code+1 more
TPA-53590	TPA	Austin Tucker	2003-03-02	—	8785571233	6741 Cedar Ln, Tampa, FL	0.54	Street suffix standardised Address re-cased State name converted to code ZIP missing+1 more
TPA-55323	TPA	Grace Sandoval	—	—	—	9578 Camelback Rd, Columbus, OH, 43245	0.54	Date of birth unreadable Street suffix standardised Address re-cased State name converted to code+1 more
TPA-64319	TPA	Douglas Lukas	1944-09-12	—	7837058963	2791 Forest Ave, Las Vegas, NV, 89177	0.54	Street suffix standardised Address re-cased State name converted to code Gender normalised+1 more
TPA-59511	TPA	Victoria Barnes	2003-11-26	—	—	1900 Ocean Ave, Charlotte, NC, 28251	0.54	Phone missing area code Street suffix standardised Address re-cased State name converted to code+1 more
TPA-52932	TPA	Bradley Rodriguez	1959-01-01	—	—	682 Pine Dr, Las Vegas, NV, 89194	0.54	Name re-cased Two-digit birth year Phone missing area code State name converted to code+1 more
TPA-59038	TPA	Linda B McDonald	1980-04-09	—	—	6056 Highland Ave, Atlanta, GA, 30385	0.54	Name split from “Last, First”Street suffix standardised Address re-cased State name converted to code+1 more
TPA-63700	TPA	Fatima Price	1945-11-18	—	—	3822 Lincoln Way, San Diego, CA, 92174	0.54	State name converted to code ZIP+4 trimmed Gender normalised Whitespace trimmed+1 more
TPA-61318	TPA	Larry Grant	1947-01-22	UHC-85640-98	—	5685 Washington St, Austin, TX, 78785	0.54	Name split from “Last, First”Street suffix standardised Address re-cased State name converted to code+1 more
TPA-54848	TPA	Nicole Sandoval	1956-12-15	—	6574344785	5628 Ridge Rd, Atlanta, GA, 30316	0.54	Two-digit birth year Phone reformatted State name converted to code ZIP+4 trimmed+1 more
TPA-61426	TPA	Juhn Dean	1983-06-25	—	—	2971 Broadway, Fresno, CA, 93700	0.54	Name split from “Last, First”Date of birth reformatted State name converted to code Gender normalised+1 more
TPA-53533	TPA	Joe Coleman	1952-07-16	—	2136132067	5241 Cedar Ln, Mesa, AZ	0.54	Two-digit birth year Phone reformatted State name converted to code ZIP missing+1 more
TPA-50069	TPA	Ruth Ferguson	1945-10-09	—	—	9177 Jefferson Ave, Mesa, AZ	0.54	Street suffix standardised Address re-cased State name converted to code ZIP missing+1 more
TPA-50598	TPA	Andrea McDonald	1960-02-20	—	—	8541 Camelback Rd, Tempe, AZ, 85238	0.54	Two-digit birth year State name converted to code Email lower-cased Gender normalised+1 more
TPA-63485	TPA	Wei Jordan	1988-12-16	—	—	5392 Union St, Nashville, TN, 37240	0.54	Name split from “Last, First”Street suffix standardised Address re-cased State name converted to code+1 more
TPA-64449	TPA	Jesse Hunter	1943-06-08	—	—	1690 Willow Ct, Phoenix, AZ, 85035	0.54	Name split from “Last, First”State name converted to code Gender normalised Whitespace trimmed+1 more
TPA-57227	TPA	Gregory Campbell	2003-06-18	—	6878780418	6371 Mountain View Dr, Austin, TX, 78791	0.54	Two-digit birth year State name converted to code ZIP+4 trimmed Whitespace trimmed+1 more
TPA-56733	TPA	Raymond Hansen	1966-09-17	—	—	4381 Palm Dr, San Diego, CA	0.54	State name converted to code ZIP missing Gender normalised Whitespace trimmed+1 more
TPA-57659	TPA	Ruth Meyer	1986-12-01	—	8385854963	2426 Forest Ave, Charlotte, NC	0.54	Street suffix standardised Address re-cased City re-cased State name converted to code+1 more
TPA-50814	TPA	Gary Walker	1999-02-04	—	7853045209	6703 Cedar Ln Apt 19, San Diego, CA, 92189	0.54	Phone reformatted Unit split from street State name converted to code Gender normalised+1 more
TPA-54153	TPA	Daniel Lynch	2001-05-17	—	—	2820 Valley View Dr, Mesa, AZ, 85224	0.54	Street suffix standardised Address re-cased State name converted to code ZIP+4 trimmed+1 more
TPA-59744	TPA	Raymond Robinson	1942-04-12	UHC-17881-72	—	1979 Union St, Atlanta, GA	0.54	Street suffix standardised Address re-cased State name converted to code ZIP missing+1 more
TPA-54887	TPA	Justin Mason	2002-01-09	—	7604226272	8634 Sunset Blvd, Dallas, TX	0.54	Name split from “Last, First”Phone reformatted State name converted to code ZIP missing+1 more

1,229 rows, page 9 of 25Previous Next