Normalised records

Normalised records (silver)

Each raw row is parsed into consistently formatted fields. Every change from the raw value is recorded as a data-quality flag.

Normalised rows

99,495

usable in matching

Flagged rows

99,881

99.9% carry at least one flag

Junk quarantined

505

no usable last name

Average quality score

0.75

1.00 = no corrections needed

Quality flags

What normalisation had to do, and how often. Select a flag to filter the table.

Placeholder values cleared71,257
Placeholder tokens such as NULL, N/A, UNKNOWN or "-" treated as empty
Whitespace trimmed57,061
Leading or trailing whitespace removed from one or more fields
Address re-cased56,490
Street line re-cased and punctuation removed
Street suffix standardised55,824
Street suffix standardised to USPS abbreviation (Street to St, Avenue to Ave, and so on)
Phone reformatted50,244
Phone reduced to ten digits, punctuation and leading country code removed
Name re-cased39,996
Name letter-case rewritten to Title Case and stray characters removed
Date of birth reformatted32,400
Date of birth rewritten to ISO 8601 from a source format (MM/DD/YYYY, YYYYMMDD, Mon D, YYYY)
City re-cased17,850
City re-cased to Title Case
Gender normalised16,828
Gender mapped to F or M from a longer or variant value
Email lower-cased11,635
Email lower-cased
Name split from “Last, First”9,980
First-name field held "LAST, FIRST"; the two parts were split into their own fields
State name converted to code9,084
Full state name replaced by its two-letter USPS code
ZIP+4 trimmed8,263
ZIP+4 trimmed to the five-digit ZIP
Member ID reformatted7,723
Member ID re-hyphenated and upper-cased to the UHC-#####-## pattern
ZIP missing7,146
Street address present but no ZIP supplied
Unit split from street6,994
Apartment, suite or unit designator split from street line and re-appended in standard form
Two-digit birth year6,661
Date of birth carried a two-digit year; century inferred by pivot
State code upper-cased4,010
Two-letter state code upper-cased
Plan code upper-cased3,278
Plan code upper-cased
SSN last four extracted2,817
Last four digits of SSN extracted from a longer or punctuated value
Date of birth unreadable2,274
Date of birth did not match any known format or was out of range; cleared
Phone missing area code2,021
Phone had only seven digits (no area code); cleared
Middle initial moved out of first name1,125
A single middle initial was embedded in the first-name field and moved to middle name
Date of birth missing990
Date of birth absent or a null token; left empty
No usable name (quarantined)505
No usable last name; record quarantined as junk and excluded from matching

Normalised records

All sources, flag “Two-digit birth year”, lowest dq score first

All ENR CLM TPA PRV

Junk onlyFlagTwo-digit birth yearClear

Record	Source	Name	DOB	Member ID	Phone	Address	Quality score	Flags
CLM-417112	CLM	Alan Lane	1982-06-10	UHC-36065-99	—	3933 Pine Dr, Plano, TX, 75096	0.80	Name re-cased Two-digit birth year Whitespace trimmed Placeholder values cleared
CLM-420610	CLM	Albert Ramos	1944-03-19	—	4332356686	—	0.80	Two-digit birth year Phone reformatted Whitespace trimmed Placeholder values cleared
PRV-22684	PRV	Kyle Ross	1970-08-03	—	2449000918	—	0.80	Two-digit birth year Phone reformatted Whitespace trimmed Placeholder values cleared
CLM-428402	CLM	Elijah Le	1964-09-23	UHC-95173-48	—	—	0.80	Name re-cased Two-digit birth year Whitespace trimmed Placeholder values cleared
ENR-123476	ENR	Helen Chavez	2000-04-08	UHC-96490-92	4245898774	5914 Canyon Rd, Mesa, AZ, 85239	0.80	Name re-cased Two-digit birth year Phone reformatted City re-cased
TPA-63996	TPA	Diane Fuller	1957-04-08	—	2603560458	5890 Apache Blvd, Houston, TX, 77064	0.80	Two-digit birth year Phone reformatted Whitespace trimmed Placeholder values cleared
CLM-400121	CLM	Sofia Lawsun	1963-09-07	UHC-68415-31	—	—	0.80	Two-digit birth year Member ID reformatted Whitespace trimmed Placeholder values cleared
PRV-29439	PRV	Samantha Williamson	1992-05-21	—	7719194035	—	0.80	Two-digit birth year Phone reformatted Whitespace trimmed Placeholder values cleared
CLM-401709	CLM	Betty Young	1987-10-28	UHC-02259-50	7782485860	—	0.80	Name re-cased Two-digit birth year Phone reformatted Placeholder values cleared
CLM-415311	CLM	Jacqueline Harvey	1973-05-08	—	—	—	0.80	Name re-cased Two-digit birth year Whitespace trimmed Placeholder values cleared
ENR-106515	ENR	Carlos Books	1950-05-09	UHC-18678-37	8319324549	3873 Broadway, Columbus, OH, 43255	0.80	Two-digit birth year Phone reformatted Whitespace trimmed Placeholder values cleared
TPA-52669	TPA	Cheryl Snyder	1988-09-06	—	9772723844	6293 Palm Dr, Houston, TX, 77097	0.80	Two-digit birth year Phone reformatted Whitespace trimmed Placeholder values cleared
TPA-52668	TPA	Cheryl Snyder	1988-09-06	—	9772723844	6293 Palm Dr, Houston, TX, 77097	0.80	Two-digit birth year Phone reformatted Whitespace trimmed Placeholder values cleared
CLM-410855	CLM	Katherine Perkins	1982-11-04	—	—	—	0.80	Two-digit birth year Email lower-cased Whitespace trimmed Placeholder values cleared
ENR-132825	ENR	Mateo V Dean	2000-12-27	UHC-92928-49	9219120581	—	0.80	Two-digit birth year Phone reformatted Whitespace trimmed Placeholder values cleared
ENR-132824	ENR	Mateo V Dean	2000-12-27	UHC-92928-49	9219120581	—	0.80	Two-digit birth year Phone reformatted Whitespace trimmed Placeholder values cleared
ENR-136878	ENR	Ruth Meyer	2004-06-19	UHC-88349-27	8647358107	8704 Central Ave, Glendale, AZ, 85341	0.80	Name re-cased Two-digit birth year Phone reformatted Whitespace trimmed
CLM-416128	CLM	George E Fisher	1961-03-23	—	8336986277	—	0.80	Two-digit birth year Plan code upper-cased Whitespace trimmed Placeholder values cleared
PRV-25285	PRV	Mike S Lynch	1940-03-05	UHC-82219-84	8325494410	4883 Park Pl, Tempe, AZ, 85202	0.80	Name re-cased Two-digit birth year Phone reformatted Placeholder values cleared
ENR-136998	ENR	Russell B Fowler	1968-06-10	UHC-69971-22	7237017922	8038 Elm St, Sacramento, CA, 95898	0.80	Name re-cased Two-digit birth year Phone reformatted Whitespace trimmed
CLM-413530	CLM	Brian Parker	1983-03-04	UHC-69055-38	4525864470	2214 Grand Ave, Charlotte, NC, 28240	0.80	Name re-cased Two-digit birth year Phone reformatted Placeholder values cleared
CLM-414008	CLM	Thomas Watson	1971-09-05	—	2952457307	7825 Lincoln Way, Phoenix, AZ, 85072	0.80	Two-digit birth year City re-cased Whitespace trimmed Placeholder values cleared
TPA-56739	TPA	Jacike McCoy	1939-11-01	—	—	—	0.80	Name re-cased Two-digit birth year Whitespace trimmed Placeholder values cleared
ENR-117247	ENR	Bryan Freeman	1940-09-08	UHC-23532-29	7209106576	3063 Church St, Charlotte, NC, 28269	0.80	Two-digit birth year Phone reformatted Email lower-cased Whitespace trimmed
CLM-406786	CLM	Edward Delgado	1986-01-16	UHC-98565-10	4453176477	—	0.80	Two-digit birth year Phone reformatted Whitespace trimmed Placeholder values cleared
CLM-407076	CLM	Anngela Sanders	1975-04-10	UHC-47771-45	6852814160	—	0.80	Two-digit birth year Phone reformatted Whitespace trimmed Placeholder values cleared
TPA-59383	TPA	Camila Jackson	1961-05-15	UHC-96379-79	—	—	0.80	Name re-cased Two-digit birth year Whitespace trimmed Placeholder values cleared
CLM-425546	CLM	Theresa Nunez	1992-07-19	UHC-41718-56	6948729574	5585 Harbor Blvd, Tucson, AZ, 85734	0.80	Two-digit birth year Email lower-cased Whitespace trimmed Placeholder values cleared
CLM-418118	CLM	Aisha E Padilla	1998-08-02	—	2194478529	—	0.80	Two-digit birth year Phone reformatted Whitespace trimmed Placeholder values cleared
TPA-50939	TPA	Kimberly Morris	1946-08-16	—	—	—	0.80	Name re-cased Two-digit birth year Whitespace trimmed Placeholder values cleared
CLM-413895	CLM	Mason Vasquez	1967-05-27	UHC-71588-63	—	—	0.80	Name re-cased Two-digit birth year Whitespace trimmed Placeholder values cleared
TPA-50507	TPA	Sara Guzman	1958-06-21	—	—	3218 Hillcrest Rd, Eden Prairie, MN, 55354	0.80	Name re-cased Two-digit birth year Whitespace trimmed Placeholder values cleared
PRV-22656	PRV	Alan Henry	1984-04-13	UHC-13004-16	6118710311	1586 Maple Ave, Jacksonville, FL, 32243	0.80	Name re-cased Two-digit birth year Whitespace trimmed Placeholder values cleared
CLM-411727	CLM	Karen Watsn	1972-03-12	—	—	—	0.80	Name re-cased Two-digit birth year Whitespace trimmed Placeholder values cleared
TPA-55935	TPA	Edward Diaz	1968-07-16	—	3487057870	—	0.80	Two-digit birth year Phone reformatted Whitespace trimmed Placeholder values cleared
ENR-102439	ENR	Jordan Luis	1949-08-24	UHC-26210-50	7809199711	1744 Church St, Houston, TX, 77007	0.80	Name re-cased Two-digit birth year Phone reformatted Whitespace trimmed
ENR-114668	ENR	Kenneth Fuller	1968-10-21	UHC-48254-48	5127562363	7076 Lake View Rd, Seattle, WA, 98176	0.80	Two-digit birth year Phone reformatted City re-cased Whitespace trimmed
CLM-407182	CLM	Lori Nunez	1987-04-10	UHC-61380-99	—	2512 Canyon Rd, Orlando, FL, 32892	0.80	Two-digit birth year Member ID reformatted Whitespace trimmed Placeholder values cleared
CLM-410912	CLM	Joseph Watkins	2008-07-19	—	—	8272 Sunset Blvd, Charlotte, NC, 28277	0.80	Two-digit birth year City re-cased Whitespace trimmed Placeholder values cleared
CLM-409758	CLM	Bryan Martinez	2008-10-21	—	—	4682 Washington St, Orlando, FL, 32825	0.80	Name re-cased Two-digit birth year Whitespace trimmed Placeholder values cleared
CLM-428547	CLM	Joseph A Pena	1945-01-07	UHC-35846-37	—	—	0.80	Two-digit birth year Member ID reformatted Whitespace trimmed Placeholder values cleared
ENR-122976	ENR	Aaron Schultz	1961-05-02	UHC-48103-97	8522367303	2191 Oak St, Columbus, OH, 43223	0.80	Two-digit birth year City re-cased Email lower-cased Plan code upper-cased
CLM-408242	CLM	Doris Dunn	1990-04-22	—	—	6561 Valley View Dr, Scottsdale, AZ, 85289	0.80	Two-digit birth year City re-cased Whitespace trimmed Placeholder values cleared
CLM-421091	CLM	Sara Gordon	1947-05-25	UHC-17238-13	7009316062	8339 Ocean Ave, Minneapolis, MN, 55412	0.80	Name re-cased Two-digit birth year Phone reformatted Placeholder values cleared
CLM-417344	CLM	Ana Mason	1960-05-06	UHC-37551-83	3148898155	4563 Lincoln Way, Eden Prairie, MN, 55381	0.80	Name re-cased Two-digit birth year Phone reformatted Whitespace trimmed
PRV-23665	PRV	Ralh U Weaver	1945-03-16	UHC-96928-89	8495346181	2322 Hillcrest Rd, Miami, FL, 33123	0.80	Two-digit birth year Phone reformatted Whitespace trimmed Placeholder values cleared
CLM-404312	CLM	Meegan Fox	1971-06-23	UHC-06501-28	3982561019	—	0.80	Name re-cased Two-digit birth year Whitespace trimmed Placeholder values cleared
ENR-125209	ENR	Logan G Ward	1949-05-04	UHC-80647-46	5576821154	2233 Cedar Ln, Plano, TX, 75051	0.80	Two-digit birth year Phone reformatted Email lower-cased Whitespace trimmed
CLM-415607	CLM	Beverly Q Garza	1973-04-17	UHC-81899-11	5735185683	—	0.80	Two-digit birth year Phone reformatted Whitespace trimmed Placeholder values cleared
ENR-127062	ENR	Brittany Morris	1994-01-22	UHC-37042-37	—	4019 Palm Dr, Charlotte, NC, 28235	0.80	Name re-cased Two-digit birth year City re-cased Whitespace trimmed

6,661 rows, page 111 of 134Previous Next