Normalised records

Normalised records (silver)

Each raw row is parsed into consistently formatted fields. Every change from the raw value is recorded as a data-quality flag.

Normalised rows

99,495

usable in matching

Flagged rows

99,881

99.9% carry at least one flag

Junk quarantined

505

no usable last name

Average quality score

0.75

1.00 = no corrections needed

Quality flags

What normalisation had to do, and how often. Select a flag to filter the table.

Placeholder values cleared71,257
Placeholder tokens such as NULL, N/A, UNKNOWN or "-" treated as empty
Whitespace trimmed57,061
Leading or trailing whitespace removed from one or more fields
Address re-cased56,490
Street line re-cased and punctuation removed
Street suffix standardised55,824
Street suffix standardised to USPS abbreviation (Street to St, Avenue to Ave, and so on)
Phone reformatted50,244
Phone reduced to ten digits, punctuation and leading country code removed
Name re-cased39,996
Name letter-case rewritten to Title Case and stray characters removed
Date of birth reformatted32,400
Date of birth rewritten to ISO 8601 from a source format (MM/DD/YYYY, YYYYMMDD, Mon D, YYYY)
City re-cased17,850
City re-cased to Title Case
Gender normalised16,828
Gender mapped to F or M from a longer or variant value
Email lower-cased11,635
Email lower-cased
Name split from “Last, First”9,980
First-name field held "LAST, FIRST"; the two parts were split into their own fields
State name converted to code9,084
Full state name replaced by its two-letter USPS code
ZIP+4 trimmed8,263
ZIP+4 trimmed to the five-digit ZIP
Member ID reformatted7,723
Member ID re-hyphenated and upper-cased to the UHC-#####-## pattern
ZIP missing7,146
Street address present but no ZIP supplied
Unit split from street6,994
Apartment, suite or unit designator split from street line and re-appended in standard form
Two-digit birth year6,661
Date of birth carried a two-digit year; century inferred by pivot
State code upper-cased4,010
Two-letter state code upper-cased
Plan code upper-cased3,278
Plan code upper-cased
SSN last four extracted2,817
Last four digits of SSN extracted from a longer or punctuated value
Date of birth unreadable2,274
Date of birth did not match any known format or was out of range; cleared
Phone missing area code2,021
Phone had only seven digits (no area code); cleared
Middle initial moved out of first name1,125
A single middle initial was embedded in the first-name field and moved to middle name
Date of birth missing990
Date of birth absent or a null token; left empty
No usable name (quarantined)505
No usable last name; record quarantined as junk and excluded from matching

Normalised records

Claims, flag “Phone reformatted”, lowest dq score first

All ENR CLM TPA PRV

Junk onlyFlagPhone reformattedClear

Record	Source	Name	DOB	Member ID	Phone	Address	Quality score	Flags
CLM-420280	CLM	Mria Carter	1941-07-21	UHC-99707-79	9365847459	—	0.82	Phone reformatted Gender normalised Placeholder values cleared
CLM-412927	CLM	Sharon Cooper	1985-01-14	UHC-81455-82	8854771235	2375 Lincoln Way # 430, Fresno, CA, 93771	0.82	Phone reformatted Unit split from street Placeholder values cleared
CLM-417799	CLM	Kyle Olson	1998-06-26	UHC-89184-73	4578211779	—	0.82	Name split from “Last, First”Phone reformatted Placeholder values cleared
CLM-418484	CLM	Ruth B Bell	1991-06-20	UHC-51877-99	6492200725	5894 Central Ave, Scottsdale, AZ, 85240	0.82	Phone reformatted ZIP+4 trimmed Whitespace trimmed
CLM-430159	CLM	Yuki Yang	1977-09-21	UHC-26988-86	3709198884	7745 Broadway # 557, San Diego, CA, 92191	0.82	Phone reformatted Unit split from street Placeholder values cleared
CLM-421160	CLM	Dorothy Riley	1986-06-13	—	8559264082	—	0.82	Name split from “Last, First”Phone reformatted Placeholder values cleared
CLM-413825	CLM	Betty Kelly	1961-06-07	—	4507602702	—	0.82	Phone reformatted SSN last four extracted Placeholder values cleared
CLM-412406	CLM	Olivia Pena	1962-11-01	UHC-64907-39	4994022698	—	0.82	Name split from “Last, First”Phone reformatted Placeholder values cleared
CLM-417345	CLM	Ana Mason	—	—	3148898155	4563 Lincoln Way, Eden Prairie, MN, 55381	0.82	Date of birth unreadable Phone reformatted Placeholder values cleared
CLM-410719	CLM	Hannah Watson	1995-07-27	UHC-44586-69	7182887677	—	0.82	Phone reformatted SSN last four extracted Placeholder values cleared
CLM-420254	CLM	Andy McCoy	1999-11-03	UHC-29060-53	7896464296	184 Broadway, Houston, TX, 77031	0.82	Phone reformatted Gender normalised Whitespace trimmed
CLM-427211	CLM	Olivia Madina	1968-07-12	UHC-41565-81	3089282390	9683 Canyon Rd, Orlando, FL, 32802	0.82	Phone reformatted Street suffix standardised Address re-cased
CLM-418194	CLM	Peter Santiago	1962-08-17	UHC-41610-43	2566629243	—	0.82	Two-digit birth year Phone reformatted Placeholder values cleared
CLM-429678	CLM	Madison Franklin	1975-01-16	UHC-89354-81	2728366963	—	0.82	Two-digit birth year Phone reformatted Placeholder values cleared
CLM-424498	CLM	Kyle Li	1941-01-02	—	8854722241	1629 River Rd, Tucson, AZ, 85724	0.82	Name split from “Last, First”Phone reformatted Placeholder values cleared
CLM-405232	CLM	Victoria Hawkins	1973-05-10	—	7752165799	3400 Baseline Rd, Houston, TX, 77040	0.82	Phone reformatted Gender normalised Placeholder values cleared
CLM-417548	CLM	Donna Graham	1968-02-06	UHC-32253-23	8736758043	8992 Valley View Dr, Nashville, TN, 37234	0.82	Phone reformatted Street suffix standardised Address re-cased
CLM-401683	CLM	Henry Johnson	1964-05-16	UHC-14151-09	8136621793	—	0.82	Phone reformatted Gender normalised Placeholder values cleared
CLM-409465	CLM	Jessica J Brooks	1968-01-08	UHC-63784-90	5462337236	5621 Elm St, Glendale, AZ, 85362	0.82	Phone reformatted City re-cased State name converted to code
CLM-415227	CLM	Robert Knight	1974-11-08	—	7698021759	7235 Spring St, Minneapolis, MN, 55483	0.82	Two-digit birth year Phone reformatted Placeholder values cleared
CLM-411329	CLM	Dylan F Dean	1940-04-18	UHC-33903-05	3722813844	—	0.82	Name split from “Last, First”Phone reformatted Placeholder values cleared
CLM-417436	CLM	Angela Sullivan	—	UHC-92117-15	8249232096	173 Indian School Rd, Minneapolis, MN, 55402	0.82	Date of birth unreadable Phone reformatted Placeholder values cleared
CLM-413529	CLM	Valentina Baker	1998-03-24	—	8666510899	1465 Apache Blvd, Scottsdale, AZ, 85233	0.82	Phone reformatted Gender normalised Placeholder values cleared
CLM-406692	CLM	Lauren M Stevens	1949-11-25	UHC-56668-55	3773283181	—	0.82	Phone reformatted Gender normalised Placeholder values cleared
CLM-422309	CLM	Samantha X Gibson	1977-09-18	UHC-78095-11	6908579553	—	0.82	Name split from “Last, First”Phone reformatted Whitespace trimmed
CLM-414170	CLM	Mateo Wight	1949-05-26	UHC-17285-52	7998977123	4302 Harbor Blvd, Columbus, OH, 43234	0.82	Phone reformatted ZIP+4 trimmed Placeholder values cleared
CLM-409206	CLM	Jonathan D Davis	1970-02-15	UHC-33869-68	3969368043	6574 Sage Ct # 737, Gilbert, AZ, 85207	0.82	Phone reformatted Unit split from street Whitespace trimmed
CLM-411692	CLM	Elijah Greene	1991-01-08	—	7868331812	8724 Hillcrest Rd, Mesa, AZ, 85294	0.82	Two-digit birth year Phone reformatted Placeholder values cleared
CLM-409578	CLM	Luis N Salazar	1950-09-10	—	4362947185	—	0.82	Phone reformatted Gender normalised Placeholder values cleared
CLM-416476	CLM	Judith J Salazar	1938-02-17	UHC-63958-44	2699514154	3981 Harbor Blvd, Las Vegas, NV, 89197	0.82	Phone reformatted State name converted to code Placeholder values cleared
CLM-428783	CLM	Diego Willis	1945-11-19	—	2887902287	7121 Elm St, Tucson, AZ, 85707	0.82	Phone reformatted Gender normalised Whitespace trimmed
CLM-430716	CLM	Amanda Q Guerrero	2007-07-09	UHC-02982-66	4982625552	3110 Jefferson Ave, Denver, CO, 80208	0.82	Phone reformatted Street suffix standardised Address re-cased
CLM-424750	CLM	Julia Murphy	2005-01-03	UHC-12257-62	6847912313	752 Palm Dr, Scottsdale, AZ, 85274	0.82	Name re-cased Phone reformatted ZIP+4 trimmed
CLM-405294	CLM	Camila T Snyder	1993-06-09	UHC-17020-16	4196341764	3515 Willow Ct, Miami, FL, 33192	0.82	Phone reformatted State name converted to code Placeholder values cleared
CLM-417956	CLM	Roger Arnold	2005-06-25	—	2925753939	2065 Lake View Rd, Denver, CO, 80213	0.82	Name split from “Last, First”Phone reformatted Placeholder values cleared
CLM-428987	CLM	Alan Nunez	—	UHC-39174-66	8023823575	1713 Sage Ct, Columbus, OH, 43220	0.82	Date of birth unreadable Phone reformatted Whitespace trimmed
CLM-417121	CLM	Ralph Rogers	1978-11-01	—	8848163211	8175 Central Ave, San Antonio, TX, 78211	0.82	Phone reformatted Gender normalised Placeholder values cleared
CLM-415430	CLM	Elizabeth Brown	1971-10-24	UHC-66461-69	8295940443	30 Maple Ave, Austin, TX, 78740	0.82	Name split from “Last, First”Phone reformatted City re-cased
CLM-422806	CLM	Terry W Banks	1941-08-25	UHC-16965-86	9348945014	9173 Lake View Rd, Plano, TX, 75064	0.82	Name split from “Last, First”Phone reformatted Placeholder values cleared
CLM-411959	CLM	Margaret Mendoza	2008-02-05	—	9565530815	678 Broadway, Plano, TX, 75045	0.82	Phone reformatted Gender normalised Placeholder values cleared
CLM-420751	CLM	Cehryl Owens	1976-10-12	—	4679141075	—	0.82	Phone reformatted Gender normalised Placeholder values cleared
CLM-431605	CLM	Wayne A Rodriguez	1980-02-06	UHC-70111-50	3108568619	8534 Canyon Rd, Gilbert, AZ, 85204	0.82	Phone reformatted Gender normalised Placeholder values cleared
CLM-401708	CLM	Wei Rivera	1963-05-11	UHC-06713-64	2213479941	—	0.82	Two-digit birth year Phone reformatted Placeholder values cleared
CLM-430294	CLM	Helen Ellis	2008-02-12	—	6389703302	—	0.82	Phone reformatted Gender normalised Placeholder values cleared
CLM-431206	CLM	Gary Montgomery	1958-03-17	—	2532302813	—	0.82	Name split from “Last, First”Phone reformatted Placeholder values cleared
CLM-419094	CLM	Helne Estrada	1944-12-08	—	2865999236	—	0.82	Name split from “Last, First”Phone reformatted Placeholder values cleared
CLM-404319	CLM	Christina Soto	1990-04-18	UHC-05302-85	2887741702	6040 Harbor Blvd, Charlotte, NC, 28292	0.82	Date of birth reformatted Phone reformatted State name converted to code
CLM-427705	CLM	Peter West	1975-01-06	UHC-81086-81	6986086364	9360 Elm St, Los Angeles, CA	0.82	Phone reformatted ZIP missing Placeholder values cleared
CLM-408067	CLM	Christopher Henderson	1952-06-11	—	2334616139	—	0.82	Two-digit birth year Phone reformatted Placeholder values cleared
CLM-424273	CLM	McDonald Kathryn	—	UHC-36310-12	8414039999	7145 Elm St, Phoenix, AZ, 85060	0.82	Date of birth missing Phone reformatted Placeholder values cleared

11,960 rows, page 172 of 240Previous Next