Normalised records

Normalised records (silver)

Each raw row is parsed into consistently formatted fields. Every change from the raw value is recorded as a data-quality flag.

Normalised rows

99,495

usable in matching

Flagged rows

99,881

99.9% carry at least one flag

Junk quarantined

505

no usable last name

Average quality score

0.75

1.00 = no corrections needed

Quality flags

What normalisation had to do, and how often. Select a flag to filter the table.

Placeholder values cleared71,257
Placeholder tokens such as NULL, N/A, UNKNOWN or "-" treated as empty
Whitespace trimmed57,061
Leading or trailing whitespace removed from one or more fields
Address re-cased56,490
Street line re-cased and punctuation removed
Street suffix standardised55,824
Street suffix standardised to USPS abbreviation (Street to St, Avenue to Ave, and so on)
Phone reformatted50,244
Phone reduced to ten digits, punctuation and leading country code removed
Name re-cased39,996
Name letter-case rewritten to Title Case and stray characters removed
Date of birth reformatted32,400
Date of birth rewritten to ISO 8601 from a source format (MM/DD/YYYY, YYYYMMDD, Mon D, YYYY)
City re-cased17,850
City re-cased to Title Case
Gender normalised16,828
Gender mapped to F or M from a longer or variant value
Email lower-cased11,635
Email lower-cased
Name split from “Last, First”9,980
First-name field held "LAST, FIRST"; the two parts were split into their own fields
State name converted to code9,084
Full state name replaced by its two-letter USPS code
ZIP+4 trimmed8,263
ZIP+4 trimmed to the five-digit ZIP
Member ID reformatted7,723
Member ID re-hyphenated and upper-cased to the UHC-#####-## pattern
ZIP missing7,146
Street address present but no ZIP supplied
Unit split from street6,994
Apartment, suite or unit designator split from street line and re-appended in standard form
Two-digit birth year6,661
Date of birth carried a two-digit year; century inferred by pivot
State code upper-cased4,010
Two-letter state code upper-cased
Plan code upper-cased3,278
Plan code upper-cased
SSN last four extracted2,817
Last four digits of SSN extracted from a longer or punctuated value
Date of birth unreadable2,274
Date of birth did not match any known format or was out of range; cleared
Phone missing area code2,021
Phone had only seven digits (no area code); cleared
Middle initial moved out of first name1,125
A single middle initial was embedded in the first-name field and moved to middle name
Date of birth missing990
Date of birth absent or a null token; left empty
No usable name (quarantined)505
No usable last name; record quarantined as junk and excluded from matching

Normalised records

Claims, flag “Two-digit birth year”, lowest dq score first

All ENR CLM TPA PRV

Junk onlyFlagTwo-digit birth yearClear

Record	Source	Name	DOB	Member ID	Phone	Address	Quality score	Flags
CLM-425290	CLM	Patrick Collins	1974-11-27	UHC-70965-59	7308391245	1406 Maple Ave, Jacksonville, FL, 32222	0.60	Name re-cased Two-digit birth year Phone reformatted Street suffix standardised+4 more
CLM-421126	CLM	Frnces P Ruiz	1949-05-28	UHC-20383-93	4406663884	4560 Cedar Ln, Mesa, AZ, 85215	0.60	Two-digit birth year Phone reformatted Member ID reformatted Street suffix standardised+4 more
CLM-423273	CLM	Bruce Carter	1968-03-28	UHC-29998-49	5447647503	3127 Mountain View Dr, San Diego, CA, 92119	0.60	Name re-cased Two-digit birth year Phone reformatted Street suffix standardised+4 more
CLM-419385	CLM	Albert Black	1944-11-07	UHC-18721-11	9566036193	5999 Palm Dr, Sacramento, CA, 95843	0.60	Two-digit birth year Phone reformatted Street suffix standardised Address re-cased+4 more
CLM-406877	CLM	Eugene Fisher	1969-09-25	UHC-45550-42	4097157953	8143 Baseline Rd, Chandler, AZ, 85258	0.60	Name re-cased Two-digit birth year Phone reformatted Member ID reformatted+4 more
CLM-407616	CLM	Barbara Rojas	1974-05-22	—	3116896591	8037 Church St, Miami, FL, 33161	0.60	Name re-cased Two-digit birth year Phone reformatted Street suffix standardised+4 more
CLM-428570	CLM	Kayla Knight	1977-10-25	UHC-89655-06	9282492380	8687 Bayshore Dr, Sacramento, CA, 95827	0.60	Name re-cased Two-digit birth year Phone reformatted Member ID reformatted+4 more
CLM-409737	CLM	Scott Howell	2004-09-04	—	2229435045	1885 Meadow Ln, Houston, TX, 77071	0.60	Name re-cased Two-digit birth year Phone reformatted Street suffix standardised+4 more
CLM-418988	CLM	Sophia Rogers	1999-04-17	—	3148013666	1710 Hillcrest Rd, Austin, TX, 78795	0.60	Name re-cased Two-digit birth year Phone reformatted Street suffix standardised+4 more
CLM-416451	CLM	Terry Jenkins	1973-05-04	UHC-17173-50	5448407784	4419 Maple Ave, Eden Prairie, MN, 55344	0.60	Name re-cased Two-digit birth year Phone reformatted Street suffix standardised+4 more
CLM-425000	CLM	Vicky Graham	1950-09-24	—	6796257726	1392 Forest Ave, San Antonio, TX, 78284	0.60	Two-digit birth year Phone reformatted Street suffix standardised Address re-cased+4 more
CLM-402528	CLM	Arthur Munoz	2006-05-28	UHC-53883-63	9609752681	657 Sunset Blvd, Tempe, AZ, 85252	0.60	Name re-cased Two-digit birth year Phone reformatted Street suffix standardised+4 more
CLM-428478	CLM	Brandon Sanchez	1967-08-24	UHC-70694-47	3565802709	2492 Grand Ave, Nashville, TN, 37257	0.60	Name re-cased Two-digit birth year Phone reformatted Member ID reformatted+4 more
CLM-415442	CLM	Samuel Castro	1975-05-08	UHC-99010-79	9047985083	216 Indian School Rd, Dallas, TX, 75266	0.60	Name re-cased Two-digit birth year Phone reformatted Street suffix standardised+4 more
CLM-432080	CLM	Scott Campbell	1947-06-03	—	3803424135	15 Hillcrest Rd, Sacramento, CA, 95811	0.60	Name re-cased Two-digit birth year Phone reformatted Street suffix standardised+4 more
CLM-405785	CLM	Pamela Jordan	1982-06-16	UHC-28186-78	8656907925	2690 Highland Ave, Phoenix, AZ, 85048	0.60	Two-digit birth year Phone reformatted Member ID reformatted Street suffix standardised+4 more
CLM-411533	CLM	Logan Collins	1944-12-21	—	5114008104	9814 Pine Dr, Las Vegas, NV, 89137	0.60	Name re-cased Two-digit birth year Phone reformatted Street suffix standardised+4 more
CLM-423086	CLM	Gabriel Park	1948-03-19	UHC-80454-21	7835290079	1820 Broadway, Houston, TX, 77060	0.62	Name re-cased Two-digit birth year Phone reformatted Address re-cased+3 more
CLM-418055	CLM	Karen Anderson	1974-08-20	—	3175019423	3300 Mountain View Dr, Los Angeles, CA, 90049	0.62	Name re-cased Two-digit birth year Phone reformatted Street suffix standardised+3 more
CLM-411991	CLM	Valentina Ortiz	1953-05-05	—	5086820139	6321 Mesa Dr, Nashville, TN, 37256	0.62	Name re-cased Two-digit birth year Street suffix standardised Address re-cased+3 more
CLM-407806	CLM	Brandon Bryant	1995-01-07	UHC-65094-90	—	7968 Central Ave, Tampa, FL, 33648	0.62	Name re-cased Two-digit birth year Street suffix standardised Address re-cased+3 more
CLM-413626	CLM	Tyler Madina	1990-10-01	UHC-89806-73	2347890945	3212 Grand Ave, Mesa, AZ, 85282	0.62	Two-digit birth year Phone reformatted Street suffix standardised Address re-cased+3 more
CLM-403920	CLM	Zachary G Carlson	2003-10-23	—	—	6475 Jefferson Ave, Denver, CO, 80273	0.62	Name re-cased Two-digit birth year Street suffix standardised Address re-cased+3 more
CLM-404266	CLM	Christina Y Phillips	1944-10-12	UHC-66533-38	—	5413 Canyon Rd, Scottsdale, AZ, 85230	0.62	Name re-cased Two-digit birth year Street suffix standardised Address re-cased+3 more
CLM-401872	CLM	Albert Rogers	1965-11-21	UHC-07011-45	6964007555	7894 Cedar Ln, Mesa, AZ, 85226	0.62	Name re-cased Two-digit birth year Phone reformatted Street suffix standardised+3 more
CLM-425336	CLM	Larry Li	2001-07-08	—	7716060688	3403 Willow Ct, Miami, FL, 33161	0.62	Name re-cased Two-digit birth year Phone reformatted Street suffix standardised+3 more
CLM-402745	CLM	Yuki Collins	1983-01-13	UHC-91200-07	3597975966	1167 Camelback Rd, Jacksonville, FL, 32248	0.62	Two-digit birth year Phone reformatted Street suffix standardised Address re-cased+3 more
CLM-418586	CLM	Raymond Powell	1994-09-10	UHC-91897-10	—	9283 Washington St, San Antonio, TX, 78234	0.62	Name re-cased Two-digit birth year Member ID reformatted Street suffix standardised+3 more
CLM-432084	CLM	William U Wells	1996-06-27	UHC-43805-72	9375878321	4905 Lake View Rd, Phoenix, AZ, 85085	0.62	Name re-cased Two-digit birth year Member ID reformatted Street suffix standardised+3 more
CLM-409958	CLM	Alice Armstrong	1999-11-04	—	—	5394 River Rd, Charlotte, NC, 28228	0.62	Name re-cased Two-digit birth year Street suffix standardised Address re-cased+3 more
CLM-421193	CLM	Alice Gonzalez	1968-02-14	UHC-10661-45	9108248546	8376 Ridge Rd, Seattle, WA, 98132	0.62	Name re-cased Two-digit birth year Phone reformatted Member ID reformatted+3 more
CLM-421578	CLM	Michael Hanson	1983-07-01	UHC-75772-33	—	3342 Sage Ct, Fresno, CA, 93738	0.62	Name re-cased Two-digit birth year Street suffix standardised Address re-cased+3 more
CLM-430999	CLM	Judy Oliver	1939-04-05	UHC-16714-15	6075564845	9763 Harbor Blvd, Plano, TX, 75089	0.62	Name re-cased Two-digit birth year Phone reformatted Street suffix standardised+3 more
CLM-417474	CLM	William Patterson	1974-02-18	UHC-70673-52	—	9035 Sunset Blvd, Miami, FL, 33172	0.62	Two-digit birth year Member ID reformatted Street suffix standardised Address re-cased+3 more
CLM-412354	CLM	Deborah V Gilbert	1966-05-12	UHC-22494-09	7152997127	5353 Church St, Minneapolis, MN, 55412	0.62	Name re-cased Two-digit birth year Phone reformatted Street suffix standardised+3 more
CLM-407376	CLM	Diana Jacobs	2008-11-10	—	8883737288	5990 Mountain View Dr, Orlando, FL, 32818	0.62	Two-digit birth year Phone reformatted Street suffix standardised Address re-cased+3 more
CLM-409001	CLM	Alice Reid	1950-07-06	UHC-19821-29	2507012884	3716 Harbor Blvd, Orlando, FL, 32861	0.62	Two-digit birth year Phone reformatted Street suffix standardised Address re-cased+3 more
CLM-402587	CLM	Jennifer Oliver	1972-06-16	—	6606920658	9553 Highland Ave, Seattle, WA, 98153	0.62	Two-digit birth year Phone reformatted Street suffix standardised Address re-cased+3 more
CLM-407780	CLM	Benjamin Wbb	1967-03-24	UHC-91181-73	—	9584 Hillcrest Rd, San Diego, CA, 92173	0.62	Name re-cased Two-digit birth year Street suffix standardised Address re-cased+3 more
CLM-400892	CLM	Amber Johnston	1946-08-06	—	—	1914 Maple Ave, Atlanta, GA, 30303	0.62	Name re-cased Two-digit birth year Street suffix standardised Address re-cased+3 more
CLM-424200	CLM	Jacob B Wood	1989-04-24	UHC-23540-39	—	1377 Willow Ct, Scottsdale, AZ, 85204	0.62	Name re-cased Two-digit birth year Member ID reformatted Street suffix standardised+3 more
CLM-425385	CLM	Roger V Warren	1962-09-09	UHC-99655-23	2674836157	6569 Mountain View Dr, Nashville, TN, 37282	0.62	Name re-cased Two-digit birth year Phone reformatted Street suffix standardised+3 more
CLM-414156	CLM	Danny Benett	2008-08-12	UHC-66829-88	—	9592 Market St, Glendale, AZ, 85308	0.62	Name re-cased Two-digit birth year Member ID reformatted Street suffix standardised+3 more
CLM-432187	CLM	Stephen Gibson	1995-11-22	UHC-07734-29	7075574177	8379 Ocean Ave, San Diego, CA, 92194	0.62	Name re-cased Two-digit birth year Phone reformatted Street suffix standardised+3 more
CLM-423856	CLM	Jacob Turner	1993-10-01	UHC-72094-54	6622507133	5366 Church St, Nashville, TN, 37234	0.62	Two-digit birth year Phone reformatted Street suffix standardised Address re-cased+3 more
CLM-413394	CLM	Elliott Tyler	1954-01-14	UHC-10283-58	6192587292	6868 Hillcrest Rd, Plano, TX, 75038	0.62	Name re-cased Two-digit birth year Phone reformatted Street suffix standardised+3 more
CLM-429578	CLM	Jacob Peters	1997-09-09	UHC-44382-28	—	7610 Highland Ave, Denver, CO, 80256	0.62	Name re-cased Two-digit birth year Street suffix standardised Address re-cased+3 more
CLM-423049	CLM	Alan Adams	1967-08-10	—	2804951766	3569 Meadow Ln, Minneapolis, MN, 55480	0.62	Name re-cased Two-digit birth year Phone reformatted Street suffix standardised+3 more
CLM-421853	CLM	Eric Watson	2005-01-05	UHC-38780-55	6615613429	—	0.62	Name re-cased Two-digit birth year Phone reformatted Member ID reformatted+3 more
CLM-431673	CLM	Jacqueline Singh	2006-02-07	—	5796103169	4215 Church St, Tampa, FL, 33693	0.62	Name re-cased Two-digit birth year Phone reformatted Street suffix standardised+3 more

2,168 rows, page 14 of 44Previous Next