Normalised records

Normalised records (silver)

Each raw row is parsed into consistently formatted fields. Every change from the raw value is recorded as a data-quality flag.

Normalised rows

99,495

usable in matching

Flagged rows

99,881

99.9% carry at least one flag

Junk quarantined

505

no usable last name

Average quality score

0.75

1.00 = no corrections needed

Quality flags

What normalisation had to do, and how often. Select a flag to filter the table.

Placeholder values cleared71,257
Placeholder tokens such as NULL, N/A, UNKNOWN or "-" treated as empty
Whitespace trimmed57,061
Leading or trailing whitespace removed from one or more fields
Address re-cased56,490
Street line re-cased and punctuation removed
Street suffix standardised55,824
Street suffix standardised to USPS abbreviation (Street to St, Avenue to Ave, and so on)
Phone reformatted50,244
Phone reduced to ten digits, punctuation and leading country code removed
Name re-cased39,996
Name letter-case rewritten to Title Case and stray characters removed
Date of birth reformatted32,400
Date of birth rewritten to ISO 8601 from a source format (MM/DD/YYYY, YYYYMMDD, Mon D, YYYY)
City re-cased17,850
City re-cased to Title Case
Gender normalised16,828
Gender mapped to F or M from a longer or variant value
Email lower-cased11,635
Email lower-cased
Name split from “Last, First”9,980
First-name field held "LAST, FIRST"; the two parts were split into their own fields
State name converted to code9,084
Full state name replaced by its two-letter USPS code
ZIP+4 trimmed8,263
ZIP+4 trimmed to the five-digit ZIP
Member ID reformatted7,723
Member ID re-hyphenated and upper-cased to the UHC-#####-## pattern
ZIP missing7,146
Street address present but no ZIP supplied
Unit split from street6,994
Apartment, suite or unit designator split from street line and re-appended in standard form
Two-digit birth year6,661
Date of birth carried a two-digit year; century inferred by pivot
State code upper-cased4,010
Two-letter state code upper-cased
Plan code upper-cased3,278
Plan code upper-cased
SSN last four extracted2,817
Last four digits of SSN extracted from a longer or punctuated value
Date of birth unreadable2,274
Date of birth did not match any known format or was out of range; cleared
Phone missing area code2,021
Phone had only seven digits (no area code); cleared
Middle initial moved out of first name1,125
A single middle initial was embedded in the first-name field and moved to middle name
Date of birth missing990
Date of birth absent or a null token; left empty
No usable name (quarantined)505
No usable last name; record quarantined as junk and excluded from matching

Normalised records

Claims, flag “State code upper-cased”, lowest dq score first

All ENR CLM TPA PRV

Junk onlyFlagState code upper-casedClear

Record	Source	Name	DOB	Member ID	Phone	Address	Quality score	Flags
CLM-416407	CLM	Arjun Rbertson	1980-11-11	UHC-87084-84	—	4498 Washington St, Jacksonville, FL, 32242	0.78	Street suffix standardised Address re-cased State code upper-cased Whitespace trimmed+1 more
CLM-431399	CLM	Matthew Bailey	2003-08-08	UHC-60063-87	4689896051	8080 Desert Sky Blvd, Tempe, AZ, 85254	0.78	Phone reformatted Street suffix standardised Address re-cased State code upper-cased+1 more
CLM-416117	CLM	Jack Sims	1983-09-21	UHC-08090-72	8249894889	8391 Harbor Blvd, Plano, TX, 75073	0.78	Two-digit birth year Phone reformatted State code upper-cased Whitespace trimmed+1 more
CLM-416571	CLM	Jacob Hall	2001-06-06	UHC-90583-09	—	2618 Ridge Rd, Phoenix, AZ, 85094	0.78	City re-cased State code upper-cased Gender normalised Whitespace trimmed+1 more
CLM-422877	CLM	Hannah Contreras	1996-09-11	—	—	9080 Meadow Ln, Tucson, AZ, 85797	0.78	Name re-cased Street suffix standardised Address re-cased State code upper-cased+1 more
CLM-424464	CLM	Ana Burns	2008-04-14	UHC-01372-41	9044077794	5119 Willow Ct, Dallas, TX, 75272	0.78	Street suffix standardised Address re-cased State code upper-cased Whitespace trimmed+1 more
CLM-421259	CLM	Dot Bradley	1952-09-12	—	—	634 Canyon Rd, Seattle, WA, 98100	0.78	Name re-cased Date of birth reformatted State code upper-cased Gender normalised+1 more
CLM-431018	CLM	Benjamin Jones	1989-02-11	UHC-75457-98	—	5630 Baseline Rd, Plano, TX, 75019	0.78	Street suffix standardised Address re-cased State code upper-cased Whitespace trimmed+1 more
CLM-411738	CLM	Janet Carpenter	1997-10-18	—	—	4513 Forest Ave, Miami, FL, 33151	0.78	Name re-cased Street suffix standardised Address re-cased State code upper-cased+1 more
CLM-421626	CLM	Arjun G Morris	1999-02-21	UHC-36733-02	—	3815 Cedar Ln, Scottsdale, AZ, 85290	0.78	Date of birth reformatted Street suffix standardised Address re-cased State code upper-cased+1 more
CLM-427610	CLM	Samuel O Richardson	2000-08-01	UHC-82787-14	—	3577 Sunset Blvd, Seattle, WA, 98145	0.78	Date of birth reformatted Street suffix standardised Address re-cased State code upper-cased+1 more
CLM-420658	CLM	Melissa Hansen	1996-03-18	—	7109650472	5176 Lincoln Way, Las Vegas, NV, 89109	0.78	Name split from “Last, First”Phone reformatted State code upper-cased Whitespace trimmed+1 more
CLM-427543	CLM	Marilyn George	1956-07-01	UHC-28198-68	9725383490	4851 Desert Sky Blvd, Jacksonville, FL, 32249	0.78	Phone reformatted State code upper-cased Gender normalised Whitespace trimmed+1 more
CLM-412665	CLM	Sharon Jordan	1940-10-09	UHC-95905-11	—	9743 Ridge Rd, Jacksonville, FL, 32207	0.78	Name re-cased Street suffix standardised Address re-cased State code upper-cased+1 more
CLM-427684	CLM	Jesse Peterson	1963-11-24	UHC-22892-68	4268226045	3424 Maple Ave, Los Angeles, CA, 90098	0.78	Phone reformatted State code upper-cased Gender normalised Whitespace trimmed+1 more
CLM-401019	CLM	Kimberly Mejia	1977-11-19	UHC-56315-91	—	4850 Indian School Rd, Mesa, AZ, 85252	0.78	Member ID reformatted Street suffix standardised Address re-cased State code upper-cased+1 more
CLM-431713	CLM	Harold Alvarado	1974-10-05	UHC-97987-12	—	2637 Church St, San Antonio, TX, 78216	0.78	Name split from “Last, First”Member ID reformatted State code upper-cased Whitespace trimmed+1 more
CLM-408948	CLM	Seean Stephens	1961-12-23	UHC-73604-61	9708002977	8270 Desert Sky Blvd, Mesa, AZ, 85282	0.78	Name split from “Last, First”Date of birth reformatted Phone reformatted State code upper-cased+1 more
CLM-406103	CLM	Santiago J Crawford	2005-05-22	—	—	3072 Main St, Columbus, OH, 43203	0.78	Date of birth reformatted Street suffix standardised Address re-cased State code upper-cased+1 more
CLM-424188	CLM	Janice P Schultz	1982-07-06	—	6629872284	7254 Forest Ave, Charlotte, NC, 28231	0.78	Phone reformatted Street suffix standardised Address re-cased State code upper-cased+1 more
CLM-402584	CLM	Lawrence Long	1978-02-09	—	—	2494 Palm Dr, Denver, CO, 80253	0.78	Name re-cased Street suffix standardised Address re-cased State code upper-cased+1 more
CLM-419633	CLM	Nicole Carlson	1941-10-20	UHC-64211-07	—	8802 Pine Dr, Tampa, FL, 33663	0.78	Street suffix standardised Address re-cased State code upper-cased Whitespace trimmed+1 more
CLM-415994	CLM	Joseph Cole	1986-04-16	UHC-31831-74	2033264395	427 Pine Dr, San Antonio, TX, 78238	0.78	Name re-cased Phone reformatted SSN last four extracted State code upper-cased+1 more
CLM-418179	CLM	Gregory Perez	1948-09-26	—	—	3026 Valley View Dr, Charlotte, NC, 28285	0.78	Date of birth reformatted Street suffix standardised Address re-cased State code upper-cased+1 more
CLM-412967	CLM	Janice Hunt	—	UHC-20449-42	8569003404	5192 Lincoln Way, Charlotte, NC, 28268	0.78	Date of birth unreadable Phone reformatted State code upper-cased Whitespace trimmed+1 more
CLM-428012	CLM	Justin Perkins	1938-11-26	UHC-33199-49	—	4991 Valley View Dr, Orlando, FL, 32832	0.78	Name re-cased State code upper-cased Gender normalised Whitespace trimmed+1 more
CLM-400918	CLM	Carl Y Cruz	1948-04-12	UHC-48607-37	—	8758 Spring St, Charlotte, NC, 28252	0.78	Name split from “Last, First”Date of birth reformatted City re-cased State code upper-cased+1 more
CLM-427367	CLM	Mary Carroll	2002-08-18	UHC-52050-46	8658569274	2762 Maple Ave, Orlando, FL, 32886	0.78	Name re-cased Phone reformatted Street suffix standardised Address re-cased+1 more
CLM-424173	CLM	Gregory Price	1991-07-24	UHC-11694-58	—	3676 Harbor Blvd, Tampa, FL, 33699	0.78	Name re-cased Two-digit birth year State code upper-cased Whitespace trimmed+1 more
CLM-426341	CLM	Bradley Barnes	1967-01-17	UHC-82109-20	9392818172	6202 Meadow Ln, Austin, TX, 78700	0.78	Phone reformatted Street suffix standardised Address re-cased State code upper-cased+1 more
CLM-426340	CLM	Bradley Barnes	1967-01-17	UHC-82109-20	9392818172	6202 Meadow Ln, Austin, TX, 78700	0.78	Phone reformatted Street suffix standardised Address re-cased State code upper-cased+1 more
CLM-406770	CLM	Donald Silva	1991-12-02	UHC-01229-52	5367923622	2275 Park Pl, Houston, TX, 77047	0.78	Phone reformatted Street suffix standardised Address re-cased State code upper-cased+1 more
CLM-402568	CLM	Mateo Jackson	1990-04-07	—	—	3971 Lincoln Way, Las Vegas, NV, 89146	0.80	Date of birth reformatted State code upper-cased Gender normalised Placeholder values cleared
CLM-401720	CLM	Patricia Price	1985-05-18	UHC-93968-03	—	8942 Apache Blvd, Phoenix, AZ, 85097	0.80	State code upper-cased ZIP+4 trimmed Whitespace trimmed Placeholder values cleared
CLM-415162	CLM	Carol Pena	1995-03-26	UHC-31476-15	—	2755 Palm Dr, Jacksonville, FL, 32245	0.80	Street suffix standardised Address re-cased State code upper-cased Placeholder values cleared
CLM-404216	CLM	Philip Bell	1989-06-25	—	8403121915	2564 Palm Dr, Fresno, CA, 93722	0.80	State code upper-cased Gender normalised Whitespace trimmed Placeholder values cleared
CLM-400202	CLM	Isabella Fernandez	1959-07-24	—	2749908588	9875 Forest Ave, Eden Prairie, MN, 55304	0.80	Name split from “Last, First”State code upper-cased Whitespace trimmed Placeholder values cleared
CLM-427724	CLM	Mark Reid	2001-09-25	UHC-02756-65	—	4841 Union St, Eden Prairie, MN, 55317	0.80	Name split from “Last, First”Date of birth reformatted State code upper-cased Placeholder values cleared
CLM-424548	CLM	William Allen	2006-07-18	UHC-31377-42	—	9630 Mountain View Dr, Miami, FL, 33163	0.80	SSN last four extracted State code upper-cased Whitespace trimmed Placeholder values cleared
CLM-406512	CLM	Laura Hall	1965-01-26	UHC-14143-76	—	8930 Broadway, San Diego, CA, 92142	0.80	City re-cased State code upper-cased Gender normalised Placeholder values cleared
CLM-414560	CLM	Jessica Walsh	1995-02-19	—	—	754 Harbor Blvd, Jacksonville, FL, 32290	0.80	Name re-cased State code upper-cased Gender normalised Placeholder values cleared
CLM-418361	CLM	Kyle Padilla	1983-10-02	UHC-83600-99	9539413714	9353 Valley View Dr, San Antonio, TX, 78227	0.80	Phone reformatted Member ID reformatted State code upper-cased Gender normalised
CLM-428559	CLM	Nathan K Bryant	1962-12-05	UHC-71806-57	—	6883 Main St, Jacksonville, FL	0.80	Date of birth reformatted State code upper-cased ZIP missing Placeholder values cleared
CLM-425208	CLM	Helen G Patel	1995-03-27	UHC-69833-28	—	3185 Valley View Dr, Nashville, TN, 37228	0.80	Street suffix standardised Address re-cased State code upper-cased Placeholder values cleared
CLM-420304	CLM	Gregory Rivera	1955-02-21	—	—	40 Park Pl, Orlando, FL, 32845	0.80	City re-cased State code upper-cased ZIP+4 trimmed Placeholder values cleared
CLM-410110	CLM	Judy Alvarez	2002-12-15	—	—	1422 Park Pl, Dallas, TX, 75278	0.80	Street suffix standardised Address re-cased State code upper-cased Placeholder values cleared
CLM-421830	CLM	Carl Santos	1988-03-04	UHC-14190-34	—	967 Valley View Dr, Tempe, AZ, 85227	0.80	Name split from “Last, First”State code upper-cased Whitespace trimmed Placeholder values cleared
CLM-431686	CLM	Camila Priice	1972-05-11	UHC-50192-84	—	6672 Canyon Rd, Nashville, TN, 37270	0.80	Street suffix standardised Address re-cased State code upper-cased Placeholder values cleared
CLM-427473	CLM	Kevin Day	1956-08-22	UHC-62051-19	9074054771	5489 Jefferson Ave, Houston, TX, 77098	0.80	Name re-cased State code upper-cased Gender normalised Whitespace trimmed
CLM-431329	CLM	Diana Luna	1953-09-27	UHC-63649-97	—	8549 Grand Ave, Columbus, OH, 43269	0.80	Name re-cased State code upper-cased ZIP+4 trimmed Placeholder values cleared

1,156 rows, page 18 of 24Previous Next