Normalised records

Normalised records (silver)

Each raw row is parsed into consistently formatted fields. Every change from the raw value is recorded as a data-quality flag.

Normalised rows

99,495

usable in matching

Flagged rows

99,881

99.9% carry at least one flag

Junk quarantined

505

no usable last name

Average quality score

0.75

1.00 = no corrections needed

Quality flags

What normalisation had to do, and how often. Select a flag to filter the table.

Placeholder values cleared71,257
Placeholder tokens such as NULL, N/A, UNKNOWN or "-" treated as empty
Whitespace trimmed57,061
Leading or trailing whitespace removed from one or more fields
Address re-cased56,490
Street line re-cased and punctuation removed
Street suffix standardised55,824
Street suffix standardised to USPS abbreviation (Street to St, Avenue to Ave, and so on)
Phone reformatted50,244
Phone reduced to ten digits, punctuation and leading country code removed
Name re-cased39,996
Name letter-case rewritten to Title Case and stray characters removed
Date of birth reformatted32,400
Date of birth rewritten to ISO 8601 from a source format (MM/DD/YYYY, YYYYMMDD, Mon D, YYYY)
City re-cased17,850
City re-cased to Title Case
Gender normalised16,828
Gender mapped to F or M from a longer or variant value
Email lower-cased11,635
Email lower-cased
Name split from “Last, First”9,980
First-name field held "LAST, FIRST"; the two parts were split into their own fields
State name converted to code9,084
Full state name replaced by its two-letter USPS code
ZIP+4 trimmed8,263
ZIP+4 trimmed to the five-digit ZIP
Member ID reformatted7,723
Member ID re-hyphenated and upper-cased to the UHC-#####-## pattern
ZIP missing7,146
Street address present but no ZIP supplied
Unit split from street6,994
Apartment, suite or unit designator split from street line and re-appended in standard form
Two-digit birth year6,661
Date of birth carried a two-digit year; century inferred by pivot
State code upper-cased4,010
Two-letter state code upper-cased
Plan code upper-cased3,278
Plan code upper-cased
SSN last four extracted2,817
Last four digits of SSN extracted from a longer or punctuated value
Date of birth unreadable2,274
Date of birth did not match any known format or was out of range; cleared
Phone missing area code2,021
Phone had only seven digits (no area code); cleared
Middle initial moved out of first name1,125
A single middle initial was embedded in the first-name field and moved to middle name
Date of birth missing990
Date of birth absent or a null token; left empty
No usable name (quarantined)505
No usable last name; record quarantined as junk and excluded from matching

Normalised records

Claims, flag “Phone reformatted”, lowest dq score first

All ENR CLM TPA PRV

Junk onlyFlagPhone reformattedClear

Record	Source	Name	DOB	Member ID	Phone	Address	Quality score	Flags
CLM-407577	CLM	Mateo Salazar	1960-07-25	—	2698371994	1316 Broadway, San Antonio, TX, 78252	0.82	Phone reformatted Gender normalised Placeholder values cleared
CLM-419963	CLM	Omar U Stevens	1970-10-06	UHC-20389-49	7394425307	1230 Church St Apt 14, Atlanta, GA, 30397	0.82	Phone reformatted Unit split from street Whitespace trimmed
CLM-416856	CLM	Janet Cruz	1942-09-25	UHC-97798-27	9218236106	9160 Sage Ct, Nashville, TN, 37254	0.82	Phone reformatted Gender normalised Placeholder values cleared
CLM-406798	CLM	Doris Y Cooper	1969-06-21	UHC-46929-19	3228304402	—	0.82	Name split from “Last, First”Phone reformatted Placeholder values cleared
CLM-410795	CLM	Naancy S Carroll	1979-05-04	UHC-31589-42	7898429756	6414 Meadow Ln, Phoenix, AZ, 85091	0.82	Phone reformatted State name converted to code Whitespace trimmed
CLM-423739	CLM	Alan Thompson	1972-10-05	UHC-77689-96	5816288126	2288 Sunset Blvd, Eden Prairie, MN, 55346	0.82	Phone reformatted State name converted to code Placeholder values cleared
CLM-428034	CLM	Lawrence L Johnston	1918-05-16	UHC-28017-01	9333107818	5252 Highland Ave, Tempe, AZ, 85240	0.82	Phone reformatted ZIP+4 trimmed Placeholder values cleared
CLM-426529	CLM	Kimberly Banks	1973-08-14	UHC-47323-56	2288029057	1608 Pine Dr, Miami, FL, 33145	0.82	Phone reformatted SSN last four extracted Placeholder values cleared
CLM-413998	CLM	Olivia Hunt	2002-12-18	UHC-49329-86	2317836571	1027 Oak St, Mesa, AZ, 85241	0.82	Phone reformatted Gender normalised Placeholder values cleared
CLM-409562	CLM	Elizabeth Olson	1982-01-28	UHC-75955-49	6824039215	—	0.82	Phone reformatted Gender normalised Placeholder values cleared
CLM-409824	CLM	Joe Thomas	1980-08-27	UHC-66607-08	4176737554	—	0.82	Name split from “Last, First”Phone reformatted Placeholder values cleared
CLM-408436	CLM	Ryan Diaz	1991-04-01	—	3212105174	1621 Willow Ct, Columbus, OH, 43295	0.82	Phone reformatted Gender normalised Placeholder values cleared
CLM-417428	CLM	Walter Baker	1999-03-23	UHC-86359-86	9879025711	8667 Hillcrest Rd, Sacramento, CA, 95810	0.82	Phone reformatted SSN last four extracted Placeholder values cleared
CLM-421069	CLM	Billy Morris	2002-09-27	UHC-18091-66	8985323762	—	0.82	Name split from “Last, First”Phone reformatted Placeholder values cleared
CLM-400976	CLM	Sean Hunter	1944-01-18	—	6185124174	5604 Pine Dr, Austin, TX	0.82	Phone reformatted ZIP missing Placeholder values cleared
CLM-404807	CLM	Philip Cruz	1950-04-31	UHC-16685-19	8113338351	7326 Broadway, Atlanta, GA, 30313	0.82	Name split from “Last, First”Phone reformatted Placeholder values cleared
CLM-416777	CLM	Karen Mitchell	1996-06-04	UHC-88403-77	9339211041	—	0.82	Name split from “Last, First”Phone reformatted Whitespace trimmed
CLM-407066	CLM	Brenda Wells	—	—	3667773249	—	0.82	Date of birth unreadable Phone reformatted Placeholder values cleared
CLM-424334	CLM	Pamela Taylor	1964-10-09	UHC-54051-45	5728062649	6513 Mountain View Dr, Denver, CO, 80237	0.82	Phone reformatted Gender normalised Placeholder values cleared
CLM-403838	CLM	Omar Knigght	1954-03-18	UHC-76996-54	7195293740	6084 Grand Ave, Phoenix, AZ, 85090	0.82	Two-digit birth year Phone reformatted Whitespace trimmed
CLM-401777	CLM	Elijah Ross	1971-11-17	UHC-43383-31	6468162965	6360 Mesa Dr, Tampa, FL, 33632	0.82	Phone reformatted ZIP+4 trimmed Placeholder values cleared
CLM-428424	CLM	Olivia Gilbert	1972-07-07	—	2306390465	2339 Oak St, San Antonio, TX, 78241	0.82	Phone reformatted Street suffix standardised Address re-cased
CLM-400343	CLM	Cheryl Howard	1946-08-24	UHC-29543-47	4318366154	5314 Apache Blvd, Las Vegas, NV, 89176	0.82	Phone reformatted Street suffix standardised Address re-cased
CLM-416979	CLM	Aisha Santos	1981-12-07	UHC-20680-09	8632051547	8512 Bayshore Dr, Miami, FL, 33184	0.82	Phone reformatted State name converted to code Whitespace trimmed
CLM-414349	CLM	Wei Castillo	1960-11-18	—	9062439468	2397 Willow Ct # 781, Eden Prairie, MN, 55392	0.82	Phone reformatted Unit split from street Placeholder values cleared
CLM-424366	CLM	Betty Scott	—	UHC-50628-36	2746697839	3319 Washington St, Plano, TX, 75006	0.82	Date of birth unreadable Phone reformatted Placeholder values cleared
CLM-402843	CLM	Billy Nunez	2006-01-11	UHC-35702-03	2149933735	—	0.82	Two-digit birth year Phone reformatted Placeholder values cleared
CLM-413809	CLM	Sarah Oliver	1996-07-24	UHC-32902-31	2285136446	—	0.82	Phone reformatted Gender normalised Whitespace trimmed
CLM-409447	CLM	Sara Ramos	1998-09-02	UHC-90845-02	6568151176	4731 Sage Ct, San Diego, CA, 92168	0.82	Name split from “Last, First”Phone reformatted Placeholder values cleared
CLM-401967	CLM	Nathan Carpenter	1959-06-26	UHC-33486-31	7788386260	3681 Meadow Ln, Scottsdale, AZ, 85218	0.82	Phone reformatted State name converted to code Placeholder values cleared
CLM-408898	CLM	Austin Johnston	2004-06-10	UHC-13663-84	3269066372	4118 Church St, Las Vegas, NV, 89196	0.82	Phone reformatted Gender normalised Placeholder values cleared
CLM-419366	CLM	Julia Le	1972-12-15	UHC-13063-97	2789404205	9364 Market St, Tucson, AZ, 85750	0.82	Phone reformatted ZIP+4 trimmed Placeholder values cleared
CLM-403684	CLM	Arjun W Richardson	1995-07-14	UHC-29828-03	5063767791	1606 Valley View Dr, Sacramento, CA, 95824	0.82	Phone reformatted Street suffix standardised Address re-cased
CLM-404177	CLM	Willlie Price	1946-06-09	UHC-51717-16	6119984074	—	0.82	Name split from “Last, First”Phone reformatted Placeholder values cleared
CLM-419168	CLM	Bradley Arnold	1982-06-07	UHC-81020-33	5115323711	—	0.82	Phone reformatted Gender normalised Placeholder values cleared
CLM-427561	CLM	Sofia Mitcchell	1969-05-08	UHC-25956-67	6635226738	1194 Ridge Rd, Miami, FL, 33130	0.82	Phone reformatted SSN last four extracted Placeholder values cleared
CLM-432466	CLM	Donald Simpson	1976-07-23	—	5643816326	—	0.82	Two-digit birth year Phone reformatted Placeholder values cleared
CLM-422262	CLM	Randy Sullivan	1986-02-21	UHC-42995-56	5488104445	841 Grand Ave, Miami, FL, 33194	0.82	Name split from “Last, First”Phone reformatted Placeholder values cleared
CLM-409361	CLM	Susan Scott	1971-09-12	UHC-34135-53	7159685927	6472 Main St, San Diego, CA	0.82	Phone reformatted ZIP missing Placeholder values cleared
CLM-414243	CLM	Jess Morgan	1957-05-01	—	3054304965	4019 Meadow Ln, Glendale, AZ	0.82	Phone reformatted ZIP missing Placeholder values cleared
CLM-413364	CLM	Andrew P Ramos	1951-09-27	UHC-09140-27	9076343928	2590 Market St, Dallas, TX, 75211	0.82	Phone reformatted State name converted to code Placeholder values cleared
CLM-417830	CLM	Marcus Warren	1963-05-07	—	3885975373	7634 Apache Blvd, Columbus, OH, 43293	0.82	Phone reformatted Gender normalised Placeholder values cleared
CLM-430451	CLM	Henry Riley	1989-05-22	UHC-56379-27	9583325527	—	0.82	Name split from “Last, First”Phone reformatted Placeholder values cleared
CLM-407613	CLM	Willie V Robinson	1992-04-01	—	5023689952	—	0.82	Name split from “Last, First”Phone reformatted Placeholder values cleared
CLM-427283	CLM	Mdaison Adams	1977-04-24	UHC-85490-31	6136132644	7892 Maple Ave, Mesa, AZ, 85280	0.82	Name re-cased Phone reformatted ZIP+4 trimmed
CLM-414211	CLM	Wei K Flores	1946-10-15	—	8686401554	2163 Union St, Eden Prairie, MN, 55343	0.82	Phone reformatted Gender normalised Placeholder values cleared
CLM-425830	CLM	Walter Guerrero	2001-02-15	—	3548703192	8015 Apache Blvd, Minneapolis, MN, 55469	0.82	Phone reformatted Street suffix standardised Address re-cased
CLM-408693	CLM	John Lee	1980-12-10	UHC-76890-70	2785192062	7726 Mesa Dr, Nashville, TN, 37298	0.82	Phone reformatted Gender normalised Placeholder values cleared
CLM-400218	CLM	John Cunningham	1954-02-12	UHC-37758-42	7973018449	—	0.82	Phone reformatted Gender normalised Placeholder values cleared
CLM-431554	CLM	Yuki Simpson	1964-09-27	—	2542366654	—	0.82	Name split from “Last, First”Phone reformatted Placeholder values cleared

11,960 rows, page 174 of 240Previous Next