Normalised records

Normalised records (silver)

Each raw row is parsed into consistently formatted fields. Every change from the raw value is recorded as a data-quality flag.

Normalised rows

99,495

usable in matching

Flagged rows

99,881

99.9% carry at least one flag

Junk quarantined

505

no usable last name

Average quality score

0.75

1.00 = no corrections needed

Quality flags

What normalisation had to do, and how often. Select a flag to filter the table.

Placeholder values cleared71,257
Placeholder tokens such as NULL, N/A, UNKNOWN or "-" treated as empty
Whitespace trimmed57,061
Leading or trailing whitespace removed from one or more fields
Address re-cased56,490
Street line re-cased and punctuation removed
Street suffix standardised55,824
Street suffix standardised to USPS abbreviation (Street to St, Avenue to Ave, and so on)
Phone reformatted50,244
Phone reduced to ten digits, punctuation and leading country code removed
Name re-cased39,996
Name letter-case rewritten to Title Case and stray characters removed
Date of birth reformatted32,400
Date of birth rewritten to ISO 8601 from a source format (MM/DD/YYYY, YYYYMMDD, Mon D, YYYY)
City re-cased17,850
City re-cased to Title Case
Gender normalised16,828
Gender mapped to F or M from a longer or variant value
Email lower-cased11,635
Email lower-cased
Name split from “Last, First”9,980
First-name field held "LAST, FIRST"; the two parts were split into their own fields
State name converted to code9,084
Full state name replaced by its two-letter USPS code
ZIP+4 trimmed8,263
ZIP+4 trimmed to the five-digit ZIP
Member ID reformatted7,723
Member ID re-hyphenated and upper-cased to the UHC-#####-## pattern
ZIP missing7,146
Street address present but no ZIP supplied
Unit split from street6,994
Apartment, suite or unit designator split from street line and re-appended in standard form
Two-digit birth year6,661
Date of birth carried a two-digit year; century inferred by pivot
State code upper-cased4,010
Two-letter state code upper-cased
Plan code upper-cased3,278
Plan code upper-cased
SSN last four extracted2,817
Last four digits of SSN extracted from a longer or punctuated value
Date of birth unreadable2,274
Date of birth did not match any known format or was out of range; cleared
Phone missing area code2,021
Phone had only seven digits (no area code); cleared
Middle initial moved out of first name1,125
A single middle initial was embedded in the first-name field and moved to middle name
Date of birth missing990
Date of birth absent or a null token; left empty
No usable name (quarantined)505
No usable last name; record quarantined as junk and excluded from matching

Normalised records

All sources, flag “Gender normalised”, lowest dq score first

All ENR CLM TPA PRV

Junk onlyFlagGender normalisedClear

Record	Source	Name	DOB	Member ID	Phone	Address	Quality score	Flags
CLM-410158	CLM	Deborah D Evans	1948-06-12	UHC-93956-02	—	7216 Harbor Blvd, Gilbert, AZ, 85270	0.70	Name split from “Last, First”Gender normalised Whitespace trimmed
ENR-107448	ENR	Henry U Larson	2005-10-19	UHC-00409-57	6215021280	3319 Maple Ave, Jacksonville, FL, 32204	0.70	State name converted to code Gender normalised Whitespace trimmed
ENR-130314	ENR	Austin Cox	1984-02-08	UHC-69639-21	6435734823	9295 Union St, Austin, TX, 78795	0.70	Name split from “Last, First”Phone reformatted Gender normalised
ENR-119527	ENR	George M Bell	2008-02-09	UHC-61073-83	2425028549	3580 Spring St, Seattle, WA, 98150	0.70	City re-cased ZIP+4 trimmed Gender normalised
ENR-136951	ENR	Samantha V Riley	1965-12-27	UHC-88189-45	2449878790	5302 Hillcrest Rd Apt 28, Orlando, FL, 32828	0.70	Unit split from street Gender normalised Whitespace trimmed
ENR-119412	ENR	Alice E Marquez	1978-07-18	UHC-69942-61	4518112987	664 Oak St, Jacksonville, FL, 32229	0.70	Street suffix standardised Address re-cased Gender normalised
CLM-427257	CLM	Mateo Armstrong	1989-08-23	—	—	—	0.70	Name split from “Last, First”Gender normalised Placeholder values cleared
TPA-61217	TPA	Carol Watkins	1997-02-06	—	—	7919 Broadway, San Antonio, TX, 78290	0.70	Name split from “Last, First”Gender normalised Placeholder values cleared
TPA-61216	TPA	Carol Watkins	1997-02-06	—	—	7919 Broadway, San Antonio, TX, 78290	0.70	Name split from “Last, First”Gender normalised Placeholder values cleared
PRV-29168	PRV	Daniel A Fowler	1974-12-04	—	—	9441 Broadway, Atlanta, GA, 30300	0.70	Name split from “Last, First”Gender normalised Placeholder values cleared
PRV-28112	PRV	Grace Wong	1999-12-03	UHC-13056-47	—	—	0.70	SSN last four extracted Gender normalised Placeholder values cleared
ENR-142991	ENR	Marilyn R Spencer	2005-10-20	UHC-90446-75	—	4124 Lake View Rd, Dallas, TX, 75207	0.70	Street suffix standardised Address re-cased Gender normalised
CLM-424777	CLM	Arjun Meyer	2002-05-20	UHC-42340-66	6435950351	5146 Valley View Dr, Mesa, AZ, 85235	0.70	ZIP+4 trimmed Gender normalised Placeholder values cleared
PRV-27511	PRV	Nathan R Clark	1941-01-15	UHC-81651-12	2929846918	—	0.70	Middle initial moved out of first name Gender normalised Placeholder values cleared
ENR-124832	ENR	Arthr W Greene	1988-06-27	UHC-95001-21	9006830550	5078 Indian School Rd, Miami, FL, 33106	0.70	Date of birth reformatted SSN last four extracted Gender normalised
ENR-125541	ENR	Zachary I Thompson	1994-01-28	UHC-57296-58	9576567938	8390 Forest Ave, Seattle, WA, 98195	0.70	State name converted to code Email lower-cased Gender normalised
ENR-138174	ENR	Santiago Stone	2008-06-10	UHC-50353-26	3094994208	1723 Cedar Ln, Houston, TX, 77084	0.70	Phone reformatted ZIP+4 trimmed Gender normalised
CLM-430764	CLM	Carolyn Simmons	1960-04-05	UHC-93810-96	8766516529	7621 Camelback Rd, Jacksonville, FL, 32270	0.70	Name split from “Last, First”Date of birth reformatted Gender normalised
ENR-142719	ENR	Carlos G Ruiz	1986-04-23	UHC-41194-02	8483815644	4033 Maple Ave, Glendale, AZ, 85316	0.70	Name re-cased State name converted to code Gender normalised
TPA-64330	TPA	Laura Torres	1972-04-11	—	—	3253 Willow Ct, Columbus, OH	0.70	ZIP missing Gender normalised Placeholder values cleared
CLM-403973	CLM	Catherine O Warren	1967-02-15	UHC-42276-35	—	290 Grand Ave, Fresno, CA, 93735	0.70	Phone missing area code Gender normalised Placeholder values cleared
TPA-63650	TPA	Richard E Roebrtson	—	—	—	—	0.70	Date of birth missing Gender normalised Placeholder values cleared
ENR-127112	ENR	Cheryl N Soto	1961-09-09	UHC-30516-95	—	5416 Baseline Rd, Nashville, TN, 37248	0.70	Street suffix standardised Address re-cased Gender normalised
CLM-425046	CLM	Ralph H Morris	1971-12-28	UHC-47328-94	—	2055 Forest Ave, Austin, TX, 78718	0.70	State name converted to code Gender normalised Placeholder values cleared
ENR-104453	ENR	Joe Carroll	1986-08-05	UHC-17125-04	7885598772	769 Willow Ct, Sacramento, CA, 95813	0.70	Name split from “Last, First”Member ID reformatted Gender normalised
CLM-401499	CLM	Judith Arnold	1968-02-05	—	—	5198 Church St, Dallas, TX, 75262	0.70	State name converted to code Gender normalised Placeholder values cleared
ENR-139818	ENR	Charles X Butler	1963-10-19	UHC-33196-93	8462801030	7058 Central Ave, Miami, FL	0.70	City re-cased ZIP missing Gender normalised
CLM-420110	CLM	Randy Medina	1973-05-25	UHC-46897-05	—	2559 Washington St, San Antonio, TX, 78292	0.70	Name split from “Last, First”Gender normalised Placeholder values cleared
ENR-115908	ENR	Pamela Hunt	1955-10-25	UHC-33974-06	9553073739	8769 Meadow Ln, Dallas, TX	0.70	ZIP missing Gender normalised Whitespace trimmed
CLM-417392	CLM	Betty Mason	1987-07-19	UHC-13974-16	—	4776 Hillcrest Rd, Tempe, AZ, 85262	0.70	Street suffix standardised Address re-cased Gender normalised
CLM-410452	CLM	Charlotte Warren	1953-12-28	—	—	—	0.70	Name split from “Last, First”Gender normalised Placeholder values cleared
ENR-109553	ENR	Daniel Freeman	1956-01-22	UHC-53118-31	8016636961	3438 Main St, Minneapolis, MN, 55463	0.70	Date of birth reformatted ZIP+4 trimmed Gender normalised
ENR-101274	ENR	Mason U Alvarado	1986-06-27	UHC-78605-01	4596639608	5551 Spring St, Jacksonville, FL, 32253	0.70	Phone reformatted SSN last four extracted Gender normalised
CLM-416685	CLM	Nathan Reid	2008-12-27	UHC-64789-70	7248086884	7259 Mesa Dr, Glendale, AZ	0.70	Phone reformatted ZIP missing Gender normalised
ENR-128214	ENR	Kevyn P King	1980-12-17	UHC-00010-37	—	7344 Indian School Rd, Sacramento, CA, 95823	0.70	Name split from “Last, First”Gender normalised Placeholder values cleared
ENR-119567	ENR	Theresa S Martinez	2003-02-12	UHC-45441-28	9499599770	2399 Valley View Dr, Nashville, TN, 37283	0.70	Name split from “Last, First”Phone reformatted Gender normalised
TPA-52831	TPA	Joan Bryant	1976-01-01	—	3477781633	7618 Meadow Ln, Tucson, AZ, 85726	0.70	Name split from “Last, First”Gender normalised Placeholder values cleared
ENR-105278	ENR	Patrick I Young	1938-04-20	UHC-68875-92	4995962742	9865 Church St, Plano, TX	0.70	Name re-cased ZIP missing Gender normalised
ENR-107967	ENR	Gregory Boyd	1959-04-06	UHC-93839-18	7604885676	9511 Harbor Blvd # 259, Scottsdale, AZ, 85203	0.70	Phone reformatted Unit split from street Gender normalised
CLM-404515	CLM	Deborah Munoz	1989-05-06	—	—	5131 Apache Blvd, Gilbert, AZ, 85265	0.70	Name split from “Last, First”Gender normalised Placeholder values cleared
CLM-412893	CLM	Joe Richards	1945-09-03	—	—	5655 Ridge Rd, Minneapolis, MN	0.70	ZIP missing Gender normalised Placeholder values cleared
CLM-416311	CLM	Walter Phillips	1998-10-01	—	—	3291 Broadway # 341, Fresno, CA, 93755	0.70	Unit split from street Gender normalised Placeholder values cleared
CLM-418562	CLM	Vincent Laawson	1948-08-14	—	—	2658 Valley View Dr, Chandler, AZ, 85252	0.70	State name converted to code Gender normalised Placeholder values cleared
ENR-111979	ENR	Amy S Lucas	1986-08-11	UHC-81763-72	8409356103	5591 Forest Ave, Atlanta, GA, 30317	0.70	Middle initial moved out of first name Email lower-cased Gender normalised
CLM-407708	CLM	Michelle Luna	2001-07-03	UHC-80345-60	—	2555 Pine Dr, Los Angeles, CA, 90092	0.70	Two-digit birth year Gender normalised Placeholder values cleared
PRV-27409	PRV	Gary Delgado	1945-02-08	—	—	8879 Valley View Dr, Fresno, CA, 93767	0.70	ZIP+4 trimmed Gender normalised Placeholder values cleared
CLM-402833	CLM	Martha Chapman	1947-11-06	—	5645129782	—	0.70	Name split from “Last, First”Gender normalised Placeholder values cleared
PRV-27608	PRV	Douglas B Sims	1987-01-18	UHC-75923-17	—	—	0.70	Phone missing area code Gender normalised Placeholder values cleared
ENR-130183	ENR	Diego Ferguson	1984-06-08	UHC-07762-22	9706859537	1523 Union St, San Antonio, TX, 78229	0.70	Phone reformatted ZIP+4 trimmed Gender normalised
ENR-128065	ENR	Nicole Hansen	2007-07-26	UHC-66560-42	8679179787	8627 Elm St # 742, Scottsdale, AZ, 85221	0.70	Phone reformatted Unit split from street Gender normalised

16,828 rows, page 249 of 337Previous Next