Normalised records

Normalised records (silver)

Each raw row is parsed into consistently formatted fields. Every change from the raw value is recorded as a data-quality flag.

Normalised rows

99,495

usable in matching

Flagged rows

99,881

99.9% carry at least one flag

Junk quarantined

505

no usable last name

Average quality score

0.75

1.00 = no corrections needed

Quality flags

What normalisation had to do, and how often. Select a flag to filter the table.

Placeholder values cleared71,257
Placeholder tokens such as NULL, N/A, UNKNOWN or "-" treated as empty
Whitespace trimmed57,061
Leading or trailing whitespace removed from one or more fields
Address re-cased56,490
Street line re-cased and punctuation removed
Street suffix standardised55,824
Street suffix standardised to USPS abbreviation (Street to St, Avenue to Ave, and so on)
Phone reformatted50,244
Phone reduced to ten digits, punctuation and leading country code removed
Name re-cased39,996
Name letter-case rewritten to Title Case and stray characters removed
Date of birth reformatted32,400
Date of birth rewritten to ISO 8601 from a source format (MM/DD/YYYY, YYYYMMDD, Mon D, YYYY)
City re-cased17,850
City re-cased to Title Case
Gender normalised16,828
Gender mapped to F or M from a longer or variant value
Email lower-cased11,635
Email lower-cased
Name split from “Last, First”9,980
First-name field held "LAST, FIRST"; the two parts were split into their own fields
State name converted to code9,084
Full state name replaced by its two-letter USPS code
ZIP+4 trimmed8,263
ZIP+4 trimmed to the five-digit ZIP
Member ID reformatted7,723
Member ID re-hyphenated and upper-cased to the UHC-#####-## pattern
ZIP missing7,146
Street address present but no ZIP supplied
Unit split from street6,994
Apartment, suite or unit designator split from street line and re-appended in standard form
Two-digit birth year6,661
Date of birth carried a two-digit year; century inferred by pivot
State code upper-cased4,010
Two-letter state code upper-cased
Plan code upper-cased3,278
Plan code upper-cased
SSN last four extracted2,817
Last four digits of SSN extracted from a longer or punctuated value
Date of birth unreadable2,274
Date of birth did not match any known format or was out of range; cleared
Phone missing area code2,021
Phone had only seven digits (no area code); cleared
Middle initial moved out of first name1,125
A single middle initial was embedded in the first-name field and moved to middle name
Date of birth missing990
Date of birth absent or a null token; left empty
No usable name (quarantined)505
No usable last name; record quarantined as junk and excluded from matching

Normalised records

Third-party administrator, flag “Placeholder values cleared”, lowest dq score first

All ENR CLM TPA PRV

Junk onlyFlagPlaceholder values clearedClear

Record	Source	Name	DOB	Member ID	Phone	Address	Quality score	Flags
TPA-59829	TPA	HiroshiJunk	1986-06-12	—	2936217265	1483 Canyon Rd, Houston, TX, 77002	0.82	Phone reformatted Placeholder values cleared No usable name (quarantined)
TPA-62975	TPA	Angela Estrada	1999-03-05	—	8085122748	5971 Camelback Rd, San Diego, CA, 92156	0.82	Name split from “Last, First”Phone reformatted Placeholder values cleared
TPA-52590	TPA	Sara Kyng	1996-12-15	UHC-68504-05	—	—	0.82	Name re-cased Gender normalised Placeholder values cleared
TPA-60298	TPA	Kathy Edwards	1955-08-04	—	9648259461	6159 Lake View Rd Apt 14, Nashville, TN, 37203	0.82	Phone reformatted Unit split from street Placeholder values cleared
TPA-57431	TPA	Terrry Richardson	1984-07-04	—	—	921 Main St # 693, Chandler, AZ, 85220	0.82	Date of birth reformatted Unit split from street Placeholder values cleared
TPA-57830	TPA	Ann Wagner	2000-06-10	—	5799385292	2748 Harbor Blvd, Las Vegas, NV, 89160	0.82	Two-digit birth year Whitespace trimmed Placeholder values cleared
TPA-57796	TPA	Danielle Ferguson	1945-04-19	—	—	3567 Elm St, San Antonio, TX, 78209	0.82	Street suffix standardised Address re-cased Placeholder values cleared
TPA-54180	TPA	Ralph Chavez	1988-12-07	—	—	8378 Ridge Rd, Denver, CO, 80258	0.82	Name re-cased Gender normalised Placeholder values cleared
TPA-64185	TPA	Melissa Fox	1979-10-28	—	3326363708	—	0.82	Name split from “Last, First”Phone reformatted Placeholder values cleared
TPA-63585	TPA	Randy Woods	1949-10-25	—	—	8616 Camelback Rd, Jacksonville, FL, 32235	0.82	State name converted to code Whitespace trimmed Placeholder values cleared
TPA-50535	TPA	Jordan Cruz	2008-01-23	—	—	4114 Spring St, Plano, TX, 75047	0.82	Two-digit birth year Whitespace trimmed Placeholder values cleared
TPA-53024	TPA	Laura Aguilar	1943-08-17	—	—	3684 Baseline Rd, Denver, CO, 80283	0.82	Street suffix standardised Address re-cased Placeholder values cleared
TPA-50424	TPA	Peter Carter	1999-02-24	—	—	8215 Market St, Fresno, CA, 93755	0.82	Street suffix standardised Address re-cased Placeholder values cleared
TPA-60888	TPA	Joey Murray	1957-08-06	—	3668801507	3641 Union St, Eden Prairie, MN, 55350	0.82	Street suffix standardised Address re-cased Placeholder values cleared
TPA-53719	TPA	Judy Payne	1950-01-20	—	—	1141 Indian School Rd, Minneapolis, MN, 55402	0.82	Street suffix standardised Address re-cased Placeholder values cleared
TPA-57272	TPA	Shirley Diaz	1960-11-11	—	—	6942 Sage Ct, Austin, TX, 78743	0.82	Name re-cased Gender normalised Placeholder values cleared
TPA-52856	TPA	Luis Reed	1944-04-24	—	2423077489	3980 Meadow Ln, Orlando, FL, 32821	0.82	Date of birth reformatted State name converted to code Placeholder values cleared
TPA-56074	TPA	Timothy Gonzalez	1941-09-16	—	—	9092 Willow Ct, Minneapolis, MN, 55494	0.82	Street suffix standardised Address re-cased Placeholder values cleared
TPA-54962	TPA	Camila Perins	1986-01-14	—	—	3532 Canyon Rd, Scottsdale, AZ, 85248	0.82	Street suffix standardised Address re-cased Placeholder values cleared
TPA-50170	TPA	Sean Rogers	1972-01-26	—	2185938625	—	0.82	Name split from “Last, First”Whitespace trimmed Placeholder values cleared
TPA-59918	TPA	Victoria Robertson	1946-04-04	UHC-63552-87	7348976315	—	0.82	Phone reformatted Gender normalised Placeholder values cleared
TPA-58919	TPA	Tyller Li	1940-02-08	—	—	3573 Grand Ave, Las Vegas, NV, 89111	0.82	City re-cased Gender normalised Placeholder values cleared
TPA-56100	TPA	Omar Mason	1987-04-02	—	5855453290	8246 Union St, Minneapolis, MN	0.82	ZIP missing Whitespace trimmed Placeholder values cleared
TPA-61654	TPA	Shirley Soto	1948-09-15	—	3274211075	6577 Baseline Rd Apt 20, Nashville, TN, 37217	0.82	Unit split from street Whitespace trimmed Placeholder values cleared
TPA-52177	TPA	Martha Willis	1966-07-20	—	—	3212 Bayshore Dr, Glendale, AZ, 85351	0.82	Two-digit birth year City re-cased Placeholder values cleared
TPA-64243	TPA	John Luna	1982-01-25	—	—	2837 Jefferson Ave, Mesa, AZ, 85294	0.82	Name re-cased Gender normalised Placeholder values cleared
TPA-58785	TPA	Ralph Fernandez	1943-07-07	—	—	—	0.82	Name split from “Last, First”Date of birth reformatted Placeholder values cleared
TPA-54755	TPA	Amanda A Rice	1940-05-10	—	—	8763 Spring St, Fresno, CA, 93709	0.82	Name split from “Last, First”City re-cased Placeholder values cleared
TPA-64131	TPA	Mateo I Sims	1981-03-12	—	—	—	0.82	Middle initial moved out of first name Whitespace trimmed Placeholder values cleared
TPA-63358	TPA	Jesse Flores	2008-11-16	—	—	7763 Hillcrest Rd, Nashville, TN, 37275	0.82	Name split from “Last, First”Whitespace trimmed Placeholder values cleared
TPA-61503	TPA	Evelyn Yang	1985-12-24	—	—	—	0.82	Name split from “Last, First”Date of birth reformatted Placeholder values cleared
TPA-51183	TPA	Thomas Soto	1970-03-01	—	7869810060	—	0.82	Two-digit birth year Whitespace trimmed Placeholder values cleared
TPA-57528	TPA	Brian Gutierrez	1995-03-11	UHC-44758-23	—	6475 Central Ave, Sacramento, CA, 95874	0.82	Street suffix standardised Address re-cased Placeholder values cleared
TPA-61898	TPA	Mason Fuller	2006-01-11	—	—	6548 Washington St, Austin, TX, 78700	0.82	Name re-cased State name converted to code Placeholder values cleared
TPA-60124	TPA	Kelly Silva	1965-06-28	—	—	5859 Spring St, Eden Prairie, MN, 55313	0.82	State name converted to code Whitespace trimmed Placeholder values cleared
TPA-55124	TPA	Amanda Allen	1954-10-20	—	—	4736 Lake View Rd, San Diego, CA, 92196	0.82	Street suffix standardised Address re-cased Placeholder values cleared
TPA-52727	TPA	Samantha Crawford	1985-10-16	—	—	4309 Main St, Tampa, FL, 33607	0.82	Name split from “Last, First”Whitespace trimmed Placeholder values cleared
TPA-54223	TPA	George Baker	1944-02-06	—	—	4291 Hillcrest Rd # 202, San Diego, CA, 92122	0.82	Unit split from street Whitespace trimmed Placeholder values cleared
TPA-54224	TPA	George Baker	1944-02-06	—	—	4291 Hillcrest Rd # 202, San Diego, CA, 92122	0.82	Unit split from street Whitespace trimmed Placeholder values cleared
TPA-50788	TPA	Sara E Ortega	1954-09-16	—	6259326223	8418 Lake View Rd, Scottsdale, AZ, 85269	0.82	Two-digit birth year Phone reformatted Placeholder values cleared
TPA-56692	TPA	Brittany Mrris	2001-01-10	—	4673404072	—	0.82	Name split from “Last, First”Whitespace trimmed Placeholder values cleared
TPA-64075	TPA	Isabella Rose	1991-01-19	UHC-86613-44	—	—	0.82	Two-digit birth year Whitespace trimmed Placeholder values cleared
TPA-60995	TPA	Debrah Luna	1952-12-05	—	—	5251 Camelback Rd, Gilbert, AZ, 85233	0.82	Street suffix standardised Address re-cased Placeholder values cleared
TPA-56687	TPA	Patricia Cook	2000-07-23	UHC-83160-56	—	1425 Valley View Dr, Sacramento, CA, 95878	0.82	Street suffix standardised Address re-cased Placeholder values cleared
TPA-50672	TPA	Christian Hicks	1961-12-20	—	6385243268	444 Grand Ave, Los Angeles, CA, 90018	0.82	Name re-cased Gender normalised Placeholder values cleared
TPA-56458	TPA	Santiago Wong	1981-08-16	—	—	7006 Mesa Dr, Jacksonville, FL, 32243	0.82	Street suffix standardised Address re-cased Placeholder values cleared
TPA-61712	TPA	Gary Collns	1978-09-17	—	—	3518 Mountain View Dr, Los Angeles, CA, 90037	0.82	Date of birth reformatted SSN last four extracted Placeholder values cleared
TPA-60752	TPA	Isabella Adams	1984-04-08	—	—	5521 Church St, Jacksonville, FL, 32276	0.82	Two-digit birth year Whitespace trimmed Placeholder values cleared
TPA-63247	TPA	Denise Knight	2005-03-02	—	—	7847 Central Ave, San Antonio, TX, 78282	0.82	Name split from “Last, First”Date of birth reformatted Placeholder values cleared
TPA-61155	TPA	Bruce U Evans	1946-06-09	—	—	—	0.82	Gender normalised Whitespace trimmed Placeholder values cleared

14,135 rows, page 194 of 283Previous Next