Normalised records

Normalised records (silver)

Each raw row is parsed into consistently formatted fields. Every change from the raw value is recorded as a data-quality flag.

Normalised rows

99,495

usable in matching

Flagged rows

99,881

99.9% carry at least one flag

Junk quarantined

505

no usable last name

Average quality score

0.75

1.00 = no corrections needed

Quality flags

What normalisation had to do, and how often. Select a flag to filter the table.

Placeholder values cleared71,257
Placeholder tokens such as NULL, N/A, UNKNOWN or "-" treated as empty
Whitespace trimmed57,061
Leading or trailing whitespace removed from one or more fields
Address re-cased56,490
Street line re-cased and punctuation removed
Street suffix standardised55,824
Street suffix standardised to USPS abbreviation (Street to St, Avenue to Ave, and so on)
Phone reformatted50,244
Phone reduced to ten digits, punctuation and leading country code removed
Name re-cased39,996
Name letter-case rewritten to Title Case and stray characters removed
Date of birth reformatted32,400
Date of birth rewritten to ISO 8601 from a source format (MM/DD/YYYY, YYYYMMDD, Mon D, YYYY)
City re-cased17,850
City re-cased to Title Case
Gender normalised16,828
Gender mapped to F or M from a longer or variant value
Email lower-cased11,635
Email lower-cased
Name split from “Last, First”9,980
First-name field held "LAST, FIRST"; the two parts were split into their own fields
State name converted to code9,084
Full state name replaced by its two-letter USPS code
ZIP+4 trimmed8,263
ZIP+4 trimmed to the five-digit ZIP
Member ID reformatted7,723
Member ID re-hyphenated and upper-cased to the UHC-#####-## pattern
ZIP missing7,146
Street address present but no ZIP supplied
Unit split from street6,994
Apartment, suite or unit designator split from street line and re-appended in standard form
Two-digit birth year6,661
Date of birth carried a two-digit year; century inferred by pivot
State code upper-cased4,010
Two-letter state code upper-cased
Plan code upper-cased3,278
Plan code upper-cased
SSN last four extracted2,817
Last four digits of SSN extracted from a longer or punctuated value
Date of birth unreadable2,274
Date of birth did not match any known format or was out of range; cleared
Phone missing area code2,021
Phone had only seven digits (no area code); cleared
Middle initial moved out of first name1,125
A single middle initial was embedded in the first-name field and moved to middle name
Date of birth missing990
Date of birth absent or a null token; left empty
No usable name (quarantined)505
No usable last name; record quarantined as junk and excluded from matching

Normalised records

Third-party administrator, flag “Placeholder values cleared”, lowest dq score first

All ENR CLM TPA PRV

Junk onlyFlagPlaceholder values clearedClear

Record	Source	Name	DOB	Member ID	Phone	Address	Quality score	Flags
TPA-58007	TPA	Megan C Crawford	1938-07-24	—	—	6340 Union St, Seattle, WA, 98117	0.82	Street suffix standardised Address re-cased Placeholder values cleared
TPA-58224	TPA	Edward Russell	1991-02-21	—	—	7133 Meadow Ln, Tucson, AZ, 85795	0.82	Name re-cased Phone missing area code Placeholder values cleared
TPA-61445	TPA	Diane Howard	1966-04-12	—	—	7592 Cedar Ln, San Diego, CA	0.82	State code upper-cased ZIP missing Placeholder values cleared
TPA-58213	TPA	Jessica Adams	1961-07-22	—	—	1007 Oak St, Columbus, OH, 43251	0.82	Street suffix standardised Address re-cased Placeholder values cleared
TPA-50728	TPA	Brian K Snyder	1969-11-19	—	—	6722 Grand Ave, Chandler, AZ, 85212	0.82	Street suffix standardised Address re-cased Placeholder values cleared
TPA-60950	TPA	Michelle Gutierrez	1998-01-28	—	—	6253 Grand Ave, Orlando, FL, 32870	0.82	Two-digit birth year City re-cased Placeholder values cleared
TPA-62933	TPA	Tom Wang	1942-08-14	—	—	1523 Sage Ct, Phoenix, AZ, 85029	0.82	Name split from “Last, First”Whitespace trimmed Placeholder values cleared
TPA-60252	TPA	Thomas Gibson	2007-04-20	—	—	—	0.82	Two-digit birth year Plan code upper-cased Placeholder values cleared
TPA-59580	TPA	Abigail Allen	1999-01-07	UHC-78813-14	—	2171 Oak St, Tampa, FL, 33683	0.82	Street suffix standardised Address re-cased Placeholder values cleared
TPA-50812	TPA	Catherine Bishop	1967-10-17	—	2628916417	—	0.82	Gender normalised Whitespace trimmed Placeholder values cleared
TPA-63119	TPA	Sharon Burke	2001-12-20	—	3514196066	655 Harbor Blvd, Glendale, AZ, 85344	0.82	Street suffix standardised Address re-cased Placeholder values cleared
TPA-52823	TPA	Billy Hunt	1995-07-25	—	—	—	0.82	Gender normalised Whitespace trimmed Placeholder values cleared
TPA-56781	TPA	Mark Hunter	1941-09-01	—	—	1443 Elm St, San Diego, CA, 92170	0.82	City re-cased ZIP+4 trimmed Placeholder values cleared
TPA-50336	TPA	Carlos Perkins	1998-11-01	—	3264008261	—	0.82	Name re-cased Gender normalised Placeholder values cleared
TPA-50463	TPA	Kelly Larson	1965-12-05	—	—	3092 Washington St, Chandler, AZ, 85221	0.82	Street suffix standardised Address re-cased Placeholder values cleared
TPA-61448	TPA	Ashley Castro	1970-04-21	—	8466303477	1834 Jefferson Ave, Austin, TX, 78730	0.82	ZIP+4 trimmed Whitespace trimmed Placeholder values cleared
TPA-50305	TPA	Mariana Berry	1988-03-20	—	—	4544 Main St Apt 30, Denver, CO, 80294	0.82	Name re-cased Unit split from street Placeholder values cleared
TPA-60881	TPA	Sofia H Phillips	2008-02-28	—	—	9700 Lake View Rd, Los Angeles, CA, 90073	0.82	Street suffix standardised Address re-cased Placeholder values cleared
TPA-51412	TPA	Keith E Jimenez	1948-01-27	—	—	49 Canyon Rd, San Antonio, TX, 78225	0.82	Street suffix standardised Address re-cased Placeholder values cleared
TPA-63062	TPA	Jeffrey Phillips	—	—	2955335291	—	0.82	Date of birth unreadable Whitespace trimmed Placeholder values cleared
TPA-58630	TPA	Lisa Diaz	2007-11-27	—	—	8963 Maple Ave, Houston, TX, 77092	0.82	Street suffix standardised Address re-cased Placeholder values cleared
TPA-55946	TPA	Cynthia Martin	1956-04-18	—	—	1627 Cedar Ln, Gilbert, AZ, 85298	0.82	Street suffix standardised Address re-cased Placeholder values cleared
TPA-61251	TPA	Joe Howll	1964-08-20	UHC-75983-70	—	—	0.82	Name split from “Last, First”Whitespace trimmed Placeholder values cleared
TPA-64357	TPA	George N Coleman	1939-05-05	UHC-22944-32	—	7711 Valley View Dr, Sacramento, CA, 95896	0.82	Name re-cased SSN last four extracted Placeholder values cleared
TPA-52266	TPA	Terry Williams	1974-12-27	—	2416504018	—	0.82	Phone reformatted Gender normalised Placeholder values cleared
TPA-54423	TPA	Gary Rodriguez	1952-11-10	—	—	1707 Mesa Dr, Chandler, AZ, 85288	0.82	Name re-cased Gender normalised Placeholder values cleared
TPA-63597	TPA	Elizabeth Oliver	1980-04-09	—	—	—	0.82	Name re-cased SSN last four extracted Placeholder values cleared
TPA-54677	TPA	Amanda Foster	1974-01-09	—	—	395 Washington St, San Diego, CA, 92199	0.82	Name re-cased State name converted to code Placeholder values cleared
TPA-60525	TPA	Maria Jenkins	—	—	—	2486 Mountain View Dr, Jacksonville, FL, 32232	0.82	Name re-cased Date of birth unreadable Placeholder values cleared
TPA-57192	TPA	Gary K Mills	1986-01-19	UHC-36526-63	7785450619	1766 Church St, Denver, CO, 80293	0.82	Phone reformatted State name converted to code Placeholder values cleared
TPA-59836	TPA	Abigail Soto	1953-03-27	—	6174447910	3268 Lake View Rd, Mesa, AZ, 85252	0.82	State name converted to code Whitespace trimmed Placeholder values cleared
TPA-61385	TPA	Bradley Cox	1951-01-18	UHC-86083-56	—	4643 Harbor Blvd, Dallas, TX, 75247	0.82	Name re-cased State name converted to code Placeholder values cleared
TPA-58677	TPA	Bobby E Webbb	1999-07-16	—	2977999298	—	0.82	Phone reformatted Gender normalised Placeholder values cleared
TPA-57938	TPA	Kevin Cole	1961-02-14	—	4152227207	2813 Market St, Eden Prairie, MN, 55329	0.82	SSN last four extracted Whitespace trimmed Placeholder values cleared
TPA-56717	TPA	Kim Marquez	1941-05-15	—	9042302544	1432 Valley View Dr # 394, Las Vegas, NV, 89170	0.82	Unit split from street Whitespace trimmed Placeholder values cleared
TPA-57693	TPA	Hlen Wallace	2006-03-25	—	—	8344 Mountain View Dr, Phoenix, AZ	0.82	ZIP missing Whitespace trimmed Placeholder values cleared
TPA-51432	TPA	Vincent Hanson	1943-12-03	—	—	6526 Camelback Rd, Atlanta, GA, 30302	0.82	Date of birth reformatted Gender normalised Placeholder values cleared
TPA-59835	TPA	Sarah U Kelley	1946-09-03	—	—	9831 Mountain View Dr, Orlando, FL	0.82	Name re-cased ZIP missing Placeholder values cleared
TPA-53145	TPA	Sharon Nguyen	1958-04-27	—	—	1832 Central Ave, Mesa, AZ, 85297	0.82	Gender normalised Whitespace trimmed Placeholder values cleared
TPA-52225	TPA	Brian Little	1946-02-09	UHC-65114-56	—	—	0.82	Date of birth reformatted SSN last four extracted Placeholder values cleared
TPA-64426	TPA	Madison Hunt	1993-05-07	—	—	2547 Mesa Dr, Tucson, AZ, 85736	0.82	Street suffix standardised Address re-cased Placeholder values cleared
TPA-64425	TPA	Madison Hunt	1993-05-07	—	—	2547 Mesa Dr, Tucson, AZ, 85736	0.82	Street suffix standardised Address re-cased Placeholder values cleared
TPA-60973	TPA	Brandon N Smith	1958-10-14	UHC-72514-77	—	1746 Bayshore Dr, Dallas, TX, 75258	0.82	Name split from “Last, First”Date of birth reformatted Placeholder values cleared
TPA-55280	TPA	Anna Medina	1972-05-06	—	8437414462	7443 Desert Sky Blvd, Tampa, FL, 33676	0.82	Phone reformatted Gender normalised Placeholder values cleared
TPA-63387	TPA	Kayla O Williamson	1993-02-05	—	—	5310 Indian School Rd, San Diego, CA, 92184	0.82	Name re-cased Gender normalised Placeholder values cleared
TPA-55959	TPA	Ann G Simpson	1984-06-28	—	—	9591 Camelback Rd, Atlanta, GA, 30397	0.82	ZIP+4 trimmed Whitespace trimmed Placeholder values cleared
TPA-50526	TPA	Jhon Powell	1942-04-22	UHC-16950-26	—	2053 Canyon Rd, Los Angeles, CA, 90049	0.82	Street suffix standardised Address re-cased Placeholder values cleared
TPA-50158	TPA	Larry Thomas	1966-10-23	UHC-34933-36	—	697 Meadow Ln # 666, Chandler, AZ, 85227	0.82	Unit split from street Email lower-cased Placeholder values cleared
TPA-63737	TPA	Elijah Owens	1953-05-21	—	—	8030 Cedar Ln, Mesa, AZ, 85278	0.82	Street suffix standardised Address re-cased Placeholder values cleared
TPA-62133	TPA	Donna Graham	1976-06-12	UHC-00728-71	7767305430	1770 Oak St, Miami, FL, 33104	0.82	Gender normalised Whitespace trimmed Placeholder values cleared

14,135 rows, page 197 of 283Previous Next