Normalised records

Normalised records (silver)

Each raw row is parsed into consistently formatted fields. Every change from the raw value is recorded as a data-quality flag.

Normalised rows

99,495

usable in matching

Flagged rows

99,881

99.9% carry at least one flag

Junk quarantined

505

no usable last name

Average quality score

0.75

1.00 = no corrections needed

Quality flags

What normalisation had to do, and how often. Select a flag to filter the table.

Placeholder values cleared71,257
Placeholder tokens such as NULL, N/A, UNKNOWN or "-" treated as empty
Whitespace trimmed57,061
Leading or trailing whitespace removed from one or more fields
Address re-cased56,490
Street line re-cased and punctuation removed
Street suffix standardised55,824
Street suffix standardised to USPS abbreviation (Street to St, Avenue to Ave, and so on)
Phone reformatted50,244
Phone reduced to ten digits, punctuation and leading country code removed
Name re-cased39,996
Name letter-case rewritten to Title Case and stray characters removed
Date of birth reformatted32,400
Date of birth rewritten to ISO 8601 from a source format (MM/DD/YYYY, YYYYMMDD, Mon D, YYYY)
City re-cased17,850
City re-cased to Title Case
Gender normalised16,828
Gender mapped to F or M from a longer or variant value
Email lower-cased11,635
Email lower-cased
Name split from “Last, First”9,980
First-name field held "LAST, FIRST"; the two parts were split into their own fields
State name converted to code9,084
Full state name replaced by its two-letter USPS code
ZIP+4 trimmed8,263
ZIP+4 trimmed to the five-digit ZIP
Member ID reformatted7,723
Member ID re-hyphenated and upper-cased to the UHC-#####-## pattern
ZIP missing7,146
Street address present but no ZIP supplied
Unit split from street6,994
Apartment, suite or unit designator split from street line and re-appended in standard form
Two-digit birth year6,661
Date of birth carried a two-digit year; century inferred by pivot
State code upper-cased4,010
Two-letter state code upper-cased
Plan code upper-cased3,278
Plan code upper-cased
SSN last four extracted2,817
Last four digits of SSN extracted from a longer or punctuated value
Date of birth unreadable2,274
Date of birth did not match any known format or was out of range; cleared
Phone missing area code2,021
Phone had only seven digits (no area code); cleared
Middle initial moved out of first name1,125
A single middle initial was embedded in the first-name field and moved to middle name
Date of birth missing990
Date of birth absent or a null token; left empty
No usable name (quarantined)505
No usable last name; record quarantined as junk and excluded from matching

Normalised records

Third-party administrator, flag “Gender normalised”, lowest dq score first

All ENR CLM TPA PRV

Junk onlyFlagGender normalisedClear

Record	Source	Name	DOB	Member ID	Phone	Address	Quality score	Flags
TPA-64120	TPA	Samuel Kim	1969-07-22	—	6246447393	3839 Park Pl, Columbus, OH, 43216	0.78	Date of birth reformatted Phone reformatted Gender normalised Whitespace trimmed+1 more
TPA-60039	TPA	Logan Richards	1975-05-13	—	—	—	0.78	Date of birth reformatted Email lower-cased Gender normalised Whitespace trimmed+1 more
TPA-63599	TPA	Judy Armstrong	1940-08-04	—	3349330130	—	0.78	Phone reformatted Email lower-cased Gender normalised Whitespace trimmed+1 more
TPA-56337	TPA	Ana Wong	1980-05-28	—	3955959376	4229 Pine Dr, Scottsdale, AZ, 85277	0.78	Name re-cased Phone reformatted Gender normalised Whitespace trimmed+1 more
TPA-59459	TPA	Angela Burns	1967-09-14	—	—	743 Lake View Rd, Sacramento, CA, 95815	0.78	Date of birth reformatted City re-cased Gender normalised Whitespace trimmed+1 more
TPA-63316	TPA	John Mattthews	1957-08-27	UHC-47617-95	—	—	0.78	Name re-cased Date of birth reformatted Gender normalised Whitespace trimmed+1 more
TPA-57165	TPA	Hiroshi Sanchez	1999-06-15	—	—	5705 Union St, Sacramento, CA, 95809	0.78	Date of birth reformatted City re-cased State code upper-cased Gender normalised+1 more
TPA-59159	TPA	Carl Cole	1950-02-14	UHC-38847-19	2696234016	—	0.78	Name re-cased Date of birth reformatted Phone reformatted Gender normalised+1 more
TPA-58963	TPA	Lauren Martin	1970-10-25	—	—	7667 Willow Ct, Sacramento, CA, 95898	0.78	Name re-cased Date of birth reformatted Gender normalised Whitespace trimmed+1 more
TPA-53867	TPA	Jack Pierce	1958-12-15	—	—	—	0.78	Name re-cased Date of birth reformatted Gender normalised Whitespace trimmed+1 more
TPA-55517	TPA	Jon B Parker	1952-09-07	—	—	8769 Lincoln Way, Seattle, WA, 98174	0.78	Name re-cased Date of birth reformatted Gender normalised Whitespace trimmed+1 more
TPA-58380	TPA	Joan Sanders	1956-07-08	—	8119415317	—	0.78	Name re-cased Phone reformatted Gender normalised Whitespace trimmed+1 more
TPA-55994	TPA	Anna Andrrews	1989-02-22	—	—	5660 Meadow Ln, Gilbert, AZ, 85235	0.78	Name re-cased Date of birth reformatted Gender normalised Whitespace trimmed+1 more
TPA-63740	TPA	Julia M Roberts	1944-04-19	—	—	5684 Mesa Dr, San Antonio, TX, 78207	0.78	Date of birth reformatted City re-cased Gender normalised Whitespace trimmed+1 more
TPA-52186	TPA	Emily Washington	1996-10-21	—	8666337447	—	0.78	Name re-cased Phone reformatted Gender normalised Whitespace trimmed+1 more
TPA-64220	TPA	Grace Gilbert	2005-04-17	UHC-23695-84	4377449257	821 Cedar Ln, Denver, CO, 80242	0.78	Date of birth reformatted Phone reformatted Email lower-cased Gender normalised+1 more
TPA-58505	TPA	Sharon Perry	1953-02-19	—	—	5356 Spring St, Denver, CO, 80211	0.78	Name re-cased State code upper-cased Gender normalised Plan code upper-cased+1 more
TPA-61663	TPA	Jack Tayllor	2003-01-12	—	8352127439	5011 Palm Dr, Miami, FL, 33193	0.78	Name re-cased Phone reformatted Gender normalised Whitespace trimmed+1 more
TPA-54283	TPA	Lucia Santos	2005-05-25	UHC-15390-10	—	1203 Baseline Rd, Tempe, AZ, 85211	0.78	Name re-cased Email lower-cased Gender normalised Whitespace trimmed+1 more
TPA-58590	TPA	Linda C Salazar	1972-07-21	—	—	—	0.78	Name re-cased Date of birth reformatted Gender normalised Whitespace trimmed+1 more
TPA-57864	TPA	Amy Ferguson	1944-01-22	—	2068895002	—	0.78	Name re-cased Phone reformatted Gender normalised Whitespace trimmed+1 more
TPA-54244	TPA	Hannah Jodan	1999-12-14	—	—	278 Hillcrest Rd, San Diego, CA, 92123	0.78	Name re-cased Date of birth reformatted Gender normalised Whitespace trimmed+1 more
TPA-55512	TPA	Henry Pierce	2007-07-20	UHC-46617-49	9179138692	—	0.78	Name re-cased Phone reformatted Gender normalised Whitespace trimmed+1 more
TPA-61522	TPA	Douglas Woods	1940-01-07	—	—	—	0.78	Date of birth reformatted Gender normalised Plan code upper-cased Whitespace trimmed+1 more
TPA-52213	TPA	Donna Torres	1978-02-11	—	—	—	0.78	Name re-cased Date of birth reformatted Gender normalised Whitespace trimmed+1 more
TPA-58123	TPA	Gary Perez	1980-08-18	—	4456895197	—	0.78	Date of birth reformatted Phone reformatted Gender normalised Whitespace trimmed+1 more
TPA-55918	TPA	Heather Mendez	1964-01-17	—	6835004957	358 Bayshore Dr, San Antonio, TX, 78288	0.78	Date of birth reformatted Phone reformatted Gender normalised Whitespace trimmed+1 more
TPA-53056	TPA	Matthew Boyyd	1958-07-07	—	—	3756 Oak St, Charlotte, NC, 28222	0.78	Date of birth reformatted City re-cased Gender normalised Whitespace trimmed+1 more
TPA-54687	TPA	Robertson M Ahmed	1973-04-27	—	6092877561	—	0.78	Name re-cased Phone reformatted Gender normalised Whitespace trimmed+1 more
TPA-57474	TPA	Bradley Sims	2006-09-04	—	7973864640	5554 Cedar Ln, Atlanta, GA, 30300	0.78	Name re-cased Phone reformatted City re-cased Gender normalised+1 more
TPA-56538	TPA	Henry Perkins	1980-07-05	—	4519060510	—	0.78	Name re-cased Phone reformatted Gender normalised Whitespace trimmed+1 more
TPA-52254	TPA	Elizabeth Kennedy	2005-06-03	UHC-97687-72	—	9389 Apache Blvd, Charlotte, NC, 28267	0.78	Name re-cased City re-cased Gender normalised Whitespace trimmed+1 more
TPA-63107	TPA	Kevin Burton	1974-02-28	UHC-40231-03	8846081503	—	0.78	Name re-cased Phone reformatted Member ID reformatted Gender normalised+1 more
TPA-52792	TPA	Paul Cruuz	1994-10-14	—	7347272116	9258 Pine Dr, Dallas, TX, 75235	0.78	Name re-cased Date of birth reformatted Phone reformatted Gender normalised+1 more
TPA-57750	TPA	Alexis Tran	1938-01-26	UHC-80596-07	6349166724	238 Apache Blvd, Sacramento, CA, 95836	0.78	Date of birth reformatted Phone reformatted Gender normalised Whitespace trimmed+1 more
TPA-59766	TPA	Hiroshi U Schultz	1978-07-23	—	9873904263	—	0.78	Date of birth reformatted Phone reformatted Gender normalised Whitespace trimmed+1 more
TPA-58791	TPA	Raymond Ortiz	1965-04-04	—	—	9314 Hillcrest Rd, Fresno, CA, 93776	0.78	Date of birth reformatted State code upper-cased Gender normalised Whitespace trimmed+1 more
TPA-57315	TPA	Bobby Rice	1938-01-19	UHC-16174-42	5103470594	8491 Desert Sky Blvd, Sacramento, CA, 95810	0.78	Name re-cased Phone reformatted Gender normalised Whitespace trimmed+1 more
TPA-54298	TPA	Scott D Morris	1976-05-10	—	—	7172 Central Ave, Columbus, OH, 43223	0.78	Name re-cased City re-cased Gender normalised Whitespace trimmed+1 more
TPA-57816	TPA	Camila Andrews	1983-02-08	UHC-90086-43	—	—	0.78	Name re-cased Date of birth reformatted Gender normalised Whitespace trimmed+1 more
TPA-59579	TPA	Camila Lawrence	1967-10-12	—	5237219460	—	0.78	Date of birth reformatted Phone reformatted Gender normalised Whitespace trimmed+1 more
TPA-57972	TPA	Susan Murphy	1969-07-25	—	3835492958	6103 Meadow Ln, Eden Prairie, MN, 55316	0.78	Name re-cased Phone reformatted Gender normalised Whitespace trimmed+1 more
TPA-63588	TPA	Mari Schmidt	1957-04-28	—	—	8387 Willow Ct, Columbus, OH, 43200	0.78	Name re-cased City re-cased Gender normalised Whitespace trimmed+1 more
TPA-60625	TPA	Jack Rose	1954-02-02	UHC-37958-45	8274787053	—	0.78	Name re-cased Phone reformatted Gender normalised Whitespace trimmed+1 more
TPA-62695	TPA	Thomas O Larson	1938-07-09	—	—	—	0.78	Date of birth reformatted Email lower-cased Gender normalised Whitespace trimmed+1 more
TPA-62293	TPA	Dylan Cole	2004-07-01	—	—	—	0.78	Name re-cased Date of birth reformatted Gender normalised Whitespace trimmed+1 more
TPA-62651	TPA	Valentina Scott	1983-10-26	—	—	6070 Elm St, Gilbert, AZ, 85220	0.78	Name re-cased Date of birth reformatted Gender normalised Whitespace trimmed+1 more
TPA-60259	TPA	Evelyn Palmer	1956-01-03	—	5335273349	—	0.78	Date of birth reformatted Phone reformatted Gender normalised Whitespace trimmed+1 more
TPA-64006	TPA	William Vargas	1981-12-28	—	5274421061	24 Forest Ave, Gilbert, AZ, 85207	0.78	Name re-cased Phone reformatted Email lower-cased Gender normalised+1 more
TPA-57481	TPA	Roy Reyes	1982-12-28	—	—	—	0.78	Name re-cased Date of birth reformatted Gender normalised Whitespace trimmed+1 more

2,435 rows, page 38 of 49Previous Next