Normalised records

Normalised records (silver)

Each raw row is parsed into consistently formatted fields. Every change from the raw value is recorded as a data-quality flag.

Normalised rows

99,495

usable in matching

Flagged rows

99,881

99.9% carry at least one flag

Junk quarantined

505

no usable last name

Average quality score

0.75

1.00 = no corrections needed

Quality flags

What normalisation had to do, and how often. Select a flag to filter the table.

Placeholder values cleared71,257
Placeholder tokens such as NULL, N/A, UNKNOWN or "-" treated as empty
Whitespace trimmed57,061
Leading or trailing whitespace removed from one or more fields
Address re-cased56,490
Street line re-cased and punctuation removed
Street suffix standardised55,824
Street suffix standardised to USPS abbreviation (Street to St, Avenue to Ave, and so on)
Phone reformatted50,244
Phone reduced to ten digits, punctuation and leading country code removed
Name re-cased39,996
Name letter-case rewritten to Title Case and stray characters removed
Date of birth reformatted32,400
Date of birth rewritten to ISO 8601 from a source format (MM/DD/YYYY, YYYYMMDD, Mon D, YYYY)
City re-cased17,850
City re-cased to Title Case
Gender normalised16,828
Gender mapped to F or M from a longer or variant value
Email lower-cased11,635
Email lower-cased
Name split from “Last, First”9,980
First-name field held "LAST, FIRST"; the two parts were split into their own fields
State name converted to code9,084
Full state name replaced by its two-letter USPS code
ZIP+4 trimmed8,263
ZIP+4 trimmed to the five-digit ZIP
Member ID reformatted7,723
Member ID re-hyphenated and upper-cased to the UHC-#####-## pattern
ZIP missing7,146
Street address present but no ZIP supplied
Unit split from street6,994
Apartment, suite or unit designator split from street line and re-appended in standard form
Two-digit birth year6,661
Date of birth carried a two-digit year; century inferred by pivot
State code upper-cased4,010
Two-letter state code upper-cased
Plan code upper-cased3,278
Plan code upper-cased
SSN last four extracted2,817
Last four digits of SSN extracted from a longer or punctuated value
Date of birth unreadable2,274
Date of birth did not match any known format or was out of range; cleared
Phone missing area code2,021
Phone had only seven digits (no area code); cleared
Middle initial moved out of first name1,125
A single middle initial was embedded in the first-name field and moved to middle name
Date of birth missing990
Date of birth absent or a null token; left empty
No usable name (quarantined)505
No usable last name; record quarantined as junk and excluded from matching

Normalised records

Third-party administrator, flag “Date of birth reformatted”, lowest dq score first

All ENR CLM TPA PRV

Junk onlyFlagDate of birth reformattedClear

Record	Source	Name	DOB	Member ID	Phone	Address	Quality score	Flags
TPA-58196	TPA	Susan Alvarez	1965-11-01	—	—	—	0.80	Name re-cased Date of birth reformatted Gender normalised Placeholder values cleared
TPA-55528	TPA	Elizabeth Ward	1947-08-04	—	—	—	0.80	Date of birth reformatted Gender normalised Whitespace trimmed Placeholder values cleared
TPA-53384	TPA	Emma Sims	1963-11-28	—	—	7059 Sage Ct, Gilbert, AZ, 85222	0.80	Date of birth reformatted ZIP+4 trimmed Whitespace trimmed Placeholder values cleared
TPA-60453	TPA	Donald O Jones	1995-03-24	—	—	—	0.80	Date of birth reformatted Gender normalised Whitespace trimmed Placeholder values cleared
TPA-56872	TPA	Samantha Coleman	1974-01-06	—	8233136294	8594 Pine Dr, Dallas, TX	0.80	Date of birth reformatted ZIP missing Whitespace trimmed Placeholder values cleared
TPA-56055	TPA	Catherine T Robertson	1941-07-02	—	—	4634 Desert Sky Blvd, Fresno, CA, 93766	0.80	Name split from “Last, First”Date of birth reformatted Whitespace trimmed Placeholder values cleared
TPA-63907	TPA	Rebecca W Adams	1965-02-17	—	—	7683 Meadow Ln, Tempe, AZ, 85213	0.80	Date of birth reformatted Street suffix standardised Address re-cased Placeholder values cleared
TPA-51993	TPA	Nancy Castro	2005-10-27	—	—	340 Canyon Rd, Tucson, AZ, 85767	0.80	Date of birth reformatted Street suffix standardised Address re-cased Placeholder values cleared
TPA-52745	TPA	Arjun Wang	1953-11-17	—	—	8871 Lincoln Way, Las Vegas, NV, 89161	0.80	Date of birth reformatted State name converted to code Whitespace trimmed Placeholder values cleared
TPA-52149	TPA	Keith Baker	1966-03-09	—	—	3446 Indian School Rd, Tampa, FL, 33651	0.80	Date of birth reformatted Street suffix standardised Address re-cased Placeholder values cleared
TPA-56452	TPA	Patrick Long	1952-01-17	—	6289051336	7892 Ridge Rd, San Antonio, TX, 78231	0.80	Date of birth reformatted Phone reformatted State name converted to code Placeholder values cleared
TPA-58374	TPA	Carl Marshall	1963-07-22	—	6894527111	1078 Forest Ave, Gilbert, AZ, 85246	0.80	Date of birth reformatted Gender normalised Whitespace trimmed Placeholder values cleared
TPA-58393	TPA	Brian Jacobs	1995-05-12	—	—	3380 Park Pl Apt 1, Phoenix, AZ, 85026	0.80	Date of birth reformatted Unit split from street Whitespace trimmed Placeholder values cleared
TPA-51990	TPA	Donald Torres	1997-12-14	UHC-22457-76	—	8591 Central Ave, San Diego, CA, 92186	0.80	Date of birth reformatted Gender normalised Whitespace trimmed Placeholder values cleared
TPA-54082	TPA	Robert Edwards	2004-07-11	—	—	—	0.80	Date of birth reformatted Gender normalised Whitespace trimmed Placeholder values cleared
TPA-54345	TPA	Martha Tucker	1988-10-14	—	—	7665 Jefferson Ave, San Antonio, TX, 78241	0.80	Date of birth reformatted Street suffix standardised Address re-cased Placeholder values cleared
TPA-60117	TPA	Ruth Parker	1984-06-02	—	5613152704	6694 Sage Ct, Chandler, AZ, 85263	0.80	Date of birth reformatted Gender normalised Whitespace trimmed Placeholder values cleared
TPA-63799	TPA	Steve Jones	1946-11-19	—	—	472 Ridge Rd, Chandler, AZ, 85219	0.80	Date of birth reformatted Street suffix standardised Address re-cased Placeholder values cleared
TPA-50884	TPA	Carlos Lawrence	1957-09-19	—	—	6107 Mountain View Dr, Phoenix, AZ, 85015	0.80	Name split from “Last, First”Date of birth reformatted Whitespace trimmed Placeholder values cleared
TPA-51686	TPA	Raymond S Aguilar	1951-04-03	—	—	1291 Highland Ave, Chandler, AZ, 85250	0.80	Date of birth reformatted Street suffix standardised Address re-cased Placeholder values cleared
TPA-54489	TPA	Mariana Snyder	1999-01-24	—	—	5485 Mesa Dr, Dallas, TX, 75275	0.80	Name split from “Last, First”Date of birth reformatted Whitespace trimmed Placeholder values cleared
TPA-60049	TPA	Douglas Matthews	1976-06-02	—	—	—	0.80	Name split from “Last, First”Date of birth reformatted Whitespace trimmed Placeholder values cleared
TPA-55602	TPA	Mateo Y Mitchell	1983-09-13	—	2917080633	—	0.80	Name split from “Last, First”Date of birth reformatted Phone reformatted Placeholder values cleared
TPA-57427	TPA	Jean Collins	1971-03-07	—	3415528863	—	0.80	Name split from “Last, First”Date of birth reformatted Phone reformatted Whitespace trimmed
TPA-60784	TPA	Kyle Dean	1965-08-09	—	—	7843 Baseline Rd, Fresno, CA, 93766	0.80	Date of birth reformatted Street suffix standardised Address re-cased Placeholder values cleared
TPA-58102	TPA	Rebecca Fuller	1939-08-19	—	—	3291 Valley View Dr, Las Vegas, NV, 89143	0.80	Date of birth reformatted State name converted to code Whitespace trimmed Placeholder values cleared
TPA-58615	TPA	Brenda Valdez	1942-10-14	—	2533758858	570 River Rd, Nashville, TN, 37242	0.80	Date of birth reformatted Phone reformatted State name converted to code Placeholder values cleared
TPA-60980	TPA	Isabella L Harrt	1975-03-17	UHC-19333-94	—	4604 Jefferson Ave, Glendale, AZ, 85372	0.80	Name split from “Last, First”Date of birth reformatted Whitespace trimmed Placeholder values cleared
TPA-56348	TPA	Alice Morris	1990-01-24	—	—	1934 Indian School Rd, Mesa, AZ, 85252	0.80	Date of birth reformatted Street suffix standardised Address re-cased Placeholder values cleared
TPA-57007	TPA	Bryan Evans	2007-08-25	—	—	4502 Canyon Rd, Los Angeles, CA, 90094	0.80	Date of birth reformatted Street suffix standardised Address re-cased Placeholder values cleared
TPA-62350	TPA	Christine I Young	1978-10-04	—	—	8138 Spring St, Tampa, FL, 33618	0.80	Name split from “Last, First”Date of birth reformatted Whitespace trimmed Placeholder values cleared
TPA-54145	TPA	Beverly Bailey	1986-04-20	—	—	5723 Spring St, Gilbert, AZ, 85222	0.80	Date of birth reformatted Gender normalised Whitespace trimmed Placeholder values cleared
TPA-57014	TPA	Dorys Anderson	1940-06-16	—	4764683227	5796 Broadway, Sacramento, CA, 95828	0.80	Name split from “Last, First”Date of birth reformatted Phone reformatted Placeholder values cleared
TPA-51958	TPA	Mason Dunan	1984-04-28	—	—	3258 Hillcrest Rd, Gilbert, AZ	0.80	Date of birth reformatted ZIP missing Whitespace trimmed Placeholder values cleared
TPA-54630	TPA	Marilyn I Patterson	1997-01-05	—	—	9305 Meadow Ln, Orlando, FL, 32888	0.80	Date of birth reformatted Street suffix standardised Address re-cased Placeholder values cleared
TPA-62331	TPA	Marcus Montgomery	1966-02-07	—	—	1942 Meadow Ln, Chandler, AZ, 85203	0.80	Date of birth reformatted Street suffix standardised Address re-cased Placeholder values cleared
TPA-59803	TPA	Edward Reed	1957-05-20	—	—	1422 Lincoln Way, San Antonio, TX, 78207	0.80	Date of birth reformatted Phone missing area code Whitespace trimmed Placeholder values cleared
TPA-62707	TPA	Bobby Ward	1955-10-01	—	—	5410 Ocean Ave, Nashville, TN, 37255	0.80	Date of birth reformatted ZIP+4 trimmed Whitespace trimmed Placeholder values cleared
TPA-51577	TPA	Nicole Wood	2002-05-07	—	—	—	0.82	Name split from “Last, First”Date of birth reformatted Placeholder values cleared
TPA-63298	TPA	Megn Hawkins	1951-05-16	—	—	667 River Rd, Sacramento, CA, 95812	0.82	Date of birth reformatted Gender normalised Placeholder values cleared
TPA-50731	TPA	Abby Coleman	1951-01-12	—	6177974325	6206 Ridge Rd, Denver, CO	0.82	Date of birth reformatted ZIP missing Whitespace trimmed
TPA-62979	TPA	Ana Vargas	1979-02-26	—	—	6532 Harbor Blvd, Austin, TX	0.82	Date of birth reformatted ZIP missing Placeholder values cleared
TPA-54739	TPA	Teresa Hudson	1994-02-16	—	3378304076	7336 Mountain View Dr, Nashville, TN, 37259	0.82	Date of birth reformatted Gender normalised Placeholder values cleared
TPA-62813	TPA	Albert Wallace	1972-07-12	UHC-61755-91	—	553 Park Pl, Chandler, AZ, 85209	0.82	Name re-cased Date of birth reformatted ZIP+4 trimmed
TPA-51355	TPA	Carolyn A Hawkins	1955-08-14	—	—	2163 Camelback Rd, Orlando, FL, 32861	0.82	Date of birth reformatted City re-cased Gender normalised
TPA-57887	TPA	Alexander Reid	1978-02-16	—	—	4432 Lake View Rd, Austin, TX, 78712	0.82	Name split from “Last, First”Date of birth reformatted Placeholder values cleared
TPA-53085	TPA	Heathher Wagner	1991-12-14	—	4473470816	4720 Canyon Rd, Miami, FL, 33174	0.82	Date of birth reformatted Street suffix standardised Address re-cased
TPA-62267	TPA	Jessica Martin	1999-01-11	—	6482936808	1720 Willow Ct, Nashville, TN, 37242	0.82	Date of birth reformatted Gender normalised Placeholder values cleared
TPA-50032	TPA	Mei Arnold	1977-07-03	—	—	4985 Church St, Miami, FL	0.82	Date of birth reformatted ZIP missing Placeholder values cleared
TPA-59044	TPA	Gregory Hudson	1968-08-14	—	—	—	0.82	Name split from “Last, First”Date of birth reformatted Placeholder values cleared

4,728 rows, page 68 of 95Previous Next