Normalised records

Normalised records (silver)

Each raw row is parsed into consistently formatted fields. Every change from the raw value is recorded as a data-quality flag.

Normalised rows

99,495

usable in matching

Flagged rows

99,881

99.9% carry at least one flag

Junk quarantined

505

no usable last name

Average quality score

0.75

1.00 = no corrections needed

Quality flags

What normalisation had to do, and how often. Select a flag to filter the table.

Placeholder values cleared71,257
Placeholder tokens such as NULL, N/A, UNKNOWN or "-" treated as empty
Whitespace trimmed57,061
Leading or trailing whitespace removed from one or more fields
Address re-cased56,490
Street line re-cased and punctuation removed
Street suffix standardised55,824
Street suffix standardised to USPS abbreviation (Street to St, Avenue to Ave, and so on)
Phone reformatted50,244
Phone reduced to ten digits, punctuation and leading country code removed
Name re-cased39,996
Name letter-case rewritten to Title Case and stray characters removed
Date of birth reformatted32,400
Date of birth rewritten to ISO 8601 from a source format (MM/DD/YYYY, YYYYMMDD, Mon D, YYYY)
City re-cased17,850
City re-cased to Title Case
Gender normalised16,828
Gender mapped to F or M from a longer or variant value
Email lower-cased11,635
Email lower-cased
Name split from “Last, First”9,980
First-name field held "LAST, FIRST"; the two parts were split into their own fields
State name converted to code9,084
Full state name replaced by its two-letter USPS code
ZIP+4 trimmed8,263
ZIP+4 trimmed to the five-digit ZIP
Member ID reformatted7,723
Member ID re-hyphenated and upper-cased to the UHC-#####-## pattern
ZIP missing7,146
Street address present but no ZIP supplied
Unit split from street6,994
Apartment, suite or unit designator split from street line and re-appended in standard form
Two-digit birth year6,661
Date of birth carried a two-digit year; century inferred by pivot
State code upper-cased4,010
Two-letter state code upper-cased
Plan code upper-cased3,278
Plan code upper-cased
SSN last four extracted2,817
Last four digits of SSN extracted from a longer or punctuated value
Date of birth unreadable2,274
Date of birth did not match any known format or was out of range; cleared
Phone missing area code2,021
Phone had only seven digits (no area code); cleared
Middle initial moved out of first name1,125
A single middle initial was embedded in the first-name field and moved to middle name
Date of birth missing990
Date of birth absent or a null token; left empty
No usable name (quarantined)505
No usable last name; record quarantined as junk and excluded from matching

Normalised records

Third-party administrator, flag “Plan code upper-cased”, lowest dq score first

All ENR CLM TPA PRV

Junk onlyFlagPlan code upper-casedClear

Record	Source	Name	DOB	Member ID	Phone	Address	Quality score	Flags
TPA-57038	TPA	Alen Marquez	2002-02-16	UHC-88620-29	—	2304 Central Ave, Fresno, CA, 93742	0.78	Street suffix standardised Address re-cased Plan code upper-cased Whitespace trimmed+1 more
TPA-54507	TPA	Jessica M Soto	1971-04-14	—	—	—	0.80	Name split from “Last, First”Date of birth reformatted Plan code upper-cased Placeholder values cleared
TPA-63031	TPA	Mason R Hawkins	1943-07-07	—	—	—	0.80	Two-digit birth year Plan code upper-cased Whitespace trimmed Placeholder values cleared
TPA-62205	TPA	Amber Lee	2004-04-08	—	5362651559	5091 Church St, Sacramento, CA, 95883	0.80	Name split from “Last, First”City re-cased Plan code upper-cased Placeholder values cleared
TPA-62395	TPA	Carl K Austin	1951-01-09	—	—	8305 Broadway Apt 28, San Diego, CA, 92142	0.80	Unit split from street Email lower-cased Plan code upper-cased Placeholder values cleared
TPA-54958	TPA	Willam Z Coleman	2004-12-19	—	—	2790 Forest Ave, Mesa, AZ, 85200	0.80	Date of birth reformatted State name converted to code Plan code upper-cased Placeholder values cleared
TPA-57980	TPA	Marcus Stephens	2007-12-18	—	2804886964	5019 Mesa Dr, Columbus, OH, 43295	0.80	Phone reformatted Street suffix standardised Address re-cased Plan code upper-cased
TPA-57196	TPA	Logan Wang	2000-11-20	—	—	7493 Ridge Rd, Scottsdale, AZ, 85245	0.80	Date of birth reformatted ZIP+4 trimmed Plan code upper-cased Placeholder values cleared
TPA-62319	TPA	Benjamin Luna	1966-06-07	—	—	924 Desert Sky Blvd, Nashville, TN, 37249	0.80	Name re-cased Gender normalised Plan code upper-cased Placeholder values cleared
TPA-54809	TPA	Gerald Robertson	1950-10-09	—	7873326872	—	0.80	Gender normalised Plan code upper-cased Whitespace trimmed Placeholder values cleared
TPA-57004	TPA	Alexander Johnston	2006-02-24	—	—	—	0.80	Name split from “Last, First”Plan code upper-cased Whitespace trimmed Placeholder values cleared
TPA-50031	TPA	George Ellis	1977-04-27	UHC-39266-32	—	8317 Elm St, Miami, FL, 33181	0.80	Street suffix standardised Address re-cased Plan code upper-cased Placeholder values cleared
TPA-59301	TPA	Joseph Bradley	1997-05-12	—	—	—	0.80	Two-digit birth year Plan code upper-cased Whitespace trimmed Placeholder values cleared
TPA-52704	TPA	Catherine E Taylor	1965-12-12	—	8284089875	7245 Hillcrest Rd, Chandler, AZ, 85253	0.80	Gender normalised Plan code upper-cased Whitespace trimmed Placeholder values cleared
TPA-61026	TPA	Joseph Y Reid	1953-04-24	—	—	7309 Washington St, Dallas, TX, 75269	0.80	Two-digit birth year Plan code upper-cased Whitespace trimmed Placeholder values cleared
TPA-57362	TPA	Thomas Black	1962-10-13	—	—	9730 Oak St, Glendale, AZ, 85321	0.80	Street suffix standardised Address re-cased Plan code upper-cased Placeholder values cleared
TPA-53023	TPA	Brandon Coleman	1945-02-20	—	—	3945 Lake View Rd, Mesa, AZ, 85261	0.80	Gender normalised Plan code upper-cased Whitespace trimmed Placeholder values cleared
TPA-60252	TPA	Thomas Gibson	2007-04-20	—	—	—	0.82	Two-digit birth year Plan code upper-cased Placeholder values cleared
TPA-53814	TPA	Nathan Bennett	1952-12-14	UHC-27614-09	—	2690 Lincoln Way, Denver, CO, 80206	0.82	State name converted to code Plan code upper-cased Placeholder values cleared
TPA-50780	TPA	Amy Rice	1991-06-04	—	7905690744	—	0.82	Name split from “Last, First”Plan code upper-cased Placeholder values cleared
TPA-52623	TPA	Brittany Hall	1964-03-06	UHC-67985-87	—	6962 Desert Sky Blvd, Houston, TX, 77081	0.82	State name converted to code Plan code upper-cased Placeholder values cleared
TPA-60149	TPA	Karen Green	1953-06-27	—	—	—	0.82	Two-digit birth year Plan code upper-cased Placeholder values cleared
TPA-50294	TPA	Willie Walsh	1959-01-26	—	—	4995 Broadway, Los Angeles, CA, 90095	0.82	State name converted to code Plan code upper-cased Placeholder values cleared
TPA-63818	TPA	Hannah Ramos	1952-09-18	UHC-51097-46	—	8140 Broadway, Tempe, AZ, 85258	0.88	Name re-cased Date of birth reformatted Address re-cased City re-cased+2 more
TPA-57305	TPA	Noah Turner	1949-03-28	—	9412898050	441 Palm Dr, Chandler, AZ, 85287	0.88	Name re-cased Date of birth reformatted Phone reformatted Plan code upper-cased+2 more
TPA-50779	TPA	Ross Edward	1956-02-20	—	2218702828	784 Ocean Ave, Las Vegas, NV, 89100	0.88	Name re-cased Date of birth reformatted Phone reformatted Plan code upper-cased+2 more
TPA-57698	TPA	Kyle Lynch	1947-10-15	—	7977288722	—	0.88	Name re-cased Phone reformatted Email lower-cased Plan code upper-cased+2 more
TPA-63837	TPA	Rachel Nichols	1970-07-06	—	—	—	0.90	Name re-cased Date of birth reformatted Plan code upper-cased Whitespace trimmed+1 more
TPA-58247	TPA	Janice Morris	1978-11-05	—	2807620499	—	0.90	Date of birth reformatted Phone reformatted Plan code upper-cased Whitespace trimmed+1 more
TPA-62852	TPA	Hannah Dunn	2004-02-01	—	—	310 Church St, Austin, TX, 78715	0.90	Name re-cased State code upper-cased Plan code upper-cased Whitespace trimmed+1 more
TPA-54025	TPA	Hiroshhi Mliler	1978-09-12	UHC-76081-36	—	—	0.90	Name re-cased Date of birth reformatted Member ID reformatted Plan code upper-cased+1 more
TPA-60202	TPA	Kimberly Chapman	1980-11-22	—	4258929299	3546 Meadow Ln, Mesa, AZ, 85213	0.90	Name re-cased Phone reformatted Plan code upper-cased Whitespace trimmed+1 more
TPA-52849	TPA	Carlos Walsh	1986-04-23	—	5678805850	1398 River Rd, Fresno, CA, 93741	0.90	Name re-cased Date of birth reformatted Plan code upper-cased Whitespace trimmed+1 more
TPA-50693	TPA	Terry Hansen	1956-10-09	—	4798898424	—	0.90	Name re-cased Phone reformatted Plan code upper-cased Whitespace trimmed+1 more
TPA-53331	TPA	Sofia Cllark	1963-06-07	—	6177107716	470 Forest Ave, Tampa, FL, 33608	0.90	Phone reformatted State code upper-cased Plan code upper-cased Whitespace trimmed+1 more
TPA-51107	TPA	Albert Myers	1959-03-01	UHC-39005-14	7528889110	2650 Mountain View Dr, Denver, CO, 80224	0.90	Date of birth reformatted Phone reformatted Plan code upper-cased Whitespace trimmed+1 more
TPA-57667	TPA	Paul Woods	2007-09-24	—	—	—	0.92	Name re-cased Plan code upper-cased Whitespace trimmed Placeholder values cleared
TPA-52895	TPA	Eugene Cox	1983-02-14	—	—	28 Spring St, Miami, FL, 33105	0.92	Name re-cased Plan code upper-cased Whitespace trimmed Placeholder values cleared
TPA-54350	TPA	Heather Cox	1991-04-26	—	—	5992 Apache Blvd, Las Vegas, NV, 89143	0.92	City re-cased State code upper-cased Plan code upper-cased Placeholder values cleared
TPA-53221	TPA	Daiel Garcia	1961-06-10	—	—	7755 Washington St, Mesa, AZ, 85270	0.92	Name re-cased Plan code upper-cased Whitespace trimmed Placeholder values cleared
TPA-54354	TPA	Kle Taylor	2006-05-28	—	7039513758	8390 Market St, Tampa, FL, 33671	0.92	Name re-cased Date of birth reformatted Plan code upper-cased Placeholder values cleared
TPA-61332	TPA	Kenneth Y Delgado	1956-05-01	—	8342968675	254 Palm Dr, Dallas, TX, 75268	0.92	Phone reformatted Plan code upper-cased Whitespace trimmed Placeholder values cleared
TPA-52033	TPA	Sandra Stone	1951-02-12	—	7706331421	8768 Church St, San Diego, CA, 92150	0.92	Phone reformatted City re-cased Plan code upper-cased Placeholder values cleared
TPA-59978	TPA	Daniel Guerrero	1946-06-03	—	3973018288	8761 Jefferson Ave, Austin, TX, 78723	0.92	Phone reformatted Plan code upper-cased Whitespace trimmed Placeholder values cleared
TPA-59098	TPA	Carol Rogers	1973-06-14	—	—	6820 Hillcrest Rd, Minneapolis, MN, 55427	0.92	Date of birth reformatted City re-cased Plan code upper-cased Placeholder values cleared
TPA-56919	TPA	Camila Dunn	2007-12-05	—	4307541468	—	0.92	Date of birth reformatted Plan code upper-cased Whitespace trimmed Placeholder values cleared
TPA-56113	TPA	Kathleen Stevens	1979-02-01	UHC-16813-28	5597005041	—	0.92	Name re-cased Phone reformatted Plan code upper-cased Placeholder values cleared
TPA-59587	TPA	Samantha West	1987-11-13	—	9849528150	—	0.92	Name re-cased Plan code upper-cased Whitespace trimmed Placeholder values cleared
TPA-53618	TPA	Bradley Kim	1945-07-19	—	4887616975	—	0.92	Phone reformatted Plan code upper-cased Whitespace trimmed Placeholder values cleared
TPA-58321	TPA	Bobby W Rodriguez	1940-03-22	—	—	9029 Main St, Austin, TX, 78743	0.92	Name re-cased Plan code upper-cased Whitespace trimmed Placeholder values cleared

227 rows, page 4 of 5Previous Next