Normalised records

Normalised records (silver)

Each raw row is parsed into consistently formatted fields. Every change from the raw value is recorded as a data-quality flag.

Normalised rows

99,495

usable in matching

Flagged rows

99,881

99.9% carry at least one flag

Junk quarantined

505

no usable last name

Average quality score

0.75

1.00 = no corrections needed

Quality flags

What normalisation had to do, and how often. Select a flag to filter the table.

Placeholder values cleared71,257
Placeholder tokens such as NULL, N/A, UNKNOWN or "-" treated as empty
Whitespace trimmed57,061
Leading or trailing whitespace removed from one or more fields
Address re-cased56,490
Street line re-cased and punctuation removed
Street suffix standardised55,824
Street suffix standardised to USPS abbreviation (Street to St, Avenue to Ave, and so on)
Phone reformatted50,244
Phone reduced to ten digits, punctuation and leading country code removed
Name re-cased39,996
Name letter-case rewritten to Title Case and stray characters removed
Date of birth reformatted32,400
Date of birth rewritten to ISO 8601 from a source format (MM/DD/YYYY, YYYYMMDD, Mon D, YYYY)
City re-cased17,850
City re-cased to Title Case
Gender normalised16,828
Gender mapped to F or M from a longer or variant value
Email lower-cased11,635
Email lower-cased
Name split from “Last, First”9,980
First-name field held "LAST, FIRST"; the two parts were split into their own fields
State name converted to code9,084
Full state name replaced by its two-letter USPS code
ZIP+4 trimmed8,263
ZIP+4 trimmed to the five-digit ZIP
Member ID reformatted7,723
Member ID re-hyphenated and upper-cased to the UHC-#####-## pattern
ZIP missing7,146
Street address present but no ZIP supplied
Unit split from street6,994
Apartment, suite or unit designator split from street line and re-appended in standard form
Two-digit birth year6,661
Date of birth carried a two-digit year; century inferred by pivot
State code upper-cased4,010
Two-letter state code upper-cased
Plan code upper-cased3,278
Plan code upper-cased
SSN last four extracted2,817
Last four digits of SSN extracted from a longer or punctuated value
Date of birth unreadable2,274
Date of birth did not match any known format or was out of range; cleared
Phone missing area code2,021
Phone had only seven digits (no area code); cleared
Middle initial moved out of first name1,125
A single middle initial was embedded in the first-name field and moved to middle name
Date of birth missing990
Date of birth absent or a null token; left empty
No usable name (quarantined)505
No usable last name; record quarantined as junk and excluded from matching

Normalised records

Third-party administrator, flag “State code upper-cased”, lowest dq score first

All ENR CLM TPA PRV

Junk onlyFlagState code upper-casedClear

Record	Source	Name	DOB	Member ID	Phone	Address	Quality score	Flags
TPA-50690	TPA	Luis Mejia	1977-02-19	—	—	3420 Ridge Rd, Phoenix, AZ, 85029	0.92	Date of birth reformatted State code upper-cased Whitespace trimmed Placeholder values cleared
TPA-62283	TPA	Michelle Harper	1952-04-17	—	—	3693 Union St, Plano, TX, 75080	0.92	Name re-cased State code upper-cased Whitespace trimmed Placeholder values cleared
TPA-59552	TPA	Alan Bradley	1971-09-10	—	4495170482	5458 Oak St, Tampa, FL, 33633	0.92	Phone reformatted State code upper-cased Whitespace trimmed Placeholder values cleared
TPA-50112	TPA	Charlotte Ortyz	2002-10-16	—	—	7944 Canyon Rd, Columbus, OH, 43239	0.92	Name re-cased State code upper-cased Whitespace trimmed Placeholder values cleared
TPA-63183	TPA	Jason V Ortega	1996-12-07	—	—	7545 Apache Blvd, San Antonio, TX, 78249	0.92	State code upper-cased Email lower-cased Whitespace trimmed Placeholder values cleared
TPA-63668	TPA	Raymond Alvarado	1940-05-14	—	—	1325 Market St, Dallas, TX, 75230	0.92	Name re-cased Date of birth reformatted State code upper-cased Placeholder values cleared
TPA-53338	TPA	Keith O Hunter	1991-09-08	—	—	8517 Mountain View Dr, Tucson, AZ, 85731	0.92	Name re-cased State code upper-cased Whitespace trimmed Placeholder values cleared
TPA-61336	TPA	Moreno Scott	1943-03-17	—	—	2645 Park Pl, Sacramento, CA, 95841	0.92	Date of birth reformatted State code upper-cased Whitespace trimmed Placeholder values cleared
TPA-50679	TPA	Christine Jacobs	1969-02-18	UHC-30563-75	5256623509	6688 Hillcrest Rd, Jacksonville, FL, 32268	0.92	Phone reformatted City re-cased State code upper-cased Placeholder values cleared
TPA-56600	TPA	Laura Watkins	1961-02-15	UHC-86062-54	—	2762 Willow Ct, Mesa, AZ, 85231	0.92	Name re-cased City re-cased State code upper-cased Placeholder values cleared
TPA-57975	TPA	Richard Harrison	1987-09-11	—	—	3041 Broadway, Atlanta, GA, 30364	0.92	Name re-cased State code upper-cased Whitespace trimmed Placeholder values cleared
TPA-62882	TPA	Lauren Brown	2002-02-20	UHC-26064-48	5444221328	4201 Lincoln Way, Glendale, AZ, 85315	0.92	Phone reformatted City re-cased State code upper-cased Placeholder values cleared
TPA-54707	TPA	Carl Gilbert	1966-08-23	—	5783226069	2361 Camelback Rd, San Diego, CA, 92186	0.92	Date of birth reformatted Phone reformatted State code upper-cased Placeholder values cleared
TPA-56256	TPA	Emma Hudson	1975-12-12	—	—	5153 Sunset Blvd, Phoenix, AZ, 85085	0.92	Name re-cased State code upper-cased Whitespace trimmed Placeholder values cleared
TPA-62079	TPA	Ryan Nichols	1978-02-25	—	2705479337	4417 Camelback Rd, San Diego, CA, 92172	0.92	Name re-cased Phone reformatted State code upper-cased Placeholder values cleared
TPA-50636	TPA	Keith M Payne	1997-02-13	—	8374687938	5572 Broadway, Phoenix, AZ, 85038	0.92	Date of birth reformatted Phone reformatted State code upper-cased Placeholder values cleared
TPA-50351	TPA	Matthew Brown	1973-10-21	—	4644624267	4028 Mesa Dr, Austin, TX, 78773	0.92	Phone reformatted State code upper-cased Whitespace trimmed Placeholder values cleared
TPA-61998	TPA	Lauren Hoffman	1940-07-25	—	—	1201 Meadow Ln, Jacksonville, FL, 32203	0.92	Name re-cased State code upper-cased Whitespace trimmed Placeholder values cleared
TPA-60709	TPA	Emma Wright	1978-08-21	—	8372116674	4449 Jefferson Ave, Chandler, AZ, 85228	0.92	Phone reformatted State code upper-cased Whitespace trimmed Placeholder values cleared
TPA-55369	TPA	Robert Weaver	1962-01-16	—	—	9421 Desert Sky Blvd, Miami, FL, 33162	0.92	Date of birth reformatted City re-cased State code upper-cased Placeholder values cleared
TPA-59109	TPA	Bryan Graham	1999-09-04	—	—	301 Baseline Rd, Denver, CO, 80251	0.92	Name re-cased Date of birth reformatted State code upper-cased Placeholder values cleared
TPA-50382	TPA	Noha Yang	1974-12-27	UHC-48251-04	—	5747 Jefferson Ave, Scottsdale, AZ, 85231	0.94	Date of birth reformatted State code upper-cased Placeholder values cleared
TPA-64314	TPA	Paul Nguyen	1989-02-24	—	—	5530 Indian School Rd, Phoenix, AZ, 85028	0.94	State code upper-cased Whitespace trimmed Placeholder values cleared
TPA-51485	TPA	Jonathan Mason	2008-11-13	—	—	5076 Cedar Ln, San Antonio, TX, 78265	0.94	Name re-cased State code upper-cased Placeholder values cleared
TPA-51178	TPA	Jordan West	1953-06-07	—	—	3742 Sage Ct, Denver, CO, 80259	0.94	Date of birth reformatted State code upper-cased Placeholder values cleared
TPA-54771	TPA	Cheryl Kennedy	1982-09-19	—	—	2547 Washington St, Plano, TX, 75005	0.94	Name re-cased State code upper-cased Placeholder values cleared
TPA-63935	TPA	Mark Turner	1980-05-22	UHC-78211-24	—	8779 Church St, Eden Prairie, MN, 55319	0.94	Name re-cased State code upper-cased Placeholder values cleared
TPA-64435	TPA	Steve Ruiz	1952-07-01	UHC-29193-51	—	2175 Highland Ave, Tampa, FL, 33605	0.94	Date of birth reformatted State code upper-cased Placeholder values cleared
TPA-50942	TPA	Joey R Willis	1943-06-27	—	—	7981 Apache Blvd, Chandler, AZ, 85260	0.94	Date of birth reformatted State code upper-cased Placeholder values cleared
TPA-54800	TPA	Scott Y Henderson	1958-01-24	UHC-32283-14	—	3879 Ridge Rd, Charlotte, NC, 28203	0.94	Name re-cased State code upper-cased Placeholder values cleared
TPA-56413	TPA	Charles Hanson	1948-07-10	—	6787665084	4807 Maple Ave, Tempe, AZ, 85267	0.94	Date of birth reformatted Phone reformatted State code upper-cased
TPA-59449	TPA	William Kim	2003-05-19	—	4588729795	9073 Cedar Ln, Mesa, AZ, 85227	0.94	Phone reformatted State code upper-cased Placeholder values cleared
TPA-60465	TPA	Dennis Alvarez	1979-08-21	UHC-79179-52	—	3110 Desert Sky Blvd, Plano, TX, 75063	0.94	State code upper-cased Whitespace trimmed Placeholder values cleared
TPA-55406	TPA	Alice Gomez	1943-11-04	—	—	6767 Baseline Rd, Tempe, AZ, 85258	0.94	Date of birth reformatted State code upper-cased Whitespace trimmed
TPA-53480	TPA	Scott Santos	1961-03-20	—	—	3753 Pine Dr, Orlando, FL, 32864	0.94	City re-cased State code upper-cased Placeholder values cleared
TPA-54308	TPA	Camila M Allen	2008-03-09	—	—	2209 Broadway, Plano, TX, 75028	0.94	Address re-cased State code upper-cased Placeholder values cleared
TPA-58462	TPA	Noah H Ramos	1947-04-23	—	—	5404 Highland Ave, Orlando, FL, 32817	0.94	Date of birth reformatted State code upper-cased Placeholder values cleared
TPA-63521	TPA	Peter Burton	1996-12-18	—	—	9727 Cedar Ln, Houston, TX, 77034	0.94	Date of birth reformatted State code upper-cased Placeholder values cleared
TPA-52733	TPA	Luis Nguyen	1977-04-15	—	—	7453 Market St, Orlando, FL, 32833	0.94	Name re-cased State code upper-cased Placeholder values cleared
TPA-60122	TPA	Carolyn Chavez	1951-11-10	UHC-58483-37	—	3210 Broadway, San Antonio, TX, 78271	0.94	Date of birth reformatted State code upper-cased Placeholder values cleared
TPA-55179	TPA	Ashley Perry	1987-02-07	—	—	3205 Ridge Rd, Atlanta, GA, 30359	0.94	State code upper-cased Whitespace trimmed Placeholder values cleared
TPA-56393	TPA	Diego Boyd	2001-09-23	—	—	6612 Washington St, Columbus, OH, 43294	0.94	Name re-cased State code upper-cased Placeholder values cleared
TPA-59684	TPA	Carlos Campbell	1961-06-18	—	5482126607	1159 Bayshore Dr, Austin, TX, 78762	0.94	Phone reformatted State code upper-cased Placeholder values cleared
TPA-55703	TPA	Jeremy N Jeensen	1950-09-03	—	—	4076 Spring St, Scottsdale, AZ, 85241	0.94	State code upper-cased Whitespace trimmed Placeholder values cleared
TPA-52571	TPA	Samuel Wilson	2003-04-10	—	—	4811 Broadway, Sacramento, CA, 95865	0.94	Address re-cased State code upper-cased Placeholder values cleared
TPA-55284	TPA	Jezse S Kim	1974-05-20	—	4098056816	3575 Main St, Fresno, CA, 93788	0.94	Phone reformatted State code upper-cased Placeholder values cleared
TPA-60916	TPA	Christine Le	1976-04-22	—	—	6862 Ridge Rd, San Antonio, TX, 78299	0.94	State code upper-cased Email lower-cased Placeholder values cleared
TPA-52329	TPA	Julia D Siimmons	1964-04-28	—	—	1215 Washington St, Phoenix, AZ, 85070	0.94	Name re-cased State code upper-cased Placeholder values cleared
TPA-50233	TPA	Christian Carpenter	1947-09-17	UHC-96005-90	—	8080 Willow Ct, Denver, CO, 80267	0.96	State code upper-cased Whitespace trimmed
TPA-63280	TPA	Andrea Lee	1994-12-25	—	5646999730	7227 Jefferson Ave, San Diego, CA, 92103	0.96	State code upper-cased Placeholder values cleared

559 rows, page 11 of 12Previous Next