Normalised records

Normalised records (silver)

Each raw row is parsed into consistently formatted fields. Every change from the raw value is recorded as a data-quality flag.

Normalised rows

99,495

usable in matching

Flagged rows

99,881

99.9% carry at least one flag

Junk quarantined

505

no usable last name

Average quality score

0.75

1.00 = no corrections needed

Quality flags

What normalisation had to do, and how often. Select a flag to filter the table.

Placeholder values cleared71,257
Placeholder tokens such as NULL, N/A, UNKNOWN or "-" treated as empty
Whitespace trimmed57,061
Leading or trailing whitespace removed from one or more fields
Address re-cased56,490
Street line re-cased and punctuation removed
Street suffix standardised55,824
Street suffix standardised to USPS abbreviation (Street to St, Avenue to Ave, and so on)
Phone reformatted50,244
Phone reduced to ten digits, punctuation and leading country code removed
Name re-cased39,996
Name letter-case rewritten to Title Case and stray characters removed
Date of birth reformatted32,400
Date of birth rewritten to ISO 8601 from a source format (MM/DD/YYYY, YYYYMMDD, Mon D, YYYY)
City re-cased17,850
City re-cased to Title Case
Gender normalised16,828
Gender mapped to F or M from a longer or variant value
Email lower-cased11,635
Email lower-cased
Name split from “Last, First”9,980
First-name field held "LAST, FIRST"; the two parts were split into their own fields
State name converted to code9,084
Full state name replaced by its two-letter USPS code
ZIP+4 trimmed8,263
ZIP+4 trimmed to the five-digit ZIP
Member ID reformatted7,723
Member ID re-hyphenated and upper-cased to the UHC-#####-## pattern
ZIP missing7,146
Street address present but no ZIP supplied
Unit split from street6,994
Apartment, suite or unit designator split from street line and re-appended in standard form
Two-digit birth year6,661
Date of birth carried a two-digit year; century inferred by pivot
State code upper-cased4,010
Two-letter state code upper-cased
Plan code upper-cased3,278
Plan code upper-cased
SSN last four extracted2,817
Last four digits of SSN extracted from a longer or punctuated value
Date of birth unreadable2,274
Date of birth did not match any known format or was out of range; cleared
Phone missing area code2,021
Phone had only seven digits (no area code); cleared
Middle initial moved out of first name1,125
A single middle initial was embedded in the first-name field and moved to middle name
Date of birth missing990
Date of birth absent or a null token; left empty
No usable name (quarantined)505
No usable last name; record quarantined as junk and excluded from matching

Normalised records

Third-party administrator, flag “City re-cased”, lowest dq score first

All ENR CLM TPA PRV

Junk onlyFlagCity re-casedClear

Record	Source	Name	DOB	Member ID	Phone	Address	Quality score	Flags
TPA-55400	TPA	Terry Torres	2008-07-25	UHC-76846-30	8744688321	1791 Main St, Chandler, AZ, 85268	0.80	Phone reformatted SSN last four extracted City re-cased Placeholder values cleared
TPA-53100	TPA	Angela Sanders	1975-04-10	—	—	2301 Grand Ave, Jacksonville, FL, 32217	0.80	Street suffix standardised Address re-cased City re-cased Placeholder values cleared
TPA-62131	TPA	James Johnston	1960-06-27	—	—	3248 Mesa Dr, Nashville, TN, 37296	0.80	City re-cased Gender normalised Whitespace trimmed Placeholder values cleared
TPA-62438	TPA	Virginia Scott	2005-05-02	—	9472393656	9105 Hillcrest Rd, Seattle, WA, 98194	0.80	Phone reformatted Street suffix standardised Address re-cased City re-cased
TPA-64141	TPA	Jackie Mitchell	1952-08-19	—	9025108443	4556 Grand Ave, Atlanta, GA, 30384	0.80	Street suffix standardised Address re-cased City re-cased Placeholder values cleared
TPA-56716	TPA	Jesse J Murray	1963-12-17	UHC-00502-63	8948422268	2900 Lincoln Way, Jacksonville, FL, 32253	0.80	Phone reformatted City re-cased Gender normalised Placeholder values cleared
TPA-58439	TPA	Katherine Hudson	1983-12-15	—	—	1002 Indian School Rd, Tucson, AZ, 85753	0.80	Name re-cased City re-cased Gender normalised Placeholder values cleared
TPA-63192	TPA	Ralph Fowler	1998-08-16	—	—	3163 Oak St, Miami, FL, 33166	0.80	Name re-cased City re-cased Gender normalised Placeholder values cleared
TPA-56315	TPA	Marilyn Hicks	1943-02-26	—	—	4833 Mountain View Dr, Austin, TX, 78799	0.80	Name re-cased City re-cased Gender normalised Placeholder values cleared
TPA-60466	TPA	Samantha Reid	1977-02-22	—	—	5376 Canyon Rd, Los Angeles, CA, 90092	0.80	Name re-cased Two-digit birth year City re-cased Placeholder values cleared
TPA-60703	TPA	Deborah E Vargas	1944-06-26	—	—	4953 Apache Blvd, Minneapolis, MN, 55473	0.80	Street suffix standardised Address re-cased City re-cased Placeholder values cleared
TPA-54266	TPA	Gabriel Chen	1997-06-05	UHC-42326-53	—	3512 Washington St, Fresno, CA, 93736	0.80	Two-digit birth year Member ID reformatted City re-cased Placeholder values cleared
TPA-52925	TPA	Cynthia Owens	1961-04-27	—	—	9409 Main St, Phoenix, AZ, 85051	0.80	Street suffix standardised Address re-cased City re-cased Placeholder values cleared
TPA-63644	TPA	Nicholas Morales	1978-01-24	—	—	7526 Broadway, Fresno, CA, 93710	0.80	City re-cased ZIP+4 trimmed Whitespace trimmed Placeholder values cleared
TPA-61817	TPA	Bradley Bishop	2002-09-22	UHC-02311-67	—	3761 Oak St, Chandler, AZ, 85221	0.80	City re-cased Gender normalised Whitespace trimmed Placeholder values cleared
TPA-56285	TPA	Gabriel Q Shaw	1941-11-06	—	—	3336 Willow Ct, Nashville, TN, 37210	0.80	Street suffix standardised Address re-cased City re-cased Placeholder values cleared
TPA-58234	TPA	Elizabeth Hansun	1981-10-23	—	—	1726 Elm St, San Antonio, TX, 78247	0.80	Name split from “Last, First”City re-cased Whitespace trimmed Placeholder values cleared
TPA-51028	TPA	Margaret D Franklin	1941-10-02	—	—	4443 Central Ave, Gilbert, AZ, 85274	0.80	Date of birth reformatted City re-cased Gender normalised Placeholder values cleared
TPA-62795	TPA	Lori Miller	1942-02-11	—	—	138 Harbor Blvd, Nashville, TN, 37242	0.80	Date of birth reformatted City re-cased State name converted to code Placeholder values cleared
TPA-63554	TPA	Olivia Myers	2008-06-12	—	—	369 Apache Blvd, Los Angeles, CA, 90023	0.80	Street suffix standardised Address re-cased City re-cased Placeholder values cleared
TPA-62561	TPA	Ashley Hill	1960-06-11	—	—	3073 Jefferson Ave, Phoenix, AZ, 85000	0.80	Street suffix standardised Address re-cased City re-cased Placeholder values cleared
TPA-55822	TPA	Janice E Weber	1972-01-16	—	2904625917	4750 Grand Ave, Tucson, AZ, 85715	0.80	Phone reformatted City re-cased State name converted to code Placeholder values cleared
TPA-57725	TPA	Carolyn Carter	1986-05-27	UHC-89438-45	—	9813 Sunset Blvd, Sacramento, CA, 95811	0.80	Street suffix standardised Address re-cased City re-cased Placeholder values cleared
TPA-55982	TPA	Beverly Elliott	1993-12-28	—	—	4808 Lincoln Way, Minneapolis, MN, 55464	0.80	Name re-cased City re-cased Gender normalised Whitespace trimmed
TPA-50449	TPA	Gloria Moore	1955-06-15	—	—	3587 Spring St, San Diego, CA, 92136	0.80	Street suffix standardised Address re-cased City re-cased Placeholder values cleared
TPA-63696	TPA	Amanda Andrews	—	UHC-57948-95	—	7758 Central Ave, Chandler, AZ, 85275	0.80	Date of birth unreadable City re-cased Whitespace trimmed Placeholder values cleared
TPA-55548	TPA	Roy Hart	1938-02-10	—	—	241 Forest Ave # 287, San Antonio, TX, 78202	0.80	Unit split from street City re-cased Whitespace trimmed Placeholder values cleared
TPA-54839	TPA	Barbara R Espinoza	2001-10-25	—	—	4396 Valley View Dr, Tempe, AZ, 85224	0.80	City re-cased State name converted to code Whitespace trimmed Placeholder values cleared
TPA-63690	TPA	Karen Thomas	2005-11-05	—	—	6718 Mesa Dr, Houston, TX, 77082	0.80	Date of birth reformatted City re-cased Gender normalised Placeholder values cleared
TPA-62766	TPA	Daniel Ward	1941-04-15	—	—	2104 Palm Dr, Denver, CO	0.80	Date of birth reformatted City re-cased ZIP missing Placeholder values cleared
TPA-61297	TPA	Mason Morales	1966-12-11	—	2416145526	4948 River Rd, Gilbert, AZ, 85249	0.80	City re-cased Gender normalised Whitespace trimmed Placeholder values cleared
TPA-54542	TPA	Ana Robinson	1955-02-02	—	4879860691	3989 Indian School Rd, San Diego, CA	0.80	Phone reformatted City re-cased ZIP missing Placeholder values cleared
TPA-54855	TPA	Jessica Evans	1974-08-13	—	—	2157 River Rd, Dallas, TX, 75242	0.80	Street suffix standardised Address re-cased City re-cased Placeholder values cleared
TPA-62205	TPA	Amber Lee	2004-04-08	—	5362651559	5091 Church St, Sacramento, CA, 95883	0.80	Name split from “Last, First”City re-cased Plan code upper-cased Placeholder values cleared
TPA-53494	TPA	Kevin Lucas	1946-07-04	—	—	7668 Indian School Rd, Mesa, AZ, 85288	0.80	Name split from “Last, First”City re-cased Whitespace trimmed Placeholder values cleared
TPA-61786	TPA	Carl Ray	1964-08-05	—	—	1930 Harbor Blvd, Mesa, AZ, 85208	0.80	Street suffix standardised Address re-cased City re-cased Placeholder values cleared
TPA-62902	TPA	Kathleen Le	1987-06-08	—	9124584030	8323 Bayshore Dr # 160, Tucson, AZ, 85782	0.80	Date of birth reformatted Unit split from street City re-cased Placeholder values cleared
TPA-58499	TPA	Vincent Reyes	2006-10-23	UHC-96719-08	—	8555 Park Pl, Plano, TX, 75016	0.80	Street suffix standardised Address re-cased City re-cased Placeholder values cleared
TPA-61353	TPA	Kathryn Jordan	1963-06-15	—	—	5080 Sunset Blvd, Charlotte, NC, 28215	0.80	City re-cased State name converted to code Email lower-cased Whitespace trimmed
TPA-62483	TPA	Brucce G Evans	1965-11-07	—	—	6479 River Rd, Denver, CO, 80250	0.80	City re-cased ZIP+4 trimmed Whitespace trimmed Placeholder values cleared
TPA-58386	TPA	Gabriel Wong	1950-02-27	—	—	3548 Harbor Blvd, Tampa, FL, 33636	0.80	City re-cased ZIP+4 trimmed Whitespace trimmed Placeholder values cleared
TPA-57331	TPA	Samantha Henderson	1945-01-13	—	—	2943 Canyon Rd, Jacksonville, FL, 32266	0.80	Date of birth reformatted Street suffix standardised Address re-cased City re-cased
TPA-50229	TPA	Carolyn Wilson	1948-05-14	—	3516852977	2995 Pine Dr, Charlotte, NC, 28254	0.80	City re-cased ZIP+4 trimmed Whitespace trimmed Placeholder values cleared
TPA-61859	TPA	Paul Bailey	1944-02-13	—	—	8032 Church St, Mesa, AZ, 85208	0.80	Street suffix standardised Address re-cased City re-cased Placeholder values cleared
TPA-51521	TPA	Betty Alvarez	1972-04-14	—	—	5477 Mountain View Dr, Scottsdale, AZ, 85223	0.80	City re-cased Gender normalised Whitespace trimmed Placeholder values cleared
TPA-58037	TPA	Ronald Price	1983-08-01	—	—	280 Spring St, Gilbert, AZ, 85200	0.80	Street suffix standardised Address re-cased City re-cased Placeholder values cleared
TPA-52777	TPA	Arjun Sanders	1961-05-25	UHC-60332-28	—	1118 Oak St, Miami, FL, 33190	0.80	Street suffix standardised Address re-cased City re-cased Placeholder values cleared
TPA-58323	TPA	Larry Chapman	1981-11-16	—	—	3349 Union St, Eden Prairie, MN, 55390	0.80	City re-cased ZIP+4 trimmed Whitespace trimmed Placeholder values cleared
TPA-63652	TPA	Christopher Yang	1961-08-27	—	—	6043 Church St, Chandler, AZ	0.80	City re-cased ZIP missing Whitespace trimmed Placeholder values cleared
TPA-53068	TPA	Donna Padilla	1951-10-28	—	—	6322 Bayshore Dr Apt 9, Sacramento, CA, 95875	0.80	Date of birth reformatted Unit split from street City re-cased Placeholder values cleared

2,455 rows, page 38 of 50Previous Next