Normalised records

Normalised records (silver)

Each raw row is parsed into consistently formatted fields. Every change from the raw value is recorded as a data-quality flag.

Normalised rows

99,495

usable in matching

Flagged rows

99,881

99.9% carry at least one flag

Junk quarantined

505

no usable last name

Average quality score

0.75

1.00 = no corrections needed

Quality flags

What normalisation had to do, and how often. Select a flag to filter the table.

Placeholder values cleared71,257
Placeholder tokens such as NULL, N/A, UNKNOWN or "-" treated as empty
Whitespace trimmed57,061
Leading or trailing whitespace removed from one or more fields
Address re-cased56,490
Street line re-cased and punctuation removed
Street suffix standardised55,824
Street suffix standardised to USPS abbreviation (Street to St, Avenue to Ave, and so on)
Phone reformatted50,244
Phone reduced to ten digits, punctuation and leading country code removed
Name re-cased39,996
Name letter-case rewritten to Title Case and stray characters removed
Date of birth reformatted32,400
Date of birth rewritten to ISO 8601 from a source format (MM/DD/YYYY, YYYYMMDD, Mon D, YYYY)
City re-cased17,850
City re-cased to Title Case
Gender normalised16,828
Gender mapped to F or M from a longer or variant value
Email lower-cased11,635
Email lower-cased
Name split from “Last, First”9,980
First-name field held "LAST, FIRST"; the two parts were split into their own fields
State name converted to code9,084
Full state name replaced by its two-letter USPS code
ZIP+4 trimmed8,263
ZIP+4 trimmed to the five-digit ZIP
Member ID reformatted7,723
Member ID re-hyphenated and upper-cased to the UHC-#####-## pattern
ZIP missing7,146
Street address present but no ZIP supplied
Unit split from street6,994
Apartment, suite or unit designator split from street line and re-appended in standard form
Two-digit birth year6,661
Date of birth carried a two-digit year; century inferred by pivot
State code upper-cased4,010
Two-letter state code upper-cased
Plan code upper-cased3,278
Plan code upper-cased
SSN last four extracted2,817
Last four digits of SSN extracted from a longer or punctuated value
Date of birth unreadable2,274
Date of birth did not match any known format or was out of range; cleared
Phone missing area code2,021
Phone had only seven digits (no area code); cleared
Middle initial moved out of first name1,125
A single middle initial was embedded in the first-name field and moved to middle name
Date of birth missing990
Date of birth absent or a null token; left empty
No usable name (quarantined)505
No usable last name; record quarantined as junk and excluded from matching

Normalised records

Claims, flag “Two-digit birth year”, lowest dq score first

All ENR CLM TPA PRV

Junk onlyFlagTwo-digit birth yearClear

Record	Source	Name	DOB	Member ID	Phone	Address	Quality score	Flags
CLM-409920	CLM	Larry I Black	1961-03-15	UHC-17622-95	3864735026	5388 Jefferson Ave, Denver, CO, 80277	0.82	Name re-cased Two-digit birth year Whitespace trimmed
CLM-425421	CLM	Ralph Fuller	1943-09-24	UHC-95961-08	—	—	0.82	Name re-cased Two-digit birth year Placeholder values cleared
CLM-406387	CLM	Brian O Torres	1986-09-09	UHC-82191-10	—	—	0.82	Two-digit birth year Whitespace trimmed Placeholder values cleared
CLM-432466	CLM	Donald Simpson	1976-07-23	—	5643816326	—	0.82	Two-digit birth year Phone reformatted Placeholder values cleared
CLM-404078	CLM	Sandra V Hansen	2005-07-06	UHC-69805-53	—	—	0.82	Two-digit birth year Whitespace trimmed Placeholder values cleared
CLM-405205	CLM	Brittany Cambell	1953-04-18	—	—	5105 Valley View Dr, Fresno, CA, 93759	0.82	Name re-cased Two-digit birth year Placeholder values cleared
CLM-427217	CLM	Amanda Peters	1971-12-05	—	—	4865 Willow Ct, Phoenix, AZ, 85031	0.82	Name re-cased Two-digit birth year Placeholder values cleared
CLM-429332	CLM	Maria Carlson	1955-09-12	UHC-01702-71	—	—	0.82	Two-digit birth year Member ID reformatted Placeholder values cleared
CLM-414882	CLM	Jan Z Mathews	2006-02-15	UHC-97785-65	—	2720 Bayshore Dr, Fresno, CA, 93774	0.82	Two-digit birth year Whitespace trimmed Placeholder values cleared
CLM-401074	CLM	Janet Sanchez	2007-08-22	UHC-19523-28	—	3187 Hillcrest Rd, Tucson, AZ, 85782	0.82	Two-digit birth year Email lower-cased Placeholder values cleared
CLM-408036	CLM	Carlos P Stewart	1996-06-01	UHC-94711-24	—	8243 Highland Ave, Miami, FL, 33144	0.82	Two-digit birth year Whitespace trimmed Placeholder values cleared
CLM-401087	CLM	Ryan Gilbert	1953-01-27	UHC-31154-02	—	—	0.82	Name re-cased Two-digit birth year Placeholder values cleared
CLM-421737	CLM	Mria Diaz	1985-09-16	UHC-05933-18	—	1719 Spring St, Miami, FL, 33159	0.82	Two-digit birth year Whitespace trimmed Placeholder values cleared
CLM-431008	CLM	Fatima I Price	1945-11-18	—	—	3822 Lincoln Way, San Diego, CA, 92174	0.82	Name re-cased Two-digit birth year Placeholder values cleared
CLM-424308	CLM	Morrison Wei	1956-07-26	—	9546831872	—	0.82	Name re-cased Two-digit birth year Placeholder values cleared
CLM-412108	CLM	Marilyn Nunez	1974-08-16	UHC-13171-62	—	4466 Broadway, Jacksonville, FL, 32235	0.82	Two-digit birth year Whitespace trimmed Placeholder values cleared
CLM-403455	CLM	Roy Baker	1990-07-17	—	—	3701 Washington St, Tampa, FL, 33607	0.82	Two-digit birth year Whitespace trimmed Placeholder values cleared
CLM-409558	CLM	Diana Woods	1989-12-02	—	6553257920	—	0.82	Two-digit birth year Whitespace trimmed Placeholder values cleared
CLM-419789	CLM	Sharon Owens	1964-06-15	UHC-46430-01	—	—	0.82	Two-digit birth year Whitespace trimmed Placeholder values cleared
CLM-427164	CLM	Elizabeth Stephens	1940-06-08	UHC-57401-20	—	9528 Meadow Ln, Austin, TX, 78768	0.82	Name re-cased Two-digit birth year Placeholder values cleared
CLM-407307	CLM	Rachel Watson	1942-09-23	—	—	1928 Camelback Rd, San Diego, CA, 92132	0.82	Two-digit birth year Whitespace trimmed Placeholder values cleared
CLM-432032	CLM	Heny King	1953-06-24	UHC-09665-72	8449914219	7813 Park Pl, Scottsdale, AZ, 85289	0.82	Two-digit birth year Phone reformatted Whitespace trimmed
CLM-425863	CLM	Matthew J Silva	1961-07-09	UHC-88687-40	—	9834 Indian School Rd, Plano, TX, 75013	0.82	Name re-cased Two-digit birth year Placeholder values cleared
CLM-408888	CLM	Jesse A Cole	1951-08-18	UHC-22366-11	—	—	0.82	Name re-cased Two-digit birth year Placeholder values cleared
CLM-424996	CLM	Marilyn Berry	1982-05-02	UHC-72413-38	5068142068	3353 Mesa Dr, Sacramento, CA, 95860	0.82	Two-digit birth year Phone reformatted Placeholder values cleared
CLM-411320	CLM	Betty Rojas	1976-12-27	UHC-59588-79	—	—	0.82	Two-digit birth year Whitespace trimmed Placeholder values cleared
CLM-413764	CLM	Christina Walsh	1985-08-19	UHC-65890-94	—	6662 Lake View Rd, Minneapolis, MN, 55487	0.82	Name re-cased Two-digit birth year Placeholder values cleared
CLM-426333	CLM	Nancy T Fields	1987-10-18	UHC-70642-29	—	—	0.82	Two-digit birth year Whitespace trimmed Placeholder values cleared
CLM-412740	CLM	Harold P Patterson	1940-03-26	UHC-04603-36	3754075325	—	0.82	Two-digit birth year Phone reformatted Placeholder values cleared
CLM-410726	CLM	Jose Weber	1957-04-10	—	—	—	0.82	Two-digit birth year Whitespace trimmed Placeholder values cleared
CLM-409506	CLM	Adam D Garrett	1986-12-01	UHC-27878-40	—	1633 Palm Dr, Los Angeles, CA, 90078	0.82	Two-digit birth year Whitespace trimmed Placeholder values cleared
CLM-428067	CLM	Jason Hunt	1963-12-08	—	—	3113 Park Pl, Tempe, AZ, 85216	0.82	Two-digit birth year Email lower-cased Placeholder values cleared
CLM-417994	CLM	Adam Lewis	1977-05-17	UHC-06334-32	—	—	0.84	Two-digit birth year Placeholder values cleared
CLM-410716	CLM	Ahmed D Jacobs	1982-06-07	UHC-99057-32	—	1326 Lincoln Way, Plano, TX, 75070	0.84	Two-digit birth year Placeholder values cleared
CLM-430009	CLM	Tyler G Moreno	1992-10-28	—	—	—	0.84	Two-digit birth year Placeholder values cleared
CLM-405759	CLM	Diego Hanson	2000-08-03	UHC-59842-53	—	3400 Broadway, Mesa, AZ, 85275	0.84	Two-digit birth year Placeholder values cleared
CLM-414908	CLM	Maria Warren	1939-08-17	UHC-52031-57	—	7583 Market St, Plano, TX, 75028	0.84	Two-digit birth year Placeholder values cleared
CLM-419435	CLM	Jon Q Silva	2006-05-10	—	—	8190 Cedar Ln, Fresno, CA, 93752	0.84	Two-digit birth year Placeholder values cleared
CLM-413953	CLM	Joyce Reyes	2008-12-04	—	5382203546	1156 Broadway, Dallas, TX, 75299	0.84	Two-digit birth year Placeholder values cleared
CLM-426185	CLM	Alexander Chavez	1961-04-07	—	6903660817	—	0.84	Two-digit birth year Placeholder values cleared
CLM-415883	CLM	Zachary Rogers	1980-11-20	UHC-85497-87	—	4290 Ridge Rd, Eden Prairie, MN, 55310	0.84	Name re-cased Two-digit birth year
CLM-420727	CLM	Cynthia Hill	2006-08-21	UHC-85055-61	2036047667	3680 Indian School Rd, Tucson, AZ, 85754	0.84	Two-digit birth year Placeholder values cleared
CLM-424656	CLM	Frank Washington	1978-07-08	UHC-91228-72	—	—	0.84	Two-digit birth year Placeholder values cleared
CLM-427090	CLM	Jim Banks	1999-03-22	UHC-39366-98	—	5022 Baseline Rd, Atlanta, GA, 30342	0.84	Two-digit birth year Placeholder values cleared
CLM-427091	CLM	Jim Banks	1999-03-22	UHC-39366-98	—	5022 Baseline Rd, Atlanta, GA, 30342	0.84	Two-digit birth year Placeholder values cleared
CLM-413612	CLM	Beverly Elliott	1993-12-28	UHC-59781-23	—	4808 Lincoln Way, Minneapolis, MN, 55464	0.84	Two-digit birth year Placeholder values cleared
CLM-409499	CLM	Russell Larson	1983-05-13	—	—	2777 Desert Sky Blvd, Orlando, FL, 32876	0.84	Two-digit birth year Placeholder values cleared
CLM-430152	CLM	Joe Rojas	1982-01-06	UHC-25331-20	8514202582	—	0.84	Two-digit birth year Placeholder values cleared
CLM-410249	CLM	Virginia Hayes	1943-10-14	UHC-15953-18	—	—	0.84	Two-digit birth year Placeholder values cleared
CLM-422901	CLM	Dorothy C Price	2007-01-05	—	—	1418 Sunset Blvd, San Diego, CA, 92153	0.84	Two-digit birth year Placeholder values cleared

2,168 rows, page 42 of 44Previous Next