Normalised records

Normalised records (silver)

Each raw row is parsed into consistently formatted fields. Every change from the raw value is recorded as a data-quality flag.

Normalised rows

99,495

usable in matching

Flagged rows

99,881

99.9% carry at least one flag

Junk quarantined

505

no usable last name

Average quality score

0.75

1.00 = no corrections needed

Quality flags

What normalisation had to do, and how often. Select a flag to filter the table.

Placeholder values cleared71,257
Placeholder tokens such as NULL, N/A, UNKNOWN or "-" treated as empty
Whitespace trimmed57,061
Leading or trailing whitespace removed from one or more fields
Address re-cased56,490
Street line re-cased and punctuation removed
Street suffix standardised55,824
Street suffix standardised to USPS abbreviation (Street to St, Avenue to Ave, and so on)
Phone reformatted50,244
Phone reduced to ten digits, punctuation and leading country code removed
Name re-cased39,996
Name letter-case rewritten to Title Case and stray characters removed
Date of birth reformatted32,400
Date of birth rewritten to ISO 8601 from a source format (MM/DD/YYYY, YYYYMMDD, Mon D, YYYY)
City re-cased17,850
City re-cased to Title Case
Gender normalised16,828
Gender mapped to F or M from a longer or variant value
Email lower-cased11,635
Email lower-cased
Name split from “Last, First”9,980
First-name field held "LAST, FIRST"; the two parts were split into their own fields
State name converted to code9,084
Full state name replaced by its two-letter USPS code
ZIP+4 trimmed8,263
ZIP+4 trimmed to the five-digit ZIP
Member ID reformatted7,723
Member ID re-hyphenated and upper-cased to the UHC-#####-## pattern
ZIP missing7,146
Street address present but no ZIP supplied
Unit split from street6,994
Apartment, suite or unit designator split from street line and re-appended in standard form
Two-digit birth year6,661
Date of birth carried a two-digit year; century inferred by pivot
State code upper-cased4,010
Two-letter state code upper-cased
Plan code upper-cased3,278
Plan code upper-cased
SSN last four extracted2,817
Last four digits of SSN extracted from a longer or punctuated value
Date of birth unreadable2,274
Date of birth did not match any known format or was out of range; cleared
Phone missing area code2,021
Phone had only seven digits (no area code); cleared
Middle initial moved out of first name1,125
A single middle initial was embedded in the first-name field and moved to middle name
Date of birth missing990
Date of birth absent or a null token; left empty
No usable name (quarantined)505
No usable last name; record quarantined as junk and excluded from matching

Normalised records

Claims, flag “Phone reformatted”, lowest dq score first

All ENR CLM TPA PRV

Junk onlyFlagPhone reformattedClear

Record	Source	Name	DOB	Member ID	Phone	Address	Quality score	Flags
CLM-410058	CLM	Cheryl Carroll	1967-02-19	UHC-80042-98	6004780411	6440 Union St, San Antonio, TX, 78213	0.66	Phone reformatted State name converted to code Gender normalised Whitespace trimmed+1 more
CLM-405484	CLM	Linda Stevens	1949-05-21	UHC-29670-57	6933022129	5554 Forest Ave # 815, Dallas, TX, 75220	0.66	Phone reformatted Unit split from street Street suffix standardised Address re-cased+1 more
CLM-408679	CLM	Janice K Burton	1956-04-03	UHC-20074-87	2265109137	5988 Baseline Rd, Seattle, WA	0.66	Phone reformatted Street suffix standardised Address re-cased ZIP missing+1 more
CLM-431281	CLM	Hananh Ramos	1952-09-18	UHC-51097-46	5717159596	8140 Broadway, Tempe, AZ	0.66	Name split from “Last, First”Phone reformatted ZIP missing Whitespace trimmed+1 more
CLM-432572	CLM	Dorothy Gomez	1965-10-25	UHC-28888-43	8404448085	4929 Elm St, Los Angeles, CA, 90030	0.66	Phone reformatted Street suffix standardised Address re-cased Gender normalised+1 more
CLM-408033	CLM	Deboah Freeman	1943-02-20	—	8524098033	1889 Market St, Orlando, FL, 32832	0.66	Two-digit birth year Phone reformatted Street suffix standardised Address re-cased+1 more
CLM-408032	CLM	Deboah Freeman	1943-02-20	—	8524098033	1889 Market St, Orlando, FL, 32832	0.66	Two-digit birth year Phone reformatted Street suffix standardised Address re-cased+1 more
CLM-425026	CLM	Geogre Austin	1938-09-20	UHC-22482-04	4903978675	3710 Bayshore Dr, Phoenix, AZ, 85073	0.66	Two-digit birth year Phone reformatted City re-cased ZIP+4 trimmed+1 more
CLM-426144	CLM	Richard Espinoza	1957-05-16	UHC-68182-02	5163396241	—	0.66	Two-digit birth year Phone reformatted Gender normalised Whitespace trimmed+1 more
CLM-412525	CLM	Jon Parker	1952-09-07	UHC-53297-26	6466498212	8769 Lincoln Way, Seattle, WA, 98174	0.66	Name split from “Last, First”Phone reformatted Street suffix standardised Address re-cased+1 more
CLM-425676	CLM	Bryan Ray	1958-11-20	UHC-15231-85	8976852507	—	0.66	Phone reformatted Member ID reformatted SSN last four extracted Gender normalised+1 more
CLM-412042	CLM	Jonathan Z McDonald	1987-07-24	—	3204387932	2481 Palm Dr, Charlotte, NC, 28269	0.66	Name split from “Last, First”Phone reformatted Street suffix standardised Address re-cased+1 more
CLM-405598	CLM	Mason P Herrera	1943-02-05	—	5424196196	182 Willow Ct, Charlotte, NC, 28299	0.66	Name split from “Last, First”Phone reformatted Gender normalised Whitespace trimmed+1 more
CLM-415947	CLM	Jean Wilson	1943-03-02	—	8927115598	—	0.66	Phone reformatted SSN last four extracted Gender normalised Whitespace trimmed+1 more
CLM-412313	CLM	Priya Warren	1987-11-26	UHC-51416-35	5596504206	9787 Park Pl, Glendale, AZ, 85331	0.66	Two-digit birth year Phone reformatted City re-cased State name converted to code+1 more
CLM-404455	CLM	Larry F Martin	2001-01-13	UHC-92470-78	8743453111	4620 Valley View Dr, San Antonio, TX, 78256	0.66	Name re-cased Two-digit birth year Phone reformatted Gender normalised+1 more
CLM-401193	CLM	Kathleen Cox	—	—	3426041160	2530 Mountain View Dr, Jacksonville, FL, 32216	0.66	Date of birth missing Phone reformatted Gender normalised Whitespace trimmed+1 more
CLM-403728	CLM	Karen Y Williamson	1989-01-28	UHC-19624-91	6128106648	6240 Elm St, Columbus, OH, 43239	0.66	Phone reformatted Street suffix standardised Address re-cased Gender normalised+1 more
CLM-403282	CLM	Judith Gilbert	1955-10-23	UHC-52805-66	7376544676	—	0.66	Name split from “Last, First”Two-digit birth year Phone reformatted Member ID reformatted+1 more
CLM-410641	CLM	Benjamin G Tarn	1956-10-03	—	6832813198	8544 Indian School Rd, Mesa, AZ, 85233	0.66	Name split from “Last, First”Phone reformatted Street suffix standardised Address re-cased+1 more
CLM-404894	CLM	Wei Harrison	—	UHC-67650-36	4509689142	—	0.66	Name split from “Last, First”Date of birth unreadable Phone reformatted Whitespace trimmed+1 more
CLM-413770	CLM	Maria Mills	2002-02-20	UHC-87139-79	9558996113	4692 Park Pl, Columbus, OH, 43211	0.66	Date of birth reformatted Phone reformatted SSN last four extracted ZIP+4 trimmed+1 more
CLM-406931	CLM	Ammber O Delgado	1998-09-15	UHC-52060-85	7168981217	6469 Market St Apt 22, Minneapolis, MN, 55401	0.66	Phone reformatted Unit split from street Gender normalised Whitespace trimmed+1 more
CLM-407510	CLM	Judy Rose	1991-12-22	UHC-66936-96	4538850988	2851 Sunset Blvd, Minneapolis, MN, 55417	0.66	Name re-cased Two-digit birth year Phone reformatted Street suffix standardised+1 more
CLM-418295	CLM	Angela C Matthews	1953-01-07	—	8466837684	—	0.66	Name split from “Last, First”Phone reformatted Gender normalised Whitespace trimmed+1 more
CLM-415803	CLM	Brian Daniels	1991-04-27	UHC-77710-35	2985199675	1346 Grand Ave # 369, Mesa, AZ, 85253	0.66	Name re-cased Date of birth reformatted Phone reformatted Unit split from street+1 more
CLM-402059	CLM	Alexander Carlson	1940-06-07	UHC-21277-93	8522695169	5227 Ridge Rd, Fresno, CA, 93742	0.66	Name re-cased Two-digit birth year Phone reformatted State name converted to code+1 more
CLM-412276	CLM	Simpson Catherine	1979-08-26	—	5538124807	2256 Oak St, Tempe, AZ, 85270	0.66	Name re-cased Phone reformatted State name converted to code Gender normalised+1 more
CLM-405023	CLM	Wille Colle	1985-09-21	—	5026621678	1476 Sunset Blvd, Nashville, TN, 37296	0.66	Two-digit birth year Phone reformatted Street suffix standardised Address re-cased+1 more
CLM-411843	CLM	Patrick Le	2007-07-13	UHC-86550-30	7813629188	5819 Washington St, Gilbert, AZ, 85233	0.66	Phone reformatted ZIP+4 trimmed Gender normalised Whitespace trimmed+1 more
CLM-418563	CLM	Sean Adams	1968-12-24	—	8357626925	6127 Indian School Rd, Los Angeles, CA, 90001	0.66	Two-digit birth year Phone reformatted Street suffix standardised Address re-cased+1 more
CLM-420643	CLM	Sarah Schmidt	1965-01-28	—	4608207029	8051 Willow Ct, San Diego, CA, 92166	0.66	Name split from “Last, First”Phone reformatted Street suffix standardised Address re-cased+1 more
CLM-410087	CLM	Helen Guzman	—	—	4839340028	939 Meadow Ln, Minneapolis, MN, 55416	0.66	Date of birth unreadable Phone reformatted Street suffix standardised Address re-cased+1 more
CLM-420936	CLM	Judith Stoo	1995-03-06	UHC-74540-84	7712855888	580 Jefferson Ave Apt 22, San Antonio, TX, 78224	0.66	Phone reformatted Unit split from street Street suffix standardised Address re-cased+1 more
CLM-419569	CLM	Debra Kelley	1975-12-19	UHC-04884-36	4522111602	1550 Sage Ct, San Antonio, TX, 78254	0.66	Name re-cased Phone reformatted Street suffix standardised Address re-cased+1 more
CLM-412809	CLM	Santiago A Wong	1969-01-19	UHC-35346-77	6855242033	4049 Washington St, Houston, TX, 77081	0.66	Name split from “Last, First”Phone reformatted Street suffix standardised Address re-cased+1 more
CLM-413657	CLM	Frances Hayes	1985-11-06	UHC-79363-79	7984806181	8483 Ridge Rd, Sacramento, CA	0.66	Phone reformatted Street suffix standardised Address re-cased ZIP missing+1 more
CLM-414035	CLM	Christine Bryant	1964-01-02	—	3139113030	8446 Union St, Jacksonville, FL, 32234	0.66	Name split from “Last, First”Phone reformatted Street suffix standardised Address re-cased+1 more
CLM-418915	CLM	Stephanie Lee	1974-09-03	—	9766355972	1459 Baseline Rd # 734, Glendale, AZ, 85313	0.66	Phone reformatted Unit split from street Street suffix standardised Address re-cased+1 more
CLM-417448	CLM	Kathleen Morgan	1994-04-23	UHC-44662-69	5535307790	5250 Spring St, Fresno, CA, 93754	0.66	Phone reformatted SSN last four extracted Street suffix standardised Address re-cased+1 more
CLM-415166	CLM	Daniel Hunter	1990-12-19	—	7019672836	3802 Mesa Dr, Nashville, TN, 37296	0.66	Phone reformatted Street suffix standardised Address re-cased State name converted to code+1 more
CLM-409525	CLM	Elziabeth Greene	1950-01-08	UHC-43618-30	2412458741	4344 Central Ave, Atlanta, GA, 30336	0.66	Phone reformatted Street suffix standardised Address re-cased State name converted to code+1 more
CLM-408987	CLM	Betty Fields	2006-08-24	—	5478738985	2940 Cedar Ln, Scottsdale, AZ, 85273	0.66	Phone reformatted Street suffix standardised Address re-cased Gender normalised+1 more
CLM-424524	CLM	Roger Nguyen	1992-02-06	—	4567329041	4735 Central Ave, Eden Prairie, MN, 55355	0.66	Two-digit birth year Phone reformatted Street suffix standardised Address re-cased+1 more
CLM-404838	CLM	Elizabeth Simmons	1938-07-15	—	6992704178	6495 Harbor Blvd, Houston, TX, 77097	0.66	Name re-cased Phone reformatted State name converted to code ZIP+4 trimmed+1 more
CLM-420527	CLM	George T Lopez	1951-11-13	—	5942626767	9472 Sunset Blvd, San Diego, CA	0.66	Name re-cased Phone reformatted ZIP missing Gender normalised+1 more
CLM-414831	CLM	Grace Coleman	1953-12-14	UHC-12213-45	6805624417	3475 Union St, Austin, TX, 78707	0.66	Phone reformatted Street suffix standardised Address re-cased Gender normalised+1 more
CLM-411416	CLM	Diana P Howard	1956-12-13	UHC-95898-65	7584887544	1940 Apache Blvd, Fresno, CA, 93727	0.66	Name split from “Last, First”Phone reformatted Street suffix standardised Address re-cased+1 more
CLM-412120	CLM	Virginia H Morrison	1981-02-21	—	8175804783	7046 Valley View Dr, Las Vegas, NV, 89169	0.66	Phone reformatted Street suffix standardised Address re-cased Gender normalised+1 more
CLM-419503	CLM	Andrew Freeman	1985-08-02	—	4145201517	8606 Church St, Denver, CO, 80221	0.66	Phone reformatted Street suffix standardised Address re-cased Gender normalised+1 more

11,960 rows, page 74 of 240Previous Next