Normalised records

Normalised records (silver)

Each raw row is parsed into consistently formatted fields. Every change from the raw value is recorded as a data-quality flag.

Normalised rows

99,495

usable in matching

Flagged rows

99,881

99.9% carry at least one flag

Junk quarantined

505

no usable last name

Average quality score

0.75

1.00 = no corrections needed

Quality flags

What normalisation had to do, and how often. Select a flag to filter the table.

Placeholder values cleared71,257
Placeholder tokens such as NULL, N/A, UNKNOWN or "-" treated as empty
Whitespace trimmed57,061
Leading or trailing whitespace removed from one or more fields
Address re-cased56,490
Street line re-cased and punctuation removed
Street suffix standardised55,824
Street suffix standardised to USPS abbreviation (Street to St, Avenue to Ave, and so on)
Phone reformatted50,244
Phone reduced to ten digits, punctuation and leading country code removed
Name re-cased39,996
Name letter-case rewritten to Title Case and stray characters removed
Date of birth reformatted32,400
Date of birth rewritten to ISO 8601 from a source format (MM/DD/YYYY, YYYYMMDD, Mon D, YYYY)
City re-cased17,850
City re-cased to Title Case
Gender normalised16,828
Gender mapped to F or M from a longer or variant value
Email lower-cased11,635
Email lower-cased
Name split from “Last, First”9,980
First-name field held "LAST, FIRST"; the two parts were split into their own fields
State name converted to code9,084
Full state name replaced by its two-letter USPS code
ZIP+4 trimmed8,263
ZIP+4 trimmed to the five-digit ZIP
Member ID reformatted7,723
Member ID re-hyphenated and upper-cased to the UHC-#####-## pattern
ZIP missing7,146
Street address present but no ZIP supplied
Unit split from street6,994
Apartment, suite or unit designator split from street line and re-appended in standard form
Two-digit birth year6,661
Date of birth carried a two-digit year; century inferred by pivot
State code upper-cased4,010
Two-letter state code upper-cased
Plan code upper-cased3,278
Plan code upper-cased
SSN last four extracted2,817
Last four digits of SSN extracted from a longer or punctuated value
Date of birth unreadable2,274
Date of birth did not match any known format or was out of range; cleared
Phone missing area code2,021
Phone had only seven digits (no area code); cleared
Middle initial moved out of first name1,125
A single middle initial was embedded in the first-name field and moved to middle name
Date of birth missing990
Date of birth absent or a null token; left empty
No usable name (quarantined)505
No usable last name; record quarantined as junk and excluded from matching

Normalised records

Third-party administrator, flag “State name converted to code”, lowest dq score first

All ENR CLM TPA PRV

Junk onlyFlagState name converted to codeClear

Record	Source	Name	DOB	Member ID	Phone	Address	Quality score	Flags
TPA-61756	TPA	Barbara Johnston	1973-12-10	—	8266139748	7133 Apache Blvd, Tampa, FL, 33651	0.82	Name re-cased State name converted to code Placeholder values cleared
TPA-62183	TPA	Deborah Nichols	1990-01-21	—	2984751728	7500 Broadway, Tampa, FL, 33601	0.82	State name converted to code Whitespace trimmed Placeholder values cleared
TPA-61091	TPA	Camila Hanson	2008-01-09	—	9133989663	9600 Lincoln Way, Nashville, TN, 37256	0.82	Phone reformatted State name converted to code Placeholder values cleared
TPA-57456	TPA	Michelle Andrews	1993-08-24	—	2377871199	6315 Highland Ave, Orlando, FL, 32874	0.82	Phone reformatted State name converted to code Placeholder values cleared
TPA-64336	TPA	Joe Stevens	1952-07-16	—	—	6977 Apache Blvd, Seattle, WA, 98174	0.82	State name converted to code Whitespace trimmed Placeholder values cleared
TPA-57303	TPA	Frnk Kelley	1942-02-28	UHC-40168-92	4224129873	4477 Sunset Blvd, Jacksonville, FL, 32204	0.82	City re-cased State name converted to code Whitespace trimmed
TPA-54156	TPA	Roy Crawford	1991-07-27	—	—	6673 Oak St, Seattle, WA, 98175	0.82	Name re-cased State name converted to code Placeholder values cleared
TPA-57865	TPA	Amy Ferguson	1944-01-22	UHC-39422-02	—	3896 Camelback Rd, Tucson, AZ, 85757	0.82	State name converted to code Whitespace trimmed Placeholder values cleared
TPA-62693	TPA	Andrea Boyd	2001-04-15	UHC-99046-48	—	6842 Harbor Blvd, Columbus, OH, 43208	0.82	City re-cased State name converted to code Placeholder values cleared
TPA-61359	TPA	Amber Jordan	1985-02-17	—	—	1088 Sunset Blvd, Seattle, WA, 98186	0.82	Name re-cased State name converted to code Placeholder values cleared
TPA-54677	TPA	Amanda Foster	1974-01-09	—	—	395 Washington St, San Diego, CA, 92199	0.82	Name re-cased State name converted to code Placeholder values cleared
TPA-57192	TPA	Gary K Mills	1986-01-19	UHC-36526-63	7785450619	1766 Church St, Denver, CO, 80293	0.82	Phone reformatted State name converted to code Placeholder values cleared
TPA-59836	TPA	Abigail Soto	1953-03-27	—	6174447910	3268 Lake View Rd, Mesa, AZ, 85252	0.82	State name converted to code Whitespace trimmed Placeholder values cleared
TPA-61385	TPA	Bradley Cox	1951-01-18	UHC-86083-56	—	4643 Harbor Blvd, Dallas, TX, 75247	0.82	Name re-cased State name converted to code Placeholder values cleared
TPA-51070	TPA	Douglas Morgan	1974-01-02	—	7783900003	4328 Grand Ave, Chandler, AZ, 85207	0.82	Phone reformatted State name converted to code Placeholder values cleared
TPA-57061	TPA	Henry W Kennedy	1990-11-13	—	—	9131 Oak St, Fresno, CA, 93700	0.82	State name converted to code Whitespace trimmed Placeholder values cleared
TPA-61754	TPA	Hannah Daniels	1985-05-22	—	—	73 Bayshore Dr, Phoenix, AZ, 85061	0.82	State name converted to code Whitespace trimmed Placeholder values cleared
TPA-52924	TPA	Deborah Riley	1947-04-26	—	—	1951 Lincoln Way, Atlanta, GA, 30315	0.82	State name converted to code Whitespace trimmed Placeholder values cleared
TPA-50255	TPA	Roger Bell	1986-11-02	—	—	7058 Meadow Ln, Miami, FL, 33133	0.82	State name converted to code Whitespace trimmed Placeholder values cleared
TPA-55304	TPA	Kenneth Harrison	1961-04-04	—	—	1680 Lake View Rd, Las Vegas, NV, 89177	0.82	Date of birth reformatted State name converted to code Placeholder values cleared
TPA-59041	TPA	Carl Rivera	1980-12-03	—	—	5451 Grand Ave, Eden Prairie, MN, 55370	0.82	Name re-cased State name converted to code Placeholder values cleared
TPA-51676	TPA	Patrick Santiago	2000-03-24	—	—	3196 Grand Ave, Minneapolis, MN, 55411	0.82	City re-cased State name converted to code Placeholder values cleared
TPA-50344	TPA	Adam R Simpson	2005-10-07	UHC-19865-62	—	5333 Harbor Blvd, Phoenix, AZ, 85000	0.82	Date of birth reformatted State name converted to code Placeholder values cleared
TPA-53538	TPA	Carlos Stone	1982-01-01	UHC-21036-35	—	3927 Lincoln Way, Atlanta, GA, 30345	0.82	Date of birth reformatted State name converted to code Placeholder values cleared
TPA-52978	TPA	Diana James	1952-05-22	—	—	3640 Sage Ct, Glendale, AZ, 85358	0.82	State name converted to code Whitespace trimmed Placeholder values cleared
TPA-63656	TPA	Noah Ferguson	1964-06-17	UHC-63143-64	—	4294 Mountain View Dr, Dallas, TX, 75234	0.82	Name re-cased State name converted to code Placeholder values cleared
TPA-51461	TPA	Dylan Day	1968-03-05	—	4364032927	522 Indian School Rd, Denver, CO, 80214	0.82	Date of birth reformatted State name converted to code Placeholder values cleared
TPA-53814	TPA	Nathan Bennett	1952-12-14	UHC-27614-09	—	2690 Lincoln Way, Denver, CO, 80206	0.82	State name converted to code Plan code upper-cased Placeholder values cleared
TPA-52623	TPA	Brittany Hall	1964-03-06	UHC-67985-87	—	6962 Desert Sky Blvd, Houston, TX, 77081	0.82	State name converted to code Plan code upper-cased Placeholder values cleared
TPA-55170	TPA	Melissa J Jordan	1981-10-21	—	—	1628 Central Ave, Mesa, AZ, 85235	0.82	Date of birth reformatted State name converted to code Placeholder values cleared
TPA-52452	TPA	Abigail Fowler	1986-06-21	—	—	4013 Broadway, Charlotte, NC, 28240	0.82	State name converted to code Whitespace trimmed Placeholder values cleared
TPA-57402	TPA	Elijah Tucker	1958-10-28	—	9823645918	6906 Harbor Blvd, Plano, TX, 75055	0.82	Date of birth reformatted Phone reformatted State name converted to code
TPA-62893	TPA	Sara Romero	1961-01-11	—	—	1684 Market St, Tucson, AZ, 85734	0.82	State name converted to code Email lower-cased Placeholder values cleared
TPA-60672	TPA	Stephanie Porter	1974-01-20	—	—	3850 Jefferson Ave, Los Angeles, CA, 90086	0.82	State name converted to code Whitespace trimmed Placeholder values cleared
TPA-52631	TPA	Steve Ortega	1941-03-27	—	—	1456 Jefferson Ave, Tempe, AZ, 85239	0.82	Name re-cased State name converted to code Placeholder values cleared
TPA-62663	TPA	Austin W Allen	1993-03-24	—	3993604770	2083 Cedar Ln, Phoenix, AZ, 85079	0.82	Phone reformatted State name converted to code Placeholder values cleared
TPA-51556	TPA	Bradley Freeman	1962-05-01	UHC-66492-18	8423257375	7726 Union St, Phoenix, AZ, 85034	0.82	Phone reformatted State name converted to code Placeholder values cleared
TPA-58705	TPA	Donna Wong	1967-09-15	—	—	7147 Mountain View Dr, Glendale, AZ, 85396	0.82	State name converted to code Whitespace trimmed Placeholder values cleared
TPA-52495	TPA	Victoria Evans	1994-03-26	—	2118074133	9661 Forest Ave, Houston, TX, 77068	0.82	Date of birth reformatted State name converted to code Placeholder values cleared
TPA-50294	TPA	Willie Walsh	1959-01-26	—	—	4995 Broadway, Los Angeles, CA, 90095	0.82	State name converted to code Plan code upper-cased Placeholder values cleared
TPA-56273	TPA	William Shaw	1996-04-14	—	—	6955 Park Pl, Los Angeles, CA, 90062	0.82	State name converted to code Whitespace trimmed Placeholder values cleared
TPA-57509	TPA	Edward Sandoval	1982-04-22	—	—	6632 Broadway, Minneapolis, MN, 55464	0.82	Address re-cased State name converted to code Placeholder values cleared
TPA-64363	TPA	Sandra Scott	1974-11-01	UHC-00116-94	—	3389 Harbor Blvd, Las Vegas, NV, 89158	0.82	State name converted to code Whitespace trimmed Placeholder values cleared
TPA-50257	TPA	Janice Kelley	1960-05-25	—	—	5743 Pine Dr, Los Angeles, CA, 90036	0.82	State name converted to code Whitespace trimmed Placeholder values cleared
TPA-52178	TPA	Christina Kennedy	1985-08-03	—	2128347188	1803 Central Ave, Tucson, AZ, 85706	0.82	Phone reformatted State name converted to code Placeholder values cleared
TPA-60920	TPA	Daniel Elliott	1941-12-11	—	—	4953 Washington St, Eden Prairie, MN, 55370	0.82	Date of birth reformatted State name converted to code Placeholder values cleared
TPA-61621	TPA	Gerald Harrison	1965-08-14	—	—	6815 Market St, Miami, FL, 33190	0.82	City re-cased State name converted to code Placeholder values cleared
TPA-55205	TPA	Aaron Sandoval	2006-04-13	—	—	8939 Valley View Dr, Jacksonville, FL, 32220	0.82	Date of birth reformatted State name converted to code Placeholder values cleared
TPA-64175	TPA	Adam Schmidt	1973-02-12	—	—	3416 Palm Dr, Orlando, FL, 32827	0.82	State name converted to code Whitespace trimmed Placeholder values cleared
TPA-55948	TPA	Noah Padilla	1984-09-20	—	—	5201 Highland Ave, Austin, TX, 78774	0.82	Name re-cased State name converted to code Placeholder values cleared

1,229 rows, page 24 of 25Previous Next