Five fields scored — delivery line · city · state · ZIP · FIPS. A row passes only if all five match Smarty.
| Field | Match | % | |
|---|---|---|---|
| Delivery line | 91/91 | 100.0% | |
| City | 91/91 | 100.0% | |
| State | 91/91 | 100.0% | |
| ZIP | 91/91 | 100.0% | |
| FIPS | 91/91 | 100.0% |
ARS resolves each address via Athena → its own cache → Smarty. The first two are 8020 data; the Smarty path is passthrough. All should equal Smarty.
| Source | n | Pass | What it means |
|---|---|---|---|
| ARS own data — the real test | |||
| athena | 33 | 33/33 | ARS Athena resolution vs Smarty |
| cache | 42 | 42/42 | ARS delta-cache vs live Smarty |
| Smarty passthrough / no-match | |||
| smarty | 13 | 13/13 | ARS called Smarty (passthrough) |
| null | 3 | 3/3 | ARS no-match |
These rows score PASS on the five standardized fields, but Smarty (the ground truth) did not return a confirmed delivery point — so the green means ARS and Smarty agree on the standardized string, not that the address is confirmed deliverable. They are surfaced here instead of being absorbed silently into the pass count.
over-match 1 — ARS resolved a should-not-resolve address as match-mailable while Smarty did not confirm it: nonexistent. A real ARS over-reach (tracked, not a standardization fail).
weak DPV 8 — edge address forms (rural route, fractional, grid, territory, no-ZIP landmark) where Smarty's DPV is unconfirmed: zip_missing_empire, rural_route, dl_half, fips_sanjuan_pr, dl_grid_utah, dl_dir_suffix, dl_us_highway, dl_county_road. Standardization agrees; deliverability is not vouched for.
Re-run the full ARS↔Smarty battery against live Smarty and rebuild this page:
uv run python run.py sync
/v1/resolve/syncAdd cases in ars_audit/cases/synthetic.py. Every number here is generated from sync_compare.json — nothing is hand-typed.
| # | Case | Input address | Src | Delivery line | City | State | ZIP | FIPS | Score | Verdict | |||||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 0 | ▸zip_wrong_whitehouse | 1600 Pennsylvania Ave NW, Washington, DC, 10001 | cache | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
White House w/ a WRONG ZIP (10001 is NYC) → must correct to 20500 ARS source cache · summary match-mailable · ZIP fixed 10001 → 20500 Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 1 | ▸zip_missing_whitehouse | 1600 Pennsylvania Ave NW, Washington, DC | cache | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
White House, no ZIP → must fill 20500 from street+city+state ARS source cache · summary match-mailable · ZIP filled → 20500 Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 2 | ▸zip_missing_empire | 350 5th Ave, New York, NY | cache | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASSweak DPV | |||||||||||||||||||||||
Empire State Bldg, no ZIP → must fill 10118 ARS source cache · summary match-mailable · ZIP filled → 10001 Weak DPV. Passes on standardization, but Smarty's own DPV did not confirm a delivery point for this edge address form — the green means ARS and Smarty produced the same standardized string, not that the address is confirmed deliverable. Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 3 | ▸zip_missing_miami | 3500 Pan American Dr, Miami, FL | athena | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
Miami City Hall, no ZIP → fill + county_fips 12086 ARS source athena · summary match-mailable · ZIP filled → 33133 Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 4 | ▸zip_missing_phoenix | 200 W Washington St, Phoenix, AZ | athena | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
Phoenix City Hall, no ZIP → fill + county_fips 04013 ARS source athena · summary match-mailable · ZIP filled → 85003 Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 5 | ▸zip_wrong_houston | 901 Bagby St, Houston, TX, 99999 | cache | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
Houston City Hall w/ impossible ZIP 99999 → must correct to 77002 ARS source cache · summary match-mailable · ZIP fixed 99999 → 77002 Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 6 | ▸zip_short_philly | 1400 John F Kennedy Blvd, Philadelphia, PA, 191 | cache | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
Truncated ZIP (191) → must expand/correct to a valid 5-digit ARS source cache · summary match-mailable · ZIP fixed 191 → 19107 Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 7 | ▸clean_civic | 1600 Pennsylvania Ave NW, Washington, DC, 20500 | cache | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
White House — canonical clean DPV-Y baseline (correct ZIP) ARS source cache · summary match-mailable Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 8 | ▸clean_landmark | 350 5th Ave, New York, NY, 10118 | cache | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
Empire State Bldg — high-rise, plus4 + precision check ARS source cache · summary match-mailable Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 9 | ▸fips_miami | 3500 Pan American Dr, Miami, FL, 33133 | athena | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
Miami City Hall — county_fips 12086 ARS source athena · summary match-mailable Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 10 | ▸fips_maricopa | 200 W Washington St, Phoenix, AZ, 85003 | athena | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
Phoenix City Hall — county_fips 04013 ARS source athena · summary match-mailable Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 11 | ▸fips_philly | 1400 John F Kennedy Blvd, Philadelphia, PA, 19107 | athena | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
Philadelphia City Hall — county_fips 42101 ARS source athena · summary match-mailable Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 12 | ▸fips_harris | 901 Bagby St, Houston, TX, 77002 | athena | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
Houston City Hall — county_fips 48201 ARS source athena · summary match-mailable Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 13 | ▸fips_jackson | 415 E 12th St, Kansas City, MO, 64106 | athena | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
Jackson County courthouse — county_fips 29095 ARS source athena · summary match-mailable Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 14 | ▸zip_plus4 | 1 Infinite Loop, Cupertino, CA, 95014-2083 | cache | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
ZIP+4 input → ARS must normalize to ZIP5 for matching, still mailable ARS source cache · summary match-mailable Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 15 | ▸dup_tokens | 350 5th Ave Ave, New York, NY, 10118 | smarty | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
Duplicated street token → preprocessing should dedupe and still match ARS source smarty · summary match-mailable Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 16 | ▸messy_case | 1600 pennsylvania ave nw, washington, dc, 20500 | cache | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
All-lowercase → casing must not change standardization ARS source cache · summary match-mailable Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 17 | ▸abbrev_expand | 1 N State St, Chicago, IL, 60602 | cache | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
Directional + abbrev St → both should expand consistently ARS source cache · summary match-mailable Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 18 | ▸extra_space | 350 5th Ave, New York, NY, 10118 | cache | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
Collapsed whitespace — tokenization robustness ARS source cache · summary match-mailable Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 19 | ▸no_city_state | 1600 Pennsylvania Ave NW, 20500 | cache | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
Missing city/state but ZIP present → should still resolve ARS source cache · summary match-mailable Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 20 | ▸street_only | 1600 Pennsylvania Ave NW | null | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS · NM | |||||||||||||||||||||||
Street only, no ZIP/city/state → expect no-match or low-confidence ARS source null · summary no-match Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 21 | ▸mf_with_unit | 20 W 34th St Apt 1000, New York, NY, 10001 | cache | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
Multifamily WITH unit → unit must be preserved in delivery_line_2 ARS source cache · summary match-mailable · ZIP fixed 10001 → 10118 Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 22 | ▸mf_no_unit | 100 Beacon St, Boston, MA, 02116 | athena | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
Multifamily NO unit → DPV may flag, both should agree on flag ARS source athena · summary match-mailable Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 23 | ▸suite_variant | 30 Rockefeller Plaza Ste 100, New York, NY, 10112 | smarty | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
Suite designator variant — secondary-unit handling ARS source smarty · summary match-mailable Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 24 | ▸po_box | PO Box 1142, Washington, DC, 20013 | cache | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
PO Box — RDI/precision differs, both must agree ARS source cache · summary match-mailable Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 25 | ▸rural_route | RR 2 Box 152, Jackson, KY, 40387 | cache | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASSweak DPV | |||||||||||||||||||||||
Rural route — non-city-style ARS source cache · summary match-mailable Weak DPV. Passes on standardization, but Smarty's own DPV did not confirm a delivery point for this edge address form — the green means ARS and Smarty produced the same standardized string, not that the address is confirmed deliverable. Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 26 | ▸directional_heavy | 1 N 1st St, Phoenix, AZ, 85004 | athena | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
Directional-heavy — leading directional ARS source athena · summary match-mailable Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 27 | ▸nonexistent | 99999 Nowhere Fake St, Springfield, IL, 62701 | cache | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS⚠ over-match | |||||||||||||||||||||||
Fabricated street → both no-match (DPV X) ARS source cache · summary match-mailable ⚠ Over-match. ARS returned match-mailable for an address that should not resolve, while Smarty did not confirm a delivery point (DPV unconfirmed). The five standardized fields still echo-match, so it scores PASS — but this is an ARS over-reach, surfaced here rather than hidden in the pass count. Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 28 | ▸garbage | asdf qwer zxcv, 00000 | null | ✓both no-match | ✓ | ✓ | ✓both no-match | ✓ | 100% | PASS · NM | |||||||||||||||||||||||
Garbage tokens + invalid ZIP → both no-match ARS source null · summary no-match Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 29 | ▸foreign | 10 Downing Street, London | null | ✓both no-match | ✓both no-match | ✓ | ✓ | ✓ | 100% | PASS · NM | |||||||||||||||||||||||
Foreign (UK) → US-only APIs no-match; foreign-handling parity ARS source null · summary no-match Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 30 | ▸bad_zip_for_state | 1600 Pennsylvania Ave NW, Washington, CA, 20500 | cache | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
State/ZIP mismatch (DC ZIP, CA state) → corrected or flagged ARS source cache · summary match-mailable Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 31 | ▸fips_la | 200 N Spring St, Los Angeles, CA, 90012 | athena | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
LA City Hall — FIPS 06037 ARS source athena · summary match-mailable Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 32 | ▸fips_seattle | 600 4th Ave, Seattle, WA, 98104 | athena | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
Seattle City Hall — FIPS 53033 ARS source athena · summary match-mailable Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 33 | ▸fips_denver | 1437 Bannock St, Denver, CO, 80202 | athena | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
Denver City/County Bldg — FIPS 08031 ARS source athena · summary match-mailable Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 34 | ▸fips_atlanta | 55 Trinity Ave SW, Atlanta, GA, 30303 | cache | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
Atlanta City Hall — FIPS 13121 ARS source cache · summary match-mailable Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 35 | ▸fips_boston | 1 City Hall Sq, Boston, MA, 02201 | athena | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
Boston City Hall — FIPS 25025 ARS source athena · summary match-mailable Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 36 | ▸fips_detroit | 2 Woodward Ave, Detroit, MI, 48226 | cache | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
Detroit City Hall — FIPS 26163 ARS source cache · summary match-mailable Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 37 | ▸fips_nashville | 1 Public Sq, Nashville, TN, 37201 | athena | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
Nashville Metro — FIPS 47037 ARS source athena · summary match-mailable Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 38 | ▸fips_nola | 1300 Perdido St, New Orleans, LA, 70112 | cache | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
New Orleans City Hall — FIPS 22071 ARS source cache · summary match-mailable Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 39 | ▸fips_portland | 1221 SW 4th Ave, Portland, OR, 97204 | cache | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
Portland City Hall — FIPS 41051 ARS source cache · summary match-mailable Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 40 | ▸fips_vegas | 495 S Main St, Las Vegas, NV, 89101 | cache | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
Las Vegas City Hall — FIPS 32003 ARS source cache · summary match-mailable Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 41 | ▸fips_saltlake | 451 S State St, Salt Lake City, UT, 84111 | athena | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
SLC City Hall — FIPS 49035 ARS source athena · summary match-mailable Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 42 | ▸fips_columbus | 90 W Broad St, Columbus, OH, 43215 | athena | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
Columbus City Hall — FIPS 39049 ARS source athena · summary match-mailable Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 43 | ▸dl_highrise_suite | 233 S Wacker Dr Ste 8400, Chicago, IL, 60606 | cache | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
Willis Tower high suite ARS source cache · summary match-mailable Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 44 | ▸dl_apt | 1 Astor Pl Apt 5B, New York, NY, 10003 | cache | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
Apartment unit — delivery_line_2 preservation ARS source cache · summary match-mailable Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 45 | ▸dl_hyphen_queens | 30-30 47th Ave, Long Island City, NY, 11101 | cache | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
Queens hyphenated house number '30-30' ARS source cache · summary match-mailable Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 46 | ▸dl_half | 123 1/2 Elm St, Dallas, TX, 75201 | cache | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASSweak DPV | |||||||||||||||||||||||
Fractional house number '123 1/2' ARS source cache · summary match-mailable Weak DPV. Passes on standardization, but Smarty's own DPV did not confirm a delivery point for this edge address form — the green means ARS and Smarty produced the same standardized string, not that the address is confirmed deliverable. Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 47 | ▸dl_ordinal | 1 W 72nd St, New York, NY, 10023 | cache | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
Ordinal street — Dakota Bldg ARS source cache · summary match-mailable Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 48 | ▸zip_missing_la | 200 N Spring St, Los Angeles, CA | athena | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
No ZIP → fill, FIPS 06037 ARS source athena · summary match-mailable · ZIP filled → 90012 Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 49 | ▸zip_missing_seattle | 600 4th Ave, Seattle, WA | athena | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
No ZIP → fill, FIPS 53033 ARS source athena · summary match-mailable · ZIP filled → 98104 Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 50 | ▸zip_wrong_atlanta | 55 Trinity Ave SW, Atlanta, GA, 10001 | cache | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
Wrong ZIP (NYC) → correct to 30303 ARS source cache · summary match-mailable · ZIP fixed 10001 → 30303 Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 51 | ▸zip_missing_boston | 1 City Hall Sq, Boston, MA | cache | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
No ZIP → fill, FIPS 25025 ARS source cache · summary match-mailable · ZIP filled → 02201 Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 52 | ▸zip_missing_denver | 1437 Bannock St, Denver, CO | athena | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
No ZIP → fill, FIPS 08031 ARS source athena · summary match-mailable · ZIP filled → 80202 Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 53 | ▸fips_ind_richmond | 900 E Broad St, Richmond, VA, 23219 | athena | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
Richmond City Hall — independent city FIPS 51760, NOT Henrico/Chesterfield ARS source athena · summary match-mailable Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 54 | ▸fips_ind_baltimore | 100 Holliday St, Baltimore, MD, 21202 | athena | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
Baltimore City Hall — independent city FIPS 24510, NOT Baltimore County 24005 ARS source athena · summary match-mailable Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 55 | ▸fips_ind_stlouis | 1200 Market St, Saint Louis, MO, 63103 | cache | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
St. Louis City Hall — independent city FIPS 29510, NOT St. Louis County 29189 ARS source cache · summary match-mailable Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 56 | ▸fips_ind_norfolk | 810 Union St, Norfolk, VA, 23510 | athena | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
Norfolk City Hall — independent city FIPS 51710 ARS source athena · summary match-mailable Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 57 | ▸fips_ind_alexandria | 301 King St, Alexandria, VA, 22314 | athena | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
Alexandria City Hall — independent city FIPS 51510 ARS source athena · summary match-mailable Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 58 | ▸zip_lead0_providence | 25 Dorrance St, Providence, RI, 02903 | athena | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
Providence City Hall — leading-zero ZIP, FIPS 44007 ARS source athena · summary match-mailable Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 59 | ▸zip_lead0_hartford | 550 Main St, Hartford, CT, 06103 | cache | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
Hartford City Hall — leading-zero ZIP, FIPS 09003 ARS source cache · summary match-mailable Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 60 | ▸zip_lead0_newark | 920 Broad St, Newark, NJ, 07102 | cache | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
Newark City Hall — leading-zero ZIP, FIPS 34013 ARS source cache · summary match-mailable Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 61 | ▸zip_lead0_portland_me | 389 Congress St, Portland, ME, 04101 | cache | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
Portland ME City Hall — leading-zero ZIP, FIPS 23005 ARS source cache · summary match-mailable Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 62 | ▸zip_lead0_manchester | 1 City Hall Plaza, Manchester, NH, 03101 | smarty | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
Manchester NH City Hall — leading-zero ZIP, FIPS 33011 ARS source smarty · summary match-mailable Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 63 | ▸fips_honolulu | 530 S King St, Honolulu, HI, 96813 | athena | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
Honolulu Hale — FIPS 15003 ARS source athena · summary match-mailable Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 64 | ▸fips_anchorage | 632 W 6th Ave, Anchorage, AK, 99501 | cache | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
Anchorage City Hall — FIPS 02020 ARS source cache · summary match-mailable Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 65 | ▸fips_sanjuan_pr | 171 Av Fernández Juncos, San Juan, PR, 00901 | smarty | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASSweak DPV | |||||||||||||||||||||||
San Juan PR — territory, urbanization-style addr, FIPS 72127 ARS source smarty · summary match-mailable Weak DPV. Passes on standardization, but Smarty's own DPV did not confirm a delivery point for this edge address form — the green means ARS and Smarty produced the same standardized string, not that the address is confirmed deliverable. Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 66 | ▸city_saint_paul | 15 Kellogg Blvd W, Saint Paul, MN, 55102 | athena | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
Saint Paul — 'Saint' vs 'St', FIPS 27123 ARS source athena · summary match-mailable Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 67 | ▸city_hyphen | 101 N Main St, Winston-Salem, NC, 27101 | athena | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
Winston-Salem — hyphenated city, FIPS 37067 ARS source athena · summary match-mailable Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 68 | ▸city_apostrophe | 710 E Mullan Ave, Coeur d'Alene, ID, 83814 | athena | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
Coeur d'Alene — apostrophe+space, FIPS 16055 ARS source athena · summary match-mailable Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 69 | ▸city_abbrev_input | 1600 Pennsylvania Ave NW, Washinton, DC, 20500 | cache | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
Misspelled city 'Washinton' → resolve to Washington ARS source cache · summary match-mailable Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 70 | ▸city_la_abbrev | 200 N Spring St, L A, CA, 90012 | athena | ✓unit-only | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
Malformed city 'L A' → Smarty mis-parses the 'L' as a secondary unit (# L) in delivery_line_1; ARS keeps the clean street line. The only divergence is that unit, and secondary units aren't scored, so this PASSES (delivery line badged unit-only). Same address with a clean 'Los Angeles' matches outright (see fips_la). ARS source athena · summary match-mailable Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 71 | ▸dl_grid_utah | 1300 E 1700 S, Salt Lake City, UT, 84105 | cache | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASSweak DPV | |||||||||||||||||||||||
Utah grid address '1300 E 1700 S' ARS source cache · summary match-mailable Weak DPV. Passes on standardization, but Smarty's own DPV did not confirm a delivery point for this edge address form — the green means ARS and Smarty produced the same standardized string, not that the address is confirmed deliverable. Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 72 | ▸dl_two_word_dir | 1120 NW Couch St, Portland, OR, 97209 | cache | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
Two-word directional 'NW' prefix ARS source cache · summary match-mailable Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 73 | ▸dl_dir_suffix | 100 Peachtree St NE, Atlanta, GA, 30303 | cache | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASSweak DPV | |||||||||||||||||||||||
Directional SUFFIX 'NE' after street type ARS source cache · summary match-mailable Weak DPV. Passes on standardization, but Smarty's own DPV did not confirm a delivery point for this edge address form — the green means ARS and Smarty produced the same standardized string, not that the address is confirmed deliverable. Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 74 | ▸dl_us_highway | 10001 US Highway 441, Leesburg, FL, 34788 | cache | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASSweak DPV | |||||||||||||||||||||||
US Highway street form ARS source cache · summary match-mailable Weak DPV. Passes on standardization, but Smarty's own DPV did not confirm a delivery point for this edge address form — the green means ARS and Smarty produced the same standardized string, not that the address is confirmed deliverable. Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 75 | ▸dl_numbered_st | 30 W 21st St, New York, NY, 10010 | athena | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
Numbered street '21st' ordinal parsing ARS source athena · summary match-mailable Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 76 | ▸dl_county_road | 5500 County Road 42, Savage, MN, 55378 | cache | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASSweak DPV | |||||||||||||||||||||||
County-road street form ARS source cache · summary match-mailable Weak DPV. Passes on standardization, but Smarty's own DPV did not confirm a delivery point for this edge address form — the green means ARS and Smarty produced the same standardized string, not that the address is confirmed deliverable. Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 77 | ▸zip_wrong_richmond | 900 E Broad St, Richmond, VA, 90001 | cache | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
Wrong ZIP (LA) on Richmond → correct to 23219 + FIPS 51760 ARS source cache · summary match-mailable · ZIP fixed 90001 → 23219 Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 78 | ▸zip_missing_honolulu | 530 S King St, Honolulu, HI | athena | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
No ZIP → fill, FIPS 15003 ARS source athena · summary match-mailable · ZIP filled → 96813 Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 79 | ▸zip_missing_stlouis | 1200 Market St, Saint Louis, MO | cache | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
No ZIP → fill, independent-city FIPS 29510 ARS source cache · summary match-mailable · ZIP filled → 63103 Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 80 | ▸zip_wrong_state_tx | 901 Bagby St, Houston, FL, 77002 | athena | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
Wrong STATE (FL not TX) w/ correct Houston ZIP → state correction ARS source athena · summary match-mailable Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 81 | ▸unit_apt_nyc | 8 Spruce St Apt 30A, New York, NY, 10038 | smarty | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
Condo tower 'Apt 30A' — unit preservation ARS source smarty · summary match-mailable Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 82 | ▸unit_hash | 330 W 38th St # 1105, New York, NY, 10018 | smarty | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
'#' unit designator ARS source smarty · summary match-mailable Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 83 | ▸unit_unit_chi | 201 W Grand Ave Unit 2103, Chicago, IL, 60654 | smarty | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
'Unit' designator high-rise ARS source smarty · summary match-mailable Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 84 | ▸unit_ste_office | 233 S Wacker Dr Ste 4200, Chicago, IL, 60606 | smarty | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
'Ste' office suite (Willis Tower) ARS source smarty · summary match-mailable Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 85 | ▸unit_fl_floor | 30 Rockefeller Plz Fl 65, New York, NY, 10112 | smarty | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
'Fl' floor designator ARS source smarty · summary match-mailable Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 86 | ▸unit_apt_miami | 100 Biscayne Blvd Apt 1408, Miami, FL, 33132 | smarty | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
Miami condo Apt — county_fips 12086 ARS source smarty · summary match-mailable Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 87 | ▸unit_apt_dtla | 1100 S Hope St Apt 2407, Los Angeles, CA, 90015 | smarty | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
DTLA condo high unit ARS source smarty · summary match-mailable Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 88 | ▸unit_mobile_lot | 8500 E Southern Ave Lot 120, Mesa, AZ, 85209 | smarty | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
Mobile-home 'Lot' designator ARS source smarty · summary match-mailable Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 89 | ▸unit_no_word | 20 Pine St 2210, New York, NY, 10005 | smarty | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
Unit number with NO designator word ARS source smarty · summary match-mailable Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
| 90 | ▸unit_denver | 1133 14th St Unit 3850, Denver, CO, 80202 | athena | ✓ | ✓ | ✓ | ✓ | ✓ | 100% | PASS | |||||||||||||||||||||||
High-rise residence 'Unit' designator ARS source athena · summary match-mailable Field-by-field · ARS vs Smarty (ground truth)
| |||||||||||||||||||||||||||||||||
Click any row to expand the field-by-field ARS-vs-Smarty detail. A green cell = the two agree; ✗ = they differ on that field.
Each address is scored on exactly five fields. A row PASSES only if all five match Smarty. Score = matched / 5.
| Scored field | Meaning |
|---|---|
| Delivery line | Standardized street line (delivery_line_1). Primary deliverability field. |
| City | USPS city name (city_name). |
| State | 2-letter state (state_abbreviation). |
| ZIP | 5-digit ZIP (zipcode, +4 normalized away). Corrected/filled where input was wrong/missing. |
| FIPS | 5-digit county FIPS (county_fips). Drives every geo join. |
plus4, rdi, precision, and dpv_match_code are NOT scored — out of scope for this Q&A.
The delivery line is scored on its primary street portion. A secondary-unit designator (#, Apt, Ste, Fl, Lot …) belongs to the unscored secondary line (delivery_line_2). So when ARS and Smarty differ only by such a unit — e.g. a malformed city like L A makes Smarty mis-parse the L as # L while ARS keeps the clean street — the row still PASSES and the delivery-line cell is badged ✓unit-only. ARS holding the clean street line is correct; it is not held against it.
For garbage / foreign inputs, when ARS returns no-match AND Smarty has no confirmed delivery point (DPV unconfirmed), both agree the address is undeliverable. Such rows count as PASS and are badged PASS · NM — Smarty echoing the parsed input back is not held against ARS.
Each card: the raw input, ARS's standardization, and Smarty's. Red = the two disagree on a scored field.
What this is. Every synthetic address is resolved by ARS (as-is) and by Smarty directly. Smarty is treated as ground truth.
How to read a row. Five cells = the five scored fields. Green ✓ means ARS equals Smarty on that field; red ✗ means they differ. Score is matched-of-five; a row passes only at 5/5.
Src. How ARS resolved it — cache / athena are 8020's own data (the real test), smarty is passthrough.
Click a row to see the exact ARS and Smarty values side by side.