User Acceptance Testing (UAT) Status
This page provides an externally-facing summary of the current status of reported issues with the forthcoming 2025 annual dataset validation activities in STAGING as well as API/UI issues in both STAGING and PRODUCTION environments. The intended audience of this page are the members of the GEOPATH ANNUAL DATASET WORKING GROUP who are participating in User Acceptance Testing (UAT) activities.
UAT group: Please send all ‘new’ bugs to geekout@geopath.org, along with expected results, actual results, steps to reproduce, environment/URLs used, and additional business context.
PLEASE NOTE:
All market plans have a 1500 spot ‘cap’; Geopath cannot support market plans that exceed 1,500 spots
All inventory plans have a 15,000 spot ‘cap’; Geopath cannot support inventory plans over 15,000 spots
All spot-level CSV exports from the ‘Explore’ table view in the Insights Suite are limited to 15,000 spots
Summaries of changes in each API release can be seen on the Version 2.2 Release Notes page
Announcements (environment-wide updates):
Latest API release (2.2.13.5) deployed to STAGING at 11pm ET on Tuesday, 9/23/25
Latest API release (2.2.13.5) deployed to PRODUCTION at 8pm ET on Wednesday, 9/24/25
Latest 2025 dataset update deployed to STAGING at 8pm ET on Thursday, 9/4/25
Latest 2025 dataset update deployed to PRODUCTION at 12am ET on Friday, 9/12/25
Final 2024 dataset update released to PRODUCTION at 8pm ET on Friday, 4/11/25
Latest UI enhancements deployed to STAGING at 9am ET on Tuesday, 7/8/25
Latest UI enhancements deployed to PRODUCTION at 12am ET on Saturday, 9/13/25
Reported issues for 20250501 Annual Dataset in STAGING and API/UI in STAGING or PRODUCTION:
Summary of Issue Observed | Status and Root Cause Summary | Next Step for UAT group (in STAGING) |
|---|---|---|
Market Plan results for counts of spots that don’t match ‘interpolation points’ may show inaccurate, R/F, TRPs and in-market impressions (GPPIS-6027) | API aggregation logic (specifically for market plan) persists an average frequency value across all spot counts between interpolation points rather than dynamically computing average frequency between interpolation points | ISSUE RESOLVED; VERIFIED OK |
Market Plans that use more than 20 unique media type groups will fail (GPPIS-5969) | Works as designed; API logic constraint is enforced due to performance limitations. Geopath will consider enhancing later. | WORK AROUND THE ISSUE WITH SMALLER MARKET PLANS AND RE-TEST (Geopath may enhance logic in 2H25+) |
Some place-based spots may show missing or incorrect reach/frequency & impression estimates using the latest annual dataset | Underlying audience measurement data for a handful of places was aggregated incorrectly or absent from the initial data processing scope; Geopath has reprocessed and validated place-based outputs in the latest annual dataset | ISSUE RESOLVED; VERIFIED OK |
Known issues for 20250501 Annual Dataset in STAGING and API/UI in STAGING or PRODUCTION:
Summary of Issue Observed | Status and Root Cause Summary | Next Step for UAT group (in STAGING) |
|---|---|---|
Generating Inventory Plans using roadside inventory and another media class (place-based or scheduled fleet) on the 2025 dataset may show plan-level R/F metrics that only pertain to roadside inventory and not all media (GPPIS-6071) | Preexisting aggregation logic for 2025 dataset and new R/F model did not sum all media class reach as expected. | ISSUE RESOLVED IN STAGING; VERIFIED OK |
Retrieving data from the API using the 2023 dataset will return audience measures from the 2023 dataset but inventory metadata from the 20240301 dataset (GPPIS-6072) | Reconfiguration addressed issue during 9/24/2025 PRODUCTION deployment; 2023 dataset is now retired as of 10/1/2025. | ISSUE RESOLVED IN STAGING; VERIFIED OK |
Retrieving some large inventory plans or inventory aggregations may not return data for some markets (GPPIS-6070, GPPIS-6040) | Under investigation by Geopath API team (NO ETA AVAILABLE YET) | Report any observed misalignments to Geopath (this symptom does not occur in all situations) |
Nationwide R/F estimates are not always aligned across all API endpoints (GPPIS-5886) | Under investigation by Geopath API team | NO ACTION REQUIRED YET (STILL UNDER INVESTIGATION) |
Requesting single-spot audience measures using multi-spot aggregation endpoints delivers incorrect R/F values (GPPIS-6032) | Under investigation by Geopath API team | ISSUE RESOLVED IN STAGING; VERIFIED OK |
Aggregations of roadside spots using multiple counties as target geographies may not display correct reach/frequency values in the API/UI (GPPIS-6028) | Reach/frequency model improvements appear to work as designed at DMA and CBSA level, but API aggregation logic for counties requires updating | ISSUE RESOLVED IN STAGING; VERIFIED OK |
Aggregating digital roadside spots on the same frame will not show aggregate reach values exceeding one spot on that frame (GPDIA-1552) | Known issue in roadside R/F model design; will enhance and address with a supplemental release prior to production launch of 2025 dataset | ISSUE RESOLVED IN STAGING; VERIFIED OK |
Summarizing aggregations of spots by more than DMA and Account criteria will return an error (GPPIS-6036) | Certain metadata necessary for summarization logic was not available | ISSUE RESOLVED IN STAGING; VERIFIED OK |
Some Market Plans using multiple media type groups may show incorrect aggregate reach estimates when multiple media classifications are used (GPPIS-5971) | API logic for complex market plans requires further improvements | NO ACTION REQUIRED YET; UAT USERS ARE ENCOURAGED TO RUN SIMPLIFIED MARKET PLANS AS A WORKAROUND |
Market Plans using multiple media type groups show incorrect aggregate reach estimates when users manually specify counts of spots for each media type group (GPPIS-5968) | API logic for complex market plans requires further improvements | NO ACTION REQUIRED YET; UAT USERS ARE ENCOURAGED TO RUN SIMPLIFIED MARKET PLANS AS A WORKAROUND |
Market Plans using multiple operators/divisions in a single media type group show inconsistent results between operator/division-level reach and media type group reach (GPPIS-5967) | API logic for complex market plans requires further improvements | ISSUE RESOLVED IN STAGING; VERIFIED OK |
Market Plans using multiple media type groups will declare that the goal cannot be met when only one of the media type groups cannot meet the goal (GPPIS-5952) | API logic for complex market plans requires further improvements | WORKS AS DESIGNED (each media type group is provisioned an even ‘fraction’ of the declared goal by default; users can override the count of spots to be used in each media type group; Geopath will consider as a long-term enhancement later in 2H25+); UAT USERS ARE ENCOURAGED TO RUN SIMPLIFIED MARKET PLANS AS A WORKAROUND |
Some Market Plans may not allow users to add all available spots when using both multiple audience geographies and multiple inventory location geographies (GPPIS-5974) | API logic for complex market plans requires further improvements | WORKS AS DESIGNED (all spots used in market plan outputs must have nonzero contributions from each of the selected target geographies; will consider long-term enhancement later in 2H25+); UAT USERS ARE ENCOURAGED TO RUN SIMPLIFIED MARKET PLANS AS A WORKAROUND |
Market Plans using Transit Shelter inventory in certain markets may show reach estimates that exceed the population of the selected market | Root cause is under investigation (R/F model parameters and configuration appear correct, but average frequency values appear to be very small) | ISSUE RESOLVED IN STAGING; VERIFIED OK |
'ZCTA' prefix shown for 'top contributing postal codes' area of the spot summary screen in UI (GIS-487) | API serves ZIP-level home origin data with a ZCTA prefix for 2025 data product, which was not initially handled in the UI | ISSUE RESOLVED IN STAGING; VERIFIED OK |
Inventory Plans using more than 3000 spots and specific start & end dates will always return audience measures representing 7 day periods | UI logic passes incorrect parameters into Geopath API when specific dates are used for more than 3000 spots (because 3000 spots is the maximum number of spots supported by the inventory/measures/summary endpoint, so the UI must switch to using the inventory/search/summary endpoint and pass a count of days as an input when 3001+ spots are used) | ISSUE RESOLVED IN STAGING; VERIFIED OK |
“Opportunity Overview” section of the Inventory Detail Plan screen shows ‘N/A’ for any spot in the latest annual dataset | Only the 4 ‘core’ target audiences of P0+, P5+, P18+, P21+ are currently testable; additional data production will occur for all 700+ possible target audiences after integration of final Bentley data patch | ISSUE RESOLVED IN STAGING; VERIFIED OK |
Some inventory units do not show thumbnail images as expected (GPPIS-5986) | Content delivery network (CDN) infrastructure may not render certain images at certain dimensions | ISSUE RESOLVED IN STAGING; VERIFIED OK |
Some named search requests may generate malformed JSON outputs (GPPIS-5951) | JSON output rendering defects may occur in rare cases when accessing specific inventory metadata for some queries | ISSUE RESOLVED IN STAGING; VERIFIED OK |