R/F Taskforce Meeting 20220927

Agenda

• Status update on testing and models

  • Model 2 is now in the QA environment

    • Model v2 is performing very well and has an RSME of 4.9 for all user test packages from the insights suite. This is compared to 18.2 for production and 8.2 for staging (v0). The lower the RSME the better.

• Use case examples and comparisons

  • Comparing Production, Staging, and QA Reach %s

• Documentation Update

  • Geopath to refine further, then will utilize sub-group for approval before seeking approval from larger group

    • Reach & Frequency: Coverage and Duplication

    • Reach & Frequency One-Pager: Package-Level Metrics

    • Reach & Frequency: What Has Changed and Why it Matters

Overall Model Comparison

Open

Production vs Observed (DMA, CBSA, CNTY) RSME = 18.2

Open

Staging vs Observed (DMA, CBSA, CNTY) RSME = 8.2

Open

QA vs Observed (DMA, CBSA, CNTY) RSME = 4.9

Test Case Comparisons

Example 1

Chicago DMA, Persons 18+, 4 weeks

Open

Example 2

Washington DC DMA, Persons 21+, 2 weeks

Open

Example 3

Chicago CBSA, Persons 18+, 4 weeks

Open

Example 4

Los Angeles DMA, Persons 18+, 4 weeks

Open

Example 5

Atlanta DMA, Males 25-54, 4 weeks

Open