Designed, not yet run
Project Mosaic
A diverse-data video benchmark designed so that no single creator, domain or capture style can quietly dominate it.
- 16 content strata
- Content strata in the diversity taxonomyThe taxonomy is versioned in code, not prose. The client's floor was twelve.
Benchmarks skew. One prolific uploader, one content genre or one camera style ends up over- represented, and a model that happens to suit it scores well for reasons nobody intended.
Mosaic answers that with thresholds fixed in the design rather than left to judgement at ingest. One video per creator. No content domain above roughly fifteen percent of total hours. At least twelve distinct domains. At least eighty-five percent dynamic content rather than static scenes. The design specifies these as gates meant to refuse a non-conforming corpus outright; Mosaic has not been run, so no corpus has been checked against them yet.
The construction method matches Vista: the open-ended answer is locked first, the multiple- choice options are generated afterwards, and two independent blind reviews plus adjudication sit behind every item. Provenance - provider, creator, domain, licence - is recorded when material enters, not reconstructed later.
The work
What the project covers
- Diversity constraints specified as gates meant to reject a non-conforming corpus, rather than as guidance.
- A versioned taxonomy of content strata and capture types, referenced by identifier rather than by prose description.
- Provenance recorded at ingest - provider, creator, domain and licence.