Publish the evidence, not the claim
A model card without a runnable harness is marketing. If we cannot reproduce a number, we delete the number.
ModelFoundry is a small collective of engineers and researchers who got tired of downloading checkpoints whose provenance nobody could state. The project maintains a catalogue of open-weight models, the tooling to verify them, an evaluation harness that ships beside every release, and a compact runtime for serving them.
We are not a research lab and we do not compete with the labs. We care about the layer between a checkpoint and the machine it runs on: hashing, licensing, quantization quality, latency and the boring question of who is allowed to pull what.
A model card without a runnable harness is marketing. If we cannot reproduce a number, we delete the number.
Long-context decay, quantization trade-offs, refusal behaviour, language parity. Limitations belong in the card, not in a footnote.
Keys instead of public links. It is less convenient and it is the only design that survives a takedown.
Time to first token, cache hit rate, digest mismatches, failed verification runs. These are the numbers that decide whether anyone can actually run this.
Six people carry the pager rotation; sixty-two more contribute models, tasks and fixes.
Schedulers, quantization promotion gates and the p99 work. Writes about latency more than is healthy.
Pre-training recipes and distillation for the small families. Maintains the bilingual sampling mix.
Owns the harness, the judge models and the rule that a suite version changes whenever a prompt changes.
Mirror operations, storage and the boring work of making a static site survive a traffic spike.
The verification pipeline, signed manifests and the gate that a build must pass before it gets a page.
Keeps the docs, the examples and the license texts honest with what the tools actually do.
Anything touching weights, licenses or the verification pipeline needs two maintainers. Anything touching documentation needs one. A change that cannot be explained in a single paragraph in the changelog does not ship.
| Channel | Use it for |
|---|---|
| Community chat | Model requests, eval questions, "is this normal?" |
| Issue tracker | Bugs with a reproduction, conversion and verification PRs |
| Security contact | Responsible disclosure, see the policy |
The mirror itself is static, so there is no support form. Anything you type into a page on this domain stays in your browser.