2 findingsStatic scanned
Flair Bench
tpsdev-ai · App
Flair Bench is a standalone benchmark for the embedding models behind flair's local semantic memory search. It runs a fixed corpus of 251 synthetic records and 126 hand-written queries against any GGUF embedding model and reports precision at 3 and MRR, with timing, memory and load figures. You can batch-compare several models, get a recommendation based on a fingerprint of your hardware, and save a redacted result to share. It does not need flair installed, but it downloads no models, so you supply the GGUF files.
Written by ooruby from the README of @tpsdev-ai/flair-bench 0.58.0.
Not claimed by its maker. Is this yours? Prove it and answer the findings
Why it's useful
You can check whether a different embedding model would recall better on your hardware before you switch.
What you could do with it
- Run a GGUF embedding model against the test corpus to get precision at 3 and MRR on your own hardware.
- Pass several model files or a list of paths to compare them in one ranked table.
- Label each run with a host or infrastructure tag to compare one model across different machines.
Written from its documentation: what it says it can do, not what our checks found.
Maintenance
Not measuredNo release date is on record for this package yet. The nightly publisher check records one as it reaches each npm package, about once every ten nights.
Release activity only: it says nothing about quality or safety, and a finished small package can be fine without releases. How it is measured
What this does not cover
- Everything. Treat it as you would software from anywhere else.
Receipt history: every signed receipt for every version of this listing, and what changed between them.
In its maker's words
Standalone embedding recall benchmark for flair — run real recall numbers (p@3/MRR) against any GGUF embedding model, batch-compare, get a host-aware recommendation, and share redacted results. No flair install required.
Compare with
Compare all 4How far this has been checked
Static scanned
- What it establishes
- Its published package, or for a hosted server its source repository at a recorded commit, was read file by file, without running it, by every check in our current scan.
- What it does not
- How it behaves when it runs, or anything the scan does not read yet: several rubric checks, the repository's history, and compiled code in folders named dist or build. For a hosted server, that the endpoint runs the code that was read. The ooruby Index sets out exactly what was read.
- Exactly what was read
- Version 0.58.0, the file with digest sha512-geTzggYVyxDhhFu1ykXqsbJLDX8NojDnAFtWfuSF3gI8LQUgBDkAX72uKjvJIvKk9edvWg0KkVKMBl0Dskh3XQ==, as the registry publishes it. A published version cannot be replaced, so this names the same bytes for anyone who checks.
- Authentication
- Runs locally. No hosted endpoint is listed for this package. You run it on your own machine, so there is no endpoint of ours to authenticate against.
Adding it
Run it with:
npx -y @tpsdev-ai/flair-bench@0.58.0Pinned to 0.58.0, which is the version the findings above were found in. Drop the version to take whatever is newest, and the report on this page stops describing what you installed.
Where this came from
- Registry
- npm
- Package
- @tpsdev-ai/flair-bench
- Version read
- 0.58.0
- Resolved
- 2026-10-10
Built from source, attested
npm publishes a signed statement that this exact package was built from the repository below, at this commit. It is verifiable without taking our word for it.
- Repository
- github.com/tpsdev-ai/flair
- Commit
- 2bec5cd8af17
- Built by
- github.com/actions/runner/github-hosted
- Registry publish attestation
- signed by npm · 2026-10-10
- Checked
- 2026-10-10
The badge, if this is your listing
It renders the current rung (static scanned) and links back here, where what that does and does not establish is one click away. It updates itself as the evidence deepens.
[](https://ooruby.com/market/tpsdev-ai-flair-bench)About this listing
- Kind
- App
- Category
- Developer tools
- Pricing
- Free
- Sandbox
- No
- Hosted
- No
- Updated
- 2026-10-09
More from tpsdev-ai
See the storefrontSimilar apps
All apps4 findingsStatic scanned
Puts Claude in your terminal to understand your codebase, edit files and handle git workflows.
80.2M installs/moSEE LICENSE IN README.md
2 findingsStatic scanned
Gives your app one API for streaming from many AI model providers, with typed and validated tools.
14.6M installs/moMIT
1 findingStatic scanned
Estimates how many tokens a text will use without loading a full tokeniser, from code or the shell.
5.8M installs/moMIT
Verification records what our published tests found on a specific version at a specific date. It is not a warranty, and it does not certify that software is free of defects.