Qdrant
Open-source vector search engine, managed in Qdrant Cloud.
Overall score
69.5/100
qdrant-cloud-rest
Measured Oct 5, 2026
Status
Ranked
Complete benchmark. `overall` is a weighted average of the applicable criteria, comparable to other surfaces in the same category and the same rubric version.
Coverage
88% of the rubric
Surfaces
evaluated.
We score a surface, not a product. One product often exposes several, and they are not worth the same.
qdrant-cloud-restrestprimary
88% coverage
69.5/100
Criterion
by criterion.
Measured on qdrant-cloud-rest, rubric v0.2.0. A criterion with no score is not counted as zero: it is excluded and the weights are renormalised.
Offload Valuejudged · weight 15 · Oct 5, 2026
84/100
Qdrant performs approximate nearest-neighbor vector search, filtering, faceting and distance-matrix computation over potentially millions of stored vectors inference cannot replicate scanning a corpus in-context. This is genuine heavy computation and proprietary-data retrieval offload, plus indexing and clustering operations. It falls short of 90+ because it has no real-world side effect (no funds, signing, compliance) and the core value is retrieval over data the user supplied; much of the documented API surface (collections, upsert, payload set/delete, snapshots) is storage CRUD, and embeddings must be produced elsewhere.
- https://api.qdrant.tech/api-reference
Qdrant is a vector database and a semantic search engine. You can use its REST API to develop a production-ready service to store, search, and manage vectors with an additional payload.
- https://api.qdrant.tech/api-reference
Qdrant is a vector database and a semantic search engine. You can use its REST API to develop a production-ready service to store, search, and manage vectors with an additional payload.
- https://api.qdrant.tech/api-reference
Qdrant is a vector database and a semantic search engine. You can use its REST API to develop a production-ready service to store, search, and manage vectors with an additional payload.
Interaction Costmeasured · weight 15 · Oct 5, 2026
100/100
Median over 2 successful run(s): 8648 tokens, 3 calls. Ratio to the best in "vector-database" (3 surfaces measured, v0.2 scale). Cold, without documentation: 1/1 succeeded.
Error Recoverabilityprobed · weight 15 · Oct 5, 2026
36/100
unknown_endpoint → HTTP 404, clarity 55/100 (field named: yes, allowed values: no, RFC 9457: no) · wrong_type → HTTP 400, clarity 30/100 (field named: no, allowed values: no, RFC 9457: no) · hallucinated_enum → HTTP 400, clarity 30/100 (field named: no, allowed values: no, RFC 9457: no) · unknown_field → HTTP 409, clarity 30/100 (field named: no, allowed values: no, RFC 9457: no)
- https://cf4f7162-4c5e-457f-9b83-952931f3f9a2.eu-west-1-0.aws.cloud.qdrant.io/collections
HTTP 403: {"error":"forbidden"}
- https://cf4f7162-4c5e-457f-9b83-952931f3f9a2.eu-west-1-0.aws.cloud.qdrant.io/collections/nonexistent_resource_xyz
HTTP 404: {"status":{"error":"Not found: Collection `nonexistent_resource_xyz` doesn't exist!"},"time":6.359e-6}
- https://cf4f7162-4c5e-457f-9b83-952931f3f9a2.eu-west-1-0.aws.cloud.qdrant.io/collections/agentscoreprobe
HTTP 400: {"status":{"error":"Format error in JSON body: data did not match any variant of untagged enum VectorsConfig at line 1 column 47"},"time":0.0}
- https://cf4f7162-4c5e-457f-9b83-952931f3f9a2.eu-west-1-0.aws.cloud.qdrant.io/collections/agentscoreprobe
HTTP 400: {"status":{"error":"Format error in JSON body: data did not match any variant of untagged enum VectorsConfig at line 1 column 43"},"time":0.0}
Doc Legibilitymeasured · weight 12 · Oct 5, 2026
17/100
text/markup ratio 2.8% (weight 30) · rendering without JavaScript undetermined (excluded from the calculation) (weight 25) · machine-readable spec: none found (weight 25) · llms.txt: https://api.qdrant.tech/llms.txt (weight 10) · 0 runnable example(s) (weight 10). Weighted average over 75 points of available sub-criteria.
Auth Frictionmeasured · weight 10 · Oct 5, 2026
90/100
Dedicated api-key header, verified by a successful call. Slightly below Bearer: the header name has to be read in the documentation.
- https://cf4f7162-4c5e-457f-9b83-952931f3f9a2.eu-west-1-0.aws.cloud.qdrant.io/collections
HTTP 403: {"error":"forbidden"}
- https://cf4f7162-4c5e-457f-9b83-952931f3f9a2.eu-west-1-0.aws.cloud.qdrant.io/collections/nonexistent_resource_xyz
HTTP 404: {"status":{"error":"Not found: Collection `nonexistent_resource_xyz` doesn't exist!"},"time":6.359e-6}
- https://cf4f7162-4c5e-457f-9b83-952931f3f9a2.eu-west-1-0.aws.cloud.qdrant.io/collections/agentscoreprobe
HTTP 400: {"status":{"error":"Format error in JSON body: data did not match any variant of untagged enum VectorsConfig at line 1 column 47"},"time":0.0}
- https://cf4f7162-4c5e-457f-9b83-952931f3f9a2.eu-west-1-0.aws.cloud.qdrant.io/collections/agentscoreprobe
HTTP 400: {"status":{"error":"Format error in JSON body: data did not match any variant of untagged enum VectorsConfig at line 1 column 43"},"time":0.0}
Safety & Reversibilityprobed · weight 10
—/100
If I retry after a timeout, do I charge the customer twice?
Payload Efficiencyprobed · weight 8 · Oct 5, 2026
52/100
Field selection via ?fields=: 85 → 59 bytes. (weight 35) · No cursor pagination marker in the response. (weight 20) · Nested envelope or non-list shape. (weight 10) · No ETag. (Compression is not measurable: the runtime decompresses it and strips the header.) (weight 10). Weighted average over 75 points of measured sub-criteria.
- https://cf4f7162-4c5e-457f-9b83-952931f3f9a2.eu-west-1-0.aws.cloud.qdrant.io/collections
HTTP 403: {"error":"forbidden"}
- https://cf4f7162-4c5e-457f-9b83-952931f3f9a2.eu-west-1-0.aws.cloud.qdrant.io/collections/nonexistent_resource_xyz
HTTP 404: {"status":{"error":"Not found: Collection `nonexistent_resource_xyz` doesn't exist!"},"time":6.359e-6}
- https://cf4f7162-4c5e-457f-9b83-952931f3f9a2.eu-west-1-0.aws.cloud.qdrant.io/collections/agentscoreprobe
HTTP 400: {"status":{"error":"Format error in JSON body: data did not match any variant of untagged enum VectorsConfig at line 1 column 47"},"time":0.0}
- https://cf4f7162-4c5e-457f-9b83-952931f3f9a2.eu-west-1-0.aws.cloud.qdrant.io/collections/agentscoreprobe
HTTP 400: {"status":{"error":"Format error in JSON body: data did not match any variant of untagged enum VectorsConfig at line 1 column 43"},"time":0.0}
Task Atomicitymeasured · weight 6 · Oct 5, 2026
100/100
Median over 2 successful run(s): 8648 tokens, 3 calls. Ratio to the best in "vector-database" (3 surfaces measured, v0.2 scale). Cold, without documentation: 1/1 succeeded.
Prior Knowledge Coveragemeasured · weight 5 · Oct 5, 2026
100/100
Median over 2 successful run(s): 8648 tokens, 3 calls. Ratio to the best in "vector-database" (3 surfaces measured, v0.2 scale). Cold, without documentation: 1/1 succeeded.
Async Compatibilityprobed · weight 2
—/100
If the operation is asynchronous, can I get the result without hosting a web server?
Tool-Native (MCP)binary · weight 2 · Oct 5, 2026
100/100
MCP server reachable at https://api.qdrant.tech/mcp ("fern-docs-mcp-server"), answering a JSON-RPC handshake. To be confirmed manually as the official server before final publication.
Runs, verified
never on the agent’s word.
Every row is a real attempt at the category’s canonical task. Success is verified by reading the created resource back.
| Task | Tokens | Calls | Errors | Docs | Result |
|---|---|---|---|---|---|
| index-and-query-vectors | 8,178 | 3 | 0 | without | verified |
| index-and-query-vectors | 8,659 | 3 | 0 | with | verified |
| index-and-query-vectors | 8,637 | 3 | 0 | with | verified |
The same entry,
without the markup.
You publish this API and dispute a score? The methodology is public and every score above points to the evidence that produced it.