OpenAPI Conformance

Loading…

Each case is an OpenAPI document that is either valid or breaks exactly one rule of the specification. Every tool is run against every case and judged on one question: did it call the document valid or invalid, and was it right? Schema cases are decided by the official JSON Schema; semantic cases break a rule only the spec's prose states (unique operationIds, path parameters that match the template, $refs that resolve, security requirements that name a declared scheme), which a schema cannot catch. Linters are judged on their error-severity results only, so a style warning never fails a valid document.

Cases come from the OAI's own schema tests (Apache-2.0) and from API Evangelist's suite. Source, cases and the runner: api-evangelist/openapi-conformance.

Scores by tool

Every case

✓ right verdict · ✗ wrong verdict · — tool declined the document's OpenAPI version · ! tool crashed or could not fetch an external $ref. Hover a cell for the tool's output.