NVIDIA releases SkillEvaluator for AI agent skills
First seen Nov 15 Updated Nov 15, 23:41 UTC Heat 26 medium evidence
NVIDIA published SkillEvaluator, a Python framework for evaluating AI agent skills. It runs quality gates, detects semantic overlap, generates synthetic evaluation datasets and runs live agent evaluations comparing runs with and without a skill. It is part of the NVIDIA Verified Skills pipeline.
- What to do
- Run pip install skillevaluator and validate a skill with --tiers 1.
- Who should care
- Developers who write or maintain agent skills in the Agent Skills format.
Why it matters: Developers can run Apache-2.0 quality checks on agent skills locally without an API key and add them to pull request CI.
Key facts
- License
- Apache-2.0
- Tier 1 checks need no API key
- skillevaluator validate ./my-skill --tiers 1
Timeline
Coverage
Evidence
Medium evidence: several community reports point the same way, but there is no official confirmation yet.
Details written Nov 15, 17:42 UTC from the sources listed above.