Evaluation8 min read
Evaluating an AI system beyond accuracy
A single percentage does not tell you whether the system works. It tells you how often it is right on average — which is precisely the figure that hides the problems that matter.
Read onBlog
Articles about how these systems work, how they are evaluated, what obligations they bring and where they fail. No unsourced figures and no promises nobody can check.
2 articles
A single percentage does not tell you whether the system works. It tells you how often it is right on average — which is precisely the figure that hides the problems that matter.
Read onGenerated data solves real problems of privacy and volume. It also, sometimes, solves the problem of getting good evaluation results without having a good system.
Read onEditorial note: Articles on this blog explain mechanisms and methods. They do not describe the association's projects and contain no figures or studies we cannot point to. The field moves quickly — the publication date matters.