基于真实用户任务构建 agent 可用性 eval 的需求

来源证据

Oqoqo 联合创始人表示，现有基准不能帮助产品构建者评估其产品如何被 AI 代理发现和使用，且大多存在于策划环境中，难以迁移到真实世界。

Hey Product Hunters, I’m Haritha, co-founder of Oqoqo Every week there is a new model launch and yet another benchmark released in the wild. But they do not help product builders evaluate how well their products can be discovered and used by these agents and models, or talk about actual tasks their users would perform. Most benchmarks today exist in curated environments and do not translate well to the real world. We built Oqoqo to bridge this gap. Oqoqo makes it super simple to build realistic