All videos

Video briefing

Model selection for AI consultancies: measure your client's tasks, not the leaderboard

Public leaderboards cannot choose a model for your client, and a one-shot demo repeats their mistake. We are piloting a service that runs your client's real tasks through candidate models with repeated trials and error bars, then breaks ties on cost. 2:30

Public leaderboards cannot choose a model for your client, and a one-shot demo repeats their mistake. We are piloting a service that runs your client's real tasks through candidate models with repeated trials and error bars, then breaks ties on cost.

Produced by TerraNet Technologies from the cited evidence behind the written article. Facts can change after the recorded date.