GAIA Agent Evaluation Runner

Instructions:

Log in to your Hugging Face account using the button below. This uses your HF username for submission.

  • Click 'Get All Questions' to fetch questions
  • Click 'Run All Questions' to run the GAIA agent and view agent's answers
  • If you are not satisfied with the agent's answer on a single question, input the question's task ID in the text box and click 'Run A Single Question'
  • Click 'Restart Agent' if you wish to restart your agent. Previous answers will be saved.
  • Click 'Submit All Answers' to submit all your answers for evaluation and see the score

Note: The 'Run All Questions' button can take several minutes to run, as it runs each question in async.

Questions and Agent Answers

Questions and Agent Answers