GAIA Agent Evaluation Runner
Instructions:
Log in to your Hugging Face account using the button below. This uses your HF username for submission.
- Click 'Get All Questions' to fetch questions
- Click 'Run All Questions' to run the GAIA agent and view agent's answers
- If you are not satisfied with the agent's answer on a single question, input the question's task ID in the text box and click 'Run A Single Question'
- Click 'Restart Agent' if you wish to restart your agent. Previous answers will be saved.
- Click 'Submit All Answers' to submit all your answers for evaluation and see the score
Note: The 'Run All Questions' button can take several minutes to run, as it runs each question in async.
Questions and Agent Answers