Hi,
I am running a MCP-atlas evaluation with the dataset from huggingface: https://huggingface.co/datasets/ScaleAI/MCP-Atlas/tree/main
I found that for task 689bd255c0422b257e7dfcda， the task is asking for converstion on June 27, 2025.
""
Who is the first user that sent a message in my gaming discussion, the 27 June 2025? I want you to give me the total number of messages he sent that day, and multiply that number by the year the messages were sent.""
However, for slack_mcp_eval_export, the data is on Dec 2025 , related commit : b268104
Is the task data out of date? Thanks for any information !
lastest
preivous version
Hi,
I am running a MCP-atlas evaluation with the dataset from huggingface: https://huggingface.co/datasets/ScaleAI/MCP-Atlas/tree/main
I found that for task 689bd255c0422b257e7dfcda， the task is asking for converstion on June 27, 2025.
""
Who is the first user that sent a message in my gaming discussion, the 27 June 2025? I want you to give me the total number of messages he sent that day, and multiply that number by the year the messages were sent.""
However, for slack_mcp_eval_export, the data is on Dec 2025 , related commit : b268104
Is the task data out of date? Thanks for any information !
lastest
preivous version