It's been a few months since this issue was raised with no updates, and the broken code link on the project website still redirects to the GitHub homepage. Given how critical the evaluation framework is for testing the Memory-Agent-Environment loop described in the paper, waiting is no longer a viable option.
I have decided to stop waiting and am currently building a lightweight, open-source evaluation harness from scratch, utilizing the multi-session dataset provided on Hugging Face. My goal is to create a clean, executable pipeline to properly benchmark structured memory mechanisms (specifically dynamic task-tree routing) against these interdependent tasks.
If anyone else is blocked by this missing code and is interested in collaborating, or if you want a reliable pipeline to test your own agentic memory architectures on the MemoryArena dataset, feel free to reach out. I will share the repository link here once the core evaluation loop is stable.
It's been a few months since this issue was raised with no updates, and the broken code link on the project website still redirects to the GitHub homepage. Given how critical the evaluation framework is for testing the Memory-Agent-Environment loop described in the paper, waiting is no longer a viable option.
I have decided to stop waiting and am currently building a lightweight, open-source evaluation harness from scratch, utilizing the multi-session dataset provided on Hugging Face. My goal is to create a clean, executable pipeline to properly benchmark structured memory mechanisms (specifically dynamic task-tree routing) against these interdependent tasks.
If anyone else is blocked by this missing code and is interested in collaborating, or if you want a reliable pipeline to test your own agentic memory architectures on the MemoryArena dataset, feel free to reach out. I will share the repository link here once the core evaluation loop is stable.