Shijie Xia (夏世杰)

Ph.D. student in Computer Science

shijiexia [AT] sjtu.edu.cn

Github | Twitter | Google Scholar

“If I were given one hour to save the planet, I would spend 59 minutes defining the problem and one minute resolving it.” — Albert Einstein

News

  • [2024.12] ReasonEval is accepted to AAAI 2025 as an oral presentation!
  • [2024.06] I have obtained the B.Eng. degree from Fudan University, with a GPA ranked 1/21 in my major!


    • Bio

    Shijie is a Ph.D. student at Shanghai Jiao Tong University, advised by Prof. Pengfei Liu. Prior to that, he received the B.Eng. degree in intelligence science from Fudan University in 2024. He worked as a research intern in Shanghai AI Laboratory from 2023 to 2024.

    Publications

    Evaluating Mathematical Reasoning Beyond Accuracy

    Shijie Xia, Xuefeng Li, Yixin Liu, Tongshuang Wu, Pengfei Liu

    AAAI 2025 oral presentation

    Paper Code

    Summary: We propose ReasonEval, a suite comprising a new evaluation methodology with defined metrics for assessing mathematical reasoning quality and corresponding LLM-based evaluators for automated calculation.

    (※ indicates equal contribution)

    Evaluating Mathematical Reasoning Beyond Accuracy

    Shijie Xia, Xuefeng Li, Yixin Liu, Tongshuang Wu, Pengfei Liu

    AAAI 2025 oral presentation

    Paper Code

    Summary: We propose ReasonEval, a suite comprising a new evaluation methodology with defined metrics for assessing mathematical reasoning quality and corresponding LLM-based evaluators for automated calculation.

    O1 Replication Journey--Part 2: Surpassing O1-preview through Simple Distillation, Big Progress or Bitter Lesson?

    Zhen Huang※, Haoyang Zou※, Xuefeng Li※, Yixiu Liu※, Yuxiang Zheng※, Ethan Chern※, Shijie Xia※, Yiwei Qin, Weizhe Yuan, Pengfei Liu

    arXiv preprint, 2024

    Paper Code

    O1 Replication Journey: A Strategic Progress Report--Part 1

    Yiwei Qin※, Xuefeng Li※, Haoyang Zou※, Yixiu Liu※, Shijie Xia※, Zhen Huang, Yixin Ye, Weizhe Yuan, Hector Liu, Yuanzhi Li, Pengfei Liu

    arXiv preprint, 2024

    Paper Code

    Evaluating Safety with Critique

    Yixiu Liu, Yuxiang Zheng, Shijie Xia, Yuan Guo, Jiajun Li, Yi Tu, Chaoling Song, Pengfei Liu

    EMNLP 2024, Findings

    Paper Code

    OlympicArena: Benchmarking Multi-discipline Cognitive Reasoning for Superintelligent AI

    Zhen Huang, Zengzhi Wang, Shijie Xia, Xuefeng Li, Haoyang Zou, Ruijie Xu, Run-Ze Fan, Lyumanshan Ye, Ethan Chern, Yixin Ye, Yikai Zhang, Yuqing Yang, Ting Wu, Binjie Wang, Shichao Sun, Yang Xiao, Yiyuan Li, Fan Zhou, Steffi Chern, Yiwei Qin, Yan Ma, Jiadi Su, Yixiu Liu, Yuxiang Zheng, Shaoting Zhang, Dahua Lin, Yu Qiao, Pengfei Liu

    NeurIPS 2024

    Paper Code

    Selected Honors and Awards

    Outstanding Graduates of Fudan University, 2024

    Shanghai City Scholarship, 2022

    Fudan University Academic Scholarship, 2020-2024

    Invited Talks

    Cognition Engineering: The Inevitable Path to AGI, Nov. 2024, CIPS-LMG 2024 [slides]

    Service

    Program Committee/Reviewer
    AAAI: 2025