CV

Research

• Postdoctoral Researcher (JSPS PD) @ Sony Computer Science Laboratories, Oct. 2026 - now
  • Advisor: Prof. Shinichi Furuya
  • Research Topics: Multimodal Sensing · Exoskeleton · LLM/VLM
  • actively exploring…
• Ph.D. and M.E. @ Computer Science, Institute of Science Tokyo, Oct. 2021 - Sep. 2026
  • Advisor: Prof. Hideki Koike, GPA：3.92/4.00
  • Research Topics: Cross-modal Synthesis · Computational Sensing · Human-Computer Interaction
  • Developed cross-modal synthesis and multimodal learning models for muscle EMG inference and human states modeling.
  • Proposed the audio-to-motion framework to generate social context-aware motions based on a DiT.
  • Published 10+ works at top-tier conferences and journals, including first-author publications at NeurIPS, TVCG (journal), SIGGRAPH, SA, CHI, IEEE VR, and ISMAR.
• Visiting Researcher @ Stanford Computational Imaging Lab, Stanford University, Sep. 2025 - Feb. 2026
  • Advisor: Prof. Gordon Wetzstein
  • Research Topics: Generative AI · Large Foundation Model · Content Creation
  • Fine-tuned the Wan2.25B video generation model with synthetic videos for instructional content creation and human motor forecasting, leveraging distributed GPUs (Stanford Marlowe).
  • Integrated visual-language inputs, LLM agents, and other foundation models to propose an interactive system for sensorimotor understanding and embodied interaction.
  • Generated and inferred 3D garment and fabric properties from a single image by fine-tuning a VLM.
• B.E. @ Computer Science and Technology, Shanghai Jiao Tong University, Sep. 2017 - Jun. 2021
  • Advisor: Prof. Baoliang Lu, GPA：86/100
  • Research Topics: Brain-like Computing · Machine Intelligence · Transfer learning

Internship

• Research Fellow @ Sony Computer Science Laboratories, Mar. 2022 - Sep. 2026
  • Advisor: Prof. Shinichi Furuya
  • Designed cross-modal generative models to capture, understand, and estimate musicians’ biomechanical kinematics and dynamics from multimodal performance data.
  • Created AI-based intelligent and interactive prototypes to help musical skill transfer in AR.
• Researcher Intern @ SJTU BCMI LAB, Sep. 2020 - Jun. 2021
  • Advisor: Prof. Bao-liang Lu
  • Contributed to building a large-scale Emotion EEG Dataset (SEED).
  • Conducted research on transfer learning, cross-subject emotion recognition, and EEG-based computing.

Skills

• Programming: Python (Pytorch, Tensorflow), C#, C++, JavaScript, MATLAB, R, Shell/Bash, Linux/UNIX
• Technologies: HuggingFace, VS Code, Jupyter Notebook, Unity, Blender, Git/Github, Meta XR/Oculus, LaTeX, HTML/CSS
• Languages: Mandarin (Native), English (Fluent, TOEFL 110), Japanese (Intermediate, N2)

Awards & Fellowships

• Research Fellowship for Young Scientists (“Gakushin” DC2), JSPS, Oct. 2025
• JST SPRING Fellowship, Japan Science and Technology Agency, Apr. 2024
• Tokyo Tech Advanced Human Fellowship, Tokyo Institute of Technology, Oct. 2023
• AIP Network Director Award, 6th JST CREST AIP Challenge Program, Jul. 2022
• Research Assistant Fellowship, Tokyo Institute of Technology, Jun. 2022
• Silver Prize in Tencent University Game Creativity Competition, Tencent, Nov. 2021
• Scholarships for International Students in Japan, JASSO, Oct. 2021
• Academic Scholarship, Shanghai Jiao Tong University, Sep. 2020
• Second Prize, China Society for Industrial and Applied Mathematics, Sep. 2019

Academic Service & Leadership

• Reviewers
  • NeurIPS, CVPR, WACV, TVCG, CHI, IMWUT, AH
• Minister of Culture, Liaison Center, Student Union of Shanghai Jiaotong University
  • Undertake school-level activities such as Starry Week Appraisal, Spark Class Chairperson Clash Forum, and Exchange Visits with other universities.