Huabin Liu's Homepage

Short Bio

Huabin Liu (刘华斌) is currently a 5th-year Ph.D student at Shanghai Jiao Tong University, working with Prof. Weiyao Lin on video understanding and analysis. From Jan 2024, I started my visit to the VISLab at University of Amsterdam as a visiting researcher for 1 year, advised by Prof. Cees Snoek and Prof. Filip Ilievski. From 2023 to 2024, I was a research intern at the Shanghai AI Lab, working with Xiao Sun. Before starting pursuing my Ph.D, I was lucky to be a research intern at Aibee, supervised by Dian Li and Jianguo Li. Prior to this, I obtained my bachelor’s degree from Xidian University in 2019.

My research focus on computer vision, especially on video analysis. My previous research covers fine-grained image recognition, few-shot action recognition. Currently, I mainly focus on video reasoning, dense video captioning, videoLLMs.

News

[07/2024] 🥳 One paper about video QA & reasoning is accepted to ECCV 2024.
[03/2024] 😃 One paper about dense video captioning is accepted to CVPR 2024.
[01/2024] 🛫 Start my visit to the VISLab at University of Amsterdam as a visiting researcher.
[12/2023] 😆 One paper about instructional video understanding is accepted to AAAI 2024.
[07/2023] 😚 One paper about human-centric video analysis is accepted to IJCV journal.
[07/2022] 😁 Our paper about few-shot action recognition is accepted to ACM MM 2022.
[11/2021] 😊 Our paper about few-shot action recognition is accepted to AAAI 2022.
[05/2021] 🥳 Our paper about fine-grained image recognition is accepted to TMM journal.
[12/2020] 🏆 Our hosted challenge won the best Challenge organization award in ACM MM 2020.
[10/2020] We will host the HiEve Challenge on ACM MM 2020.

Publications [Google Scholar][DBLP]

ECCV

TimeCraft: Navigate Weakly-Supervised Temporal Grounded Video Question Answering via Bi-directional Reasoning

Huabin Liu, Xiao Ma, Cheng Zhong, Yang Zhang, Weiyao Lin

European Conference on Computer Vision (ECCV), 2024

PDF

CVPR

DIBS: Enhancing Dense Video Captioning with Unlabeled Videos via Pseudo Boundary Enrichment and Online Refinement

Hao Wu*, Huabin Liu*, Yu Qiao, Xiao Sun (* Equal Contribution)

IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2024.

PDF Code BibTex

Preprint

Few-shot Action Recognition via Intra-and Inter-Video Information Maximization

Huabin Liu, Weiyao Lin, Tieyuan Chen, Yuxi Li, Shuyuan Li, John See

Under review.

PDF BibTex

AAAI

Collaborative Weakly Supervised Video Correlation Learning for Procedure-Aware Instructional Video Analysis

Tianyao He, Huabin Liu, Yuxi Li, Xiao Ma, Cheng Zhong, Yang Zhang, Weiyao Lin

AAAI Conference on Artificial Intelligence (AAAI), 2024.

PDF BibTex

IJCV

HiEve: A Large-Scale Benchmark for Human-Centric Video Analysis in Complex Events

Weiyao Lin, Huabin Liu, Shizhan Liu, Yuxi Li, Guojun Qi, Nicu Sebe

International Journal of Computer Vision (IJCV)

PDF Project Page BibTex

ACM MM

Task-adaptive Spatial-Temporal Video Sampler for Few-shot Action Recognition

Huabin Liu, Weixian Lv, John See, Weiyao Lin

ACM International Conference on Multimedia (ACM MM), 2023

PDF Code BibTex

CVPR

Speed Up Object Detection on Gigapixel-Level Images With Patch Arrangement

Jiahao Fan, Huabin Liu, Wenjie Yang, John See, Weiyao Lin

IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2023.

PDF BibTex

AAAI

TA2N: Two-Stage Action Alignment Network for Few-shot Action Recognition

Shuyuan Li, Huabin Liu*, Rui Qian, Yuxi Li, John See, Mengjuan Fei, Xiaoyuan Yu, Weiyao Lin (* Equal Contribution)

AAAI Conference on Artificial Intelligence (AAAI), 2023.

PDF Code BibTex

TMM

Learning scale-consistent attention part network for fine-grained image recognition

Huabin Liu, Jianguo Li, Dian Li, John See, Weiyao Lin

IEEE Transactions on Multimedia (TMM), 24, 2902-2913

PDF BibTex

BMVC

Temporal Alignment via Event Boundary for Few-shot Action Recongnition

Shuyuan Li*, Huabin Liu*, Mengjuan Fei, Xiaoyuan Yu, Weiyao Lin (* Equal Contribution)

British Machine Vision Conference (BMVC), 2021

PDF BibTex

ICCV

Enhancing Self-supervised Video Representation Learning via Multi-level Feature Optimization

Rui Qian, Yuxi Li, Huabin Liu, John See, Shuangrui Ding, Dian Li, Weiyao Lin

IEEE/CVF International Conference on Computer Vision (ICCV), 2021

PDF Code BibTex

TOMM

Scene Graph Lossless Compression with Adaptive Prediction for Objects and Relations

Weiyao Lin, Yufeng Zhang, Wenrui Dai, Huabin Liu, John See, Hongkai Xiong

ACM Transactions on Multimedia Computing, Communications and Applications (ACM TOMM), 2024

PDF

Awards

[12/2023] Founded by China Scholarship Council (CSC) as a visting researcher for 1 year
[09/2022] CETC scholarship for Ph.D. students in SJTU (¥20000).
[10/2019] Selected as member of Wu Wenjun (吴文俊) AI honorary PhD student in SJTU (< 1%).
[06/2019] Outstanding undergraduate student of Xidian University (XDU)
[2015-2018] First Prize Scholarship of Xidian University (< 4%), 3 times
[2015-2018] Outstanding Student of Xidian University (< 3%), 2 times
[10/2017] First prize of National college students Mathematical Contest in Shaanxi (< 3%)

Contact

Address: No.800, Dongchuan Road, Minhang District, Shanghai, China
Email: huabinliu (at) sjtu.edu.cn
Wechat: a377323665