Yusuke Hirota
I am a 2nd year PhD student in Graduate School of Information Science and Technology at Osaka University and a member of ISLab.
I work with Prof. Yuta Nakashima and Prof. Noa Garcia on the intersection of computer vision and natural language processing (Vision-and-Language).
My research interests include:
Societal bias in Vision-and-Language
e.g., Evaluate/mitigate societal bias in image captioning and VQAImage representation for Vision-and-Language
e.g., Textual representation of images for VQA
News
[03/2023] Our paper "Uncurated Image-Text Datasets: Shedding Light on Demographic Bias" has been selected as a highlight at CVPR 2023.
[02/2023] Two papers are accepted at CVPR 2023.
[04/2022] A paper accepted at ACM FAccT 2022.
[03/2022] A paper accepted at CVPR 2022 as an oral.
[07/2021] A paper accepted at ICCV CLVL 2021.
Publications
Conferences
Model-Agnostic Gender Debiased Image Captioning
Yusuke Hirota, Yuta Nakashima, Noa Garcia. CVPR 2023Uncurated Image-Text Datasets: Shedding Light on Demographic Bias
Noa Garcia, Yusuke Hirota, Yankun Wu, Yuta Nakashima. CVPR 2023, HighlightQuantifying Societal Bias Amplification in Image Captioning
Yusuke Hirota, Yuta Nakashima, Noa Garcia. CVPR 2022, OralGender and Racial Bias in Visual Question Answering Datasets
Yusuke Hirota, Yuta Nakashima, Noa Garcia. ACM FAccT 2022A Picture May Be Worth a Hundred Words for Visual Question Answering
Yusuke Hirota, Noa Garcia, Mayu Otani, Chenhui Chu, Yuta Nakashima, Ittetsu Taniguchi, Takao Onoye. arxiv 2021
Workshops
Visual Question Answering with Textual Representations for Images
Yusuke Hirota, Noa Garcia, Mayu Otani, Chenhui Chu, Yuta Nakashima, Ittetsu Taniguchi, Takao Onoye. ICCV CLVL 2021
Education
Apr. 2022 ~ Ph.D. School of Information Science and Technology, Osaka University, Japan.
Apr. 2020 ~ Mar. 2022 M.S. School of Information Science and Technology, Osaka University, Japan.
Apr. 2016 ~ Mar. 2020 B.S. School of Engineering, Osaka University, Japan.
Reviewer
Conferences: CVPR'23, ICCV'23
Journals: IEEE TPAMI
Skills
Programming Languages: Python
Software: Pytorch, Docker, Git, Latex
Languages: English (intermediate), Japanese (native)
Contact
Email: y-hirota [at] is [dot] ids [dot] osaka-u.ac.jp