Publications
2024
Tuning Large Multimodal Models for Videos using Reinforcement Learning from AI Feedback
Daechul Ahn,
Yura Choi,
Youngjae Yu,
Dongyeop Kang,
Jonghyun Choi
Aligning Large Language Models by On-Policy Self-Judgment
Sangkyu Lee,
Sungdong Kim,
Ashkan Yousefpour,
Minjoon Seo,
Kang Min Yoo,
Youngjae Yu
Pearl: A Review-driven Persona-Knowledge Grounded Conversational Recommendation Dataset
Minjin Kim,
Minju Kim,
Hana Kim,
Beong-woo Kwak,
Soyeon Chun,
Hyunseo Kim,
SeongKu Kang,
Youngjae Yu,
Jinyoung Yeo,
Dongha Lee
Can Large Language Models be Good Emotional Supporter? Mitigating Preference Bias on Emotional Support Conversation
Dongjin Kang,
Sunghwan Kim,
Taeyoon Kwon,
Seungjun Moon,
Hyunsouk Cho,
Youngjae Yu,
Dongha Lee,
Jinyoung Yeo
HyperCLOVA X Technical Report
Jiwan Chung,
Sangkyu Lee,
Youngjae Yu
contributed.
Language Models as Compilers: Simulating Pseudocode Execution Improves Algorithmic Reasoning in Language Models
Hyungjoo Chae,
Yeonghyeon Kim,
Seungone Kim,
Kai Tzu-iunn Ong,
Beong-woo Kwak,
Seonghwan Kim,
Taeyoon Kwon,
Jiwan Chung,
Youngjae Yu,
Jinyoung Yeo
NAACL2024
# multimodal # Commonsense # Video UnderstaningSMILE: Multimodal Dataset for Understanding Laughter in Video with Language Models
Hyun Lee,
Kim Sung-Bin,
Seungju Han,
Youngjae Yu,
Tae-Hyun Oh
ICLR2024
# Text-to-Image # PEFTNavigating Text-To-Image Customization:From LyCORIS Fine-Tuning to Model Evaluation
Shin-Ying Yeh,
Yu-Guan Hsieh,
Zhidong Gao,
Bernard B W Yang,
Giyeong Oh,
Yanmin Gong
2023
Neurips2023
# multimodal # CommonsenseLocalized Symbolic Knowledge Distillation for Visual Commonsense Models
Jae Sung Park,
Jack Hessel,
Khyathi Chandu,
Paul Pu Liang,
Ximing Lu,
Youngjae Yu,
Qiuyuan Huang,
Peter West,
Jianfeng Gao,
Ali Farhadi,
Yejin Choi,
Qiuyuan Huang
EMNLP2023 (Oral)
# multimodal # Commonsense # Social NormReading Books is Great, But Not if You Are Driving! Visually Grounded Reasoning about Defeasible Commonsense Norms
Seungju Han,
Junhyeok Kim,
Jack Hessel,
Liwei Jiang,
Jiwan Chung,
Yejin Son,
Yejin Choi,
Youngjae Yu
EMNLP2023 (Oral)
# NLP # Commonsense Knowledge # Distillation # DialogSODA: Million-scale Dialogue Distillation with Social Commonsense Contextualization
Hyunwoo Kim,
Jack Hessel,
Liwei Jiang,
Peter West,
Ximing Lu,
Youngjae Yu,
Pei Zhou,
Ronan Le Bras,
Malihe Alikhani,
Gunhee Kim,
Maarten Sap,
Yejin Choi
EMNLP2023
# NLP # Commonsense Knowledge # DialogDialogue Chain-of-Thought Distillation for Commonsense-aware Conversational Agents
Hyungjoo Chae,
Yongho Song,
Kai Tzu-iunn Ong,
Taeyoon Kwon,
Minjin Kim,
Youngjae Yu,
Dongha Lee,
Dongyeop Kang,
Jinyoung Yeo
BMVC2023
# VideoQA # multimodalLong Story Short: a Summarize-then-Search Method for Long Video Question Answering
ArxivRA-L/ICRA2024
# Robotics # NLP # uncertainty estimationCLARA: Classifying and Disambiguating User Commands for Reliable Interactive Robotic Agents
Jeongeun Park,
Seungwon Lim,
Joonhyung Lee,
Sangbeom Park,
Minsuk Chang,
Youngjae Yu,
Sungjoon Choi
ACL2023
# NLP # Chain-of-thoughtSymbolic Chain-of-Thought Distillation: Small Models Can Also "Think" Step-by-Step
Liunian Harold Li,
Jack Hessel,
Youngjae Yu,
Xiang Ren,
Kai-Wei Chang,
Yejin Choi
NeurIPS2023
# Computer Vision # NLP # augmentation # interleaved image+textMultimodal C4: An Open, Billion-scale Corpus of Images Interleaved With Text
Wanrong Zhu,
Jack Hessel,
Anas Awadalla,
Samir Yitzhak Gadre,
Jesse Dodge,
Youngjae Yu,
Ludwig Schmidt,
William Yang Wang,
Yejin Choi
ICCV2023
# Computer Vision # NLP # Conversation # Visual ContextCHAMPAGNE: Learning Real-world Conversation from Large-Scale Web Videos
Seungju Han,
Jack Hessel,
Nouha Dziri,
Yejin Choi,
Youngjae Yu
CVPR2023
# NLP # Computer Vision # Reinforcement Learning # Zero-shotFusing Pre-trained Language Models with Multimodal Prompts through Reinforcement Learning
Youngjae Yu,
Jiwan Chung,
Heeseung Yun,
Jack Hessel,
Jae Sung Park,
Ximing Lu,
Prithviraj Ammanabrolu,
Rowan Zellers,
Ronan Le Bras,
Gunhee Kim,
Yejin Choi
ICRA2023
# Computer Vision # Robotics # Object DetectionZero-shot Active Visual Search (ZAVIS): Intelligent Object Search for Robotic Assistants
Jeongeun Park,
Taerim Yoon,
Jejoon Hong,
Youngjae Yu,
Matthew Pan,
Sungjoon Choi