HCI Research Scientist · TwelveLabs

Taewan Kim, Ph.D.

HCI researcher specializing in human-AI interaction and AI-driven service design, with industry experience at TwelveLabs, Samsung Electronics, and NAVER AI Lab. Ph.D. from KAIST. Publications at CHI, CSCW, and DIS.

twkim24@gmail.com
GitHub LinkedIn Scholar CV

News

Jockey Research Preview publicly launched — I contributed the interaction language design for video AI interaction.

Paper on LLM-generated patient-friendly clinical notes published in Scientific Reports.

Joined Twelve Labs as an HCI Research Scientist, focusing on human-AI interaction and multimodal video understanding.

Paper on exploring design spaces to facilitate household collaboration accepted to CHI 2025.

Invited talk at Korean Neuropsychiatric Association Spring Conference.

Two papers accepted to CHI 2024 Workshop on Human-centered Evaluation and Auditing of Language Models (HEAL).

Experience

TwelveLabs
HCI Research Scientist
  • Human-AI interaction research on multimodal AI agents for video exploration, analysis, and creation.
  • Designing interaction paradigms for AI-driven video analysis and creation tools, bridging interaction design and AI model development.
Samsung Electronics
Senior Designer
  • AI Creator in Samsung's generative AI design program, sharing AI-driven practices across the organization.
  • Explored how generative AI can augment early-stage UX design through synthetic persona-based user studies.
NAVER AI Lab
Research Intern
  • Led research on large language models for mental health support contexts.
  • Designed and evaluated multimodal AI interfaces through user-centered research methods.

Education

KAIST
Ph.D. in Industrial Design
  • Advisor: Hwajung Hong
  • Dissertation: Designing for Mental Wellbeing: Exploring the Role of AI for Reflective Practice
Seoul National University transferred
Ph.D. Candidate, Cognitive Science
UNIST
M.S. in Creative Design Engineering
Handong University
B.S. in Product Design

Research

Designing the interaction layer between people and AI, across clinical care, mental health, and multimodal media.

Interaction Design for Multimodal Video AI

Video holds time, space, people, and narrative at once — a chat box isn't the right interface for it. I'm designing interaction languages where direct manipulation (selecting regions, brushing timelines, clicking entities) translates into structured intent that drives AI video reasoning.

In Progress · TwelveLabs Multimodal Interaction Generative UI
Jockey by TwelveLabs
Research Preview Jockey · TwelveLabs ↗

LLMs in Clinical & Mental Health Settings

Exploring how LLMs can reduce the gap between clinical information and the people who need it — from AI-assisted journaling that supports psychiatric patients' self-reflection, to generating patient-friendly clinical notes that help patients actively participate in their own emergency care.

MindfulDiary · CHI '24 DiaryMate · CHI '24 Clinical Notes · Sci Rep '26

Digital Mental Health

Innovative approaches to improving mental well-being through technology. MindScope monitors stress from smartphone activities, while a social bot design explores care-receiver interactions and stigma reduction.

MindScope · CHI '22 Gloomy · CHI '20

Publications

Journal & Conference Papers

Extended Abstracts & Workshop Papers