CV

Education

• B.S. in Computer Engineering, Korea University of Technology and Education, Korea, 2017
• M.S. in Computer Science, Tokyo Institute of Technology, Japan, 2019
• Ph.D. in Computer Science, Tokyo Institute of Technology, Japan, 2022

Professional experiences

• March 2022 ~ : Researcher
  • CLOVA, NAVER Corp.
• April 2020 ~ March 2022: Research Fellow
  • The Japan Society for the Promotion of Science (JSPS), DC2
• December. 2018 ~ Feb 2022: Research Assistant
  • Team Koike, Tokyo Institute of Technology, JST Crest.
• April 2021
  • Program Chair, ACM CHI2021 Workshop: Human Augmentation for Skill Acquisition and Skill Transfer (HAA2021)
• June ~ September. 2020: Part-time Researcher
  • CLOVA AI Avatar, NAVER Corp.
• October. 2019 ~ January. 2020: Visiting Scholar
  • Robotics Institute, Carnegie Mellon University
• June ~ October. 2019: Research Internship
  • CLOVA AI Video (Current Avatar), NAVER Corp.
• ACM / IEEE conference and journal reviewer

Skills

• Python
  • Numpy
  • Pandas
  • Matplotlib
• Machine Learning
  • PyTorch
  • TensorFlow2
  • Scikit-learn
• Image Processing: OpenCV
• Computer Graphics: Unity
• Motion Capture System: Optitrack, Perception Neuron

Publications

Hand-Gesture Recognition Using Concentric-Circle Expanding and Tracing Algorithm

Dong-Hyun Hwang and Kyung-Sik Jang. "Hand-Gesture Recognition Using Concentric-Circle Expanding and Tracing Algorithm." Journal of the Korea Institute of Information and Communication Engineering 21.3 (2017): 636-642.

Fast Hand-Gesture Recognition Algorithm For Embedded System

Dong-Hyun Hwang and Kyung-Sik Jang. "Fast Hand-Gesture Recognition Algorithm For Embedded System." Journal of the Korea Institute of Information and Communication Engineering 21.7 (2017): 1349-1354.

ParaPara: Synthesizing Pseudo-2.5D Content from Monocular Videos for Mixed Reality

Dong-Hyun Hwang, and Hideki Koike. "Parapara: Synthesizing pseudo-2.5 d content from monocular videos for mixed reality." Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems. 2018.

AR based Self-sports Learning System using Decayed Dynamic Time Warping Algorithm

Ikeda et al. "AR based Self-sports Learning System using Decayed Dynamic Time Warping Algorithm." ICAT-EGVE 2018. 2018.

MlioLight: Projector-camera Based Multi-layered Image Overlay System for Multiple Flashlights Interaction

Sato et al. "MlioLight: Projector-camera Based Multi-layered Image Overlay System for Multiple Flashlights Interaction." Proceedings of the 2018 ACM International Conference on Interactive Surfaces and Spaces. 2018.

Real-time Visual Feedback for Golf Training Using Virtual Shadow

Ikeda, Atsuki, Dong-Hyun Hwang, and Hideki Koike. "Real-time Visual Feedback for Golf Training Using Virtual Shadow." Proceedings of the 2018 ACM International Conference on Interactive Surfaces and Spaces. 2018.

MonoEye: Monocular Fisheye Camera-based 3D Human Pose Estimation

Hwang et al. "MonoEye: Monocular Fisheye Camera-based 3D Human Pose Estimation." 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR). IEEE, 2019.

Golf training system using sonification and virtual shadow

Ikeda et al. "Golf training system using sonification and virtual shadow." ACM SIGGRAPH 2019 Emerging Technologies. 2019.

Lightweight 3D Human Pose Estimation Network Training Using Teacher-Student Learning

Hwang et al. "Lightweight 3D human pose estimation network training using teacher-student learning." Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision. 2020.

MonoEye: Multimodal Human Motion Capture System Using A Single Ultra-Wide Fisheye Camera

Hwang et al. "MonoEye: Multimodal Human Motion Capture System Using A Single Ultra-Wide Fisheye Camera." Proceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology. 2020.

Portable 3D Human Pose Estimation for Human-Human Interaction using a Chest-Mounted Fisheye Camera

Aso et al. "Portable 3D Human Pose Estimation for Human-Human Interaction using a Chest-Mounted Fisheye Camera." Augmented Humans Conference 2021. 2021.

MonoMR: Synthesizing Pseudo-2.5D Mixed Reality Content from Monocular Videos

Dong-Hyun Hwang and Hideki Koike. 2021. "MonoMR: Synthesizing Pseudo-2.5D Mixed Reality Content from Monocular Videos" Applied Sciences 11, no. 17: 7946. https://doi.org/10.3390/app11177946

How Can I Swing Like Pro?: Golf Swing Analysis Tool for Self Training

Invited Talks

Synthesizing Pseudo-2.5D Content from Monocular Videos for Mixed Reality (NAVER)

February 01, 2019

Talk at Green Factory, South Korea, Korea

Mobile Human Pose Estimation (Microsoft Research Asia)

May 01, 2020

Talk at Virtual, Virtual

Patents

[1] HUMAN POSE ESTIMATION SYSTEM

Hideki Koike, Dong-Hyun Hwang Publication number: 20210035326 (Japan and United States patents)

[2] METHOD AND APPARATUS FOR GENERATING DATA FOR ESTIMATING THREE-DIMENSIONAL (3D) POSE OF OBJECT INCLUDED IN INPUT IMAGE, AND PREDICTION MODEL FOR ESTIMATING 3D POSE OF OBJECT (Internship at CLOVA AI Video [Current: Avatar])

Suntae Kim, Dong-Hyun Hwang, Nicolas Monet, Soonmin Bae
Publication number: 20210209788 (Korea, Japan, and United States patents)