KAIST CT-AR Summer School '21

- Abstract.

 In this lecture series, I would like to take basic topics on computer vision. In the end of every day’s lecture, an exercise will be given to understand the day’s lecture topic. Then, in the second week, I will give a tutorial on the technology called as Diminished Reality, in which objects in the captured scene are virtually erased by replacing with the background texture. As the final exercise, a system for Diminished Realty should be designed and implemented.
 For exercise, I would recommend each participant to use Python with OpenCV and Open3D, and other related libraries.

- Bio.

• Ph.D. degree in Electrical Engineering, Keio University, Japan, in 1992
  (Thesis Title : Magnetic Field Imaging Using CT Technique)
• Master of Engineering in Electrical Engineering, Keio University, Japan, in 1989
• Bachelor of Engineering in Electrical Engineering, Keio University, Japan, in 1987

• 2006-present - Professor at the Department of Information and Computer Science, Keio University
• 2001-2006 - Associate Professor at the Department of Information and Computer Science, Keio University
• 1997-1999 - Visiting Scientist at Robotics Institute, Carnegie Mellon University
• 1996-2001 - Assistant Professor at the Department of Information and Computer Science, Keio University
• 1995-1996 - Assistant Professor at the Department of Electrical Engineering, Keio University
• 1992-1995 - Research Associate at the Department of Electrical Engineering, Keio University

- Abstract.

 Augmented Reality (AR) has been researched and developed for nearly 60 years, but it is only recently that the technology has become more readily available. However, until recently, creating AR applications required strong programming skills. This is often an obstacle to people wanting to create novel and intuitive AR user experiences.
 In this seminar, participants will learn how to use a wide array of non-programming tools for rapid prototyping of AR experiences and them to evaluate these experiences. These will range from physical prototyping tools including paper templates for sketching out AR experiences, to web-based drag-and-drop applications with rapid previews on AR devices, to immersive authoring tools which can be used for creating 3D interface mockups, and others.
 The seminar will also review how to design user studies to evaluate the prototypes. This will include AR experiment design, qualitative and quantitative evaluation methods, and how to perform data analysis.

- Bio.

 Prof. Mark Billinghurst has a wealth of knowledge and expertise in human-computer interface technology, particularly in the area of Augmented Reality (the overlay of three-dimensional images on the real world).
 In 2002, the former HIT Lab US Research Associate completed his PhD in Electrical Engineering, at the University of Washington, under the supervision of Professor Thomas Furness III and Professor Linda Shapiro. As part of the research for his thesis titled Shared Space: Exploration in Collaborative Augmented Reality, Dr Billinghurst invented the Magic Book – an animated children’s book that comes to life when viewed through the lightweight head-mounted display (HMD).
 Not surprisingly, Dr Billinghurst has achieved several accolades in recent years for his contribution to Human Interface Technology research. He was awarded a Discover Magazine Award in 2001, for Entertainment for creating the Magic Book technology. He was selected as one of eight leading New Zealand innovators and entrepreneurs to be showcased at the Carter Holt Harvey New Zealand Innovation Pavilion at the America’s Cup Village from November 2002 until March 2003. In 2004 he was nominated for a prestigious World Technology Network (WTN) World Technology Award in the education category and in 2005 he was appointed to the New Zealand Government’s Growth and Innovation Advisory Board.
 Originally educated in New Zealand, Dr Billinghurst is a two-time graduate of Waikato University where he completed a BCMS (Bachelor of Computing and Mathematical Science)(first class honours) in 1990 and a Master of Philosophy (Applied Mathematics & Physics) in 1992.

- Abstract.

 This class will review the main works in the state-of-the-art in Deep Learning with application to Augmented Reality, in particular for 3D perception of geometry and semantic. We will discuss methods for predicting depth from monocular views, 3D pose estimation of objects and hands, Neural Radiance Fields (NeRFs), 3D shape prediction, point cloud analysis, and camera pose estimation.

- Bio.

 I am a director of research at ENPC ParisTech, France. I also supervise a research group at TU Graz, Austria. Before that, I was a full professor at the Institute for Computer Graphics and Vision, Graz University of Technology, and before that, a senior researcher at CVLab, EPFL, Switzerland.
 My research focuses on 3D scene understanding. More exactly, I aim at reducing as much as possible the guidance a system needs to learn new 3D objects and new 3D environments: How can we remove the need for training data for each new 3D problem? Currently, even self-supervised methods often require CAD models, which are not necessarily available for any type of object. This question has both theoretical implications and practical applications, as the need for training data, even synthetic, is often a deal breaker for non-academic problems.