1.Speaker: Yi-Ping Hung Professor and Director Graduate Institute of Networking and Multimedia National Taiwan University Joint Research Fellow Institute of Information Science Academia Sinica

2. OUTLINE Introduction Digitization of Museum Collections Interactive Systems for Virtual Exhibition Stereoscopic Kiosk Magic Crystal Ball Interactive Multi-Resolution Tabletop Displays Turning Rust into Gold 2 3. INTERACTIONbetween Human and Machine Input Method Output MethodCard Punch MachineLine PrinterkeyboardCRT Screen MouseLCD ScreenFinger Touch Touch Screen Other interaction methods, such as speech,gesture, bio-signals, etc. 3 4. Touch-Control Handheld Devices iPhone iPadApple Computer, 2007Apple Computer, 2010 5. Hand Gesture Recognition Microsoft Kinect SixthSensecontroller-free gaming and entertainment WUW Wear Ur World A Waerableexperience for the Xbox 360, E3 2009.Gesture Interface, SIGCHI 2009 6 http://www.youtube.com/watch?v=qC3H3JOt vSs 6. Intangible Displays FogScreen Heliodisplayhttp://www.fogscreen.com http://www.heliodisplay.eu/tech.htm 7. Related Work Bio-Signal, Brainwave8 8. OUTLINE Introduction Digitization of Museum Collections Interactive Systems for Virtual Exhibition Stereoscopic Kiosk Magic Crystal Ball Interactive Multi-Resolution Tabletop Displays Turning Rust into Gold 9 9. Digitization of 2D Museum CollectionsNational Palace Museum Chinese Paintings Chinese Calligraphies10 10. Digitization of 2D Museum Collections Reprographic Scanner GigaPixel Camera 11 11. Digitization of 3D Museum ArtifactsHistorical Museum of Academia Sinica 3D Collection of Shoung dynasty National Museum of History, Taipei Tricolors of Tang dynasty 12 12. Digitization of 3D Museum ArtifactsNational Palace Museum 5 artifacts selected for virtual exhibition13 13. Object Movies Image-Based Rendering Equipments for images acquisition Texnai, Nodal Ninja, PeaceRiver Studios 14 14. Acquisition of Object MoviesObject-centric representation CO3D configuration of views15 15. OUTLINE Introduction Digitization of Museum Collections Interactive Systems for Virtual Exhibition Stereoscopic Kiosk Magic Crystal Ball Interactive Multi-Resolution Tabletop Displays Turning Rust into Gold 16 16. Integration of Object Movies with Panoramas Augmented Reality Based on Cuboid Structure Chen, Yu, Hung, ICCV99 Augment a Panoramawith Object Movies Hung, et al, JVCA 2002Yi-Ping Hung, et al, Augmenting Panoramas with Object Movies ,Journal of Visualization and Computer Animation (JVCA), 2002.17 17. Interactive 3D Virtual Exhibition Design a Stereoscopic Kiosk for Virtual Exhibition3D VirtualExhibitionViewerSync. StereoObject Movies 18 18. Stereoscopic Kiosk Contains two screens the upper one with touch panel the lower one with micropol for stereoscopic view 19 19. Stereoscopic Kiosk F@imp 2004 (Festival Audiovisuel InternationalMusees et Patrimoine) 2020 20. Daily Exhibition at theNational Palace Museum2004/10 2005/1021 21. OUTLINE Introduction Digitization of Museum Collections Interactive Systems for Virtual Exhibition Stereoscopic Kiosk Magic Crystal Ball Interactive Multi-Resolution Tabletop Displays Turning Rust into Gold 22 22. Magic Crystal Ball Magical Visual Experience Intuitive Manipulation VRST 2007 23. System ArchetectureTransparent Glass Ball Fresnel LensTouch ScreenReflection Mirror Two IR CamerasIR Illuminators Strain Gauge SensorsCantilever beam structure LCDDisplayDetection ModuleModule 24. Hand Gesture Recognition Cover the spherical ball with two cameras Side viewWith one camera With two cameras 25. IRON MAN 27 /65 26. Virtual Panel2D Planar Intangible ScreenLCD ScreenVirtual PanelFresnel LensIR Cameras 27. OUTLINE Introduction Digitization of Museum Collections Interactive Systems for Virtual Exhibition Stereoscopic Kiosk Magic Crystal Ball Interactive Multi-Resolution Tabletop Displays Turning Rust into Gold 30 28. Interactive Multi-resolution TableTop Displayi-m-Top Rear Projection Multi-Touch Multi-Resolution i-m-Top: An Interactive Multi-Resolution Tabletop System Accommodating To Multi-Resolution Human Vision, IEEE Tabletops andInteractive Surfaces, Amsterdam, IEEE Tabletop 2008. To Move or Not to Move: A Comparison between Steerable and Fixed Regions of High-Resolution Projection in Multi-ResolutionTabletop Systems, ACM SIGCHI 2009 31 29. Motivation for Multi-resolution Human Visual System: Multi-resolution Fovea region: acute visual details Peripheral region: coarse visual details 30. Related Works Focus + ContextBaudisch, P., Good, N., and Stewart, P. "Focus Plus Context Screens: Combining Display Technology with VisualizationTechniques." In proceedings of ACM UIST 01, Orlando, FL, November 2002 31. Related Works Escritoire A multi-resolution tabletop display system with front-projection Interact by two pens Fovea area is fixedMark Ashdown, Peter Robinson, Experiences Implementing and Using Personal Projected Displays, University of CambridgeProcams03 " 32. i-m-Top System96 ppi 24 ppi 56Steerable Mirror Fovea ProjectorIR Camera x 2 Peripheral Projector IR Illuminator x4 33. Some Applications Museum Painting Browser Map Browser Photo Browser 34. Map Touring with Tangible WidgetLCD Screen (Panorama view)Tangible object (You)im-Top (map view) 35. Tangible Widgets for Virtual Exhibitionof Museum Collections38 36. Yongzheng Exhibition-- National Palace Museum-- Oct 2009 ~ Jan 201039 37. Beyond-Surface Interaction with Infrared ProjectionThree Applications 40 38. IDEA: Using an Invisible Projection i-m-Lamp Location & Orientation -- 6 DOFi-m-FlashlightColorProjector IR Projector i-m-ViewMirrorMirrorIR Camera41 39. i-m-Lamp Project high-resolution content on thesurface, mimicking the use of a desk lamp. 42 40. i-m-Flashlight A mobile version of i-m-Lamp, facilitatinginformation explorations and cooperativetasks. 43 41. i-m-View An intuitive tool to view 3D content oraugmented information from differentperspectives.44 42. Demo Emerging Tech in SIGGRAPH 2010 Publication UIST 2010 Press Coverages: New Scientist Engadget GearLog Reuters International and domestic TV 45 43. OUTLINE Introduction Digitization of Museum Collections Interactive Systems for Virtual Exhibition Stereoscopic Kiosk Magic Crystal Ball Interactive Multi-Resolution Tabletop Displays Turning Rust into Gold 46 44. Turning Rust into Gold The Mao-Kung Ting One of the most precious artifacts in the National Palace Museum, Taipei Dating back to 800 B.C. Having 500-character inscription cast inside Howto reveal the great nature of this artwork? Howto set up the connection between museum visitors and this artwork? 45. Why Breath-Aware Sensor? The Power of the Breath Breathing is a function in our bodies that we can do both consciously and unconsciously Breathing is a bridge between mind and body Yoga, meditation, Qi-Gong, Tai-Ji, all focus on breathing Be fully conscious of each breath make you healthier and enlightened enlightened: feel oneness with Being 46. Respiration Detectors Which Method for Respiration Detection ? Optoelectronic Plethysmography (OEP) Respiratory Inductive Plethysmography (RIP) Heart Rate Variability (HRV) Ultra Wide Band (UWB) 47. Respiration DetectionComparison of Different Respiration Detection MethodsOEP RIP HRVUWB AttachedAttachedAttachedAttachedNon-to bodymarkerstoto invasive Body skin AccuracyHigh MedianMedianLow Least Detectors DetectorsLessLimitationmobility attachedattachedmobilitytoto the body fingers 48. Turning Rust into Gold K. T. Creativity Award 2009: is now demonstrated in the NPM LOHAS Exhibitat the Future Museum, located at the Taiwan Taoyuan International Airport. 49. National Palace Museum-- Future Museum Location: Taiwan Taoyuan International Airport LOHAS Exhibition, April/2010 April/2011 50. Thanks