mobileappdev fah
DESCRIPTION
ContacTRANSCRIPT
Click to edit Master title style
Challenges & Trends for Next-generation Smartphone Apps
Application-oriented IT Research:
FRANK ALLAN HANSEN
PRODUCT MANAGER ALEXANDRA MOBILE APPS
RESEARCH AND INNOVATION SCIENTIST, PHDINTERACTIVE SPACES LABTHE ALEXANDRA INSTITUTE LTD.
Click to edit Master title style
Page 2
Challenges & Trends for Next-generation smartphone apps
• Introduction• The current app paradigm• Three perspectives on next generation smartphone apps
– Overlaying the world– Interacting with objects and controlling the environment– Apps as glue for digital activities
• Wrap up and conclusion
Agenda
April 8, 2023
Click to edit Master title style
Page 3
• Private research institute founded in 1999• Part of the GTS network (Godkendt teknologisk service)• Focus on applied, research-based innovation in pervasive
computing– Pervasive Healthcare, Interactive Spaces, Advanced visualization, New Ways of
Working, Software, Pervasive Positioning, It-security and Business and processes
• Non-profit company that works with application-oriented IT research and development and sells IT services and products to the Danish industry.
• Bridge-builder between research, private corporations, public institutions and citizens.
• Based in the IT-city Katrinebjerg in Aarhus and the IT-University in Copenhagen.
The Alexandra Institute
April 8, 2023
Click to edit Master title style
April 8, 2023 Page 4
• Social networking, games, photography,…
• Simple focused apps• Rich in detail• Rich interaction
– Touch and gesture based
• Lot of attention to design and detail
• However, apps are often monolithic• Developed for their own digital niche• Not much integration with the user’s
world
The current app paradigm
Click to edit Master title style
Page 5
Smartphones as “smart” devices
April 8, 2023
Click to edit Master title style
Page 6
Smartphones as “smart” devices
April 8, 2023
• Very powerful devices– Quad core CPUs, Dedicated GPUs, etc
• Many physical sensors:– Camera (ID, Object tracking, light levels)– Microphone (audio levels, voice commands)– 3G/4G (location, proximity)– Bluetooth (location, proximity)– Wi-Fi (location, proximity)– Accelerometer (movement)– Compass (direction)– GPS (location)– Gyroscope (movement)– NFC/RFID (identification)– …
Click to edit Master title style
Page 7
• Next generation apps should utilize this technology
• Apps should be aware of the user’s context– Adapt functionality and application behavior– Present and filter relevant information– Allow the user to control and interact with the surroundings
• Not an “easy” task of course…• So new software tools and ideas are needed
Digital-physical apps
April 8, 2023
Click to edit Master title style
Page 8
1. Overlaying the world
April 8, 2023 Minority Report (2002)
Click to edit Master title style
Page 9
• Digital Threads (Digitale Tråde)• Location-based augmented reality
– GPS, Accelerometer, Compass
• Developed with Museum Midtjylland• Displays excavation sites and
historical buildings in the landscape
• Challenge:– Turned out to be “complex” to
implement– Accuracy depends on the smartphone
sensors
Location-based AR
April 8, 2023
Click to edit Master title style
Page 10
• Storm P Museum• Skovgaard Museum• Developed for Redia
– http://www.redia.dk/
• Vision based• Based on feature models• Overlays graphics, animation
and control over the camera image.
• Challenge:– Very dependent on light conditions– Scalability: hard to model
everything
Vision based AR
April 8, 2023
Storm P Museum
Skovgaard Museum
Click to edit Master title style
Page 11
• AR is “complex” to implement – Sensor fusion– Advanced tracking
• Location based augmented reality is only as good as the accuracy of the mobile phone's sensors
• Vision based augmented reality requires models and a lot of computation – (i.e. you can’t model the entire world)
• But, when you combine the two:– You can filter the models based on the user’s
location and orientation!– Can potentially make it much easier to create
advanced digital-physical visualization apps!
Challenges for mobile augmented reality
April 8, 2023
Click to edit Master title style
Page 12
• Idea: using the smartphone as a information and control device for the environment.
– Smartphones can be used to identify physical objects– Using the camera, GPS, NFC, etc
– Apps can present relevant information to the user
– Smartphones can adapt to the environment, – eg. as an advanced and dynamic remote control
2. Interacting with objects and controlling the environment
April 8, 2023
Click to edit Master title style
Page 13
Interacting with objects – tagging
April 8, 2023
App: Rød rute, Aarhus Festuge
Click to edit Master title style
Page 14
• RFID (Radio Frequence Identifier)• Radio based tag• Can be hidden inside object
– No camera needed
• Support simple “swipe”-based interaction
• Killer app: mobile payment
• App: AudioMove.org• Developed for Katapult and KMD• Audio-based theater for system
developers• User scans props to hear the story
Interacting with objects – next generation
April 8, 2023
Click to edit Master title style
Page 15
• Car controller, Mercedes and B&O• Mercedes-Benz Viano Vision Diamond
• Standard iPhone / iPad is used as control device
– Television, audio system, lights, …– Different scenes:
• Office, cinema, concert, internet, live or relax
Controlling the environment
April 8, 2023
Click to edit Master title style
Page 16
• Not all interaction has to go through the smartphone• Other forms of interaction:
– Interactive installations in the city– Installations in the home (heat control)– Fitness or life style equipment
• But smartphone apps may be the glue or hub that connects it all…
3. Apps as glue for digital activities
April 8, 2023
Click to edit Master title style
Page 17
• Jawbone UP– “Use the UP wristband
and iPhone app to track your steps, distance, calories burned, pace, intensity level, active vs inactive time, GPS routes and more.
– http://jawbone.com/up
• Nike+ Fuel Band– http://nikeplus.nike.com/plus/prod
ucts/fuelband
Health monitors
April 8, 2023
Click to edit Master title style
Page 18
• Not all interaction has to go through the smartphone• Other forms of interaction:
– Interactive installations in the city– Installations in the home (heat control)– Fitness or life style equipment
• But smartphone apps may be the glue or hub that connects it all…
• All interaction is through a more natural interface but heavy lifting and data communication is handled by the smartphone apps
3. Apps as glue for digital activities
April 8, 2023
Click to edit Master title style
Page 19
More information:
– MarketIT article: Next generation smartphone apps: sensor-based interaction
– http://www.marketit.dk/Forside/Indhold/Artikler/6---Tablets-smartphones--APPs/N%C3%A6ste-generation-smartphones--Sensorbaseret-interaktion
– Bedre Innovation:Næste generations SmartPhone Apps til professionelle anvendelser
– http://www.bedreinnovation.dk/aktivitet/n%C3%A6ste-generations-smartphone-apps-til-professionelle-anvendelser
– The Alexandra InstitutePending research application about professional smartphone appshttp://alexandra.dk/
Wrap up
April 8, 2023