inform- interacting with a dynamic shape display
TRANSCRIPT
INTRODUCTIONINFORM is a Dynamic Shape Display that
can render 3D content physically, so users can interact with digital information in a tangible way.
INFORM can also interact with the physical world around it, for example moving objects on the table’s surface.
These physical objects have features that not only provide functionality , but also suggest possible uses, or confine the ways we may interact with them.
User interface’sA graphical user interface (GUI) is a human-computer
interface (i.e., a way for humans to interact with computers) that uses windows, icons and menus and which can be manipulated by a mouse (and often to a limited extent by a keyboard as well).
TUIs may be described as a set of relationships between physical objects and digital information.
“Radical atoms” is our vision of human interaction with the future dynamic physical material that are transformable, conformable and in formable.
Radical Atoms is a vision for the future of human-material interaction, in which all digital information has a physical manifestation so that we can interact directly with it. We no longer think of designing the interface, but rather of the interface itself as material. We may call it “Material User Interface (MUI).”
BLOCK DIAGRAM
ACTUATORS
COMPUTER
KINECT
SENSOR
PROJECTOR
SHAPE DISPLAY
AT MEGA 2561(PINS
)
LINKAGES
SHAPE OUTPU
T
Kinect sensor and projector Kinect sensor is a horizontal bar connected
to a small base with a motorized pivot and is designed to be positioned lengthwise above or below the video display.
The device features an “RGB camera, depth sensor and multi-array microphone running proprietary software", which provide full-body 3D motion capture ,facial recognition and voice recognition capabilities.
Digital Projectors is typically used loosely to include any projector capable of connecting to a computer, or other device displaying data.
However, for a projector to be considered truly digital, theoretically it would use a digital device, such as a DLP chip as opposed to LCD or LCoS panels, and would be equipped with an LED light source.
DIGITAL PROJECTORS
SHAPE DISPLAYShape displays can
appropriate passive objects by independently actuating and manipulating them to create dynamic affordances and constraints.
This way, the shape display can apply mechanical force to an object and cause it to move in a variety of ways.
This greatly expands opportunities for interaction, and inter-material interaction, as well as solving a problem inherent in passive tangible systems: keeping tokens’ physical state synchronized with the digital state
. Our techniques for actuating passive objects do not require an active or special material (such as magnets), but instead manipulate geometrical shapes, with the limitation that certain geometries (such as a ball) are easier to move than others.
Tokens and constraintsTokens are the physically manipulable elements
of tangible interfaces, and reference frames to be the physical interaction spaces in which these objects are used.
Tokens are also a graspable physical objects, the represents digital information or function
Constraints are embodied as physical structures that mechanically channel how tokens can be manipulated.
LINKAGES Push-Pull rods are used to link
each pin with an actuator, to enable a dense pin arrangement independent of actuator size, giving the system a height of 1100 mm.
The linkage, a nylon rod inside a plastic housing (Sullivan Gold-N-Rods), transmits bi-directional force from a motorized slide potentiometer (ALPS RSA0N11M9A07), through a bend.
Six slide potentiometers are mounted onto a custom-designed PCB, powered by an Atmel AT Mega 2560, and TB6612FNGCT-ND motor drivers.
ACTUATORSAn actuator is a type
of motor for moving or controlling a mechanism or system.
In this project, it contains 900 mechanical actuators where the INFORM system actuates and detects shape change.
External actuators changes the object states using such as mechanical, electromagnetic, magnetic or ultrasonic
ATMEGA 2560The high-performance, low-power
Atmel 8-bit AVR RISC-based microcontroller combines 256KB ISP flash memory, 8KB SRAM, 4KB EEPROM, 86 general purpose I/O lines, 32 general purpose working registers, real time counter
The device achieves a throughput of 16 MIPS at 16 MHz and operates between 4.5-5.5 volts.
The system uses 30×30 motorized white polystyrene pins, in a 381×381 mm area.
For each pin, we can update both position and PID terms to provide haptic feedback and variable stiffness, for example, to create haptic detents or buttons that are harder to press.
This control also allows us to limit power consumption per pin to avoid burning out the motors.
Each pin can exert a force of 1.08 Newtons (equivalent to 100 g weight), which was measured using a precision digital scale.
Dynamic Physical Affordance and constrainsDynamic affordances which can transform shape,
size, location and orientation, in addition to being able to appear and disappear.
They provide appropriate affordances on demand by changing their physical properties based on program states and the context of the user or other objects in the interaction area to facilitate interaction.
Buttons can, for example, grow in size to ease target acquisition, or move out of the way of an object.
We also introduce Dynamic Constraints, which help mediate interaction between the interface and tangible tokens or tools.
(a).Button(b).1D touch track
(c).2D touch track
(d).HandleDynamic Physical Affordances transform the UI to
facilitate interactions.
Actuated and Dynamically Controlled Objects A natural extension to user manipulation of TUIs is the ability to
computationally control them through actuation. The Actuated Workbench uses electromagnetism for 2D
movement of tracked tangibles on an interactive surface, while Madgets extends the concept to enable height actuation
Binary Switches: Buttons 1. Buttons are formed by raising pins from the surrounding
surface . 2. Users activate a button by touching it or by pushing it into the
surface, which is registered as a binary input.
Software tools1.DOG programming language:Dog is a new programming language that
makes it easy and intuitive to create social applications.
One of Dog’s key features is built-in support for interacting with people.
It can perform a long-running computation while also displaying messages, requesting information, or even sending operations to particular individuals or groups.
2.Embedded c
ADVANTAGESThe 3D Model Manipulation application
demonstrates how the INFORM system’s dynamic capabilities can be used to render physical representations of 3D models that the user can flip through, and then use tokens and tools to transform, edit or paint
APPLICATIONS This can solve the mathematical graphical representations by
showing the 3dimensional interactions. The system allows people to remotely manipulate objects from a
distance, physically interact with data or temporary objects, and could open the door to a wide variety of gaming, medical, or other interactive scenarios where people might be in remote locations.