1. Physical Object Tagging and Decoding Amnon Dekel Embedded Computing Seminar Fall 2005 Prof. Scott Kirkpatrick

2. Outline

Introduction

Object Tagging Methods

Object ID Acquisition in the Field

Data Entry in the Field

Some Applications

3. Introduction

Tagging

• The act of creating a linkage between a physical object and a symbolic representation of that object

PhysicalObject Tag Symbolicrepresentation 4. Introduction

Why Tag?

• Because the Brave new world of Ubiquitous/Pervasive computing needs a way to identify the world and what is happening in it

5. Introduction

Why Tag?

• Enable Context discovery

• Enable Categorization

• Minimize errors

• Minimize ambiguity

• Enable linkages between objects

• • Physical to physical

• • Physical to symbolic (services)

6. Introduction

Why Tag?

• Context discovery

• • Location (physical and symbolic)

• • Task (where in the process, service management)

• • Change (relative to planned)

• • Behavior Patterns (learn, react)

7. Object Tagging 8. Object Tagging

Two main methods

• Passive Tags

• Active Tags

• Note: I use a slightly different meaning than the

• existing Active/Passive

9. Passive Visual Tags 10. Passive Visual Tags

Passive Visual Code Tags: Many Types

11. Passive Visual Tags

Passive Tagging:

• Dumb Tags which do not react to their surroundings

• Stick and Forget

• Very Cheap

• Need Line of Site

• Range

• • Normal use: Up to ~1.5 M

• • Range can grow by enlarging the tag

12. Passive Visual Tags

1 D Bar Codes:

• Provide a simple and inexpensive method of encoding information that is easily read by inexpensive electronic readers.

• Allows data to be collected rapidly and with extreme accuracy.

• Consists of a series of parallel, adjacent bars and spaces.

• Predefined bar and space patterns or "symbologies" are used to encode small strings of character data into a printed symbol.

• Can be thought of as a printed type of the Morse code with narrow bars (and spaces) -> dots, and wide bars -> dashes

http://www.taltech.com/TALtech_web/resources/intro_to_bc/bcbascs.htm 13. Passive Visual Tags

1 D Bar Codes:

• The different symbologies have different capabilities for encoding data. For example the

• • UPCsymbology used to identify retail products always contains12 numeric digits

• • The general purposeCode 39orCode 128bar code symbologies can encode variable length alphanumeric data up to about30 charactersin length. These types of bar codes are called " linear symbologies " because they are made up of a series of lines of different widths.

• Most commercially available bar code scanners are able to read all of the different linear bar code symbologies therefore you do not need different readers for different types of bar codes.

http://www.taltech.com/TALtech_web/resources/intro_to_bc/bcbascs.htm 14. Passive Visual Tags

1 D Bar Codes:

http://www.taltech.com/TALtech_web/resources/intro_to_bc/bcbascs.htm 30 Chars 12 Digits 15. Passive Visual Tags

1 D Bar Code Usage

See:http://searchcio.techtarget.com/sDefinition/0,,sid19_gci213536,00.html Used for human readable version of the UPC, EAN, JAN, Bookland, and ISSN bar codes and for optional human-readable digits with Code 39 and Interleaved 2 of 5 symbols OCR-B The optical character recognition format used on book covers for the human readable version of the ISBN number OCR-A A special font used for the numbers on the bottom of bank checks MICR (Magnetic Ink Character Recognition) Used by Federal Express, in libraries, and blood banks Codabar Used in the shipping and warehouse industries Interleaved 2 of 5 Used in preference to Code 39 because it is more compact Code 128 Based on ISSN numbers, used on periodicals outside the U.S. ISSN bar code Based on ISBN numbers and used on book covers Bookland Similar to the EAN, used in Japan Japanese Article Number (JAN) A superset of the UPC that allows extra digits for country identification European Article Number (EAN) Encoding zip codes on U.S. mail POSTNET Identification, inventory, and tracking shipments Code 39 Retail stores for sales checkout; inventory, etc. UPC (Universal Product Code) Uses Code Standard 16. Passive Visual Tags

1D Barcode History:

• 1948: Woodland and Silver build prototype system

• • Used ink and 500 watt light

• 1952: US Patent2,612,994

• 1966: First commercial product

• • The National Association of Food Chains (NAFC) put out a call to equipment manufacturers for systems that would speed the checkout process

• 1967: RCA installs reader in Cincinnati standards needed

• 1970: Logicon: UGPIC standard, Sylvania Railroad Car scanning

• 1973: UPC standard

• 1974: First UPC scanner (NCR), first checkout: Packet of gum

• 1981: LOGMARS (Code 39) for the DoD

• 1984: Barcodes are mandated by Wal-Mart (remind you of something?)

http:// www.barcoding.com/Information/barcode_history.shtml 17. Passive Visual Tags

2D Bar Codes:use 2 dimensions to get more storage capacity

http://www.taltech.com/TALtech_web/resources/intro_to_bc/bcbascs.htm 18. Passive Visual Tags

2D Bar Codes:use 2 dimensions to get more storage capacity

• New "2-Dimensional" bar code symbologies likePDF417 ,Aztec Code ,Data MatrixandQR Codeare also now available that can encodeseveral thousand bytes of datain a single bar code symbol includingtextorbinarydata.

• The newer 2D bar code symbologies typically require special bar code readers that are designed specifically for reading them.

http://www.taltech.com/TALtech_web/resources/intro_to_bc/bcbascs.htm 19. Passive Visual Tags

The 2D standards:

• QR Code

• Data Matrix

20. Passive Visual Tags

QR Code

• 1994: Released by Denso wave

• The specification is disclosed and the patent right owned by denso wave isnt exercised.

• Has been approved by various standards bodies over the years,

• • i.e. approved iso standard (ISO/IEC18004) and available for purchase in their store

http://www.engadgeted.net/archives/2005/09/18/matrix-codes-visual-code-recognition-on-cellphones/ 21. Passive Visual Tags

QR Code

• Uses three position detection patterns located at corners of the symbol

• a data area and a quiet zone outside of the symbol.

• The symbol size ranges from 2121 to 177177 modules (increases in steps of 4 modules per side)

• it supports four error correction levels usingReed-Solomon code .

• QR codes can store up to 7089 numeric characters, 4296 alphanumeric characters or 2953 bytes

http://www.engadgeted.net/archives/2005/09/18/matrix-codes-visual-code-recognition-on-cellphones/ Position detection 22. Passive Visual Tags

QR Code

• 40 versions

http://www.denso-wave.com/qrcode/qrgene2-e.html 4 7 10 17 72 30% 7 11 16 27 104 25% 8 14 20 34 128 * 15% 10 17 25 41 152 7% 21x21 1 Kanji Binary Alfanumeric Numeric Data bits ECC Level Modules Version 784 1,273 1,852 3,057 10,208 30% 1,024 1,663 2,420 3,993 13,328 25% 1,435 2,331 3,391 5,596 18,672 * 15% 1,817 2,953 4,296 7,089 23,648 7% 177x177 40 23. Passive Visual Tags

Micro QR Code

• Micro qr code sacrifices storage capacity (35 Num, 21 ANum, 15 Binary) for a smaller print footprint.

• It has only one position detection pattern,

• supports fewer levels of error correction

• ranges in symbol size from 1111 to 1717 modules.

http://www.denso-wave.com/qrcode/microqr-e.html 24. Passive Visual Tags

Data Matrix Code:

• Invented by RVSI Acuity Cimatrix

• Has been placed in the public domain

• Is an approved iso standard (ISO/IEC16022) and available for purchase in their store

http://www.engadgeted.net/archives/2005/09/18/matrix-codes-visual-code-recognition-on-cellphones/ 25. Passive Visual Tags

Data Matrix Code:

• Uses twosolid bordersas handles foralignment

• Two broken borders on the opposite corner assyncs for module sampling

• Uses a data area and a quiet zone outside of the symbol.

• Additional handles and borders are added with growing matrix dimensions. (size ranges from 1010 to 144144)

• Supports Reed-Solomon error correction.

• Can store up to3116 numericchars,2335 alphanumericchars or1555 bytes .

http://www.engadgeted.net/archives/2005/09/18/matrix-codes-visual-code-recognition-on-cellphones/ 26. Passive Visual Tags

Additional 2D codes

Multi-Colored Matrix Info Density is not clear, but Supposedly large Maxi (UPS) Code 93 Alphanumeric chars 138 Numeric chars Aztec 3000 chars 3750 digitsPDF417 2725 charsCircular bar-codes No Data Available More Info:http://www.taltech.com/TALtech_web/resources/intro_to_bc/bcsymbol.htm 27. Active Tags 28. Active Tags

Active Tagging is the use of objects that can respond to electromagnetic pulses and return data to a query system

• RFID

• • Passive

• • Active

• • NFC

29. Active Tags

RFID R adioF requencyID entification

• An RFID tag is a small object that can be attached to or incorporated into a product, animal, or person.

• RFID tags contain siliconchipsandantennasto enable them to receive and respond toradio -frequency queries from an RFIDtransceiver .

• Passive tags require no internal power source, whereas active tags require a power source.

• IMPORTANT :

An EPC RFID tag used for Wal-Mart Chip Antenna http:// en.wikipedia.org/wiki/Rfid No need for Line of Sight Communication ! 30. Active Tags

RFID History

• 1939: Watson-Watt: IFF (identification Friend of Foe) for RADAR

• 1948: Stockman, H. Communication by Means of Reflected Power. Proceedings of the IRE, pp 1196-1204, October 1948.

• 1973: first Patents:

• • Active tag with rewritable memory

• • Passive transponder used to unlock a door without a key

• Mid 1980s: First Industrial Systems:

• • Active System for tracking Dangerous materials

• • Passive RFID system (125 kHz radio waves) to track cows

• Since:

• • Move up the spectrum to the unregulated 13.56MHz wavelength and above

• • Greater range, capacity and data transfer rates (IBM UHF RFID Patents)

• • Access control, anti-theft, smart cards

• • 1999: Auto-ID Center set up at MITRFID into the supply chain (simple ID on chip is used to access information online) ->move the data Off the chip (and thus make it cheaper).

• The grail: the 1cent tag

http:// en.wikipedia.org/wiki/Rfid http://www.rfidjournal.com/article/articleview/1338/1/129 / 31. Active Tags

RFID Frequencies

From:FDIS 2004 presentation: Prospects for RFID Technologies More Info:The RFID Handbook cars 32. Active Tags From:http://www.rfid-handbook.de/rfid/frequencies.html More Info:The RFID Handbook

RFID Frequencies

33. Active Tags

RFID Frequencies

• Each frequency range has its advantages and disadvantages.

• • Europe use 868 MHz. for its UHF applications while the US uses 915 MHz. for its UHF applications.

• • Japan does not allow the use of the UHF frequency for RFID applications.

• • Low Frequency tags (LF) are less costly to manufacturer than Ultra High Frequency (UHF) tags.

• • UHF tags offer better read/write range and can transfer data faster then other tags.

• • HF tags work best at close range but are more effective at penetrating non-metal objects especially objects with high water content.

Source:http:// www.controlelectric.com/RFID/Types_of_RFID.html 34. Active Tags

Interference?

• EPC standard UHF tags operate in the 850-950 MHz frequency band. There is an interference with 802.xx wireless LAN standards.

• Older WAN standards operating in the 915 MHz band can cause interference and may have to be replaced as interference can occur.

• Effective site surveys are required prior to the implementation of RFID equipment to understand the current radio frequency environment of the location you wish to install RFID technology.

http://www2.cio.com/ask%5Cexpert/2004/questions/question1910.html 35. Active Tags

RFID Identification Speed:

• ISO 18000-3 Mode 2:

• • 200 static Items/sec (theoretic speed)

• • Magellan has shown a demo of 100 items/sec.

• ISO 18000-3 Mode 5:

• • 500 static Items/sec (not implemented because of prohibitive equipment costs)

Also:Magellan: http://www.rfidjournal.com/article/articleview/445/1/1/. From:http:// www.teco.edu/~krohn/collaborative.pdf 36. Active Tags

RFID Reader Costs

• Industrial readers cost in the order of $2,000-6,000, but small scale systems are starting to arrive:

• • Home systems: $450 ( iAutomate )

• • Compact Flash Reader: $150 ( Syscan )

• • Phidget RFID Reader: $60 ( Phidget )

• • Press Release: $20 Reader ( View )

37. Active Tags

NFC: Near Field Communications

• A standards-based, short-range wireless connectivity technology that enables simple and safetwo-way interactions among electronic devices , allowing consumers to performcontact-less transactions ,access digital contentandconnect devices with a single touch

See:http://www.semiconductors.philips.com/news/content/file_1053.html Near Field Communication Interface and Protocol -2 38. Active Tags

NFC: Near Field Communications

• NFC technology evolved from a combination ofRFIDand interconnection technologies.

• Passive RFID Tags inside Nokia Phones (3300, 3500, 6360)

• NFC operates in the 13.56 MHz frequency range, over a distance of typicallya few centimeters .

• NFC technology is standardized in ISO 18092, ECMA 340, and ETSI TS 102 190.

• NFC is also compatible to the broadly established contactless smart card infrastructure based on ISO 14443 A, i.e. Philips MIFARE technology, as well as Sonys FeliCa card.

• March 2004: Nokia, Philips and Sony establish theNear Field Communication (NFC) Forum

See:http://www.semiconductors.philips.com/news/content/file_1053.html Near Field Communication Interface and Protocol -2 39. Active Tags

NFC: Interference?

Standard: ECMA-352:1st Edition / December 2003

• OPERATING FREQUENCY (fc)

• • 13.56 MHZ +/- 7 kHz.

• 6 External RF field threshold value

• • NFCIP-2 devices shall detect external RF fields at the OPERATING FREQUENCY with a value higher than HTHRESHOLD while performing external RF field detection.

• • The value of HTHRESHOLD = 0,1875 A/m.

• 7 RF Field detection

• • In order to not disturb any communication on the OPERATING FREQUENCY, an NFCIP-2 device shall not switch on its RF field when it detects an external RF field, as specified in Clause 6.

Near Field Communication Interface and Protocol -2 40. Object ID Acquisition 41. Object ID Acquisition

Now that the information is in the world, How do we access it?

• Passive Tags:

• • Single Purpose Scanners

• • Multi-Purpose Visual Recognition Systems

click 42. Object ID Acquisition

Now that the information is in the world, How do we access it?

• Active Tags:

• • RFID Readers

• • Near Field Communications (NFC)

43. Data Entry in the Field 44. Data Entry in the Field

So the world is tagged and we can access those tags and use them in a variety of ways.

The missing piece for a full cycle is to enable data entry in the field

45. Data Entry in the Field

Why?

• Enable commercial transactions

• • Which drivese-commerce in the field

• Enable bi-directional content services

46. Data Entry in the Field

Transactions :

• On board application uses ObjectID to carry out a transaction (Buy, Rent, etc)

• • NFC :

• • • Swipe your phone to the object (decode ObjectID)

• • • Send Transaction data commerce server (with ObjectID)

• • • Commerce Server notifies in store security system

• • Visual Tags:

• • • Capture and decode ObjectID

• • • Send Transaction data commerce server (with ObjectID)

• • • Commerce Server notifies in store security system *

47. Data Entry in the Field Commerce Server In StoreSecurity 1. Visual ObjectID Decoding 1. NFC ObjectID transfer 2. Transaction 3. Notify 48. Data Entry in the Field

Bi-Direction Content Services:

• On board application uses ObjectID to enable you to communicate with a content service.

• • Get product information

• • Compare products

• • Collaborative Filtering

• • Personal Annotation

• Up-channel Technique:

• • Keying: Click on Links or Text entry (Yuck!)

• • Send ObjectID query

• • Capture and Upload (Voice, Photo, Video)

• • Visual Gesture recognition (gesture represent simple responses- i.e. Yes, No)

49. Applications 50. Applications

Visual Tags

• 1D:

• • Item Number

• • Manufacturer

• • i.e. ISBN

• 2D:

• • Web URL

• • Object Information

• • Gaming

• • Rich location information

• • Physical Address

• • Orientation Information

• • Active Advertising

Active Tags

• Supply Chain Management

• Real Time Location Tracking

• Access Control

• People Tracking

• Baggage tracking

• Parcel Tracking

• Cloths Labels

• Animals

• Vehicle ID

• Electronic Locks

• Patients

• Communication IDs

51. Applications

Demo1: Visual Tags

Demo2: NFC

52. Scenarios of Interest (to me)

Shopping

Moving Personal Media

and how Tagging Technologies can be used to help me Browse and Annotate the world

53. Shopping 54. Shopping Information Overload! I cant rememberwhat I want! So many options! 55. Shopping

What can I do? I can use:

• A piece of paper

• Call my partner

• Remember by heart

• Or

56. Shopping

Have my (Smart) Phone help me

• • Remind me

• • Give me more info on a product

• • Tell me what others think of a product

• • Suggest things to me (collaborative filtering)

57. Shopping

Have my (Smart) Phone help me

• Give me more info on a product

• • Visual decoding or NFC technology directs me to a productinformationpage

• Tell me what others think of a product

• • Visual decoding or NFC technology directs meto a productopinionpage

• Suggest things to me(collaborative filtering)

• • Visual decoding or NFC technology directs me to a productsuggestionpage (People who bought this also)

Shopping 58. Moving Personal Media

Now that our cell phones are rapidly becoming our cameras and recorders, how can we use Tagging technology to enable them to become more integrated into our media environment?

59. Moving Personal Media

What do we want to move?

• Our Media

• • Photos

• • Audio (personal recordings, music)

• • Video

• Our Data

• Our Location

• Our Point of View

60. Moving Personal Media

Moving our media is relatively easy, isnt it?

• Install software on PC

• Install cable, or

• open wireless port

• Start communication session

• Move or Synch data

Too many steps, too complicated, too many points of failure and actual failure

61. Moving Personal Media

Using Wireless data networking along with object recognition we can make this as easy as point and click:

• Pointat the object you want to transfer your media to

• Click

• • Your Camera-Phone decodes the ID of the object

• • The ID is translated to an address online

• • Your Camera-Phone transfers the media to the object over the net

• • Voila: your media is now shown on the device (TV, Computer, iPod, etc)

62. Moving Personal Media I want to move my photo to my TV 63. Moving Personal Media I Zap my TV (with my camera or my NFC app) Capture and decode ObjectID Xxxxx Xxxxx Xxxxx 64. Moving Personal Media I Zap my TV (with my camera or my NFC app) Capture and decode ObjectID 122.345.234.345.678.112 65. Moving Personal Media I send my photo to my TV Send Photo to my TV 122.345.234.345.678.112 66. Moving Personal Media Enjoy! 67. Moving Personal Media

Yes- I know-

the architecture could be designed to be

very different

i.e. direct communication

between the devices, etc

But the concept remains the same

Capture code 2.Decode Address 3.Transfer

68. Summary 69. Summary

Two main forms of Object tagging

• Passive Tags(Visual Codes)

• • Cheap

• • Needs line of sight

• • (Most probably a transitional technology except in a few specific cases )

• Active Tags(Electromagnetic Transfer)

• • Getting cheaper (2004 ~$0.30 in large volumes)

• • No need for line of site

• • Starting to be integrated into consumer devices (NFC)

70. Summary

Object Tagging will have a big effect on our future

• (including our privacy, or lack of it)

• Many possible applications

• Big potential:

• • Connecting the physical world with rich information resources of the online world

• • Enabling the ease of Ecommerce in the physical world

• • Adding the gigantic physical world market to the Online Ecommerce ecosystem

71. Summary

Problems that still need to be overcome:

• Tag manufacturing costs still too high

• • Goal: 1 cent RFID tags in volume (~2007)

• Conflicting and interfering systems

• Integration of NFC (or similar) technology in a ubiquitous fashion

• Privacy concerns

• Culture

72. Questions

Amnon Dekel

amnoidatcsdothujidotacdotil