![Page 1: UNITED STATES PATENT & TRADEMARK OFFICE 229 YEARS OF … · A six-digit numerical design search code is assigned to each design element of a trademark, such as a depiction of a star](https://reader036.vdocument.in/reader036/viewer/2022071214/604213cf1d3abe63835900f3/html5/thumbnails/1.jpg)
Emerging Technologies in USPTO Business SolutionsMay 25th 2018
UNITED STATES PATENT & TRADEMARK OFFICE229 YEARS OF DATA
![Page 2: UNITED STATES PATENT & TRADEMARK OFFICE 229 YEARS OF … · A six-digit numerical design search code is assigned to each design element of a trademark, such as a depiction of a star](https://reader036.vdocument.in/reader036/viewer/2022071214/604213cf1d3abe63835900f3/html5/thumbnails/2.jpg)
STATS @• ~8500 Patent Examiners; • Receive ~600k patent applications a year; have ~605,000 applications in
inventory.• ~1.2M patent applications in flight.• ~2.5M granted patent that are enforceable.• Issue ~305,000 patents a year with ~5 million “claims” that can be litigated.
• Time to issue first millionth Patent – ~75.8 years;• Time to issue our last millionth patent – ~3.6 years.
• 875 Trademark employees (7% of USPTO)• 579 examining attorneys (66% of Trademarks)• Trademark Operations receive ~594,100 classes for registration in FY 2017.
![Page 3: UNITED STATES PATENT & TRADEMARK OFFICE 229 YEARS OF … · A six-digit numerical design search code is assigned to each design element of a trademark, such as a depiction of a star](https://reader036.vdocument.in/reader036/viewer/2022071214/604213cf1d3abe63835900f3/html5/thumbnails/3.jpg)
Uses within the USPTOI. Patent Enriched Citation Data II. Patent CPC Analytics - TrendsIII. Browser Based End Point Advanced
Analytics for PatentsIV. Trademark Image ClassifierV. Research Projects at the USPTO
3
![Page 4: UNITED STATES PATENT & TRADEMARK OFFICE 229 YEARS OF … · A six-digit numerical design search code is assigned to each design element of a trademark, such as a depiction of a star](https://reader036.vdocument.in/reader036/viewer/2022071214/604213cf1d3abe63835900f3/html5/thumbnails/4.jpg)
I. Enriched Citation & DocDB• Extracting the associated citations and related
rejection type using emerging technologies.• This allows us to provide this information to the
IP5 Office in an internationally consumable format.• DocDB (granular international family mapping with
IP Office specific citations) advanced analytical analysis.
4
![Page 6: UNITED STATES PATENT & TRADEMARK OFFICE 229 YEARS OF … · A six-digit numerical design search code is assigned to each design element of a trademark, such as a depiction of a star](https://reader036.vdocument.in/reader036/viewer/2022071214/604213cf1d3abe63835900f3/html5/thumbnails/6.jpg)
https://developer.uspto.gov/api-catalog/
![Page 7: UNITED STATES PATENT & TRADEMARK OFFICE 229 YEARS OF … · A six-digit numerical design search code is assigned to each design element of a trademark, such as a depiction of a star](https://reader036.vdocument.in/reader036/viewer/2022071214/604213cf1d3abe63835900f3/html5/thumbnails/7.jpg)
• Data Sources– CPC Scheme Definition
• Concatenated the definition to the root using XML parser– Patents/PGPubs Specifications
• Summary text, a mix of “Background of invention”, “Brief description of the invention”, etc.
– Patents/PGPubs Claims• Independent and dependent claims of patents
• Machine Learning/AI Algorithms– Supervised/Unsupervised Machine Learning
Algorithms– Ensemble Algorithms
II. CPC Classifying Trends/Analytics
![Page 8: UNITED STATES PATENT & TRADEMARK OFFICE 229 YEARS OF … · A six-digit numerical design search code is assigned to each design element of a trademark, such as a depiction of a star](https://reader036.vdocument.in/reader036/viewer/2022071214/604213cf1d3abe63835900f3/html5/thumbnails/8.jpg)
Prototype Interface
• Classifies entered text (ie patent application)• “Explains” why/how algorithm arrived at its conclusion• Enables human validation and model training
![Page 9: UNITED STATES PATENT & TRADEMARK OFFICE 229 YEARS OF … · A six-digit numerical design search code is assigned to each design element of a trademark, such as a depiction of a star](https://reader036.vdocument.in/reader036/viewer/2022071214/604213cf1d3abe63835900f3/html5/thumbnails/9.jpg)
III. Browser based end point Advanced Analytics for Patents
![Page 10: UNITED STATES PATENT & TRADEMARK OFFICE 229 YEARS OF … · A six-digit numerical design search code is assigned to each design element of a trademark, such as a depiction of a star](https://reader036.vdocument.in/reader036/viewer/2022071214/604213cf1d3abe63835900f3/html5/thumbnails/10.jpg)
Platform AI/BD Capabilities
![Page 11: UNITED STATES PATENT & TRADEMARK OFFICE 229 YEARS OF … · A six-digit numerical design search code is assigned to each design element of a trademark, such as a depiction of a star](https://reader036.vdocument.in/reader036/viewer/2022071214/604213cf1d3abe63835900f3/html5/thumbnails/11.jpg)
IV. Trademark Machine Learning Framework
![Page 12: UNITED STATES PATENT & TRADEMARK OFFICE 229 YEARS OF … · A six-digit numerical design search code is assigned to each design element of a trademark, such as a depiction of a star](https://reader036.vdocument.in/reader036/viewer/2022071214/604213cf1d3abe63835900f3/html5/thumbnails/12.jpg)
New Application Filings• FY16: 530,270 classes filed FY17: 594,107 classes filed• FY18 up 8.7% compared to FY17. Expecting 646,000
classes this year
![Page 13: UNITED STATES PATENT & TRADEMARK OFFICE 229 YEARS OF … · A six-digit numerical design search code is assigned to each design element of a trademark, such as a depiction of a star](https://reader036.vdocument.in/reader036/viewer/2022071214/604213cf1d3abe63835900f3/html5/thumbnails/13.jpg)
Electronic TM Prosecution, End to End
![Page 14: UNITED STATES PATENT & TRADEMARK OFFICE 229 YEARS OF … · A six-digit numerical design search code is assigned to each design element of a trademark, such as a depiction of a star](https://reader036.vdocument.in/reader036/viewer/2022071214/604213cf1d3abe63835900f3/html5/thumbnails/14.jpg)
Trademark Design Code SuggestionsA six-digit numerical design search code is assigned to each design element of a trademark, such as a depiction of a star (01.01.03) or flower(05.05.25). Using years of images with corresponding examiner-annotated design codes, we are able to train deep learning systems that can predict design codes of a new trademark image.
TensorFlow Training Process
Initial Neural Net Model
Neural Net Model Optimized For Recommending Trademark Design Codes
Types of Training Tried: 1. Retraining just last layer
of the neural network (Transfer Learning)
2. Retraining all the layers from scratch
11.01.02 11.01.03 07.01.04
05.03.25 09.01.04
03.03.01 02.11.0103.03.24
Trademark DATA
![Page 15: UNITED STATES PATENT & TRADEMARK OFFICE 229 YEARS OF … · A six-digit numerical design search code is assigned to each design element of a trademark, such as a depiction of a star](https://reader036.vdocument.in/reader036/viewer/2022071214/604213cf1d3abe63835900f3/html5/thumbnails/15.jpg)
Design Code Based on Image
Design Codes On Record
Neural Net RecommendedDesign Codes
Confidence scores
![Page 16: UNITED STATES PATENT & TRADEMARK OFFICE 229 YEARS OF … · A six-digit numerical design search code is assigned to each design element of a trademark, such as a depiction of a star](https://reader036.vdocument.in/reader036/viewer/2022071214/604213cf1d3abe63835900f3/html5/thumbnails/16.jpg)
V. Research Projects at the USPTO
16
• AI Assisted Patent Searching• AI based Patent Term Library Generator• AI based Trademark Image Search• Deep Machine Learning Chat Bots
![Page 17: UNITED STATES PATENT & TRADEMARK OFFICE 229 YEARS OF … · A six-digit numerical design search code is assigned to each design element of a trademark, such as a depiction of a star](https://reader036.vdocument.in/reader036/viewer/2022071214/604213cf1d3abe63835900f3/html5/thumbnails/17.jpg)
AI-BASED PATENT PROCESSING SEARCHING
The
AI Patent Search Capabilities
![Page 18: UNITED STATES PATENT & TRADEMARK OFFICE 229 YEARS OF … · A six-digit numerical design search code is assigned to each design element of a trademark, such as a depiction of a star](https://reader036.vdocument.in/reader036/viewer/2022071214/604213cf1d3abe63835900f3/html5/thumbnails/18.jpg)
Patent Synonyms Generator Tool
Build Word Embedding Models
CorpusPatent Applications,Technical Journals, Technical Standards,…
Training Generating Synonyms By Technical Fields
![Page 19: UNITED STATES PATENT & TRADEMARK OFFICE 229 YEARS OF … · A six-digit numerical design search code is assigned to each design element of a trademark, such as a depiction of a star](https://reader036.vdocument.in/reader036/viewer/2022071214/604213cf1d3abe63835900f3/html5/thumbnails/19.jpg)
Trademark Image SearchSearching for marks that look similar is an essential job function of a trademark examiner. Using neural networks we are able to retrieve and store features of mark images that we can then compare to other marks’ features.
Trademark Image
Trademark ImageFeatures
Pre-trained on Trademarks Image SimilarityCalculation
![Page 20: UNITED STATES PATENT & TRADEMARK OFFICE 229 YEARS OF … · A six-digit numerical design search code is assigned to each design element of a trademark, such as a depiction of a star](https://reader036.vdocument.in/reader036/viewer/2022071214/604213cf1d3abe63835900f3/html5/thumbnails/20.jpg)
TM Image Search Prototype using Machine Learning
![Page 21: UNITED STATES PATENT & TRADEMARK OFFICE 229 YEARS OF … · A six-digit numerical design search code is assigned to each design element of a trademark, such as a depiction of a star](https://reader036.vdocument.in/reader036/viewer/2022071214/604213cf1d3abe63835900f3/html5/thumbnails/21.jpg)
21
V. Leveraging Deep Learning for Chatbot Service
![Page 22: UNITED STATES PATENT & TRADEMARK OFFICE 229 YEARS OF … · A six-digit numerical design search code is assigned to each design element of a trademark, such as a depiction of a star](https://reader036.vdocument.in/reader036/viewer/2022071214/604213cf1d3abe63835900f3/html5/thumbnails/22.jpg)
22
Prototype Chatbot Service
![Page 23: UNITED STATES PATENT & TRADEMARK OFFICE 229 YEARS OF … · A six-digit numerical design search code is assigned to each design element of a trademark, such as a depiction of a star](https://reader036.vdocument.in/reader036/viewer/2022071214/604213cf1d3abe63835900f3/html5/thumbnails/23.jpg)