this survey is being conducted by researchers at stanford ...yongslee/aireg_fda.pdf · consumer...
TRANSCRIPT
You are invited to participate in a survey of business application of artificialintelligence technologies, such as chatbots, image recognition, and productrecommendation programs. We expect that the survey will take about 6~9 minutesto complete.
This survey is being conducted by researchers at Stanford University and thesurvey results will be used for academic research only. Any personal informationwill remain confidential.Thank you for participating in our survey.
Artificial Intelligence Use in Businesses (A)
1
Artificial Intelligence Use in Businesses (A)
1. What best describes your role at your organization?
Owner or Partner
President/CEO/Chairperson
Other C-level Executive, e.g., CFO, COO, CTO
General/Operations Manager
Information System/ Information Technology Manager
Marketing Manager
Finance Manager
Sales Manager
Project Manager
Other (please specify)
2. Please briefly describe the type of work you do at the business for which you work.
2
3. What is the highest degree or level of school you have completed? If currently enrolled, mark the currentdegree you are enrolled in.
Less than a high school diploma
High school degree or equivalent (e.g. GED)
Some college, no degree
Associate degree (e.g. AA, AS)
Bachelor’s degree (e.g. BA, BS)
Master’s degree (e.g. MA, MS, MEng, MEd, MSW, MBA)
Doctorate or professional degree (e.g. PhD, EdD, MD, DDS, DVM, LLB, JD)
4. Which race/ethnicity best describes you? (Please choose only one.)
American Indian or Alaskan Native
Asian / Pacific Islander
Black or African American
Hispanic
White / Caucasian
Multiple ethnicity / Other
3
Now we will ask to what extent your workplace uses Artificial Intelligencetechnologies. We will be asking about 3 Artificial Intelligence technologies:
Natural Language ProcessingComputer VisionMachine Learning
AI technologies are different from robots or traditional data analysis. We will providea description of each technology in each question.
Artificial Intelligence Use in Businesses (A)
4
Natural Language Processing Use in the Workplace
Artificial Intelligence Use in Businesses (A)
5. Natural Language Processing is the technology that allows computers to process human speech ortext, or converse with humans. Examples of business processes using Natural Language Processinginclude sales chatbots on websites, customer service chatbots, automated speech transcription, voicerecognition in apps, virtual machine assistants, etc.
In the most recent quarter, did your workplace use Natural Language Processing? If so, in howmany business process(es) has your workplace used Natural Language Processing?
0 - No use
1 business process
2 business processes
3 business processes
4 business processes
5 business processes
6 business processes
7-9 business processes
10 or more business processes
Don't know
5
Artificial Intelligence Use in Businesses (A)
6. For which business process(es) has your workplace used Natural Language Processing? (Check all thatapply)
Customer service or sales chatbots
Speech recognition/transcription
Virtual machine assistants
Information retrieval/extraction
Recognition / prediction of diseases from text/speech
Sentiment analysis
Track news and information
Recruitment
Automated content creation
Machine translation
Litigation or fraud detection
Other (please specify)
6
Decreased
greatlyDecreased
slightlyThe
sameIncreased
slightlyIncreased
greatly
Notrelevantfor this
workplace
Managers
Technical workers (R&D workers, IT technicians, programmers,etc.)
Office workers (e.g., HR, accounting, secretarial workers, etc.but not in managerial positions)
Service and Sales workers (e.g., customer service, clientservice, salesperson etc.)
Production workers
7. How did the adoption of Natural Language Processing affect the number of the following workers at yourworkplace? Please respond to changes that happened because of Natural LanguageProcessing technology only.
7
Computer Vision Use in the Workplace.
Artificial Intelligence Use in Businesses (A)
8. Computer Vision is the technology that provides image-based automatic inspection, recognition oranalysis. Examples of business processes using Computer Vision include facial recognition for securitypurposes, anomaly detection using video analysis, image analysis in healthcare, delivery usingautonomous drones or unmanned vehicles, etc.
In the most recent quarter, did your workplace use Computer Vision? If so, in how many businessprocess(es) has your workplace used Computer Vision?
0 – No use
1 business process
2 business processes
3 business processes
4 business processes
5 business processes
6 business processes
7-9 business processes
10 or more business processes
Don’t know
8
Artificial Intelligence Use in Businesses (A)
9. For which business process(es) has your workplace used Computer Vision? (Check all that apply)
Facial recognition for security or other purposes
Video analysis for anomaly detection / inspection
Image analysis for disease diagnosis or prescription
Image analysis for autonomous vehicles/drones
Image recognition in retail stores / monitoring of inventory
Image recognition to authenticate documents (e.g. Passports, id cards)
Assisting humans in identification tasks
Other (please specify)
Decreased
greatlyDecreased
slightlyThe
sameIncreased
slightlyIncreased
greatly
Notrelevantfor this
workplace
Managers
Technical workers (R&D workers, IT technicians, programmers,etc.)
Office workers (e.g., HR, accounting, secretarial workers, etc.but not in managerial positions)
Service and Sales workers (e.g., customer service, clientservice, salesperson etc.)
Production workers
10. How did the introduction of Computer Vision affect the number of workers at your workplace? Pleaserespond to changes that happened because of Computer Vision technology only.
9
Machine Learning Use in the Workplace
Artificial Intelligence Use in Businesses (A)
11. Machine Learning is the technology that provides automated prediction and recommendationusing computer algorithms. Examples of business processes using Machine Learning include productrecommendation, consumer purchase behavior prediction, prediction of energy usage for bettermaintenance, recommending financial trading, etc.
In the most recent quarter, did your workplace use Machine Learning? If so, in how many businessprocess(es) has your workplace used Machine Learning?
0 – No use
1 business process
2 business processes
3 business processes
4 business processes
5 business processes
6 business processes
7-9 business processes
10 or more business processes
Don’t know
10
Artificial Intelligence Use in Businesses (A)
12. For which business process(es) has your workplace use Machine Learning? (Check all that apply)
Recommendation engines / product recommendation
Consumer purchase behavior prediction
Medical services
Online customer support
Information retrieval
Database mining
Churn modeling
Dynamic pricing
Customer segmentation
Prediction of energy usage to optimize maintenance
Recommend financial trading
Fraud detection
Other (please specify)
11
Decreased
greatlyDecreased
slightlyThe
sameIncreased
slightlyIncreased
greatly
Notrelevantfor this
workplace
Managers
Technical workers (R&D workers, IT technicians, programmers,etc.)
Office workers (e.g., HR, accounting, secretarial workers, etc.but not in managerial positions)
Service and Sales workers (e.g., customer service, clientservice, salesperson etc.)
Production workers
13. How did the introduction of Machine Learning affect the number of workers at your workplace? Pleaserespond to changes that happened because of Machine Learning technology only.
12
Please consider the following report on AI adoption in businesses in answering the nextquestions.
Artificial Intelligence Use in Businesses (A)
A 20.0% Recent research has found that early adopters of AI have started to reap thebenefits of their investments in this technology. First-movers have alreadydeployed and marketed AI-related solutions across healthcare, autonomousdriving, retail and so on. Forty-seven percent of companies say they haveembedded at least one AI capability in their business processes.
While the potential for AI is vast, most organizations still have a long way togo in developing the core practices that enable them to realize the potentialvalue of AI at scale. Business executives and managers will need to thinkabout how to incorporate AI into their business strategy, as well as thetransparency and “explainability” of AI algorithms, biases in data, andconcerns about safety and privacy.
For the next questions assume you are in the position to make artificialintelligence technology investments and human resource decisions foryour company.
13
B 20.0% Recent research has found that early adopters of AI have started to reap thebenefits of their investments in this technology. First-movers have alreadydeployed and marketed AI-related solutions across healthcare, autonomousdriving, retail and so on. Forty-seven percent of companies say they haveembedded at least one AI capability in their business processes.
Until now, states and the federal government have enacted little oversightand regulation specific to AI. But a new Algorithmic Accountability Act isexpected to change that. Under this Act, firms that are using or selling AIrelated products are subject to a variety of requirements governing their useof AI systems. Requirements include disclosure of firm usage of AI systems,including their development process or contractor of origin, AI system design,model training, and data gathered and in use. The Act also requires firms todisclose to a government agency the impact of their AI systems on safety,accuracy, fairness, bias, discrimination, and privacy. The regulation isexpected to go into effect in 2020.
For the next questions assume you are in the position to make artificialintelligence technology investments and human resource decisions foryour company.
14
C 20.0% Recent research has found that early adopters of AI have started to reap thebenefits of their investments in this technology. First-movers have alreadydeployed and marketed AI-related solutions across healthcare, autonomousdriving, retail and so on. Forty-seven percent of companies say they haveembedded at least one AI capability in their business processes.
As the development of AI-related products requires more data, policymakersand the public are increasingly concerned about data privacy. For example,California’s recently-enacted digital privacy initiative, the California ConsumerPrivacy Act of 2018 (CCPA), will affect all businesses buying, selling orotherwise trading the “personal information” of California residents–– including companies using online-generated data from residents acrosstheir products. In order to stay compliant with the regulation, firms mustdisclose how they use and store personal data, and how they conform withdata privacy rules. California’s regulation goes into effect in 2020. Otherstates are expected to enact similar data privacy regulations in the nearfuture.
For the next questions assume you are in the position to make artificialintelligence technology investments and human resource decisions foryour company.
15
D 20.0% Recent research has found that early adopters of AI have started to reap thebenefits of their investments in this technology. First-movers have alreadydeployed and marketed AI-related solutions across healthcare, autonomousdriving, retail and so on. Forty-seven percent of companies say they haveembedded at least one AI capability in their business processes.
Although some observers believe little oversight and regulation has beenattached to the area of AI training and product deployment, firms using AItechnology in the United States generally are subject to common law andstatutory requirements. Existing law (e.g., tort law) may require that acompany avoid any negligent use of AI to make decisions or provideinformation that could result in harm to the public. Current employment, labor,and civil rights laws create the risk that a company using AI to make hiring ortermination decisions could face liability for its decisions involving humanresources. These legal requirements apply now, and will likely continueapplying to future products, services, and company practices.
For the next questions assume you are in the position to make artificialintelligence technology investments and human resource decisions foryour company.
16
E 20.0% Recent research has found that early adopters of AI have started to reap thebenefits of their investments in this technology. First-movers have alreadydeployed and marketed AI-related solutions across healthcare, autonomousdriving, retail and so on. Forty-seven percent of companies say they haveembedded at least one AI capability in their business processes.
The healthcare and drug sectors have been actively developing AItechnologies for various purposes including patient diagnosis, treatment,drug development, and patient monitoring and care. The Food and DrugAdministration (FDA) currently regulates the industry and has proposed anew regulatory framework for AI/Machine Learning-based software. Thisframework aims to examine and pre-approve the underlying performance ofthe firm’s AI products before they are marketed, and post-approve anyalgorithmic modifications. In this process, the FDA will assess the firm’sability to manage risks associated with various issues such as, transparencyand explainability (e.g., diagnosis recommendation algorithms), and security(e.g., use and protection of patient private information) of the AI/MachineLearning based software. FDA’s proposed framework is expected to go intoeffect in 2020.
For the next questions assume you are in the position to make artificialintelligence technology investments and human resource decisions foryour company.
17
Artificial Intelligence Use in Businesses (A)
14. To what extent would you adopt AI? Please respond in terms of the total number of businessprocesses in which you would adopt any AI technology. If your business is currently adopting AI pleaseinclude those processes in the total number.
0 – No adoption
1 business process
2 business processes
3 business processes
4 business processes
5 business processes
6 business processes
7 business processes
8 business processes
9 business processes
10 or more business processes
15. What is the biggest annual budget you have been responsible for in your career to date?
Less than $10,000
$10,000-$100,000
$100,000-$500,000
$500,000-$1,000,000
$1,000,000-$5,000,000
More than $5,000,000
18
16. Adopting AI technology could entail a variety of costs. For example, there could be costs related tohiring technical workers, purchasing AI packages, computers and data centers, purchasing or gatheringdata, research and development, developing AI strategies for your business, consulting fees, assessing theimpact of AI product and services.
How much would you budget for AI adoption at your company in the following year? Pleaseconsider all potential costs and write in the dollar amount in whole numbers.
AI-related research and development (e.g., R&D costs related to creating new AI products orprocesses)
Hiring the workforce to manage, operate, and maintain AI systems at your company (e.g.,managers, technicians, programmers, etc. but excluding R&D workers)
AI training for existing employees (e.g., coding, how to use AI technology, etc.)
Purchase of AI packages from external vendors (e.g., AI software, analysis fees, etc.)
Computing resources and data related costs for AI systems at your company (e.g., computers,cloud computing, data collection and purchase costs, etc.)
Developing AI strategy that is compatible with your company's overall business strategy (e.g.,consulting and marketing costs, internal strategy development, assess ethical impact, etc.)
17. What percentage of the above total AI budget would you allocate to each of the below 6 expensecategories? Please write down the percentages in integers without the % sign. The percentages shouldadd up to 100. Write down 0 for any category that you would not allocate any expenses to.
19
Artificial Intelligence Use in Businesses (A)
Decrease
greatlyDecrease
slightlyThe
sameIncreaseslightly
Increasegreatly
Notrelevantfor this
workplace
Co-operation on AI related R&D activities with other institutions(universities, research institutes, other businesses, etc.)
Filing of AI related patents
Introduction of an AI related good, service, or production/deliverymethod that is new or significantly improved
18. How would you adjust each of below AI related innovation activities at your workplace next year?
Not
importantSlightly
importantModeratelyimportant Important
Veryimportant
Layoffs or labor related issues due to AI adoption
Racial and gender bias/discrimination from AI algorithms
Safety and accidents related AI technologies
Privacy and data security issues related to AI adoption
Transparency and explainability of AI algorithms
19. AI-related technologies can introduce various ethical issues in businesses. How important would youconsider each of the following ethical issue when adopting AI at your business?
20
20. Who do you think is primarily responsible for minimizing AI-related ethical issues that could arise at yourbusiness?
Managers in my company
Engineers in my company
AI package vendors
The government, i.e., regulatory agencies
The court, i.e., the legal system
Other (please specify)
Decrease
greatlyDecrease
slightlyThe
sameIncreaseslightly
Increasegreatly
Notrelevantfor this
workplace
Managers
Technical workers (R&D workers, IT technicians, programmers,etc.)
Office workers (e.g., HR, accounting, secretarial workers, etc. butnot in managerial positions)
Service workers (e.g., customer service, client service, careworkers etc.)
Sales workers
Production workers
21. What would you do to the below employees at your workplace in response to AI adoption nextyear? Please respond how you would adjust the number of each worker type because of AI adoptionat your workplace next year.
21
This is the last page. We would like to ask a little bit about the business you workfor.
Business characteristics
Artificial Intelligence Use in Businesses (A)
22. Which state is your workplace located in?
23. What is the primary way employees are promoted at this business?
Promotions were based solely on performance and ability
Promotions were based partly on performance and ability and partly on other factors (for example, tenure or family connections)
Promotions were based mainly on factors other than performance and ability (for example, tenure or family connections)
Employees are not normally promoted
24. In the past year, what typically happened to under-performing employees at your workplace?
Reassigned or dismissed within 6 months of identifying employee under-performance
Reassigned or dismissed after 6 months of identifying employee under-performance
Under-performing employees are not normally reassigned or dismissed
No under-performing employees were identified in the past year
25. How many employees does this business usually have? If the business has multiple establishments,please respond in regards to your current workplace
less than 50
50-249
250-499
500-999
1,000-4,999
5,000 or above
22
26. What is your company’s annual revenue?
Less than $100K
$100K to $499K
$500K to $999,999K
$1M to $4.9MM
$5MM to $9.9MM
$10MM to $49.9MM
$50MM to $99.9MM
$100MM to $499.9MM
$500MM to $999,999B
$1B or more
27. The final question is a request for feedback about the responses you provided so far. It is vital to ourstudy that we only include responses from people who devoted their full attention to this study.This will not affect in any way the payment you will receive for taking this survey.
In your honest opinion, should we use your responses, or should we discard your responses sinceyou did not devote your full attention to the questions so far?
Yes, I have devoted full attention to the questions so far and I think you should use my responses for your study.
No, I have not devoted full attention to the questions so far and I think you should not use my responses for your study.
23