intelligent process automation in auditescoladecontas.tce.mg.gov.br/.../07/...automation.pdf ·...

23
Intelligent Process Automation in Audit Abigail (Chanyuan) Zhang Continuous Auditing & Reporting Lab Rutgers Business School 1

Upload: others

Post on 20-Aug-2020

13 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Intelligent Process Automation in Auditescoladecontas.tce.mg.gov.br/.../07/...automation.pdf · Intelligent Process Automation (IPA) 4 IPA Artificial intelligence Machine learning

Intelligent Process Automation

in Audit

Abigail (Chanyuan) Zhang

Continuous Auditing & Reporting Lab

Rutgers Business School

1

Page 2: Intelligent Process Automation in Auditescoladecontas.tce.mg.gov.br/.../07/...automation.pdf · Intelligent Process Automation (IPA) 4 IPA Artificial intelligence Machine learning

Overview

• RPA and IPA

• Audit workflow

• IPA framework

• Prototype and evaluation

• Discussion and conclusion

2

Page 3: Intelligent Process Automation in Auditescoladecontas.tce.mg.gov.br/.../07/...automation.pdf · Intelligent Process Automation (IPA) 4 IPA Artificial intelligence Machine learning

Robotic Process Automation (RPA)

• Robotic Process Automation (RPA) can run application software in the same

way that a person works with that software.

• Tasks that RPA deals with

3

Definable Standardized Rule-Based

RepetitiveMachine-readable

inputs

Page 4: Intelligent Process Automation in Auditescoladecontas.tce.mg.gov.br/.../07/...automation.pdf · Intelligent Process Automation (IPA) 4 IPA Artificial intelligence Machine learning

Intelligent Process Automation (IPA)

4

IPA

Artificial intelligence

Machine

learning

Computer

vision

Virtual

agent

NLP/NLG Others

RPA

Other technologies

Data

analyticsDrones IoT Others

“Now, with help from AI, RPA robots are learning new skills. AI enables them to

interact with UI elements to complete tasks, read and process documents,

communicate in natural language, and analyze and optimize processes.” -

UiPath, 2019

Page 5: Intelligent Process Automation in Auditescoladecontas.tce.mg.gov.br/.../07/...automation.pdf · Intelligent Process Automation (IPA) 4 IPA Artificial intelligence Machine learning

Workflow Theory

A network of workflows (Adapted from Cichocki et al., 2012)

5

Page 6: Intelligent Process Automation in Auditescoladecontas.tce.mg.gov.br/.../07/...automation.pdf · Intelligent Process Automation (IPA) 4 IPA Artificial intelligence Machine learning

The Audit Workflow

6

An Audit

Engagement

Audit

Planning

Internal

Control

Testing

Substantive

Testing

Audit

Conclusion

Page 7: Intelligent Process Automation in Auditescoladecontas.tce.mg.gov.br/.../07/...automation.pdf · Intelligent Process Automation (IPA) 4 IPA Artificial intelligence Machine learning

Framework of R/IPA Implementation

7

• Identify the primary and all the lower-level workflows

• Re-design the workflow if needed

• Identify the workflows that have already been automated, that could be automated, and that cannot be automated

Audit workflow analysis

• Utilize the existing automation tool if existed

• Automate using either RPA or AI if the task is automatable

• Include human in the loop if the task is not automatable

Close the inner loops • Use RPA to

close the outer loop (i.e. complete the primary workflow)

Close the outer loop

Framework of R/IPA Implementation

7

• Identify the primary and all the lower-level workflows

• Re-design the workflow if needed

• Identify the workflows that have already been automated, that could be automated, and that cannot be automated

Audit workflow analysis

• Utilize the existing automation tool if existed

• Automate using either RPA or AI if the task is automatable

• Include human in the loop if the task is not automatable

Close the inner loops • Use RPA to

close the outer loop (i.e. complete the primary workflow)

Close the outer loop

Page 8: Intelligent Process Automation in Auditescoladecontas.tce.mg.gov.br/.../07/...automation.pdf · Intelligent Process Automation (IPA) 4 IPA Artificial intelligence Machine learning

The “Auditor-in-the-Loop” IPA Ecosystem

8

Auditors

Structured audit

tasks

Unstructured

audit tasks

Semi-structured

audit tasks

• AI/cognitive

computing

• Other

• AI

• Other

AuditorsRPA

RPA

Page 9: Intelligent Process Automation in Auditescoladecontas.tce.mg.gov.br/.../07/...automation.pdf · Intelligent Process Automation (IPA) 4 IPA Artificial intelligence Machine learning

Pre-SEFA

Testing

DCF

Standardization

SEFA Testing

Planning

Procedures 4

Planning

Procedures

2&3

Planning

Procedures 1

Bot completes

SA 434

(Planning

Worksheet)

Auditor

Auditor AuditorReview and sign Finish SA434.1/2

Add other major programs

Finish Testing summary Auditor

RPA prototype in audit planning - real case study

Workflow analysis:

Fill in a planning worksheet using information generated from a series of simple

analytical procedures and auditor’s professional judgement.

Page 10: Intelligent Process Automation in Auditescoladecontas.tce.mg.gov.br/.../07/...automation.pdf · Intelligent Process Automation (IPA) 4 IPA Artificial intelligence Machine learning
Page 11: Intelligent Process Automation in Auditescoladecontas.tce.mg.gov.br/.../07/...automation.pdf · Intelligent Process Automation (IPA) 4 IPA Artificial intelligence Machine learning

IPA prototype in audit – simulated case study

Page 12: Intelligent Process Automation in Auditescoladecontas.tce.mg.gov.br/.../07/...automation.pdf · Intelligent Process Automation (IPA) 4 IPA Artificial intelligence Machine learning

• Workflow analysis

IPA prototype in audit – simulated case study

Page 13: Intelligent Process Automation in Auditescoladecontas.tce.mg.gov.br/.../07/...automation.pdf · Intelligent Process Automation (IPA) 4 IPA Artificial intelligence Machine learning

• Close the inner loop

IPA prototype in audit – simulated case study

Page 14: Intelligent Process Automation in Auditescoladecontas.tce.mg.gov.br/.../07/...automation.pdf · Intelligent Process Automation (IPA) 4 IPA Artificial intelligence Machine learning

• Close the outer loop

IPA prototype in audit – simulated case study

Page 15: Intelligent Process Automation in Auditescoladecontas.tce.mg.gov.br/.../07/...automation.pdf · Intelligent Process Automation (IPA) 4 IPA Artificial intelligence Machine learning

15

Page 16: Intelligent Process Automation in Auditescoladecontas.tce.mg.gov.br/.../07/...automation.pdf · Intelligent Process Automation (IPA) 4 IPA Artificial intelligence Machine learning

Evaluation

Tested the bot 10 times on Rutgers CARLab server

The average time spent by the bot is 1:34, compared to 5 min needed by human

16

IPA prototype in audit – simulated case study

Page 17: Intelligent Process Automation in Auditescoladecontas.tce.mg.gov.br/.../07/...automation.pdf · Intelligent Process Automation (IPA) 4 IPA Artificial intelligence Machine learning

Conceptual Model of IPA in Pension Audit

17

Run testing queries (RPA)

Further analysis

(DA or AI)

• Process the pension

contract and extract

relevant information (NLP)

• Populate the data into DB

(RPA)

• Clean, standardize and

extract data (RPA or

NLP)

• Populate data into DB

(RPA)Plan Doc

12

Raw client data

AuditorsInvestigate

6

Report

Automatically generate testing

report (RPA and NLG)

Notify (RPA)

3

4

5

Page 18: Intelligent Process Automation in Auditescoladecontas.tce.mg.gov.br/.../07/...automation.pdf · Intelligent Process Automation (IPA) 4 IPA Artificial intelligence Machine learning

IPA Facilitates Continuous Audit

• IPA provides new opportunities for the existing manual work in

external audits to be automated

• The automation facilitated by IPA provides chances for external

audits to be conducted more timely

• IPA is non-invasive, so the data acquisition in real time is expected

to be easier and to get less resistance from the client.

18

Page 19: Intelligent Process Automation in Auditescoladecontas.tce.mg.gov.br/.../07/...automation.pdf · Intelligent Process Automation (IPA) 4 IPA Artificial intelligence Machine learning

Discussion

Where to implement AI?

– Not where “professional” judgements are needed

19

Page 20: Intelligent Process Automation in Auditescoladecontas.tce.mg.gov.br/.../07/...automation.pdf · Intelligent Process Automation (IPA) 4 IPA Artificial intelligence Machine learning

Conclusion

• IPA could achieve flexible, scalable, and intelligent process

automation in audit.

• Auditors’ work will be further shifted to the part that needs their

professional judgement.

• IPA could enhance the efficiency and effectiveness of audit

• IPA could facilitate continuous audit

20

Page 21: Intelligent Process Automation in Auditescoladecontas.tce.mg.gov.br/.../07/...automation.pdf · Intelligent Process Automation (IPA) 4 IPA Artificial intelligence Machine learning

Please contact me at:

[email protected]

21

“If we knew what it was we were doing, it

would not be called research, would it?”

-Albert Einstein

Page 22: Intelligent Process Automation in Auditescoladecontas.tce.mg.gov.br/.../07/...automation.pdf · Intelligent Process Automation (IPA) 4 IPA Artificial intelligence Machine learning

“Think-Feel-Do” loop of IPA

22

Drones, NLP, IoT, etc. PPA/RPA

AI and

cognitive

technologies

Human

Think

DoFeel

Page 23: Intelligent Process Automation in Auditescoladecontas.tce.mg.gov.br/.../07/...automation.pdf · Intelligent Process Automation (IPA) 4 IPA Artificial intelligence Machine learning

The Audit Workflow Driven by IPA

23

Smart

workflow

Smart

workflow

Smart

workflow