soa admin handbook - examsoft handbook examsoft worldwide page 5 of 29 version 3.5.0 minimum...

S O A H A N D B O O K

2 0 0 7 / 2 0 0 8

A D M I N I S T R A T O R S G U I D E

SOA Handbook ExamSoft Worldwide

of 29 version 3.5.0


of 29 version 3.5.0

Table of Contents

Table of Contents .....................................................................................................3 Overview.................................................................................................................4 Minimum Specifications for Testing Computers..............................................................5

1.1. Computer Requirements: ............................................................................5 1.2. Vista Users:...............................................................................................5

SofTest Use Summary...............................................................................................6 2.1. Installing Softest........................................................................................6 2.2. Taking the Mock Exam ................................................................................6 2.3. Taking Real Exams .....................................................................................6 2.4. Uploading the Answer File ...........................................................................6

Softest Use Checklist.................................................................................................8 Installing SofTest......................................................................................................9

Router/Proxy Configuration ................................................................................9 4.1. Single File Install (Single/Multi User).............................................................9 4.2. Image Install .............................................................................................9 4.3. Active Directory Install ................................................................................9

SofTest Use - Downloading an Exam File.................................................................... 10 SofTest Use - Opening an Exam File .......................................................................... 13 Softest Use - Taking the Exam ................................................................................. 15 Softest Use - Exiting the Exam ................................................................................. 19 Softest Use - Uploading the Answer File ..................................................................... 21 Check Exam Download/Upload History (Exam Candidate) ............................................. 23 Trouble-Shooting.................................................................................................... 24

11.1. Restart (reboot) Loop..............................................................................24 11.2. Permissions ...........................................................................................24 11.3. SofTest doesn’t boot into Secure Mode ......................................................24 11.4. Candidate Break.....................................................................................24 11.5. Error Message: A newer version resides on the server..................................26 11.6. Error Message(s): when Starting an Exam..................................................26 11.7. Error Message: Unable to Establish an Internet Connection...........................26 11.8. Error Message: Type ‘13’ Mismatch ...........................................................26 11.9. ISA Server Firewall .................................................................................26 11.10. Mid Exam Restart .................................................................................26 11.11. Manual Upload (Auto Upload Does Not Work)............................................27

Contacting ExamSoft Support................................................................................... 29 12.1. Contacting ExamSoft Support...................................................................29 12.2. Support Management:.............................................................................29 12.3. Networking Issues:.................................................................................29


of 29 version 3.5.0

Overview SofTest is designed by ExamSoft exclusively for use in high stakes examinations and performs three critical functions in the exam administration process. It is used to secure the testing computer, securely locate, open, write, and return encrypted exams and preserve the integrity of the exam content and process.

SofTest operates on Windows 2000, XP, and Vista platforms and is not dependent upon the installation of any third party programs, dedicated servers or server software.

Candidate exam files are downloaded and answer files auto-uploaded via the Internet using SofTest. Internet connectivity is ONLY required to download and upload exams. Internet Connectivity is NEVER required DURING an exam.

During a SofTest secure exam, SofTest prohibits normal behaviors including:

Windows Desktop Icons,

Task Bar Availability,

Power Management,

Desktop Wallpaper and Screen Savers,

Task Switching (Alt-Tab behavior),

Start Menu and Control-Escape behavior,

Task Manager Access (Ctrl-Alt-Delete behavior),

It forces closure of all open programs and windows not associated with the exam process,

Windows clipboard control, and

Prevents creation of any new windows or processes by the user or any pre-existing scheduled activity (e.g. reminder programs, etc.).

SofTest blocks the use of virtual programs and prevents the running of select Windows services that could be used to breach security. (i.e. VirtualPC, VMWare, NetOP, Multiple XP users, etc.) Exam files opened are opened exclusively by SofTest and cannot be viewed by any other user.


of 29 version 3.5.0

Minimum Specifications for Testing Computers

1.1. Computer Requirements: CPU = 450 MHz Pentium III or Industry Equivalent RAM = 256 MB Drives = 50 MB of free space and one floppy disk drive Operating System = Windows 2000 (Pro), XP (Home, Pro or Tablet PC) or Windows Vista Software = Internet Explorer 6.0 or greater Internet Access for Sign Up, Registration, Exam Download and Upload AOL Users - Version 6.0 or higher required Screen Resolution must be 1024x768 or higher

1.2. Vista Users: Please note that your computer must meet the minimum requirements for the specific edition of Vista you are using. Please check the documentation that came with Vista to find these requirements.


of 29 version 3.5.0

SofTest Use Summary

2.1. Installing Softest

Softest may be installed using our MSI Installer (page 9). Installing SofTest REQUIRES Administrative rights to the local computer. Using SofTest does NOT REQUIRE Administrative rights.

2.2. Taking the Mock Exam

To insure SofTest has been properly installed, after installation reboot the computer and log into Windows using a user account with the same level of permissions used by your exam candidates. Next, using the User ID and Password combination assigned to YOU by ExamSoft, launch Softest, download a copy of the Mock Exam, complete it and upload the answer file.

The Mock Exam simulates the exam taking process the exam candidate will encounter on exam day. Taking the Mock Exam will identify any underlying issues with Intranet firewalls, proxy server settings or permissions (see 11.2. Permissions page 24).

2.3. Taking Real Exams

Once the Mock Exam has been completed, SofTest is ready for use on exam day. EVERY exam candidate MUST download their copy of the exam using the unique ID and Password combination assigned to them by SOA. DO NOT DOWNLOAD one exam file and then copy it to multiple machines. DO NOT USE another exam candidates ID and Password to download an exam file for use by someone else. EVERY exam candidate MUST USE the ID and Password provided to them by SOA to download a copy of their exam.

2.4. Uploading the Answer File

SofTest will automatically upload the answer file after the exam has been closed provided the exam candidate logs back into Windows. Accordingly ALL exam candidates MUST log back into Windows for SofTest to auto return the answer file. DO NOT uninstall SofTest or re-image the testing computer until the exam candidate has received their score.


of 29 version 3.5.0


of 29 version 3.5.0

Softest Use Checklist

The checklist below is an overview summarizing the entire examination process. Please be sure to cover each and every aspect illustrated below to ensure a successful examination.


of 29 version 3.5.0

Installing SofTest

Below are (3) methods for deploying Softest into your computer lab environment. Each method requires the use of our Softest MSI installer. To obtain a copy of our MSI installer go to www.examsoft.com/SOA and select ‘Administrators’, then ‘Lab Management’. Follow the instructions on screen to create a login. Once your login has been approved you will receive an email. You may then submit lab details to request an installer. Once your lab details have been approved and an installer has been prepared, you may return to download it.

Router/Proxy Configuration

Exam files downloaded and uploaded using SofTest are transmitted via HTTP. To enable this basic functionality port 80 must be opened for traffic to www.examsoft.com. If you use a proxy server, ideally traffic to and from www.examsoft.com will bypass the proxy server. If your proxy server performs caching your caching functionality should be disabled for www.examsoft.com.

4.1. Single File Install (Single/Multi User)

1) With Administrative Level Rights log into the computer that you want to install Softest on.

2) Go to the link provided to you by ExamSoft or navigate to where you have the Softest MSI stored.

3) If you are installing from the URL link ExamSoft provided you then Click ‘Run’ when prompted, to install Softest locally.

4) Follow the on-screen instructions.

4.2. Image Install

SofTest can be installed onto a system image that can be deployed to a lab environment. Once you downloaded the Softest MSI follow the steps below:

1) With Administrative Level Rights log into the computer that you want to install Softest on.

2) Go to the link provided to you by ExamSoft or navigate to where you have the Softest MSI stored.

3) If you are installing from the URL link ExamSoft provided you then Click ‘Run’ when prompted, to install Softest locally.

4) Follow the on-screen instructions.

5) Create the image using your imaging software then deploy it on onto your lab computers.

4.3. Active Directory Install For distribution using Active Directory download the MSI installer and follow the directions outlined by Microsoft for distribution of software using Active Directory.


of 29 version 3.5.0

SofTest Use - Downloading an Exam File

Step 1 - Log onto your computer and establish an Internet connection.

Step 2 - Launch SofTest by clicking the shortcut icon as shown below.

Figure 1

Step 3 - When SofTest Launcher displays, select ‘Download Exam Files’ as shown in Figure 2 below.

Figure 2 Step 4 - Enter the Candidate ID number and Password provided by SOA and click ‘Next’ as shown in Figure 3 below.

Figure 3


of 29 version 3.5.0

Step 5 - The Exam Files are now displayed. Click on the Exam File you want to download and then click the ‘Download’ button as shown in Figure 4 below.

Figure 4

Step 6 - When the Exam File downloads, a ‘Success’ message window is displayed as shown in Figure 5 below.

Figure 5

Step 7 - The Exam File has been downloaded and now resides locally on the testing computer inside the ‘Exams’ folder in the SofTest program directory. Click ‘Close’ as shown in Figure 6 below to exit SofTest Launcher.


of 29 version 3.5.0

Figure 6


of 29 version 3.5.0

SofTest Use - Opening an Exam File

Step 1 – From SofTest Launcher, select ‘Launch SofTest’ as shown in Figure 7 below.

Figure 7

Step 2 – SofTest is now open (Figure 8 below).

Figure 8


of 29 version 3.5.0

Step 3 – To access an Exam File, click the drop down arrow and highlight an exam as shown. The Exam File is auto loaded into SofTest and the Candidate ID, First Name, Last Name, Exam Name, Instructor and Exam File Location text fields are automatically updated (Figure 9 below). Put in the password given to you by your exam proctor and then be sure to select the language you wish to take the exam in, either ‘French’ or English’. Then click on the ‘Begin Exam’ button.

Figure 9

NOTE: Your computer will now reboot into secure mode and you will be prompted to log back into Windows. ALWAYS enter the same username/password combination used to log into Windows.


of 29 version 3.5.0

Softest Use - Taking the Exam

Exam Notice Screens – After ‘Begin Exam’ is selected, the computer reboots and the exam candidate logs back into Windows, SofTest displays the Exam Notice Screens. Exam Notice Screens are used to communicate information about the exam to the Candidate before the first question is displayed (Figure 10below).

Figure 10

Timed Exams – SofTest can manage enforcement of the time allowed to work in the exam. If this option is used, one (1) minute into the exam a ‘SofTest Alert’ is displayed advising how many minutes Candidates have to complete their work. SofTest automatically warns Candidates when two (2) minutes remain. If Candidates wish to be warned prior to two (2) minutes, they may enter a time in the text box labeled ‘Warn again in’ (Figure 11 below).

Figure 11


of 29 version 3.5.0

When two (2) minutes remain, SofTest will display ‘SofTest Reminder’ advising Candidates only two (2) minutes remain to finish their work. Once this reminder is displayed Candidates must finish their exam and close SofTest within two (2) minutes. If Candidates do not close SofTest within two (2) minutes, SofTest will automatically close their exam and the following message will appear. The exam candidate’s only option is to click ‘OK’ and exit SofTest. See Figure 12

Figure 12

Question Navigation - Each question is displayed individually. Candidates use the blue ‘Navigation Arrows’ or ‘Question Navigator’ feature to move between questions. See Figure 13

Figure 13


of 29 version 3.5.0

Essay Questions - Candidates have access to a full range of word processing features. See Figure 14

Figure 14

Multiple Choice Questions

Figure 15


of 29 version 3.5.0

True/False Justification

Figure 16


of 29 version 3.5.0

Softest Use - Exiting the Exam

Step 1 – Exit the exam by clicking the ‘Exit Exam’ button, the ‘X’ in the upper right hand corner of the window or by selecting ‘File…Save & Exit’, as shown in Figure 17.

Figure 17

Step 2 – When any of these three ‘Exit’ options are selected, a message is displayed as shown in Figure 18. Once ‘Close Exam’ is selected, the Exam File CANNOT be re-opened.

Figure 18


of 29 version 3.5.0

Step 3 – When ‘Close Exam’ is selected, the screen shown in Figure 19 is displayed. Select ‘Exit’ to close SofTest and upload the completed exam (Answer File).

Figure 19

Step 4 – When ‘Exit’ is selected, the screen shown in Figure 20 is displayed and SofTest closes.

Figure 20

NOTE: Your computer will now reboot out of secure mode and you will be prompted to log back into Windows. You MUST log back into windows for Softest to automatically upload your Answer File. ALWAYS enter the username/password combination used to log into Windows.


of 29 version 3.5.0

Softest Use - Uploading the Answer File

After the exam closes the computer will reboot back into Windows or to your Windows login. If you used a unique username/password combination to log into Windows, use that same combination to log back into Windows.

If Internet connectivity exists and there are answer files available, SofTest automatically uploads all answer files. A message window confirms the file has uploaded and an email confirmation is sent to the candidate. See Figure 21 below.

Figure 21

If an Internet connection does not exist and there are answer files available for upload, SofTest displays the following message See Figure 22 below.

Figure 22


of 29 version 3.5.0

If auto-uploading the answer file fails the candidate is given another opportunity to auto upload or to manually upload. See Figure 23 below.

Figure 23

If ‘Manual Upload’ is selected, the candidate is automatically logged into the CHP and given the following instructions for manual uploading their answer file. See Figure 24 below.

Figure 24


of 29 version 3.5.0

Check Exam Download/Upload History (Exam Candidate)

Within Softest exam candidates have the ability to the view the status of the exam files they have downloaded. From SofTest Launcher, select ‘Download History’ as shown in Figure 25 below. Next, enter your ID and password provided to you by SOA. A web page will appear detailing your exam upload/download history.

Figure 25


of 29 version 3.5.0

Trouble-Shooting

11.1. Restart (reboot) Loop

In order to exit from a reboot loop press <Ctrl><Alt><Delete> after you have logged in with your ID and password or when Windows seems to lock up. Next, select Task manager (<alt> T). Select File, New Task (Run…), type ESWINSR. This will start SofTest’s Windows Shell Restorer. Click on the Restore Settings button. Next Select YES to restore and reboot.

11.2. Permissions

SofTest installation requires Administrative level rights. Using SofTest to take an exam, users do NOT need Administrative rights. Below are the registry keys and directories that the User does need read/write permissions to in order to use Softest.

HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\Windows NT\CurrentVersion\Winlogon

HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\Windows\CurrentVersion\RunOnce

HKEY_LOCAL_MACHINE\SOFTWARE\zrattet

C:\Program Files\ExamSoft\Softest

C:\Documents and Settings\All Users

11.3. SofTest doesn’t boot into Secure Mode

Upon selecting the exam file and clicking the ‘Begin Exam’ button Softest should reboot the computer into secure mode. Secure mode works by modifying the Shell registry key so that SofTest runs instead of Explorer. If Softest doesn’t reboot into secure mode, and the user reboots into the normal desktop environment, then check to ensure the user running SofTest has read/write permissions on the following registry key.

HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\Windows NT\CurrentVersion\Winlogon

11.4. Candidate Break

During an exam Candidates may have a legitimate reason to leave their workstation and return. SofTest exam files are single use files so are not to be closed until the exam is completed. To prevent other Candidates from viewing their monitor, the ‘Hide Exam’ feature may be used. Selecting ‘Hide Exam’ will hide the screen. Once hide, clicking anywhere on the screen will reopen the screen. See Figure 26 below.


of 29 version 3.5.0

Figure 26


of 29 version 3.5.0

11.5. Error Message: A newer version resides on the server

If you are installing SofTest using ExamSoft’s web installer and you encounter a message stating that, “there is a newer version of Softest on the Server.” Then clear you’re Internet Explorer temporary Internet files. Also, if your site uses a caching proxy server then contact your IT Group and have them clear the temporary Internet files for the proxy server.

11.6. Error Message(s): when Starting an Exam

If you receive the following error(s) then either there is a security program locally installed on the computer preventing Softest from writing to the registry or the user doesn’t have the necessary privileges (permissions) for Softest to write to the registry. If no security software is present then please see item 11.2. Page: 24, Permissions.

Error: SofTest cannot open your exam. This may be the result of Anti-Spyware running on your computer. Disable or remove any Anti-Spyware and re-open SofTest. If this fails contact ExamSoft Client Support or your IT Department.

Error: Unable to start this exam. Failure to write shell information to the registry.

11.7. Error Message: Unable to Establish an Internet Connection

If you receive this error then you either have a locally installed Firewall preventing Softest from accessing the Internet or your companies, school’s, Intranet Firewall needs to be setup to allow Softest to communicate to www.examsoft.com over port 80.

11.8. Error Message: Type ‘13’ Mismatch

If you receive this error when you are trying to register softest then you either have a locally installed Firewall preventing Softest from accessing the Internet or your companies, school’s, Intranet Firewall needs to be setup to allow Softest to communicate to www.examsoft.com over port 80.

11.9. ISA Server Firewall

Although SofTest successfully downloads and uploads exams even in the presence of an ISA Server Firewall, in some cases, the ISA Server software miscalculates the final file integrity check of the answer files following the upload. Believing it to be a corrupted file, SofTest deletes the uploaded file. This can occur even if the ISA Server software is instructed to permit ALL traffic to the examsoft.com domain. As such, if you utilize an ISA Server Firewall, it might need to be disabled on the testing computers used during your exam cycle(s).

11.10. Mid Exam Restart

ALL exam files are single use files that may only be opened and closed once. In case of computer freezes or power outages SofTest manages exam recovery. In such an occurrence, security is maintained and the answer file is recoverable when the computer is rebooted.

Step 1 – Have the Candidate reboot the computer.

Step 2 –If the candidate used a unique username/password combination to log into Windows, use that same combination to log back into Windows again.

Step 3 - Upon recovery from a computer freeze or power outage the following message is displayed. These are the only 2 options available. Access to the computer is blocked until one of the options is selected. See Figure 27 below.


of 29 version 3.5.0

Figure 27

When ‘RESUME’ is selected, the exam file is reopened and access to the exam at the point of interruption is automatically restored. If the exam is timed, the timer is paused at the point of interruption and restarts when the exam is reopened. The Exam Taker is not penalized for the time elapsed while the exam was interrupted.

When ‘Exit’ is selected, the answer file found will be closed, a final save is made and encrypted answer files are created. The exam can no longer be re-opened.

11.11. Manual Upload (Auto Upload Does Not Work)

If auto-uploading the answer file fails, the Exam Taker is given another opportunity to auto upload or to manually upload. See Figure 28 below.

Figure 28


of 29 version 3.5.0

To use the Manual Upload option, select ‘Manual Upload’, see Figure 28 above. SofTest will automatically launch a web browser which will bring up the Manual Upload page. Follow the on-screen instructions to manually upload the answer file. See Figure 29 below.

Figure 29


of 29 version 3.5.0

Contacting ExamSoft Support

12.1. Contacting ExamSoft Support If you need assistance, please contact ExamSoft Support at [email protected] or by phone at 954-429-8889. Be sure to include your telephone number and city, state (if in US) and country in the event Support needs to contact you by phone.

Mailing Address:

ExamSoft Worldwide, Inc.

350 Jim Moran Boulevard, Suite 120

Deerfield Beach, Florida 33442

Phone: 954-429-8889 Fax: 954-429-0766

Normal Hours of Operation: Monday – Friday 8:30 AM – 5:30 PM Eastern Standard Time

Web Address:

www.examsoft.com/SOA

General Support Email:

[email protected] (to expedite please reference SOA and your school name in the subject line of your email)

Live Chat: Go to www.examsoft.com/SOA and click on support at the bottom right hand side of the page. Next, click on the button labeled ‘ExamSoft Support’. Enter the Login ID and password given to you by SOA and click the ‘login’ button. On the following page click on:

12.2. Support Management:

Janette Delgado – Client Support Manager

Direct Line: 866-429-8889 Ext 114

Email: [email protected]

David Sanders – Client Support Manager

Direct Line: 866-429-8889 Ext 112


12.3. Networking Issues:

Stephan Auerhahn - Systems Coordinator

Direct Line: 866-429-8889 Ext 107
