compari son of features: datadirector 3.x vs. 4

1 1

Questions? Contact your Account Manager or email feedback to [email protected] .

Rev. 11/21/11

Comparison of Features: DataDirector 3.x vs. 4.0

DataDirector 4.0 represents an evolution in form and functionality from previous versions. Though we have taken this opportunity to introduce several new features, including an updated user interface, streamlined Exams and Assessments tab, simplified assessment creation processes, additional item creation tools, reporting clusters, and custom performance band sets,, many key features have undergone only minor changes and should still be recognizable to experienced users.

If you have a question about a topic that you do not see addressed in this guide, please contact your Account Manager.

Table of Contents General Use ................................................................................................................................................... 4

Logging In and Getting Started ................................................................................................................. 5

Sharing, Hiding, Duplicating, and Deleting Assessments .......................................................................... 6

Communication ......................................................................................................................................... 7

Locating Demographic Search Options ..................................................................................................... 9

Assessments ................................................................................................................................................ 10

Working With Assessments in DataDirector 4.0 ..................................................................................... 11

Creating an Exam Shell vs. Creating an Answer Sheet Assessment .................................................... 14

Multiple Response Questions ............................................................................................................. 16

Matching Questions ............................................................................................................................ 18

True/False and Yes/No Questions....................................................................................................... 19

Rubric-Scored Questions ..................................................................................................................... 21

Short Answer / Extended Response Questions .................................................................................. 22

Number Grid Questions ...................................................................................................................... 23

Unsupported Question Types ............................................................................................................. 24

Aligning Questions to Standards ......................................................................................................... 25

mailto:[email protected]

2 2


Rev. 11/21/11

Adding Multiple Questions at Once .................................................................................................... 27

Marking All Responses Correct With the Asterisk Function ............................................................... 28

Using the Filled by Teacher Function .................................................................................................. 28

Creating an Item Bank Exam vs. Creating an Item Bank Assessment ................................................. 29

Creating an Assessment vs. Creating a Summary Assessment ........................................................... 34

Creating a New Exam .......................................................................................................................... 39

Attaching Additional Materials ........................................................................................................... 40

Using Auto Export ............................................................................................................................... 41

Modifying Items, Sections and Clusters in 4.0 ........................................................................................ 42

Other Assessment Tab Functions Found in the Assessment Module ..................................................... 45

Finding Former Exams Tab Functions in the Assessment Module ......................................................... 47

Uploading Data ................................................................................................................................... 49

Searching the Item Bank ..................................................................................................................... 50

Displaying All Items in the Item Bank ................................................................................................. 53

Displaying Your Own Items in the Item Bank ...................................................................................... 54

Displaying Districtwide Items in the Item Bank .................................................................................. 55

Displaying Pending Items in the Item Bank ........................................................................................ 56

Creating an Item.................................................................................................................................. 57

Searching for Archived Assessments ...................................................................................................... 62

Sections and Clusters .............................................................................................................................. 64

Adjusting Assessment and Exam Permissions ........................................................................................ 70

Finding and Organizing Assessments Using Folders in DataDirector 4.0................................................ 72

The Shared Assessments Folder ......................................................................................................... 72

The District Folder ............................................................................................................................... 72


3 3


Rev. 11/21/11

The State Assessments Folder ............................................................................................................ 72

The Personal Folder ............................................................................................................................ 73

Refreshing Assessments After Changing Filters .................................................................................. 73

Subfolder Deletion .............................................................................................................................. 73

Folder Permissions .................................................................................................................................. 74

Setting Up User Level Permissions ...................................................................................................... 76

Assigning User-Type and Site Level Permissions ................................................................................ 78

Putting it All Together: Assessments ...................................................................................................... 79

Reports ........................................................................................................................................................ 80

Exam Scoring ........................................................................................................................................... 81

Putting it All Together: Reports .............................................................................................................. 82

Performance Bands and Custom Reporting Clusters .......................................................................... 83

Curriculum ................................................................................................................................................... 88

Standards Search .................................................................................................................................... 89

Putting it All Together: Curriculum ......................................................................................................... 90

Students ...................................................................................................................................................... 91

Putting it All Together: Students ............................................................................................................. 92

Programs ..................................................................................................................................................... 93

Putting it All Together: Programs............................................................................................................ 94


4 4


Rev. 11/21/11

General Use


5 5


Rev. 11/21/11

Logging In and Getting Started

DataDirector 3.x DataDirector 4.0

The process for logging in is identical in both versions of DataDirector. Once a user enters their login information, they will be prompted to select a district.

DataDirector 3.x


6 6


Rev. 11/21/11

DataDirector 4.0

Sharing, Hiding, Duplicating, and Deleting Assessments DataDirector 3.x users will be familiar with several icons for sharing, hiding, duplicating, or deleting assessments. DataDirector 4.0 maintains all of the same functionality with an updated look and feel.

Functionality 3.x Icon 4.0 Icon

Share

Hide

Duplicate

Delete


7 7


Rev. 11/21/11

Communication

The Communication process has undergone minimal changes in DataDirector 4.0.

DataDirector 3.x

In DataDirector 3.x, users begin by clicking on the “Communication” tab, displaying the Search Users screen. The image below is how the page appears with the “advanced search” option enabled.

At this point, users have the option of searching for others in a number of ways. It is possible to view a list of site users, search by basic information like first or last name, or use advanced search options to locate and contact individuals.


8 8


Rev. 11/21/11

DataDirector 4.0

In DataDirector 4.0 users access communication options by hovering their mouse over the “Admin” option then clicking “Admin Tools.”

In the Admin Tools menu, the Communication option can be found along the left hand side.

At this point, the Communication process becomes identical to DataDirector 3.x.


9 9


Rev. 11/21/11

Locating Demographic Search Options

The Data Tab has been consolidated into the Students Module in DataDirector 4.0.

DataDirector 3.x

In 3.x, the Data tab allows users to search for demographic information in a separate tab.

DataDirector 4.0

In 4.0, the same options are accessed through the Students module.


10 10


Rev. 11/21/11

Assessments


11 11


Rev. 11/21/11

Working With Assessments in DataDirector 4.0 In DataDirector 3.x, Assessments and Exams were closely related, but separate. To improve the user experience, the functions performed within the Exams and Assessments tabs in DataDirector 3.x have been streamlined into the Assessments module within DataDirector 4.0.

DataDirector 3.x

In DataDirector 3.x, the Assessments tab is selected from the navigationbar at the top of the page. Opening the Assessments list, allows users to perform a number of key functions. Similiarly, users can access separate functions in the Exams tab.

DataDirector 4.0

In DataDirector 4.0, users access the Assessments module through the Application Switcher.


12 12


Rev. 11/21/11

Once the Assessments module is open, users will see the Find Assessments screen. This area serves as a hub for numerous folder-based activities, including finding Assessments within the folder structure. For more on folders, permissions and locating assessments, please see Finding and Organizing Assessments Using Folders in DataDirector 4.0.

In DataDirector 3.x, Exams and Assessments were created separately under the Exams and Assessments tabs. In DataDirector 4.0, these functions have been streamlined into the same creation process.

DataDirector 3.X DataDirector 4.0


13 13


Rev. 11/21/11

In 4.0, clicking the Create Assessment link will begin the process, opening up the Create an Assessment page where users can choose which type of assessment they would like to create.

The new types of Assessments and how they differ from their 3.x counterparts are explained in the Creating an Exam Shell vs. Creating an Answer Sheet Assessment, Creating an Item Bank Exam vs. Creating an Item Bank Assessment, and Creating an Assessment vs. Creating a Summary Assessment sections below.


14 14


Rev. 11/21/11

Creating an Exam Shell vs. Creating an Answer Sheet Assessment

The Answer Sheet Assessment in DataDirector 4.0 is a user-created test document that can be customized to suit the user’s needs. In 3.x, an answer sheet was known as an Exam Shell or an Alignment. An Answer Sheet will allow students to take a teacher created or publisher test and record their answers on a bubble sheet, simplifying scoring and data upload for non-Itembank tests.

In 3.x, Exam Shell creation begins by clicking on the Exams tab, followed by the Create a New Exam link. This will open the Exam creation wizard.The Exam Shell creation process actually begins when the user opts to not use the Item Bank for their exam.

The user must then enter the remaining creation information, including their answer key, which will be used to generate their answer sheets. Users can then administer their test, scan in student responses, and begin analyzing data.

In 4.0, users will first need to access the Create an Assessment page through the Application Switcher. Clicking this link will open the Create Answer Sheet Assessment page, where the New Answer Sheet Assessment option is available.


15 15


Rev. 11/21/11

Clicking this link opens the Create Answer Sheet Assessment page. Here, users can edit the name of their assessment, select grade levels and subject areas as well as set the school year and date of the assessment. Users can also determine question types, fill in their answer key and link questions to standards.

Note that a variety of question type options exist: multiple choice, multiple response, matching, true/false, yes/no, short answer, rubric-scored, extended response, and number grids. The newer formats are reviewed in detail on subsequent pages.

If the user wishes to create an answer key for scanning purposes, the correct answer for each question on the Assessment must be noted by clicking it, darkening the circle. It’s also possible to deselect an answer by clicking it a second time.

It’s also possible for users to create and save an Answer Sheet assessment without noting any correct answers, effectively creating a bubble sheet that can be scored and entered manually.

It is always best practice to keep similar question types in the same section. Users alst must limit answer documents to one page in length for DataScanner use.


16 16


Rev. 11/21/11

Multiple Response Questions

Multiple Response Questions are a new feature in DataDirector 4.0 which allow users greater flexibility in creating Answer Sheet Assessments.

Multiple Response Questions allow a user to specify more than one correct answer for a question. For a student to score a correct on the question, they must identify each of the appropriate answers. On the above example, options A and C are the correct responses. The answer would only be marked correct if both A and C were selected.

It’s possible to customize answer choices for Multiple Choice questions in DataDirector 4.0. To begin, click the “edit” link to the right of the Answer column.

This will open up the default options for customization. Users can select from these or choose the “Custom” button for further options.

Clicking on the “Custom” button will open up a larger array of letter choices to include on the answer sheet, as well as numbers. Selected letters will appear in the box at the top of the window. Unwanted choices can be removed by hovering the pointer over the appropriate letter and clicking the red “X” that appears.


17 17


Rev. 11/21/11

Clicking the “Done” button will return the user to the initial question, with their new answers included.


18 18


Rev. 11/21/11

Matching Questions DataDirector 4.0 incorporates support for matching questions on Answer Sheet Assessments. To make a matching section, begin by selecting Multiple Choice as your question type.

Ensure that you have the same number of matching questions as answer choices in the section. Set the correct answers and align standards to complete the section.

It’s important to keep in mind that any question with more than 6 answer choices will receive its own line on the answer document. Questions with 6 or less answer choices will be grouped with up to three questions on the same line.


19 19


Rev. 11/21/11

True/False and Yes/No Questions

True / False questions are a new feature in DataDirector 4.0 which allow users greater flexibility in creating Answer Sheet Assessments. True / False questions ask students to determine whether a statement is true or false.

Clicking the “edit” link allows these questions to be customized.

Users form “Yes / No” questions, in which a student must determine whether the correct answer to a question is “Yes” or “No,” and select appropriately. It’s also possible to choose custom answer letters.

To delete an answer choice, hover your pointer over the letter and click the red “X.”


20 20


Rev. 11/21/11

Clicking “Done” will return you to the Answer Sheet screen.

Note that the system categorizes Yes / No questions as True / False questions.


21 21


Rev. 11/21/11

Rubric-Scored Questions Rubric-Scored Questions allow for partial credit to be given based on a student’s response, making it ideal for incorporating essay questions into an Assessment.

When creating a Rubric-Scored question, it’s possible to customize the number of levels by clicking on the “edit” link.

This will bring up a dialog box where you can select the number of levels you would like your question to have. Enter the number of points you wish your question to be worth to the right of the level area.

It’s important to keep in mind that however many levels are possible for scoring is what the total number of points will be divided by. For example, a 24-point question with 6 levels will provide 4 additional points for every level a student moves up.

Currently, it is not possible to customize rubrics beyond the options available. It is also not possible to rubric-score a number grid question. This functionality may be included in later releases. For more on number grid questions please see Number Grid Questions.


22 22


Rev. 11/21/11

Short Answer / Extended Response Questions

Short Answer Questions have been implemented to provide even greater flexibility in the types of questions teachers can use on Answer Sheet Assessments. To use a short answer question, simply mark whether the student supplied the correct response on their answer sheet while entering data. It’s also possible to customize answer types on Short Answer questions by clicking the “edit” link.

This will open the customization options window.

Clicking on the “Custom” radio button will open further customization options.

To delete an answer choice, hover your pointer over the letter and click the red “X.” Clicking on the “Done” button will return you to the Answer Sheet creation screen. DataDirector does not currently support more than two bubbles for short answer questions.


23 23


Rev. 11/21/11

Number Grid Questions

Number grid questions allow open-ended responses to math or numerical questions. The process for creating these questions in 4.0 is different from 3.x.

In the “Answer” column, DataDirector displays the number of columns students will have available to fill in, along with the currently selected correct answer. These will default to 5 and 0, respectively. Note that although there are five columns available to students, they will not all need to be used. It is not possible to customize the number grid’s appearance.

Number grid data from DataDirector 3.x will be valid in 4.0, however; it will not be possible to duplicate 3.x exams with customized number grid items in 4.0. All number grids in 4.0 will need to use columns with digits from 0 to 9. Further opportunities for customization will be available in subsequent releases.


24 24


Rev. 11/21/11

Unsupported Question Types Question types that can no longer be created in 4.0 will be marked on Assessments as “Unsupported Question Types.” While the data for these question types is still valid and can be used in DataDirector, it is not possible to duplicate the actual items used to obtain the data.

Such questions include all former matching questions created through the use of short answer, number grid, or rubric items in Exam Shells.

It was also possible to create a number grid in 3.x using rubric questions. Users would select the “Block” configuration for Rubric Clusters as pictured below with the resulting appearance on an Answer Sheet.

Any questions of this type created in 3.x will be converted to number grid questions in 4.0 and will appear differently on bubble sheets.


25 25


Rev. 11/21/11

Aligning Questions to Standards

In DataDirector 3.x, it was possible to add standards to a question by searching for standards and then linking them to specific questions in the assessment.

In 4.0, this functionality still exists, but is executed differently. For Item Bank Assessments, standards are added automatically with questions. However, standards may also be added directly from the Edit Assessment page.


26 26


Rev. 11/21/11

Clicking on the Add Standards button will bring up a Standards Search window that will be familiar to 3.x users. This window makes it possible to attach additional standards to an Assessment.


27 27


Rev. 11/21/11

As standards are added to an Assesment, they will be listed under the Currently Aligned Standards area. Standards links for individual questions can be edited by clicking on the blue text in the Standards column.

For more on Standards, please see the Standards Search section.

Adding Multiple Questions at Once

In DataDirector 4.0, it’s also possible to add multiple questions to an Answer Sheet Assessment at once.

Click the “Add Multiple Questions” icon at the bottom right hand corner of the screen. This will bring up a slider which you can use to adjust how many questions will be added to the Assessment.

For subsequent additions, the system will by default add more of whatever question type the user has most recently selected. To change o a different question type, it’s necessary to select it from the drop-down menu prior to clicking the Add Multiple or Add Question button.

Please note that the Add Multiple option will only appear once during the creation process – once it has been selected and used, the button will be replaced with a slider bar allowing the user to choose how many questions of each type are added at a time.


28 28


Rev. 11/21/11

Marking All Responses Correct With the Asterisk Function

The Asterisk function in DataDirector 4.0 will cause all responses for the indicated item to be marked as correct. To use this function, simply place an asterisk in the Points column during Assessment creation.

Using the Filled by Teacher Function

The Filled by Teacher option is a new function for DataDirector 4.0. This function is best suited for Short Answer, Rubric and Number Grid items. Checking this option provides instructions on the Answer Sheet for students not to mark in the bubbles on those questions. This allows users to determine whether a student’s answer is correct before scoring.


29 29


Rev. 11/21/11

Creating an Item Bank Exam vs. Creating an Item Bank Assessment

The Item Bank Assessment in DataDirector 4.0 is a user-created test, including questions, that is generated to suit the user’s needs. Users opting to create this type of exam will pull items from sets of items available to that user including Riverside items, district-created items, and items previously created by the user.

In 3.x, this exam is created by clicking on the Exams tab, followed by the Create a New Exam link. This will open the standard Exam creation wizard.The user must answer Yes when prompted about whether they will be using the Item Bank to construct their exam.

Users must then search for and select items from the associated Item Bank to begin creating their exam.


30 30


Rev. 11/21/11

Once items are selected, the exam can be previewed and edited finalization and exportation to assessment. To create this type of assessment in 4.0, users first need to access the Assessments module from the Application Switcher.

This will open the Find Assessments page. Here, users need to click on the Create Assessment link to proceed.


31 31


Rev. 11/21/11

Doing so will open the Create an Assessment page, where the New Item Bank Assessment option is available.

Clicking this link will open the Create Itembank Assessment page. Here, it’s possible for users to edit the name of their assessment, select grade levels and subject areas as well as set the school year and date of the assessment. Users can also add questions to their assessment by clicking “Add Items” at the bottom of the page.


32 32


Rev. 11/21/11

Clicking the Add Items button will open the Item Search window, where it’s possible to apply a number of filter criteria in order to find appropriate items. The itembank search function has not changed.

Once the user has searched for and selected their items, they can close out the search window to return to the Edit Itembank Assessment page.


33 33


Rev. 11/21/11

Here, it’s possible to create and assign questions to sections. For more on sections and clusters, please see Searching for Archived Assessments or contact an Account Manager.


34 34


Rev. 11/21/11

Creating an Assessment vs. Creating a Summary Assessment

The Summary Assessment in DataDirector 4.0 is a spreadsheet containing summary data. Summary Assessments include data uploaded from state sources (state tests) and local assessments customized to suit the user’s needs.

In 3.x, an Assessment is created by clicking on the Assessments tab, then clicking Create New Assessment. This brings up the Edit Assessment Summary page.

Users enter their preliminary information before proceeding to name their fields and enter point values for each subject.


35 35


Rev. 11/21/11

Users may then enter the number of points each student has earned in each of the subject areas being assessed or upload the data from a file. Once data is entered, they can save their work and return to the menu for their Assessment.

To create this type of assessment in 4.0, users first need to access the Assessments module from the Application Switcher.


36 36


Rev. 11/21/11

This will open the Find Assessments page. Here, users need to click on the Create Assessment link to proceed.

Doing so will open the Create an Assessment page, where the New Summary Assessment option is available.


37 37


Rev. 11/21/11

Clicking this link will open the New Assessment Summary page. This page is identical to the current 3.x Assessment creation. Here, it’s possible for users to edit the name of their assessment, select grade levels and subject areas as well as set the school year and date of the assessment. Users will also need to select how many fields will appear in their Assessment Summary.

Users can then name each of the fields they’ve specified and apply a maximum value for each area.


38 38


Rev. 11/21/11

After clicking on Next Step, the Assessment Summary will appear. Users can then upload pre-existing data, enter their own data, or export the Summary as a report.


39 39


Rev. 11/21/11

Creating a New Exam The process for Exam and Assessment creation is combined in DataDirector 4.0.


Users in 4.0 will need to click the Create Assessment link in order to begin the process. This will open up the Create an Assessment page.

Here, users can choose which type of assessment they would like to create, and proceed as normal. For more information on the different types of assessments in


40 40


Rev. 11/21/11

DataDirector 4.0, please see Working With Assessments in DataDirector 4.0 or contact your Account Manager. For more information on other former Exam functions, please see Finding Former Exams Tab Functions in the Assessment Module.

Attaching Additional Materials

Attaching supplementary materials to an Exam or Assessment in 3.x is accomplished on the overview page of either the Assessment or Exam. The function is not available during Exam or Assessment creation in 3.x.

To use this feature, users must click the Add/Remove Additional Materials link while on the main information page of either the Assessment or Exam.

To attach additional materials to an exam in 4.0, users must click the Upload a File button during the beginning of the assessment creation process. This functionality is available on the edit assessment page. To attach materials after an assessment has been created, click the “Edit Assessment” link in the left hand navigation.


41 41


Rev. 11/21/11

Using Auto Export The Auto Export feature is enabled by default in DataDirector 4.0. Once users enter student data into an Itembank Assessment or an Answer Sheet (formerly an Itembank Exam or Exam Shell), that data will automatically be exported into a Summary Assessment (formerly an Assessment). The Summary Assessment will be linked to the Itembank Assessment or Answer Sheet through the “Summary Assessment” link in the left hand navigation.


42 42


Rev. 11/21/11

Modifying Items, Sections and Clusters in 4.0 In DataDirector 3.x, modification of items, sections and clusters was accomplished using the Modify Questions/Items link on the main page of the user’s Exam.


43 43


Rev. 11/21/11

This would open the Modify Questions / Items screen, where it was possible to rearrange the exam by entering the order in which the user wanted questions to appear. Clusters were added on a separate page with a different process.

In 4.0, these same changes can all take place on the main Edit Assessment page. Sections and questions can be added easily by selecting the Add Section and Add Items buttons. Users can rearrange questions and sections on-the-fly using convenient handlebars on the left side of the screen.Simply grab the handle bar and drag and drop each question or section into the appropriate location.


44 44


Rev. 11/21/11

Users can also edit their reporting cluster information from the Edit Assessment page. This functionality is identical within the Create Answer Sheet Assessment module.

For more on Sections and Clusters in 4.0, please see Sections and Clusters.


45 45


Rev. 11/21/11

Other Assessment Tab Functions Found in the Assessment Module The functions performed within the Assessments tab in DataDirector 3.x have been streamlined into the Assessments module within DataDirector 4.0. The process for accessing these functions is different in both versions.

DataDirector 3.x

In DataDirector 3.x, the Assessments tab is selected from the tab bar at the top of the page. This will open the Assessments List, where a number of key functions can be found on the left hand side menu.

DataDirector 4.0

In DataDirector 4.0, users need to access the Assessments module through the Application Switcher.


46 46


Rev. 11/21/11

Once the Assessments module is open, users will see the Find Assessments screen.

Here, users can access a number of familiar features from DataDirector 3.x. The View Assessments function has been rolled into the Find Assessments section of the Assessments menu, which is the default window in the Assessment module.

Each of the Assessment functions within DataDirector 4.0 works the same as in previous versions.



47 47


Rev. 11/21/11

Finding Former Exams Tab Functions in the Assessment Module The functions performed within the Exams tab in DataDirector 3.x have been streamlined into the Assessments module within DataDirector 4.0. The process for accessing these functions is different in both versions.

DataDirector 3.x

In DataDirector 3.x, the Exams tab is selected from the tab bar at the top of the page. This will open the Exams List, where a number of key functions can be found on the left hand side menu.

DataDirector 4.0

In DataDirector 4.0, users need to access the Assessments module through the Application Switcher.


48 48


Rev. 11/21/11

Once the Assessments module is open, users will see the Find Assessments screen.

Here, users can access a number of familiar features from DataDirector 3.x.


49 49


Rev. 11/21/11

Uploading Data

It is possible to upload pre-existing data in both versions of DataDirector; however, the process is located in different areas on each version. While under the Exams tab in DataDirector 3.x, users can click “Upload to Multiple Assessments” in order to incorporate pre-existing data into different exams.


In DataDirector 4.0, users must first navigate to the Assessments module through the Application Switcher. Once there, users can click on the upload function, which then becomes identical to the function from 3.x.


50 50


Rev. 11/21/11

Searching the Item Bank

DataDirector 3.x

To perform an Item Bank search in DataDirector 3.x, users need to first access the Exams tab. This opens the Exams List page, where the “Search Item Bank” feature is available on the left hand side menu.

The Item Bank can then be searched using a number of criteria, including Item ID numbers, filtering state and national standards, and item publisher. The user is then able to add the desired items to their exam.


51 51


Rev. 11/21/11

DataDirector 4.0

To search the Item Bank in DataDirector 4.0, users must navigate to the Assessments page from the Overview page using the Switcher in the upper-left hand corner of the screen.

Once on the Assessments page, the user needs to click on the Manage Item Bank tab on the left hand side of the screen.


52 52


Rev. 11/21/11

Once at the Item Search page, the user can proceed to search just as they would have in DataDirector 3.x. Users can also browse all items, their own items and items created by others in the district. As DataDirector 4.0 continues to grow, new functionality will be added to this tab.


53 53


Rev. 11/21/11

Displaying All Items in the Item Bank

It is possible to view a list of every item in the Item Bank, but the process is different in both versions of DataDirector. In DataDirector 3.x, this list is accessed under the Exams tab by clicking on the All Items link.


In DataDirector 4.0, users will find this function within the Assessments module. There, users need to click on the Manage Item Bank link (pictured above) in order to access the Item Bank menu, where the “All Items” link can be selected.


54 54


Rev. 11/21/11

Displaying Your Own Items in the Item Bank

It is possible to view a list of only items that you have created in the Item Bank, but the process is different in both versions of DataDirector. In DataDirector 3.x, this list is accessed under the Exams tab by clicking on the My Items link.


In DataDirector 4.0, users will find this function within the Assessments module. There, users need to click on the Manage Item Bank link (pictured above) in order to access the Item Bank menu, where the My Items link can be selected.


55 55


Rev. 11/21/11

Displaying Districtwide Items in the Item Bank

It is possible to view a list of district-specific items in the Item Bank, but the process is different in both versions of DataDirector. In DataDirector 3.x, this list is accessed under the Exams tab by clicking on the Districtwide Items link.


In DataDirector 4.0, users will find this function within the Assessments module. There, users need to click on the Manage Item Bank link (pictured above) in order to access the Item Bank menu, where the “Districtwide Items” link can be selected.


56 56


Rev. 11/21/11

Displaying Pending Items in the Item Bank

It is possible to view a list of pending items in the Item Bank, but the process is different in both versions of DataDirector. In DataDirector 3.x, this list is accessed under the Exams tab by clicking on the Pending Items link.


In DataDirector 4.0, users will find this function within the Assessments module. There, users need to click on the Manage Item Bank link (pictured above) in order to access the Item Bank menu, where the “Pending Items” link can be selected.

Please note that this feature is available only to a limited number of users.


57 57


Rev. 11/21/11

Creating an Item

The primary difference in the item creation process between DataDirector 3.x and 4.0 is the number of item types users have the ability to create. In 3.x, it is only possible to create multiple choice questions, while 4.0 users can create multiple choice, true/false, yes/no, short answer and constructed response questions.

DataDirector 3.x

To create a new Item in DataDirector 3.x, users need to first access the Exams tab. This opens the Exams List page, where the “Create an Item” feature is available on the left hand side menu. This will open the Item Builder.

Once the Item Builder is open, it’s possible to create a new multiple choice question for use in assessments.

Once incorrect and correct answer choices are established, users need to note whether the item will wrap into more than one column, whether the item will be available for use in exams, the primary language of the item and its cognitive difficulty. At this point the user can finish the item creation process by clicking “Create Item.”


58 58


Rev. 11/21/11

DataDirector 4.0

To create an item in DataDirector 4.0, users must navigate to the Assessments page from the Overview page using the Switcher in the upper-left hand corner of the screen.

Once on the Assessments page, the user needs to click on the Manage Item Bank tab on the left hand side of the screen, which will take them to the Search Item Bank page by default.


59 59


Rev. 11/21/11

Once at the Item Search page, the user must click the “Create New Item” link.

The “Create New Item” link will take users to the Item Properties page, which is nearly identical to the Item Properties page found in 3.x. The main difference is the inclusion of a drop-down “Item Type” menu, which allows users to select between multiple choice, true/false, yes/no, short answer and constructed response questions. Please note that at this time, online testing only supports multiple choice item types.

The multiple choice item creation process is identical to the 3.x multiple choice item creation. However, if a user opts to create another type of question, the screen will automatically change accordingly.


60 60


Rev. 11/21/11

True/false and yes/no items are constructed using a radio button where the user notes the correct answer after typing the question. The true/false item type is pictured below, but the yes/no item type will appear in the same format.

Short answer questions are created by typing the question in the appropriate box and filling in the answer under the “Correct Answer” box.


61 61


Rev. 11/21/11

Constructed response questions are also created by typing the question in the appropriate box and filling in the answer under the “Correct Answer” box. Once a correct answer has been supplied, the user can then fill in Rubric Scores depending on what answer is appropriate for each point level. There are four rubric scores (0-3) by default, but more can be added or removed as needed.

Once the possible answers have been entered, the user needs to select whether the item will wrap into more than one column, whether the item will be available for use in exams, the primary language of the item and its cognitive difficulty. At this point the user can finish the item creation process by clicking “Create Item.”


62 62


Rev. 11/21/11

Searching for Archived Assessments

To search for an archived assessment in DataDirector 4.0, users must first enter the Assessments module via the Application Switcher.

This will open the Find Assessments page. Here, users need to click on the Switch to List View option.


63 63


Rev. 11/21/11

This will cause the window to appear like the one below.

Users will need to select the appropriate criteria for their assessment and activate the Show Archived Assessments filter before clicking the Search button. DataDirector will then return the search results.


64 64


Rev. 11/21/11

Sections and Clusters

Sections and reporting clusters are handled differently in DataDirector 3.x and 4.0. In 3.x, sections and clusters are not considered different entities.

DataDirector 3.x

To edit reporting clusters in 3.x, users must first locate and open the exam they wish to work with. Once this exam is open, they must click the “Links to Clusters” link. If no clusters currently exist, users will be prompted to create clusters. Once the clusters have been identified, the user can begin linking questions to clusters. To do so, the user must first click on the radio button of the desired cluster on the left hand side of the screen.

Then, they need to click and check off each of the questions they would like associated with that cluster. Finally, clicking the “Link” button will assign those questions to the appropriate cluster. Questions can be unlinked from reporting clusters in a similar fashion. The user can then click “Return to Exam” when they have finished assigning questions to clusters.

DataDirector 4.0

In DataDirector 4.0, sections and reporting clusters are considered different entities, and each has a unique function within the system. Sections have been reimplemented as distinct areas of a single exam, while clusters are used to better target reporting efforts. Each cluster can be assigned its own customized set of performance bands which will display in the Assessment Report.


65 65


Rev. 11/21/11

Users can still create reporting clusters based on sections of an assessment, but clusters can now also be structured around a group of standards, cognitive difficulty level, Bloom’s Taxonomy Level, or criteria defined by the user. Questions can even lie in different sections and still be added to the same cluster.

Since sections can be used as criteria for reporting clusters in DataDirector 4.0, this guide will first cover the creation of sections. To create an exam section, the user must locate and access the exam in which they wish to add sections.

Once the appropriate exam has been opened, the user needs to click on the “Edit Assessment” link on the left hand side of the “Assessment Overview” page.

This will open the “Edit Itembank Assessment” page or “Edit Answer Sheet Assessment” page.


66 66


Rev. 11/21/11

The user will need to scroll down until they locate the “Add Section” button.

Clicking this button will add a new section to the exam, which the user must then name. Questions can be added to the section by clicking the Add items link. In addition, users can reorder questions using the handlebars on the left hand side of each question to dragan item into a section. The sections of an assessment can also be rearranged in this fashion. Users should be sure to click “Save” before moving to another part of the assessment, or their changes will not be saved.


67 67


Rev. 11/21/11

Once the sections of an exam have been created (if necessary), a user can proceed to the cluster creation process. To begin, the user needs to click on the “Edit Reporting Clusters” link on the left hand side of the page. This link can be accessed from the Assessment Overview page.

Clicking the link will bring the user to the Reporting Clusters page, which will detail all the standards linked to the current Assessment, sections created, and any pre-existing clusters. Notice that the volume section created earlier is listed under the “Sections” area of the standards list.


68 68


Rev. 11/21/11

Scrolling to the bottom of the page will bring the user to the Custom Reporting Clusters section, where they can add a new reporting cluster to their Assessment ny clicking “Add a Reporting Cluster.”

Clicking this button will bring up a box titled “Creating New Cluster.”

Here, the user can identify the cluster’s name and check off which questions will be included in the cluster. Notice that Question 18 has automatically been listed in the Volume section so that the user can easily see how questions are grouped on the assessment.


69 69


Rev. 11/21/11

Once the user’s desired questions have been incorporated into the cluster, the user can also choose to add custom performance bands for that cluster.

To do so, the user must click on “Performance Band” and select the “New Performance Band” option. This will bring up the pictured box, where the performance band set can be titled and customized. Once a user is done entering this information, they need to click save in order to ensure their changes are preserved.

The cluster will then be added to the standards page. Once the user clicks on the save button on this page, the cluster will be ready for use in reporting.


70 70


Rev. 11/21/11

Adjusting Assessment and Exam Permissions

In DataDirector 3.x, permissions between Exams and Assessments were kept separately, although it was possible to copy permission sets from an Exam to an Assessment.


71 71


Rev. 11/21/11

Users who have transferred over Exams and Assessments from DataDirector 3.x to DataDirector 4.0 will find that their pool of permissions has been combined as well; DataDirector will automatically assign the larger of the two pools to the new assessment.


72 72


Rev. 11/21/11

Finding and Organizing Assessments Using Folders in DataDirector 4.0 Folders are a new way to organize, access and share Assessments within DataDirector 4.0. The Find Assessments page serves as a hub for all folder and Assessment based activity. Folders are listed in alphabetical order.

The Shared Assessments Folder The Shared Assessments folder is where users will find any Assessments that have been shared with them, including state and district data (for non-administrative personnel). In a forthcoming update, a new Folder will be created to house State data.

The District Folder The District admin can choose which assessments can be placed in the District Folder. Users should be cautious when placing district benchmarks directly into the district folder, as folder permissions override Assessment permissions. It may be advisable to create a subfolder in the District Folder with appropriate permissions for district benchmark Assessments. See Folder Permissions for more.

The State Assessments Folder The State Assessments Folder is a subfolder of the District folder. All state assessments will automatically migrate into the State Assessment folder and do not need to be moved. All user permissions will remain the same as in the current version of DataDirector.

Since folders are listed alphabetically in DataDirector, the State Assessment Folder will likely be near the bottom of the list. Users who wish to change this can speak with their Account Manager about getting the name of their State Assessment folder changed.


73 73


Rev. 11/21/11

The Personal Folder

Any Assessments created by the user appear in the Personal Folder. Administrators will also find state data in their Personal Folder.

Refreshing Assessments After Changing Filters To refresh which Assessments appear in your folders after changing a search filter, click the green “Refresh” arrows in the top right corner of the folder area.

Subfolder Deletion It is possible for district administrators to delete subfolders. This is accomplished by clicking on the small cog to the right of the folder’s name and selecting the “Delete” option.

However, if the subfolder contains any Assessments, it will be impossible to delete. Users should ensure that all Assessments have been moved to different folders or deleted before attempting to delete a subfolder. Additionally, if users are still unable to delete a subfolder after removing all Assessments, they should employ the hidden assessment filter in order to locate any remaining assessments. This will allow the removal or deletion of Assessments so that the folder itself can ultimately be deleted.


74 74


Rev. 11/21/11

Folder Permissions Initially, only District Administrators have access to all District and School folder permissions; however, Administrators can provide these permissions to any individual. All users can view the District folder. In addition, users may view the School folder of Schools to which they are affiliated. Permissions associated with the District and School folder will override assessment permissions.

Only District Administrators may create and edit District and School folders. In addition, the District Administrator can provide these permissions to the appropriate individuals. To edit permissions for a folder, a user will need to click on the small cog next to the folder’s title. This will open a small menu where users can either create a sub folder or share exam permissions with another user.


75 75


Rev. 11/21/11

After clicking the Share option, a new window will open, revealing the permissions sets within the specific site the user has chosen.

Here, it’s possible to set up permissions for individuals, user types, or at the site level.


76 76


Rev. 11/21/11

Setting Up User Level Permissions To establish permissions for an individual or a group of people, the user must click on the Add New Sharing Rule Button.

This will pull up a new dialog box where the user can select an individual (or a group of people by normal control + or shift + click actions) and establish permissions.


77 77


Rev. 11/21/11

After selecting the appropriate people, the user will need to specify which permissions that group will have access to before clicking the Add button.

The user(s) will then be added to the list on the main permissions page, along with quick-reference icons detailing which permissions they have.

Notice it is also possible to edit or remove a permission set at any time using the links on the right hand side of the box.


78 78


Rev. 11/21/11

Assigning User-Type and Site Level Permissions The process for assigning Site Level permissions is identical to the User Permissions process. However, when setting User-Type permissions, it is also necessary to choose the site for which you would like the permissions applied.


79 79


Rev. 11/21/11

Putting it All Together: Assessments


80 80


Rev. 11/21/11

Reports


81 81


Rev. 11/21/11

Exam Scoring

In version 3.x, users can enter data and view their results in the system immediately. To improve system performance overall, DataDirector 4.0 requires all exams to be scored on a separate server. As a result, users may notice a 5 to 10 minute delay between the time that a user enters their data and the point at which they can review and begin analysis.

The DataDirector team is working to reduce or eliminate the delay in scoring before DataDirector 4.0 goes live.


82 82


Rev. 11/21/11

Putting it All Together: Reports


83 83


Rev. 11/21/11

Performance Bands and Custom Reporting Clusters DataDirector 4.0 introduces a number of enhancements to Reporting Clusters, including the ability for users to set custom Performance Bands. Reporting Clusters are questions grouped together for reporting purposes, and typically share a commonality such as standard, topic, section, or item attribute. Performance Bands categorize a student’s performance on an assessment, indicating what a student’s score means. DataDirector automatically creates reporting clusters for the overall Assessment and user-defined Assessment sections, as well as State and National standards attached to items on the Assessment. In addition, it is possible for users to create their own reporting clusters comprised of manually chosen questions from their Assessment. Combined with the ability to generate custom performance bands, users now have greatly increased flexibility in how they report on Assessments and how to use their data to improve classroom learning. For example, a user could create Reporting Clusters on an Assessment to address specific student skills, such as graphing questions and word problems. A custom performance band could then separate students into ability levels based on their scores in that Cluster. Then, the user could assign another performance band to the overall assessment, assigning grades of A, B, C, D and F based on overall performance. Another user might choose to group sections based on the design of a specific assessment, customizing performance bands to correlate with cut points set by the test creator for example; an HM Theme Test, or a McDougal Math test. On the following pages, an example set of Performance Bands and Reporting Clusters will be shown from the creation process to their appearance on reports.


84 84


Rev. 11/21/11

Sample Performance Bands for an Assessment (2011-12 Math Grade 5 Quiz Q3 - #4636)

In this example, the user has seven automatically-generated Reporting Clusters covering the Overall Exam, the sections from their Assessment and the State Standards which appear in their Assessment. The user has also created two custom Reporting Clusters for Graphing and Word Problems.

There are three Performance Bands in use on this Assessment; the first is the DataDirector Default, with the other two being user-created – Met / Not Met, and “Groups.”

Overall Performance Band Groups Performance Band (Used in Sections)

Met Not Met (Used for Standard and Custom Reporting Clusters)


85 85


Rev. 11/21/11

Examples of Reports – Teacher View (2011-12 Math Grade 5 Quiz Q3 - #4636)

1. District Assessment Report (Summarized) - This report only shows the percentage of the different clusters. The clusters associated with a specific question appear in the Response Frequency section of this report, however; note a separate performance level graph does not appear for the custom clusters.


86 86


Rev. 11/21/11

2. Classroom Performance Summary Report - This report shows only the percentage scores of different clusters. Note a performance level graph does not appear for the custom clusters.

3. Student Assessment Report - This report shows only the number of points received for a specific cluster. Note a performance Summary graph does not appear for the custom clusters.


87 87


Rev. 11/21/11

4. Parent Letter - This document shows only the number of points received for a specific cluster. Note a separate Performance Summary graph does not appear for the custom clusters.

5. View Assessment Summary – This report shows the different performance band descriptions as well as the “Groups” defined earlier.


88 88


Rev. 11/21/11

Curriculum


89 89


Rev. 11/21/11

Standards Search The process for browsing standards has been relocated for DataDirector 4.0.

DataDirector 3.x

In DataDirector 3.x, users can access the Standards tab directly from the home page.

DataDirector 4.0

In DataDirector 4.0, users must first access the Curriculum module from the Overview page.

Standards can then be searched or browsed normally.


90 90


Rev. 11/21/11

Putting it All Together: Curriculum


91 91


Rev. 11/21/11

Students


92 92


Rev. 11/21/11

Putting it All Together: Students


93 93


Rev. 11/21/11

Programs


94 94


Rev. 11/21/11

Putting it All Together: Programs


compari son of features: datadirector 3.x vs. 4

Documents