Performance Map

From BEARWiki
Jump to: navigation, search

The Performance Map displays progress across the assessments (Item Sets) that have been administered to date. Thus, it is only relevant when respondents have been assessed multiple times and when the instruments have been equated (see Item Linking for more information about test equating in ConstructMap).

Performance Maps can be generated for individual respondents or for groups of respondents.

  1. Start by selecting the respondents to report.
    - To generate a Performance Map for a single respondent, first select that case by clicking on the name or id. This will highlight the case in yellow.
    - To generate a Performance Map for a group of respondents, select several cases by dragging the mouse over the names or ids of cases in adjacent rows. This will highlight the selected cases in yellow. You can also select a group of respondents with the Filter Cases option.
    - To generate a report for all the respondents, go see Step 2.

  2. To generate a Performance Map for each selected respondent, select Reports – Individual Reports - Performance Map.
    To generate an aggregated report for all the selected respondents, select Reports – Group Reports - Performance Map.
  3. Perfmapdialog1.png Perfmapdialog2.png
    Figure 1. Display options for Performance Maps.

  4. You will be presented with dialog windows similar to those shown in Figure 1, of the display options described in Table 1 below. The settings shown in Figure 1 will produce the maps shown in Figure 2.
  5. Table 1. Display options for Performance Maps.
    Option Description
    Title The title you provide will appear at the top of the output window.
    File Name The location and name where the Performance Map image file (png) will be saved. For multidimensional models, ConstructMap appends "_xxx" to the filename for each dimension, where "xxx" is the short name of each construct.
    Item Set Highlight the Item Set that contains the instruments (or items) to be plotted.
    Displayed Range You can change the displayed range to display only part of the full range of ability estimates.
    Graph Type Select a Line Graph or a Bar Graph.
    Performance Axis Label Enter the label to be used for the axis showing proficiency estimates.
    Display Scores If you want to display logit values along the proficiency axis, select Yes, otherwise, select No.
    Show Estimate Type Select Yes for the estimate type (e.g., EAP)to appear in the heading.
    Plot Group Progress Enter Yes to plot the average proficiencies for the selected group of cases (all cases when filters are off). This plot will appear as a second series on the Individual Performance Maps.
    Plot Expected Progress If expected proficiency levels have been entered for each Item Set, and you wish to see those expected locations, select Yes. See how to set expected performance levels for each instrument in the Item Sets section.
    X-axis location Indicate whether the x-axis labels should be located at the top or the bottom of the chart.
    Background Color Use the Change Color button to change the background color for the map.
    Cut-point Color Use the Change Color button to change the color for criterion zone bands on your map.
    Line Color Use the Change Color button to change the color of the plot line on your map.

    PerfMap AJ DCI MLE.png
    PerfMap AJ ET MLE.png
    Figure 2. Performance Maps for the DCI and ET variables for Anne Jackson after completing four Item Sets.

    Figure 2 shows two Performance Maps for the hypothetical student named Anne Jackson. ConstructMap produced two maps because the model contains two constructs: Designing and Conducting Investigations (DCI) and Evidence and Tradeoffs (ET). A particular construct is selected by clicking on the tab at the top of the window.


    Note that these are maps of MLE proficiency estimates. This option is selected in the Proficiency Estimation Options screen. One point is plotted for each Item Set contained within the parent Item Set specified in the options. In the SEPUP data, the base Item Set contains six Item Sets, representing sets of activities that are conducted in the classroom (e.g., 1-12, 13-20, etc.) Each of these Activity Item Sets contain several items.

    The horizontal shaded areas represent the user-specified Criterion Zones, or performance levels. These are only displayed if the user has previously set up cut-points on the constructs. Two lines are plotted on the graph. The solid blue line is Anne Jackson's performance, while the dashed black line is the average performance for all respondents.

    The data plotted on the DCI Map in Figure 2 (the top map) indicate that Anne Jackson was performing at the "incomplete" level when she completed Item Sets "1-12," "13-20," and "21-28" and then performed at the "correct" level on Item Sets "29-38" and "39-46" for the DCI variable. She did not complete Item Set "47-58," although the rest of the class did complete it (because the black dashed line has a point plotted for that Item Set).

  6. Resize or change the shape of the map by dragging the corners of the map window, or the window edges. Some actions will crop the window, but dragging back will restore the window contents.
  7. To print the map, select File – Print Selected Chart. This will print the map for the currently displayed variable. Use the tabs at the top of the map to select another variable, and then select File – Print Selected Chart again to print that map. This will print a full-size map. To control the size of the printed map, you may prefer to save it as a JPG or PNG file and then import it into a Word document (see the next step). You can then modify the size directly.
  8. By default, the map is saved to the location you indicated in the Filename entry on the dialog window. To save the map to another location or in another format, select File – Save as JPG or Save as PNG. This will automatically save a graphical file for each variable. For example, entering a filename of "perfmap" generates the files perfmap_DCI.png and perfmap_ET.png.
  9. Close the map window with the Close button at the bottom of the window.