Viewing Course Evaluation Results in Watermark for Faculty

This article provides instructions on how to access course evaluation results in Watermark Course Evaluations & Surveys at Idaho State University (ISU).

• Accessing Watermark 
• Creating Batch Reports
• Selecting Report Type
• Tracking Response Rates
• Awarding Points to Students
• Troubleshooting Access to Watermark
• Additional Resources

1. To access Watermark, log into Canvas and from the main menu on the left, click on Account.
2. In the Canvas left-hand navigation menu, select Settings, then Instructor Course Evaluations. 
3. You should now see your Watermark Course Evaluations & Surveys dashboard - from the Project List in the middle of the dashboard click on the name of the term you wish to view. This will give you access to the reports for each course that was evaluated.
4. Under the Report column, click on the Download Report button and select the type of report. You will be prompted to select the location for the download. 

Generally, evaluation results will be available the day after final grades for the semester are due. Instructors will receive an email from the system (sender: courseevals@isu.edu) announcing that evaluation results are available. Evaluation results will remain visible, i.e. they do not get archived, deleted, or hidden. 

Watermark only maps to individual course sections, but if you would like to combine the results of a metacourse or multiple course sections you can create a batch report.

1. Follow the steps above to access the list of courses that were evaluated.
2. Click on the box to the left of the Course Code for each course you wish to combine.
3. In the window that opens, type a descriptive name in the Report Name box.
4. Select the Report Type from the drop-down menu.
5. Select one of the following report options:
   1. Merge Multiple Detailed Reports into one PDF for Selected Courses. This report will combine individual course section reports into a single PDF report. Data is not aggregated.
   2. Download Multiple Detailed Reports/Batch as ZIP file for Selected Courses. The course section reports will be downloaded as individual PDF files into a single ZIP file. Data is not aggregated. Note: This would be the preferred method if you want to quickly download the results of all of your individual courses.
   3. Aggregate Data for Selected Items into One Report. Results for all selected course sections will be aggregated into one single PDF report. This would be the preferred method for combining the results of metacourses.
   4. Raw Data: Course section reports will be downloaded as individual Excel files into a single ZIP file. Data is not aggregated. This would allow you to manipulate the data to meet your specific needs.
6. Click GO. You will receive an email once the report has been generated with a link to download the report.

• Detailed Report: Results of evaluations, including questions and responses, weight, frequency, percent, percent responses, mean, standard deviation and median but none of the comments in any write-in type questions. PDF Download.
• Detailed Report with Comments: Student write-in comments included with detailed report results. PDF Download.
• Short Report: Results of evaluations in a condensed form, includes question, frequency, percent, means, standard deviation and median but none of the comments. PDF download.
• Short Report with Comments. Student write-in comments included with short report results. PDF Download.
• Raw Data: Excel file containing data about user responses, including timestamps and course information.

You can track the response rates of evaluations that are in progress. The real-time response rate for individual courses is available within your course(s) on the left-side. Note: If you have course sections combined into a metacourse, you will need to access the individual sections to see the response rate information since the system does not map to metacourses. You can also access response rates by accessing the Watermark Dashboard by following the steps above.

• Students will receive an email from the system (sender: courseevals@isu.edu) notifying them that they have evaluations available to complete. The email will provide direct links to their assigned evaluations.
• In addition, while the evaluation project is in progress students will receive a pop-up when they log into Canvas with direct links to any course evaluations that have been assigned to. They will be given the option to close the window and continue on into their course(s) but they will continue to be reminded each time they log in until they have completed all of their assigned evaluations. 
• You may wish to create an assignment with no submission in order to manually award points for completing the evaluation. It is recommended that you award points based on an established response rate for the course. For example, if 75% of students complete the evaluation, everyone will receive x points for extra credit. You will be able to view the response rate in real time via the Response Rate Tracker in your Watermark dashboard and also in Canvas within your course.
• For more information, see Adding Extra Credit in ISU Canvas for Faculty and/or How do I add or edit details in an assignment?

1. If you are not seeing your evaluations results, you may have multiple roles in the Watermark system. In the top-right corner to the left of your name, you can toggle between your roles.
   • If you are a program coordinator you will have Administrator access to the evaluations of all courses in your designated program.
   • If you are an Instructor, you will have access to the results of any courses in which you were listed as a teacher of record.
   • If you are enrolled in any ISU courses as a Student, you will have student/respondent access to any surveys currently in progress. You will click on My Surveys to access the evaluations for courses you are enrolled in as a student.
2. It may also be the case that the evaluations for your courses are still be in progress. The results of course evaluations are generally made available the day after final grades are due for the full semester courses.

• Chat with Canvas Support for Faculty (external link)
• Canvas Instructor Guides (external link)
• Visit the ITRC Portal for answers to common questions (external link)
• For additional assistance email AnswersITRC@isu.edu