Digital Assessment

Integrating digital assessments is one of many ways in which you can boost the quality of your teaching practice. Digital assessments allow you to improve the quality of your tests and to work more efficiently and effectively.

Various types of software are available for online assessments. The test applications TestVision Online, SOWISO and Maple TA are centrally offered and managed at the AUAS.

Digital tests benefit both students and lecturers. Digital tests resonate and connect more with students: evaluations show that they would rather type than write and that they appreciate variety in the types of question asked. In addition, a literature study (in dutch) shows that when used correctly, digital tests have a positive effect on test quality. Both summative and formative tests can be administered online. Formative tests can be administered independently of time and place.

Benefits

  • Gain access to your test questions and test results anywhere and any time.
  • Use a workflow to safeguard the ‘two pairs of eyes’ principle.
  • Add tags (metatags) to the test questions, for example the level of knowledge: Bloom’s taxonomy – Application
  • Automatically generate tests, based on the blueprint and database.
  • Automatic marking/scoring of closed questions.
  • Online marking of open questions and sufficiently legible written answers.
  • Make the tests more applicable to the real world by adding audio and visual material or other applications such as SPSS, Tableau, Excel, etc.
  • Extensive analysis functionality at both the test level and the question level.
  • Provide feedback to students about results.
  • The test application functions as archive

In a non-covid situation, students are able to take exams digitally that would normally be taken in person and on paper.  

To avoid plagiarism, these exams are taken in a secure test environment such as in the digital UAUS examination locations with a secured laptop for each student (see also exam rooms). 

As a result of the measures surrounding the Covid-19 crisis, it is currently not possible to make use of these environmentsTherefore, we must rethink our exams to test on the stated learning objectives whilst minimizing fraud. Have a look here to see what you can do to minimize fraud by knowledge tests.

On the AUAS testing website https://score.hva.nl/you can read the following about types of online testing that helps you (re)design your tests: 

Many types of assessment can be administered online. This overview shows the possibilities offered by online AUAS tools. Please consider the following before you start creating your exams. 

  • Create an overview of all units of study for your course and the intended assessment schedule, including both summative and formative test dates. Check to see if there is any overlap in learning objectives.
     ​ 
  • Check whether it is possible to limit the number of summative tests by combining assessments for various courses into a larger, integral exam, such as a final assessment or integrative professional assignment. Adjust the assessment matrix based on the assessment matrices of all courses that are being tested via the integrative assessment. 
     ​ 
  • Increase the use of formative assessment to gain insight into the progress being made towards learning objectives. Design a combination of interim (formative) assessments or sub-assignments.
     ​ 
  • Explore whether knowledge testing can be integrated into application assignments.
     ​ 

 

A range of test applications can be used for the purposes of these summative and formative tests. For more information, first have a look at Applications or directly consult ourtool guide. 

Would you like more information about the best type of assessment method for your programme or how to design, construct, administer, mark and analyse tests effectively? Feel free to contact us atedulab.fbe@hva.nl

Test applications are used to manage test questions and to develop, administer, review, analyze and archive formative and summative tests. A test application also provides statistics that provide input for determining the quality of test and questions. The main application we use is Testvision Online (TVO)​. Brightspace, the Learning Management System, also offers opportunities for formative assessment en handing in reports, essays etc. For math heavy exams, we use Maple TA. 

Brightspace

Brightspace is being used tfacilitate learning and is therefore ideal for formative testing, like quizzes.  

Use Quizzesto easily design multiple choice-quizzes and short open answer questions 

  • You can randomize questions and answer alternatives 
  • You can use an item bank to randomly select questions to students 

Use Assignments for handing in reports, essays and multiple open essay questions. These can be individual or group assignments.  

  • Use a rubric to help yourself grade students work 
  • Use the annotation tool to give feedback 
  • Use Urkund to check on plagiarism (see here for more information) 

More information needed? Check the online course ‘getting started for FBE lecturers’ on Brightspace and https://edulab.fbe.hva.nl/en/brightspace-quiz/.

Testvision

TestVision Online (TVO) is a dedicated testing application in which lecturers can manage and design tests. Students can take these exams in an exam hall on a laptop (so supervised and controlled environment), but also unsupervised at homeThe tool has important advantages: ​ 

  • Create all types of different questions 
  • Automatically grades closed questions (mc-questions and short answer questions) 
  • Let your questions be reviewed and approved by your colleagues 
  • Easy grading 
    • Use grading schemes to award points 
    • Divide questions over different lecturers to grade 
    • Grade per student or per question 
  • Create item banks  
    • to design different versions of an exam 
    • to see in which exam you used which question 
  • Test analysis  
  • Review what the quality of questions is before you publish results. 

 

When exams on location would be possible again, students can make these TestVision exams in test halls on (locked) computers. Be aware that the computers on campus within the examination rooms have limited internet access and therefore students would not be able to review external resources. 

 

The education office plans and hosts these exams. If you would like to set up your exam in TVO, please fill in the registration form remote digital test’ 

 

 

 

More information needed? Check https://edulab.fbe.hva.nl/en/testvision-online/ 

Brightspace and TestVision Online compared

 

  Brightspace  TestVision Online 
Mainly used for  Formative testing  Summative testing:  knowledge tests (with various question forms including multiple choice, input, open and upload questions).  
Controlled or supervised conditions  No  No, not in the current situation  
Automatically designs exams based on matrix  No  Yes option of using a preset matrix to randomly select questions from a larger item bank of e.g. multiple-choice or open-ended questions in order to generate a test or even an unique test for each student. 
Multiple versions of an assignment  Yes, but students can see the version they are in   Yes  
Offers blocks of questions (e.g. a test of 5 blocks with 3 questions per block). 

Each student starts with a random test question or question block. 

Yes 

 

No 

Yes  

 

Yes 

Option to display test questions or question blocks once. When displaying a test question once, the student cannot go back to a previous question or forward to a subsequent question.  Yes   Yes  
Time limit per test  Yes    Yes 
Tracking of students’ progress during test  No  Yes 
Grading    Teachers can divide question answers over different reviewers/assessors \ 

Grade per student or per question 

Grade anonymously 

Support in setting up exam  Via Edulab, Annemieke & Adriaan  Central support via education office 
Support when students take exam  No support  Central support via education office 
Check on plagarism  Yes, for the upload of assignments via Urkund (see here for more information)  No, but there is a work. around (see plagarism <link> ). 

 

During the Covid-19 situation, it is a lot harder to give students a supervised test environment. When you (re)considered your exam and a written knowledge test is the best option, using the options below – and in accordance with the examination board – these measures might reduce fraud 

  • Randomize questions;  
  • One question per page and not allowing students to go back to previous questions;  
  • Disallow right click (copy / paste 
  • Install a time limit 
  • Consider splitting exams in 2 when combining multiple choice and open questions to allocate specific time limits per each type of test (minimizing the amount of exposure time to multiple choice questions also minimizes the chances of committing fraud among students. Guidelines dictate 60-90 seconds per multiple choice question) 
  • Make different versions without informing students (easy in TestVision Online) 
  • Give every student only one attempt to the quiz so they can’t leave questions open and start over again; 

If you suspect plagiarism, please inform the exam committee. 

Online proctoring

This information will be updated soon  

Plagiarism check for assignments

It is possible to check the submitted assignments for plagiarism in Brightspace. The Urkund plagiarism scanner is currently linked to Brightspace and is set up once an Assignment has been created. For more information about the possibilities and the use of it within your course, please read chapter ‘9. grade and give feedback’ in our online course ‘Getting started with Brightspace for FBE lecturers. Here you can also find more information about how to read the analysis report.

 

** Due to the Covid-19 crisis digital testing at an AUAS location is currently not possible **

Exam rooms

The AUAS uses digital test rooms with a total capacity of 1,420 places. The rooms are used by HvA, UvA and AMC. For tests administered via  TestVision Online test application dedicated Test laptops (Chromebooks) can be used. For tests with other educational applications or “upload” tests, only the dedicated Windows test PCs can be used.

Test laptops (Chromebooks): available for tests in central locations IWO Yellow and REC M3.01 and on location for small groups, using only TestVision Online. Capacity: 690 laptops.
Test PCs (Windows): available for tests in central locations (IWO Red, IWO Blue and Nicholaas Tulphuis) for different variants of digital tests. Capacity: 730 computers

Equipment

The computers have been specially designed for digital tests and are equipped with a mouse and keyboard. All of the computers are situated on separate tables and the screens are fitted with privacy protectors to prevent copying. In addition to the standard programs that a regular workstation would have, the exam computers also have special programs that can be used for digital testing.

Both the computers and the laptops are connected to a secure wired network. The exam computers can be centrally controlled by an administrator’s computer, e.g. to enable tests to be centrally activated/deactivated. The students only have access to the test website and any other software that has been made available.

The exam rooms are not identical: for more information contact the faculty’s Contactpersoon Digitaal Toetsen.

Support

If you require support relating to testing in BrightSpace or TestVision, then please contact: 

Resources & Training  

We are aware of the importance of being able to make use of the recommended applications for testing (BrightSpace and TestVision). Within this section, you will be able to find the necessary tutorials relating to the functionalities of the application. 

BrightSpace Testing: https://edulab.fbe.hva.nl/en/brightspace-quiz/ 

TestVision Information: https://edulab.fbe.hva.nl/en/testvision-online/ 

TestVision Tutorials: https://online.testvision.nl/documentatie/index.htm# 

Additional training/workshops can be organized with superusers if required. 

 

Additional Resources

https://score.hva.nl/Paginas/The-Corona-crisis-and-assessment-at-AUAS.aspx