Integrating digital assessments is one of many ways in which you can boost the quality of your teaching practice. Digital assessments allow you to improve the quality of your tests and to work more efficiently and effectively.
Various types of software are available for online assessments. The test applications TestVision Online, SOWISO and Maple TA are centrally offered and managed at the AUAS.
Digital tests benefit both students and lecturers. Digital tests resonate and connect more with students: evaluations show that they would rather type than write and that they appreciate variety in the types of question asked. In addition, a literature study (in dutch) shows that when used correctly, digital tests have a positive effect on test quality. Both summative and formative tests can be administered online. Formative tests can be administered independently of time and place.
- Gain access to your test questions and test results anywhere and any time.
- Use a workflow to safeguard the ‘two pairs of eyes’ principle.
- Add tags (metatags) to the test questions, for example the level of knowledge: Bloom’s taxonomy – Application
- Automatically generate tests, based on the blueprint and database.
- Automatic marking/scoring of closed questions.
- Online marking of open questions and sufficiently legible written answers.
- Make the tests more applicable to the real world by adding audio and visual material or other applications such as SPSS, Tableau, Excel, etc.
- Extensive analysis functionality at both the test level and the question level.
- Provide feedback to students about results.
- The test application functions as archive
In a non-covid situation, students are able to take exams digitally that would normally be taken in person and on paper.
To avoid plagiarism, these exams are taken in a secure test environment such as in the digital UAUS examination locations with a secured laptop for each student (see also exam rooms).
As a result of the measures surrounding the Covid-19 crisis, it is currently not possible to make use of these environments. Therefore, we must rethink our exams to test on the stated learning objectives whilst minimizing fraud. Have a look here to see what you can do to minimize fraud by knowledge tests.
On the AUAS testing website https://score.hva.nl/, you can read the following about types of online testing that helps you (re)design your tests:
Many types of assessment can be administered online. This overview shows the possibilities offered by online AUAS tools. Please consider the following before you start creating your exams.
- Create an overview of all units of study for your course and the intended assessment schedule, including both summative and formative test dates. Check to see if there is any overlap in learning objectives.
- Check whether it is possible to limit the number of summative tests by combining assessments for various courses into a larger, integral exam, such as a final assessment or integrative professional assignment. Adjust the assessment matrix based on the assessment matrices of all courses that are being tested via the integrative assessment.
- Increase the use of formative assessment to gain insight into the progress being made towards learning objectives. Design a combination of interim (formative) assessments or sub-assignments.
- Explore whether knowledge testing can be integrated into application assignments.
Would you like more information about the best type of assessment method for your programme or how to design, construct, administer, mark and analyse tests effectively? Feel free to contact us at firstname.lastname@example.org
Test applications are used to manage test questions and to develop, administer, review, analyze and archive formative and summative tests. A test application also provides statistics that provide input for determining the quality of test and questions. The main application we use is Testvision Online (TVO). Brightspace, the Learning Management System, also offers opportunities for formative assessment en handing in reports, essays etc. For math heavy exams, we use Maple TA.
Brightspace is being used to facilitate learning and is therefore ideal for formative testing, like quizzes.
Use Quizzes to easily design multiple choice-quizzes and short open answer questions
- You can randomize questions and answer alternatives
- You can use an item bank to randomly select questions to students
Use Assignments for handing in reports, essays and multiple open essay questions. These can be individual or group assignments.
- Use a rubric to help yourself grade students work
- Use the annotation tool to give feedback
- Use Urkund to check on plagiarism (see here for more information)
TestVision Online (TVO) is a dedicated testing application in which lecturers can manage and design tests. Students can take these exams in an exam hall on a laptop (so supervised and controlled environment), but also unsupervised at home. The tool has important advantages:
- Create all types of different questions
- Automatically grades closed questions (mc-questions and short answer questions)
- Let your questions be reviewed and approved by your colleagues
- Easy grading
- Use grading schemes to award points
- Divide questions over different lecturers to grade
- Grade per student or per question
- Create item banks
- to design different versions of an exam
- to see in which exam you used which question
- Test analysis
- Review what the quality of questions is before you publish results.
When exams on location would be possible again, students can make these TestVision exams in test halls on (locked) computers. Be aware that the computers on campus within the examination rooms have limited internet access and therefore students would not be able to review external resources.
The education office plans and hosts these exams. If you would like to set up your exam in TVO, please fill in the ‘registration form remote digital test’
More information needed? Check https://edulab.fbe.hva.nl/en/testvision-online/
Brightspace and TestVision Online compared
|Mainly used for||Formative testing||Summative testing: knowledge tests (with various question forms including multiple choice, input, open and upload questions).|
|Controlled or supervised conditions||No||No, not in the current situation|
|Automatically designs exams based on matrix||No||Yes, option of using a pre–set matrix to randomly select questions from a larger item bank of e.g. multiple-choice or open-ended questions in order to generate a test or even an unique test for each student.|
|Multiple versions of an assignment||Yes, but students can see the version they are in||Yes|
|Offers blocks of questions (e.g. a test of 5 blocks with 3 questions per block).
Each student starts with a random test question or question block.
|Option to display test questions or question blocks once. When displaying a test question once, the student cannot go back to a previous question or forward to a subsequent question.||Yes||Yes|
|Time limit per test||Yes||Yes|
|Tracking of students’ progress during test||No||Yes|
|Grading||Teachers can divide question answers over different reviewers/assessors. \
Grade per student or per question
|Support in setting up exam||Via Edulab, Annemieke & Adriaan||Central support via education office|
|Support when students take exam||No support||Central support via education office|
|Check on plagarism||Yes, for the upload of assignments via Urkund (see here for more information)||No, but there is a work. around (see plagarism <link> ).|
During the Covid-19 situation, it is a lot harder to give students a supervised test environment. When you (re)considered your exam and a written knowledge test is the best option, using the options below – and in accordance with the examination board – these measures might reduce fraud
- Randomize questions;
- One question per page and not allowing students to go back to previous questions;
- Disallow right click (copy / paste)
- Install a time limit
- Consider splitting exams in 2 when combining multiple choice and open questions to allocate specific time limits per each type of test (minimizing the amount of exposure time to multiple choice questions also minimizes the chances of committing fraud among students. Guidelines dictate 60-90 seconds per multiple choice question)
- Make different versions without informing students (easy in TestVision Online)
- Give every student only one attempt to the quiz so they can’t leave questions open and start over again;
If you suspect plagiarism, please inform the exam committee.
This information will be updated soon
Plagiarism check for assignments
It is possible to check the submitted assignments for plagiarism in Brightspace. The Urkund plagiarism scanner is currently linked to Brightspace and is set up once an Assignment has been created. For more information about the possibilities and the use of it within your course, please read chapter ‘9. grade and give feedback’ in our online course ‘Getting started with Brightspace for FBE lecturers’. Here you can also find more information about how to read the analysis report.
** Due to the Covid-19 crisis digital testing at an AUAS location is currently not possible **
The AUAS uses digital test rooms with a total capacity of 1,420 places. The rooms are used by HvA, UvA and AMC. For tests administered via TestVision Online test application dedicated Test laptops (Chromebooks) can be used. For tests with other educational applications or “upload” tests, only the dedicated Windows test PCs can be used.
Test laptops (Chromebooks): available for tests in central locations IWO Yellow and REC M3.01 and on location for small groups, using only TestVision Online. Capacity: 690 laptops.
Test PCs (Windows): available for tests in central locations (IWO Red, IWO Blue and Nicholaas Tulphuis) for different variants of digital tests. Capacity: 730 computers
The computers have been specially designed for digital tests and are equipped with a mouse and keyboard. All of the computers are situated on separate tables and the screens are fitted with privacy protectors to prevent copying. In addition to the standard programs that a regular workstation would have, the exam computers also have special programs that can be used for digital testing.
Both the computers and the laptops are connected to a secure wired network. The exam computers can be centrally controlled by an administrator’s computer, e.g. to enable tests to be centrally activated/deactivated. The students only have access to the test website and any other software that has been made available.
The exam rooms are not identical: for more information contact the faculty’s Contactpersoon Digitaal Toetsen.
If you require support relating to testing in BrightSpace or TestVision, then please contact:
- Annemieke Van Den Bijllaardt: email@example.com
- Adriaan Van Nieuwkerk: firstname.lastname@example.org
Resources & Training
We are aware of the importance of being able to make use of the recommended applications for testing (BrightSpace and TestVision). Within this section, you will be able to find the necessary tutorials relating to the functionalities of the application.
BrightSpace Testing: https://edulab.fbe.hva.nl/en/brightspace-quiz/
TestVision Information: https://edulab.fbe.hva.nl/en/testvision-online/
TestVision Tutorials: https://online.testvision.nl/documentatie/index.htm#
Additional training/workshops can be organized with superusers if required.