Post-survey solution to measure course impact
To measure the impact of your project, atingi, together with the Sectoral Department (FMB), has developed standardised indicators for e-learning. The technical tools to measure those indicators are readily available for any new atingi course.
There are two different activities that need to be in place to successfully track the indicators: atingi feedback activity and atingi re-engagement activity. Both are provided in the standard course templates. Below you can find the instructions for standard settings in case you don’t want to use the templates but create them from scratch. If you use the template that is provided in your course category on atingi, you only need to adjust re-engagement delay and adjust feedback questions to your needs.
Setting up a reminder via re-engagement activity
In general, both activities, re-engagement and feedback, should be set up after all other activities (including the course certificate) have been finalised and course completion has been configured.
The re-engagement activity makes sure that the learners who have completed the course receive a notification to give feedback after the completion of the course. Both activities can be part of the certificate tile and will only be available to learners after the scheduled reminder has been sent out.
If you are working in the course template:
Re-engagement activity settings
Under “Re-engagement details”, please adjust notify user “After delay” and “[X] weeks”. The time of delay should be coordinated with your indicators or – if you don’t have any – should not be sent right after a user has completed the course.
Make sure that “Learner must match the following: Course completed – Yes” is selected in the access restriction settings.
Leave any other settings and the content of the message as is.
Feedback activity settings
“After submission”: If you like, you can add a completion message for the learner to receive after they have submitted the feedback.
“Access restriction”: Please make sure that the following two access restrictions are in place:
1) Learner must match all of the following: “Course completed – Yes”
2) AND Activity completion: “[Name of re-engagement activity] must be marked complete”
After you have set up the feedback as well as the re-engagement activity, please make sure that they are NOT selected under course completion.
Leave any other settings as they are.
With those settings, learners will receive a message and be granted access to the feedback activity within the scheduled delay time after completion of the course. You can later track responses in the response tab of the feedback activity.
Adding and editing questions in the feedback activity
Now that you have configured the settings, you only need to select the template provided in the feedback activity, called atingi - e-learning standard indicators - template.
Click on “Use this template” and “Delete old items” to use and edit the questions within your feedback activity (this doesn’t affect the public template).
You can now edit the questions and answers to fit your specific course and context. Of course, the overall questions should be set up in a way that can be measured meaningfully.
To finalize the survey, click on “Save as new template” and it will be available under “Templates” and “Course” from now on.
Please note that the feedback activity shouldn’t be edited anymore after the course has been launched, because making any changes could lead to data loss. Therefore, please make sure that your questions fit your M&E needs and if in doubt, ask the atingi team for help.
If you create a new course from scratch:
Adding re-engagement
Like any other activity, re-engagement can be added to a course by turning the editing mode on and clicking on the “+” sign in the according section to add a new activity to the course.
In the activity, you need to define the message to be sent to users (please use the text given in your template course), the time after which the notification should be sent and the condition under which it is being sent.
Re-engagement details
Under “Re-engagement details”, please choose notify user “After delay” and “[X] weeks”. The time of delay should be coordinated with your indicators or – if you don’t have any – should not be sent right after a user has completed the course.
Reminder count would be 1, so that learners receive one reminder after the time is up.
The notification subject is the subject of the email that learners will receive, and the notification content is the email text.
In the text, placeholders such as %coursefullname% (enters the name of the course automatically) and https://online.atingi.org/course/view.php?id=%courseid% (enters the link to the course) should be used.
Please always use or copy the template provided in your own template course for this notification, otherwise images won’t be displayed correctly.
Subject:
Your feedback for atingi!
Content:
Congratulations on completing the course %coursefullname% on atingi!
Please take a moment to complete the anonymous survey about your experience with %coursefullname%:
Or use this link: https://online.atingi.org/course/view.php?id=%courseid% (Please note that you need to log in first to access the survey)
We would love to hear how the course has impacted your personal growth and how we could improve our course offers.
Thank you for helping us making our courses even more valuable!
You are receiving this email because your email is registered on the digital learning platform atingi. atingi offers courses and certifciates free of charge that help you boost your competencies and your career. The atingi platform is financed by the Federal Ministry for Economic Cooperation and Development (BMZ) and implemented by GIZ GmbH. If you don't want ot receive this or similar notifications from atingi, please reach out to our support team via help@atingi.org.
Please note: it is not possible to add other images or replace the images in the template because they need to be linked to a publicly available source to show up in the learners’ email.
If you don’t use the template to create your course, we would advise you to go into the HMTL of the re-engagement activity in your template course (which can be found in your category) and copy the HTML code to your new re-engagement activity:
To find the HTML, click on "View" in the text editor and then on "Source code":
Access restriction and activity completion settings
You can leave the third-party notification empty and leave “common module settings” as they are.
Now you need to restrict access to the activity to make sure that the reminder is only sent out after the course has been completed. To do so, choose “Learner must match the following: Course completed – Yes” in the access restriction settings. Please remember to set up course completion before.
In the activity completion settings, re-engagement duration can be set to 1 minute. The re-engagement activity is always invisible to your learners and will automatically be marked as completed once they have received their reminder.
Now you can click save and display and move on to the feedback activity.
After you have set up and saved the re-engagement activity once, no changes to the notification delay can be made. Please keep this in mind.
Setting up feedback activity
To measure the impact of your digital capacity building measures, you can integrate a feedback activity into your atingi course.
Please follow the steps below to add valuable survey questions that can be measured through atingi standard indicator reporting and to connect the re-engagement message to the feedback reminding the learners to take part.
Like any other activity, feedback can be added to a course by turning the editing mode on and clicking on the “+” sign in the according section to add a new activity.
Next, you need to give the activity a name and ideally a short description like the following:
"This feedback will be made available a few weeks after you have completed the course. You will receive a notification whenever you can submit your feedback."
Please tick “Display description on course page” so that learners are informed why the feedback is not available immediately after they have completed the course.
Availability and question and submission settings can stay as default, unless you want to receive an email notification for each submitted feedback. Please note that due to data privacy regulations, surveys on atingi should always be carried out anonymously.
If you like, you can add a completion message for the learner to receive after they have submitted the feedback. Common module settings can stay at default.
Most importantly, you need to configure an access restriction for your survey to connect it to the re-engagement message. There are two access restrictions needed here:
1) Learner must match all of the following: “Course completed – Yes”
2) AND Activity completion: “[Name of re-engagement activity] must be marked complete”
Lastly, in the activity completion settings, choose “Submit feedback"
After you have set up the feedback as well as the re-engagement activity, please make sure that they are NOT selected under course completion.
With those settings, learners will receive a message and be granted access to the feedback activity within the scheduled delay time after completion of the course. You can later track responses in the response tab of the feedback activity.
Adding and editing questions in the feedback activity
Now that you have configured the settings, you only need to select the template provided in the feedback activity, called atingi - e-learning standard indicators - template.
Click on “Use this template” and “Delete old items” to use and edit the questions within your feedback activity (this doesn’t affect the public template).
Note:
Delete old items
Remove any questions/text types previously added to the Feedback Activity you are viewing before importing items from the selected Template.
Append new items
Add items stored within the selected template to the current Feedback activity, to any existing questions/text types.
You can now edit the questions and answers to fit your specific course and context. Of course, the overall questions should be set up in a way that can be measured meaningfully. To finalize the survey, click on “Save as new template” and it will be available under “Templates” and “Course” from now on.
Please note that the feedback activity shouldn’t be edited anymore after the course has been launched, because making any changes could lead to data loss. Therefore, please make sure that your questions fit your M&E needs and if in doubt, ask the atingi team for help.
Now you have set up both activities and your learner will receive a notification asking them to give feedback after they have completed the course.