Hi Stephane, I like the improved questionnaire. Here are my comments: - In general, the fact that the videos were upside down made it confusing to understand. For some questions, I found it easier to read the text and pick the answer than watch the video and understand what the robot is doing. - Q6. The difference between video 2 & video 3 is not clear, i.e., video 2 seems like video 3 run half as long. I think it would be better if the videos are the same length so that every example is shown for the same amount of time. - I especially like Q7, but once again, it bothered me a bit that in video 4, the person presses the button for noticeably longer than in other videos. Would the robot in video 4 have the same behavior as the one in video 3 if the person pressed it shorter? - Q8. The first thing that caught my attention is that in video 1, the person presses the forwards button then places an obstacle immediately whereas other videos, the person always pushes the center button in between. I think children could think that the center button does the magic. Also, while I get that the question said the forwards button "or" place an obstacle, after seeing three videos where a person presses the forwards button before placing an obstacle, video 4 stood out because the person places an obstacle then presses the forwards button.
Let me know if you want me to clarify any of the points. Best regards, Jiwon ________________________________________ From: Aseba-edu [[email protected]] on behalf of Stéphane Magnenat [[email protected]] Sent: Friday, September 05, 2014 9:05 AM To: [email protected] Subject: [Aseba-edu] Updated evaluation tool for Thymio/VPL Dear Thymio educators, In an effort to make Thymio/VPL the best tool to teach CS to children, we are constantly improving it. To do so, we have developed a questionnaire to assess how much children learn after a 1.5-hour workshop. This work resulted in a ITiCSE 2014 paper [1]. For this paper, we used a text-based questionnaire, and one drawback we observed was that the questionnaire was as difficult, if not more, to understand than the programming itself. Thus we are now refining this evaluation tool and for that are making a video-based questionnaire. A preliminary version is available here for testing: https://docs.google.com/forms/d/1FlrmzmPefHmH5qZUWCxTddbF07rYfIiQvitZpKGmciQ/viewform?usp=send_form You are warmly welcome to test it, we are interested in your feedback as educators. Thank you for your interest and contributions to the Thymio/VPL project. kind regards, Stéphane [1] http://tinyurl.com/vpl-iticse-2014 -- http://stephane.magnenat.net _______________________________________________ Aseba-edu mailing list [email protected] https://mail.gna.org/listinfo/aseba-edu _______________________________________________ Aseba-edu mailing list [email protected] https://mail.gna.org/listinfo/aseba-edu
