This will be my final blog for our major project. Last time, I left off saying that this post would be about student and teacher feedback that we’ve received. We haven’t done our formal teacher feedback yet, but we have had some student feedback. First, let’s check that data out:
One of our barriers to start was that students were using their student numbers to use the hallpass signout. This is something that is easily addressed, either by the teacher telling the student their number, or by a student finding the number on their course timetable. The second issue is that students could very easily type in someone else’s student number or text to misidentify themselves and throw off the data collected. This was something that there was no way around outside of teacher monitoring the hallpass submissions live as they were coming in.
As you can see from our initial polling data, 100% of students either had a personal device or access to a computer to sign in and out of the class. This was a higher number than we anticipated. Overall, we would estimate that this number is closer to 90%.
72% of those polled had actually used the electronic hallpass signout. We only included this question so that those that answered “yes” could be given some follow-up questions as to not skew out data. Approximately 85% found this method faster than the old paper method. This was higher that we were expecting, but we worked hard to make the process as streamlined as possible. The QR code versus a direct link was the preferred way to access the sign out with 57%.
The final question asked if this method impacted hallway use at all.
88.5% said that it hasn’t changed their habits, While 8.2% said that they find themselves into the hallway less now. 3.3%, or 2 out of 85 respondents said that they go into the hallway now with the electronic sign out.
Though we’re still a few days out from surveying staff participants, the overall feedback has been positive. Kyle and I recently switched from Google Forms to Microsoft Forms, which allows student submissions to be tied to their names via our system Microsoft Office accounts. Student misidentification was the #1 concern, so we were glad to discover that functionality with the Microsoft variant. A couple of math teachers said they had some students reverting back to a paper log because the online process is too slow. With 85% of our surveyed indicating that our system is faster for them, I believe this is just a matter of training staff and students a bit more on best practices. We created shortened URL for a direct link. Many teachers have this on their websites or written on their white board. Assuming students are logged into their one drive account on their personal device, and have the URL in their browser history, our current average time for each sign in or sign out is approximately fifteen seconds. We feel that this can be cut to ten seconds or less with proper training.
One issue that remains is that we are at the mercy of internet connectivity. Though we haven’t surveyed for this, I would guess that a smaller fraction of students who have personal devices have data plans. In a power or internet outage, there’s not much that can be done outside of reverting to the paper log.
In switching to Microsoft forms, we have also lost some functionality for allowing teachers to see results. As far as we can tell, there is no live spreadsheet view of student submissions to verify that a student is indeed submitting an entry. At a certain point we have to trust that the students are following the procedures, as we’ve done as much as we can to keep them honest in this.
As far as what is done with the data after, we’re not really sure. So we send a monthly report to all pilot teachers? Do we forward this information to Student Services or administration? To us, streamlining the process, eliminating paper, and having at least some accountability across classrooms is an important step in the right direction. I don’t think that Kyle or I wanted this to become something that was used strictly to discipline students who are frequently in the hallway. At the end of the day, those students are going to find a way around the system, particularly with only about 25% of the staff on board.
Overall I think we’ve done some good work on this project. There are still some changes that need to be made and some staff and student training to be done. I will likely blog again on the progress that we’ve made beyond the class, so stay tuned for that.