First, the observer writes down the following:
- the start time of the cycle,
- the subjects to be observed, whether it be "entire class", "subgroups", or any specific group,
- the major activity, which can be "instructional", "procedural", or other,
- the estimated portion of learners on task, which can be "all", "almost all", "half or less", etc.,
The observer also observes the instructor and marks the instructor's type and object of engagement. Finally, the observer also notes the number of questions students ask in the cycle.
What STROBE provides is a simple and effective way of gauging the level of engagement of students in the classroom, not necessary learning. It can also be skewed by untrained observers like me who did it for the first time in one of the CS classes recently. As a newbie to this, I found myself picking on the students who were not "norms" to be my targets, those who were working on their computers, those who were talking to other people, etc. I had to keep reminding to randomly pick students and not just the ones that catch my attention!
Kelly, P. , Haidet, P., Schneider, V., Searle, N., Seidel, C., Richards, B. (2005). A Comparison of In-Class Learner Engagement Across Lecture, Problem-Based Learning, and Team Learning Using the STROBE Classroom Observation Tool, Teaching and Learning in Medicine, Volume 17, Issue 2 April 2005 , pages 112 - 118