Thursday, May 29, 2014

Cognitive Engagement in Online Postings

Shukor, N. A., Tasir, Z., Van, M. H., & Harun, J. (2014). A Predictive Model to Evaluate Students’ Cognitive Engagement in Online Learning. Procedia - Social and Behavioral Sciences, 116, 4844-4853.

Shukor, Tasir, Van & Harun use an interesting methodology to explore cognitive engagement in online course postings.  Since educators need to verify the quality of online learning, examining the level of cognitive engagement generated serves as a good starting point.  After citing studies on how cognitive engagement increases motivation, improves grades and enhances learning, the authors look at studies investigating cognitive engagement in online environments.  Using a 12-point coding system developed in one of these studies (Van der Meijden, 2005), Shukor et al examined all postings for 20 students enrolled in a web development course at a Malaysian university.  Combining coded responses allowed students to be ranked as showing high, high-low or low cognitive engagement.  Finally, the researchers compared these rankings with course management data to investigate how often these students had logged in and read postings.  Using their content analysis results and dating mining techniques, the researchers offered a predictive model for what factors lead to cognitive engagement.

I was impressed with the coding system and intrigued by the use of data mining techniques but less impressed by the predictive model.  The researchers concluded that two factors predicted the level of cognitive engagement: total number of high cognitive engagement responses versus total number of unelaborated responses only offering information.  Perhaps I am missing something, but it sounds circular—if you do this behavior, you’ll show this behavior.  Nevertheless, it does suggest that students can be encouraged to increase cognitive engagement with more elaborated responses.  This connects to another, more informative finding. Levels of cognitive engagement were not correlated with participation.  In other words, students who logged in frequently and read discussions did not necessarily show higher levels of cognitive engagement. This does offer an instructor a starting point for encouraging engagement.  By offering more elaborated responses, students can deepen their learning.  

Several other factors limit the conclusions.  For one thing, since the online component was 20% of the course grade, apparently the bulk of the course was face to face.  Thus, students who showed high engagement in the online portion of the course may not have been highly engaged overall or vice versa. Since the quality of the course was not entirely invested in the online components, can we generalize these findings to fully-online courses? Another obfuscating factor is that English is unlikely to be the first language of most students at a Malaysian university, albeit an English medium one.  The ability to demonstrate higher cognitive engagement through elaborated responses will inevitably be affected by linguistic proficiency.  Finally, the course studied here was a practical class where students were solving problems related to designing websites.  It would be interesting to see whether the results might differ for humanities or social science classes designed to probe ideas.


Because of the narrow scope and research concerns, I would not recommend this article as a general online learning resource.  However, it could be useful for course developers seeking to increase cognitive engagement or researchers exploring the topic.  If nothing else, the coding methodology looks like a useful research tool and the literature review points to some promising-looking studies.

Tuesday, May 27, 2014

Student Engagement in Online Writing Course



Rendahl, M., & Breuch, L. A. (2013). Toward a Complexity of Online Learning: Learners in Online First-Year Writing. Computers and Composition, 30(4), 297-314.

In this article, Merry Rendahl and Lee-Ann Kastman Breuch, both of whom teach first-year writing writing and professional communication courses at the University of Minnesota, describe a case study looking at the degree to which learner behaviors predicted success in two online first year writing courses.  Although other researchers have claimed that social engagement is a key aspect of student success in online writing courses, Rendahl and Breuch found that student engagement is a more crucial aspect. 

I chose this article to examine how learning theory translates into the online context.  I have long been interested in how learning works and looked to recent advances in cognitive science to provide explanation.  Ron Ritchhart’s Intellectual Character, Daniel Willingham’s Why Students Don’t Like School, and How Learning Works by Susan A. Ambrose et al suggest that a key element of learning is cognitive engagement.  On the other hand, Lev Vygotsky’s theories of social learning as well as Mikhail Bakhtin’s ideas about dialogism, John Swale’s acknowledgement of discourse community, and WAC and WID research showing learners moving into a disciplinary community suggest that successful learning involves social engagement, whether direct or mediated through texts. 

Looking for articles that applied learning theory to distance learning led me to Rendahl and Breuch’s article.  In fact, Rendahl and Breuch find their theoretical basis in the social cognitive theory of Albert Bandura who proposes a triadic interaction between environmental factors, student behaviors such as study habits, and personal factors such as motivation, ability, personality, gender and so on.  In their literature review, the authors note how writing researchers such as Linda Flower have also used Bandura’s theories.  In fact, although Bandura’s ideas form the foundation for this study, the researchers primarily focus on behavior, on how study habits contribute to student success.  In a way, of course, this makes sense, since these are most easily controlled by learners.  In order to examine these factors, the researchers used four different surveys which looked at study behaviors, attitudes, learning strategies and technology access supplemented with statistics from course management system, and interviews with students and instructors.  They learned that students spent more time interacting with course content than social interaction, either with instructor or classmates.  Nevertheless, students were satisfied with the amount of social interaction, and most were enthusiastic about taking another online writing class.  In other words, student engagement does not appear to be the essential factor for student success in online courses. Students may equally benefit from mental engagement with course content.  Obviously, this claim needs to be investigated further, but the article offers an interesting starting point for those who are interested in exploring how learning theories may shed light on online learning.