Sunday, April 5, 2015

Decision-Making in Educational Design Research

The decision-making process inherent in Educational Design Research (EDR) is still a bit muddy for me. My sense of EDR is that the design is constantly in flux. Assumptions, decisions, and changes all continue to happen throughout the design and implementation process. According to McKenney and Reeves (2012), the interactions and resulting changes to the design continue, and can even increase, as a project matures. The video of Dr. Bannan-Ritland describing the process of decision-making in EDR contributed to my confusion. In the video, she defined EDR as an unstructured, problem-solving process. She went on to describe the EDR process as having large numbers of assumptions and decisions made during the design process. She even indicated that her graduate assistants made many decisions along the way concerning the design of a project.

This situation makes me then wonder how we are able to measure which aspects of the design principles impacted the outcomes of an intervention, and to what extent. Perhaps due to my inexperience as a researcher, I would find it difficult to feel confident about making continuous decisions regarding the design of a program. It seems to me that effective EDR requires an experienced researcher who can quickly make design decisions based upon assumptions from the literature and from experience. My concern is really the potential domino effect of making weak design decisions early on which can then have negative effects on the subsequent decision-making. Very quickly, a design can become either quite convoluted or just based on weak assumptions and decisions. Either way, a researcher would end up in a situation where it would be very difficult to have confidence in the ability to judge the impact of the design elements on the outcomes of the intervention.

McKenney, S. E., & Reeves, T. C. (2012). Conducting educational design research. New York: Routledge.

Wednesday, March 11, 2015

DBR: Questions & Literature Reviews

I think that McKenney and Reeves (2012) do a good job of explaining Design-Based Research (DBR) in our textbook. They are very thorough in describing the phases of the DBR process. The researcher investigates an educational problem or issue, then enters the design phase, then implementation (with iterations, and then goes into the evaluation phase. My confusion comes from considering who would do this kind of research. A doctoral candidate who is hoping to finish his/her dissertation in a reasonable amount of time is likely to shy away from a process that includes multiple iterations perhaps over the span of a couple of years. I can also imagine that many research institutions also prefer to spend their time and resources on projects that will not take so long to get to the publication stage. I wonder if some DBR studies are supported by vendors (individuals or companies) that are trying to get a product, such as a new professional development program, to the market. Those vendors might have the capacity in terms of resources and time to embark on a long range project which might help substantiate their own product in the long run?

According to McKenney and Reeves (2012), conducting a literature review should help the researcher to gain insight into how to shape the data collection for the study, and it should help the researcher identify important elements for data analysis. Conducting the literature review for my study helped me do both of those things. I had been thinking that a survey would give me enough data in order to improve the online professional development program for new teacher induction. However, as I read more about studying professional development (online or face-to-face), it became clear that in order to get the rich, descriptive data that I would need to be able to improve the online professional development and suggest design principles that others could use, I would need to conduct interviews with at least a subset of the participants in this induction program. Those interviews would lead to the detailed data needed to identify themes, provide rich descriptions, and and make decisions based on the real perceptions of the participants.


McKenney, S. E., & Reeves, T. C. (2012). Conducting educational design research. New York: Routledge.

Saturday, February 7, 2015

Clarifying Design-Based Research

This post has two objectives. First, I will identify an area of Design-Based Research (DBR) that I am still finding a little confusing. And second, I will share a concept map that I created to represent some of my current understanding of DBR.

I am finding DBR, or Educational Design Research (EDR), to be a particularly useful methodology for addressing educational issues. However, one aspect of DBR that is still a bit muddy for me is the way some DBR studies end up with a list of design principles that are intended to be applied to other research or to the development of other programs or interventions. Generating a list of design principles as a result of a DBR study ends up feeling like a bit of a leap to me. I like the DBR process of identifying a an educational problem, creating a professional development (or other intervention) program based on the literature and known design principles, and then implementing and revising through an iterative process. My confusion comes when the researcher then generates design principles from the results of the study with the expectation that those principles could be generalized.

websitewer
easel.ly

Above is the concept map I created (using easel.ly) to represent some of my learning from this module. All of the reading that we did for this module indicated a few basic phases of the DBR process. The phases include analyzing a practical problem, developing a potential solution based on existing principles, engaging in an iterative process of refinement, and then reflecting on the process in order to generate new design principles which might be generalized (McKenney and Reeves, 2012). I chose to use a path design for my concept map because the literature is very clear about the steps involved in the DBR process. The two studies that I reviewed both followed the process outlined by the authors of each of our textbooks. Also, the studies presented in in the VoiceThreads of my classmates followed the same basic steps. Upcoming readings in our texts will dive deeper into each of the phases of DBR. But for now, I am feeling good about my level of understanding of this methodology.

My learning really focused on the iterative process of design, trial, feedback, revision, and more trials. I fear that I have overlooked that phase too frequently in my career so far. The impact of this module will be a change in my approach to my next professional development design project. I intend to highlight an iterative process that I think will lead to a higher quality product than I would have gotten otherwise.

McKenney, S. E., & Reeves, T. C. (2012). Conducting educational design research. New York: Routledge.

Wednesday, July 30, 2014

Reflection on the Online Teaching for Adult Learners Course


I created a concept map on the dimensions of online learning leading to persistence earlier in this course. Now I have updated that concept map to include the critical features of the online learning environment. I started by searching for a quote that would summarize my learning and my thoughts on the topic: “Knowledge is constructed actively by learners within a socio-cultural context.” (Bose, 2010). With that belief in mind, I tried to relate it to some of the things we have learned this semester
Created on easel.ly
about what makes for good online instruction. The real difference between the two sides of this concept map is the move from the theoretical to the practical. For me, the right side represents some of the ways in which online instructors can activate what they know about andragogy, contextualization, and self-directed learning. Online (and blended) instructors need to be even more purposeful than face-to-face instructors when it comes to creating an environment that values the experience that adult learners bring to the class, respects the adult learners' need for choice and control, and plays to adult learners' need to connect and to see the relevance of what they are doing in the class.

For part two of this blog reflection, we were asked to explain how this course has impacted our current or future work. I feel fortunate in that this course has directly affected two large projects under my direction. The first is one that I was going to have to do anyway. The "Social Media in the Common Core" online course I developed for an earlier assignment was the subject of my previous post (see below). The second project that has a direct relationship with this course came as a surprise. I was in a meeting recently with some people from my office and from a large school district in our county. The discussion turned to the Advancement Via Individual Determination (AVID) program. An issue that some students were having with the AVID elective courses was finding time in their schedule without losing opportunities for taking courses which will help them meet college entrance requirements in California. I asked about the possibility of an online alternative to these face-to-face elective courses. By the end of the meeting I had a new project in my lap! So I am now leading a small consortium of school districts in the creation of online AVID courses. This is a great project with a lot of potential to impact students in Riverside County and beyond. I do not believe this would have come about if this course had not raised my confidence in being able to put together a quality online learning experience.

Bose, S. (2010). Learning Collaboratively with Web 2.0 Technologies: Putting into Action Social Constructivism. Online Submission.

Friday, July 25, 2014

Reflection on Online Lesson Creation

Image licensed through Presenter Media
For me, getting this assignment to create an online lesson was a blessing in disguise. In my regular job I was going to have to take a face-to-face workshop about social media in the Common Core that I had done a few times and turn it into an online min-course anyway. So this assignment gave me the kickstart I needed to get that work done that I was going to have to do anyway. So I started transforming the content of my day-long face-to-face workshop into a three-week online professional development experience.

One of the concepts that I struggled quite a bit with from the beginning was trying to decide how much content was the right amount for this short online course. I had a full day's worth (7 hours) of content for the face-to-face course ready to go. But not all of that content translates well into an online course. So I decided to chink the content into three sections, or modules, and prepare approximately two hours worth of content for each module. Not that I care so much about the seat time. I am more interested in the mastery of the content. But having an approximate target helped me organize the content.

I have some experience creating online courses for adults. But I had never created one that was going to be reviewed by my peers and evaluated my my instructor. I found the readings and the evaluation criteria posted by Dr. Ching to be of great value as references for the mini course I was creating. More than once, I thought I was ready to submit this assignment only to review the criteria again and realize that I had not addressed something important. In the end, there turned out to be two great benefits of doing this assignment at this time. First, as I already mentioned, I was going to have to do this anyway to have this online course ready to go in September. Second, it was a great opportunity to actually put to use immediately all of the things we had been learning during this summer course. It is always important for my learning to have some timely, practical application for something I have been studying.

Sunday, June 29, 2014

Online Learning Tools: The Power of Reflective Blogs

I have been blogging for a while now. However, my main blog, Ed Tech Matters, exists mostly as a function of my job. In this blog I try to highlight different educational technology projects and implementations from districts around my county. While this is important work in communicating with
the educational technology community around Riverside County, it is definitely not a reflective blog. I had been resistant to the idea of a reflective blog until going through the reading this week.

Stavredes (2011) asserts that the practice of self-reflection supports the growth of self-directed, independent learners. I can see how a reflective blog, for students and/or the instructor, can be an important piece of that self-reflection. The reading by Stavredes (2011) also indicates the importance of social presence, instructor presence, and cognitive presence in an online course. Blogs can contribute to social and instructor presence when an instructor shares his/her thoughts on a topic and invites interaction from the learners. Cognitive presence can be facilitated through the use of reflective blogs by having students engage in interactive blogs to construct knowledge. "Blogs are an excellent reflective tool for learners to communicate about their learning experiences in the form of an online jo
urnal" (Stavredes, 2011, p.176).

Some adult learners use reflective blogs to learn course content, to foster reflection, to monitor and assess their learning process (Kidd & Keengwe, 2010). The last item in that list, monitoring and assessing their own learning process, is where I think a reflective blog would be good for my own professional practice. I could take a lesson from my wife. She keeps up a professional reflective blog called Balancing on the Leading Edge. It has been her experience that this practice of reflecting through her blog helps her internalize her learning as well as share it our with others in our profession.

I have some concerns about my ability to keep up two professional blogs - one that is part of my job function, and one that is a reflective blog. But I can see the benefits and I do hope that I can make a reflective blog part of my regular professional practice.


References

Kidd, T. T., & Keengwe, J. (2010). Adult Learning in the Digital Age: Perspectives on Online Technologies and Outcomes (pp. 1-293). Hershey, PA: IGI Global. doi:10.4018/978-1-60566- 828-4

Stavredes, T. (2011). Effective online teaching: Foundations and strategies for student success. John Wiley & Sons.


Tuesday, June 10, 2014

Persistence and Online Learners



My assignment for this post was to discuss the challenges that affect learners' persistence in online courses and relate those challenges to my own online teaching or learning experiences. Stavredes (2011) defined persistence as referring to the actions of learner as they continue their education from first enrollment through degree attainment. That is a broad definition that would include variables from inside and outside of the educational institution.

PersistenceModels
Created on easel.ly by Dennis Large
Researchers have created many models to provide frameworks for understanding the factors of persistence and attrition of learners at traditional higher education institutions. Those models tend to have three things in common. First, they all describe lack of persistence as occurring over time and affected by a learner's ability to create a relationship with the school. Second, the models all describe both social and academic factors that affect a learner's persistence. Third, the models are complex with each having multiple variables.

For online learners, the factors affecting their persistence can be very different from those of the learners at traditional face-to-face institutions. The biggest difference is that many of the factors of the social environment that affect so many face-to-face students do not exist online. So online learners do not typically have the extra support structure of a social environment available to most traditional learners. Also, online students tend to be older (over 24) than traditional students (Stavredes, 2011). These older students tend to have more family and work obligations and more life crises to deal with than younger students.

Created on easel.ly by Dennis Large
I created these two infographics to illustrate the variables affecting the persistence of adult online learners. The concept map depicts the dimensions of adult online learning that lead to persistence in
learning in an online setting include the ability to contextualize, the degree to which the learner is self-directed, and the dimensions of andragogy. The Venn diagram shows the variables listed come from two different models of persistence. What I find interesting (as with any Venn diagram) is the section in the middle. The variables that are found in both of these models include: ethnicity, academic performance, finances, hours of employment, family responsibilities, and outside encouragement. Where the two models really diverge is in the post-admission to the institution variables of the Rovai model. That model includes external and internal factors that may not have been present prior to enrolling in the institution. Those factors include: life crises, opportunities to transfer, academic integration, social integration, goal commitment, institutional commitment, learning community, study habits, absenteeism, course availability, accessibility of support, and teaching and learning styles.

In my own experience with online learning, I can report that I had a very difficult time with my first online class. It was about six years ago that I first took an online course at a university. I had a difficult time with the lack of a social group. I was used to having a group of students that I would talk with before and after class, and form study groups with, and generally commiserate with. I eventually got past that and adjusted my learning style for further online learning experiences. However, last year I had another very difficult experience with online learning. I tried taking a Massive Open Online Course (MOOC) and that was a complete failure. I ended up dropping out of the course three weeks into the eight week course. I did not end up feeling connected to the course, the instructor, or any classmates in any way. I've learned that those social connections are important to me, even in an online course. That realization has also affected the way that I teach online. I try to give plenty of opportunities and options for creating a social environment within the courses that I teach.


References:
Stavredes, T. (2011). Effective online teaching: Foundations and strategies for student success. John Wiley & Sons.