Monday, October 19, 2009

Questions for Digital Publishing Panel

I'm not exactly sure what I want to ask the presenters for this coming Friday. I'll probably have questions forming as I listen to their presentations.

However, when I meet with Kris, I would like to talk through my research ideas. Maybe I can get some ideas about which aspects of that research might be publishable later on. Or maybe I can get idea for an article I can start working on and get published eventually.

I am interested in the idea of a multimodal dissertation. I want to know more about what this could look like or what the presenters have seen happening.

Wednesday, October 14, 2009

Computer- Mediated Research

I think my definition of computer-mediated research has expanded since trying out the games in the games lab and reading the articles for today. Computer-mediated research can really include a lot of different things. I'm not sure how to define "computer-mediated" research, but I guess a very broad and general definition would be any research that examines human interaction with computers/technologies (not just computers, but software programs, etc.). 

I had never filled out an IRB form before. It felt strange filling out a form that I think was meant for kids. I know IRB forms are supposed to explain to people what they can expect while being participants, but I found it interesting that the form presented the risks before the benefits (they were explained in the same paragraph). Are IRB forms supposed to present the risks of the study before the benefits? Is there some reason for doing so?

Sunday, October 11, 2009

Digital Environments and Virtual Research

Question 1-What special circumstances or considerations should be given to research done in an about online spaces (i.e. informed consent of "subjects", ethics, access, etc.)?

Answer 1-I think research done in online spaces should be treated just like research done in face-to-face or physical spaces whenever possible. If someone claims that digital research should be treated differently, that person is suggesting that virtual research should be valued differently (and most likely this would mean valued less than other more traditional forms of research). We've all heard of up-and-coming scholars fearing that tenure committees won't value their virtual research. Because this is a real fear (although, I think the appreciation of virtual research and writing is changing), virtual research should reflect practices relating to consent, ethics, and so on that traditional research follows.

I think it is important to get consent of "participants" even when they don't know they are participants. Yes, this could make research much, much more difficult. For instance, how could we get consent from someone in Second Life? Second Life participants could very easily ignore my request for consent to study their communities. But, as many people argue, the internet is a "public" space, and information is available to all people. So is consent needed in this case? I can see the argument that people can change certain settings to private, but not all people know how to do this. I don't think we can, as researchers, make any assumptions about whether or not people want their information to be public. Also, just because someone's information is "private," it does not mean that people can't get to it. There are many ways around privacy settings.

Question 2-What are some of the major benefits you see in virtual research? What are some of the disadvantages?

Answer 2-Virtual research is very relevant. It is beginning to explore a space where most of our interaction takes place today. By researching how people communicate or make meaning in these spaces, we are better able to understand how to help our students learn to become not only examiners of texts but also rhetorical producers of texts. Virtual research allows us to examine new writing practices, and as McKee and DeVoss explain, virtual research requires us to make or adapt new methodologies to study writing practices and how they change. This new environment helps researchers to continually evaluate methodologies and their strengths and weaknesses.

Some disadvantages to virtual research do exist. For instance, most virtual research probably does not include any f2f interaction. Despite my interest in virtual research, I do feel that f2f interaction provides information about participants that researchers can't get any other way. I've read a lot about virtual teams in technical communication articles. No matter what technologies people use to communicate virtually, people claim that they feel more "respect" for their teammates once they meet teammates in f2f locations. I wonder if by never meeting virtual participants researchers are more or less likely to represent those participants accurately (if it is ever possible to represent people accurately, no matter what the location is). Face-to-face interactions also allow researchers to study body language, which I'm sure has an effect on how researchers understand participants, whether researchers admit this or not in their written studies.

Question 3-In light of research like Thurlow and McKay's, how do you think our students are likely to value online scholarship and research practices?

I think students see online research as "easier" when they first set out to complete a research assignment or paper. However, they quickly learn that research done online (Google or databases) can be very difficult because of the amount of information. They also realize that getting the exact information they need is hard. For instance, students, at least in first-year writing courses, don't understand that they must search many, many key terms before they will find the information they need. They are very likely to search one term and then become frustrated when they don't find anything they see as relevant. I like that the Digital Breadcrumbs piece values many different kinds of research practices and seeks "to offer a broader perspective on what constitutes legitimate and effective scholarly research." This idea opens up many possibilities for students when doing research. Although students do initially go to Google, I think they enjoy using databases offered through the library because they find more relevant and useful information.

I do see some problems, though, with this move towards online research practices. I never noticed this problem until coming to NMSU. Many of my students, I suspect, do not have internet or even a computer at home, so online research is probably harder for them to learn how to do. Yes, students can use computers on campus, but many of them can't spend all day and night on campus. Most of the work I get done happens in my apartment, so thankfully I have a computer and internet connection to use at home. I think this example shows that there is still largely a economic divide between who can and cannot do successful online research. And that makes me think that the research we (scholars) do in online spaces is probably skewed by who has access to online technologies. This could be problematic for researchers who want to generalize their study results to a larger population.

Saturday, October 3, 2009

Possible Research Questions and Methodology

As mentioned before, I'm interested in teacher response to students' written work in online and face-to-face classrooms. Some possible research question include the following:

How do teachers respond to students' written work in traditional classrooms and online courses?
In what ways to teachers respond? What tools are used in both kinds of classrooms? Do these tools make responding easier? Do these tools change/influence the kinds of feedback teachers give? Do teachers in online courses respond differently/provide different kinds of feedback to students in online courses compared to face-to-face courses? If so, why? Are students receiving equally effective feedback in both kinds of classrooms?

In order to answer these questions (or some of them), I feel the best methodology would be a case study. Because I don't have one specific question to focus my research, a case study might help me to narrow down my focus or show me which directions the research could go. A case study would allow me to observe classrooms, code feedback on students' papers, and interview both teachers and students if necessary. I don't think a survey or just coding would be enough. I feel that I would need to have contact with participants in order to observe or discuss the reasoning behind the ways teachers decided to provide feedback. There would be a lot of information I couldn't simply interpret on my own or that I wouldn't feel comfortable trying to interpret without any kind of explanation from the participants.

Ethical Considerations of Surveys

Wednesday's facilitation about surveys helped me to further understand how much work surveys can be. They might take many, many revised revisions before the questions are as perfect as they can possibly be in order to avoid leading respondents to certain answers. It seems that one way researchers can avoid, as much as possible, creating biased surveys or questions that lead participants in a certain direction is by using a combination of questions. Maybe using both fixed and open-ended questions will allow for more accurate responses and interpretations of those responses by the researcher. Of course, even if a researcher uses mixed question types, the questions might still be biased or leading. However, one way to prevent unethical behavior with surveys is probably to have other researchers examine the questions or the interpretations the researcher has about the results. If it's even possible, like with interviews, the researcher could try to locate some of the participants after the survey is complete to see if those participants feel that the research has given accurate, unbiased interpretations of the responses. For example, if I surveyed 5 different composition courses, I could attend those courses to show the results I found. The students might have some kind of feedback as to whether or not they feel the interpretations accurately represent their answers. Maybe this would be impossible to do, but surely it is possible to have colleagues examine the research a person has done.

As for my own research, I'm sure I am biased in some way. I'm interested in understanding if teachers respond differently to students' written work in online classrooms compared to face-to-face classrooms. I'm interested in this study because I want people to understand that online instruction is valuable for many reasons--so I guess that is a bias right there. However, I've never taught an online course, so I actually really don't know what to expect to find if I do a study on this issue. I think that is helpful--because I don't feel that I would be going in looking for something specific. I have an idea of the different tools teachers use to respond to students in online courses, but I have no idea how those tools affect the kinds of response students receive about their written work.

I can see how for many people it might be tempting to reject certain responses from surveys that don't fit their preconceived ideas. I suppose we can all admit that it might even be tempting to do this, especially if we have invested a lot of time and energy into a project and feel that we really have something to prove (like an issue we care strongly about). However, I think it is very important to remember that not proving our point is also important. For example, maybe I find that students receive exactly the same kind of feedback in online courses as they do in face-to-face courses. Well, that says something very important about the teachers in our field and how students are learning. Maybe I find that teachers do respond differently to students in online courses. That would lead to more research about why this happens, what needs to change, or what face-to-face courses can learn from online courses. There's really a place to contribute to the field no matter which way my results lead me. But, in order to ensure I don't fall into the temptation to choose only the results that matter most to me, I can always ask colleagues to check my work, give their opinions, and challenge my results. Second and third and even forth opinions are very important. Plus, they might even lead to ideas that I never thought of before. Really, all work we do is collaborative, and knowledge is never "created" by just one person. It's important to have others review the work I have done for so many reasons.