You are currently browsing the tag archive for the 'skylight matrix survey system' tag.

CTLT has been developing a new online survey tool to meet our needs to administer online course evaluations on a large scale. This work is funded in part by a FIPSE grant (BeTA) in collaboration with the TLT Group. One of the by-products we have found in the system we are calling “Survey to make a survey.”

The general idea is that one survey is used to gather information needed to create a second survey and that the data from the first survey can be moved into the second survey by simple, mostly automatic processes: the data in an Excel report coming from the first survey is transformed using Excel functions to be the data needed to create a variant of the survey for a group of respondents in the second survey.

Our first implementation of this idea is a survey exploring instructors’ (largely informal) mid-course formative assessments. The goal was to learn about good practices faculty employ, offer opportunities to learn about other practices, AND, learn which faculty would like to have a formal mid-term course evaluation administered online.

This “survey to make a survey” technique has many possible applications. In describing Matrix Surveys examples, the TLT Group gives an example in the section  “Using a Survey of Faculty to Create a Matrix Survey of their Students”

An even more elaborate application of the technique would be to implement our ideas of a transformed grade book. In that example, there are several surveys that are linked to one another and that are used to report results to multiple audiences. This might be done in the semi-automatic means described above, but for uses on a large scale, the linkages enabling survey creation will require greater automation.

This blog will attempt to emulate what we think we've learned from George Hotz and others, how to be a node in a learning community working on a problem. Our statements of the problem(s) we are working on are tagged here. We view this space as one element in our Learning Portfolio, and will link to other portions of our portfolio among systems we host and world systems we have adopted. more...

Categories

Blog Stats

  • 11,099 hits

RSS CTLT and Friends Recent Bookmarks

  • Five fallacies of cloud computing
    "much of the thinking and hype surrounding cloud computing is built upon fallacies while ignoring the market realities. Let me outline those fallacies here."Especially note Fallacy #5, which includes a discussion of "trust".Comments:"much of the thinking and hype surrounding cloud computing is built upon fallacies while ignoring the […]
  • Google Gadget Ventures
    Google Gadget Ventures is a new Google pilot program dedicated to helping developers create richer, more useful gadgets. Inspired by the success of iGoogle, which has been driven by the creation by 3rd-party developers of a broad range of gadgets, Gadget Ventures provides two types of funding:Grants of $5,000 to those who’ve built gadgets we’d like to see de […]
  • WSU Today Online - Current Article List
    Comments:I ponder these highlights - Gary BrownHighlights and Sticky Notes:the goal of the program is for students to submit their portfolios at the start of their junior year, and only about 34 percent are managing to do that.Writing Assessment Program received the 2009 “Writing Program Certificate of Excellence”If students delay completing their portfolio […]
  • CDC Evaluation Working Group: Framework
    Framework for Program Evaluation by the CDCThis is a good resource from another institution engaged in program evaluation. Click through "Steps and Standards" for information on collecting credible evidence and engaging stakeholders.Comments:Framework for Program Evaluation by the CDC This is a good resource for program evaluation. Click through […]
  • U.S. GAO - Program Evaluation: A Variety of Rigorous Methods Can Help Identify Effective Interventions
    Comments:a critical resource - Gary BrownHighlights and Sticky Notes:In the absence of detailed guidance, the panel defined sizable and sustained effects through case discussionThe Top Tier initiative's choice of broad topics (such as early childhood interventions), emphasis on long-term effects, and use of narrow evidence criteria combine to provide li […]