Paper assessment remains to be an essential formal assessment method in today's classes. However, it is difficult to track student learning behavior on physical papers. This thesis presents a new educational technology—Web Programming Grading Assistant (WPGA). WPGA not only serves as a grading system but also a feedback delivery tool that connects paper-based assessments to digital space. I designed a classroom study and collected data from ASU computer science classes. I tracked and modeled students' reviewing and reflecting behaviors based on the use of WPGA. I analyzed students' reviewing efforts, in terms of frequency, timing, and the associations with their academic performances. Results showed that students put extra emphasis in reviewing prior to the exams and the efforts demonstrated the desire to review formal assessments regardless of if they were graded for academic performance or for attendance. In addition, all students paid more attention on reviewing quizzes and exams toward the end of semester.

Virtual Reality (hereafter VR) and Mixed Reality (hereafter MR) have opened a new line of applications and possibilities. Amidst a vast network of potential applications, little research has been done to provide real time collaboration capability between users of VR and MR. The idea of this thesis study is to develop and test a real time collaboration system between VR and MR. The system works similar to a Google document where two or more users can see what others are doing i.e. writing, modifying, viewing, etc. Similarly, the system developed during this study will enable users in VR and MR to collaborate in real time.

The study of developing a real-time cross-platform collaboration system between VR and MR takes into consideration a scenario in which multiple device users are connected to a multiplayer network where they are guided to perform various tasks concurrently.

Usability testing was conducted to evaluate participant perceptions of the system. Users were required to assemble a chair in alternating turns; thereafter users were required to fill a survey and give an audio interview. Results collected from the participants showed positive feedback towards using VR and MR for collaboration. However, there are several limitations with the current generation of devices that hinder mass adoption. Devices with better performance factors will lead to wider adoption.

Many English Language Learner (ELL) children struggle with knowledge of vocabulary and syntax. Enhanced Moved by Reading to Accelerate Comprehension in English (EMBRACE) is an interactive storybook application that teaches children to read by moving pictures on the screen to act out the sentences in the text. However, EMBRACE presents the same level of text to all users, and it is limited in its ability to provide error feedback, as it can only determine whether a user action is right or wrong. EMBRACE could help readers learn more effectively if it personalized its instruction with texts that fit their current reading level and feedback that addresses ways to correct their mistakes. Improvements were made to the system by applying design principles of intelligent tutoring systems (ITSs). The new system added features to track the student’s reading comprehension skills, including vocabulary, syntax, and usability, based on various user actions, as well as features to adapt text complexity and provide more specific error feedback using the skills. A pilot study was conducted with 7 non-ELL students to evaluate the functionality and effectiveness of these features. The results revealed both strengths and weaknesses of the ITS. While skill updates appeared most accurate when users made particular kinds of vocabulary and syntax errors, it was not able to correctly identify other kinds of syntax errors or provide feedback when skill values became too high. Additionally, vocabulary error feedback and adapting the complexity of syntax were helpful, but syntax error feedback and adapting the complexity of vocabulary were not as helpful. Overall, children enjoy using EMBRACE, and building an intelligent tutoring system into the application presents a promising approach to make reading a both fun and effective experience.

The purpose of this study was to investigate the impacts of three types of instructional presentation methods on learning, efficiency, cognitive load, and learner attitude. A total of 67 employees of a large southwestern university working in the field of research administration were randomly assigned to one of three conditions. Each condition presented instructional materials using a different method, namely dynamic integrated, dynamic non-integrated, or non-dynamic non-integrated. Participants completed a short survey, pre-test, cognitive load questions, learner attitude questions, and a post-test during their experience. The results reveal that users of the dynamic integrated condition treatment showed significant improvement in both learning and efficiency. The dynamic non-integrated participants had a faster mean time to complete an assigned task, however, they also had significantly lower average test scores. There were no other significant findings in terms of cognitive load or learner attitude. Limitations, implications and future studies are discussed.

This research study looks at the design and development of an online concussion awareness education module. The Keep Your Head in the Game: Concussion Awareness Training for High School Athletes, or Brainbook, is a stand-alone e-learning module designed to run for fifty minutes and to be highly interactive using short video clips with associated comments as well as polling features to allow students to experience the content as they are learning. It was designed to provide the instruction through a framework that resembles social networking to increase relevance and engagement to the high school student-athlete population it was created for. The content is delivered through the presentation of an online conversation or a "feed" where characters with varying attitudes towards concussion, with contributions from a doctor and professional athlete, discuss concussions from their experiences and beliefs. The instructional goals of the module are to increase the athletes understanding and personal application of the causes and effects of concussions, and to motivate a change in attitude and behavior related to the perception, recognition, and care of head injuries. The design and development of this online educational module followed the tenets of design and development research as determined by Richey and Klein (2007), where the tasks of completing the design and development of the product were combined with studying the process. The study focused on what could be learned during the phases of design and development, identifying challenges that were encountered designing education that resembles social networking, testing the effectiveness of the module in relation to meeting the instructional objectives, and creating guidelines and best practices that contribute to the field of instructional design.

This design and development project was found to be a success by the design team, the client, and outside entities. Findings of the study include a breakdown of the most impactful decisions made by the design team in the design and development process, the results of the team member and client interviews to provide additional insight into the process, and results from the student athlete post-module design and attitude surveys informing if attitude change indeed occurred as a result of this educational intervention. Brainbook also received much coverage in the media and has progressed on to version 2.0, additional measures of success of the project.

With the advent of Massive Open Online Courses (MOOCs) educators have the opportunity to collect data from students and use it to derive insightful information about the students. Specifically, for programming based courses the ability to identify the specific areas or topics that need more attention from the students can be of immense help. But the majority of traditional, non-virtual classes lack the ability to uncover such information that can serve as a feedback to the effectiveness of teaching. In majority of the schools paper exams and assignments provide the only form of assessment to measure the success of the students in achieving the course objectives. The overall grade obtained in paper exams and assignments need not present a complete picture of a student’s strengths and weaknesses. In part, this can be addressed by incorporating research-based technology into the classrooms to obtain real-time updates on students' progress. But introducing technology to provide real-time, class-wide engagement involves a considerable investment both academically and financially. This prevents the adoption of such technology thereby preventing the ideal, technology-enabled classrooms. With increasing class sizes, it is becoming impossible for teachers to keep a persistent track of their students progress and to provide personalized feedback. What if we can we provide technology support without adding more burden to the existing pedagogical approach? How can we enable semantic enrichment of exams that can translate to students' understanding of the topics taught in the class? Can we provide feedback to students that goes beyond only numbers and reveal areas that need their focus. In this research I focus on bringing the capability of conducting insightful analysis to paper exams with a less intrusive learning analytics approach that taps into the generic classrooms with minimum technology introduction. Specifically, the work focuses on automatic indexing of programming exam questions with ontological semantics. The thesis also focuses on designing and evaluating a novel semantic visual analytics suite for in-depth course monitoring. By visualizing the semantic information to illustrate the areas that need a student’s focus and enable teachers to visualize class level progress, the system provides a richer feedback to both sides for improvement.

For this master's thesis, an open learner model is integrated with Quinn, a teachable robotic agent developed at Arizona State University. This system is represented as a feedback system, which aims to improve a student’s understanding of a subject. It also helps to understand the effect of the learner model when it is represented by performance of the teachable agent. The feedback system represents performance of the teachable agent, and not of a student. Data in the feedback system is thus updated according to a student's understanding of the subject. This provides students an opportunity to enhance their understanding of a subject by analyzing their performance. To test the effectiveness of the feedback system, student understanding in two different conditions is analyzed. In the first condition a feedback report is not provided to the students, while in the second condition the feedback report is provided in the form of the agent’s performance.

The American Heart Association recommended in 1997 the data elements that should be collected from resuscitations in hospitals. (15) Currently, data documentation from resuscitation events in hospitals, termed ‘code blue’ events, utilizes a paper form, which is institution-specific. Problems with data capture and transcription exists, due to the challenges of dynamic documentation of patient, event and outcome variables as the code blue event unfolds.

This thesis is based on the hypothesis that an electronic version of code blue real-time data capture would lead to improved resuscitation data transcription, and enable clinicians to address deficiencies in quality of care. The primary goal of this thesis is to create an iOS based application, primarily designed for iPads, for code blue events at the Mayo Clinic Hospital. The secondary goal is to build an open-source software development framework for converting paper-based hospital protocols into digital format.

The tool created in this study enabled data documentation to be completed electronically rather than on paper for resuscitation outcomes. The tool was evaluated for usability with twenty nurses, the end-users, at Mayo Clinic in Phoenix, Arizona. The results showed the preference of users for the iPad application. Furthermore, a qualitative survey showed the clinicians perceived the electronic version to be more accurate and efficient than paper-based documentation, both of which are essential for an emergency code blue resuscitation procedure.

This study aims to uncover whether English Central, an online English as a Second Language tool, improves speaking proficiency for undergraduate students with developing English skills. Eighty-three advanced English language learners from the American English and Culture Program at Arizona State University were randomly assigned to one of three conditions: the use of English Central with a learner-control, shared-control, and a no-treatment condition. The two treatment groups were assigned approximately 14.7 hours of online instruction. The relative impact of each of the three conditions was assessed using two measures. First, the Pearson Versant Test (www.versanttest.com), a well-established English-as-a-second-language speaking test, was administered to all of the participants as a pre- and post-test measure. Second, students were given a post-treatment questionnaire that measured their motivation in using online instruction in general, and English Central specifically. Since a significant teacher effect was found, teachers involved in this study were also interviewed in order to ascertain their attitude toward English Central as a homework tool. Learner outcomes were significantly different between the shared and learner conditions. Student motivation was predictive of learning outcomes. Subjects in the shared condition outperformed those in the learner condition. Furthermore, those in the shared condition scored higher than the control condition; however, this result did not reach statistical significance. Results of the follow-up teacher survey revealed that while a teacher's view of the tool (positive or negative), was not a predictor of student success, teacher presentation of the tool may lead to a significant impact on student learning outcomes.