Responsible test use requires validation \u2014 the process of collecting evidence to support the inferences drawn from test scores. In high-stakes testing contexts, the need for validation is especially great; the far-reaching nature of high-stakes testing affects the educational, professional, and financial futures of stakeholders. The Standards for Educational and Psychological Measurement (AERA et al., 2014) offers specific guidance in developing and implementing tests. Still, concerns exist over the extent to which test developers and users of high-stakes tests are making valid inferences from test scores. This paper explores the current state of high-stakes educational testing and the validity issues surrounding it. Drawing on measurement theory literature, educational literature, and professional standards of test development and use, I assess the significance of these concerns and their potential implications for the stakeholders of high-stakes testing programs.

The areas of cloud computing and web services have grown rapidly in recent years, resulting in software that is more interconnected and and widely used than ever before. As a result of this proliferation, there needs to be a way to assess the quality of these web services in order to ensure their reliability and accuracy. This project explores different ways in which services can be tested and evaluated through the design of various testing techniques and their implementations in a web application, which can be used by students or developers to test their web services.

Web-application development constantly changes \u2014 new programming languages, testing tools and programming methodologies are often proposed. The focus of this project is on the tool Selenium and the fairly new technique known as High Volume Automated Testing (HVAT). Both of these techniques were used to test the Just-in-Time Teaching and Learning Classroom Management System software. Selenium was used with a black-box testing technique and HVAT was employed in a white-box testing technique. Two of the major functionalities of this software were examined, which include the login and the professor functionality. The results of the black-box testing technique showed parts of the login component contain bugs, but the professor component is clean. HVAT white-box testing revealed error free implementation on the code level. We present an analysis on a new technique for HVAT testing with Selenium.

Smartphones have become increasingly common over the past few years, and mobile games continue to be the most common type of application (Apple, Inc., 2013). For many people, the social aspect of gaming is very important, and thus most mobile games include support for playing with multiple players. However, there is a lack of common knowledge about which implementation of this functionality is most favorable from a development standpoint. In this study, we evaluate three different types of multiplayer gameplay (pass-and-play, Bluetooth, and GameCenter) via development cost and user interviews. We find that pass-and-play, the most easily-implemented mode, is not favored by players due to its inconvenience. We also find that GameCenter is not as well favored as expected due to latency of GameCenter's servers, and that Bluetooth multiplayer is the most well favored for social play due to its similarity to real-life play. Despite there being a large overhead in developing and testing Bluetooth and GameCenter multiplayer due to Apple's development process, this is irrelevant since professional developers must enroll in this process anyway. Therefore, the most effective multiplayer mode to develop is mostly determined by whether Internet play is desirable: Bluetooth if not, GameCenter if so. Future studies involving more complete development work and more types of multiplayer modes could yield more promising results.

This project creates a possible framework for the application of music therapy to reduce test anxiety in students. Although music therapy has grown in recent years as a treatment method for a variety of mental health and wellness problems, it has yet to be comprehensively applied to the specific issue of test anxiety. Some studies have examined the use of music in testing situations in order to reduce anxiety or improve academic performance. However, more in-depth music therapy interventions are a promising, largely untried treatment possibility for students suffering from this type of anxiety.

Testing and Verification of Cyber-Physical Systems (CPS) is a challenging problem. The challenge arises as a result of the complex interactions between the components of these systems: the digital control, and the physical environment. Furthermore, the software complexity that governs the high-level control logic in these systems is increasing day by day. As a result, in recent years, both the academic community and the industry have been heavily invested in developing tools and methodologies for the development of safety-critical systems. One scalable approach in testing and verification of these systems is through guided system simulation using stochastic optimization techniques. The goal of the stochastic optimizer is to find system behavior that does not meet the intended specifications.

In this dissertation, three methods that facilitate the testing and verification process for CPS are presented:

1. A graphical formalism and tool which enables the elicitation of formal requirements. To evaluate the performance of the tool, a usability study is conducted.

2. A parameter mining method to infer, analyze, and visually represent falsifying ranges for parametrized system specifications.

3. A notion of conformance between a CPS model and implementation along with a testing framework.

The methods are evaluated over high-fidelity case studies from the industry.

This study investigated the effects of distributed presentation microlearning and the testing effect on mobile devices and student attitudes about the use of mobile devices for learning in higher education. For this study, a mobile device is considered a smartphone. All communication, content, and testing were completed remotely through participants’ mobile devices.

The study consisted of four conditions: (a) an attitudinal and demographic pre-survey, (b) five mobile instructional modules, (c) mobile quizzes, and (d) an attitudinal post-survey. A total of 311 participants in higher education were enrolled in the study. One hundred thirty-seven participants completed all four conditions of the study. Participants were randomly assigned to experimental conditions in a 2 x 2 factorial design. The levels of the first factor, distribution of instructional content, were: once-per-day and once-per-week. The levels of the second factor, testing, were: a quiz after each module plus a comprehensive quiz and a single comprehensive quiz after all instruction. The dependent variable was learning outcomes in the form of quiz-score results. Attitudinal survey results were analyzed using Principal Axis Factoring to reveal three components, (a) student perceptions about the use of mobile devices in education,

(b) student perceptions about instructors’ beliefs for mobile devices for learning, and (c) student perceptions about the use of mobile devices post-instruction.

The results revealed several findings. There was no significant effect for type of delivery of instruction in a one-way ANOVA. There was a significant effect for testing in a one-way ANOVA There were no main effects of delivery and testing in a 2 x 2 factorial design and there was no main interaction effect, and there was a significant effect of testing on final quiz scores controlling for technical beliefs in a 2 x 2 ANCOVA. The significant difference in testing was contradictory to some literature.

Ownership of personal mobile devices in persons aged 18–29 is practically all-inclusive. Thus, future research on student attitudes and the implementation of personal smartphones for microlearning and testing is still needed to develop and integrate mobile-ready content for higher education.

South Sudanese refugees are among the most vulnerable immigrants to the U.S.. Many have spent years in refugee camps, experienced trauma, lost members of their families and have had minimal or no schooling or literacy prior to their arrival in the U.S. Although most South Sudanese aspire to become U.S. citizens, finally giving them a sense of belonging and participation in a land they can call their own, they constitute a group that faces great challenges in terms of their educational adaptation and English-language learning skills that would lead them to success on the U.S. citizenship examination. This dissertation reports findings from a qualitative research project involving case studies of South Sudanese students in a citizenship preparation program at a South Sudanese refugee community center in Phoenix, Arizona. It focuses on the links between the motivations of students seeking citizenship and the barriers they face in gaining it. Though the South Sudanese refugee students aspiring to become U.S. citizens face many of the same challenges as other immigrant groups, there are some factors that in combination make the participants in this study different from other groups. These include: long periods spent in refugee camps, advanced ages, war trauma, absence of intact families, no schooling or severe disruption from schooling, no first language literacy, and hybridized forms of second languages (e.g. Juba Arabic). This study reports on the motivations students have for seeking citizenship and the challenges they face in attaining it from the perspective of teachers working with those students, community leaders of the South Sudanese community, and particularly the students enrolled in the citizenship program.