United States

Pre-assessments are common tools for research and pedagogy in higher education, but they may pose risks that are largely unexplored. To investigate potential risks to students, instructors, and researchers, we conducted ten semi-structured interviews with college students about their experiences taking pre-assessments. The students unanimously found pre-assessments to be non-threatening and their performance on them to be inconsequential. 

They did not interpret pre-assessments as a predictor of success or indicator of their inherent ability. Instead, the students attributed their pre-assessment performance to having previously taken a relevant course with similar assessment items.

As a result, half of the students were not motivated at all to put effort into taking the pre-assessment.

The students believed that pre-assessments are intended to inform the instructor in making tailored course revisions to meet student needs. 

Students valued pre-assessments more if they believed that the instructor uses the pre-assessment results to make course revisions, but half of the students disbelieved that their instructor does so.

Taken together, our findings suggest that pre-assessments do not pose a direct risk to students, but they may indirectly affect students&#39; learning experience or relationship with the instructor if the use of pre-assessments undermines the instructor&#39;s credibility. Moreover, students&#39; lack of motivation to complete pre-assessments can render them an inaccurate measure for instructors and researchers. We therefore encourage instructors and researchers to clearly communicate the specific uses of a pre-assessment to students before assigning it.

PERC SM 21

Student perceptions of pre-assessments: &quot;It&#39;s basically just guessing anyways&#39;&#39;

student attitudes

pre-assessments

self-efficacy

**Making Physics More Inclusive and Eliminating Exclusionary Practices in Physics**

As a gateway discipline to STEM majors and careers, physics plays a central role in deciding who does, and who doesn't, get to discover and pursue scientific careers. Technical and scientific professionals are rewarded with economic privilege and status which affords them both social and cultural power. Therefore, social justice will be realized only when the opportunity, and the choice, to excel in physics is open to all students. The culture and practices of the physics classroom reflect the culture of physics at large, which raises the question of how our professional physics communities can embrace, rather than inadvertently repel, a diverse group of academics that can help improve physics culture.  To this end, the 2021 Physics Education Research Conference will focus on defining inclusive spaces and practices. Additionally, we will explore strategies for eliminating exclusionary practices in our classrooms, research spaces, and professional organizations. We call on the community to propose sessions that will drive conversations related to these initiatives throughout PERC 2021.

Please download the full program [here. ](https://drive.google.com/file/d/1TRMC_SYJ3PUqXyP7sskA7LRSA8ow0eRE/view?usp=sharing)

August 4, 2021 - August 5, 2021 in a Virtual Conference Format

Making Physics More Inclusive and Eliminating Exclusionary Practices in Physics

Pre-assessments are common tools for research and pedagogy in higher education, but they may pose risks that are largely unexplored. To investigate potential risks to students, instructors, and researchers, we conducted ten semi-structured interviews with college students about their experiences taking pre-assessments. The students unanimously found pre-assessments to be non-threatening and their performance on them to be inconsequential. 

They did not interpret pre-assessments as a predictor of success or indicator of their inherent ability. Instead, the students attributed their pre-assessment performance to having previously taken a relevant course with similar assessment items.

As a result, half of the students were not motivated at all to put effort into taking the pre-assessment.

The students believed that pre-assessments are intended to inform the instructor in making tailored course revisions to meet student needs. 

Students valued pre-assessments more if they believed that the instructor uses the pre-assessment results to make course revisions, but half of the students disbelieved that their instructor does so.

Taken together, our findings suggest that pre-assessments do not pose a direct risk to students, but they may indirectly affect students' learning experience or relationship with the instructor if the use of pre-assessments undermines the instructor's credibility. Moreover, students' lack of motivation to complete pre-assessments can render them an inaccurate measure for instructors and researchers. We therefore encourage instructors and researchers to clearly communicate the specific uses of a pre-assessment to students before assigning it.

Student perceptions of pre-assessments: "It's basically just guessing anyways''

poster

The Teaching Practices Inventory (TPI) was modified to be valid for both face-to-face and online course modalities. The original TPI was found to lack face validity based on responses collected from 90 instructors teaching general education science, mathematics, and social science courses primarily online at a midwestern research university during the anthropogenic disaster of the coronavirus pandemic (COVID-19). Several TPI items were rewritten by a team composed of discipline-based education researchers in the sciences and social sciences and education researchers. Further refinement and final content validity was established through external review by experts in online education and a diverse group of instructors. The resulting survey was administered to 92 instructors representing 12 departments and teaching via a variety of modalities (online, hybrid, and face-to-face), establishing face validity across modalities and disciplines. Concurrent validity was established via alignment of modified TPI items to items from the Online SUNY Course Quality Review (OSCQR) rubric. The resulting inventory provides a generalized self-report on the prevalence of high-impact practices valid for science, mathematics, and social science courses whether offered online, face-to-face, or a hybrid of the two.

Modification and Validation of the Teaching Practices Inventory for Online Courses

We report our preliminary efforts to evaluate a departmental project: the inclusion of computational methods across our undergraduate curriculum. Our overarching goal is for students to consider computational approaches as a “normal” way to solve physics problems, on par with analytical approaches. In this paper, we focus on our efforts to evaluate the development of our students’ attitudes and self-efficacy with respect to key computational methods. We describe our efforts to develop and deploy a survey instrument students complete each semester. This allows us to study, e.g., the points in the curriculum at which students gain confidence with particular methods, or adopt more expert-like attitudes regarding computation in general. We investigated the reliability of our instrument using a split-half process and found the Spearman-Brown coefficients for unequal length were r = 0.818, r = 0.895, and r = 0.917 for the three constructs in our survey. We also provide preliminary data from the early use of the survey and outline next steps for the project.

Preliminary efforts to evaluate an initiative introducing computation across the undergraduate physics curriculum

We present an ongoing qualitative analysis of twenty-six interviews about computation in introductory mechanics courses. The interviews are part of a longer term project to develop an assessment protocol for computation in introductory physics. Interviews were coded into twenty-seven different nodes. Sub-nodes and themes were then found and developed. This paper focuses specifically on the node, and its sub-nodes and themes, with the most anecdotes (197): "Important Computational Topics". This node is mainly comprised of computational skills or ideas that interviewees expect students to gain during the course of taking an introductory physics course with computation integrated. This node was broken into five themes with 44 sub-nodes. The five themes are: technical programming skills and knowledge, program environment best practices, physics and programming, barrier reduction strategies, and restraints. The sub-nodes with the most agreement between subjects are:"Read Code", "Scaffolding Incomplete Code","Quality Plotting", "No Code From Scratch", "Identifying Core Physics", and "Code Commenting"

Identifying important computational skills in introductory physics: An interview analysis

The shortage of human resources in the fields of technology and science has now become one of the main obstacles to the economic development. Due to the low number of Physics lessons and the declining popularity of science subjects, choosing appropriate teaching methods can be a serious challenge for teachers. In the Physics education, a change of attitude towards innovative teaching methods is necessary in order to be effective even under the changed conditions and provide students with the same quality of education. In order to enhance the popularity of Physics among students, the application of techniques and methods considered successful in other fields can be a good solution by promoting an internationally successful approach in the Physics education. The process of educational development requires the use of new ideas when applying traditional activities, and the development and testing new methods and tasks. Competence-based Physics education provides an opportunity for students to acquire the expected knowledge according to specific requirements. The requirement system helps teachers to plan lessons by taking into account specific competences that they would like to develop with the chosen activities. The inquiry-based method can effectively contribute to students’ competence development and it supports Physics lessons, too. The method encourages students to take part actively in their learning process and acquire knowledge by observing, describing and understanding different phenomena. Teachers monitor the learning process by providing a logically-structured way for students to reach the appropriate level while developing skills. In our study, we present an Arduino-based opportunity for student experimentation and investigate its role in competence development and the acquisition of necessary knowledge. With the methodological description of the tasks we have developed, we would like to support colleagues in choosing successful teaching methods.

Competence-based Physics Teaching

Due to the advances in digital technology, many new perspectives have been opened in the educational system. The use of digital devices in the classroom can enhance the level of classes and increase our students’ attitude towards Physics. Digitalized education is popular and as the pandemic situation proved, it is essential to rely on digital teaching methods. This situation and the findings of research in the importance of handwriting and digitalism in education have induced our investigation of the influence of digital and traditional Physics homework solving on students’ academic performance. The study discusses the effect of digitalized education on students’ academic performance and cognitive development, investigates the role of handwriting in education – focused on homework solving – and compares it with the opportunities given by using digital methods. The research was carried out in Budapest among 7th graders. We investigated which method can contribute effectively to the long-term information processing. The students were organized into two groups. The test group prepared homework via Google Classroom, while the control group solved the same homework with traditional methods. The application of appropriate tests provided valid data for comparing students’ test results and cognitive development. The answers on a questionnaire show our students’ learning habits and their attitude towards learning Physics. The results of the research indicate that there is no significant deviation in the short-term knowledge of the students in the different groups, but there is a significant negative deviation in students’ digitally acquired long-term knowledge. Based on the students’ answers on the attitude-test, the traditional learning methods can contribute to academic success. The study raises attention on that although the use of digital technology in education can have positive effects, there are parts of the learning process where the traditional methods are essential

The Influence of Traditional and Digital Homework on Students’ Academic Performance and Attitude towards Physics

Dr. Clausell Mathis will discuss research on strategies and methods that physics teachers have used to become culturally relevant educators. In particular, Clausell will describe a previous study he did with a female physics instructor who attempted to incorporate culturally relevant pedagogy features, along with his current research in assisting physics teachers to be more equitable in their instruction. Findings from his work show that teachers show the strongest indicators of culturally relevant pedagogy through their willingness to address sensitive topics, consistent encouragement of students toward academic excellence, and the ability to adapt the curriculum to students' strengths. However, there remain challenges that physics teachers have in actualizing culturally relevant pedagogy. Findings from Dr. Mathis's research give implications for physics faculty who wish to use culturally relevant pedagogy in their instruction. He will also discuss the challenges and affordances that may occur when making pedagogical changes that support culturally relevant instruction.

A Look at Physics Teachers Searching for Cultural Relevance

Partial derivatives are among the many mathematical tools used throughout physics to help describe the physical world. We have been investigating how students are able to determine and interpret partial derivatives both symbolically and from contour graphs with mathematical, electrostatic, and thermodynamic contexts. While many students had strong procedural abilities for calculating derivatives, most did not strongly link this process (of finding a partial derivative) with the idea of "holding a variable constant," especially when dealing with a thermodynamics context. We found this to be true regardless of the representation in which students were asked to work. These results suggest a deeper theoretical framework is needed for understanding how students think about partial derivatives.

How Students Reason about Changes when Finding Partial Derivatives

The present study examined the covariational reasoning of three preservice mathematics teachers (PSTs) as they make sense of a simple model to introduce climate change. The PSTs worked on a mathematical task that required PSTs to activate their covariational reasoning abilities in order to explore two key notions related to climate change: (i) the balance of energy between the components of the climate system (Sun, surface, and atmosphere), and (ii) the link between carbon dioxide (CO2) pollution and global warming. The PSTs completed the task during an individual, task-based interview of approximately 60 minutes.

The analysis revealed that, in order to develop a operative understanding the climate system model, the PSTs' covariational reasoning must support, at a minimum, the ability to: (i) understand how the balance between the energy inflow into and the energy outflow from the climate system regulates the variation of the plante's mean surface temperature over time (dynamic relationships), and (ii) conceptualize the energy exchange between the surface and the atmosphere interms of two energy flows changing in tandem and obeying a circular relationship as time elapses (feedback loop). The analysis also revealed that the differences in the PSTs' covariational reasoning abilities coincided with two ways of thinking about the link between CO2 pollution and global warming: a productive way of thinking that had the potential of making visible the role of human activities in driving global climate change, and a less productive way that had the potential of promoting misconceptions about regarding that environmental challenge.

The study's results show that PSTs can engage in covariational reasoning while they learn about climate change and that covariational reasoning (and in general mathematics education) can have a role in promoting climate change education.

Connecting mathematics education and climate change education through covariational reasoning

Students and experts engage in a plethora of sophisticated ways of thinking during modeling tasks, blending between mathematical and physical reasoning. This integrated way of reasoning about quantities and how they are related is ubiquitous to “thinking like a physicist.” One facet of this process is covariational reasoning -- reasoning about how changes in one quantity relate to changes in another quantity. In laboratory courses that engage students in experimental design, students commonly use covariational reasoning as they model changing quantities and the relationships between them. However, those without strong mathematical reasoning skills may unintentionally be perceived as also having less nuanced physics reasoning skills. To investigate the multifaceted ways students model in physics lab courses, we examined student discussions during remote, student-designed labs in which students interact with physical, but fictitious, matter in a virtual reality (VR) simulation. The VR environment allows for students to observe and measure novel situations for which the “answer,” in this case a mathematical model about the particles’ behavior, is not known. Using a conceptual blend analysis, we examine two lab groups that take different approaches to the task, despite beginning with the same observations and reporting on the same final model. One group demonstrates expert-like mathematical reasoning that is typically rewarded in physics courses, while the other engages in early signs of expert-like physics reasoning. Our analysis suggests that there are productive ideas emerging in both groups, and that of the less mathematically rigorous may be going unnoticed. We suggest that characterizing these features of physics covariational reasoning may provide an opportunity to move beyond data analysis techniques in lab courses towards incorporating more physics expert-like techniques. In doing so, instructors may recognize hidden strengths that may otherwise go undetected.

Emerging covariational reasoning student resources in physics lab courses

The University of Washington Bothell (UWB) STEM Public Outreach Team (SPOT) trains undergraduate students to give presentations and lead activities related to current STEM research topics. During 2020 and 2021 the SPOT program pivoted to online classrooms and events with adaptations that will carry forward. Access and availability for the SPOT Student Ambassadors as well as the participating schools and community groups has been expanded through online engagement options. The SPOT program collaborates with the UW Center for Evaluation and Research for STEM Equity (CERSE) on Evaluating the Impact of Participation in STEM Outreach on Persistence of Diverse Students in Physics, Math, and Engineering.

Premium content

Student perceptions of pre-assessments: "It's basically just guessing anyways''

Next from PERC SM 21

Modification and Validation of the Teaching Practices Inventory for Online Courses

Similar lecture

Effects of facilitating collaboration in large-enrollment introductory physics courses