United States

We have developed the Physics Inventory of Quantitative Literacy (PIQL) as a tool to measure students&#39; quantitative literacy in the context of introductory physics topics. We present the results from various quantitative analyses used to establish the validity of both the individual items and the PIQL as a whole. We show how examining the results from classical test theory analyses, factor analysis, and item response curves informed decisions regarding the inclusion, removal, or modification of items. We also discuss how the choice to include multiple-choice/multiple-response items has informed both our choices for analyses and the interpretations of their results. We are confident that the most recent version of the PIQL is a valid and reliable instrument for measuring students&#39; physics quantitative literacy in calculus-based introductory physics courses at our primary research site. More data are needed to establish its validity for use at other institutions and in other courses.

PERC SM 20

Toward a valid instrument for measuring physics quantitative literacy

piql

physics quantitative literacy

assessment

The 2020 AAPT Virtual Summer Meeting brought together physics educators from around the globe to learn about the latest in physics theory, research methodology and education from leaders in their field. The program featured plenary speakers, sessions, workshops and many special activities.

For more information please visit the 2020 AAPT Virtual Summer Meeting page at: https://www.aapt.org/Conferences/SM2020/index.cfm.


AAPT SM 20

The 2020 AAPT Virtual Summer Meeting brought together physics educators from around the globe to learn about the latest in physics theory, research methodology and education from leaders in their field. 

We have developed the Physics Inventory of Quantitative Literacy (PIQL) as a tool to measure students' quantitative literacy in the context of introductory physics topics. We present the results from various quantitative analyses used to establish the validity of both the individual items and the PIQL as a whole. We show how examining the results from classical test theory analyses, factor analysis, and item response curves informed decisions regarding the inclusion, removal, or modification of items. We also discuss how the choice to include multiple-choice/multiple-response items has informed both our choices for analyses and the interpretations of their results. We are confident that the most recent version of the PIQL is a valid and reliable instrument for measuring students' physics quantitative literacy in calculus-based introductory physics courses at our primary research site. More data are needed to establish its validity for use at other institutions and in other courses.

poster

Join us in exploring emergent themes in PER as a scholarly endeavor and as a research community!  Since its inception, PER has served as a confluence of discipline, theory, research methodology, practice, and application.  How have these facets and the interplays among them been fruitful for physics education globally, regionally, locally, or otherwise?  And, how have our successes and interactions influenced the very nature of PER itself?
Following the lead of AAPT for the summer meeting, PERC 20/20 was virtual. Enjoy browsing the content.

Since its inception, PER has served as a confluence of discipline, theory, research methodology, practice, and application.  How have these facets and the interplays among them been fruitful for physics education globally, regionally, locally, or otherwise?  And, how have our successes and interactions influenced the very nature of PER itself?

Societal stereotypes and biases pertaining to who belongs in physics and who can excel in physics can impact motivational beliefs, e.g., of women and racial and ethnic minority students in physics courses. This study investigates how the learning environment predicts male and female students motivational beliefs including physics self-efficacy, interest, and identity at the end of year long (spanning two-semester) algebra-based introductory physics courses. These were courses at a large university in the US taken primarily by biological science majors many of whom are interested in health professions. Although women are not underrepresented in these physics courses, societal stereotypes and biases internalized by female students over their lifetime can still impact their motivational beliefs about physics. Our findings show gender gap in motivational beliefs favoring men. These findings can be useful to provide support and create an equitable and inclusive learning environment to help all students excel in these courses.

How the learning environment predicts male and female students motivational beliefs in algebra-based introductory physics

It is a given that not everyone who starts their Ph.D. in physics will complete it. That being said, there are people who have the great potential of being competent and able researchers that leave without the Ph.D. Using techniques from the Georgia Tech Center for Deliberate Innovation, based in developmental psychology and behavioral economics, we are working to see more clearly what might be getting in the way of competent, motivated students who fail to complete their Ph.D. This includes a focus on the advisor/advisee relationship.

Using Deliberate Innovation Methodologies to Enable Graduate Student Success

The United States is facing a critical shortage of grade 7-12 teachers in the STEM disciplines, particularly in physics, chemistry, and mathematics. Faculty members play a major role in their students career choices, and faculty members perceptions of the profession may determine whether students choose to pursue teaching. To this end, we developed two surveys to measure student and faculty perceptions of grade 7-12 teaching. We found that both groups hold many incorrect beliefs about teaching careers. Furthermore, we found that faculty members believe they are quite supportive of future teachers, while students perceive that they are less supportive. Our findings highlight the need for both faculty members and students to be informed about the benefits of careers in grade 7-12 teaching. Additionally, our results suggest that faculty members should work to dispel their internal biases surrounding the teaching profession, which may inadvertently drive students away from grade 7-12 teaching.

College Faculty Support for Grade 7-12 Teaching Careers: Survey Results and Comparisons to Student Perceptions

As part of a larger study of exploring students' problem solving in small groups, we investigated how instructor influences students' epistemic framing in an upper-division electromagnetism class. We use the CAMP (Conceptual, Algorithmic, Mathematics, Physics) framework to investigate the dynamics of students' frames surrounding their interaction with the instructor, tracking frame triplets before, during and after instructor's intervention during the tutorial sessions. We present a case study of one such triplet (AP, CP, AP) by qualitatively analyzing students' interaction with instructor. Careful examination indicates that disagreements during the interaction necessitated the instructor to initiate conceptual discussion thereby causing a frame shift from an algorithmic to a conceptual frame.

Qualitative Analysis of Students’ Epistemic Framing Surrounding Instructor’s Interaction (PERC)

In our open-source model of a pandemic-resilient flipped lab course, students pose their own research questions and devise their own physics experiments. Their major instruments are an Arduino and electronic sensors which they choose from the wide and growing selection of inexpensive devices based on solid-state and MEMS technologies. Supported by the open-source software and other online resources of the Maker movement, students are empowered to design and conduct experiments at home at intermediate and advanced levels. Using flipped-lab methods, instructors devote contact hours to coaching students in refining research questions and analyzing and interpreting data, while students get continual practice in communicating their own evolving goals and latest results to their instructors and classmates. While our pilot course continued virtually unchanged in the switch to virtual classes, our students achievements show that these methods also bear consideration for inclusion even when all teaching activities can return to campus.

Open-inquiry experiments using sensors controlled by Arduinos in a pandemic-resilient lab course

We designed a rubric to assess free-response exam problems in order to compare thinking skills evidenced in exams in classes taught by different pedagogies. The rubric was designed based on Blooms taxonomy (revised version) [1-3]. The rubric was then used to code exam problems. We analyzed exams from different sections of the algebra-based physics course taught the same semester by the same instructor with different pedagogies. One section was inquiry-based and the other was taught traditionally. We discuss the instrument, present results and present plans for future research. The inquiry-based students demonstrated all of the thinking skills coded more often than the traditional students.

A Rubric for Assessing Thinking Skills in Free-Response Exam Problems

BEMA (Brief ElectroMagnetism Accessment) tests were conducted for undergraduate students in introductory electromagnetism courses at Texas A&M University (TAMU) from 2014 - 2017 to assess students performances. A total of 3480 students participated and more than 6000 test scores are collected. The present study used a part of the data to investigate the BEMA performance with these scores taken prior to and after the class using the statistical measures based on the classical test theory. Item difficulty index, item discrimination index, point biserial coefficients and so on obtained from the TAMU data agree with the results reported by various research groups in past, and showed the test is statistically reliable. Thus, it is confirmed that administering the BEMA test is beneficial for assessing students learning of undergraduate electromagnetism at university classes.

New measurements of BEMA performance based on classical test theory

We collaborated with our universitys office of institutional research to assess pedagogical changes in our calculus-based introductory physics courses using different sets of student data. We found that switching to a competency-based grading system in these classes reduced the drop/fail/withdrawal rates and course-associated grade penalties of under-represented minority, first generation, and female students. We separately performed a longitudinal study to identify how changing the curriculum of these physics courses affected student performance in downstream engineering courses. We found that increasing the calculus content in introductory physics correlated with higher grades earned in subsequent engineering courses, and that these downstream benefits were largest for students with lower math abilities. Taken together, these results demonstrate how instructors can use educational data sets to make improvements in their courses that specifically target improving the performance and retention of traditionally underserved populations.

Changing pedagogy to help traditionally under-served populations

Building on prior analyses of how introductory physics experiences affect student attitudes, preliminary evidence suggests that IPLS students, more so than their counterparts in traditional introductory physics courses, express the attitude that physics is relevant to their primary biological interests. We report on the durability of these attitudes. We present results from interdisciplinary attitude surveys given to students a year (or more) after their initial experience in IPLS, as well as immediately after that experience. By tracking the evolution of student attitudes over time, we assess whether attitude improvements due to IPLS are in fact stable and long-lasting. We also explore how students subsequent coursework in biology or other disciplines may influence these attitudes.

Exploring the Durability of Student Attitudes Toward Interdisciplinarity

An instructional intervention consisting of students interacting with eight short videos on scientific topics was introduced to a general education physics class. The effects of these videos on student attitudes about science and their scientific reasoning skills were assessed by comparison of pre- and post-test data from the CLASS and Lawsons Test of Scientific Reasoning for two control and three treatment semesters. Initial findings showed improved student attitudes toward science and improved scientific reasoning skills. With continued use of the videos in additional semesters, similar pre-post gains in scientific reasoning skills were observed, however, less improvement in student attitudes toward science was measured. This decrease in improvement of student attitudes as the new course activity became standard has implications for the number of semesters a new curriculum aimed at improving student attitudes should be studied. Most new curricula only report a semester or two of results before wide implementation occurs.

Premium content

Next from PERC SM 20

How the learning environment predicts male and female students motivational beliefs in algebra-based introductory physics

Similar lecture

Assessing mathematical reasoning:The Physics Inventory of Quantitative Literacy (PIQL)