United States

Modified Module Analysis using partial correlations (MMA-P) has been a productive method for studying concept inventories. MMA-P finds patterns in student responses, which can represent common alternative conceptions, test-taking strategies, or structures arising from the construction of the instrument. MMA-P has shown that because of these structures, grading each item independently underestimates students’ understanding of the material and that concept inventories written with highly attractive distractors may not detect the full spectrum of students’ reasoning. MMA-P can be extended by using multilevel network analysis. With multilevel techniques, populations of students can be disaggregated in the MMA-P analysis. For example, a multilevel network could be constructed with data from different institutions forming different levels in the network. Within each level, MMA-P finds modules of popular responses within an institution. Common responses form edges that link institutional networks together, opening a new dimension for MMA-P to find patterns that cross institutional boundaries. &amp;nbsp;

AAPT WM 21

Multilevel Network Analysis: A New Dimension for Analyzing Concept Inventories

modified module analysis - partial

modified module analysis

multilevel network analysis

concept inventory

network analysis

AAPT® is a strong professional physics science society dedicated to the pursuit of excellence in physical science education.

Winter and Summer National Meetings:
These National Meetings, held each winter and summer, are opportunities for members, colleagues, and future physicists from around the world to:

- participate in physics workshops
- meet and greet other physics educators
- form networks nationally and locally
- engage exhibitors and learn about the latest physics resources
- discuss innovations in teaching methods
- share the results of research about teaching and learning.

If you're not able to log in, you're most likely using **incorrect login credentials**. Double-check that you are using the same email and password that you used to register for the conference, submit your abstract or access your AAPT membership. There may also be **an issue with your AAPT meeting registration**. Please email aapt2021@underline.io and programs@aapt.org and we will work quickly to resolve this issue.

Modified Module Analysis using partial correlations (MMA-P) has been a productive method for studying concept inventories. MMA-P finds patterns in student responses, which can represent common alternative conceptions, test-taking strategies, or structures arising from the construction of the instrument. MMA-P has shown that because of these structures, grading each item independently underestimates students’ understanding of the material and that concept inventories written with highly attractive distractors may not detect the full spectrum of students’ reasoning. MMA-P can be extended by using multilevel network analysis. With multilevel techniques, populations of students can be disaggregated in the MMA-P analysis. For example, a multilevel network could be constructed with data from different institutions forming different levels in the network. Within each level, MMA-P finds modules of popular responses within an institution. Common responses form edges that link institutional networks together, opening a new dimension for MMA-P to find patterns that cross institutional boundaries. &nbsp;

technical paper

This talk presents a network analysis of group exam data from a two-class introductory physics sequence. In each class, on each of four exams, students took the exam individually and then reworked it with classmates. Students recorded their collaborators before submitting the exam, and these reports are used to build directed networks. The networks are partitioned using positional analysis, which uses similarities in linking behavior to detect blocks of actors in a network. By calculating block structure for each exam and mapping over time, it is possible to see a stabilizing social structure over the two semesters. Some students find a coherent group immediately, while others take longer, but almost all settle into a regular set of collaborators by the second semester. We will discuss this evolving block structure, what it suggests about the social positions available to students in the classes, and how network position connects to exam grades.

Social Positions in Group Exam Networks

We have developed a multiple-choice test for measuring students’ quantitative literacy in the context of physics (Physics Inventory of Quantitative Literacy, PIQL). Items were created based on the framework of conceptual blending in which students’ mathematical reasoning and conceptual physics understanding cannot necessarily be separated. As such, we include several multiple-choice/multiple-response (MCMR) items to which students may select as many answer choices as they think are correct. Common factor analysis techniques for identifying groups of items that share common traits are inappropriate because these methods require MCMR items to be scored dichotomously, which destroys the rich information available in students’ response pattern. As an alternative, we use Modified Module Analysis (MMA) to identify communities based on networks of correlations between answer choices. We present the results from using MMA to analyze networks of correct responses to PIQL items, networks of incorrect responses, and networks of all responses combined.

Examining Response Patterns to Multiple-Response Items Using Module Analysis

We have all experienced it; watching a movie (cartoon or not) where something happens that is a physical impossibility making all the physicists&nbsp;in the room cringe.&nbsp; Someone walks off a cliff and doesn’t fall until the look down (looking at you Wyle E. Coyote) or the path of a launched object looks nothing like a parabola…it can be infuriating.&nbsp; But, instead of raging against the incorrect, why not use it to teach how the world really works? Students are surprisingly good at picking out the incorrect physics when watching cartoons, but they also can fall into traps believing that real life emulates the cartoon world.&nbsp; During this talk, I will detail my experiences using cartoons to teach physics to high school students and pre-service elementary teachers.

Cartoon Physics in the Classroom

Before being solved by Newton and Laplace, explanation of the cause of the tides was a long-standing problem. In this talk, we will look at two failed attempts to explain tides: Galileo’s “alternately accelerated and retarded motion” published in Discourse on Two World Systems in 1632 and George-Louis Leclerc’s hilariously implausible description of tides due to blocking of ocean currents in The System of Natural History, Vol.1 in 1741, over 50 years after Newton.

The Troublesome Tides

Benjamin Franklin was a first-rate physicist. Yet, his experiments and demonstrations almost killed him several times, and once even shocked him completely unconscious. Valiantly carrying on, Franklin was the de facto founder of the science of electricity and even a publishing member of the Royal Society of London. In this talk, allow me to introduce you to Benjamin Franklin the Physicist as I outline his most important and dangerous discoveries, demonstrate them, and explain why the heck he thought that positive charge flowed in conductors.

Benjamin Franklin’s Most Dangerous Experiments

The evolution of NGSS standards and the influence this has had at the HS level has created an important inflection point nationally for&nbsp;new innovation and policy about how we can integrate engineering&nbsp;and design, not just in science, but across entire campuses.&nbsp;Four years&nbsp;ago, the&nbsp;creation of the&nbsp;MakerDen at Ramona Convent Secondary School (the first all-girls makerspace in Southern California)&nbsp;allowed for a&nbsp;transformational&nbsp;change in&nbsp;not only how&nbsp;students,&nbsp;but teachers across all disciplines, integrate engineering skills.&nbsp;The&nbsp;goal&nbsp;was to&nbsp;create&nbsp;policies and procedures&nbsp;that allowed for the&nbsp;building&nbsp;of a&nbsp;new community of collaboration between teachers&nbsp;in&nbsp;an&nbsp;innovative&nbsp;shared physical space. This is a story of collaboration, stake holder engagement, empowering&nbsp;community, and then giving up control to let it thrive. The creation of this fertile soil resulted in the MakerDen being featured at the 2019 International Symp. of Academic Makerspace at Yale.

Freedom, Innovation, and Makerspaces; creating new campus realities.

Most teachers of general physics and other physics courses have been dismayed by the rampant student use of and dependence upon online homework solutions.&nbsp; I have developed a “5-Star Rating,” done by students, to indicate&nbsp;use, or no use, of online solutions in the solving of physics homework problems.&nbsp; A 5-star problem can be achieved if you can work a problem without use of the book, notes, or other people.&nbsp; Or, you can work your way down to a 0-Star problem utterly copying without understanding.&nbsp; The emphasis is on honesty and integrity.&nbsp; If students use&nbsp;an online solution, they must reference it!&nbsp; If someone else helps, give them credit!&nbsp; One’s homework grade is not reduced by star-rating the problem.&nbsp; In fact, a small bit of extra credit is awarded should a student use 5-Star Rating. &nbsp;&nbsp;The 5-Star Rating system and possible correlations between 5-Star Rating and performance will be discussed.

"5-Star" Student Self-Assessment for Online Homework Solutions in General Physics

Promoting engagement in large synchronous sessions can be challenging, particularly for educators who are not used to working in the online format. Students are reluctant to engage in large-format online groups, leaving online synchronous sessions feeling passive. Community-engaged online performers, or streamers, have developed techniques for promoting interest and engagement from a text-based “chat” of viewers. If our goal is to promote engagement with online synchronous class content, this contemporary entertainment medium offers relevant and timely examples of promoting interactivity in a remote synchronous format. These solutions can range from technological add-ons to active engagement techniques that are adaptable to educational technology and active learning. This paper will present techniques, case studies, and examples of application to a remote introductory physics course.

A in the Chat: Remote Engagement Inspiration from Streaming Culture

The Physics and Everyday Thinking Curriculum is built around students talking and working together. In the classroom groups have white boards and the instructor circulates to monitor work and ask questions. In online environments, an instructor can only be present with one group at a time, and an instructor showing up in a breakout room can disrupt the student-student discussions. Providing groups with shared documents, virtual whiteboards and other collaboration tools not only makes their group work more productive, it also provides a way for the instructor to unobtrusively monitor multiple groups simultaneously. In this talk we will present a variety of tools we have used from the Google Suite as well as our experience using Microsoft Teams. This is part of a series of talks stemming from the NextGen PET FOLC project. &nbsp;This work was supported by the National Science Foundation grant NSF DUE-1626496.

Tools to Support On-line Small Group Activities

Equal access to lucrative careers depends on every student being exposed to coding and science courses are prime territory for this task. Jupyter, Binder, and Colab have been critical tools for making that happen. They’re free, used in research, and enable non-CS-fluent instructors to give their students meaningful exposure to introductory programming and data science. &nbsp; I’ll share lessons learned from helping school districts embed coding activities into core science curriculum for over 15,000 middle schoolers annually. I’ll also report more recent developments using this strategy in remote physics courses at the 2nd largest US university and in Quarknet’s Data Camp for high school teachers.

Premium content

Multilevel Network Analysis: A New Dimension for Analyzing Concept Inventories

Downloads

Next from AAPT WM 21

Social Positions in Group Exam Networks

Similar lecture

Network Analysis of the FCI and the FMCE