2009 Summer Program on Psychometrics
July 7-17, 2009

Research Foci
Description of Activities
Application
Schedule
Peer Review Working Group
Further Information

Research Foci

Much of current psychometric research involves the development of novel statistical methodology to model educational and psychological processes, and a wide variety of new psychometric models have appeared over the last quarter century. Such models include (but are not limited to) extensions of item response theory (IRT) models, cognitive diagnosis models, and generalized linear latent and mixed models. The development of several of these models has been spearheaded by quantitative psychologists, a group of researchers who find their academic homes primarily in psychology and education departments. During the same period, very similar models and methodologies were developed-often independently-by academic statisticians residing in mathematics and statistics departments. The lack of interaction between these two groups has resulted in a substantial duplication of effort and, more importantly, a delay in the development of methodology crucial to both fields. The goal of this program is to bring researchers from both areas together to explore possible avenues for mutual collaboration.

The Program Leaders Committee is currently comprised of Charles Lewis (Fordham University), Richard Swartz (University of Texas M.D. Anderson Cancer Center), and Valen Johnson (University of Texas M.D. Anderson Cancer Center); Directorate Liaison is James Berger (SAMSI).

The goal of this program is stimulate collaborations between researchers in the psychometric and statistical communities. The desired outcome for the program will be a well-defined, concrete list of specific research directions that will facilitate methodological development in related psychometric/statistical models.

Description of Activities

The first week of the program of the program will be devoted to extended, tutorial-style talks during morning sessions, and contributed and invited research talks during the afternoons. Topics covered during the morning sessions will include IRT models, cognitive diagnostic models, and variations of generalized linear latent and mixed models. Afternoon talks will be selected to complement topics covered in the morning sessions. Speakers confirmed to provide tutorial-style lectures during the morning sessions include Matthew Johnson (Columbia University), Matthias von Davier and Sandip Sinharay (Educational Testing Service), and Yanyan Sheng (Southern Illinois University).

During the second week of the program, three working groups will convene to discuss current, practical applications of methodology presented during the first week of the program. These working groups will focus on (a) the analysis of patient reported outcomes (PROs), (b) journal and grant peer review, and (c) cognitive diagnostic models. Leaders of these working groups include Charlie Cleeland (MD Anderson Cancer Center), Bryce Reeve (National Cancer Institute), Richard Swarz (MD Anderson Cancer Center); David Banks (Duke University); Jimmy de la Torre (Rutgers University) and Andre Rupp (University of Maryland), respectively.

Application

REGISTRATION IS CLOSED.

Please make reservations at the Radisson RTP as soon as possible. The SAMSI room block and rate ($109) is effective until June 19, 2009. After this date, there is no guarantee a room will be available. If you have a change in plans, individual room reservations must be cancelled 72 hours prior to arrival. Check-in is at 3:00 PM; check-out is 12:00 noon.

Schedule

Tuesday, July 7, 2009
Radisson RTP

Wednesday, July 8, 2009
Radisson RTP

Thursday, July 9, 2009
Radisson RTP

Friday, July 10, 2009
Radisson RTP

Monday, July 13 - Friday, July 17, 2009
SAMSI

Charlene's Safe Ride will be provided between the Radisson Hotel and SAMSI:
Monday, July 13 through Friday, July 17: 8:20 am - 9:20 am
Monday, July 13 through Wednesday, July 15: 5:00 pm - 6:00 pm

Program on Psychometrics: Peer Review Working Group

The PRWG will meet spontaneously during the second week of the program. Currently scheduled talks are listed below. Contributed talks will be added to the schedule during the course of the Psychometric Program. A white paper will be prepared by the working group and summarized at a joint meeting at the end of the week. Non-meeting time will be devoted to group collaboration on topics related to peer review.

PRWG Schedule

Monday, July 13, 2009
SAMSI

Tuesday, July 14, 2009
SAMSI

Wednesday, July 15, 2009
SAMSI

Thursday, July 16, 2009
SAMSI

Friday, July 17,2009
SAMSI

Cognitive Diagnostic Models Working Group (CDMWG)

The CDMWG will meet during the second week of the program. The program will be more structured during the beginning of the week, and more open during the end of the week. Talks currently scheduled during this week are listed below. Additional talks will be added to the schedule during the course of the Psychometric Program. A white paper will be prepared by the working group and summarized at a joint meeting at the end of the week.

CDMWG Schedule

Monday, July 13,2009
SAMSI

Tuesday, July 14,2009
SAMSI

Wednesday, July 15,2009
SAMSI

The morning of the fourth day will be devoted to identifying the cutting-edge methods in cognitive diagnosis modeling, and three to five important gaps that must be filled to advance the field forward. The cutting-edge methods and research gaps will constitute the research agenda of the working group. The topics in these research agenda will be distributed into three 90-minute time blocks that will extend from Thursday afternoon and the first part of Friday morning. Participants will be asked to select a research topic in each time block. The 1.5 hour-block will be used to discuss potential research projects that can be done in specific topics, sign-up participants who can collaborate on these projects, and outline strategies and time frame for completing these projects. Starting the latter part of Friday morning (10:30-12:30), participants will report the summary of the discussion of potential projects to all the participants of the working group. The working group will adjourn after a lunch.

Longitudinal Assessment of PRO Working Group (LAPROWG)

The LAPROWG will meet during the second week of the program. The program will be more structured during the beginning of the week, and with more spontaneous meetings during the end of the week. Talks currently scheduled during this week are listed below. Additional talks may be added to the schedule during the course of the Psychometric Program. A white paper will be prepared by the working group and summarized at a joint meeting at the end of the week.

LAPROWG Schedule

Monday, July 13,2009
SAMSI

Tuesday, July 14,2009
SAMSI

Wednesday, July 15,2009
SAMSI

Thursday, July 16,2009
SAMSI

Friday, July 17,2009
SAMSI

The white paper to be produced in the LAPROWG has two main goals:
1) to discuss the state of the art and recommend policy and procedures for analyzing longitudinal PRO data, and
2) to identify areas needing methodological improvement when considering longitudinal PRO data.

Further Information

For additional information about the program, send an email to [email protected]

Please send a letter describing your interest, along with a vita (if a new researcher), to the indicated e-mail address.

Entire site © 2001-2009, Statistical and Applied Mathematical Sciences Institute. All Rights Reserved.