|
THURSDAY,
MAY 17
7 pm Dinner, Airlie
Room
8 pm Introductions
and initial observations, Meadow Room
FRIDAY,
MAY 18
7:30
am Breakfast, Airlie Room
8:30
am Meadow Room
Susan Cozzens, Georgia Tech
Rachelle Hollander, National Science Foundation
9
am Demand and Supply of R&D evaluation
in the U.S. (10 minute presentations,
followed by discussion after each panel)
Chair: Cozzens
User panel: Norine Noonan (EOP
Associates), Robin
Nazarro (GAO) [pdf : 364 kb], Kathy
Kendrick (AHRQ) [pdf : 282 kb]. The
demand side: what do Congress and agency
managers want from evaluation of R&D programs?
10:30
am Break
10:45
Chair: Shapira
Funder panel. Bill
Valdez (DOE) [pdf : 386 kb], Paul
Doremus (NIST), Jim Dietz (NSF). What
are we looking for in the studies we commission,
to address the needs of our audiences?
Practitioner panel.
Irwin Feller (Penn State), Gretchen
Jordan (Sandia) [pdf : 38 kb]. How
has demand been shifting over the last
few years? What new questions are we hearing
in the practitioner community?
12:00
am Lunch, Airlie Room
1:30
pm Meadow Room. The Evvy Awards. Participants
will present evaluations that they consider
to be the best they have ever seen. The
aim is to capture the state of the art
across the wide range of programs we evaluate.
(15 minute presentations)
Part
1: Master of ceremonies: Bozeman
Strategic research:
Luke Georghiou [pdf : 25 kb]
Socioeconomic
effects: Terttu Luukkonen [pdf : 55 kb]
Socioeconomic
effects: Barend van der Meulen
Centers: Tim Turpin
3:15
pm Break
3:30
pm
Part
2: Master of ceremonies: Dietz
Technology
programs: Phil Shapira
State
government: Julia Melkers (presented
by Gordon Kingsley)
Innovation
programs: Gordon Kingsley
Human
resource programs: Yolanda George
8
pm Meadow Room
Mel Mark,
Penn State University
"Program evaluation outside the world
of research: Where are we now? Where are
we going?"
SATURDAY,
MAY 19
8:30
am Meadow Room, Board Room, Foxes
Den, North Room
Wish lists.
Small groups identify their "wish lists"
for the next decade in research evaluation,
e.g., methods we wished we could develop,
users we wished were out there, practitioners
we wished we could find, conferences we
wished we could hold… etc.
Small group leaders: Judith Sutz, Adam
Holbrook, Gordon Kingsley, Stefan Kuhlmann,
Maryann Feldman.
9:30
am Razzle dazzle.
What is the fanciest methodological "stuff"
we have available, whether or not it is
currently being used in real life evaluations
or assessments? The underlying question
is: How far can we push current methods?
Do we need new directions to address the
central questions we are being asked?
(20 minute presentations)
Chair: Holbrook
Stefan Kuhlmann: strategic analysis [pdf
: 86 kb]
Barry
Bozeman: research value mapping
10:45
am Break
Maryann Feldman:
patent analysis [pdf : 28 kb]
Philippe Laredo:
literature-based bibliometrics [pdf :
18 kb]
12:30
pm Lunch
2
:00 pm Meadow Room Reports on wish
lists (in plenary). Open discussion
of major research questions among the
wish list items.
Facilitator: Sutz
Break at about 3 p.m.
3:15
pm Gather in Meadow Room for formation
of groups. Mock proposal
groups. These groups will be formed to
address the major research questions among
the wish list items that emerge. Each
of these groups will outline a mock proposal
for a program of research or action in
one of the wish list areas. Facilitator:
Jordan. 4:30 p.m. International panel
on the political context of research evaluation.
What questions are we likely to be asked
to address? Asked not to address? How
is research policy evolving, and how do
we need to evolve with it? (10 minute
presentations)
Chair: Nazzaro
Panel participants: Adam
Holbrook [pdf : 47 kb], Judith
Sutz [pdf : 8 kb], Maryann
Feldman [pdf : 36 kb] , Dave Roessner,
Luke Georghiou
[pdf : 11 kb]
SUNDAY,
MAY 20
9
am Mock
proposal groups meet for final work
session. Gather in the room where you
were working before.
10:15
am Break
10:30
am Mock proposal
groups report back. Meadow Room. Facilitator:
Jordan
11:30
am Concluding observations, next steps.
Facilitator: Cozzens
12:00
pm Lunch
|
