Steve Koch

This presumes fixed strategies and rational decisions I presume? So there are also marketing effects in here as well? Not just what are the percentage of players in each camp but the perceived percentage? - Cameron Neylon

Important theory... now many tend to think that Closed Science only takes advantage of Open Science... game theory can provide some (theoretical) evidence for that.... interesting! - Egon Willighagen

Open science has many "players". Do the arguments hold if I am Player 1 and the crowd is Player 2? - Matthew Todd

If you haven't already, you should check the literature on game theory and collective action problems (e.g., http://scholar.google.com/scholar... ) Open science is an example of a collective action problem. - Michael Nielsen

@Michael, I haven't read any background yet. Rob has, I'm sure, as he used this in his Ph.D. research in evolutionary biology (experiment + modeling/theory). I'm hoping I can get his attention / contribution on this thread soon! I don't have any background in game theory. But, as far as I understand, the analysis Rob's done so far is the most basic first step, and tit for tat (TFT)... more... - Steve Koch

@Mat I am not sure. I'm going to see if I can get Rob to chime in here! - Steve Koch

@Cameron, I think this starting point is fixed strategies, either "defect" or "tit for tat." Like I said in one legend, I can't remember what "temptation to defect" means exactly. I don't think perception is modeled in this basic starting point. I sent an email to Rob urging him to chime in on this thread, so I hope he can! - Steve Koch

Good to see this being tackled in a more formal way, but sure, the simple 2x2 matrix is only the first step. For instance, collaboration can well occur behind closed doors. - Daniel Mietchen

Side issue: Wouldn't something like Octave or R be a better fit to an open project than MATLAB? - Daniel Mietchen

Totally agree open coding platform would be better. Right now there's not much code at all, since it's analytical that Rob did. (Rob, can you post snapshot images of your calculations, if any?) Since right now it's just plotting, R would be good. (I added the text to his images via powerpoint, just for convenience.) I am tempted later tonight to make the pots in R. A further aside: I... more... - Steve Koch

A somewhat related project is Lee Worden's "Mathematics of Direct Democracy" at http://rockethub.com/project... (or, more detailed, at http://lalashan.mcmaster.ca/theobio... ) - see also https://plus.google.com/u... on link to collective action problems. - Daniel Mietchen

Notes from today: https://github.com/steveko... - Steve Koch

R code for graph: https://github.com/steveko... - Steve Koch

Google docs notes: https://docs.google.com/documen... - Steve Koch

Can u include any more info for ur dossier? I can give you the analytics for my notebook. - Anthony Salvagno from Android

After reading this, I'll ad a section to my CV: 'peer-reviewed methods' right after 'peer-reviewed original research'. This new section will also have download stats to our software at http://buridan.sourceforge.net (as soon as our paper describing that package is out). - Björn Brembs

"Use as many metrics to back up your contributions as you can." Anyone have metrics they'd want to help make their open science case that they can't easily get to now? - Heather Piwowar

@Ant: Yes! Dan was extraordinarily helpful with advice and letter for me. He's one of many generous, helpful, and successful open scientists out there & why I know regardless of my own tenure decision, open science contributions will be rewarded. Fundamentally, it makes for much, much higher impact science and since most scientists want that, the reward system will come around. - Steve Koch

@Heather the system you've been working on is great! Every tool that is developed in the coming years needs metrics. As Nielsen points out in his book, many of the most successful endeavors (such as the Mathworks competition and fold.it) provide instant feedback and scoring. Some very important features of those successes are (1) numerical score, (2) instant scoring, and (3) EASY... more... - Steve Koch

Steve, very useful, thanks. Nope, total-Impact doesn't have any relative metrics yet, we're trying to figure out the best way to do it... - Heather Piwowar

Not sure that ethics would be the right edge to link researchers with librarians. Data management would seem more natural to me. - Daniel Mietchen

Agree with Daniel - I am working with the library to build a 'information literacy' content for the medical students that opt into doing research for a semester or year. - Kubke

Although having some courses from sociology and philosophy departments on ethics and responsible conduct could be bloody interesting! - Kubke

Data management has several points of contact with ethics: personally-identifiable information and other human-subjects issues (which leads directly into discussions of data security), data ownership, open data, fraud avoidance, appropriate crediting... - RepoRat

And currently, at least in the few example US universities at our working table, ethics and responsible research training courses are currently linked. Many training grants (NIH, NSF) require these courses and currently (in my experience), the courses are ad-hoc and not enthusiastically designed. So, depending on institution, it's a ripe opportunity for connecting library with graduate... more... - Steve Koch

Based on my experience with undergraduate laboratory teaching, I think that undergrad labs are a fantastic opportunity for bridging the research / library gap as far as "e-research" goes. - Steve Koch

I agree with that as well, no surprise. :) Got a one-credit "basic data management" course on the slate for this summer. Gonna be spending a LOT of time flacking it this spring. - RepoRat

@Repo: One idea at our table (maybe you already do this): require the students to bring data from their lab to the course and do hands-on data management. Whatever the result should be educational for all. E.g., if the student's PI says, "no you can't take the data it's mine," that's a good springboard for discussion. Or if they bring a laptop with the sole copy of data, another lesson. Etc. - Steve Koch

that's DEFINITELY part of the plan. :) - RepoRat

I think big factors are Andy's commitment to open science and his new PI's commitment to making an impact in science and medicine. I met Hugh Smyth a few times when he was at UNM and only detected awesomeness, both in his research and in his mentoring and concern for students. Openness is probably going to be more challenging for them, though. One reason is their research is much more... more... - Steve Koch

I can't do the math, but I love the metaphor! - Bill Hooker

Every student we put out there tilts the scales just a little bit. I've noticed this in my own teaching -- one of my very first students spearheaded a library OA mandate in his first professional job! I almost cried when I realized I'd taught him, I was so proud -- and I'm not surprised you're starting to notice it too. - RepoRat