 |
|
| FriendFeed is the easiest way to share online. Learn more » |
Dustin › Likes
Impact Factor Boxing 2009 - http://duncan.hull.name/
Daniel Mietchen, fidel ramirez, Dustin and 6 other people liked this
The latest results from the world championship impact factor boxing are out. This year includes the first-ever update to the newly introduced Five Year Impact Factor and Eigenfactor™ Metrics [1,2] in JCR Web (See http://www.isiknowledge.com/JCR), presumably in response to widespread criticism of impact factors. The eigenfactor seems to correlate closely the impact factor scores, both of which work at the level of the journal, which makes you wonder what the point of including it is as it doesn’t seem to add any new information. What many people are often more interested in is the impact of an individual article, not the journal where it was published. So it would be interesting to see how these figures tally with Google Scholar, see also comments by Abhishek Tiwari. I’ve included a table below of bioinformatics impact factors, updated for June 2009. Of course, when I say 2009 (today), I mean 2008 (these are the latest figures available) – so these shiny new figures published this week...
more...
- Duncan Hull
from Bookmarklet
Does anyone remember how Ubiquity can scatterplot the last two columns of the table?
- Egon Willighagen
I don't know what is the take home lesson from IF posts. Should I take them as a good or bad thing? If it's not important why do we keep giving it attention? If it's important why don't we talk more about the good of IF?
- Paulo Nuin
@Paulo: they're both important and bad. Which is an embarrassment to the scientific community and I hate being embarrassed. @Duncan: when you look at rankings for 5-year and Eigenfactor as opposed to old-style IF, it's actually vastly different - at least for journals important to me.
- Björn Brembs
@Björn that's interesting, so the Thomson data is slowly getting better then, slowly very s - l - o - w - l - y...
- Duncan Hull
Impact factor is like smoking, use it with warning:"Impact factor is Harmful to Science!" that's all I can say
- Abhishek Tiwari
What about PLoS One IF? Only for next year? I checked and in 2006 they just published in december...
- Pedro Matos
@Pedro only six PLoS journals are currently listed: Biology, Computational Biology, Genetics, Medicine, Neglected Tropical Diseases and Pathogens. Like Matthew Cockerill says, IF's have a very long lag time...http://www.biomedcentral.com/1471-21...
- Duncan Hull
Thomson Reuters refuses to index PLoS One. The reaons they give are ridiculous enough to suspect that they're simply afraid: PLoS ONE success means decline in IF impact, which means less money for TR. I actually think ONE should not get an IF, because the IF ought to be deprecated as the fraud it is.
- Björn Brembs
Personalized Web 2.0 Service for Authoritative Content - MilcordWiki - http://wiki.milcord.com/wiki...
Hope Leman, Dustin and Thomas Brox Røst liked this
I'm not sure exactly who milcord is. Still, its interesting to see all the different people and organizations that are trying to tackle this issue.
- Fitzgerald Steele
milcord is working with Dept of Energy's OSTI to define authority metrics for new media content types (blogs, videos, podcasts, tweets, etc.) to enable searching the long-tail of online discourse for content published by authorities in their field.
- Dustin
I learn so much here! Thank you all!
- Hope Leman
I'm interested to know if any research has been conducted that tells how much scientists use social network tools and which ones.
Dustin, Mr. Gunn, Richard Akerman and 3 other people liked this
I realize that this community is not typical because we're a bunch of people interested in using social networking and social media tools to communicate science. That's why I would like to see research results, not our biased opinions.
- Sol Lederman
the last information I have is at: http://christinaslibraryrant.b... - I hope someone else has something newer.
- Christina Pikas
oh, there's also the 2collab survey, but I think that had some issues
- Christina Pikas
Yeah, I think the 2collab study was pretty flawed (which is unfortunate as Nature Network was one of the top apps they named).
- Euan
Research Information Network in UK are currently funding a study (Oxford and NCESS leads) which should be reporting about mid-year (full disclosure - a group of us tendered for this contract and got beaten - our proposal was better of course ;-)
- Cameron Neylon
I just posted this: http://www.pbs.org/wgbh... while not a study itself, would certainly provide rich source material for one.
- Mr. Gunn
The for-fee report from Outsell "Social Media in STM Part 2: Social Publishing - Usage and Abusage" has some stats but they're not that granular, they're by user type (Executive Management, R&D + Science, etc.) Mostly they say that people really really like email alerts.
- Richard Akerman
Great references everybody. Some nice pieces to follow up on. Thank you. Others?
- Sol Lederman
quickly trying to find an example of science libraries that start with a big federated search box... couldn't. are we still in OPAC world?
Dustin, NextBio, Lambert Heller and 8 other people liked this
was trying to explain why federated search is the obvious solution... but e.g. MIT takes me to some catalogue search thing http://libraries.mit.edu/ or some journal title search thing http://vera.mit.edu:8080/multi... Is this seriously how libraries are still doing search in the 21st century?
- Richard Akerman
uva is pretty close: http://www.lib.virginia.edu/
- Christina Pikas
Try UIUC: http://www.library.uiuc.edu/
- Sarah
As a user, I'd be delighted to use a science library that started with a front page that looked like: http://www.google.com :-)
- Michael Nielsen
Yes, Michael, and within five years the library would be defunded and die. I'm not saying it's a good dream -- just consider all its consequences.
- D0r0th34
http://library.canterbury.ac.nz has federated search on its front page (uni library - has a science library branch and an engineering library branch but one website covers all branches)
- Deborah Fitchett
http://search.smartlib-bibliogen.ca/zengine... - Searches Capital SmartLibrary Consortium of Libraries.
- Sol Lederman
http://lifesearch.indexdata.dk/# - Searches University of Copenhagen’s Library of Faculty of Life Sciences.
- Sol Lederman
http://osulibrary.oregonstate.edu/metafin... - Searches Oregon State University’s Library.
- Sol Lederman
@Sol - thanks, that (indexdata.dk) is getting close to what I imagined - although as I indicated in my follow-up tweet, I guess I forget how much the focus at libraries is still on title-level metadata, rather than article-level metadata.
- Richard Akerman
Dorothea - why would it be defunded and die? I'm really curious to understand this - I'm so much outside the library community, and would love to hear what insiders have to say about the changes going on inside libraries.
- Michael Nielsen
Richard - I'm the primary author for the Federated Search Blog (http://federatedsearchblog.com). Please help me to understand your question. Maybe I can answer it and maybe I'll even write an article addressing your question.
- Sol Lederman
@MichaelNielson it's a bit more complicated problem than that - libraries have different types of data to search (book metadata, article metadata, in some cases article fulltext) and many different types of sources (A&I databases, publisher sites etc.) You can present a single search interface - but it's a challenge to construct a meaningful results page. Facets can help a bit. Or if they're *only* doing keyword search on *only* full-text resources, you can make it more google-like.
- Richard Akerman
Richard - Google have many different types of data, many different types of source (YouTube, Flickr, online databases, webpages, news sites, etc). I've been told (reliably, I think) that they put a great deal of effort into solving this integration problem in a way that's transparent to the user.
- Michael Nielsen
@Sol I realised I was kind of mixing two questions together. One question was just what libraries start people on their home page with a single box that is a federated search across all their resources (catalogue + licensed content + locally loaded content). The second, which I only realised in retrospect, is what libraries start with fed search that is defaulted to a keyword search of...
more...
- Richard Akerman
Michael - I don't want to speak for Dorothea but an issue we see among scientists/engineers is that they do not realize that the Library is paying for the resources they use all the time. So we often hear "oh I never use the library anymore" when in fact they are accessing full text that we are paying for. So libraries tend to worry abt interfaces/ services that don't make clear the value the library is bringing to the researchers. Does that make sense?
- Sarah
@Michael well if you look at Scholar, basically it just lists an article, or says [book] or [citation] - is that a rich enough set of search results? (I don't actually know the answer, I'm just asking the question.)
- Richard Akerman
Sarah - That makes perfect sense. It also wasn't something I really appreciated was an issue, so thankyou! On the other hand, I'm not sure I see that moving (or not) to a single search box would have much impact on this front, especially if researchers already don't realize who is paying for journal access.
- Michael Nielsen
@Sarah that is a universal problem, but it's a branding issue - I've said this before: Libraries should make it a condition of their license that they get prominent "this service / publication / whatever" brought to you by..." branding. No branding, no license.
- Richard Akerman
Richard - Now that I think about it, I increasingly use Google Scholar in preference to my library's webpage, in part because there is partial integration - the Scholar results sometimes have a link to library resources. It seems to work much better for journal articles than it does for books, so I find I mostly start with GS for articles, and only sometimes for books.
- Michael Nielsen
@Michael The problem (which is invisible to you) is that Scholar can't see all of your library's licensed resources - which is why library federated search is key to providing value to patrons, since federated search *does* see all (well at least most of) the licensed resources.
- Richard Akerman
Michael - true, it wouldn't necessarily but libraries are nervous about it. And, yes, branding should be a part of all license agreements.
- Sarah
@Richard You have good questions I don't have answers for and don't know how I would even get answers. I suppose that I could conduct a poll on my blog but I'm not confident I'd get many responses.
- Sol Lederman
Federated search should help resolve several issues. First - it seems that most library websites expect the user to make intelligent choices about where to start searching (books, articles, database x, y. I think that's an unreasonable expectation... especially when these resources are often labeled with unfamiliar names like 'catalogue' and 'A&I'. Secondly, there's the issue of clients being unaware of all of the available (expensive) licensed resources - most of which are not on Google.
- Stephen Anthony
our awesome programmer has whipped up faceted results on our federated search - but it can only facet like the first 30 results from each source.... which is problematic... a reason we can't approach scholar in many ways, is that our tools can't pre-index licensed targets... and the vendor provided indexes and the communication protocols limit what can be done by a library-run federated search...
- Christina Pikas
@Christina I think you've hit on an important limitation - in a way Fed Search is a hack to get around the incredible fragmentation of licensed resources, most all of which were designed for one-at-a-time human access, not for federation - I know there's been some effort from providers to improve this, but preindexing, index joins, more (machine-level) access to metadata, standard APIs - these would all make a much better discover experience for patrons.
- Richard Akerman
Richard, some of the code4lib crowd have come to very similar conclusions... you might want to look at Georgia Tech's "umlaut" project (Jonathan Rochkind) if you haven't already.
- D0r0th34
@D0r0th34 Yeah I like the Umlaut resolver layer work a lot.
- Richard Akerman
Merely because it is made of win and awesome? :)
- D0r0th34
Thanks to everyone for the library links - Steve (@gandalf_grey) is going to use them in an internal presentation today.
- Richard Akerman
of course Jonathan Rochkind is at JHU - so I was talking about his work in my previous comment :)
- Christina Pikas
New impact metric - http://www.the-scientist.com/blog...
Daniel Mietchen, Dustin, Pedro Beltrao and Mr. Gunn liked this
n an attempt to provide alternative metrics to the traditional journal impact factor, the open-access journal Public Library of Science ONE announced that it will release a slew of alternative impact data about individual articles in the coming months. The new "articles-level metrics project" -- which will post usage data, page views, citations from Scopus and CrossRef, social networlking links, press coverage, comments, and user ratings for each of PLoS ONE's thousands of articles -- was announced yesterday (Jan. 18) by Peter Binfield, the journal's managing editor, at the ScienceOnline'09 conference in Research Triangle Park, North Carolina. "No one has any data other than [ISI] impact factors," Binfield told The Scientist. "Our idea is to throw up a bunch of metrics and see what people use."
- Alexey
rom its inception at the end of 2006, PLoS ONE has eschewed the notion of impact factors. (It is not currently listed by the ISI Web of Science's rankings.) Binfield argued that the traditional impact factor judges a journal's overall performance, rather than assessing impact at the article-level. The new scheme, however, is aimed at evaluating each article on its own merits, regardless of the other papers in the same journal, he said.
- Alexey
PLoS ONE doesn't plan to crunch the data itself, though. "We're not being arrogant enough to make our own metric," said Binfield. Rather, he hopes that the journal's readers will use the information to come to their conclusions. "We're putting the data out there and letting the world figure it out." Eventually, Binfield hopes that readers will be able to personalize how they view the...
more...
- Alexey
awesome!
- Alexey
very nice! I presume this data will be available in a structured format?
- Mr. Gunn
Has anyone had a chance to check out this 'semantic' delicious competitor yet? - http://zigtag.com/
Dustin, Jesper Lind, Stefan Palsson and Russellreno liked this
read a Reisinger review here - http://news.cnet.com/8301-17...
- Richard Filing
I used ZigTag for about 3 months expecting better and easier tags. I gave up because it did not deliver and then discovered Twine. Same promise, same poor results.
- Russellreno
There you are Russell - thanks for the follow - I agree with you - so much overpromise so little 'semantic' value. Perhaps its too hard - I'm sticking with Delicious and Linkagogo for now.
- Richard Filing
I'm curious to know who has heard of the OSTI Eprint Network, which accesses some 5 million Eprints, including the arXiv preprints? - http://eprints.osti.gov
Dustin liked this
One hand raised
- carolh
I'm interested to know because one of my goals of attending this conference is to understand how to better promote the Eprint Network and OSTI's products. Of course, everyone knows of arXiv but the Eprint Network, which intersects in a way with arXiv, is hardly known.
- Sol Lederman
never heard of OSTI Eprint Network http://www.osti.gov/eprints/ - I would have assumed it would have been integrated in WorldWideSciece? But I'm not a working researcher in any case, so I may not be the best sample.
- Richard Akerman
Hi, Sol! I've heard of it. (Of course, OSTI is one of our member organizations)
- Jill O'Neill
It's not ringing any bells.
- Michael Nielsen
I've heard of it and tried to use it, but I find it very difficult to navigate and the results don't feel comprehensive. IMHO, Google Scholar has pretty much replaced this as a tool. GS indexes individual researchers' homepages in addition to repositories like ArXiv, which is exactly what OSTI Eprints does.
- Hilary
Hilary- Google scholar can't access the Deep Web. There are some 4 million documents in the Eprint Network that are federated in real time, plus the 1 million documents from crawled sites. So, I would guess that Google Scholar would not access more than roughly 20% of what's in the Eprint Network.
- Sol Lederman
Sol - do you know what the actual overlap is? I tried a couple of searches on eprints and couldn't find any documents that weren't also findable via Google or Google Scholar. Google has been making advances into indexing the "deep web" (http://googlewebmastercentral....) so technically Google (GS?) could index most or all of what is found in the eprints network. Also, there are many...
more...
- Hilary
My apologies if I sounded negative in my first and second comments--on the positive side, I have both heard of the site and used it! I realize you are looking for ways to promote the site-- I was researching preprint resources for biologists, so you should take my comments as being from a different point of view. If it helps, I think the site would really benefit from having a more user friendly search interface and display of results.
- Hilary
Hi Hilary - No worries. All feedback is good, pleasant or otherwise. I've asked Dennis to respond to your concerns and have forwarded your comments to him.
- Sol Lederman
The terminology is a bit confusing because eprints is also a specific repository software http://www.eprints.org/softwar... - when I read "A distributed search across E-prints on Web Sites and/or Databases" I still don't know if it means "across open access articles" or "across eprints servers". Also, how does this differ from OAIster - I guess the databases part is the differentiator?
- Richard Akerman
I'm curious to find out what people mean when they use the word "eprint" and what they mean when they use the word "preprint"...
- Hilary
Beth Noveck: From Science 2.0 to Government 2.0
Dustin, Chad Orzel, Cameron Neylon and 3 other people liked this
Tunisian prison map - opening up govt abuses
- Michael Nielsen
Changing the nature of expertise and the single point of failure
- Michael Nielsen
"We're putting too much decision making power n the hands of a single individual"
- Michael Nielsen
said ted steven's
- Paul Guinnessy
I'm rather sympathetic to Stevens on this, must admit... it's just a metaphor.
- Michael Nielsen
Chris Mooney: http://scienceblogs.com/interse... The book she mentioned is here: http://www.amazon.com/exec...
- Chad Orzel
Cat frog image: http://bp1.blogger.com/_OCDQDs...
- Michael Nielsen
Ethan Zuckerman on the importance of cute animal pictures: http://www.ethanzuckerman.com/blog...
- Chad Orzel
Group Brain Project: http://groupbrain.wjh.harvard.edu/
- Chad Orzel
Talks about the importance of chunking governance into small chunks. C.f. Benkler on the importance of this in open source.
- Michael Nielsen
Importance of teams, "group-based participation" maybe like Clay Shirky says?
- carolh
Peer-to-patent project: this is the talk within the talk
- Michael Nielsen
Peer to Patent Project -- yay!
- carolh
Peer to Patent: http://dotank.nyls.edu/communi...
- Chad Orzel
Mozilla is only an example of participation , not governance
- Paul Guinnessy
Working on 250 applications, with inventor consent
- Michael Nielsen
www.peertopatent.org
- Paul Guinnessy
Paul - Lots of decisions need to be made. What ships? When? What are the design goals? These are all governance issues, I think. Mozilla is even split into two parts (Mozilla Foundation and Mozilla Corporation) - the Foundation is, I believe, soley concerned with governance of Mozilla Corporation.
- Michael Nielsen
Patent office reverted to quasi-registration system: this is a major problem with people patenting perpetual motion machines
- Chad Orzel
Wow! This is the same reason many journals started to become peer reviewed! E.g., Nature started peer review in 1967 because of a backlog.
- Michael Nielsen
Why has it taken so long to get to this point with patents, when peer review of paper happened so long ago?
- Jen Dodd
Patent Office does prior art searches using internet archive (not Google, for privacy concerns). The archive is great, but it's not much chop at search...
- Michael Nielsen
Patent Office forbids Google-- some examiners search in Internet Archive (also get date stamp that way)
- Chad Orzel
Internet Archive really is tracking USPTO search activity
- Chad Orzel
15 hours is the review time for prior art for patents.
- Michael Nielsen
Groklaw: http://www.groklaw.net/
- Chad Orzel
Question: Why have they only scaled to 400 patents, after several years?
- Michael Nielsen
Question: Who is actually volunteeting their patents for review? Presumably it's not the patent trolls...
- Michael Nielsen
http://peertopatent.org/ Community patent review ala web 2.0
- Sol Lederman
Apparently people who submit to this process get their applications reviewed first.
- Michael Nielsen
Argues that inventors have benefit of greater certainty that their patent is indeed original. Would be nice to know after time whether there are fewer later challenges to patents that have gone through this process.
- Simeon Warner
Not replacing patent examiner, just providing extra information, while keeping quality control.
- Chad Orzel
Participation very granular. Most people just do things once or twice.
- Michael Nielsen
30+% of volunteer commenters from CS background, but ~3% from history...
- Chad Orzel
InnoCentive: http://www.innocentive.com/
- Chad Orzel
Up to 80 applications only! Very small experiment.
- Michael Nielsen
40 applications, 401 discussion comments. 176 pieces of prior art.
- Michael Nielsen
Very small fraction of patent traffic-- 80 applications so far, out of 400,000/year. Patent Office completed comment on 40.
- Chad Orzel
European patent office interested, Japan doing it, UK designed, but yet to be deployed.
- Michael Nielsen
Discussion of whether science faculty may be willing to do this for course credit. Sounds like a lot of the boundary conditions are right.
- Michael Nielsen
No spam in the project. People are exceedingly well behaved, apparently. Says people self-select.
- Michael Nielsen
I'll be interested to watch the video of this as I'm at the intersection of science 2.0 and government 2.0
- Richard Akerman
Jeff Howe's book has a nice treatment of Beth's work - http://crowdsourcing.typepad.com/cs...
- Michael Nielsen
If she said, I missed it: How many of the 40 patents considered were granted?
- Chad Orzel
I missed whether people can contribute anonymously to this? I'm guessing not?
- Cameron Neylon
She has a wonderfully improbable story about how this all happened, that really probably needs to be seen on the video.
- Chad Orzel
Regarding my question a few notes up, I asked her later, and she said that they don't have enough information yet to say whether the applications through this program are accepted at a rate different from the usual process.
- Chad Orzel
Other ways to read this feed:
