YQL

access PLoS article level metrics by DOI for use in Javascript and more - Mike Chelen

table code from http://github.com/mchelen... includes ncbi http://github.com/mchelen... and usgs http://github.com/mchelen... - Mike Chelen from Bookmarklet

plos alm table http://github.com/mchelen... added - Mike Chelen

the open data table adapts the query URL parameters and specifies the series of elements to return. source code: http://github.com/mchelen... - Mike Chelen

all three tables are available using a custom environment, for example with esearch: http://bit.ly/27tTVn - Mike Chelen

New feature highlights: y.rest and y.query now support timeouts y.rest(..).timeout(30).get() will fail after 30ms y.query(…,30) will fail after 30ms An exception gets thrown if the timeout is hit Open Data Table schema changes url/urls is now optional in the schema Bug fixes, including: @ substitution works for paging parts of the query url based paging works in more cases

open data table source: http://github.com/mchelen... - Mike Chelen

"To aid in your debugging efforts, YQL provides the option to have network-level logging. When enabled, all network requests are uncached, so you can iteratively develop Open Data Tables more easily, as well as debug network requests between YQL and the remote service. Network logs display both the request headers and the response content for each network call." - Mike Chelen from Bookmarklet

#yql opentables guide: http://developer.yahoo.com/yql... something similar to sunlight lab's open data table for legislators http://github.com/spullar... - Mike Chelen

there is a version available on data gov wiki http://data-gov.tw.rpi.edu/wiki... - Mike Chelen

Q: "While trying to parse html using Yahoo Query Language and xpath functionality provided by YQL, I ran into problems of not being able to extract “text()” or attribute values." - Mike Chelen from Bookmarklet

A: "YQL requires the xpath expression to evaluate to an itemPath rather than node text. But once you have an itemPath you can project various values from the tree" - Mike Chelen

New feature highlights: set verb for configuring static variables yql.storage tables for storing tables, environments and more in YQL itself debug mode for table development (debug=true) multiple environment support Core table changes: update for geo.placemaker table social.connections.updates results are sorted by date similar to social.updates csv table now has a charset key (if the source doesn’t provide one this can be used instead [...]

"Last weekend the Young Rewired State event in London, England, a few dozen hackers aged 15-18 years came to Google's office to hack with government data." - Mike Chelen from Bookmarklet

another nice RSS http://data-gov.tw.rpi.edu/raw... done using #rdf - Mike Chelen

fixed link: http://bit.ly/LB4fT plain text: http://pastebin.com/f28b66757 - Mike Chelen

"The following elements and sub-elements of YQL Open Data Tables are discussed in this reference" - Mike Chelen from Bookmarklet

"jQuery Plugin: Query YQL simply" - Mike Chelen from Bookmarklet

YQL - http://ydntest.com/ohd-han.... BOSS - http://ydntest.com/ohd-han.... - Ivan Zuzak from Bookmarklet

New feature highlights: INSERT/UPDATE/DELETE bindings and language features JSONP-X feature (XML string as JSON result if format=xml and JSONP callback is specified) Core table changes: social.updates defaults to sorting updates by date (most recent first) New core tables: social.profile.status social.connections.updates (efficiently gets updates for all connections) flickr.photoset geo.placemaker Open Data Table schema changes new “url” paging model new “insert”,”update” and “delete” bindings new “map” and “value” input key [...]

"A couple of days ago, @mikechelen asked: “can yql plug in to pipes for improved development, compared with other cloud platforms that accept standard languages?” where YQL is the Yahoo Query Language, a SQL like query language that can run queries on data pulled in from all over the web… There are a couple of ways at least of doing this: a) calling YQL from Yahoo Pipes; b) calling Yahoo Pipes from within a YQL query." - Mike Chelen from Bookmarklet

I want USGS earthquake data.  More specifically, I’m interested in recent, substantial quakes.  Fortunately, data.gov makes this data easy to find.  After searching through the USGS raw data catalog for the text “earthquake”, I choose the Worldwide M2.5+ Earthquakes, Past 7 Days feed, and pull it into YQL for parsing.  It’s almost perfect, but I [...]

One question that the YQL and Pipes teams get asked is “how can I get stock quotes? There isn’t an API for it on developer.yahoo.com”. Interestingly, while there isn’t a more traditional web service API, Yahoo finance does provide a very nice way to get a lot of well structured information on a given company. [...]

Bug fixes, including URI Template Handler now supports multiple -neg variables. Escaped values in literals such as ‘\\d’ are now correctly passed to YQL execute as ‘\d’ Fixed uritemplate table example Better integration of Local Search: Added search parameters to local.seach namely listing_id, omit_category, minimum_rating, route and sort Enhancements YQL Execute: y.rest(uri) now parses HTML documents and returns an E4X object [...]

Today we’ve released a significant new feature for YQL: <execute>. Previously our open data tables enabled any developer to bring the power of YQL and the table model available to new APIs or data sources that we hadn’t covered. Many of these are hosted on github, and you can read (and use) about them on datatables.org. [...]

Bug fixes, including JSON and JSONP mimetypes now different/fixed. fixed robots.txt evaluation bug “NaN” value sorting bug fixed Open Data Table schema changes private open data table keys don’t have to be “const” and key name (not value) is displayed in “desc” new “https=true” attribute on open data tables new “variable” paramType for open data table [...]

We’ve introduced a new env query parameter to both the YQL console and the web service. The env parameter expects a URL value that points to a plain text file anywhere on the web (including subversion repositories, github etc). The file should contain a list of use statements that specify all the open data tables [...]

Console and web service now support an “env” query parameter. This is a url that points to an environment/shell file that YQL will load. Currently this enables multiple tables to be used at once. “Use” table no longer requires the “as” clause. When “as” is absent it will default to the final path segment filename minus [...]

We’re pleased to announce that our last update now enables developers can create, use, and share table definitions over for any public API on the web, in addition to the Yahoo! APIs we support today. For example, one of the requests we had when using our weather table was how to get an ID that would [...]

NOT LIKE added MATCHES regex matching added New USE verb for open data table importing Support for open data table definitions

New tables upcoming.user microformats flickr.photos.sizes Table updates local.search “location” key is now optional mybloglog user by service fixed typo in mybloglog.members.find “charset” is now an optional key in html table, to enable developers to force a particular charset to be used when parsing the web page Bug fixes, including: more html and xhtml and i18n issues fixed for html table subselect fix for optional keys Other: publiclyCallable [...]