YQL

A lot of hassle is involved in submitting your own table to YQL. First, you would have to open a GitHub account. Then you would visit the YQL repository on GitHub and create a fork. Once you’ve done that, you’d have to pull the fork onto your local machine. After the fork has been pulled, you [...]

We recently added a new YQL execute method: y.pipe(pipeid,params) This method will allow you to run a Yahoo Pipe within a YQL execute statement. Accepted Parameters: pipeid (required string) params (optional json object) Returns: A response object that contains a result instance or an error object Why would you want to do this? 1. Allows you to utilize all the benefits that a [...]

The Yahoo! Query Language is an expressive SQL-like language that lets you query, filter, and join data across Web services. With YQL, apps run faster with fewer lines of code and a smaller network footprint. With YQL, developers can access and shape data across the Internet through one simple language, eliminating the need to learn [...]

Effective immediately the YQL Rate Limits are now increased: Public endpoint to 2k/ip/hr (previously 1k) Oauth endpoint to 20k/ip/hr (previously 10k) Per application limit (identified by your Access Key): 100,000 calls per day will remain the same. With this increase you can get up to 3 million – 3.1 million requests per month. (100k cap per day) Thank you to [...]

Some new enhancements were recently made to the YQL console and editor. Console: New debug checkbox. Checking this will simply add debug=true to your console URL. When debug=true is set, it enables open table debugging and viewing of YQL network calls. New expand checkbox. Checking this will expand the results section to full height. Renamed “My Tables” to “My YQL”. With [...]

The HTML table has recently been enhanced to support HTML version 5. The HTML table in the backend uses a parser which autocorrects malformed tags. To support HTML5 we are using a different parser then the one used previously. Because of this change, the output might be slightly different than before. To ensure backward compatibility, [...]

The YQL Editor is a simple and easy way to create your table in Yahoo’s cloud. The editor makes use of the yql.storage table to store your table with Yahoo’s cloud instead of hosting it on your own server. Simply access it from the YQL console on the upper right hand column under “My Tables”. Some quick [...]

YQL has attracted a large number of OpenData tables thanks to the efforts of the community. But some of these tables don’t end up working properly due to many factors, like recent changes made to the underlying API. Therefore we’ve created two new tools, YQL Table Health and YQL Lint, to help developers see and [...]

We’ve removed all search tables that relied on the BOSS v1 API (search.web, search.image, and search.news) as the aforementioned BOSS v1 no longer exists as of today (http://www.ysearchblog.com/2011...). For those of you relying on those tables please consider using the community BOSS v2 table (https://github.com/yql...). Thanks -YQL Team

Summary The latest YQL release adds support for Comet-based streaming with Downstream Polling (”CDP”), which allows YQL clients to receive updates to their queries in real time. Motivation In traditional YQL, a client must poll the YQL server for updates, by sending the same YQL query over and over again. Each time, the YQL server parses the query [...]

There have been many reports (and complaints) in the past about the YQL engine changing the structure of a JSON response from a downstream webservice as part of its processing before returning JSON output to the client. This corruption of JSON response content would manifest itself in a number of ways: JSON numbers in the downstream [...]

We started datatables.org with our first github entry back in 2009-02-05. Since then we’ve had quality contributions made by the public. We amazingly hit our 1000th table and the award goes to Carson McDonald (@casron) for submitting soundcloud.playlists.xml!! This means on average we get just over 1 new table a day. Thousands of developers benefit [...]

Yahoo! Pipes V2 engine will be using the YQL engine to process Pipes. Here is the timeline for the new changes, soon to take effect. http://blog.pipes.yahoo.net/2011...

New Feature Highlights Streaming support (experimental) – http://developer.yahoo.com/yql... Making Asynchronous Calls with JavaScript Execute – http://developer.yahoo.com/yql... execute-asynchronous_calls Query parameter added to support jsonCompat=new Single-element JSON arrays are corrupted into JSON objects Enable round trip lossless JSON processing Added y.rest.head() method support Added support for “NOT IN” comparison operator Improved CSV handling to cope with quotes according to RFC http://tools.ietf.org/html... Add decompress(true) on y.rest [...]

In the next few days we will change the Flickr internal tables where it will be recommended that you use your own Flickr API key to access the flickr.* YQL tables. If you do not provide an API key the request will still work but is subject to rate limiting which may be triggered with high [...]

The third team talk was presented by Paul Donnelly and Nagesh Susarla. They go over how to start your query out in the YQL console, access YQL data via the various endpoints, and go through YQL’s various authentication layers. Code examples here. And slides here. Here is the link to the original yuiblog post and [...]

The second YQL talk at YUIConf was presented by Nagesh Susarla. Nagesh goes over how to use YQL execute in the open data tables. Here is the link to the original yuiblog post and below an embedded video.

The YQL team was honored to be asked to participate at YUIConf 2010. Several team members had the chance to present various topics on YQL. The first talk was presented by Mirek Grymuza and Josh Gordineer. Here is the link to the original yuiblog post and below an embedded video. We’ll post the remaining YQL videos from [...]

New Feature Highlights Console: YQL Query Builder and Explorer http://y.ahoo.it/OOdKEyTv New core tables Social update activity streams: social.updates.activitystreams, avatars.get, social.relationships Other features y.rest(url).path(value) should check URL for trailing slash Support array based arguments for post-yql query functions Changes no notable changes Bug fixes, including Unescaped HTML entities produce invalid JSON in JSON-p In execute function does not preserve JSON true/false values but turns them into strings Date [...]

New Feature Highlights Store recent queries using HTML5 container Console y.ahoo.it url shortener integrated into the console when permalinking queries – now it’s easier to grab and share long console query New core tables Yahoo Mail API Social Relationship API Other features y.cache.incr() should return the new value geo.placetypes adds language support Changes Preserve newlines in console output Bug fixes, including Aliased input keys are not available [...]

New Feature Highlights: Allow an <execute> outside the execute blocks to add libraries, functions y.rest().ping() add a way to beacon data to statistics gathering services New core tables Fantasy Sports API Other features Improve ability to throw exceptions from execute tables Update tidy library to support HTML5 Add y.tidy(String html) to tidy the html and return a document <execute> changes Core HTTP changes to enable [...]

New Feature Highlights: new <meta> element in YQL response envelope returns information “about” the result list social.updates.search table – access the social updates firehouse changes to environment feature and capabilities new “env” statement. You can now load envs using the “env” statement as part of the regular YQL syntax. “env”s may now be nested – you [...]

New Core tables yql.env, automatically apply environments per app or per user per app Bug fixes, including: “content” can be used to filter in WHERE clause fixed charset parameter handling in HTML table (was broken in previous build) another custom redirect fix (for SPARQL table) update now supports “in” as where clause

Web caches are great pieces of software: they lower the load on servers; and serve content faster to clients. YQL and Pipes love caches for this very reason, and we reward clients making good use of our reverse proxy caches by not subjecting those who get cached content to rate limits. That’s right – if [...]

another nice RSS http://data-gov.tw.rpi.edu/raw... done using #rdf - Mike Chelen

Pipes/YQL broke because the CSV file became to large, see instead: http://data-gov.tw.rpi.edu/wiki... - Mike Chelen

New feature highlights: Customizable caching. Execute can now set maxage header in response (response.maxAge=300), and clients can also request a greater maxage header for increased performance (&_maxage=300). Query aliases. Name your YQL queries using meaningful short names. Core Table changes New global execute element outside of bindings is prepended to all executes (to enable common js to be [...]

access PLoS article level metrics by DOI for use in Javascript and more - Mike Chelen

table code from http://github.com/mchelen... includes ncbi http://github.com/mchelen... and usgs http://github.com/mchelen... - Mike Chelen from Bookmarklet

plos alm table http://github.com/mchelen... added - Mike Chelen

the open data table adapts the query URL parameters and specifies the series of elements to return. source code: http://github.com/mchelen... - Mike Chelen

all three tables are available using a custom environment, for example with esearch: http://bit.ly/27tTVn - Mike Chelen

New feature highlights: y.rest and y.query now support timeouts y.rest(..).timeout(30).get() will fail after 30ms y.query(…,30) will fail after 30ms An exception gets thrown if the timeout is hit Open Data Table schema changes url/urls is now optional in the schema Bug fixes, including: @ substitution works for paging parts of the query url based paging works in more cases