Feed-buster - FriendFeed

I'm new to feed-buster, my problem may be a simple one ;) How can I control the image shown in fed-buster's output ? It's always showing my banner, not the image in the post. (feed://trscope.com/feed/) (http://feed-buster.appspot.com/mediaIn...)

Wednesday - Comment - Like - Share

Ivan Zuzak liked this

That's strange. When I import the link you gave me into a group - I get all the images (including the banner unfortunately). Have you tried importing the feed into a group or did you just use the http://friendfeed.com/api... page? Also, the system should automatically pick up on which images are banners and ads and filter them out as it processes more items. Let me know if I can help more. - Ivan Zuzak

Mike Chelen

"Application Error Over Quota This application is temporarily over its serving quota. Please try again later." appearing at http://feed-buster.appspot.com/

September 20 - Comment - Like - Share

April Russo (app103) and Ivan Zuzak liked this

does this mean someone should put up a mirror? - Mike Chelen

5 more comments

yeah... near the end of the day feed-buster runs out of resources. the quota resets every 24 hours so i guess it's best to wait an hour or two. if you want to set up your own mirror - let me know and i'll try and find the exact version of the app which is running right now. - Ivan Zuzak

ah well, as long as it works most of the day, that's not too bad. is the SVN trunk current? unless there is some way to increase the bw limit, it wouldn't hurt to have a few mirrors available :) - Mike Chelen

i don't think it's current - i've been working on a PSHB implementation of the hub lately so the latest svn version has some of that stuff in and is probably not in working order. which brings me to this - when i get the pshb version up, the load will probably drop significantly and the resource quota will probably stop being an issue. - Ivan Zuzak

how easy would it be to set up a mirror? just push some code to a new appspot account? - Michael Kuhn

yep, that's it... i'll try and find the exact SVN version that's currently running so you can give it a try. - Ivan Zuzak

revision 136 should be the version which i'm running right now. you should be able to checkout the code from google code and submit it to appspot as it is. - Ivan Zuzak

Michael Kuhn

Hi Ivan, could you please specify on the feed-buster page how long the caching period is? would be helpful for testing. :)

September 16 - Comment - Like - Share

Ivan Zuzak liked this

Hi Michael. Feed-buster doesn't cache anything actually. When the service receives a feed request, it fetches the original feed, inserts the image XML tags, and writes the resulting feed as output. What's important here is the frequency with which FriendFeed polls feed-buster feeds - and this is around once every 45 minutes (i.e. FF checks feed-buster for new content every 45 minutes).... more... - Ivan Zuzak

3 more comments

I went to feed-buster, generated a "injected" URL for my blog's feed: http://blog.mckuhn.de/atom.xml turns into http://feed-buster.appspot.com/mediaIn... . When I download the raw feed, I see a test post that I made after generating and testing the new feed, but in the feed from feed-buster the new post isn't there. - Michael Kuhn

(I think appspot might do some caching for you that you can't influence.) - Michael Kuhn

if I add a "?" to my blog's URL, appspot / friendfeed do update the feed - Michael Kuhn

You're right, I've tried it myself now. That's really strange, never happened before. Thanks, I'll look into it! - Ivan Zuzak

Kyle Wegner

I'm testing out FB and running into an issue: Current importing of Google Reader items (non-FB) include my shared notes as comments under the article, however when I am testing the feed from FB these notes/comments are lost. Is there any way to include that functionality from gReader?

August 28 - Comment - Like - Share

Kol Tregaskes and Ivan Zuzak liked this

Hey Kyle, I answered you here - http://friendfeed.com/friendf.... - Ivan Zuzak

Paul Greer to Paul's feed, Feed-buster, Tumblr Users, FriendFeed Feedback, FriendFeed for Beginners

Going to Experiment with the Feedbusters scraper thing (http://friendfeed.com/feed-bu...).

August 18 - Comment - Like - Share

Mac Sharp, Владимир, Mitchell Tsai and 5 other people liked this

Apologies for any duplication weirdness. I love it because it gives me the big pictures, that look nice (call me shallow). Uncertainties at this stage are the effects it has on my feedburner stats, and audio not showing up as playable on FF. Other than that it looks great, makes the whole FriendFeed thing come alive even more. - Paul Greer

4 more comments

You do lose the speediness of the the New Reader RSS, which is a shame, but it is a price worth paying I think.. - Paul Greer

Hi Paul! I'm glad you're finding the service useful. :) I'm actually working on making the service more speedy by porting it to PSHB architecture. Other than that, please do report other quirks you find (mp3 files should be showing up in FF) and throw in the URL of the problematic feed so I can debug the problem. Thanks! - Ivan Zuzak

Seems to be working well, although the GReader stuff seems to be coming in far back in the stream, like its dated when the post was originally made rather than when I shared it, but then adjust themselves later, not sure. Thats a small thing tho, generally its fantastic and makes mey stream look much more inviting. Thanks! Now thinking of using GReader more and less of the peripheral thing i have been using to share with. Oh and Tumblr posts look so much better. - Paul Greer

Thanks Paul! And yeah, you're right - FF sorts imported RSS/ATOM feed items based on their creation time, which is different from the moment you shared them on GReader. Lucio solved this problem with a Yahoo Pipe - http://friendfeed.com/google-.... - Ivan Zuzak

OK, I tried this a few times and couldn't get it to work. Have now retried with more patience, sussed I needed to put the feebuster into the pipe not the google reader feed. seems to be working.. - Paul Greer

Kamilah Gill

Fwd: GAH is Feed Buster busted?? My Google Reader post should have been here by now :( Even manual refresh isn't working. (via http://friendfeed.com/friendf...)

August 16 - Comment - Like - Share

April Russo (app103) and Ivan Zuzak liked this

Hi Kamilah. Can you give me the URL of the feed so I can check what's going on? Thanks, and sorry for the problems. - Ivan Zuzak

4 more comments

Oops, I should have added, it did finally come through, but it just took a very long time (more than an hour). Hang on, I'll get the URL... - Kamilah Gill

It's http://feed-buster.appspot.com/mediaIn... - Kamilah Gill

Thanks! will check it out. But I have a feeling it's related to the fact that feed-buster is getting very popular, and since it's hosted on AppEngine (Google's free hosting service) - it runs out of resources near the end of the day (uslualy after ~22-23 hours). The resources quota resets daily, which is when the service starts pumping feeds again. I'm actually working on fixing this by porting the whole thing to PubSubHubBub architecture (http://code.google.com/p...). Thanks for the feedback! - Ivan Zuzak

I am having the same problem. A blog post I made over an hour ago still hasn't shown up. http://feed-buster.appspot.com/mediaIn... - April Russo (app103)

I take it back. It just showed up. - April Russo (app103)

David Ing

Geotag trumps images/media from Wordpress as Friendfeed preview image. At http://daviding.com/blog..., trying both Geotag for Wordpress http://bobsp.de/weblog/geotag/ + MediaRSS plugin http://wordpress.org/extend... . On Friendfeed, preview icon is Google Map. On My Yahoo, preview icon is first image. Chacun a son gout?...

August 2 - Comment - Like - Share

Ivan Zuzak liked this

David - I didn't understand what the problem is. Can you explain in more detail what you expect should happen when you import the feed into freiendfeed? If you try importing the feed-buster processed feed (http://feed-buster.appspot.com/mediaIn...) into the feedtest app (http://friendfeed.com/api...) you will see images... more... - Ivan Zuzak

Ivan, thanks for the question. I'm not sure what behaviour should be expected. If there is a geotag plus multiple images, I would expect multiple thumbnails in Friendfeed ... with the geotag first or last. I was just surprised that My Yahoo skips the Geotag. I guess that there's not a "standard" behaviour yet. - David Ing

Massimo Fontana

ONLINE miniRSSL generator, if you have or not a RSS service in your site this service helps you to share informations.Can be used with your friendfeed account or any other page.Keeps RSSL (Legacy RSS) forever, the aim is to remember dead sites, and to be able to track a site history.Can produce a miniRSS each month for you, just come and scan again

July 27 - Comment - Like - Share

ianf ⌘

User-specified blacklisting for ads [via http://friendfeed.com/ianf...]

User-specified blacklisting for ads [via http://ff.im/5e9s9]

July 20 - Comment - Like - Share

Ivan Zuzak liked this

Re: "I was thinking of a small form through which everyone could enter an URL which the service would ignore if it was seen as an image URL prefix. Having the list of URL which should be blocked in encoded in an URL may be an overkill for most users." - ianf ⌘

2 more comments

Admittedly, it's not a simple task to provide valid and verifiable feedback/ input for a blocklist. I favor the google/gwt approach of having just a simple hyperlink last on each gwt-processed page to "report (a) problem" [e.g. http://google.com/gwt...] - which is then investigated and handled in ways unknown to me (and just as well). I'm not... more... - ianf ⌘

I like your ideas of crowdsourcing the process with per-post links. Unfortunately, there are some limitations - The only place I could put that link is either in the subject or comment section of a post, and moreover text in those sections is treated like normal text, not HTML. This means I can't put up a link which is not a URL (e.g. "AdBeGone!" which links to some feed-buster... more... - Ivan Zuzak

Actually, you could simply tack this onto the end of any accompanying comment (or create one just for the purpose) "[Make http://tinyurl.com/AdsBeGone] - which would simply note the referrer, and exit quietly. Because it'd be last in the comment, and under poster's full control, I don't see anything improper is such hypertextInfusion! - ianf ⌘

ianf ⌘

Re: My mediaInjected custom RSS sub http://feed-buster.appspot.com/mediaIn... now uniformly displays this ad-pic, rather than item picture(s). (via http://friendfeed.com/ianf...)

Re: My mediaInjected custom RSS sub http://feed-buster.appspot.com/mediaInjection?inputFeedUrl=http://www.dailyicon.net/feed/rss/&webScrape=1 now uniformly displays this ad-pic, rather than item picture(s). (via http://ff.im/5e9s9)

July 20 - Comment - Like - Share

Ivan Zuzak liked this

[izuzak] "[…] The point at which everything falls apart is when I update the service since AppEngine clears all caches on updates. Therefore, when I clear the cache, it is as your feed has 0 items when I encounter new posts. The problem persists only for the 2 new posts after an update until the heuristic can start working." - ianf ⌘

Clearly, this calls for writing out at least the known-offending urls to file prior to updates, and restoring them afterwards. A cumulative blacklist of sorts. - ianf ⌘

Yep, that's exactly what I'll be implementing soon. Damn ads :) - Ivan Zuzak

ianf ⌘

Mechanical cropping of overflow mediainfused pictures.

July 21 - Comment - Like - Share

Kol Tregaskes and Ivan Zuzak liked this

There are two views of the same two feed-buster-enhanced items, at its lowest (unreadable) onscreen scale, and six times enlarged version of (the latter practically filling out my 13.3" laptop's screen). The cropping stays the same, though the extent changes slightly if window made wider. So it'd appear to be the aftermath of FF's reliance on maximum relative-column-width element. What makes me wonder, however, is why the second picture doesn't get the "more pictures" iconette, but is mechanically cropped instead… - ianf ⌘

Whoa, that shouldn't happen. Seems like a FF layout issue. Compare http://friendfeed.com/ianf... with http://friendfeed.com/ianf.... The first one is OK, while the second one is borked, and when you view it in your stream, you don't see the "more pictures" icon since it is probably outside the viewable area (like the... more... - Ivan Zuzak

ianf ⌘

FriendFeed API v2: Real-time, OAuth, file attachments, and more | http://blog.friendfeed.com/2009... (via http://friendfeed.com/friendf...)

FriendFeed API v2: Real-time, OAuth, file attachments, and more | http://blog.friendfeed.com/2009/07/friendfeed-api-v2-real-time-oauth-file.html (via http://ff.im/5tnDJ)

July 20 - Comment - Like - Share

chrisofspades

having some problems with some feeds. am I doing something wrong?

July 16 - Comment - Like - Share

Ivan Zuzak liked this

this one http://feed-buster.appspot.com/mediaIn... only "busts" the first entry. - chrisofspades

7 more comments

this one http://feed-buster.appspot.com/mediaIn... only grabs one entry - chrisofspades

this one only grabs one entry as well http://feed-buster.appspot.com/mediaIn... - chrisofspades

you're right. i also see only the first item processed, and the rest cut off for some (unknown) reason. i'll look into it tomorrow. in the meantime - you can check out http://friendfeed.com/indexed... and http://friendfeed.com/new-mat... groups which already have some of these feeds imported. - Ivan Zuzak

thanks Ivan. I was hoping to combine those and some others into a group for math-related humor. I guess I could always make a list. - chrisofspades from IM

Ok, I've found out what the issue was - it was a non-configured feature I implemented. In order to reduce the load, the service attempts to return only a few "old" feed items (old feed items = feed posts that are not new, or better said - post that were present in the feed during the previous crawl of the feed). The limit was falsely set to "1" which means only a single old post was... more... - Ivan Zuzak

that makes sense. 5 items should be enough. have you considered caching old items so you don't need to crawl as much? - chrisofspades

Actually, currently I don't crawl anything on my own - the service fetches a feed whenever the FF crawler pings my service for that feed. In the future, I am thinking of reducing the number of fetches via caching or some other method, since FF mostly crawls more often than a service is updated. Also, I'm thinking of utilizing PSHB (http://pubsubhubbub.googlecode.com/) to get around some of the resource problems. - Ivan Zuzak

good idea. and I wonder if friendfeed's SUP would be useful too, so that way they don't have to crawl your service as often. - chrisofspades

immaterial

Hiya, something seems to have broken with mine ( http://feed-buster.appspot.com/mediaIn... ) I refresh it but the new items aren't showing up (& i'm pretty sure it's not because it just hasn't updated yet) thanks

July 20 - Comment - Like - Share

Ivan Zuzak liked this

Traceback (most recent call last): File "/base/python_lib/versions/1/google/appengine/ext/webapp/__init__.py", line 501, in __call__ handler.get(*groups) File "/base/data/home/apps/feed-buster/11.334851719557403039/feed-buster.py", line 395, in get scrapedMediaLinks = self.searchForMediaDOM(descriptionCrawlNodes) File "/base/data/home/apps/feed-buster/11.334851719557403039/feed-buster.py", line 231, in searchForMediaDOM crawledMedia += self.searchForMediaString(stringToParse) File "/base/data/home/apps/feed-buster/11.334851719557403039/feed-buster.py", line 209, in searchForMediaString imageProperties = self.getImageProperties(imageSrc) File "/base/data/home/apps/feed-buster/11.334851719557403039/feed-buster.py", line 147, in getImageProperties imageInfo = simplejson.loads(serviceResultJson.replace("\\x00","").replace("'",'"').replace(";","")) if serviceResultJson else None File "/base/python_lib/versions/third_party/django-0.96/django/utils/simplejson/__init__.py", line 232, in loads... more... - immaterial

4 more comments

I'll look into it, thanks! - Ivan Zuzak

OK, I've found that the problem is in an external service which I use to determine image properties (dimensions, type) for images that don't have those dimensions set in HTML <img> tags. It looks like that the developer of that service (http://img2json.appspot.com) has made changes to the service recently, and broke a case where responses for non-valid images are not formatted properly. I've notified him and hope he'll fix the issue soon. In the mean time, I hope to patch things up on my end somehow. - Ivan Zuzak

Oh, cool. Thank you for the quick response! :-D - immaterial

Thanks, it all seems to be working again now :-) - immaterial

No problem, thanks again for reporting this :). - Ivan Zuzak

Edward Zwart

Is it possible to scrape mp4 from the feed into FF?

July 1 - Comment - Like - Share

Ivan Zuzak liked this

eg, http://crackle.com/rss... - Edward Zwart

Sorry for not responding sooner Edward. I'll look into it and let you know. It shouldn't be impossible. Thanks for the feedback. - Ivan Zuzak

hey no worries, thanks for looking into it - Edward Zwart

Zulema ◕ ◡ ◕

I've noticed that my Google Reader Shares brought in using feed-buster are dated in the past. I just shared this from Google reader today (Friday) but it's dated as Tuesday: http://friendfeed.com/zoblue... Am I doing something wrong?

June 26 - Comment - Like - Share

Vedrana Janković, Ivan Zuzak and Kol Tregaskes liked this

Hey Zulema. You're right, Lucio (http://friendfeed.com/cantorjf) discovered this issue before, see: http://friendfeed.com/friendf... for a description. What's even better, he has a solution in the form of a Yahoo Pipe available here: http://friendfeed.com/google-.... Try... more... - Ivan Zuzak

4 more comments

I think I'll keep using feedbuster because it imports images along with the entries and that's my favorite part. Thanks! - Zulema ◕ ◡ ◕

You don't have to choose between the two, you can use both at the same time. If you give Feed-buster your Google Reader shared items feed, and then give the Yahoo Pipe the output of Feed-buster, you will get both the images and the right ordering and timestamping. This is the final URL you would get for your Google Reader shared items feed:... more... - Ivan Zuzak

oh my gato you're blowing mah mind!!!!!!! - Zulema ◕ ◡ ◕

Wow, thank you so much! It never occurred to me to use a combination of both! SQUEEEEEEEEEEEEEEE!!! - Zulema ◕ ◡ ◕

no problem, i'm glad you're enjoying it :) - Ivan Zuzak

Lucio Riccardi  CantorJF to Lucio's feed, Yahoo Pipes, Google Reader, Feed-buster, FriendFeed Hacks

Yahoo Pipes Madness – Episode 1 - http://cm.brainsfactory.org/2009...

June 16 from Bookmarklet - Comment - Like - Share

Richard ¿digame? Walker, metalerik, NaHi and 5 other people liked this

"In last few weeks i studied some RSS, GoogleReader and FriendFeed protocols and built yahoo Pipes “for fun and profit”. Here the list and the description, take it with some assumptions: "Every pipe you want to “use into a pipe” (by dropping it from left-menu) has as input a feed or a webpage, you can’t use it “in the middle” of an item feed analysis redirecting stream of item into it. This behaviour limits construction of “pipes as module”, then CLONE IT or TAKE IT AS INSPIRATION for your pipe." List of my “public” pipes (consider this as freezed, if I’ll update it I’ll clone a 0.2 version and so on ..): Go to website :)" - Lucio Riccardi  CantorJF from Bookmarklet

Good stuff man, keep 'em coming :) - LANjackal

Lucio Riccardi  CantorJF to Lucio's feed, FriendFeed Hacks, Google Reader, Yahoo Pipes, Feed-buster

Google Reader / Feed-Buster / Pipes and the order of posts: We all (ahem, me and other 3-4 people for sure) like to use Pipes and Feed-Buster for enhance feed import behavior .. BUT, when you use it on GoogleReader feed, you have to import it as a Rss or Blog, then elements are in "when was published order" and not "shared" order.. (continue)

June 8 - Comment - Like - Share

metalerik, masstrovato, Wallace and 4 other people liked this

..then posts are published in "the middle" of the "time-line" of your FriendFeed page, it's not shared to subscribers (is "forget" in the past items, no one see it in real time), Friendfeed don't twitter it.. Then timeline is strictly on item.pubDate? How we can handle it? Smart pipe solution? Challenge is open :) - Lucio Riccardi  CantorJF

11 more comments

i think i get what you're saying, lucio - FriendFeed sorts the posts by each item's pubDate, which is different from the moment of sharing posts? yeah, i've had similar problems with feeds that didn't have a pubDate at all, so FriendFeed did some weird ordering... anyway, you're right. the pubDate for the greader shared items feed is copied from the pubDate of the feed from which the... more... - Ivan Zuzak

but i must say that i haven't tried this out to confirm that this is an issue. are you sure that new items don't come out at the top in FF, regardless of the pubDate? is it possible that items are wrongly sorted only at the moment when you do the import, but all newly shared items are correctly shown at the moment they are shared? - Ivan Zuzak

@Ivan Zuzak: I don't know .. i think i can make it also with few tricks on pipes (at this time i don't know how but it seems quite possible), but i don't think that reorder with an arbitrary item.pubDate is a big idea.. on every "feed request" can generate also other type of problems.. I imagine posts already-posted that with a date update jumps in the "time-line" like salmon swim upstream :).. need some tests.. - Lucio Riccardi  CantorJF

@Ivan Zuzak: I'm quite sure, results of the pipe is ordered in "Sharing time", on Friendfeed are reordered, I imagine in pubDate time, if i find the exact answer in API I'll write here :) - Lucio Riccardi  CantorJF

@Lucio: i wasn't thinking of reordering them every time differently. i could do an initial reorder at the moment of import and then internally mark the items in the feed that have been reordered. after that, i just reorder new items which haven't been marked. this is just a conceptual idea :). i too have a feeling that this could be doable in pipes. you can detect the existence of items, insert new items, change old items...etc. - Ivan Zuzak

@Lucio: yes yes, you're right. i'm sure that the feeds look what we've described and that friendfeed orders the post in the described way. but i wonder what happens in FF when an item appears that has a pubDate which is older than of an item which already exists? how is this new item shown to the user? is it shown at the top of the timeline in the "Home" stream? it doesn't really matter since it doesn't fix anything, i was just wondering how FF handles that from an UI-notification perspective. thanks :) - Ivan Zuzak

@Ivan: But for reordering in this way i need to manage "memory" in queue, then on every new requent and feed source control compare last time fetched and tagged.. i think we can make it only comparing to a feed reshared from friendfeed.. resemble me a cannibal loophole but it can work (still i'm not sure can be done by pipe.. i'll try) - Lucio Riccardi  CantorJF

@Ivan: When a pubDate of a new item in a feed is antecedent to last item: the new item is not positioned on the head of stream (and this is not really a problem), is not twittered (haihai...), and don't spread on live coverage of items (haiahiahiahiahi...), because is not on the head of the queue.. :) - Lucio Riccardi  CantorJF

Thanks Lucio :) Yeah, for my approach you need some kind of "memory". Or do a reordering every time so that the posts at the top of the feed have the newes timestamp. This timestamp may change with each reordering, but it won't matter - nothing will get duplicated or wrongly ordered ever since only the relative position determined by pubDate is important. The actual pubDate is not important, I think. But I'd rather see a Pipes implementation than doing it in my service - since it's less work for me :) - Ivan Zuzak

On way to resolve this, stay tuned.. :) - Lucio Riccardi  CantorJF

resolved here: http://friendfeed.com/google-... - Lucio Riccardi  CantorJF

Bravo Lucio! - Ivan Zuzak

April Russo (app103)

Feed-Buster doesn't seem to work with my Blogger feed to import images when I make posts with Windows Live Writer. They are not showing any images at all. (example: http://friendfeed.com/app103... )

June 14 - Comment - Like - Share

Kol Tregaskes liked this

Thanks for reporting this April, I'll look into it asap. - Ivan Zuzak

2 more comments

April, you we're right. Some of your posts have images with *very* strange URLs (e.g. "imageName.jpg?img=800"). I've included a special case that should take care of this for future posts, so you should start seeing all images from now on. I don't know if there's anything I can do for previous posts, but you can try refreshing the feed (go to your account, select the feed and then... more... - Ivan Zuzak

Thanks! I'll let you know how it works out after my next blog post. Part of the issue is that the feed is already mrss enabled, but for only images inserted using the web based Blogger editor. Images inserted any other way end up in a different gallery in Picassa Web and are not included in Blogger's mrss tagging. They don't allow posting to that special reserved Picassa Web gallery in... more... - April Russo (app103)

Oh my, you have a whole history of mrss problems. And yes, I've noticed that some posts in your blog have mrss items. In feed-buster, I try to scrape those existing mrss items for image links, and then remove them afterwards because I've observed that FF doesn't import images from mrss items if they are not structured a certain way. I hope it works out for you :) - Ivan Zuzak

Lucio Riccardi  CantorJF to Lucio's feed, FriendFeed Hacks, FriendFeed Feedback, Google Reader, Feed-buster

Google Badge OPML on Friendfeed? YES - http://cm.brainsfactory.org/2009...

June 4 from Bookmarklet - Comment - Like - Share

nektarios sylligardakis, Peter van Teeseling, Mark Wilson and 25 other people liked this

After few weeks on FriendFeed and few days gaming on Yahoo Pipes i made a Pipe that use OPML link generate from a GoogleReader Badge to extract RSS items, and enrich it (By Feed-Buster & co). Waoaaaa!!! :) You can find it here: http://pipes.yahoo.com/cantorj... In simple three steps: 1) Gererate Badge on [more....] - Lucio Riccardi  CantorJF from Bookmarklet

40 more comments

Slick - Mitch

I'm not clear what the advantage is here (over just the feed buster using the Greader rss outputs) - guruvan (Rob Nelson)

cool stuff lucio! i was planing on making an OPML -> FF service myself, but you beat me to it. now i'm expecting a spike in feed-buster traffic. i hope it doesn't gobble up the whole appengine quota :). - Ivan Zuzak

rob, it's a shortcut for importing a lot of feeds with a single step. in google reader you would create a bundle of say 50 feeds and this bundle is described with something called an OPML file. lucio takes this OPML file, combines all the feeds into a single feed and then pulls this feed through feed-buster (and some other stuff, like creating a comment if it doesn't exist). the result... more... - Ivan Zuzak

I did similar without the pipes: I have a couple that are imported straight from the RSS/ATOM link on the bundle page, and a couple that are from the RSS/ATOM link from the "public link" from a GReader folder. I'm just not understanding the extra step of the yahoo pipes. (see the feeds on my room: http://friendfeed.com/guruvy-... ) - guruvan (Rob Nelson)

You are a genius! - Rich

@Guruvan, I tried your approach but the images are not showing... any ideas? http://friendfeed.com/jungleg... - Jorge Escobar

rob - yeah, you're right. i suppose there are other sources of OPML files other than greader, and those sources may not have nifty shortcut links such as the ones greader has? other than that, the pipe also parses the content of each feed item and creates a comment based on the first 400 chars of the content, and you can then import the feed into FF to show that comment as the first comment of the post. but yeah, i see your point, it's somewhat the same as using the link + feedbuster :) - Ivan Zuzak

@Rob Nelson: because you can take advantage from Badge's Google repository, and with few click you can use it with generic OPML too. - Lucio Riccardi  CantorJF

Hmmm - my atom from my bundle isn't recognised by FF, or feedbuster, or this pipe.... http://www.google.com/reader... - Rich

Any idea's why not? - Rich

@Jorge - take the feed URL you got from GReader and then pull it through feedbuster http://code.google.com/p.... you should see the images then. let me know if you need help. - Ivan Zuzak

Yeah, my pipes didn't work either - Jorge Escobar

Ivan, look at this: http://feed-buster.appspot.com/mediaIn... - Jorge Escobar

Ivan, then I fed the above to here: http://friendfeed.com/jungleg... - Jorge Escobar

@Rich - i'm getting a "permission denied" for your feed. if i'm getting it, so are all the services. try to logout of GReader and then follow that link. - Ivan Zuzak

Hmmm that's weird. I get the permission denied when viewing in Safari (logged out), but not if I curl or wget the feed from the command line. - Rich

@Jorge - thats strange. go to http://friendfeed.com/api... and try the url (view-source:http://feed-buster.appspot.com/mediaIn...) there. i see images for top 4 feed items which is the correct behaviour for feedbuster (i fetch the 4 most recent items currently in the feed, and ALL new items that come after that). - Ivan Zuzak

Is the correct place to get the link to make a bundle, then to choose the OPML link (for the pipe), or to preview the bundle, then to grab the ATOM feed from the address bar? - Rich

@Ivan, it is strange, I'm using it for my JungleG blog and it works perfectly - Jorge Escobar

@Jorge - any chance that you mistakingly imported the original feed, and not the one processed by feedbuster? just a shot in the dark :) - Ivan Zuzak

Ah, for my prob in getting an rss from a bundle, click send link, then you have a link to an atom feed there. - Rich

@Ivan, no, hover over the RSS icon here: http://friendfeed.com/jungleg... - Jorge Escobar

Weird, it's now showing some pictures, oh well - Jorge Escobar

@Rich - Go to http://www.google.com/reader..., then click the "Put a link to your website or blog", and then take the "Atom feed" URL to get the combined *feed* url for the whole bundle. To get the OPML file URL, just get the URL from the "OPML file" link. - Ivan Zuzak

@Jorge that's high-tech for ya :) glad it's working! - Ivan Zuzak

@Ivan thanxs for always being there helping us with your great tool - Jorge Escobar

Will these feeds automatically refresh? - Jorge Escobar

@Jorge you're welcome :). and yes, those feeds will refresh automatically. when you give FF a feed-buster modified feed, FF pings the feed-buster service each time it wants to know if new posts exist for that feed. and each time FF pings feed-buster, feed-buster pings the original feed also. so it's all synced. - Ivan Zuzak

When I run this I get: "Pipes encountered a problem while running this pipe: Pipes engine request failed (malformed engine data) (2)" That's with this OPML: http://www.google.com/reader... - Rich

@richbradshaw: .. too much feeds for a pipe.. i have to read docs and make some tests.. tnx - Lucio Riccardi  CantorJF

Lucio, I tried your pipe with my OPML bundle (of 188 feeds) and got this error: Pipes encountered a problem while running this pipe: Pipes engine request failed (malformed engine data) (2) - Kol Tregaskes

Is this too many feeds? - Kol Tregaskes

@Kol: Yes, i think Yahoo Pipes block pipe execution after a certain period of elaboration. I have to search docs about limits, or test the "breaking point".. I'm thinking that there are some way to keep this pipe slim and increase number of feeds in OPML that can support (not to 188 :)).. i'll keep you update.. Friendfeed? anyone is listening? Suppoert for OPML? :D - Lucio Riccardi  CantorJF

Lucio, what is the currently limit? What limit do you think it could get up to? - Kol Tregaskes

I always wondered what the limits and quotas are for Pipes. Let us know when you find something, Lucio. - Ivan Zuzak

I tried with an opml of 400+ feeds (i'm a little GReader addicted :P) and work fine.. however i found some limits in regex module searching on docs.. I'll make some mods in next hours, I'm little busy with projects, exams, and a wedding (of a friend), but i'll comment here for news and debug help :) - Lucio Riccardi  CantorJF

Thankfully I have all my feeds in FF (manually added a while back) but just wanted to test this pipe. :-) - Kol Tregaskes

thanks again guys for working on this stuff. way cool. - metalerik

I made some changes in accord to Ivan, if you want Feed-buster on OPML pipe you have to use it in "old school" way, by URL... now the pipe is called "Public OPML to Unic Feed" to underline the discontinuity :). Tnx @Ivan, and @Kol i will send you a private message to try again with your OPML for test some future changes :) - Lucio Riccardi  CantorJF

OK, cool. :-) - Kol Tregaskes

Ivan Zuzak to Ivan's feed, Feed-buster

I've made several changes and bugfixes to the feed-buster service today (http://code.google.com/p...), let me know if anything breaks.

June 6 - Comment - Like - Share

immaterial, metalerik and Kol Tregaskes liked this