if twitter grows to the size of facebook i.e 200 million so 10 times... thats still only 2k per second...
- Robert O'Callaghan
Adam: that's according to people who are getting the firehose feed.
- Robert Scoble
I assumed it would be more than that, too.
- Robert Scoble
Ah ok. Which, to my knowlede is just google, friendfeed and just a few other "partners" do we know who is a firehose partner?
- Adam Jackson
But, looking through the data it seems most people don't tweet very often.
- Robert Scoble
And that is because Twitter is just getting to be popular in the rest of the world, wait to see what is coming..
- Julian Flores
sort of weird comparison, tweets are writes and queries are reads
- Kiran Patchigolla
Adam: we don't have a comprehensive list, no. There are others, though.
- Robert Scoble
And are firehose partners getting ALL tweets?
- Julian
Robert: have you spoken to Nick from tweetmeme - he has some real good stats regarding rt's, data growth over the last 2 years etc
- Robert O'Callaghan
Kiran: yeah, it's not a good comparision, to be sure. But if there's only 200 tweets a second I seriously doubt that Twitter search is seeing many people hit it.
- Robert Scoble
The people who are getting the firehose feed also say that it's very difficult to deal with the data flow at the level it is today (and they say that even Twitter isn't doing very well at it, look at how bad Twitter search was last week). THey all are wondering how they will deal when Twitter's traffic is 100x what it is today.
- Robert Scoble
Robert: this is what I love about friendfeed. The post gets better over time because of everyone's participation. Thanks!
- Robert Scoble
Yes that's what I don't understand Robert, 200 tweets/s x 160 chars (including headers) = 32kB a second. This is not difficult to deal with, surely (+XML / JSON overhead, still tiny amounts)
- Julian
Louis: it's not much, but it's all text. The real struggle that many of these companies have is with photos and video and other data types. It's very expensive to deal with all this data. I wonder if we could decrease the cost of hosting and dealing with it all by sharing the data in some way?
- Robert Scoble
Julian: it's not the per second amount that's difficult to deal with. It's that the size of databases keeps growing. Remember the guy who bragged about having 800 million rows in his database?
- Robert Scoble
Now, what happens if you need to resort your database? Or do something else funky?
- Robert Scoble
Robert, you're asking the right questions. The biggest growth areas in data today are in files and rich media - including photos, videos, etc. We're all creating more and more, but nobody is deleting.
- Louis Gray
It is expensive to store the data and to transfer the data. Networks have gotten larger, disks have gotten larger (and cheaper per GB), but the disk speeds themselves are not increasing, and servers are largely processor-bound, so you see low utilization rates.
- Louis Gray
Louis: yup, and the folks I talked with say that if you want really fast response like what friendfeed has you've gotta pay for expensive SSD devices for your datacenter. I don't know if that's absolutely true, but it sounds reasonable, especially for systems with lots of databases and lots of indexing and lots of reading.
- Robert Scoble
there's a new o/r mapper available to Java programmers that lets them write programs in a typical relational-backend fashion, but behind-the-scenes large files are transparently stored in Amazon S3 cloud storage and the database rows are stored in Amazon SimpleDB.
- Brian Hendrickson
How about adding friendfeed stats here too.. (if somebody knows already!)
- Jigar Mehta
Louis: but I wonder if that data will have worth in the future - mining photos for example for data about your friends, family and holiday destinations.
- Robert O'Callaghan
Robert O: A significant amount of data is infrequently accessed. And as Scoble is saying, you are looking to have SSDs at what's called Tier 0. The best enterprise storage devices have multiple tiers of disk and automatic policy-based data migration between tiers from high performance disk, like SSD and Fibre Channel, to high density SATA.
- Louis Gray
But if you assume data will be there, most people won't mind having some latency on data retrieval for older information, so slower SATA (like in your laptop) is just fine.
- Louis Gray
Maybe it's just me, but speaking with people around the queries issue made me realize these are still big numbers for most average sized companies. You might think that giants like Google, Microsoft or Facebook can easily take care this amount of requests but many other small startups would probably find it difficult to handle.
- Nir Ben Yona
Good point Robert, 200 tweets / s = 6.3 billion rows for one year of tweets. But still surprised this is an issue these days. Anecdotally, even MySQL can support billions of rows.
- Julian
That's an interesting Google datapoint, it explains the aircraft hangers full of servers. The scaling challenge for Twitter however is less related to 200 tweets being posted per second, more about all those Twitter clients hammering their API trying to get them out in real time. Firehoses aside, does anyone know how many API hits Twitter gets per second?
- Bob Hitching
Every incorrect assumption in this post seems to think that 1 tweet on twitter = 1 database row = "So easy!". You've left out the user fanout! One Obama Tweet = 1M database rows, someplace.
- netik
Twitter bought a load of kit a month or so back - at @devnest we were told it was to do with search. People had noticed it had shrunk in size from year dot to only two weeks worth. Anyone know if it expanded back to the beginning or have they closed that door?
- Robert O'Callaghan
Robert O: The data set of Twitter's Search can be as little as 4 days. Do a search on tweets "from Oprah" for example, and you will see none.
- Louis Gray
Thank you for all of this Robert, you are such an eternal giver.
- Thomas Power
At a basic level we're talking about storage and distribution. Data is stored somewhere until someone requests it and it's then distributed. In this scenario there are at least two potential bottlenecks or problem areas. There is currently no infinite storage space and there is currently no infinite amount of bandwidth to distribute it. Plus it's a two way distribution network, we're...
more...
- Gilbert Harding
The best comparison would be Google's web crawler new page discovery rate to Twitter's new status rate. The read rate on Twitter is many orders of magnitude above the write rate-- the comparison of Google QPS to Twitter API calls. Furthermore, the total Twitter user-driven write rate is much larger than the new public statuses rate, which is what the firehose represents. Think of all...
more...
- John Kalucki
No one in their right mind would use a relational database to store all this data - the biggest issue is that you have SO MANY synchronous writes as well as index and key changes per second. A stream-fed architecture is ideal for this, and 200 inputs a second is easily parseable. TIBCO is an exampleof a very heavyweight version of a streaming service, as Steve Wilhelm mentioned above.
- David Sifry
This uncovers the secret to what may be twitter's eventual financial success and ability to resist being acquired. I'm reminded of the recent techcrunch article proposing that youtube would have been unable to survive as a standalone entity because of the enormous cost of storing all of the video data
- keith kleiner
Late to the comments but I agree with Louis, 10G per day is trival. The last network collection stream service I helped design was 24 Petabytes per work of text messages comparable to tweets across multiple protocols and transport technologies.
- Ken Camp
I never would have thought that Twitter's high volume times would only create 200 tweets per second.
- Diego Barros
So what you're saying is that Rails really can't scale? ;)
- Diego Barros
Steve, I was just about to give up RSS for Twitter, but then a few weeks ago, you wrote that Twitter had peaked, so I decided to just wait until the next thing I'm supposed to give up for the next thing I'm supposed to trade it in for.
- Rex Hammock
for me Twitter supplements my RSS consumption but doesn't replace any of it. Twitter is more about discovery of things I wouldn't normally know about via RSS.
- Tac Anderson
I agree, it is more like mining for information on twitter.
- Drew Lucas
Don't have time for both RSS and Twitter so I focus on the current conversation over the archive.
- Jason Catena
Twitter & Hacker News have taken up most of frequent, distracted attention I used to spend on reading feeds. I still go back to feeds to do my deep reading tho
- Kingsley Joseph
I have to agree that RSS has fallen off my radar due to the time I put into Twitter and other Social Media tools (FF).
- John Flynn
I will never ditch RSS. It is too easy and great. I don't check as often as Twitter, but I can save posts and refer back to them when I need to. I can also easily find blogs there, rather than my bookmarks, which is flooded. Twitter is GREAT, but who knows if it will last? MySpace was great once, too. RSS is more stable than a social network, and easier to sort (no hashtags required).
- Angela Wilson
I wouldn't. For the Twitter and RSS have different uses. And I wouldn't spam the people that follow me at twitter with links to posts.
- Bibi
Not ditched, but Twitter's become my primary social RSS. They're different rabbits.
- phil baumann
two different things...two different uses. ;o)
- Rob Sellen :o)
i use friendfeed for both feedreading and twitterstream.
- lodro
I'm just cutting down on number of followers and feeds. Seems to help with managing information overload.
- Dave "Freedom 35"
Twitter is too ephemeral... would need some organization (folders/tags/saved-searches) and mark-as-read functionality at the very least for me to even consider it. RSS is essential to me for required reading and for discovery.
- LogEx
Not at all, if anything Twitter/Friendfeed etc has helped me find new RSS feeds to add.
- Adam Turetzky
That's like hiring the garbage company to DELIVER trash to your door.
- Rob Michael (Atmos Trio)
Twitter for Microblogs and Status Updates, Google Reader for regular blogs, Friendfeed for actual conversations!
- Dane Findley
Ditching RSS in lieu of Twitter?? What's next, ditching email for DM's? Not a smart move.
- Kevin Pruett
I think Kevin just summed it up nicely. I'll just add: The number of websites who provide real-time updates to Twitter is minuscule. When that changes, then we'll talk about swapping RSS for Twitter.
- Alexander Grundner
Nope, absolutely not. Twitter serves its purpose as microblogging and link sharing but RSS still has a purpose for me. Not everything I read is shared through Twitter (actually, I should hope not!). If I got all my news through Twitter, it would be more of an echo-chamber than it already is. Further more, I work in marketing. I use RSS to keep up with client industry news and to aggregate information. Twitter cannot do this for me.
- Violet Mae Lim
I got sick of reading long blog posts about the best way to develop software.... at least with twitter you get rid of long windedness. :)
- Paul Kinlan
i did not. and i won't you can't find in 140 char what a full page gives you
- Ouriel Ohayon
I've pushed most of my feeds to Twitter.For me, trying to keep up with RSS was like having another email inbox from hell. Now I catch what I can and let the rest pass over me. http://bit.ly/YQcK5
- Tech Introvert
...i've mostly ditched blogging for Twitter.
- .LAG liked that
I have ditched RSS for FriendFeed. I prefer the Real-Time Web. Welcome to the RTW!
- Dimitar Vesselinov
Everyone! Haven't you heard -- Twitter is dead. Oh wait. I'm confused. RSS is dead. Umm. Steve Gillmor? It's TechCrunch -- it's dead. That's right.
- Dave Winer
Feedly + Firefox really makes Google Reader useful, IMHO
- .LAG liked that
no way. though i have reduced the number of feeds i actively keep up with.
- coffee
++Lag. Love my Feedly plus FF/Twitter. I have cut down on feeds however.
- Bonnie Foster
I love my netnewswire. It's all the stuff I've personally asked for rather than the stuff others feel they need to throw at me.
- Josh Kinal
from twhirl
I'm still using my RSS readers a lot. Google Reader on line and Byline on the iPhone. Less "clicks" on the iPhone.
- Mike Beck
OK, so this post brought out mostly RSS lovers (which I remain). Yet why is it that some are now railing against RSS? Here's another thought RSS = a standard. We have no standards for status updates and thus Twitter and Facebook are in the driver's seat. RSS is final and stable.
- Steve Rubel
Nope. I see different uses in the different services. I like the organization of a reader. and I like your comment about the standards and stability and lack thereof on Twitter and FB. Also, I like to pick my news sources and trust that I am getting something accurate. SkyGrid is a nice combination of real fast / real time and reliable.
- Martha
On the contrary, besides using Twitter, I've added lots of RSS from Twitter to Google Reader.
- Mike Reynolds
My comment is a bit suggestive because of my work with Alltop. But even so, Twitter could not replace the gens I find via RSS too.
- L.P. NEENZ FALEAFINE
Sheri- Because people like to talk about this "king" "killing" that "king" and "destroying" this "queen" blah blah blah. ;) In my opinion, one new form of technology or communication doesn't always have to replace another.
- Violet Mae Lim
That question is ridiculous. RSS is far easier to manage and customize and can deliver a lot more information. Watching the interests of your social graph on Twitter is great, but far more and higher quality information can be consumed, (re)organized, and aggregated with a good RSS reader.
- David Chartier
I'm stuck between using FriendFeed and Google Reader but I defenetely like FF more than twitter for that function!
- Brian
from BuddyFeed
Still like both. With Twitter I feel like I keep up with individuals better, and catch new stuff earlier than I might anywhere else. Reader still gives me a ton of good reading from all the places I like best though ...
- Patrick Jordan
I still use RSS but more for reference. I get the link to the post in Twitter and then go look at the feed
- Janet Fouts
I'm still a fan of Netvibes, and I have not ditched RSS for Twitter, I've made some RSS out of Twitter searches, does that count?
- Albert Maruggi
FriendFeed replaced RSS for me a while ago.
- Thomas Hawk
Ditch RSS for Twitter? Never. RSS is the fuel for the real time web - they're complimentary products. http://bit.ly/10dkr8
- AJ Kohn
I will most likely not ditch ditch rss for twitter, both are good and valuable, but rss is useful since one can't always read it
- Justin Yost
The more interesting question may be how many have replaced RSS with FriendFeed...
- Josh Street
from twhirl
<sigh> I dunno. I see twitter as a subplot of FF and FF is also a subplot. Even slashdot used to be cool.
- Derek Lords
Haven't heard Slashdot mentioned in years
- Mike Reynolds
Ditching RSS for Twitter will work as the idea that people wouldn't look at paintings once photos came out
- shelisrael1
I think there is some confusion here. Are we talking about giving up on the technology that is called RSS, or are we simply talking about switching the platform on which we consume these ie. ditching google reader for friendfeed or twitter. Friendfeed lives on RSS feeds, the links you get on twitter most probably come straight out of someone's rss reader. The question is, if we ditch...
more...
- Kasper Sorensen
I discover more of value through friendfeed than twitter, really. But once I determine the long term value of a site it goes into my google reader, if it's Really important (i.e. top 10) it goes in my operamini feeds on my phone.
- guruvan (Rob Nelson)
it is like dithing your car for fishing: they are not the same. More precisely, Rss gives you focuses attention on the sources of information. Twitter gives you second hand check-it-outs that are possibly not so focused or accurate, but *seem* more urgent because they are in real time.
- Michele Costabile
I use RSS, don't like twitter, and seems no reason.
- yagami
How many of you have ditched bathing for Twitter - and if so why?
- Dave Winer
I ditched porn for Twitter since, you know, it makes so much sense to do so.
- Scott Jarkoff
I use both RSS and Twitter. I use Twitter more frequently though.
- Donelle
RSS is quite useful, both serve their own purpose
- Erik Magraken
this is BS, twitter can't and won't replace RSS, neither will friendfeed for that matter
- Dobromir Hadzhiev
Twitter gives me a portal to the author but won't replace RSS
- Joe Dawson
I increasingly use Twitter Search rather than Google Search or RSS to find cleantech news to blog about.
- Bob Morris (polizeros)
Nopes, Twitter has a long way to go before it replaces RSS. My days begins by reading 500 feeds, imagine how many tweets would I have to go through to get all those news!
- Rajtilak Bhattacharjee
Friendfeed can do that. Not twitter
- Rohit
from twhirl
For ordinary web users who are only interested in a handful of feeds, maybe 10 or 20 then twitter beats a feed reader hands down. Much simpler to use, easy to understand and real time. Plus twitter has the social media/communication features. However power users that are tracking 100 or more feeds need a reader for their research. The google reader / feedly combination is hard to beat for these people.
- Adrian
Google reader is evil and must be destroyed. Who has time to sift through 400 unread posts per day?
- Tech Introvert
How can Twitter replace a few decent RSS feeds? Not understanding the Twitter love...
- George Gray
I don't understand, RSS and Twitter are two different services. Have I missed something? :-)
- Kol Tregaskes
I spend time on Twitter where I would have otherwise been in Google Reader. It's easier to follow trending topics on Twitter.
- Peter Warnock
did a blog post a while back called 'my network is my search engine' but truth is, probably meant my 'network is one of my rss feeds' - not an either or proposition for me
- leigh himel
Many RSS feeds push their content thru Twitter, which makes Twitter a real-time RSS reader (that doesn't act like a horrific email inbox, ahem Google Reader). FF is an even better implementation of this, if only more sites pushed their feeds thru FF.
- Tech Introvert
No, they're two different use cases for me. Twitter is real time conversation. RSS is non-real time information.
- Ian Betteridge
What Ian said. IMHO, their strengths are so different it would be silly not to use both.
- Karen Mohler
If anything, Twitter points me towards more stuff to add to my RSS!
- Amie Gillingham
Yeah, what Ian said. I'd just get lost in the info if I got all RSS via Twitter.
- Julie Barrett
from twhirl
I am using RSS in FriendFeed. What I have ditched is Google Reader. RSS is underlying technology, not an application. We'll keep using that underlyng technology for a long time. We may ditch the readers, but not the RSS itself.
- Bora Zivkovic
I haven't ditched sourcing news via RSS for Twitter, but I have subscribed to more news via Twitter and find myself getting it more frequently on twitter.
- tekhelet
This isn't the right kind of debate. It's distracting from the fact that both are useful.
- William Mougayar
nope, not going to happen. A) twitter doesn't have all the blogs I read B)there's no good aggregation of blog notices - I can't come back 2 days later & find older content.
- clarke thomas
For Twitter? No, maybe for Friendfeed in some time.
- Diego Espinoza V.
Because I got the gist of the post and a quick link in the same stream. No more reader for over 12 months
- derek
Traditional RSS readers are even more boring than Facebook. Stopped using them a long time ago. I do consume RSS feeds still in FriendFeed but though a socially filtered lifestyle.
- Thomas Hawk
I have pretty much ditched RSS for FriendFeed. I use Twitter also.
- Bill Romanos
for must part..BUT subscribing via RSS to derivations from Twitter can be useful, for example, I subscribe via RSS to http://www.whatthetrend.com/ . It gives me the day's trends PLUS explanations as to why which is key. Extremely useful to go through just in case I missed something during the day.
- Mike Bracco
your followings are your feed source - Human Syndication. spending most of your time on Twitter, you dont have time to switch to RSS. Also, with RSS feeds coming from media companies, news may not break as quickly with human syndication which Twitter provides. With RSS feeds coming from Blogs, the news will have broken out on Twitter prior to that blogger's RSS feed hitting you somehow...
more...
- iTbay
No. RSS still has a place on my computer (or at least in my web browser). I prefer it for it's easy-to-read aspect and it's speed (Google Reader is awesome). Twitter is for discovery, as is friendfeed.
- Amy H.
RSS bankrupcy. Hundreds of blogs unread. By reading Twitter only on the web and not on the phone, and using Twitter search, I get what I get. The rest finds its way, so I don't have to pile up enormous wads of reading in my Google reader. RSS is still absolutely vital, however, for those who block you on Twitter. You search their name, RSS the search results, read them on Google. My new Google read attention space is the ppl like @ajkeen who have blocked me on Twitter.
- Prokofy Neva
I subscribe to Twitter hash-tag and keyword searches via RSS and read them in Google Reader. I see the them as complimentary.
- Mike Boudreaux
I usually have Google Reader/feedly & TweetDeck open at the same time.
- Jason R. Hunter
Hundreds of RSS feeds and no time to consume; Twitter better fits my lifestyle. Plus, the community that surrounds me shares very similar interests, so I can count on useful info from them.
- Paul Chaney
"Having RSS feed" =/= "using Twitter", so I read the RSS of a lot of sites every day via NetNewsWire.
- Rick Cogley
I use RSS to read Twitter (meaning) I can follow some people on Twitter via Google RSS reader (without really following them). Does that make sense?
- Doug Vos
"Spedr" is the best for me. It's a very useful Firefox add-on. You don't even need to go the the website page to shorten urls. It's a 1-click-application.
- Smeerch
I've found tr.im pretty good, as of late.
- Tyson Key
bit.ly has to get the nod, not just for the click thrus but the twitter/FF conversation tracking and other nifty info http://bit.ly/info/YcN6 _ I do have to say they could make their click-thru graph a little easier to read/use...
- Scott Lockhart
I'm very partial to my service called Cligs ( http://cli.gs/ ). It has very deep analytics, social media monitoring (Twitter, Friendfeed, blogs, blog comments, delicious, etc), and also geotargeting of the destination (only service that does this).
- Pierre
Cli.gs is No. 1, followed closely by BudURL and idek. Just how many of these URL-shortening sites are there? I'd like to use 'em ALL!! :) I use TinyURL, Cli.gs, BudURL, idek, Snipr, bit.ly, is.gd, TweetBurner (Twurl.nl) and Twirl.at.
- J. D. Ebberly
Why not roll your own URL Shortener with Shorty: get-shorty.com - you can see my self-made one at cnvg.us
- Roger @ CineVegas
bit.ly with a hat tip to @davewiner for first suggesting it vs other options. However, I still use tinyurl.com from time to time.
- Dave Martin
I use is.gd for two reasons: It's 5 characters long (tinyurl.com is 11) and it's the default for TweetDeck (which keeps resetting it to is.gd whenever I launch it).
- Chris, Taskerrific Guy
I use tinyurl and it works good enough that I aint making time to try anything else... Sometimes good enough is good enough.
- Cody Heitschmidt
No one sheds a tear for the early ones with long names like tinyurl.com. tr.im and bit.ly are both great. "adjinx" sucks, because they insert ads right on top the destination site.
- randulo
If you want to make a short Amazon link or eBay link on the fly, I have LinkFeed.com just add the ASIN for Amazon or the Item ID for eBay (you can also use a search term) http://linkfeed.com/am?moose or http://linkfeed.com/ebay?moose This works well when you are typing in a IM or similar and just don't want to go to the site to make your short url.
- RAD Moose
tr.im is one character short, so it gets my tweet vote for url shrinking
- Ernie Oporto
I find tinyurl is good for preview feature. It helps prevent unwanted redirection!
- Paul
is.gd has that as well, just add a - to the end of the URL (that is one feature that I really like due to the amount of abuse of short URL services.)
- RAD Moose
Robert, I'm a huge fan of Cli.gs. Its free, has metrics, hits by date, country, referer statistics, if a search bot found your URL, when your URL gets RT, or on FF. When the destination URL is on Delicious. Plus one URL can redirect to a different page according to country IP. http://cli.gs/jcf
- Julio F ~ @SocialJulio
thanks louis i hope to eventually figure it all out.
- Om Malik
Om: make sure you check out the FriendFeed bookmarklet... makes it easy to "feed the FriendFeed" from your browser. (if you haven't already) also enables adding graphics to your FF links.
- dave mcclure
Jason, Vinko - agreed. It's a single feature app, but does it's one thing so well and feels good to use.
- Micah Wittman
Feature design is simple and perfect. The "click on the applet to start" quirk cramps the style a bit (although people are used to this from flash apps). A way around it is to show some intro text and an "ok" button to dismiss it :) For example: http://zzzen.com/police05.swf (an ancient flash 4 app, but the principle is the same)
- ĎÚβĨŐÚŚ Dod
Shame it needs Java. I can't stand having the Java VM running and ruining my browsing.
- Pierre
He runs O'Reilly publishing which does tons of geek books, tons of conferences from the Web 2.0 Summit to Maker Faire, and lots more. His blog is here: http://radar.oreilly.com/tim/
- Robert Scoble
Ask him what we had before Web 2.0. Was it like, 1.9.3? How much of an upgrade was made? I guess that's three questions....
- Mike Shields
What comes after Web 2.0? Or to rephrase, What is Web 3.0?
- Pierre
Mike, I can answer that without asking him. The first web, from 1994 through about 2000, was about getting yourself or your company onto the Web. Getting a URL. Making a page, or a set of pages. Being presentable. The second web, from 2000, through today, was about adding people and interactivity to those sites. The third web, which started in 2006, is about getting rid of the page all together. Mashups. Live web, like on FriendFeed or TwitterVision.com, and symantec web.
- Robert Scoble
Is the future here yet, or does it remain unevenly distributed? i.e. will some get Web 3.0 while others are still on Web 1.0? If so, what effect will that have? Okay that's three questions, too.
- Donald H Taylor
Spencer: sounds good. Web 2.0, for me, was about adding people and interactivity to web pages. That's HUGE for business. Who wants to do business with a faceless corporation? And who wants to have to refresh their web pages to fill out forms and get information?
- Robert Scoble
Good idea. Could you ask him: - His predictions for 2009; what´s his top 3 of new developments, new growth areas and failures the followiung year - Will he deliver an iPhone App with access to all books, or, maybe even better, give the iPhone App Stanza access to all his books ? If not, why not ? - Does he think there room between Twitter and Friendfeed for a, say, easier, more...
more...
- peter huesken
When will "web 3.0" come? What is significant for this new phase? Could it be the third "monitor"? 1st TV, 2nd computer, 3rd mobile with camera so you could take photos of tags and always be ready to get information through GPS and other features.
- Martin Lindeskog
Robert I have to disagree, I think mashups including Friendfeed are still part of Web 2.0 or maybe 2.x. Increased user involvement, community driven websites, and a mix of services are still characteristics of Web 2.0. Web 3.0 will be a much bigger step forward.
- Bhavishya Kanjhan
Martin: the third wave has already started, but we'll definitely talk about what's happening now. Certainly mobile fits into that. Location awareness. Presence and status awareness. Real-time web. Video. And mashups (there's a new service/tool coming Monday that's pretty wild, by the way).
- Robert Scoble
How will the Web evolve to help us better filter useful information from the information overload currently on the internet? Search? Social Media? Something else?
- Dobes Vandermeer
Web 2.0 has become a revolution - it would be great to know if user generated content will improve in quality and credibility as more people take to it, or will the quality drop?
- Harish
Bhavishya: hmm, well, here's where we get into trouble with using version numbers. One wave morphs into the next wave, it isn't a binary thing (it doesn't just "appear" one day). The mashups I'm seeing coming next year are quite wild and aren't ANYTHING like what we were thinking about when people started talking about Web 2.0.
- Robert Scoble
Harish: good question. I see the quality of user generated content increasing a lot once you can see some social capital behind the participation. Ask yourself, why is the participation here on FriendFeed so good? My answer: because there are very real social consequences for being an asshole here.
- Robert Scoble
What business idea does Tim think would be a good web start up in a recession?
- Kevin
i'd actually like to talk about web2.5--the innovations and corrections/tuning on 2.0 laying the groundwork for 3.0. and are we there?
- mark silva
What are Tim's thoughts on Enterprise 2.0? Will it be as big as Web 2.0? Rationale? (This question is valid for Tim because E2.0 was derived from W2.0)
- Chintan Zaveri
Spencer: I see smartphones drastically reducing the cost of getting information. This certainly will be true of the third world which doesn't have good computing infrastructure, but where tons of people have cell phones.
- Robert Scoble
What could be the impact of the Obama administration on the web? Will the economic conditions change fundamentally? And - maybe a default subject - has he some advice for the newspaper industry? - After all he is a successful print and web publisher.
- Heinz Wittenbrink
from twhirl
Kevin, Chintan: good questions. It's interesting that I got to know Tim during the last downturn.
- Robert Scoble
Well what about privacy? You talk about location awareness, status awareness, data being moved around in mashups, etc.
- Pierre
hey robert, thought it was interesting how guy kawasaki promoted twitter--even more than his book or alltop--in your recent interview. can we learn what o'reilly's hot about (he posted recently about ceo tweeting, for instance, but what else?) and what he prefers, friendfeed or twitter.
- mark silva
Pierre: awesome question too, but we all know privacy is dead. Want to see my medical records or credit card statement? We're getting pretty close to sharing even those things because there's some value that comes back to us if we do (ala mint.com or google's health services).
- Robert Scoble
mark: Tim is a Twitter guy. I rarely see him show up here on FriendFeed. We will definitely talk about microblogging and the real-time web.
- Robert Scoble
In the thinking stages, did he imagine Web 2.0 would evolve in the way that it has? If so, is he happy with the progress? What would he have changed?
- Shevonne
Ask him about XBRL. It was mandated by the SEC this week. What does it mean. Is he interested. He'll have an interesting viewpoint, I'm sure.
- Dominic Jones
from twhirl
The question that I would like to ask would be if Web 1.0 was representative of a technological shift, and Web 2.0 was representative of a social shift, what revolutionary change will instigate the next big shift on the Internet? Place of interaction perhaps?
- TheLovableRogue
I think you should ask, How does Web 3.0 enhances Web 2.0?
- Michael Fidler
from twhirl
Dominic: this is why I ask you all for feedback on interviews. I would never have thought to ask about XBRL. Thanks!
- Robert Scoble
Robert - this (pre-interview brainstorming) is a great idea , which I shamelessly plan to steal and reuse myself.
- Donald H Taylor
If it'll be 3.0, don't look at me, anyway what'll be paper 2.0 and tv 2.0? Thanks
- Daniele Beta
Ask about Kindle ebook platform. Ask about ebooks overall as well.
- Mark Rauterkus
Ask about costs. Costs of paper, production, shipping, HR, research, time, returns, damaged goods, and other 'sinks.' How are they being avoided / reduced.
- Mark Rauterkus
Robert you can ask him how the symantec web is going to influence the search engine economy? Do we have to redefine the term "web search" for web 3.0? Are the huge companies like Google, Yahoo etc ready for the symantec web or for the next generation of the web overall?
- Kivanc Toker
Ask him about istant web evolution and less great content published? I mean short content versus long old blog post !
- Christian
Suggestions to counter "Information overwhelming" on Web, Next era of filters, tools, techs capable to summarize loads of information adapting user preferences likes/dislikes from activity streams.
- Ali Sohani
Given the recession at hand, how can Web 2.0+ and beyond help people and enterprises to reduce costs?
- Neill Adamson
When will Enterprise 2.0 and Web 2.0 merge, when the business world "becomes one" with the consumer world through onlince social tools?
- Zach Berg
Ok, then who decided what you state above? Did he also come up with 3.0? Your answer is generating more questions, and I'd like to hear his answers to the first ones, actually....
- Mike Shields
does he regret coming up with that term? and the what is next? surely not 3.0 maybe web 2.1 beta :p
- Darren Stuart
Some random questions: - SaaS or Open Source? - According to Tim, which are the top 10 Web 2.0 technologies (Microblogging, Mashups, Blogs, Wikis, RSS, ... ) suitable for adoption in an organization for improving their capability - Open Source companies will earn "significantly" better revenues in 2009 than 2008. True or False? - Thoughts on Social Media versus Knowledge Management
- Chintan Zaveri
I tweeted him a question about preservation and the fact that little of the Web 2.0 world is being preserved. Are we moving through a historical black hole when no one will be able to follow some important thinkers because all that they wrote from 1997-2008 will be lost?
- Todd Carpenter
Another question related to "information overload" (and not to get too geeky for NPR, but): What are his thoughts about the future of semantics on the web and could that be the next gen on the internet?
- Todd Carpenter
Todd: that's a real problem, the first two years of my blog are gone. But even worse is that Twitter is a black hole. Quick, pull out all conversations about the Chinese Earthquake that happened in the first three hours after the earthquake happened. You can't. That's even worse. The data is there, we can't get to it.
- Robert Scoble
Ask him about consolidation. People generally use a wide variety of different web sites for different purposes (google/wikipedia/flickr/FB/amazon/etc) , each with its own user interface and idiosyncrasies. Does the fact that information should flow more freely in the future mean that we may see the birth of mega sites, which aggregate all this data, and allow much higher levels of interoperability and integration. Thanks
- David Semeria
Robert: If the data is there it's just an issue of focus and worry about scale. If the data is replicated and caches (shouldn't change right :) ) all would be well just takes dev time which they don't have.
- Ben Hedrington
They should contribute all old tweets to Archive.org! Now that's an idea. It's history right?
- Ben Hedrington
Where does Assurance and Permanence live in this model. I built iForem to capture source + object to be saved for generations. The core is a legal trust that will insure the commodity services of the net will be supplied and the service maintained, Without some trust or real sustainable archive what good is much of the content we create for ourselves or others. Where is a TRUE digital time capsule so to speak?
- stephen pieraldi
Ask him if he found a service for website referral analytics? If yes...which and why he chose that?
- Andrea Vascellari
Ask him about the Safari books service. Any plans to make the site truly iPhone capable (a better mobile version of the site)? Right now the iPhone app is just a glorified PDF viewer.
- Shazron Abdullah
Ask him how he thinks history would have been different if Hitler and Mother Theresa had lived in a time of facebook/twitter/friendfeed.
- Tim Connors
I'm pretty sure it wasn't Tim O'Reilly who coined the term "web 2.0", but Dale Dougherty - albeit while in conversation with O'Reilly. http://www.oreillynet.com/pub...
- carl morris
The original Google datacenter in '99 :)
- Paul Buchheit
One of the consequences of factoring in component failure in your every move: you can save the cases, stuff's going to break anyway ;)
- Mustafa K. Isik
This design turned out to be somewhat nightmarish. It was eventually cleaned up (we had a "cabling fest") and by now the designs are quite slick, though still very unconventional. I wish Google would publish more about their hardware, because it's very interesting.
- Paul Buchheit
WHEN CABLES GO BAD! I used to have a similar problem and the only way to trace cables was to put a small binder clip over the wire and push it along.
- Stephen Pierzchala
Cables Gone Wild! woo hoo! gees that is bad. Paul YES I too wish Google published their IT Infrastructure / hardware info
- Susan Beebe
pretty sure their current IT infrastructure involves genetically-modified human brains soaking in some kind of nutrient bath.
- Karim
BTW, I believe this is the same generation of hardware found in the Computer History Museum (they have the jj rack, as I recall).
- Paul Buchheit
Paul: I've been inside a Google datacenter. They are a thing of beauty now. I've always wanted to interview the team that is responsible for doing those and get some video.
- Robert Scoble
That's how it would look if it was set up at my house.
- Gabe
I worked in a server room that look like that too - all those spagetti cabling craziness.
- imabonehead
Robert - YES do video interview with Google DC Infrastructure brains! :)
- Susan Beebe
How long would it take to fix if you pulled out just one cable?Or plugged it into the wrong socket?
- Alistair (alpinefolk)
Here are some pics of a datacenter I put together for a client back in 2003 with some pretty insane cabling. With this much cabling, it was too hard to manage without automation. So I built some tools that allowed me to plan for rapid growth (i.e 20 server SAN jumped to 120+ while we were building out) http://bit.ly/9Q7O
- Jauder Ho
Grunt: OK boss, I've got a new cable crimped. Where do you want it? Boss: Server 99,9999 port 1. See it? I'll see you in a week. Grunt: &^*
- Shane
"Employees dismantling sections of Google's original data center discovered the decaying corpse of an engineer tangled in a web of network patch cables, police reported today. The mostly-skeletal remains have not been conclusively identified, though the victim appeared to have been wearing a 'Banyan Vines' t-shirt. While forensic tests have yet to be completed, the County Medical Examiner has estimated the date of death to be 'sometime around the 1999, 2000 timeframe.'"
- Karim
"A police spokeperson said foul play was not suspected, adding, 'Unfortunately, this is not the first time we've seen this. The Internet was growing so rapidly back then, these things just happened. Someone goes in to work on a patch panel, and they get tangled up. It's sad. And I don't blame Google for not noticing -- their headcount was growing rapidly too. One or two engineers go missing, nobody notices. I bet the poor bastard is still getting direct deposit on his paychecks.'"
- Karim
A spokesperson for Google referred to the grisly discovery as "a regrettable loss, but not a single point of failure," and added that engineers are currently required to use "the buddy system" to work in pairs when cabling servers.
- Karim
Most datacenters I've ever been in don't allow photography. The exception was the Stanford Linear Accelerator data center that Scoble got me into: http://www.flickr.com/photos...
- Thomas Hawk
AJ, we're trying to avoid spending too much money, so our datacenter pictures would be a lot less interesting than Google's. Here's a photo of one of our servers though: http://friendfeed.com/e...
- Paul Buchheit
One of the walls (supposedly the one they began with) at eBay's datacenter in Sunnyvale looked very much the same about 5 years ago.
- earlyadopter
CoreFTP LE is free and also offers drag and drop capabilities. I stopped using it after I discovered FileZilla. http://www.coreftp.com
- Manasseh Lee
from twhirl
Mac - CyberDuck. Recently started using this after going back to give it another go and it does everything i want it to do (mainly PRET). I bought Captain FTP as it could do PRET and its shit, crashed after every transfer, froze up, just all round bad. Not worth the money i bought it for.
- Simon Wicks
If only Flash FXP was on OS X, i loved that for FTP when i was on the dark side.
- Simon Wicks
Paul, yes, but they have other ways to find funding with captive customers
- Loic Le Meur
Or the classic, "running a startup is like jumping out of a window and hoping you finish putting together your parachute before you hit the ground"
- Rod Bauer
Running a startup is like flying upside down and feeling the terrain by the bumping on your head.
- Denny K Miu
Paul, well that certainly makes the term "bailout" more concrete for me.
- Victor Ganata
good to see some of you still read me / interact on FF.
- Loic Le Meur
from twhirl
"No download required (works in the browser). Compatible with Windows, Mac OS X, Linux. Embed them on blogs/webpages or send them by email."
- CannonGod
from Bookmarklet
-- They're in private beta at the moment, but having this over a service like Jing (http://www.jingproject.com/) which requires running an app from the desktop is definitely a plus :¬)
- CannonGod
Disclosure: This is *my* small project, but of course i'm hoping that will mean you show it more love! :) We're going into private beta next week, invite code for my friendfeeders is funnily enough: "friendfeeders". PS. If you think you're tweet buddies would be interested, pls tweet away. Cheers!
- Zee.
wow guys, I post this and come back a few minutes later and what a response! Thankyou. Richard, not sure am out of office right now -on iphone- will check when I'm back.
- Zee.
Signed up and bookmarked. Thanks, Zee : )
- LouCypher
Tweet on this one and signed up. Zee, will there will some sort of integration with this room? Perhaps that can serve as part of the recommendation system?
- Jonathan Kong
Jonathan - thank you, just saw the tweet :) Regarding integration, it wasn't the initial plan but yeah no doubt it could be a potential feature for the future.
- Zee.
"Map My Tracks is the easy way to accurately track, or share in real-time, your sporting activity over land, sea or air using your mobile cell phone and GPS."
- Kerem Ozkan
Looks really good. Might be the way to get a technophile to do some exercise :)
- Pierre
I'm wondering about pairing this with a photography habit. Can it export a standard NMEA file to use with other software? That'd be nice.
- Jordan Hofker
i've just tried both and the reason why i currently prefer cligs is because you can see where the hits came from which unfortunately you can't do with Tweetburner yet - unless i'm missing something?
- Zee.
@Marcel but i can't see who clicked it & from which site - right?
- Zee.
You could have mention my post... I'm the one that posted about them (this is what I don't like about Friendfeed - no credit what so ever)
- Orli Yakuel
Orli, take it easy - I forgot to mention you...I normally always do & thought I had in this case, my apologies. If you look at other things i've found via you, i have always put your name there.
- Zee.
All it would have taken was a polite request to always make sure people link back to you (which in my case i normally do)...but instead you go on the attack from the start. So yeah, "take it easy" seems appropriate.
- Zee.
that's really interesting Marcel - no i didn't have that...I'll try resharing somethign again via there because that's exactly what i was looking for. Also Marcel, my apologies, i had to remove your comment from above so I could mention @Orli in this share...if you could edit your comment above to include the link again that would be great. Again, my apologies.
- Zee.
from fftogo
Owner of Cligs here. Thanks for the mention Zee. Glad you like it. Please let me know if you have feature requests - very happy to oblige!
- Pierre
hey there Pierre, thanks for stopping by! Great service you got there...I'm sure we'll all put our thinking hat on regarding features. The main one that comes to mind is a slicker bookmarklet, which doesn't open a new tab/window...similar to bit.ly's . One question if you don't mind, should I assume that the majority of 'no-referers' are desktop apps?
- Zee.
There is a FF extension in the works. If anyone is good at developing extensions *PLEASE* contact me at http://blog.cli.gs/contact . I'm swamped developing the app.
- Pierre
Forgot to add, the no referrers are bots + desktop apps. I've been tracking this since launch and there is a post coming about it.
- Pierre