Sign in or Join FriendFeed
FriendFeed is the easiest way to share online. Learn more »

Joe Beda () › Comments

Tudor Bosman
FreeBSD / ZFS box is up!
Screen shot 2009-12-05 at 4.03.06 PM.png
Now installing Samba and MediaTomb. - Tudor Bosman
Yay! Now clean up the office. :) - Jeanette Bosman
I'm doing the same thing this weekend. - Scott Ludwig
Does it have a time-slider equivalent? The integration into nautilus is a nice touch in opensolaris. - Eric Borisch
s/MediaTomb/Firefly/ as I wanted something that iTunes recognizes. - Tudor Bosman
8.94T: 5 * 2TB drives (- 40GB reserved for the root fs), raidz1. - Tudor Bosman
@Tudor What is Firefly? Got a link? - EricaJoy
http://www.fireflymediaserver.org/ although the site seems down at the moment. Search for "Firefly media server" (formerly known as mt-daapd) - Tudor Bosman
sweeet - Logan Lindquist
Also, I love the FreeBSD ports collection (which Gentoo tried to imitate). cd /usr/ports/devel/git; make install will fetch git, build it, and install it, and automatically deal with any dependencies as they arrive. - Tudor Bosman
Another option is pkg_add -r git which will install a binary package compiled with default options, and resolve dependencies. - Scott Ludwig from iPhone
Okay, nested dependencies work just fine until you find a package that depends on TeX. Why does my little storage box need latex and amstex and mkfontdir and dvips and...? - Tudor Bosman
Because you need PDFs of the documentation, of course! - Eric Borisch
In many languages, apparently. /usr/ports/print/latex-cjk/scripts/installt1enc.sh arb5sung arb5sung.ttf Bg5 Generating Type 1 subfonts arb5sung from arb5sung.ttf [Bg5 planes: 1-55]: - Tudor Bosman
This is apparently all caused by updating the freebsd-doc-en package, which regenerates all forms of documentation from scratch. - Tudor Bosman
One of my disks appears bad, hopefully it's the cable.ad8: FAILURE - READ_DMA48 timed out LBA=766744255 - Tudor Bosman
Yep, RMAing now. - Tudor Bosman
Two more disks are showing read errors, including the boot disk. This is not good at all. Maybe WD actually qualifies RAID-level drives, and rebrands the crappy ones (with bad sectors which auto-remap) as consumer-level. With auto-remapping turned off, errors start creeping in within days. - Tudor Bosman
I'll investigate this more, of course, by mounting the bad disks into a different machine and looking at SMART output, but so far it smells of a bad batch of drives. - Tudor Bosman
How hot are they getting? (It's in the SMART data) ... We had a fan go out on a drive tower (and the 'dead fan' alarm didn't sound -- wonderful) and we smoked at least three drives before figuring out what was going on. - Eric Borisch
Eric: While trying to stress the disks with a few dd commands running in parallel, I can't get them to heat up above 26 degrees Celsius. I'd say that cooling inside my box works well. The two newly failed disks have 5 UNCorrectable sectors each -- and that's just because the SMART buffer only remembers the last 5 errors. - Tudor Bosman
Maybe I just got a bad batch, but at this point I would recommend against using WD20EADS drives for anything. - Tudor Bosman
yeah, the EADS aren't so good. The ABYS series have been super reliable in comparison, but I don't think they go up to that many TB. - Private Sanjeev
incidentally the drives are physically different (the mechanicals are more vibration-resistant on enterprise drives), so WD doesn't just rebrand flaky drives. - Private Sanjeev
Any opinions on the new, 4-platter WD RE4 RAID edition drives? They're 2TB, expensive as hell, but there may be deals to be had. Alternatively, the Seagate Barracuda XT 2TB. - Tudor Bosman
I have a bunch of EADS drives (4x1TB, 4x1.5TB) and I haven't seen any problems. Might just be a bad batch. - Joe Beda ()
Currently leading the pack: Hitachi 7K2000. - Tudor Bosman
I only have experience with ABYS and EADS in production :(. - Private Sanjeev
I have 24 A7K1000s that have been going great for over a year. (Knocks on wood) - Eric Borisch
Okay, I ordered 5 7K2000s. Let's see how this goes. - Tudor Bosman
The box is back up with the 5 Hitachi 7K2000 drives. I copied all the data over again, and "zpool scrub" now completes without errors. I'll update this post after 2 or 3 days of burn-in. - Tudor Bosman
Hint: Read the man page. The "--batch" option to portupgrade is supremely useful. portupgrade -vaP --batch: upgrade all installed FreeBSD packages, prefer to use precompiled packages if available (-P), don't ask questions (use default configuration options). - Tudor Bosman
A few scrubs later, still zero errors, and normal smartctl output. I now deem the box ready for production use (that is, the main storage device in the Bosman household). - Tudor Bosman
Does anybody sell a BSD/ZFS raid box that is all ready to go? - Peng-Toh
For small boxes, you could consider a self-contained box like a MSI Wind PC ($139). - Scott Ludwig from iPhone
I mean something that comes with all software (BSD/ZFS) installed, an UI and no "hacking" required. Something for a non-techie. - Peng-Toh
my EADS results: 2/6 failed so far (free RMA replacement). no data loss though. - Michael Herf
Tudor: FWIW, random activity is much more stressful (and power consuming = heat producing) than the contiguous reads/writes you get from dd. Try bonnie++ or iozone if you'd like to really hit the system. Glad to hear you're up and running - ZFS is fantastic stuff. - Eric Borisch
Michael: Yes, I had 3 out of 5 EADS drives fail within a week. I returned all 5 and got Hitachi 7K2000. - Tudor Bosman
Peng-Toh: There's FreeNAS, http://freenas.org/, but I'd wait until they upgrade to FreeBSD 8, probably in a couple of months (the FreeBSD folks didn't consider ZFS to be production quality until FreeBSD 8.0). - Tudor Bosman
Kevin Fox
Put me down as on the Avatar train. Saw it last night in Real3D and it was fantastic. There was even more depth to the metaphoric levels then there was to the screen. Seeing it in IMAX 3D over Christmas.
Me too. Tickets purchased. - Scott Ludwig from iPhone
Seeing it in IMAX 3D tomorrow. I've read no full reviews and I'm going in with low expectations on all fronts except the technical one which is the ONLY reason why I'm going to begin with. Well, that, and the fact that friends of mine did all of the legwork getting tickets and whatnot. - Akiva Moskovitz
Akiva's stepping out, yo! - Josh Haley
if kevin is on the train all of a sudden ... I'm curious. - karl dotter
Akiva, I think you'll like it for more than just the special effects. I liked the plot and acting as well. - FF's Bubba of Arizona
It's partially on purpose. The lower my expectations, the more likely I am to be surprised and impressed by the film. - Akiva Moskovitz
I saw IMAX 3d on friday and it was awesome. I'd love to see it again sometime soon but I'm not sure when we can sneak out. - Joe Beda () from iPhone
can anyone convince me further?, this is what I've been told from the amazing nate beaty: "if you love mega-cgi, hamfisted, 3-Dee, thinly-veiled native american allegory, cardboard-character driven ecodrama and purple glitterskinned 12-foot amazon catwomen who connect their ponytails to fly giant poly-eyed fantasy birdbeasts, then fall in love with 'murican soldiers with "curiously active brains" in a $500m bluescreen hollywood earth++." - karl dotter
hey, I was just trying to help lower your expectations. the fx are fantastic but I'm spoiled by Pixar in expecting an amazing story to connect to also. - nate beaty from iPhone
Gary Burd
Lightroom -> Export to File -> Picasa Web Album Uploader: Image date set to export time. Wrong! Lightroom -> Export to File -> Import to iPhoto -> Picasa Web Export Plugin: Image date set to capture time.
Is there an easier way to get PicasaWeb to use the capture time, or should I just use Smugmug? - Gary Burd
Changing EXIF with PIL is pretty easy. - Scott Ludwig
I was hoping that I didn't need to write a program to get the correct dates to appear in Picasweb. - Gary Burd
There is Jeffrey Friedl's exporter plugins that can upload to picasaweb or smugmug directly. They seem to work well and are worth registering. - Joe Beda () from iPhone
The date is set to the current date with Jeffrey Friedl's exporter plugin. I worked around the problem by setting the file modification date to the exif capture date and uploading with the Picasweb Uploader. - Gary Burd
Joe Beda ()
Hey Bicyclists -- I'll start sharing the road when you start respecting the law. A stop sign is still a stop sign dumbass!
I saw a motorist do something illegal once, ergo I don't have to obey traffic laws either? - Sean O'Connor
+1 to Sean :( - Katya Rogers
I apply this on a case by case basis based on the actions of that bicyclist. Volations are met by frustration on my part and perhaps some unwanted advice given through a rolled down window. I haven't run anyone over -- yet. - Joe Beda () from iPhone
Why can't we all just get along!? - Moishe Lettvin
IIRC there is one state in the US where a Stop sign is not a Stop sign for cyclists. I can't remember which one it is now. I'll have a search and edit this comment when I find it. IIRC, for cyclists, the Stop sign was more of a Yield sign i.e. if there is nothing coming then no need to come to a complete stop [losing momentum etc] - 1x29
I see a lot more bicyclists cruise through stop signs than I see cars run stop signs. In my neighborhood, it's a rare day that I see a bicyclist ever stop at a stop sign, in fact - Rochelle
Don't get me wrong, I think traffic laws should be enforced on all users of the road. But I am amused at how people become incensed when they notice (after the fact – typically they are unaffected) that a cyclist, previously invisible to the motorist, has squeaked through an intersection, split the lane, or done something else that the motorist wasn't able to do. I'm not attributing that to Joe's situation, and I'm not advocating obnoxious behavior by cyclists. - Sean O'Connor
This particular stop sign was on the Burke-Gilman trail. It is a stop sign actually *on* a bike trail. Here is the intersection: http://maps.google.com/maps... - Joe Beda ()
Is a Stop sign as enforceable (by law) on a bike trail as it would be a public highway? [being UK based, I have no knowledge of the local laws]. - 1x29
The Stop sign on the google map also looks to be positioned for traffic on the road as opposed to the trail crossing the road (if indeed I'm interpreting the image correctly) [although, I have now spotted one further ahead on the right hand side too]. - 1x29
There is a stop sign on the trail and another on the road. I stopped on the road and was starting to go when the bicyclist blew the stop sign on the trail and darted out in front of me. Ah well, at least no one got hurt by his asshatery. - Joe Beda ()
Kevin Fox
Photos of Amazon.com fulfillment center | Doobybrain.com - http://www.doobybrain.com/2009...
Photos of Amazon.com fulfillment center | Doobybrain.com
Show all
It's like Costco, but more awesome! - Kevin Fox from Bookmarklet
awesome... that's where the stuff comes from !!! - Harold
one of these just a few miles from my house. one. bug. giant. box. of. stuff. - MikeAmundsen
Dang. - Derrick
So amazing. There's one in Plainfield, IN, near where Harold used to live, too. - Kamilah Gill
Reminds me of the ending sequence from Indiana Jones. - Hayes Haugen
"Top... men..." - Gabe
I think I see my package! - Joe Beda () from iPhone
oh sweet, loverly books that make me so happy and content. <sigh> - Felicia Yue
Sch-WINGGGG!!! - Ladybug Heather
Where's the Twilight warehouse? That warehouse doesn't look big enough to hold all the Twilight books that must be ordered. - Matt Cutts
Matt, I think they drop-ship those directly from the Twilight-HarryPotter fulfillment moonlet. - Kevin Fox
lol Kevin - Kamilah Gill
oh wao.... #amazon fulfillment - Yann Ropars
We have top men working on it...Top....men!!! - WorldofHiglet
Oh - gabe beat me to it :) - WorldofHiglet
So two-dimensional. Look at all that third dimension simply going to waste! - Tim Tyler
ahem... top men as storage sorters... you have nothing else for them to do? - A.T.
An organized mess - Josh Haley
Hard to believe that we actually get things so quickly! - Sheila Taylor
Thinking about it - do you think the TARDIS has a room like this in it somewhere? - WorldofHiglet
I'm glad all that stuff is there, that is all of my Christmas presents that now need to be delivered... - amelia arapoff
Gary Burd
I am putting phone purchase decisions on hold. Waiting to see the gphone.
Not related to anything: do you want to do lunch soon? - Joe Beda () from Android
DeWitt Clinton
You can't spell _XSLT in a Nutshell_ without "nuts".
Or "hell". - DeWitt Clinton
C'mon -- XSLT isn't that bad. I've used it for C++ code generation in the past. ;) Now that I think about it, I was the only one that could modify the templates and the next person rewrote it, but... - Joe Beda ()
XSLT makes the simple things impossible and the difficult things improbable. - DeWitt Clinton
XSLT is almost a functional language, and has as many occurrences of <xsl:template> as Lisp would have of open parentheses. - Tudor Bosman
Makes sense as it is the stepchild of DSSSL :) - Ray Cromwell
Need more http://www.w3.org/TR...! I've used XSLT in a past life for transforming XML data into a presentation format, which was pretty nice, except that in this case the original authors were not able to express everything they needed in a purely functional way so they mixed in a bunch of calls out to JScript with the transform. Made the whole thing an ungodly mess - hence hiring some people to try to clean it up. - James R
XSLT > awk? - Peng-Toh
Peng-Toh: even that is debatable. - Tudor Bosman
Michael Herf
Please stay away from OpenSolaris 128a. My machine isn't booting after trying to migrate to a de-dup'd pool.
I'm sorry to hear that. I'm glad that I avoided it. I don't need deduping that bad! - Joe Beda ()
Booting again, but stuck at "Reading ZFS Config: *" - hope this resolves itself. - Michael Herf
Yuck! - Scott Ludwig from iPhone
I'm doing exactly this (zpool import after clearing the zfs cache): http://www.mail-archive.com/zfs-dis... - wish me luck in a few days. :) - Michael Herf
All ok now: the zpool import completed after a bunch of hours staring at the screen. Everything's back to normal. Advice: don't "zfs destroy" and reboot right after. - Michael Herf
Kevin Fox
U.S. Helps Frequent Fliers Make a Mint - http://online.wsj.com/article...
U.S. Helps Frequent Fliers Make a Mint
"At least several hundred mile-junkies discovered that a free shipping offer on presidential and Native American $1 coins, sold at face value by the U.S. Mint, amounted to printing free frequent-flier miles. Mileage lovers ordered more than $1 million in coins until the Mint started identifying them and cutting them off. Coin buyers charged the purchases, sold in boxes of 250 coins, to a credit card that offers frequent-flier mile awards, then took the shipments straight to the bank. They then used the coins they deposited to pay their credit-card bills. Their only cost: the car trip to make the deposit." - Kevin Fox from Bookmarklet
Makes me wish I'd known about it. :) - Spidra Webster
I was really close to doing this with my cash back card but the ROI wrt time and effort wasn't there. - Joe Beda () from iPhone
I remember reading about it on flyertalk.com but was to lazy to participate. I'm surprised that the mint cut them off considering it was just a small amount of the total amount sold. - Carl Haynes
I'm not surprised at all. The Mint was willing to absorb the shipping and credit card fees (1.5-3%) as a promotional cost to get the coins into advocates' hands. If the coins are being sold in a way that doesn't meet these goals, just to take those marketing dollars and give them to people with completely different agendas, I can totally see them halting that. - Kevin Fox
I love coin dollars and didn't know these had been minted. I am one of those weirdoes who actually likes the Susan B. Anthony and Sacajawea coins (although I'd sure like to see a historical woman on a coin people actually *use*. Guess I'm going to have to wait for rampant inflation...) - Spidra Webster
Joe Beda ()
Google storage bundle offers a free Eye-Fi card - http://www.eye.fi/google
Google storage bundle offers a free Eye-Fi card
This is a pretty sweet deal. - Joe Beda () from Bookmarklet
Joe Beda ()
Bad doctor joke: page to 867-5309.
The best part is that the iPhone highlights the number to make it dialable. - Joe Beda () from iPhone
Joe Beda ()
Definition: The Cobra. Wiping a baby's nose before he can move his head and block.
Theo is a mongoose. - Joe Beda () from iPhone
DeWitt Clinton
Introducing Google Public DNS, for a faster, and safer, internet experience: http://googlecode.blogspot.com/2009...
I'm also pleased with the Privacy Policy: http://code.google.com/speed.... Full IP logs are deleted within 24-48 hours. This is a very good thing. - DeWitt Clinton
And Google Public DNS telephone support! http://code.google.com/speed... - Tony Ruscoe
I'll have to do some tests to see if this is any faster than my local ISP DNS. - Benjamin Golub
hmmm... and the reason behind this offer? - MikeAmundsen
They will then know every single domain name that every user is trying to resolve, and how often, etc. - Mistletoe Glen
DeWitt that doesn't mean they aren't copied elsewhere or they will actually follow through with the policy. - Todd Hoff
anyone know what appears when the domain request is invalid? i.e. will i see a google search page w/ ads? - MikeAmundsen
Yay! This is super cool. I'm using it to work around my ISP (Comcast) hijacking DNS requests. - Joe Beda ()
Another cool thing are the vanity IP addresses that were obtained for this: 8.8.8.8 and 8.8.4.4. '8' is a lucky number, you know. - Joe Beda ()
@Todd: Actually, the privacy policy is pretty clear about what's temporary and what's permanent. If temporary logs were "copied elsewhere" as you suggest, it would be a pretty obvious violation of this policy. And I think it's pretty unreasonable to suggest that Google wouldn't "actually follow through" on its own privacy policy. - Joel Webber
Joe, do you know who had 8.8.8.8 prior? - Micah Wittman
Fast, doesn't seem to hijack 404s in any way. But I will have to go over the privacy policy carefully, in the context of Google's broader privacy policy. I wish we knew if the NSA had direct access to Google's traffic like they do for ISPs. This will certainly give Google a lot of data about web use. - LogEx
Joel, it's just a policy. If the NSA or some other agency says Google won't get this slice of spectrum etc then don't be surprised of all that traffic is split off some switch somewhere into total information awareness. - Todd Hoff
@Todd - half the company would quit in protest on the spot if Google even contemplated doing something like that. Including our own founders. But here's a question -- what could a company do that would reduce your fear? Clearly you use the Internet, and DNS, today. What assurances did your ISP make that cause you to trust them? Personally speaking, I find the Google DNS privacy policy a heck of a lot more reassuring than my ISP's. At least Google is promising in writing to do the right thing. - DeWitt Clinton
People don't know DeWitt. All those fat internet pipes hook into switches that have tap lines on them. And are there any examples of people quitting en masse in protest? I've not seen it. There's nothing people can do to reduce my fear because I know too much about it. Those promises don't matter. They can change at anytime and there's no external verification and as I said, the data is... more... - Todd Hoff
I wonder how much this gets traction beyond things like Chrome OS where Google can require the client to use their name servers. DNS is an abstract concept to most people, and for businesses, Google Public DNS doesn't offer the level of control other managed DNS services offer (like OpenDNS, for example). As an IT guy, one thing that I see missing is the ability to manually refresh the cache. I'm also interested to see how Google respects TTLs. - Mark Trapp
BTW, here's the Speakeasy Privacy Policy: http://www.speakeasy.net/tos.... Here is Comcast's: http://www.comcast.net/privacy.... Here is AT&T/SBC's: http://www.att.com/gen.... Guess what? None of them publish a log deletion policy and ALL of them reserve the right to do nearly whatever they want (even sell) your personally identifiable information, including IP addresses. Those ISPs are seeing every bit of traffic from our machines today. - DeWitt Clinton
@Mark - technical details, including TTL policy, can be found here: http://code.google.com/speed... - DeWitt Clinton
DeWitt, I went through that, and I'm still left wondering what Google's caching does. It doesn't explicitly say that Google will always respect the TTL on a record, and I don't see a remedy to resolve an outdated cache (for example, if Google fetches a record with a TTL of 86400 10 minutes before I change that record, if there's no way to force a manual lookup, even changing the TTL to... more... - Mark Trapp
@Mark -- I can't see how to force a manual refresh either, but I'll find out. I agree that it's necessary in some situations. - DeWitt Clinton
Mark, that page DeWitt linked to seems to infer that they respect TTL for prefetches: "The complexity of the name selection problem makes it impossible to solve online, so we have separated the prefetch system into two components: a pipeline component, which runs as an external, offline, periodic process that selects the names to commit to the prefetch system; and a runtime component, that regularly resolves the selected names according to their TTL windows." - Matt Mastracci
@micah Level3 owns 8.0.0.0/8 and Google has 8.8.8.0/24. BTW, 7.7.7.7 is owned by the US Dept. of Defense. - Joe Beda ()
Matt, what concerns me about that is it seems they interpret the TTL as a range of times they're allowed to ask for a new record; that is, if they automatically refresh records faster than the TTL, that's okay, as long as they don't hold onto it for longer than the TTL. A TTL shouldn't be a guideline: if I set a TTL to 86400, unless I manually tell you to fetch it again, you shouldn't... more... - Mark Trapp
Cool, added them to my list of servers that dnsmasq is to use. - Grant Bierman
The RFC does specify TTLs as "a 32 bit unsigned integer that specifies the time interval ... that the resource record *may be* cached before it should be discarded" I don't know if there's ever going to be a rock-solid guarantee that a resolver will cache your records (its cache could always overflow or become corrupted). Jumping TTLs isn't half as annoying as the broken resolvers that cache one of your round-robin DNS responses for all their customers for days, though. ;) - Matt Mastracci
Oh yes, checking too quickly is definitely a better problem than checking too slowly. One of the things we used to deal with was managed DNS that charged by the record lookup; in cases like that, you absolutely want people to respect the TTLs you specify or it can wind up costing you dearly. I don't really know if companies still get away with that (we get managed DNS for free now), but... more... - Mark Trapp
seems pretty good to me so far - Logan Lindquist
http://OpenDNS.com have been doing the same thing for a while if you are worried about Google owing all your data! - John Cooper
OpenDNS FTW - Shey, Jamaican of FF
I'm not happy with this. I feel it is a step too far. They could know and control way too much... from the OS Chrome to DNS/ mweh! And then what about a system fail! Laugh! I'm sure Murphy is working on it. How much of the network could go down with it. #don't-put-all-your-eggs-in-one-basket - DC Crowley
4.3.2.1 - Itachi
@Glenc +1 - Serkan Unsal
Joe Beda ()
Harvard study: Computers don't save hospitals money - http://www.computerworld.com/s...
For Rachel, in honor of the new computer system that is going online at Harborview soon. It just crashed for Rachel while she was trying it out. - Joe Beda () from Bookmarklet
Out of curiosity, what OS is it running? - Scott Ludwig
Computerization is a tool/technique. Who ever proved it guarantees a better mousetrap? Especially considering the human factor alone in a thing as complicated as a modern healthcare complex. - Micah Wittman
++Micah - people are always going to be a limiting factor in any system that involves them (in both good ways and bad) - Jennifer Dittrich
Scott - it is a java app launched from the browser. Lots of delay on every action. Too long to log in and too long to find patient. Lots of BS unnecessary data entry. From what I saw it is pretty horrendous. - Joe Beda () from iPhone
Computers are both a blessing and a curse. Being a person who implements computer systems in hospitals, I know they can save lots of money (or at least improve care), but they tend to be poorly implemented such that they are a burden on the users and the system in general. Most of them are written by mid-level programmers at best or anesthesia residents who are into computers, so they're not very good. - Gabe
What this really means is that trying to skimp is false economy, right? - Mr. Gunn
Joe: a local java app launched from browser or a java applet? If the former, what's the point of the browser? If the latter, WTF? - Steve Lacey
I think it is a local app installed/launched from the browser. This isn't the first time I've seen this. REOS is a system a lot of pro photo labs (WHCC) use for uploading orders and it is similar. - Joe Beda () from iPhone
Joe: You mean ROES? (Which BTW is a piece of crap as far as I'm concerned.) - Gabe
Yeah -- sorry -- ROES isn't great, but it is better than a simple web form or mucking around with FTP. It (and this hospital app) are examples for how far HTML (5?) has to go. - Joe Beda ()
I have to question why a company made a hospital app in Java in the first place. ROES is Java because every photo lab is going to have some Mac users and they don't want to have to write and maintain a separate Mac version of their app. But no hospital is going to have anybody who needs to enter or access patient data from a Mac. I would have written it as a Windows app and saved all the Java overhead. - Gabe
Joe Beda ()
Crashplan hosted backup for $3.50/mo - http://www4.crashplan.com/consume...
Nice! Not sure how they make the math work, but they are now competitive with the other consumer backup services there. I'll probably try this out soon. - Joe Beda () from Bookmarklet
I have a central file server that holds all my data. Most backup services assume you're backing up from a local disk. Do you know if they allow backing up from NAS device? - Brian
Not sure -- I'm going to do the same thing. Worse comes to worse you upgrade to their $5/mo family account to back up everything in your house. Still a good deal. - Joe Beda ()
The limitation I've hit in the past is that the backup client runs on a host and won't backup network mapped drives. - Brian
I'm so close to pulling the trigger on crashplan. I just wish they had a lightweight linux client that I could build for ReadyNAS. - Sean O'Connor
@Sean -- Are you happy w/ ReadyNAS? - Brian
Yes. - Sean O'Connor
This is why I've stayed away from packaged NAS solutions. You can't run custom stuff on them easily. And they don't seem to be a cost savings over building a box from the ground up. - Joe Beda ()
The savings is one of time. You can build a much better box for significantly less money, and I don't know that I'd shell out for the high-end ReadyNAS products. For a boring NAS with a zero-administration RAID controller, the low-end readyNAS is a good turnkey solution. Time I want to spend administering a file server at home: 0 hours / year. - Sean O'Connor
The crashplan client still uses too much CPU and RAM for me. They claim it's scheduled "idle" but my laptop still burns hot when it's going. - Michael Herf
Michael - we run cool as winter on laptops - if it's us burning your laptop up - something else is wrong - that's not normal behavior. We do use CPU .. but you can configure how much in settings (i.e. 10% / 10%) - Matthew Dornquast
You can control how much ram we use too, this is easy on linux. For instance, you can run it with a restricted footprint of something like 20MB of ram on linux, headless. Works awesome. - Matthew Dornquast
@Matthew -- Since you say "we can..." I assume you're speaking on behalf of CrashPlan. Does CrashPlan support backing up a NAS device? - Brian
Yes - we support backing up any NAS - steps required depend on OS. In terms of running "on" the NAS itself - that requires some work on your part. It has and can be done. We don't show you how. Lots of folks have asked to support readyNAS by running on it - we're not currently focused there. We do run on windows home server - if you are using that on top of your storage. - Matthew Dornquast
I've noticed that the "client" portion isn't that bad. However, the "daemon" portion does seem to be pretty memory intensive. On OpenSolaris, I've had it run out of heap (and get into a crash/restart loop that ate CPU). I fixed it by finding the startup script and gave it more memory. - Joe Beda ()
Matthew, any plans for a FreeBSD port? Now that ZFS is stable on FreeBSD 8, it is an attractive base system to use for data storage, and using crashplan to back up that data would be nice. - Scott Ludwig
Personally? I love BSD. Sadly, no plans at this time. I must say BSD 8 looks really really good. Huge kudos to them. We'll get there - lots of C code would have to be done to wire into realtime stuff on BSD. In theory, you could probably get our PRO Server going out of the box without our help on it. And PRO Client (Crashplan) would probably work in a non-realtime manner as well. So if once/day is ok - give it a try if you're so inclined. No official support available as yet however. - Matthew Dornquast
A CrashPlan module (or whatever they call them) for the ReadyNAS would rock. I'd shell out $$ for it. - Steve Lacey
I think it would probably require a third party to implement it. I think the crashplan guys write heavy java clients? That's a non-starter on the low-spec readynas models in widespread use. - Sean O'Connor
Joe Beda ()
I met Rob, their CEO, at a Washington Tech Alliance dinner and found out about these guys. What they are doing is providing a way to collect and organize photographs and other data about large construction jobs in order to prove compliance, record conditions, etc. They are hiring. - Joe Beda () from Bookmarklet
Tudor Bosman
My big hard drive (where all my important documents are -- photos, music, tax returns) is showing signs of failure. No bad blocks that I can tell (yet), but the occasional characteristic "ATA command failed, controller reset" sound. Given how cheap disks are these days, I'm going to build a RAID setup next.
Options: 1. cheapest: two mirrored disks using my machine's built-in hardware RAID controller. - Tudor Bosman
2. custom-built, small, cheap-ish OpenSolaris / FreeBSD box with ZFS, and two (mirrored) hard drives (or four, for twice the space and striping). This requires more work, but it gives free snapshots. - Tudor Bosman
What is that sound? - Andrew C
3. ReadyNAS NVX (sadly, they factored "snapshots" into the enterprise NVX version, not the home-office NVX Pioneer version). Expensive, but probably the least hassle to set up. - Tudor Bosman
Andrew: a click as the heads reset, then a half-second whirr (during which your computer is likely frozen) as they realign. - Tudor Bosman
So yes, I'm taking suggestions :) - Tudor Bosman
I have one of these: http://www.amazon.com/gp.... Price was right for me since I didn't have a desktop to cannibalize and everything I wanted worked out of the box (Time Machine and media server) - Benjamin Golub
Ben I've been looking at that WD. My concern always is ... 2TB is too small :) - Deepak Singh
Go with the OpenSolaris/ZFS box. (Or FreeBSD 8?) You can then install custom software (Crashplan?) to do offsite backup also. You can build a 4x1.5T setup for $600-900 depending on the CPU/RAM. - Joe Beda ()
Deepak: they do have a 4TB version (2x 2TB disks), which is of course 2TB if mirrored. - Tudor Bosman
Joe: I'm kind of leaning that way myself. I don't need a lot of CPU, as there will be only 1-3 hosts accessing it concurrently. - Tudor Bosman
So now I'm looking for recommendations for a small, well-ventilated micro-ATX case with at least 4 drive bays. Hot-swappable would be nice :) - Tudor Bosman
After my raid issues of the last week, I've decided on the following plan: One master 1.5T disk and one 1.5T 'delayed mirror' disk that gets synced up every 24 hours. Once every few months I pull the delayed mirror off, call it a snapshot, and store it off-site, and replace it with a new 1.5T drive. This system protects against single-drive faulure, catastrophic site loss (theft/fire),... more... - Kevin Fox
DROBO! - James Myatt
Definitely agree with Joe - Mo Kargas
I wish there were some sort of open source Drobo project. At a minimum, it could just be a list of suggested cases, motherboards, etc for a ZFS appliance. - Ken Sheppardson
Question: What are you trying to protect from? RAIDs are great for high throughput (striping) and high uptime (mirrors). If you're not overly concerned about either then I'd suggest a more traditional incremental backup solution. - Kevin Fox
Ken: There's FreeNAS, I'm sure that people on their community have some advice. I just haven't looked at it yet. - Tudor Bosman
Kevin: I'll need some form of offline backup as well. Recovering 1TB+ of data from offline backup is bound to be painful, though, so I'd rather save that for catastrophic events (ie. things an order of magnitude less likely than a disk failure) - Tudor Bosman
'k. I'll only add that I had a 4-disk RAID array that went south because of directory problems. The fact that the data was redundant didn't help recovery one bit (and actually made it harder). As of this morning it looks like I got the data back, but I've learned not to trust RAID as a comprehensive parachute. Data corruption can happen lots of ways, and not all of them are protected by RAID. - Kevin Fox
Here is hardware that worked well for me for OpenSolaris, based on Mike Herf's experience: http://bedafamily.com/ZFSServ... - Joe Beda ()
Ordered a box with five 2TB WD drives (Newegg had them on sale, 5 per customer limit). As I don't really need more random read bandwidth than a single disk, it will be RAID-Z, and likely using FreeBSD 8. I'll post updates as I build this thing. - Tudor Bosman
I'd like to make IT too! Keep us updated! - CantorJF from iPhone
Joe Beda ()
This is the hardware for an OpenSolaris ZFS box that I built in June. - Joe Beda ()
Joe Beda ()
Just made our yearly donation to Northwest Harvest. Who are you giving to this year? - Joe Beda () from Bookmarklet
Joe Beda ()
Upgrading the hard drive in a TiVo is pretty easy these days. It was really as easy as pulling the drive, plugging both in to a Window machine and copying the data with this utility. - Joe Beda () from Bookmarklet
Benjamin Golub
I needed a rot13 encoder over the weekend (don't ask :P). Attached in case anyone else needs command line rot13 encoder/decoder
rot13.txt 504 bytes
This time attached as a txt file so it's viewable in the browser. - Benjamin Golub
Maybe for hiding *SPOILERS*? :) - AJ Batac
Huh, I never used OptionParser before. Damn does that look nice. I had only used sys.argv before. Well, this makes my life better. Thanks! :) - Keith Bourgoin
And before someone says "encoding and decoding rot13 is the same, you don't need that option": I know :) - Benjamin Golub
You should add an option so you can double rot13 encode. (That joke never gets old!) - Joe Beda ()
joey
Amazon.com: Pentax Optio W80 Waterproof 12.1MP Digital Camera with 5x Wide Angle Triple Shake Reduction Optical Zoom and 2.5 inch LCD (Gunmetal Gray): Camera & Photo - http://www.amazon.com/dp...
Amazon.com: Pentax Optio W80 Waterproof 12.1MP Digital Camera with 5x Wide Angle Triple Shake Reduction Optical Zoom and 2.5 inch LCD (Gunmetal Gray): Camera & Photo
I'm stupid. Is this like, waterproof waterproof? Like, could I take it snorkeling? - joey from Bookmarklet
"With the most watertight and airtight external joints ever, Pentax has improved the Optio W80’s underwater performance to more than 16 feet for up to two hours of continuous operation." So you can take it 16' deep and stay there for 2 hours. Any deeper or longer, and it might get damaged. - Rochelle
Looks like it :) - Rodfather
I just didn't trust that, Rochelle. Haha. I really want a waterproof camera (totally frivolous) but it looks like the Canon Powershot version is much more highly rated. Maybe someone will love me and want to buy one for us as a wedding/honeymoon gift. - joey
Put it on your registry! - Rochelle
It's expensive, though! Like $272 or something. - joey
Akiva put the OED on our wedding registry. It's $900 or something. He also put cereal on our registry. We got the cereal; we did not get the OED. - Rochelle
Haha but did you get it? - joey
We also don't even have a registry. I am all stressing over it. - joey
We didnt have a registry - we just took a pretty blank journal, and cut and pasted things with comments and a little tickbox, and space for a doodle and message by the people who chose to gift that, and mailed it around. It worked and makes for a nice souvenir - Joelle Nebbe (iphigenie)
A registry is the easiest thing, unless you're wanting to register for matching dining/tableware, which we didn't. Then it can get complex. But just make one on Amazon and put stuff like that camera on there. And, you know, breakfast cereal and the OED. - Rochelle
Yeah, we just weren't planning to register at all but everyone is pressuring me to and I don't really know what I'd register for besides cookbooks and the camera and random things that we don't really need. I mean, we've been together for a long time. I have dishes and cookware and such. - joey
That's why you have to do it at Amazon or a place other than Macy's. You can add literally anything on Amazon, especially if you use the Universal Wish List tool. For the next several months, instead of clicking to add things to your own wish list, throw it on the registry list! I see registries as more of a fun wish list these days, rather than the "list of items needed to complete our home" like it used to be. Heck, I had a cat litter box on my list. - Rochelle
Yeah, I think that makes more sense. I just don't know if people have culturally moved to that point. Like is my family more traditional/old-fashioned and will they think that is really weird and uncouth? Haha. I did make a separate wish list with cookbooks and some domestic stuff that I can turn into a registry. The other issue is that we need less junk in our house. I wanted to have a... more... - joey
If you use the Amazon Universal Wish List, you can link to a (or more than one) charity donation page so people can donate that way. - Rochelle
That's a good idea. We were just going to ask people to choose their own cause but it seems like everyone is telling me that they want to be told what to do. So I think that may solve the problem! Then they feel like they are doing something registry-related. But they've basically told me that if we don't put items on there that people will buy random things anyway even if we really, really don't want people to. So I guess it's time to have fun with Amazon! - joey
It's true! - Rochelle
Wrt snorkling with these -- be aware that they don't float. If you really want to take something snorkling, I'd suggest buying a Canon SDxxx with the matched waterproof case. That combo works *really* well under water. - Joe Beda ()
Joe, do you mean like the Canon waterproof camera or just a regular with an enclosure? Are the enclosures waterproof enough? http://www.amazon.com/gp... - joey
Regular camera plus the underwater case. The case is probably more waterproof and it floats. Ours doubles as a tough kid case for the camera as it has big ole buttons. - Joe Beda () from iPhone
Joe Beda ()
Wii ordered. Yay!
Wheee! - Bill Strathearn
Did you order any games with it? - Gary Burd
New Mario bros with it. Going to hook it up to the 100" screen. :) - Joe Beda () from iPhone
Joe Beda ()
The Muppets: Bohemian Rhapsody - http://www.youtube.com/watch...
The Muppets: Bohemian Rhapsody
Play
Make sure you watch it in 1080p. Very cool in high res. - Joe Beda ()
Awesome! - Jeff P. Henderson
Joe Beda ()
Which will last longer: this meeting or my iPhone battery.
I think the meeting is winning. - Joe Beda () from iPhone
dannysullivan
RT @alleyinsider: Microsoft Offers To Pay News Corp To "De-List" Itself From Google $MSFT $NWS $GOOG by @nichcarlson http://www.businessinsider.com/microso...
Why am I so tempted to proclaim that Microsoft and News Corp deserve each other? - Louis Gray
Can we get Microsoft to pay Fox news to delist itself also? - Piaw Na
++1 Louis - Sebastian
+100 Piaw :) - Joel Webber
As much as the claims that "Google is the new Microsoft" rings true, this is something that I could never see Google doing. In what way is this good for MSs customers? - Joe Beda () from iPhone
Kevin Fox
Experiencing my second Drobo data failure. Any advice for storing 1TB of data with high reliability and low access needs? S3 would cost $150/mo.
Set up your own RAID? Mozy's good, too. - Jesse Stay
I'd hoped that Drobo would be more reliable than my own raid... - Kevin Fox
Can you swap out new hard drives in a Drobo? - Jesse Stay
I like Mozy, but I don't know how much I can trust a small company offering 'unlimited storage' for a low price. I feel it's more likely that in 10 years my 1TB drive in a vault will still be readable than Mozy will still be in business. - Kevin Fox
small? They're owned by EMC I thought. - Jesse Stay
Just buy a couple 1TB USB HD's and keep one as the working disk and the second as a mirror backup. If you are really paranoid, buy a third drive and do a periodic backup or sync to it and keep it off site. Use any number of automated backup or sync software packages set to run on a daily basis. - Jeff P. Henderson
Jeff, that's my inclination, mostlikely. Mirror or raid locally, off-site backups. Archives are my biggest concern. Terabytes of photos that don't need to be available, but can't be forgotten in a closet where hard disks go to fade away or obsolesce themselves (Firewire? What's that?). - Kevin Fox
Jesse, okay, so perhaps they're not small, but I doubt their 'unlimited' will support a terabyte or two, when their business tier charges $0.50 a gig per month (unclear whether that's per gig of added storage or per gig of total storage. S3 charges $0.15 per gig of total.) - Kevin Fox
You can swap out new drives in a Drobo. If one goes bad you can hot-swap it with a new one and pretty lights tell you when the new one is synced up. The problem is that I've never had it tell me that a drive's gone bd. It's always more fundamental problem like an inability to mount the combined volume or Disk First Aid (which Drobo recommends using) tells me the 'drive' is so messed up... more... - Kevin Fox
I have one of these: http://www.wdc.com/en... - Benjamin Golub
Whoops hit enter too fast. I have the 2TB one (advertising is false, 2TB = 1TB, 4TB = 2TB since you obviously want to use RAID 1 and the default is to use RAID 1). It has worked very well for me and I am more comfortable with it than a Drobo. Drobo uses some proprietary format, but this is just RAID and ext3 I believe. You can replace the drives very easily (no tools required) and it... more... - Benjamin Golub
A ZFS box? - Ken Sheppardson
Open Solaris + ZFS. Use ZFS snapshots to protect against accidental deletions. Use ZFS mirror to handle single disk failure. Run the zpool scrub command regularly to check for and repair bit rot. Use offsite backups to protect against a fire or other catastrophic event in your house. - Gary Burd
Not trying to dissuade you from the local solution (I think it's probably the best one) but just wanted to mention that the "unlimited" model is based on the assumption that only a few users really take advantage of it. I think it's safe to say they've done their modeling homework and arrived at an equation that provides a bottom line they feel comfortable with. This blog post from... more... - Jason Wehmhoener
Anyone have an OpenSolaris + ZFS tutorial aimed at the non-sysadmin? I love the idea of doing this for home backup, but I'm not a Solaris admin by day and wonder if it would be too much learning curve compared to a couple mirrored USB drives... The WD dual drive Benjamin linked to is super easy... - Jason Wehmhoener
I've been using backblaze, its mac client software is simple and solid. The problem with rotating local TB backup drives is of course non-automation + lazy developer = not up-to-date backups. - Micah Wittman from iPhone
For remote storage of pictures there is picasaweb. Prices are $256/year per terabyte (I think). - Scott Ludwig from iPhone
Kevin from your description it sounds like you had a drive integrity failure that your drobo didn't notice until you went to use it. - Scott Ludwig from iPhone
Scott, the sad thing is that the Drobo *still* hasn't noticed. MacOS is the one telling me about these problems while the Drobo Dashboard thinks everything's peachy. I'd be tickled pink if Drobo threw up a red light and said 'this one drive is bad' because then it would be working as it should and I could just swap the drive with a new one and maintain data integrity, but as it is I'm probably screwed. - Kevin Fox
Even with something like RAID, ZFS, or a Drobo, isn't it possible for data to become corrupted without there being a problem with a drive? I.e. cant an app or the OS still just muck up a file? - Ken Sheppardson
ZFS snapshotting and scrubing goes a long way. I run a home opensolaris server. I love ZFS. Opensolaris is meh. I want to play with freebsd but don't have the time. - Joe Beda () from iPhone
How much time + money does it take to setup an opensolaris server with zfs and get everything working automatically? - Benjamin Golub from email
I did a box with 4 1.5T WD green drives and ECC RAM for ~1k. Set up time is a day or two. A few of us around here have done it and can help out. - Joe Beda () from iPhone
What filesystem are you using on the drobo? HFS+? I wonder if different filesystems have different levels of reliability: mine has been on ext3 for some time with zero dataloss. Knock on wood, of course. - Matt Mastracci
This looks interesting... "EON ZFS is a RAM based live/install image which runs from CD/DVD, USB or CF" -- http://sites.google.com/site... - Ken Sheppardson
You might consider one of the G-Drives/Raids: http://www.g-technology.com/product.... I have one and have been happy with it. No failures over 4 years. They have configurations for as much storage as you probably ever need, with various raid and connection options. - Cristo
This one is probably the best for your needs, as it allows for offsite backup: http://www.g-technology.com/product.... "G-SAFE features high-speed 3Gbit eSATA, FireWire 800 and USB 2.0 interfaces for universal connectivity to Mac's and PC's and two removable hard drives coupled with a sophisticated hardware RAID 1 (mirroring) engine designed to ensure 24x7 data protection. A... more... - Cristo
I'd start to be wary of standard RAID with today's drive capacities. The chances of a second drive failure while resyncing after a first are much higher now that they were with 500GB drives. Of course, if you keep a good backup of the storage it won't be an issue. Ref 1: http://hardware.slashdot.org/hardwar... Ref 2: http://labs.google.com/papers... - Matt Mastracci
raid mirroring is all I do... i also then use an online back up service (backblaze) to back up the data from the mirrored drives. Photos also get backed up to smugmug (but no raw photo storage) - Matt Ellsworth
i've been using a raid-5 Buffalo Terrastation for 4 or 5 years now with no problems... *knocks on wood* it's got 4 500gb drives in it and it's almost full - Chris Heath
Benjamin, Michael Herf wrote about his ZFS setup here: http://www.nerdblog.com/2009... I run OpenSolaris on an MSI Wind PC w/ two 1TB drives. The configuration cost $350 from NewEgg. It took me a couple of hours to figure out how to configure ZFS, setup snapshots and run scrub. - Gary Burd
Search my posts for zfs for a link on how to configure a mirrored root partition. It is a little complicated. My soln was more $ because of more ram, ecc, more CPU and 4 drives. I picked the motherboard mike herf lists on his blog. - Joe Beda () from iPhone
You can make a Linux RAID scrub weekly too - just schedule it ("echo check > /sys/block/md0/md/sync_action"). Also, the Intel SS4200E is $200 and apparently has EMC software: http://www.tomshardware.com/reviews.... Personally, I'm happy with ZFS, it's not too hard to learn the admin stuff. - Michael Herf
Also, Time Machine seems half-allergic to NAS. You can make it work but it fails randomly later. I guess you could try iSCSI and format HFS+? To fix this, you can also look for one of the RAID-1 enclosures that do attached eSATA and just plug a couple drives in. Not foolproof, but at least it supports Time Machine reasonably well (think one of my friends has the "Raidon" brand.) - Michael Herf
Michael, thanks for the ZFS writeup, really helpful. I like the idea of a really low cost, low power setup based on Atom. - Jason Wehmhoener
Be aware that the wind atom pcs aren't super low power. The chipset eats as much or more than the processor. I think toms hardware had a writeup on that. - Joe Beda () from iPhone
Adding one more thing to this mega-thread - you can do free remote backup between two of your machines, by putting the 2nd machine at a friend's house, then using CrashPlan: http://www.crashplan.com. Crashplan runs on OpenSolaris, for those of us using ZFS. The two machines connect using peer-to-peer networking. - Scott Ludwig
LACIE NAS drives are what we use - no failures in 3 years! AWS for critical offsite storage - Susan Beebe from iPhone
I think windows home server works with apple computers as well. - CJPhoto
Follow-up, for those interested: http://friendfeed.com/kfury... - Kevin Fox
Wouldn't JungleDisk "work" for that? Although I can see transferring 1TB of data over any Internet connection being painful and slow, not to mention a surefire way to exceed any bandwidth quota within any time period... - Tyson Key
Interesting, I almost went with Drobo for a new setup... instead, I decided to keep my ReadyNAS. Depending on what you find, I may be glad I waited as the ReadyNAS (crosses fingers) is solid. - Jason Silverstein
Having suffered partial loss with the WD raid units to a smoked controller, I'm likely to go w/ a zfs server, possibly async mirroring to an encrypted userfs mounting storage on a provider like dreamhost. - Scott Small from iPhone
Has anyone tried the OpenSolaris-based EON ZFS Storage? I played with it when it first came out on a vmware guest instance for a short while but never really got into it. The homepage is http://sites.google.com/site... and can browse their blog at http://eonstorage.blogspot.com. - imabonehead
EON looks pretty cool! - Jason Wehmhoener
Kevin, to be clear, are you saying the Drobo system itself is unreliable? That's worrying - LANjackal
Joe Beda ()
Tired bear is tired.
photo.jpg
Oh, that's adorable. :) - Rochelle
So cute! - Chrimmus Tad
He isn't really sleeping. Just resting his eyes for a sec before playing more. - Joe Beda () from iPhone
Joe Beda ()
Should we move? http://www.redfin.com/WA.... Spendy...
It looks nice. - Gary Burd
Only thing to mention is that it has no garage. I would miss that. Our current place has a 2 car garage on an alley. - Joe Beda ()
Wow, it looks really nice. I'd buy it. - Paul Buchheit
Does it have offstreet parking? - Gary Burd
I like your current house better. - Scott Ludwig
I think that this house has a single car wide dive way in the back. So, you could park multiple cars in tandem. But it backs on to a busy street. - Joe Beda ()
I want to downsize to a tiny house -- easier to clean. :-) - Matt Armstrong
The outside picture is very Magrittesk .. too much photoshopping ;) - Henner Zeller
Just toured it. Not so much. Main floor was amazing. Upstairs had 5 small bedrooms that shared one bathroom. Top floor was semi-finished and the basement not at all. Oh well. - Joe Beda ()
That's in my neighborhood - sorta. I personally wouldn't want to live adjacent to 24th with the traffic and that busy intersection. It's also on the NE side of a hill in Seattle which means not so much sun. I live East of the crest of the hill and that's bad enough. - Hayes Haugen
This guy needs some work but it's a great location: http://www.redfin.com/WA... - Hayes Haugen
Gabe
It looks like I'm paying less than double the wholesale rate for natural gas, but 3-4 times the wholesale rate for electricity. Can I take advantage of this somehow?
I think that if I get my own high-efficiency natural gas generator I should be able to get my electricity really cheaply. I could even sell it to my neighbors! - Gabe
I recently switched to a gas powered on demand water heater in our house and love it. It takes a little while longer to get hot water to the tap, but it never runs out. On top of that it is more efficient, uses gas vs. electricity and frees up space in my basement because it is on the outside of the house. The downside is that installing it wasn't easy (it was part of a larger remodel) as it involved water, gas and electricity to be routed to its new site. - Joe Beda ()
I'm thinking a combined-cycle gas turbine with heat recovery steam generator should do the trick. - Gabe
I know where I can get a 250MW model. Does anybody know where I can find a 2.5kW version? - Gabe
Other ways to read this feed:Feed readerFacebook