Carrie getting some much deserved attention. "Ms. Grimes is an Internet-age statistician, one of many who are changing the image of the profession as a place for dronish number nerds. They are finding themselves increasingly in demand — and even cool. “I keep saying that the sexy job in the next 10 years will be statisticians,” said Hal Varian, chief economist at Google. “And I’m not kidding.”"
- Bret Taylor
from Bookmarklet
Great article, but it left out that statisticians need some CS muscle to effectively operate on large scale data. It's the combination that make Carrie -- and others like her -- 'Internet-age' statisticians.
- Michael E. Driscoll
I know, not very important but it would be a very-nice-to-have. :-) I wouldn't need to visit Google Reader then as I'm really liking that I can read my feeds in FriendFeed atm. :-) #betakoltag-sg-postscomments
- Kol Tregaskes
Google Reader doesn't have an API for setting shared items, so it's pretty much impossible without some sort of greasemonkey or firefox extension.
- Kevin Fox
Shame, I have a bookmarklet that does it so might start using that, thanks Kevin.
- Kol Tregaskes
In this day and age, caching effects outweigh most algorithmic gains (for most data sets that you're likely to encounter). The cost of a cache miss can be disastrous -- going to main memory is roughly 200 times slower than hitting in your L1 cache. This is why...
1. Tree-oriented data structures are usually a bad idea. Every branch means you're chasing a pointer to some completely unrelated area of the memory, likely a cache miss.
- Tudor Bosman
2. High-performance server code is hard to write in Java (as opposed to C/C++). You can't embed objects in each other; every object reference means following a pointer, likely a cache miss. Also, objects are huge -- they contain a vtable and a lock and all sorts of other crap that you often don't need.
- Tudor Bosman
3. You get surprising behavior with C++ STL data structures. It's often faster (for small-sized data sets accessed infrequently) to store them in a vector and do linear search than to store them in a std::map (which is a tree) and do binary search.
- Tudor Bosman
This, by the way, is why I don't like Java. Write most of your code in a high-level language (Python, PHP, Javascript, Lisp, whatever floats your boat), which is easy to write, read, debug, and deploy, and the performance-critical parts in C++. Java is trying to sit in the middle, but doesn't do either "ease of use" or "high-performance" particularly well.
- Tudor Bosman
Techniques originally designed to minimize disk seeks now make sense for data held in RAM. For example, btrees can be faster than red-black trees on modern machines: http://idlebox.net/2007...
- Ben Darnell
I'd critique this assertion on a few grounds. One, while you do not have control over object embedding, there is nothing preventing it, and indeed, there are tons of papers on "object inlining" compilers, in much the same way that escape analysis can allow automatic stack allocation. It is true that current JVMs don't do this, but it is not prohibited. Secondly, compacting garbage...
more...
- Ray Cromwell
I feel the same way about Java being in the middle. If you only pick one language that might be the thing to use. But if you're using two, a combination like C++ and Python seems better than C++ and Java, or Java and Python. It may be true that JVMs *could* inline objects, but they don't, and that's what matters to me as a programmer (not a compiler writer). However I think there could...
more...
- Amit Patel
OT, but "When it comes to operating-system-specific details and solutions, the text exclusively describes Linux. At no time will it contain any information about other OSes. The author has no interest in discussing the implications for other OSes. If the reader thinks s/he has to use a different OS they have to go to their vendors and demand they write documents similar to this one."
- Andrew C (✓)
Some would that a high level language that requires programmers to specify object allocation and layout is basically not a high level language. HLLs tend to defer such design decisions until later, relying on the compiler, because early optimization could inhibit later reuse (e.g. declaring a method 'final' in Java for 'performance') The dismissal of the JVM's current optimizations...
more...
- Ray Cromwell
Related, it has already been implemented in HotSpot (http://citeseerx.ist.psu.edu/viewdoc...), 9% average to 51% speedup. Also, JDK6u14 has experimental escape analysis, but not full stack allocation yet, however, IIRC the IBM J9 VM has had automatic stack-allocation for non-escaping objects since early 2000s.
- Ray Cromwell
back in 99-03 we had rather opposite problem -- we had to reduce capacity/bandwidth (on now obsolete pentiums :) yeah, we had also to keep it running 99.999% reliable, hotswappable, on _minimal_ hardware support, and what not else. The Decision we made to make it _that_ capable was to drop C++ & C mix and write it plain C ;) Moral of story -- don't over-engineer :D
- A. T.
I don't know what datasets you use, but it only takes a few thousand or so nodes to make an O(log n) tree algorithm faster than an O(n) list algorithm, even when a node access it 200 times slower than a list access.
- Gabe
Are you suggesting that a O(n) algorithm is better than O(log n) because the O(log n) has a constant factor of 200 (or even 1000)?
- siva
I am suggesting that a program that uses an O(n) algorithm might be faster than a program that uses a O(log n) algorithm under the circumstances. I'm not comparing the algorithms, but their implementations on real hardware.
- Tudor Bosman
and with real-world data sets. Depending on your application (say... videogames), they might in fact be quite small.
- Andrew C (✓)
#LifeAppreciation lesson #1 - If you're thinking of doing something crazy and fun, but it would be irresponsible, ask yourself: "what are the odds I'll get the chance to do this again in the future?" If they are less than 50%, you should consider doing it anyway. If they're less than 10%, don't even think about it. Do it.
I've learned most of my wisdom the hard way. And I didn't learn it the first time, either. I'm a slow learner. :-/
- Spidra Webster
You know, I'm not sure there really is an easy way. Or I'm slow too :P
- Lo the Baker
Some people learn just by listening to those older and wiser. Some learn the first time they make a mistake. I think I learned about the 1000th time I made a mistake. :)
- Spidra Webster
*Unless it means you are being a total jerk to someone else you care about.
- The Amber
Amber, good point. Societal disapproval is the only caveat in this example. And Spidra, I've heard of those people but not really met them :P
- Lo the Baker
If we did create a device that would allow parallel peeking you can bet the device would be patented, and they'd use it to find new ideas from the other universes. (Okay, of course it wouldn't be patented, it would be/has been kept secret)
- Kevin Fox
I saw a theory recently that Dark Matter and Dark Energy are the manifestations of leakage between our universe and another...
- DGentry
I think I'm going to hold off buying the "peek" device and save up my money to buy the device that lets you browse and swap places with the alternate you in the parallel universe of your choice.
- Ken Sheppardson
Is this thread about next week's episode of LOST?
- no name
@Bill: It's about the Other Universe in Fringe.
- Amit Patel
I hope JJ Abrams inspires thought on this topic with this season's run of both!
- no name
"Many circumstances can trigger anger, but one that is commonplace in the male adolescent culture of cruelty is the feeling of inferiority or being devoid of social status. There is little scientific evidence to support the admittedly popular idea that boys with high testosterone levels are aggressive and yet have higher social status..."
cont'd. "Our clinical experience also refutes the notion of such a biological imperative. It is not the virile class leader who is usually the bully or the one getting into the fights after school. It is the boy who is further down the social ladder, one who feels rejected or ashamed, who expresses his hurt through aggressive action. Clinical evidence tells us that boys who have the genetic defect Kleinfelter's syndrome tend to be aggressive. Kleinfelter's is a clinical condition caused by an extra female chromosome (XXY), and affected boys have small genitalia and a testosterone deficiency. Clinicians who work with these boys report that they tend to be self-conscious because, especially for those on the cusp of puberty who must shower together after gym class, penis size is a visible measure of manhood. These boys tend to get into trouble fighting, perhaps to protect themselves against the pain of this shame and perhaps in part to validate their manliness. Research directed by...
more...
- April Buchheit
First come the innovators, who see opportunities that others don’t. Then come the imitators, who copy what the innovators have done. And then come the idiots, whose avarice undoes the very innovations they are trying to use to get rich. -- Warren Buffett
I don't normally put a Like on these kinds of posts but I definitely support magazines publishing shots of girls who look... y'know. Natural and healthy.
- Akiva
thank god for first time not a skinny woman :)
- samantha
"Toyota North America hired several employees directly from the National Highway Traffic Safety Administration (NHTSA). These former government employees helped to end NHTSA probes into unintended acceleration occurring in some of the same vehicles that are now being massively recalled and which are apparently responsible for causing deaths. The probes were ended in 2002-03, and the employees consistently lobbied against any expanded inquiry into these issues over the past decade."
- Andrew C (✓)
from Bookmarklet
"The irony is that Toyota's regulatory lobbying effort was in pursuit of short-term gains that ended up causing long-term damage to their reputation. As with banking, special treatment given to firms at their own request has been damaging -- even fatal, to their own existence. In Toyota's case, it has led to the tarnishing of their once impeccable reputation, and regrettably to the deaths of 19 of their customers."
- Andrew C (✓)
"Other issues that come to mind include: [...] • How is it even legal to lobby regulators? Shouldn't they be off limits to this, like courtroom trials? What's next, lobbying judges with booze and hookers?"
- Andrew C (✓)
Kittens are back from surgery. Both are spastic and hopped up on their lingering drugs. So far Zora hasn't been trying to lick herself and when we tried a cone on her she went crazy and could not be calmed at all - so it is off till we see a need for it. Coraline however needs a cone. Here she is in a lovey phase with her cone on! #foxfosterkittens
Coraline is handling the cone much better. She doesn't like it but she is dealing. She goes back and forth between being spastic and being super lovey!!! The photo above where you can't see her face because the cone is facing me is where she is smoshing her facing into mine, her way of expressing love.
- Rachel Lea Fox
Totally Kevin. Last season Office Depot had all the kittens sporting beautiful purple cones. This year it is orange that is in for the Office Depot kitten!!
- Rachel Lea Fox
They are so adorable...I wish I could have more than two...I'd adopt them both in a blink!
- Bash
You guys are such good people -- so proud to say I know you two. :)
- Mona Nomura
i was hoping to video tape them learning to walk in the cones, but Coraline picked it up quick and Zora... well she was just being crazy and was kind of painful to watch. So I'll video tape another group in the future.
- Rachel Lea Fox
Bash, you and me both! but I'm glad to know Moxie has a good home with you and Sebastian!!
- Rachel Lea Fox
Regardless of how it turns out, I'm really happy for you that you did what you could to influence the situation for the better! Good luck tomorrow.
- Daniel Dulitz
"The Society of Automotive Engineers (SAE) published a paper in 1995 suggesting how outside mirrors could be adjusted to eliminate blind spots. The paper advocates adjusting the mirrors so far outward that the viewing angle of the side mirrors just overlaps that of the cabin’s rearview mirror."
- Simon
from Bookmarklet
That's how my dad taught me to do it <mumble> years ago. You get four blind spots instead of two, but none of them are large enough to fit a car in an adjacent lane.
- Seth
Click & Clack explain this also in their book.
- Piaw Na
Great idea, but one subtle problem with this for me would be that if I can't see my car's flanks in the side mirrors as reference points, then it won't be obvious to me when the mirrors have become misaligned, as happens from time to time.
- Doug Beeferman
If you can see your car's flanks, your mirrors are misaligned. ;-)
- Seth