Sunday, November 2, 2014

“But would not any program that helps to reduce the shame of sending innocent people to prison be worth trying?”

“But would not any program that helps to reduce the shame of sending innocent people to prison be worth trying?”  That's the final sentence of an essay by Jed Rakoff, a U.S. District Judge.  He's talking about a proposal for reforming one of the most shameful aspects of the U.S. system of justice, one that no other country uses so pervasively: plea bargains.  A sample:
...the prosecutor-dictated plea bargain system, by creating such inordinate pressures to enter into plea bargains, appears to have led a significant number of defendants to plead guilty to crimes they never actually committed. For example, of the approximately three hundred people that the Innocence Project and its affiliated lawyers have proven were wrongfully convicted of crimes of rape or murder that they did not in fact commit, at least thirty, or about 10 percent, pleaded guilty to those crimes. Presumably they did so because, even though they were innocent, they faced the likelihood of being convicted of capital offenses and sought to avoid the death penalty, even at the price of life imprisonment. But other publicized cases, arising with disturbing frequency, suggest that this self-protective psychology operates in non-capital cases as well, and recent studies suggest that this is a widespread problem. For example, the National Registry of Exonerations (a joint project of Michigan Law School and Northwestern Law School) records that of 1,428 legally acknowledged exonerations that have occurred since 1989 involving the full range of felony charges, 151 (or, again, about 10 percent) involved false guilty pleas.
Do go read the whole thing...

The Obama Doctrine...

The Obama Doctrine...  As tweeted by Gary Kasparov:
Do as little as necessary to appear to be doing something without actually committing to a cause or course of action.
You know, that's completely plausible...

Surprising graphics...

Surprising graphics...  Twenty-one more like the one at right.  Not all of these were surprising (at least, not to me), but they all are ponder-worthy...

Vintage ads...

Vintage ads...  A couple dozen of 'em, some funny, some shocking.  Most of these “vintage” ads are from within my lifetime, which I don't find amusing at all!

“One thing is for sure: politics is in for a major overhaul.”

“One thing is for sure: politics is in for a major overhaul.”  Gary Shapiro is president of the Consumer Electronics Association.  He notes that software for smartphones is becoming available that can analyze emotions from images of faces, and can determine from the sound of a voice whether someone is telling the truth or is lying.  Then he ponders the implications of such technologies, particularly if they get better than they are today.

To anyone who reads science fiction, this will seem like old territory.  Sci-fi authors have been pondering questions like this for about 80 years now.  I'm going to guess that Gary Shapiro does not read science fiction, or this wouldn't all seem like new territory to him :)

Something he doesn't mention at all, though, is much more concerning to me.  That is the fact that this software will be wrong very often – maybe even most of the time.  Imagine an app that listens to someone you're talking to on the phone, and tells you whether they're telling the truth.  If your caller says “I’d love to go to dinner with you!” and the app says they're lying – but they're actually telling the truth – that's going to be a problem.  Or, if your caller says “That’s too expensive for me!” and the app says they're telling the truth – but they're actually lying – that's also going to be a problem.  And those apps will make these sorts of errors, because assessing emotional state or verity is not an exact science.  Like “lie detectors”, there's not really solid evidence that these things work outside of carefully controlled (and possibly carefully constructed) test scenarios.  The current state of the art here isn't much different than a Ouija board – which means that about half of Americans will believe they're infallible. 

This I find very worrisome...

Snow in Paradise...

Snow in Paradise...  Snow showers are forecast for here today.  That is all...

“Their little heads are exploding.”

“Their little heads are exploding.”  A sixth grade class (with an unusually gifted teacher!) attacks a simple, but interesting numerical problem.  The results were different than my intuited result, but the blow-by-blow description of the class' result is fascinating...

Trap a cat in a circle...

Trap a cat in a circle...  This is weird, and I'm skeptical.  I've asked Debbie to see if she can verify this experimentally...

Some non-deterministic software makes me uncomfortable...

Some non-deterministic software makes me uncomfortable...  Reading this article about flaws in neural networks got me thinking about some of my own experiences with non-deterministic software.

There are two big areas of software I'm aware of whose outputs are not (necessarily) determined by its inputs: many kinds of AI, and genetic programming.

Some kinds of (so called) artificial intelligence (or AI) use non-deterministic “learning” mechanisms that result in a system that produces outputs from its inputs in a way that no human understands.  I'm not saying that these systems aren't useful, because they demonstrably are useful.  I first ran into such a system when interviewing with a company that made software to evaluate the risk in credit applications.  In the interviewing process I was left alone for a few hours with a computer running a development version of their software.  This let me play around with various inputs and see how they changed the output – and I very quickly spotted some things that looked like big problems to me.  For instance, I noted that if I varied the applicant's annual income up in $100 increments, the output would vary from “recommend approval”  to “recommend disapproval” in an apparently random way.  It's hard to imagine any real world justification for that!  When I inquired about that response, I was told that nobody knew why that happened, exactly; they just knew that the “network” had learned that somehow.  As a software developer, this makes me uncomfortable, and distrustful of the results.  This is the kind of software application that (it seems to me) should be deterministic – but it's not.

Genetic programming attempts to find solutions for problems through the same sort of mechanisms through which life has evolved.  The basic method is to try various approaches, randomly selected, and let the winners survive through some sort of Darwinian filtering.  This is a concept I find fascinating, as it has the potential to solve problems that no human software engineer has ever found a solution for.  Implementing genetic programming is a tricky thing to do, and I've only played around with it a little bit.  Only twice did I manage to “evolve” a program that actually accomplished something (that is, produced the desired results) – and in one of these cases, the result was better (meaning faster, in this case) than what I did by hand.  This better result was for a sorting program written in Java.  The test that controlled the evolution of my genetic program took 10 sets of data as inputs, and sorted them all correctly.  I ran the evolution part of the program for about a month on a Linux server, where it consumed one core for that entire time – that's a lot of computing!  The result was three times faster than my hand implementation of Quicksort, and four times faster than the standard Java library's sort method.  The code itself was complete gobbledegook, a couple thousand lines of incomprehensible lunacy that I spent a week trying to reverse-engineer but totally failed.  Somewhere during that week it occurred to me to try other datasets on the genetic algorithm, and here I found some fascinating results.  On some datasets, the algorithm never terminated – bad.  On some datasets it sorted correctly, but slower than Quicksort – moderately bad.  On most datasets, it sorted very quickly – but incorrectly.  Very bad!  How could one ever trust the result of a genetically derived sort algorithm?  I don't think you could.  My conclusion to that is that genetic programming is really only useful when the entire set of possible inputs can be tested – and that's a very limited set of problems, indeed.

I'm much more comfortable with deterministic software.  Some would argue, though, that all software is non-deterministic – because of the bugs lurking within.  They may be right :) 

Scott Adams is a fascinating person...

Scott Adams is a fascinating person...  I first ran across his work through his Dilbert cartoon.  Reading the day's strip is still a morning ritual for me, and more often than not results in a hearty laugh-out-loud for this geek.  He captures the office dynamics so perfectly, and finds a way to make them funny.

Then I started reading his blog, and later a couple of books.  Both of these are full of meaty, interesting ideas and concepts – somehow not something I ever expected from a cartoonist.  I don't know where or how I acquired the notion that a cartoonist wouldn't be that interesting a person, but clearly I did – because reading Adams' prose surprised me.  A lot.

This morning I read another great example, on his blog.  A key paragraph:
The winner worldview is that you have responsibility for your own life and it is irrelevant who is at fault if the people at fault can't or won't fix the problem. I've noticed over the course of my life that winners ignore questions of blame and fault and look for solutions they can personally influence. Losers blame others for their problems and expect that to produce results.
This resonates very strongly with me, as I had a similar revelation early in my adult life.  In my case, it happened while I was in the Navy.  The trigger was a very clear one: my bosses told me that I was doing such a great job that I couldn't go on vacation (the Navy calls this “leave”).  It was clear they weren't going to change their minds – so I went on a sort of intellectual strike: I stopped knowing how to fix computers (my job).  They got the message, and we made an explicit agreement: I'd get my vacation, and I would start knowing how to fix computers again.  That was a formative experience – after that, there are many occasions when I reached some objective by finding my own way to get it done.

If you enjoy reading someone with a unique and refreshing perspective on the world, I recommend Scott Adams' blog and books.  His cartoons aren't bad, either :)

“The first thing we do, let’s kill all the lawyers.”

“The first thing we do, let’s kill all the lawyers.”  That famous quote is from Shakespeare's Henry the Sixth.  I think that's a little more extreme than I'm comfortable with.  A little.

But I'd be ok with banning lawyers from public office, including (especially) Congress and the Presidency.  There was a time when Supreme Court justices were often not lawyers, as well – and I'm not at all sure that was a bad idea.

So I absolutely loved the ad at right!

Saturday, November 1, 2014

Oh, it burns!

Oh, it burns!  The ignorance of American college students. it burns!  How the hell did these people graduate from high school?  Or get admitted to college?

And then what were those other questions about, the ones they (apparently) all got right, instantly?  I'm guessing that they were Hollywood celebrities, or maybe sports.

I hear the drums of doom getting closer, as America works hard on becoming the most unserious nation evah...

Not your mother's music boxes...

Not your mother's music boxes...

Friday, October 31, 2014

RIP, Halala Pala...

RIP, Halala Pala...  Debbie took Halala into see the cancer specialist today, after he had rather a bad week.  Halala didn't want to eat, and didn't want to be out with Debbie or the other cats – definitely not a good sign for him.  Longtime readers will know that we've been helping him fight cancer for close to three years now, and most of that time he was in remission.  Just the last couple of months he's had a relapse, and the chemo wasn't working.  When his oncologist (the wonderful Dr. Geist at VCA in Kearney Mesa) examined him today, he told Debbie there really wasn't anything left to be done.  He was clearly suffering and there was no realistic chance of recovery, so poor Debbie made the call by herself (as I'm up in Utah) to put him to sleep.  She held him as he went down.

Halala Pala has been a special cat in our household for almost ten years.  We're pretty certain he was a Maine Coon, either purebred or close to it.  He had all the classic Maine Coon attributes: fat, fuzzy, affectionate, and tiny voice more suited to a mouse than to a cat of his portly magnificence.  He loved to chase a laser pointer or feather on a string.  Oh, and he loved to eat :)

He was one of the cutest kittens I've ever seen (first picture below).  Not just his appearance, but his behavior as well.  You'd never guess that such a cute little kitten would, two years later, attain the level of magnificence you see in the second photo – but he did.  The rest of the photos were taken recently, when he was still in remission.  I've written about him several times before.

We'll miss you, Halala Pala.  We rescued you, and we're grateful for the the years of affection and companionship you gave us...

Allen wrench...

Allen wrench...  The photo at right shows the end of a 4mm Allen wrench at 60x.  The side to the right of center is visibly deformed, as is the center peak. 

I threw this under the microscope because I could feel the deformation, but not really see it with my naked eye.  It surprised me that I apparently had more “resolution” with my fingertips than with my eyeball...

Portugal's experience with decriminalizing drugs...

Portugal's experience with decriminalizing drugs...  Interesting material. 

I've read several more formal studies that primarily concentrate on two things: the impact on crime, and the impact on society more generally.  In both areas Portugal has shown rather large improvements since 2002, when the country decriminalized drug possession.  Most interesting to me is that the improvements track quite closely the major claims of American libertarians (including me!) who advocate decriminalization here: large decreases in property crimes, and large decreases in the number of young men in jail.  One big surprise to me: Portugal is seeing much lower rates of domestic violence.  Of course, with any studies such as these, there is no proof of causation.  All we have is the lagging correlation, which is suggestive, but not proof...

Animal sculptures in stainless steel...

Animal sculptures in stainless steel ... by Korean artist Byeong Doo Moon...

Shades of 1984...

Shades of 1984...  Except these always-watching, always-listening screens are things you buy voluntarily, and the data is being used commercially.  For now.

Is this a different kind of impact than other technology advances have made upon us?  I think it's only different in its details, really.  As with most other advances, there are benefits and there are drawbacks.  Loss of privacy, whether actual or perceived, is definitely a drawback.  Convenience and ease of use are definitely benefits - if I can say "Show C-SPAN" rather than picking up the remote, scrolling through the directory to find C-SPAN, and then clicking to show the channel, I'd much prefer the simple voice command.

One thing you can depend on about technology advances: if there's competition, the manufacturers will be falling all over themselves to provide what consumers actually want.  If the majority of consumers say they want privacy protection (in particular, if they're willing to pay for that), the manufacturers will be providing it.  Unfortunately, it seems that we can also depend on our own government to exploit technology to snoop on us – this I find far more worrisome than the commercial use.  Apple's recent cloud encryption decision may point a way for manufacturers to shield their consumers from the possibility of government snooping – and I, for one, would absolutely pay for that!

180 million years old...

180 million years old...  That's the age of the incredibly detailed fossilized fern at right, buried by ancient lava in what is Sweden today...

Rockets are hard...

Rockets are hard...  Astronaut Don Pettit on the tyranny of the rocket equation.  It's an easy read, no math, and a good introduction to the reasons why rocket engineering is so hard – which is why rockets blow up more than cars do...