The guy who said the thing

It was James Garfield.

The audio version of Sarah Vowell's wonderful Assassination Vacation features Jon Stewart as the voice of Garfield. He's quite good.