Naruto The Abridged Series has the Third Hokage, Gladas the Village Elder and Bob the Other Village Elder (who still can't be Hokage).
Yugi's grandpa in Yu Gi Oh The Abridged Series. He frequently fantasies about dying as he hates his life so much, is increasingly senile and seems to find nothing in life enjoyable. Except of course, for his rendezvous with the poster of the Black Luster Soldier …
Anime and Manga
Genryusai Shigekuni Yamamoto from Bleach, a shinigami pushing at least several thousand years, who constantly complains about the younger generation of shinigami when he is forced into battle. Counteracted by the fact that he is a Badass Grandpa.
Everyone is a kid to him and even when he does fight he speaks to his opponents as though they're naughty children he has to punish.
The movie Grumpy Old Men, featuring Jack Lemmon and Walter Matthau, which focuses on two such characters fighting amongst themselves over old-man stuff and ages-long grudges. It got a sequel, Grumpier Old Men.
Mr. Nebbercracker in Monster House is shown at first to be the basic "Stay off my lawn" old man who took any toy that came near his house. However later it is revealed that this is a cover for his true intentions of protecting kids from the wrath of Constance, his child-hating deceased wife who has possessed his house for 40-so years and eats anybody who comes too close to her. Basically anytime he yells "Stay off my lawn" it is not so much a threat as it is a warning. Ultimately the main characters set her spirit free by blowing up the house and he loses his crotchety behavior, happily giving back all the toys he confiscated to everyone in the neighborhood.
There was a Saturday Night Live character, played by Dana Carvey, who was actually called "A Grumpy Old Man". Every time he appeared on the show, he would make a rant against modern-day society, starting off with his Catch Phrase ("I'm old and I'm not happy!"), contrasting how things were in his day. ("In my day we didn't have hair dryers! If you wanted to blow dry your hair you stood outside during a hurricane. Your hair was dry, but you had a sharp piece of wood driven clear through your skull! And that's the way it was and you liked it! You loved it! Whoopee, I'm a human head-kabob!")
Adam Schiff and, to a lesser degree, Arthur Branch on Law & Order.
The BBC series of one-off TV shows Grumpy Old X takes a bunch of Real Life grumpy old celebrities, and has them do talking heads about whatever the x is this time. The initial ones were Grumpy Old Men and Grumpy Old Women, more recently there have been things like Grumpy Old Holidays, Grumpy Old Christmas etc etc etc.
Captain Picard of Star Trek: The Next Generation started out as this, yelling at Wesley for coming onto his bridge. Becoming more of a Cool Old Guy when the series took off, though he still held onto some of the traits of grumpyness.
Peo Persson from Vintergatan, every installment — though he lightens up off-work, and with his wife. Of course, his wife is frequently kidnapped, so this isn't often. He has become less of this later, though, instead becoming more of a jaunty old man.
Andy Rooney on 60 Minutes embodies this trope so perfectly, it's usually pretty hard to take him seriously. Honestly, he probably knows how ridiculous some of his gripes are, but he also doesn't care.
The "Old Man" of Pawn Stars of ten reminiscence about the "good old days". Never seen even cracking a smile.
Lampshaded and subverted by the Youtube-based anime-reviewer, Grumpy Jii-san (lit., 'grumpy grandpa'). Very rarely does he ever make some sort of complaint against something new, despite his name, and he has adapted to modern times quite well, going so far as to review anime that is being streamed on the internet. Jii-san also has some editing prowess: in his review of Irresponsible Captain Tylor, Jii-san spliced images of himself into the intro of the anime. Every now and then, he brings out some Laserdiscs, or references some old movies or artifacts.
Grumpy Jii-San *during his review of Baccano!*: "For that matter, does anyone even remember passenger trains?"
Ed Crankshaft, originally from Funky Winkerbean then later spun off into his own strip, Crankshaft. He's not only a Grumpy Old Man, he's a school-bus driver, who keeps a running tally of how many times he's destroyed his neighbor George Keesterman's mailbox with the bus, and how far he can make parents or the kids chase the bus before they give up.
Funky himself seems to have (d)evolved into this, after Time Skip #2.
In one Dilbert strip, a scowling employee says that he had only plain zeros and ones to work with when he started programming, and sometimes not even ones.
Comedian Godfrey's own father qualified. What makes this funnier is that his father is Nigerian, and is acted with an appropriate accent. When l'il Godfrey complained about missing the bus, he talked about how he had to walk one hundred miles to school every day. When Godfrey had managed to save up $195 towards $200 Air Jordans and asked for a loan, his father talked about how, in their day, he did not have feet. He had to borrow his feet.
Billy Crystal used to do routines based on his own grandfather, talking about the Bad Old Days ("Happiness? What happiness? We were miserable, and we loved it, goddammit!"). Listening to the routine, it's clear that he based Miracle Max off of this character.
Long Beards in Warhammer. Their special ability allows units to reroll a morale test to prevent their grumpy leers and words of "told you so".
Jolee Bindo from Knights of the Old Republic is an interesting example, he purposefully acts like a stereotypical Grumpy Old Man because he finds humor in it and (jokingly?) thinks youth expects him to act like it.
Ezio Auditore has become this by the time Assassin's Creed: Embers takes place. He's 65, and just wants to enjoy what little time he has left with his family in peace, away from the Templars and the Assassins, which is why he doesn't take too kindly to Shao Jun pulling him back into it all. However, he does warm up, in typical Ezio fashion, once he gets to know her properly.
Huang Zhong from Dynasty Warriors, a Badass Grandpa at 62, defeating generals half his age. He also tends to make comments that have him come across less like a legendary Chinese hero and more like a cranky old man with a bow and arrows.
Played with in the Futurama episode "A Clone of My Own". When Fry has to pretend to be the professor so the Planet Express crew can sneak into the Near-Death Star, but the robot guards are skeptical about his age, Fry instantly convinces them he is a 160-year-old man by shouting "Hey, you kids! Get off my lawn!"
Grandpa: … and your Blu-Ray Discs and your pierced scrotums and your bull frogs and your telekinesis and your Marvel Comics and your YouTube.com and your nuclear physics and your ingrowing toenails and your Gears of War and your Quentin Tarantino and your power steering and your elevators and your six-person space capsules and your illegitimate offspring and your — hey, why did it fade to black? Am I dead?'' Yugi: No, Gramps. It's just the end of the trope. Grandpa: Oh, fiddlesticks!