Anita Blake repeatedly mentions how little she likes small talk, and how much she appreciates those characters who don't indulge in it either, like Dolph and Edward.
RCN: Adlele Mundy has no patience for conversation that does not convey data, and prefers to get her data electronically without any conversation at all.
Live Action TV
Sheldon from The Big Bang Theory. It's not that he hates small talk; it's that his idea of small talk consists of advanced physics theory, comic book and Star Trek canon, and obscure factoids he finds fascinating (even if no one else does). Things such as gossip, sports or personal relationships, he couldn't care less about.
Both Worf and Odo hate small talk. Inevitably this leads to a conversation in Star Trek: Deep Space Nine where they make small talk...about how they hate small talk.
In Star Trek: The Next Generation, Captain Picard is not a big fan of small talk. In fact, when Data attempted to make small talk with him, he directed the android to keep an eye on someone who was notorious for being big on small talk. Data follows that order and the rest of the crew look in amazement as the resulting conversation rapidly shrinks to microscopic proportions.
The "Vocational Guidance Counsellor" sketch from Monty Python's Flying Circus has this exchange between Palin and Cleese (no prizes for guessing who plays what):
Counsellor: Ah, Mr Anchovy! Do sit down.
Mr Anchovy: Thank you. Take the weight off the feet, eh? Lovely weather for the time of year I must say!
Counsellor: Enough of this gay banter.
In the crime-lab show Bones, one of the regularly-repeating crew of interns is constantly frustrated by the amount of time the main characters spend discussing their personal lives and dramas, so much so that "can we talk about the job, please" is basically his Catch Phrase. Of course, on the rare occasions when he talks about his personal life, everyone else expresses shock at how unprofessional he's being.
Going round in circles, hearing too many points of view Just words to tire me out, small talk I could do without I would be amazed if you returned to see things my way Now that you've been disrespectful to my sense of pride
The song "Everybody But Me" by Lykke Li covers this pretty well.
In The Venture Brothers episode with the Walt DisneyExpy Mr. Brisbee, Brock at first tries to get along with Brisbee's bodyguard, but the other is completely silent and rude. Later on Brock is bored and tries to light a cigarette but can't, at which point the other bodyguard produces a lighter, prompting Brock to say "You're all right." Of course, it was all a trick to knock him out.
Lemongrab of Adventure Time tends to be like this, thanks to his almost total lack of social skills. He prefers sending people to the dungeon without a peep to actually discussing problems.
This is why introverts are perceived as not being very talkative by so many, in fact. They don't like making small talk, but if they're asked about a subject they enjoy talking about, it may be difficult to get them to shut up.
Phil Hill, the first American to win a Formula One championship has been described as being uneasy making small talk, but welcoming of a serious discussion on any topic.
Steve Wozniak, one of the fathers of the modern computer, also hates small talk, which he has said is part of what made him so interested in computers. If he wasn't so asocial he wouldn't have become so interested in electronics in the first place.
In the Finnish language, the closest thing there is to a expression for "small talk" can also be roughly translated to "grinding shit." The implication is that you are moving your mouth, but you are not doing anything useful with it.