Michael's turn carrying the Jerkass Ball climaxes with him swiping Mary Poppins' magic compass. Instead of naming the four directions one at a time, he quickly says all of them in a row. This causes everyone that Michael and the others met during their first journey with the compass to surround him with bloodthirsty expressions. The sight scares Michael into dropping the Jerkass Ball by the time Mary Poppins swoops him back to the nursery.
Michael has a similar experience in one of the other books, after journeying to a star inhabited by talking cats. He becomes seemingly unable to return home because time passes more slowly on the star than on Earth, and during the time he spent with the cats, everyone in Michael's family died. Their house also became abandoned.
When Jane and Michael flee the bank through an alleyway, and encounter a creepy old lady, a large black dog, and a shadowy figure. (Fortunately, the last one is just Bert covered in soot.)
It doesn't even help that the old crone they ran into was played by Betty Lou Gerson, the voice of Cruella De Vil.
Bert's verse of "Chim-Chim-iney" where he sings about "the chimney sweep world" is very accidentally unnerving and sinister sounding. Particularly how he ends it with an almost maniacal smile after singing "on the rooftops of London...man, what a sight!"
Just... the way Dick Van Dyke reads the line "There's things half in shadow... and halfway in light". Chills, man.
The stage musical features a new, scary number called 'Temper, Temper' where Jane and Michael's toys grow bigger than they are, come to life, and hold them trial for breaking their tempers. Remember all the mean things you did to your toys? Cover your children's eyes... and your own.
The song was deemed so scary that it has been replaced with 'Playing the Game' in the Broadway version. It was also part of the reason the producers would not allow any child under the age of three into the theatre during its London run and stated that the show was meant for children age 7 and up.