When you find yourself trying to remember a show (or any works) that's on the tip of your tongue but just out of reach, come here - the collective brain of the TVTropes community can probably help. Post all the details you can remember (examples help). If you're looking for a trope, head over to Trope Finder. Have general questions about tropes? Visit Ask The Tropers!
The most immediate and obvious thing that comes to mind for me is Miss Spider's Sunny Patch Friends. Are you thinking of that?
Alternatively, could you be thinking of Bug Diaries, which also has a spider character that is yellow or yellowish brown, at least in the head area anyway?
Edited by JMQwilleran
^ I concur. If it was from the Turn of the Millennium and an All-CGI Cartoon, that points you further in Miss Spider's direction.
Rock'n'roll never dies!
It had a yellow spider and it was a female spider.