I was using click-to-play whitelisting for all plugins for a bit and it didn't work really well for me. There are some services that use hidden flash movies, like how grooveshark plays audio. There is no where to click to allow it so you just can't use the service with that feature enabled.

I've been using noscript intstead. It provides an easier interface for approving plugins and more.