There is something self-defeating in the too-conscious pursuit of pleasure.
Max Eastman
Most men pursue pleasure with such breathless haste that they hurry past it.
Soren Kierkegaard
Why not seize the pleasure at once, how often is happiness destroyed by preparation, foolish preparations.
Jane Austen
The essence of pleasure is spontaneity.
Germaine Greer
Pleasure is the bait of sin.
Plato

Pleasure is indeed the bait of sin. Long live Plato!
To sin I would add GREED.
But we have to allow ourselves small pleasures. At the very least, be kind to ourselves so that we can recognize the small pleasures in life.