Yogis are not against pleasure. It is just that they are unwilling to settle for little pleasures. They are greedy.