Rhythmbox now has Magnatune integration. Magnatune is a music service which 'isn't evil', and even lets you choose how much you pay for the music you buy. It's definitely worth a try, although my taste in music doesn't seem to be particularly well represented unfortunately.
Rhythmbox allows you to play Magnatune tracks in full, and you can buy the album using Rhythmbox itself. Go for it!