My suggestion is to listen different type of speaker and see which one you like the most. You can put 60-70% of your budget in the speaker.
After choosing the speaker, or the sound which suits you, select the amp and CD player. Trust me, the difference between amp and CD player is almost neligible. Nowadays we use CD as audio source, the quality from CD is already very high compare to the era using tape or LP.