The simplest way to speed up your Ubuntu desktop is to use Alltray.
Alltray is a tool you can use to park applications in the tray – that's the area of the panel where the volume controls and network applet reside.
The effect is "instant-on" applications.
Ubuntu is Linux, and a such it's inherently fast. The single slowest point of any Ubuntu desktop is the launching of applications.
On my P4-era laptop, Evolution, the default mail application, takes 4 to 5 seconds to launch. Alltray eliminates that launch delay, and docks the application for instant recall. – Admittedly, compared to the current Multi-Core processors found in newer computers, P4 is starting to get a little old. If you're stuck with a P3 or P4 however, AllTray will bring some snap back to your desktop.