Given that it is actually one of my all time favourite algorithms, I thought it worthwhile to include a link to a great article on Simulated Annealing. When I used to play around with neural networks, this was a great way to find close-to-optimal solutions.