For Windows 7 users:

Windows Icon (start)--> All Programs--> Accessories--> System Tools--> Character map

There you can find it every letter imaginable, with the diaeresis even.
Windows XP users can find the same character map in following similar instructions but just slight difference.