Under Windows, it's probably going to be easier to develop something if the primary purpose is to make a Windows application. So I'd recommend C# in that case. VS Express is free and good enough for most projects.
From the general perspective, Python is a nice language to start from.
From the general perspective, Python is a nice language to start from.