How advanced can you go with C#?

With C# and XNA, you can make a VERY advanced game... one that would even play on the Xbox 360. And the language is powerful enough to create pretty much any GUI-based or command-line program you would want.