Yes, I've used Go. The compiler is fast and that's really nice; fast compilation was one of their explicit goals.
Pascal and C are fast because they're old and relatively simple, and their implementations are mature.
C++ becomes super slow when you start doing anything interesting, when I tried Rust it seemed very slow, even Java is slow although it seems like it shouldn't have to be. Those languages are all more widely used than D, I think.