Wiki
When you hover over a fogged capital territory the [Capital] label is not displayed in the pop-up.
It's by design - the capital could have been destroyed which would tell you about ownership.
Didn't think of that. Thanks.