Exclude Git Ignored Files from Indexing

Settings -> Version Control -> Git -> Automatically exclude ignored directories from the indexing

For some reason this wasn't set to TRUE in my settings,

So could be worth checking your settings for this value as well.