I am careful to rate all the boards I play public games on. But I have an unrated board I can't rate. I'd like the notification t to disappear, is that possible?

The reason it came on the list is that I played a game that was terminated and haven't revisited the board since. 

Probably not. 

You could start another game on that board, finish it, then rate it...