Tbh I think Consider Phlebas is one of the weakest Culture novels, so I’d absolutely give Player of Games a shot! I started with that one, and it does a much better job at showing The Culture’s society than the mere outside glances we get from Phlebas.

With the possible exception of Phlebas, I recommend going through the series in publication order. But feel free to skip Inversions and State of the Art, imho they both mostly suck 😅 The rest of the books are great :)