This is why Durant going to GS seemed like a no-win move, perception-wise. They're not winning 73 again, so they will be dogged all year with questions about whether he's hurting the team, making other players disillusioned, etc etc. There's no avoiding it, and as the most prominent team in the league it will be constant.
There's basically no chance it will go away until they win a ring, but even then they won one without him, so there will likely be criticism that he didn't really improve the team, didn't really earn the ring, etc. And that's if they win one soon. If they go a season or two without a championship it will be deafening. The flak Miami took in the first LeBron year times 2 or 3.