I voted Toronto as I think they are the best team not in Boston, though I do think Philadelphia is a bigger "rival" just given the history and the fact that they have actually played recently in the playoffs.
I think there is also an argument for the Cavs as the team that has eliminated Boston from the playoffs the last 2 seasons and 3 of 4, though with James leaving I think that "rivalry" is gone.