Game Ping (800+) Issue (Xbox)

[drag554]

About 1 in every 3 or 4 games recently, I will have +800 Ping throughout the whole game. If I close the game and reload, it will still make me framey and same ping. Regular games, I am about 40-60. Does anyone know if it's an issue with me connecting to the game? Just trying to figure out if this is happening to anyone else, or if there's something I need to mediate on my console. (One X)