Ping Issues with doing party xp grind, WE or Raids

Recently I've done Xp grinds and world events to level up for Fruma content, I've realised that my ping goes insane (100k-300k Ping) everytime I do Anything that has lots of entities and with a party, when I am in a server where I have around 20-100 Ping and I go do Xp grind and there are other players doing the same thing on the same server, my ping yet again goes insane. Even tho i belive my internet is just bad, this also happens on servers where I get good ping, so i belive it has something to do with there being lots of entities.

If anyone also have/had the same issue and has solved it, Please tell me how. Thanks!