Cannot interact with anything on a friend's server

[Exhho]

Everything worked well until I had a connexion issue and had to connect to my phone's hotspot
My friend also killed me, it may be the reason too
And I deleted my waypoints on the map

These 3 things happened before I realised I could not interact with anything anymore
Even though I'm in my friend's team, who can still open his chests, place blocks and everything

I tried to disconnect and come back, I even tried to close the game and come back but it fixed nothing

Thanks if anyone has an answer !