[ There's no enmity coming from the Servant. It's simply how he is -- until proven otherwise, everything is a threat. He puts the spear upright in a neutral position now. It's not that Berserker feels safe, it's that he has no interest in another fight right now. Nothing would be gained from a fight here. ]

Bother me? Only in the sense it makes it harder to focus on my fight. I don't know if you're a threat or not, so I have to split my attention. It's an annoyance.