He should have first beaten them with a wooden stick or something to avoid exposing his sword. The quietly followed behind and killed them somewhere quiet
My first impulse was he could have killed them using something like a stick and kept the sword concealed but quickly realized he'd have still ended up terrifying the villagers and they'd have still reacted like they did so might as well use the sword and get things over with.