take your time, I know how a single thing can make you blow up, just ensure you don't make a rash decision and take a break. just know you shouldn't let others rip you down. this story is yours, tell the story you want to tell. don't give the trolls the attention they crave. your best bet is to ignore them. they want a reaction, and they got one. so spend some time on yourself, we are not going anywhere.
I have seen many like you author who are put off by a bad comment (luckily, as you say, they have more readers who support it). - do not get carried away by small negative comments (you should feel good, since you can write a story, while the one who criticizes, the only thing he knows is to criticize because he cannot create his own story, just go ahead only writing for loyal readers who want to see the end of their story).