Not really. Think about it, he’ll be back there eventually after canon starts and we’ll see a grown up Robin who will remember him fondly and be grateful instead of in canon where she was unable to fully trust anyone most of her life and then there’ll be Nami too.