If you are going to create a character reincarnated in another world but he has no memory of his past life, then why not make the character a native of that world? Furthermore, in a reincarnation story, it is correct for the character to have their memories.