When you don't get happiness naturally, you have to find it elsewhere if you want to live in decent peace. Even though his happiness was Liuyun, knowing it's impossible, it's best to settle for next best possible option instead of drowning in misery.
Let's see if Fujiwara will be able to move on.