Graham had probably beat Arthur and kidnapped Minny so he was scared of them at the end of his life
It seemed foolish in this type of situation to suggest such a thing. Sure Arthur was strong, perhaps stronger than Bryce, and maybe enough to take on Bryce and Cindy, but what about the rest, including the Dalki that he was scared of at the time