The fight of goku and berus when goku became the sayian God they that just the Shockwaves of their physical clash is enough to destroy the universe and whis had to stop the fight this proves that they are physical very strong even without ki blasts
you can also say that Dragon ball characters have excellent control over their forces limiting the damage they cause to the environment, in my opinion when Goku super Saiyan God and beerus were about to destroy the universe it's because goku didn't have full control of that shape
i do like the story so far, but ki takes time to train, making it make people auper strong instantly isnt what it can do, otherwise goku would be way way stronger in the start of og dragon ball since he is a saiyan...