They would need at least 100,000,000 troops to do it. Being able to spread across all of the Northern border and all attack at once would make it impossible to defend. Not to mention having a secured base of operations and food source that doesn't depend on crossing an ocean to feed their army.