PM can no longer put off building national defences