Freed hostage’s dad: ‘Of course’ we wanted him back earlier but gov’t also has security concerns