After watching for a few hours yesterday morning, I can assure you that when one parent flies off, the other is very close to the nest box. You may not see them on camera. They don't leave it undefended.
Oh, and congrats on your first post Doggymom. Good question.