We both work during the day – can we give you a key?

Yes.
I am used to working in this way and it is probably best for you to be out of the way anyway –
the toilet may be removed during the day whilst work is going on, and building work can be
noisy anyway!