I agree, although I prefer a physical computer or shared session to whiteboard. I always tell interviewees that they can use pseudo-code or make up functions as long as they explain what they are intended to do. This takes the pressure off of knowing specific language constructs and leads to better overall assessment in my experience.
Using this method, you could have revoked AWS keys notify you if someone who recently quit your team or was fired is attempting to access your systems.