A smart Puppeteer will set things up so they don't seem too suspicious, but gaps in memory are a problem if they want to leave or jump hosts, yes.