Is it possible to leave the site as a swim guest during a swimming bath visit?

No, partly for the prevention of fraud, it is not possible to leave the site and then re-enter, without paying.