Unscrew the bolts connecting the toilet tank to the bowl. Carefully lift the tank off the bowl and set it aside. With a utility knife, cut through the caulk around the base of the toilet.