After the glue is softened, use the metal spudger to scrape the glue away.

You may need to use the iOpener more than once per speaker, but be sure to follow the instructions for the iOpener so as not to overheat it.