I agree with salty, is your rock caribbean? Those encrusting sps are pretty common on caribbean rock, I have 3 or 4 that came on mine, they are super hardy too.
Sponge should be fine, so long as it doesn't start to choke any corals, just keep an eye on it.