If it is aiptasia I know some one who makes their own stuff to get rid of them. He states that its basically pepper juice, thats what kills them he thinks (I dont know, have to test that). Yes you have to get rid of them, they can sting corals and harm them, and they can multiply like crazy.