My pearl gouramis act very similar sometimes. If I do something 'suspicious' like put my hand near the top and they don't see any food they kinda freak out. Or if I make any sudden moves around them they don't like that. Usually when they get frightened they will sink to the bottom of the tank and hide in the corner for an hour or so.