Do the edges of his fins look a little bit red? Is there any white fluffy things on them? It could be some kind of infection or fungus, like fin rot.
I'd change half the water in the container and add something like melafix or stress coat and see how he does. If he looks sick or it gets any worse, take him to a real aquarium and ask them what you can do