If you are doing regular water changes, you should not need to. However, if you don't, and its a heavily planted tank, the plants may take up the calcium (they would show signs of deficiency too). In that case, you would want to supplement.
A 20% water change every two weeks, even if the ammonia and nitrite stay zero, and nitrates are under 40, will give you all the calcium you need (providing its well or city water, not RO water).