Calling someone “callous” is a way of metaphorically suggesting a lack of feeling similar to that caused by calluses on the skin, but if you are speaking literally of the tough build-up on a person’s hand or feet, the word you need is “callused.”