A costly item is expensive, but the price itself is not expensive; neither does a cheap item have a cheap price. Prices are high or low, not expensive or cheap.