The rocky planets, and our Moon, have rocky crusts. Some moons such as Europa, a Moon of Jupiter, have an icy crust.
A planet or moon is not made entirely of the substances in the crust. There are other layers below the crust, and these are made of other materials. For example, the Earth's crust has a layer called the mantle below it. This is made of hot rock which flows very slowly.