just use a rubber mallot i had to pund on mine pretty good to get it off sometimes it seizes on there try some penetrating oil and let it sit an hour or so then pound on it. it'll come.
If you have never had it apart before it may come off a little hard, but there is nothing "holding" it onto the shaft except the caliper. It is a keyed shaft.