using .X as a terrain may not be the best way to do this, as large .x files can slow down your game/program considerably. try to find a .x->.bsp converter and make your map into a quake3 .pk3 map.
however, if you must use .X, just load it like you would a model.