To meet the need for Quality of Experience(QoE), the User Equipment(UE) has to handover frequently in the coverage area between Macro cell and Femto cell, with the increase of total handover times, the UE will occupy some physical resources continuously, resulting in lower system throughput. Relational intimacy degree handover algorithm of Long Term Evolution(LTE) heterogeneous network is proposed, which estimates the relational intimacy between UE and Femto cell by gathering the historical information of the former access to the latter, then sorts the priority ordering for UE waited for handover by using this attribute, and makes the handover decision by taking the receiving signal strength, speed and Femto cell bandwidth available into account. Simulation results show that the proposed algorithm can reduce the total handover times obviously, avoid the unnecessary handover times and improve the system throughput effectively.