When there is a rider nearby and you are going to be chased by it, equip your axe and keep it ready. Once the rider runs you over, do not flee if there are no other enemies around. Instead, run under the horse and attack it with the axe. It should not charge unless you are a good distance away. This allows an easy kill. If possible, get rid of riders by doing this before they charge.