What am I?

Brown I am and much admired. Many horses have I tried. Tire a horse and worry a man, tell me this riddle if you can. What am I?