Difficult

I'm not man's best friend, I'm their enemy, I can mark your end, yet you do not see me, I am very small, but very tough, If you have me, then you have it rough.