"NO"
Technically yes, since your realesing sperm when you masturbate, but it usually won't affect you in long term perspective, unless you do it way too much. Your sperm cells are constantly making more of themselves so it's no big deal to lose a few every once in a while.
