Hollywood keeps crying.

Hollywood keeps crying.  When I try to pet him, he hisses.  When I go away, he cries.  I almost feel like I should hold him, but I don't want to hurt him / freak him out.  I'm torn.  What should I do?