Simon Rex attempted comedy last night ... he should stick to solo porn!

TMZ got the "Scary Move" star leaving Les Deux in Hollywood, where after posing with a few fans -- who knew he had so many? -- he joked, "Jerry Lewis was in there, so weird, and his kids!"

*hook*