If you set a story to public you still, as editor have certain controls over the contributions to the story. Threads need to be approved by the editor. If you believe they are incompatible or too badly written or too short a thread you can reject them. For minor errors, such as spelling or getting established facts wrong you can edit threads before you approve them.
As far as I know you cannot contact people leaving feedback through the story site. Only on this forum section, providing they have registered here also and are registered by the same name with which they left the feedback.