7

Stack exchange has a strong history of answering questions like "Why is this code broken? How do I fix this? What is the best way to write this algorithm?"

It is strange to me that this is not allowed in the writing community on this site; which is not to say I don't see why there is such a rule. Anyone can submit bad writing, at higher flow rates and in ways that are harder to categorize, than perhaps code questions are. But, if it is the case questions on specific works are going to always be off limits, it does seem largely at odds with the purpose of the rest of the exchanges.

I thought I'd re-challenge this restriction on this site as in my mind it is the main thing that would prevent me from voting for this stack to leave beta status.

In short, I think the the main reason this stack doesn't "fit" SE and the largest problem to solve for the long term health of the site.


If the rule were going to change, what would need to be in place to support it? Does SE have the tools to divert critiques into a classification that doesn't drown out the professional development/skill level questions we do a relatively decent job supporting today?

1
  • 2
    It looks like that's not a valid path forward. Either we do it here or it doesn't happen on this site.
    – Kirk
    Aug 27, 2018 at 1:38

5 Answers 5

10

Not strictly an answer, but some thoughts.

"Why is this code broken? How do I fix this? What is the best way to write this algorithm?"

"Why is this code broken?" and "How do I fix this?" are (usually) two ways of saying the same thing, so I'll lump them together. Assuming an otherwise clearly written question, it'll be pretty clear what the person asking the question is after. However, it's worth noting that e.g. Stack Overflow has a specific off-topic close reason for "debugging help" questions "without a clear problem statement", as well as one for "problem[s] that can no longer be reproduced or [] simple typographical error[s]".

Many critique questions are largely similar, except with natural language instead of code. "How can I improve this text?" is not really an answerable question; there are far too many ways that any non-trivial chunk of text can, in someone's eyes, be "improved". On the flip side, "here is an example of my writing that I feel is lacking in X; what techniques can I use to emphasize the X?" can be answered with experience, and to my reading is already on topic under the "own writing as examples" exception to the critique questions ban. Even something like "why doesn't this text evoke any emotions?" can in principle be rephrased into "what techniques can I use on a text like this to evoke emotions in the reader?", at which point it becomes a question about technique rather than a question about the specific block of text while still giving the OP what they are likely to be after.

An unqualified "what is the best way to write this algorithm?" would almost certainly get closed over on Software Engineering (which would likely be the most appropriate site for that type of question) as either unclear or too broad. However, if one qualifies it with what the most important factor is (run time? memory usage? how either grows in the size of the input? etc.), and asks for algorithms to solve a given problem, then it'd probably be acceptable, but at that point, we're back to the distinction between solving a generally applicable problem and critiquing something specific already written.

The closest thing to critique requests that we can find on Stack Exchange is probably Code Review, and as you'll notice if you browse their site, they often get multiple very different answers to a single question, but each answer tends to point out one or more issues with the code in question and propose fixes. If we want to discuss allowing critique questions, I suspect that we'll need to take a few pages out of their book. Notice that they pretty much spend their entire "What topics can I ask about here?" page just to outline what is required for a question to be on-topic with them. Code critiques also have one major benefit over writing critiques, in that it's (a) immediately obvious if the answer works at all (does the code compile?), and (b) one can tell somewhat objectively whether the code still does what OP describe as its original purpose. An answer that meets both of those criteria is likely providing worthwhile feedback on the code, even if it is feedback that OP might perhaps not enjoy, while an answer that fails to meet one or both of those criteria is clearly not a useful answer. I can't quite tell what similar criteria would be for natural-language text critique questions, given that the bar for "what works" and "does the same thing" are both higher and fuzzier.

in my mind it is the main thing that would prevent me from voting for this stack to leave beta status.

Unfortunately in a sense, that's not a vote the community can make. It's even out of the hands of the moderators. Even though all our other stats are "Excellent", it has been repeatedly mentioned that 10 questions per day is a strict limit to graduation under the current scheme. Although there has been some discussion about changing what graduation means, my understanding at this point is that the questions per day metric remains extremely important for The Powers That Be.

What I really think that we shouldn't do is to sacrifice quality for sheer number of questions. It would probably be easy to get to 10 q/d if we considerably lowered our standards for what constitutes a good question, but I suspect that doing so would also drive away a lot of users. In my opinion, that's not the proper trade-off to do.

5
  • 1
    Good info, all around. I'm not proposing changing the rule for the sake of a higher question count, though that would happen. It just seems to me we've narrowed the purpose of this site, and that it's worth thinking about how we would expand it, responsibly, since there is a consistent stream of questions we close; an implicatiom people need help, and we don't yet have the best solutions for providing said help. The code review exchange's rules are interesting. Perhaps there's a way; or the writers who are lost are too lost for that sort of restriction. :/
    – Kirk
    Aug 18, 2018 at 14:01
  • 2
    There could be an Area 51 proposal for a separate stack like Code Review that could be "Fiction Critique" or something. I mention that because Code Review is its own separate stack just for that. Aug 21, 2018 at 14:28
  • 1
    @ToddWilcox Incidentally, I proposed one earlier this morning (before seeing this), see writing.meta.stackexchange.com/questions/1640/… for more info :)
    – Adi219
    Aug 25, 2018 at 18:04
  • 1
    And to follow up on the results of Adi's request, it didn't work out; new site requests for things which don't work on other sites aren't allowed on Area51; More-over, we recently rebranded the stack to be generically, professionally writing oriented. I understand the desire to try this elsewhere; but, ultimately it does seem like our expansion might put this under our preview.
    – Kirk
    Aug 27, 2018 at 14:57
  • 1
    Just for the record i think Software Engineering is a trash fire, that closes 90% (hyperbola?) of their questions and should not be a guideline for anything. I would Love a writing review site though.
    – Andrey
    Aug 29, 2018 at 13:36
6

I think that the main barrier is this: Generic critique questions are, inherently, poll questions.

Leading to all the usual problem with polls and bikeshedding:

  • They aren't about solving a problem -- "Wow, that's a really fantastic piece!" is a perfectly valid answer.
  • They don't necessarily agree on what the problem is -- "This opening is boring, here's how to fix that" and "This opening doesn't give me enough detail, here's how to fix that" are both valid answers, even if the answers are 100% in contradiction.
    • This means answers are impossible to compare. Each is a solution to a different perceived problem.
  • A single poster may have multiple suggestions -- does that mean multiple answers? A single answer with five different points? How do I vote if I love two of the suggestions and hate three? If two answers offer the same suggestion, is one of them better than the other if it has another couple of suggestions as well?
  • Which answer does OP accept? If each answer is one poster's genuine opinion, how is any one of them "more" correct than any other?

Not only do all these issues undermine Stack Exchanges entire system of voting and visibility -- they also don't provide the (mixed) benefit that poll/bikeshedding questions do on Stack Overflow. On SO, a popular bikeshedding question can attract engagement and activity, from the site and from search traffic. But critique questions are, by nature, extremely localized. They matter to the person writing the piece, but it's hard to find any circumstances under which anybody else will find those responses helpful to something they're dealing with.

  • There's almost no reasonable search likely to lead writers to these questions.
  • There's almost nothing to differentiate one critique question from another.
  • There's no way for a writer to look for subsets of critique questions that are helpful to them right now -- they can go reading everything, but there's no better resolution than that.

So another hypothetical way to help, would be to come up with at least some taxonomy for critique questions. Critique questions asking "is this a good opening" are somewhat more focused than "is this a good snippet"; you could read a bunch to learn about how to open strongly. You could read critiques of romance scenes, SF-nal infodumping; establishing character in family drama; blank verse poetry.

This is hypothetically possible, but I'm very skeptical of it.

  • I don't think we've got anywhere near the volume of users and writing we'd need to create a varied body of critique questions.
  • Picking a single snippet to be critiqued with little context is incredibly difficult. Many users (and most newbies) will not do it well.

In conclusion, you write:

But, if it is the case questions on specific works are going to always be off limits, it does seem largely at odds with the purpose of the rest of the exchanges.

I disagree. SE is all about Q&A -- that's what it's built around, and that's what it excels at. You can't post code to Stack Overflow asking "Here's some code, is it good? -- you have to narrow yourself to a clear, answerable question.

A Writing.SE for critiques is a very understandable goal, but it's also a very difficult one. Critiques to Writing is like Code Review to Stack Overflow -- asking for general feedback, rather than Q&A. And Code Review is a much more obscure site, more difficult to understand and make use of.

The problem is that writing doesn't lend itself to concrete problems, the way that code does. (Ah, if only Word would tell us, "This story does not compile; excessive POV shifts in Chapter 3"!)

We basically need to make the choice: focus on what concrete problems writing does yield up, or abandon the focus on Q&A.

Neither choice is wrong, but I think there's no lack of writing spaces online that don't have the Q&A focus to begin with. If we're going to be good at anything, it'll be questions that can be framed as Q&A, not the critiques.

15
  • 6
    "This story does not compile; excessive POV shifts in Chapter 3" Or maybe even just "parse tree too complex, chapter 6 paragraph 42".
    – user
    Aug 19, 2018 at 18:17
  • 1
    I get the general gist of the fourth paragraph from the bottom, but you probably want to re-read what you've written there and fix any issues thus identified...
    – user
    Aug 19, 2018 at 18:19
  • 1
    @Michael : Sorry, I don't get it... Want to just propose an edit? :-)
    – Standback
    Aug 19, 2018 at 18:34
  • 3
    It could be established that answers such as "That's great!" are not answers and should be expanded or deleted. If somehow everything about a story excerpt is excellent, then answers could be about why each element works, what are potential pitfalls for the continuation of the story from there, etc. But the larger point of how to make sure answers are of quality and helpful is a good one. Aug 21, 2018 at 14:29
  • @MichaelKjörling I've proposed a site for writing critiques, see writing.meta.stackexchange.com/questions/1640/…
    – Adi219
    Aug 25, 2018 at 18:05
  • 2
    I don't agree on your whole premise "Generic critique questions are, inherently, poll questions". They are not, or at least, we can enforce policies to avoid poll-questions, and the same we can do for "that's a great piece" answers.
    – Liquid
    Aug 30, 2018 at 13:08
  • 1
    But you CAN post code snippets to Stack Overflow and say "This code isn't working, what is wrong with it?" Or "I have this code for computing X, but it takes way too long, is there a better way to do it?" IMO those translate directly to writing critique.
    – Amadeus
    Aug 30, 2018 at 13:37
  • @Liquid : By "generic critique questions," what I mean is questions saying, Here's a piece I wrote; what do you think of it? That's what I mean by "generic" :) And I don't think you can write What do you think of this piece? questions without "I think it's great" being a fine answer, or without being a poll question where everybody's thoughts are valid answers, even if they repeat.
    – Standback
    Aug 30, 2018 at 15:08
  • 1
    If you think you have a sense of how critique questions could be non-generic, well, I'm all ears :)
    – Standback
    Aug 30, 2018 at 15:10
  • 1
    @Standback I think there is a wide array of questions that are non-generic regarding a specific piece of writing :) Questions like "Is this extract too slow/descriptive?", "How can I show this character's anxiety in this dialog?", "Is the foreshadowing in this piece right?" "Does the atmosphere here gives off the intended vibes?". In short, there are specific aspects that the writer may be concerned with.
    – Liquid
    Aug 30, 2018 at 15:17
  • Of course those questions don't cut out the "I think it's great" kind of answer, but as a rule of thumb, we could promote even those answers to be more specific and provide reasons. "I think it's great because ..." would be more informative both to the original asker and the readers.
    – Liquid
    Aug 30, 2018 at 15:19
  • @Liquid: So, this was actually our guideline back when we did allow critique questions! :) "You need to pick what you want critiqued." The problem was... it didn't work. (A) Authors often had poor ideas of what the issue in their writing was, (B) Authors would try to post "generic" What do you think of this questions and then get frustrated when asked to narrow it down, (C) Answerers would often ignore the question focus, and just give whatever reactions and responses they had to the piece (which were often great points! -- they just didn't answer the question...)
    – Standback
    Aug 30, 2018 at 15:23
  • I wasn't aware of that. I don't know, I've got the feeling this may as well a "generational" issue: newer users want to try, older are sure it wouldn't work because it didn't the first time. But then again, seeing that the SE is still in beta and dwindling, I wonder if it was bad beyond redemption in the first place, and if wouldn't it worth to bring it up again.
    – Liquid
    Aug 30, 2018 at 18:29
  • 2
    @Liquid: Yeah, generational makes sense :-) But, don't assume it's just "we tried and it didn't work; never again." We gave it a ton of thought and discussion (which you'll still find, on the critique tag here on Meta). We leaned heavily on the immense wealth of experience that other SE sites, of every site, have gained (trading stories with moderators and community managers is basically gold :-P ). We also compare to other non-SE sites, which are way better equipped for critique; IMHO I don't even want to compete with them -- they're awesome at their thing; we're awesome at ours.
    – Standback
    Aug 31, 2018 at 9:44
  • Of course, new people come in without having read aaaaaall that. As you might observe, I'm happy to hold the conversation over and over :-) And (a) I might be persuaded, by the right suggestion, and (b) us old-timers can absolutely be overruled, if there are enough people who are eager to try. ...but, given all that, I'm still advising against it :-P
    – Standback
    Aug 31, 2018 at 9:47
5

To solve some of the problems noted by Michael and Standback (that posted before me); I'd suggest we allow critiques, but limit answers to ONE topic in response. Answer the question,

what is ONE thing wrong with this piece?

In comments one might say "nothing is wrong, I love it", but that is not a helpful answer to the question. Limit answers to ONE topic of critique. If I see more than one major error, then sure, I will post multiple answers, but they get separate votes depending on how many people agree with that ONE topic. And multiple answers are already allowed under SE rules.

I would also limit the amount of text to be critiqued to 250 words; or two screenfuls of the question writing text box (I think that is the same on every system, I don't know). 250 words is about a page of a book; that is enough to critique.

As far as other sites, World Building has TONS of questions that are effectively "what to write" (about science, biology, evolution, sociology, psychology, etc), and "critique this idea" and "I need help with my plot", and other questions with no "right" answer; like how would technology develop if there were no iron in the Earth's crust; or for a what to write Question; something like "My human-like aliens are an all female race, how do they reproduce?"

If World Building manages to field these broad, no-right-answer questions, so can we. And WB is nothing like Code Review. Many of these questions attract several disparate answers, but the OP picks whichever one they like best. We don't require a "right" answer to a critique; or alternatively, presuming the writer wants their writing to be popular, the highest voted answer is the right answer to a critique.

In my opinion, if we are here to help writers become better at this craft, prohibiting critique in any form cripples that mission. And it isn't solved by making the writer pick what THEY think is wrong and ask how to make that aspect better: Beginning writers don't necessarily know what is wrong with their writing, they want to know if anything is wrong with it.


Reasons why this approach works where others do not.

  1. Length is limited. The truth is, many writers would like to cut and paste their whole book in for a "review". By limiting them to a page, they present a passage, some prose, a conversation, etc, something interested people can read and respond to in a reasonable length.
  2. If necessary, we can establish a policy of one review per day; posts could be flagged/closed for violating it.
  3. By limiting the answers to one topic of fault, votes indicate whether that singular topic is something others agree upon. That can be useful information to the OP. For example, if many people agree the characters are too cliché, then they should take it to heart. If many agree that the descriptive language is too convoluted to follow, they should take that to heart. But if one answer has 8 votes and three others get zero, those three others can likely be dismissed as "personal preference" answers that most do not support.
  4. Many amateurs don't know even the basic terms of writing. We shouldn't hold that against them! This lets us review amateur work and suggest a course of action (or study), perhaps with links supporting that to other questions or outside sources that can provide the author instruction. They can learn the lingo as they need it.
10
  • 2
    I wholeheartedly agree with this proposal. The idea to limit every answer to one specific critique is especially good. Also, the example of World Building.SE was a great one. Aug 29, 2018 at 21:38
  • 2
    "In my opinion, if we are here to help writers become better at this craft, prohibiting critique in any form cripples that mission" That's a core point. Aspiring writers need pin-pointed, constructive feedback about their craft; not being able to give is ... meh.
    – Liquid
    Aug 30, 2018 at 13:11
  • 1
    What do you do if a user posts several things wrong with the piece? Delete his answer? This isn't enforceable. People are, very reasonably, going to trip up on this all the time.
    – Standback
    Aug 30, 2018 at 15:14
  • And, well, I don't actually see how this addresses any of my criticisms, or Michael's :-/ You're suggesting a specific format, but it doesn't focus the question, reduce answers, make comparing answers easier, or anything. You're just saying "I think the result will be fine, in ways comparable to Worldbuilding," -- which I absolutely accept as a viewpoint and a valid opinion, I just wouldn't say it solves any of the problems we raised, if you do accept them as problems...
    – Standback
    Aug 30, 2018 at 15:18
  • 1
    @Standback Yes, a moderator can delete his answer, a user can flag his answer, or even edit his answer to restrict it to a single topic. Or remind him in a comment of the rules. We could automatically put up a box stating the rules for answering a critique anytime the [critique] flag was present. We could modify any Post to include the critique flag if the OP failed to attach it. We could handle this the same way we handle an abusive answer or any other violation of the rules. I think this approach is just as enforceable as dealing with any other rule breaking.
    – Amadeus
    Aug 30, 2018 at 15:21
  • 1
    If moderators delete entire answers because they didn't follow the rules, that's going to be really frustrating, particularly for newer users. And editing an answer down to just one point is a ton of work, and takes on the responsibility of choosing which point to keep! An abusive answer is pretty rare here, and also either (a) the bad bit is very local, easy to edit, or (b) the entire answer can be tossed. A thoughtful response that doesn't follow the guidelines... is much more difficult to handle, unless we want to be hardnose deleters...
    – Standback
    Aug 30, 2018 at 15:26
  • @Standback It solves the major problem of how to vote; each answer is ONE topic. You need no taxonomy, the answers provide the taxonomy per question. Nor is the generic "what's wrong with it" a POLL, the answers must show a specific topic, thus answer a specific question. And answers ARE comparable, because viewers are judging how well each single-topic answer would improve the OP's writing if implemented, so there is always the same criterion for comparison: How good is this advice to the OP on this question? And, it CAN help others with similar problems, by example.
    – Amadeus
    Aug 30, 2018 at 15:29
  • @Standback Moderators close entire questions for being off-topic. They delete whole comment chains, or move them to Chat. A moderator in a comment can ask the violator to clean up their post and follow the rules for answering a critique, or tomorrow their answer will be deleted. The Answerer can still say all they wish to say in multiple answers. If the Answerer refuses to do the necessary work to comply with the rules, then they deserve to have their post deleted. The law is the law for everybody.
    – Amadeus
    Aug 30, 2018 at 15:35
  • 1
    "Moderators close entire questions for being off-topic." I see why you're drawing this comparison, but as a former mod here, these are really different. The community can close a question, discuss it, edit it, and reopen it, without a mod intervening at all. Whereas only a mod can delete or undelete -- and then nobody sees the content, or can discuss editing. That puts all the work on the mods, and all the judgement calls are exclusively theirs -- nobody else gets a say. It's a ton of work, and a recipe for bitter arguments. It's not the same as closing questions at all.
    – Standback
    Aug 30, 2018 at 17:15
  • @Standback All the work doesn't have to be by the mods, as the rest of my comment indicates. The community (including me) can flag critique answers as not adhering to the rules and comment why, mods can tell the answerer to clean it up or risk deletion of the answer; just like offensive answers. I'm not saying there would be zero software work to implement this, but all the same mechanisms apply as for breaking the "not nice" rule, except the rules I propose are far less subjective and much more of a bright line. 1 topic of critique, PERIOD. 2 screens of text for the OP, period.
    – Amadeus
    Aug 30, 2018 at 18:10
2

Why we must do this here, or not at all.

I think it's worth posting The StackExchange position on "Review Stacks" which has been used to close Adi's request; as it is an answer of sorts to this question.

There have been a few attempts in the last week or two to suggest a new form of stack-exchange specifically for writing reviews. All of them have been deleted/closed.

There's a standard answer posted whenever suggests such a thing on area 51.

On Proposals Soliciting reviews, recommendations, comparisions, etc

Software Recommendations" was created in a time when the sheer size of our software developer audience gave them the collateral to give this a shot. "Hardware Recommendations" later expanded on that idea and it's struggling critically with nearly half the questions either deleted or closed. Since then, proposals have pushed out even further into website recommendations, book recommendations, travel recommendations, idea exchanges, essay reviews, textbook errata, job scams registries, software comparisons, suggest-a-song —

I don't have any regrets with the sites we tried, but hardware and software search is about as far as we can take this format; we don't wish to keep expanding this model any further.

I can appreciate that you have [other] questions you would love to ask on a Stack Exchange site, but gathering up questions from a community where they're not wanted doesn't seem to make them work any better here. Honestly, where we should be spending our energy is in figuring out how to make the best of these questions work on our existing sites, but that's a big boat to steer and we need a lot of software support and a buy-in from the communities that host these subjects.

This does not provide a positive outlook for the suggestion that we allow critiques on this site as apparently they are a source of struggle and lead to many, many unanswered, deleted & locked questions. It also does not preclude us from having some form of review on this site. What it does ultimately say is that we either find a way to have constructive critiques live here, as a part of this site; or abandon the idea of it living in the StackExchange environment.

I don't want to extrapolate too far from the content I'm linking/quoting, but I think we should acknowledge the following:

  • The need for these types of things, does not exist here solely. There is a site-wide desire for these types of things. Point: Common Problem.
  • Most communities have not figured out how to make them successful, excluding, perhaps "Software Recommendations". Point: Hard to Fix
  • The owners of the web site have concerns about the software structures that are available to support this type of exchange of ideas. Point: System May Prevent Solution
  • Communities that exist need to be the point of innovative beginnings if expansion were to ever occur. Point: Even though it's hard, maybe impossible given current state, it's still valuable for us to consider this.
4
  • I basically agree with your analysis, yes. I'd say there are other places, outside of SE, that are excellent for critique -- Critters, Absolute Write, Scribophile. So, this isn't about "is critique obtainable"; it's "can I get it here."
    – Standback
    Aug 31, 2018 at 9:53
  • 1
    And that leads us to the fundamental question: Is Writing.SE dependant on critique? Is that what we're about? Is that not what we're about, but still a necessary evil we're obligated to support? Personally, I'd say it's neither -- and that critique is so poorly suited to SE, that I would fear for the site's health more if we did change to support it. It would fill the site up with amateur cruft, and elbow out any other use but that.
    – Standback
    Aug 31, 2018 at 9:57
  • Kirk, please define "successful"? Why is a site unsuccessful when, for example, many questions remain unanswered? They remain unanswered if they cannot be asked anyway. And allowing them to be asked gives us a chance to answer some of them, which is more than if they aren't allowed to be asked.
    – user34178
    Jan 5, 2019 at 9:07
  • @user57423 The goal of a Question & Answer site is to provide answers to those seeking answers. If questions are going unanswered or are answered with low quality response, it's a clear observable metric that indicates expertise is not present. If the answer rate is low enough in either quantity or quality, new comers to the site won't believe they will find the desired expertise and the site will suffer. Success on a Q&A site is simply defined as satisfactory answers to the people who are asking the questions. Partial success, if rare, is probably still not good.
    – Kirk
    Jan 5, 2019 at 18:20
1

Code fixes, identifications and answers dependent on physical laws are all pretty concrete and objective correctness can be judged. Writing is very subjective, genre writing is even more subjective; without completely objective standards to adhere to there is no "right" against which to measure answers given. This is a major problem on English Language and Usage when sentence interpretation/improvement questions get answered, it would be much worse when considering large parts of pieces of narrative fiction.

Also purely from a "good use of our members' time" standpoint the amount of writing that would be needed from OPs to give respondents enough context to adequately critique a piece is huge. Reading enough material to create a good answer will take almost as long as writing a reasonably detailed critique as well.

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .