-130

This quarter, the Community Enablement team is focused on researching the asking experience. This research has led the team to consider the types of questions allowed on Stack Overflow and how to expand the process to accommodate more types of questions. Over the next few months, one of our key focuses will be centered on finding a home for a wider range of technical questions on Stack Overflow. We've observed that many valuable questions are closed as 'opinion-based' because they don't fit our traditional format for objective Q&A. While this strict format is the foundation of our site's quality, it also means our library of knowledge has lost out on crucial technical discussions. Our goal, as a company, is to find a way to welcome more extensive questions while maintaining the high quality our community expects. Back in July, we talked about this a little bit on Meta Stack Exchange and the Stack Overflow Blog:

Simplified posting experience: We're exploring simplifying the process of asking questions on Stack Overflow, so that any technical question has a place and can find an answer. Our goal is to make it easier for all technologists to share their knowledge gaps, no matter how specific or broad the problem, while maintaining the quality of traditional Q&A. This means welcoming a wider range of questions and perspectives, ensuring Stack Overflow continues to be a comprehensive and supportive resource as technology evolves. We believe this will diversify the knowledge available on the platform and make it even more valuable for everyone.

In our upcoming experiments, we will explore allowing well-reasoned, opinion-based questions to sit alongside our traditional Q&A. This effort is to simplify how more users want to ask and answer questions that have not typically been allowed. This isn’t an attempt to diminish the valuable and high-quality questions and answers we have, but to expand the knowledge base for more types of content to exist alongside it. To be explicitly clear, here are some things we, as a company, are trying to do:

  • We will not tie these new question types to reputation or privilege-earning opportunities. We are open to considering a new incentive system for them.
  • Users will not be forced to see this content; community members will have the option to filter their feeds to their liking. Or opt out of opinion-based content entirely.

In addition, here are some commitments we’re making prior to moving forward with this initiative:

  • We will work with the Charcoal team to make sure that all of these questions are exposed to their tools to help prevent spam. We’ve learned from our experiences with the Discussions project.
  • We will work with moderators to ensure that the appropriate moderation tools are available to moderate new question types if this becomes a permanent change.
  • We are focused on attracting any quality technical questions; we do not intend to attract generic homework questions, or frivolous conversations
  • We do not want to become a generic homework help desk.

I'd like to leave you with a few discussion prompts to consider, thinking about how you would like to see something like this come to life.

  • What kind of tools would you like to see that allow you to curate your question feeds to include only the content types you are interested in?
  • Opinion-based content allows for a considerable amount of room in defining what makes a good question. What guidelines would you like community members to see when asking these types of questions?
  • We don’t believe that reputation as structured today is the correct incentive for addressing these types of questions. How should quality discussion-oriented content be rewarded or incentivized?

We'll be back very soon with more details on how we might alpha test this. We will be monitoring this post for questions till October 16th, 2025

42
  • 19
    To be fair, if you are going to allow opinion based questions then they should be part of main Q/A. the easiest way to remove reputation is to make such questions and their answers as community wiki. I would not give options to remove such questions outside general public view as this makes moderation harder. Even if we would allow opinion based questions that does not mean that any kind of questions should be allowed in that category. Or just bring back Discussions for such content. There is no need to reinvent hot water. Commented Oct 2 at 15:52
  • 56
    This, admittedly, sounds a lot of Discussions. I know that Discussions failed, but some of the reasons for that was because it lacked the features that you state you would provide with such a release; working with Charcoal and giving mods appropriate tools were two significant reasons why Discussions failed with the community. I think you have a good foundation (admittedly, you may need to purge the existing content to a degree), but if you actually add those tools to it, I think it could be more of a success. Commented Oct 2 at 15:55
  • 20
    " We've observed that many valuable questions are closed as 'opinion-based'" Can you maybe quantify this a bit more. I counted around 30k such closed questions, which isn't a lot and how many of them are valuable I wouldn't know. Commented Oct 2 at 16:20
  • 48
    "our library of knowledge has lost out on crucial technical discussions" -- not buying it for a minute. We curate a library, as you say, of knowledge. Discussions are not knowledge. The fact that we (mostly) do not host discussions is among the primary discriminators of StackOverflow, and large among the reasons for its perceived quality. Commented Oct 2 at 17:54
  • 8
    One of the problems with having separate spaces is shuffling content and (users) back and forth. Having a single place for all kinds of posts makes that easier. If you want high quality opinion based questions then they can be part of main Q/A, or we need ability to effortlessly move content. In that light, the question is what are we going to do with existing opinion based questions which are closed or even deleted? All that needs to be taken into account before starting experiments. We need to have all those fine details worked out. Otherwise this will just be a huge waste of time. Commented Oct 2 at 17:58
  • 56
    As a user of Stack Overflow for nearly 2 decades, and as programmer with 2 decades of professional programming experience and an additional decade of programming as a hobbyist, I will never find a question seeking my opinion as helpful. Additionally, " has lost out on crucial technical discussions", my immediate response is that is a GOOD THING since Stack Overflow is not the place nor should it ever be the place to have technical discussions. Of course I fully expect feedback on this topic to be ignored. Feedback on similar changes in the past have been ignored by staff. Commented Oct 2 at 18:09
  • 54
    "it also means our library of knowledge has lost out on... technical discussions." Yes. This is a good thing. They are not "crucial" at all. If you keep trying to take Stack Overflow away from Stack Overflow users, they will continue to take themselves away from you, too. Commented Oct 2 at 21:17
  • 11
    If you remove the "opinion based" close reason, I will just vote to close them for a different reason. "lacks focus" would be appropriate. Commented Oct 2 at 23:52
  • 42
    Can you please add some accountability to your "experiments"? Define your success criterias now and then when you post in a couple weeks that this "experiment" was a success refer back with data of how those criterion were validated. Commented Oct 3 at 8:15
  • 7
    I read more about the early history of programmers.SE and this feels more like a try to revive programmers than a revival of discussions. As such it should pay special attention to why programmers failed (see Adding discipline.. for example). Commented Oct 4 at 5:47
  • 14
    Would it be possible to maybe have a list of, say 20, subjective questions you found while searching that you thought are promising? You say that there is a lot of potential missed out and with some examples it might be easier to believe, even if not every single one convinced everyone. Commented Oct 4 at 5:50
  • 13
    @Hoid given your and the companies previous record, unless you otherwise specify, the success criteria is going to assumed to be 'was implemented and data collected' with everything else being a post facto justification for why you go ahead any way. If you don't define a success criteria now, it creates an image that the 'experiment' is just a facade to pretend that this hasn't already been decided. Commented Oct 5 at 12:23
  • 7
    @NoDataDumpNoContribution "I counted around 30k such closed questions, [...] how many of them are valuable I wouldn't know" - I am unconvinced that anyone at SE knows this either. If this will be evaluated in the same way as the recent comment experiment, the success will be measured by the amount of content being created, with the usefulness of that content being an afterthought. Commented Oct 6 at 9:20
  • 13
    @Hoid Do you think you can decide and publish a metric and a success threshold before deploying any experiments? Commented Oct 6 at 21:42
  • 9
    The fact that Stack Overflow doesn't have discussions and opinion-based content is what makes it a good resource. This proposal is nonsense. Commented Oct 8 at 0:03

27 Answers 27

93

Look at the history of the network, specifically the first few years. Purely opinion-based questions were allowed then, and they were quite popular. But they caused a lot of issues with the system, though many of these issues were related to reputation. Many of those questions were non-technical, so not quite what you're proposing here. But the problems are mostly similar.

There's a lot to learn about the potential pitfalls from the discussions of that time. If you exclude reputation gain, there are still big issues around voting. Those posts tended to attract a lot of votes, much more than any objective, technical questions. So if you merge them into regular questions, they will drown out any list sorted by score.

They also attract a lot of answers. More than you can effectively moderate. Not everyone knows the answer to a specific question, but everybody has an opinion. Nobody will read the late answers, which is problematic in terms of moderation and also not a nice experience as a user.

Established site rules don't work for them. So you need to change the rules for these, which will make the rules even harder to understand.

Duplicate rules are even more of an issue than for normal questions. Adding new answers to old questions is futile, as they attract too many answers in the first place. The opinion-based questions also get out of date more easily. So you might again need special rules for this content type.

I think you're underestimating again just how difficult it would be to make this work well.

9
  • 2
    These are some excellent points, and for the sake of clarity, it's worth noting that we have been reading old discussions on meta. Your moderation point is one we have been thinking about. I have wondered if giving mods or curators the ability to block new answers to old discussions might be worthwhile after some amount of time has passed. Commented Oct 3 at 17:13
  • 10
    @Hoid I don't think manual moderation can be the solution here. You'll need to find more fundamental ways to address these issues. One fundamental difference between SE/SO and other sites that allow discussions is that duplicates are not allowed here. So on other sites you'll just repeat discussions every now and then (there are certainly rules on too much repetition on many sites). Commented Oct 3 at 17:32
  • 3
    @Hoid It could just be that these kind of topics aren't very suitable for the Q&A format. It is a clunky format and not very suitable for a lot of things (like for example meta). This was what Discussions were supposed to solve, though the horrible UI and lack of moderation turned that into a fiasco. The idea was perhaps not bad, just the implementation. Commented Oct 4 at 10:43
  • 1
    @MadScientist I agree that there are repetitive questions that this invites. Like what is the best language/framework/library/coding book etc. Those can invite useful information, but they won't collect useful information if asked every day. That problem is on our radar, I don't know what the solution to that could be, maybe just having a new version of it pop up every couple of months for people to add newer information? And maybe just not allowing them. That is something we will want to hear the community's input on. Commented Oct 6 at 19:48
  • 1
    @MadScientist Moderation also has to be handled differently; that's one of the reasons the product team is going to work on moderating during the experiments. It will be the easiest way to determine what's missing. Commented Oct 6 at 19:48
  • 2
    @Lundin I think thats spot on, the typical Q&A format probably doesn't work to well for this over the long term. As set up today, answers with threaded comment discussions seem hard to parse. We probably will start with just threaded replies and move from there to determine how to organize. We have time to iterate on how to best position opinion-based questions to determine the best UI to work with. Commented Oct 6 at 19:50
  • 2
    "Established site rules don't work for them. So you need to change the rules for these, which will make the rules even harder to understand." - Upvote for that alone. Right now I would consider that a blocker. And perhaps a good trigger to finally give the rules some attention? Making site changes, even experimental ones, is an uphill battle to begin with when you want to keep involving the likes of meta as people are dug in like Alabama ticks based on them. The rules being as ambiguous and possibly outdated as they are hurts. A lot. Commented Oct 8 at 14:36
  • @Hoid: It may be worth having a look at the Software Engineering site as well. There tends to be "softer" (less objective) questions asked there, so you may get a better feeling of how such questions are handled in SE. Do beware that it's a much smaller site, so any problem it could have would be magnified on SO. Commented Oct 8 at 15:18
  • 1
    @Hoid Rather than closing old questions to new responses, a better solution might be to make a new OpinionOverflow site that worked more like Reddit. Then you don't have the problem of opinion votes dominating votes on objective questions in overall reputation. Then the current "Close as opinion-based" would become migrate to OpinionOverflow. Commented Oct 16 at 0:50
77

Opinion-based questions by their nature do not lead to answers, they lead to discussions. The Q&A format, even with the new comment system, is not a good format to support discussions, especially when we have spent literally decades trying to train people to not use Stack Overflow like it is a forum.

Why is this not a separate product from Q&A with systems designed specifically to support discussion rather than trying to shoehorn it into Q&A?

11
  • 2
    We are considering making a minor adjustment to the UI to give it a unique appearance, rather than resembling a typical Q&A. It could just be tested with the new commenting UI, with a response that has a higher character limit or something different, so it doesn't feel quite like a typical Q&A. Regarding the second part of your question, this is why we plan to introduce customizable filtering options, allowing them to coexist so community members get to see the types of content they wish. Commented Oct 3 at 19:25
  • 24
    @Hoid Giving things "a unique appearance" is not what I meant when I said "systems designed specifically to support discussion". For example, a discussion needs threaded answers, not multiple answers with threaded comments that scatter discussion points and scoring all over the place. Meta sites barely work in a Q&A format and that's only because the community makes them work. It's not going to scale. There's a good reason opinion-based questions are not welcomed in the current system and it's not because people are mean. Commented Oct 3 at 19:44
  • "Opinion-based questions by their nature do not lead to answers, they lead to discussions." - that is not universally true. Do you ever read multiple blog posts on the same topic? Having different opinions can help you have a richer understanding of complex topics. Commented Oct 6 at 0:03
  • 1
    @SteveBennett Blog posts are not opinion-based questions, they are (at least in the realm of programming blogs which I assume you are talking about here) 'how to' tutorials. You can more readily translate various blog posts on the same topic to different answers to a 'how to' question on Stack Overflow than you can do an opinion-based discussion on a forum. Commented Oct 6 at 15:08
  • 4
    @TylerH Also, I come to SO for succinct, actionable answers to specific questions. If the company wants to branch out into a uh blog aggregator, they should design the systems to support that well instead of forcing it into a Q&A format. These aren't opinion-based questions, they are discussion topics, and the responses aren't potentially The Answer that should rise to the top, they are one of many equally valid responses that should not be scored or accepted as if they were answers. We certainly shouldn't be letting others edit them if they're the author's opinion. Commented Oct 6 at 15:31
  • 2
    @ColleenV My original comment doesn't have enough detail. So let me expand a little bit. When I say unique, I do mean different in how it's interacted with. For an initial test, that probably means getting rid of "answers" as a reply function and instead starting with threaded replies similar to Discussions or the new commenting UI directly on a question. We have also thrown around the idea of being able to highlight specific sections and start threaded discussions on certain pieces of the text. That's just an idea on the wall, but we do want a different enough UI so you know it's different. Commented Oct 6 at 19:35
  • 1
    It will need different quality signals from voting, maybe voting actually works, but it can't just be a long thread with some kind of scoring signal attached to different replies. It's on our minds, and we want to discuss this further with the community rather than trying to come up with something we think is 100% complete. Our first goal is to determine if we make opinion-based questions, do people ask them? And the harder part is whether they are getting quality responses? Signaling quality is a huge piece, given that it's on Stack Overflow, and we have ideas to toss around for that as well. Commented Oct 6 at 19:38
  • 6
    @Hoid "if we make opinion-based questions [allowed], do people ask them" I mean, that should be obvious already. Opinion-based questions currently are not allowed on Stack Overflow and have been explicitly and loudly disallowed for a good 15 years, yet people still post them daily. Of course you will see an explosion of opinion-based content if you explicitly allow it, because it's way easier to hold an opinion on something compared to truly understanding how something works or why it works that way. Commented Oct 6 at 20:51
  • 1
    @TylerH That's fair, for what it's worth, we are considering how people reply to them and what they reply to, as the more meaningful piece of that. We already know that people want to ask them, and getting them to ask more of them is the easy part. Making the other half enjoyable and rewarding is the tricky part. Commented Oct 6 at 21:14
  • opinion-based questions do not have a single solution. But they have multiple arguments that might be shared. It is valuable to know these arguments as long as you don't go into an endless circular discussion of which arguments hold more value. Commented Oct 14 at 10:40
  • @julaine "multiple arguments that might be shared" is also called a discussion. We will have to agree to disagree on whether knowing everyone's opinion on something is valuable. I find many people's opinions are not well-reasoned. Commented Oct 14 at 13:06
48

Let me quote something from before:

As many of you know, Stack Overflow has mainly focused on objective content: questions that can clearly and definitely be answered. [..........] aims to expand upon this with subjective content.

[..........] threads may not have a specific conclusion with an answer that’s right or wrong. Instead, participants can discuss, debate, and explore varying opinions, perspectives, and implementation strategies in order to make more informed technical decisions.

We expect some [..........] threads to only be relevant for a finite duration in time, while others will become long-lasting points of reference. Our goal is for these conversations can be easily accessible and discoverable in both the short and long term. a

or

[..........] provides a way for developers to learn or share a new perspective outside of the traditional question-and-answer space, with a lower barrier for engagement and covering a broader range of topics. b

[..........] = Discussions

These are from the posts concerning launch and expansion of Discussions;

a. Discussions experiment launching on NLP Collective

b. Discussions: Learnings and experiments

Do you see the similarities? Basically, you are bringing Discussions to the main Q&A. They'll be a great source of cluttering the main. We have already pointed out the issues with Discussions, things that need to improve, and why and how they are different from Q&A.

Take this part of Tyler's answer about Discussions:

Discussions are not Q&A. They are a new product; users need not expect or rely on similar interaction options as Q&A (like voting). For open-ended, opinion-based discussions, voting never really made sense in the first place. Especially if it's not tied to any user reputation (which was the entire point of adding voting to Stack Overflow Q&A in the first place--to give the post authors reputation to signify their knowledge and effort on the site, and then also to unlock site privileges).


Now let me go through some of your commitments:

We will work with the Charcoal team to make sure that all of these questions are exposed to their tools to help prevent spam. We’ve learned from our experiences with the Discussions project.

Same promise was made about Discussions at some point. It never happened.

We will work with moderators to ensure that the appropriate moderation tools are available to moderate new question types if this becomes a permanent change.

Same as above.

So, I believe it when I see it.

10
  • 1
    We went through the Discussions learnings quite extensively, so there is quite a bit of considerations from Discussions to be leveraged here. Thats why we plan to include Charcoal early on. Regarding feed clutter, we want community members to have the option to choose what they want to see. There will be extensive filtering options to turn off opinion-based questions, so you won't see them and can continue with the experience you wish to have. As far as mod tools, the product team is going to help moderate, its the best way to identify and understand tools that are missing. Commented Oct 3 at 19:28
  • 1
    Although we may not have any different mod/curation tools at launch, it's definitely on our radar to identify what is missing so it can be earmarked for development. Commented Oct 3 at 19:29
  • 1
    @Hoid I appreciate you engaging with this. While this may sound like a disgruntled rant, it comes from a place of affection. I have had spent a lot of time on moderating Discussions and had multiple talks with Bert on how to improve things. While Bert was onboard with most of them, logistic limitations resulted in little to no development getting allotted to Discussions. I seriously hope this gets the attention that it needs to eventually graduate to a successful product and break the pattern of short-lived experiments. Commented Oct 3 at 19:41
  • 2
    It's okay, it's a big change to consider, even if there are ways to ignore it. If you want to be able to share feedback with the team directly in a private space, I think I can make that happen. You can of course also do it here on meta. Commented Oct 3 at 20:31
  • @Hoid Thank you. There's already this room: chat.stackoverflow.com/rooms/256608/discussions-moderation (mod-only link). So if you (or the members of the team) want to pop in, I am sure we can share some insights; if not me then other folks who've interested some time on Discussions. Cheers. Commented Oct 3 at 20:37
  • lol, interested-->invested Commented Oct 5 at 2:01
  • 3
    @Hoid it may be on your radar, but would you be willing to pull the plug and revert entirely if resources are pulled from the project before they get implemented? Because that's what we are afraid of. We want to see a commitment that either these tools will be put in place, or the entire thing canned. But at the moment it seems the only way that we can get that is if they are present at launch. These are minimum viable features for us. Commented Oct 5 at 15:47
  • 9
    And this is a very real fear. As a company you have a history of saying things are on your radar at launch, and the deresoucing the feature before they are implemented. Commented Oct 5 at 15:49
  • @user1937198 speaking of minimum viable features: meta.stackexchange.com/q/408764 Commented Oct 5 at 16:16
  • 4
    @Hoid "We went through the Discussions learnings quite extensively" "we may not have any different mod/curation tools at launch" - if your current development plan does not include presenting the full design of this experiment to the mods, asking for their input on any required tooling, and only pushing code to production after building that tooling, IMO you failed to extract the important learnings from the failed discussions experiment. SE recently loves pushing half baked MVPs but I really see no technical or community reason why this should be rushed instead of well-built from the start. Commented Oct 6 at 10:44
37

Maybe I'm missing something here, but it sounds like you just want forums: something more structured than chat, but less structured than Stack Exchange's No-Nonsense Laser-Focussed Real-Questions-Have-Answers system.

Forums have been around forever, and Stack Exchange was designed to take the role of what forums were frankly terrible at: Distilling everything into focused questions and useful answers, separating the wheat from the chaff as it were. Instead of people needing to scour countless threads full of opinions and valuable technical discussions and piecemeal bits of knowledge and figuring out what is relevant and what is not, Stack Exchange concentrates the useful bits all into one place, easy to find and ready for the next person who needs it.

Stack Exchange Q&A never tried to take over what forums were already quite excellent at: congregating like-minded individuals and fostering valuable discussions on a wide range of opinionated topics. It was a supplement to the existing tools, not a replacement for them. Rather, the whole Stack Exchange system is — by design — TERRIBLE at being a forum, because otherwise people would just treat it like another forum and, well, what even would be the point of it all? What makes Stack Exchange valuable is its unique model which is designed to do only what it does and do it well.

And as best I can tell, you want to take this system and shoehorn it back into being a forum, something it was explicitly trying to distinguish itself from? Stack Exchange works because it eschews the noise, the distractions and detours that stand in the way of a clear answerable question and a useful valuable answer. A forum works because it embraces the noise, bringing in a variety of opinions and perspectives, churning them together to (hopefully) produce something more valuable than its component parts.

I don't disagree that there's a place for something like this on the Stack Exchange network — Stack Overflow likely never would've succeeded were it not for the countless forums already full of knowledge that had paved the way — but integrating it right into the Q&A like this feels like exactly the wrong approach: They're two completely different approaches to information handling, and blurring that line by merging them into one Q&A system feels like it'll just make everything worse for both, instead of better for anyone.

5
  • 5
    But look for example at this Meta. It effectively is a forum merged with a knowledge database and half of the items here are marked discussion and it works somehow. You can get quite lively debates even in a Q&A format with comments. Commented Oct 3 at 6:00
  • 24
    @NoDataDumpNoContribution Meta works in spite of the system because there's a strong community of power users who need it to work and who know how to make it work. That's... not scalable, not to the extent that it needs to be. Commented Oct 3 at 6:45
  • 3
    If you say so I believe it. It's just not my personal experience. I might be just unfamiliar with Reddit, but I don't like the threaded content structure there much. You basically have to read everything in order to be sure you saw everything. I like the two tier system (answers, comments) of Q&A here more. I can scan all answers which are on the same level and I know that is all I basically need to know. For example politics.SE is often quite opinionated but somehow (more or less) works. Q&As there are somewhat subjective but it hasn't become a forum. Commented Oct 3 at 19:51
  • 6
    I agree that early Stack Overflow was successful because it didn't try to be a forum. But I also disagree that we are just trying to be a forum. I don't think that is the case, though I will admit this obviously has some similarities. But I think it's possible that we can have opinionated questions, even if they lead to discussions on the site. They can carry significant value, I think at SO or on SE we can make a higher quality discussion. If someone doesn't want to participate or see it, then they won't have to; we will provide them with tools so they never have to. Commented Oct 3 at 19:55
  • 8
    @Hoid Maybe you're not "just" trying to be a forum, but you're still trying to do a lot of things that a forum is really good at, except through a framework that is really bad at it. I just... I have trouble seeing how this will end up being a net positive for anyone. Commented Oct 7 at 0:20
33

Over the next few months, one of our key focuses will be centered on finding a home for a wider range of technical questions on Stack Overflow.

With respect, no. You are misunderstanding your own product, or rather, conflating Stack Exchange with Stack Overflow. If you want to find a home for new types of questions that currently are not a good fit on Stack Overflow,

You already have a platform for that: Area 51. Make a new site and leave Stack Overflow alone.

A new site would not even require massive efforts in development because everything you need is already baked-in: you can set your own topic rules, you can set your own privileges and the reputation level they apply to, etc.

Sites on this network have communities that keep them alive, and those communities generally decide what they want their site to accept. I get that Stack Overflow is the money maker/star performer here and therefore special, but there's a reason it is the money maker and the star performer: strict quality control. You can leave SO alone and put all your efforts into this new site if you want it to succeed so badly.

In this scenario you are Victor Frankenstein trying to find how to renew life and create something good. That's understandable. Laudable even. I empathize with you on that. However, you are currently at the step where you are strapping Stack Overflow to the table and trying to create a monster by sewing an arm of Reddit onto it and a leg of Quora onto it, which will destroy Stack Overflow in the process, however slowly.

Let me ask you a rhetorical question: which website has the reputation for being a high quality, thorough resource of information? Wikipedia? Quora? or Reddit? It's Wikipedia, because they have strict quality controls and editorial standards. Stack Overflow is the programming Q&A version of Wikipedia. Please stop trying to make it like Reddit or Quora.

This effort is to simplify how more users want to ask and answer questions that have not typically been allowed. This isn’t an attempt to diminish the valuable and high-quality questions and answers we have, but to expand the knowledge base for more types of content to exist alongside it.

This is exactly what Area 51 is for:

Area 51 is the Stack Exchange Network staging zone. It's where groups of experts come together to build new Q&A sites that work just like Stack Overflow. Here you can:

  • Propose new Q&A sites. If you have an idea for an expert Q&A site, propose it here.
  • Get involved in the process. Help sites get off the ground by defining the types of questions that are wanted, recruiting a critical mass of experts, and committing to the site's success.

Back to this post:

We will not tie these new question types to reputation or privilege-earning opportunities. We are open to considering a new incentive system for them.

Users will not be forced to see this content; community members will have the option to filter their feeds to their liking. Or opt out of opinion-based content entirely.

So why try to tie them to Stack Overflow yet at the same time make them completely separate/optional?

You already have a way to do this. Area 51.

You can even just call it "Stack Overflow Subjective" or something.

Again, with respect, y'all do not have the grasp on the ins and outs of how Stack Overflow's code (or, apparently, design or ethos) works to change it so much without fundamentally breaking the site every time you try something huge like this. This is like Chesterton's Fence, except instead of no one knowing why the fence was there, the entire village is yelling at you not to remove the fence, while explaining why it is there in the first place.


  • What kind of tools would you like to see that allow you to curate your question feeds to include only the content types you are interested in?

Why is this predicated on expanding the types of questions asked here? Why not just put effort into this for the site as it is now? We would actually be grateful and supportive if you put in efforts to just fix and improve the site we already have and love.

  • Opinion-based content allows for a considerable amount of room in defining what makes a good question. What guidelines would you like community members to see when asking these types of questions?

I would not like opinion-based content on Stack Overflow as that's like going to the grocery store to buy nails and lumber.

  • We don’t believe that reputation as structured today is the correct incentive for addressing these types of questions. How should quality discussion-oriented content be rewarded or incentivized?

Opinion-based discussions don't merit reward or incentives. But if you must, give them badges like popular question or famous question. Just make copies of the existing code for those Q&A badges and adjust them slightly for opinion-based discussions.

8
  • 9
    I think you're missing an important point: this is yet another flailing attempt to boost metrics and explore new growth avenues. As such, area 51 is dead in the water because that would not even get 10% of the eyeballs that an SO experiment gets. Same reason why the failing discussions experiment was reimagined as "code challenges" which should have just been its own thing instead of being grafted onto SO. Commented Oct 6 at 15:41
  • 1
    @l4mpi They could trivially insert a dismissable banner at the top of every page of SO (for example) that says "check out our new site on Area 51 for subjective programming discussions/questions" for a week or two, which would pretty much guarantee orders of magnitude more eyeballs on it than any other A51 site has ever received. Commented Oct 6 at 20:47
  • 2
    Sites the company wants to have don't use Area51. These sites are exceptions like the GenAI site and they do what they feel like. Commented Oct 6 at 21:45
  • @TylerH SE could do lots of things but I guess we'll never know why they chose not to. Maybe they don't want banners due to banner blindness, or to keep that space reserved for more important announcements (which I doubt, but that would be a charitable interpretation). Or maybe whoever pushed for this was not even aware that Area 51 exists. Commented Oct 7 at 12:30
  • 3
    genAI.SE is an example where they bypassed Area51 and still started a separate site in a relative short amount of time by simply gathering enthusiastic people, made a private beta with them and then went public. They could do the same here as they seem anyway determined to make it happen, so the proposal phase of Area51 could be skipped. Commented Oct 7 at 15:27
  • 1
    Assuming they don't want that, I'd like to see the companies' reasoning on that. Commented Oct 11 at 6:26
  • Programmers.SE (now Software Engineering SE) was originally supposed to be "Stack Overflow Subjective," so really, that experiment was already done a long time ago. Commented Oct 15 at 14:14
  • @EJoshuaS-StandwithUkraine Sort of... it was for conceptual programming problems/questions. See stackoverflow.blog/2010/12/17/… and softwareengineering.stackexchange.com/help/on-topic for authoritative information on what SE.SE is for (then and now). Commented Oct 15 at 15:01
26

I'm super-wary about the concept. It seems at odd with the aspects of Stack Overflow that drew me here. But I'll run with your premise and offer a sketch of a possible design that might address some of my biggest concerns with this.

Focus on aggregating expert opinion. Focus on where you can add special value: questions that need answers from experts, and where Stack Overflow can collect and aggregate information and opinions from experts. Don't try to be everything for everyone. Don't try to be another Reddit/Quora/Yahoo Answers clone where anyone can post anything and anyone can post any answer they like.

Set clear expectations for subjective or open-ended questions. I would suggest that such questions must (1) ask about software development, (2) be practical and answerable, (3) be directed towards answers that can be supported by evidence or experience, and (4) ask a question that requires answers from experts.

Restrict who can answer. Require 250+ reputation to answer. This is designed to signal that the goal is to gather expert opinions, and the goal is to focus on questions that require aggregating expert views. Also, it helps reduce answers from people who just want to engage or chime in, from people who have opinions but no expertise, and from people who want to share their opinions but have no buy-in to the requirement for providing evidence or experience. Only rep from standard questions and answers should count towards this 250+ threshold; rep from these new subjective questions or answers on them should not count. If people want to engage with subjective questions, they should first contribute to the knowledge base and establish their credentials as knowledgeable in this domain.

Restrict who can vote. Require 250+ reputation to vote (same as for answering).

Require that answers be supported by evidence or experience. Set a clear rule that all answers must be supported by evidence or experience. Document this rule prominently. Delete all answers that don't follow this. Create a new flag type on answers, 'primarily opinion not supported by evidence or experience', and either (a) get buy-in to act on it from SO moderators or (b) enable the community enforce this, e.g., if there are 2 such flags, the answer is deleted. The tradeoff for lowering requirements for questions and making it harder to close or delete questions is higher requirements for answers and making it easier to delete answers.

Mark subjective and open-ended questions separately. Put a post notice above such questions that indicates it is a subjective or open-ended question, and different rules apply, and link to the rules.

Change the closure rules. I suggest disabling the "opinion-based" close reason and (maybe) the "duplicate" close reason on such questions, but allowing other close reasons to remain.

Change how answers are sorted and vote totals are displayed. Use Bayesian ranking to sort answers, to take into account aspects of the current system that don't work well for opinion polls. These issues aren't a big deal for most existing questions, because most existing questions don't receive a lot of answers or a lot of votes; but opinion questions often receive many answers and many votes, which creates new problems.

See https://stats.stackexchange.com/q/26833/2921, https://planspace.org/2014/08/17/how-to-sort-by-average-rating/ (also: https://stackoverflow.blog/2009/10/23/alternate-sorting-orders/, https://web.archive.org/web/20111003060234/http://blog.reddit.com/2009/10/reddits-new-comment-sorting-system.html, https://julesjacobs.com/2015/08/17/bayesian-scoring-of-ratings.html, https://www.evanmiller.org/bayesian-average-ratings.html, http://www.evanmiller.org/how-not-to-sort-by-average-rating.html, https://web.archive.org/web/20150214083151/https://camdp.com/blogs/how-sort-comments-intelligently-reddit-and-hacker-).

Currently, answers posted earlier and answers at the top of the sort order tend to receive more votes. So someone who posts an early answer gets more votes, which raises it to the top of the sort order, whence it receives even more votes. Late answers languish at the bottom, get little visibility, and don't receive many votes. So the current sort order is influenced by "which was posted earliest" as much as it is influenced by quality. Bayesian ranking reduces these issues.


Do I expect to like such a system? I don't know, it feels pretty different from Stack Overflow's existing mission, so probably not. There could be some value in opening up in a limited way. But, do I trust the company to implement this in a healthy way? Not at all, the circumstances right now are so dire for the financial future of the company that I don't trust the company's ability to resist the desire to maximize engagement regardless of quality. But I thought I'd do my best to sketch a possible way that is as consistent as I can make it with the goals articulated in the question.

7
  • 2
    I agree with the most what has been said here. If there is a room for some kinds of opinion based questions, but if we want them to be a good ones, then some restrictions are necessary to prevent flood of useless questions and answers. Commented Oct 3 at 6:27
  • 9
    Disable duplicates? Isn't dealing with "what's the best programming language?" or "I've just left college what programming language should I learn?" for the 10,000th time going to be somewhat tedious. I'm sure there are other questions that would get asked equally often that would simply be the same again and again and again. Commented Oct 3 at 11:03
  • 1
    @RobertLongson, Fair enough! I don't have any great confidence about whether it'd be better to enable or disable duplicates, in such a system, so you could be right that it's better to continue to allow closing as a duplicate. I've revised my answer to indicate my uncertainty about that part. Commented Oct 3 at 19:35
  • 1
    @D.W. Other places handle this by closing as duplicate for a medium-length period (e.g. 6 months), then allowing the next duplicate after that. Commented Oct 3 at 21:45
  • 1
    I don't think the 250+ rep requirement will work. Yes, this does need answers from experts, but not only from experts that have been on SO for years. We also need to allow new users to participate if the community should stay healthy. I would rather make downvotes count more, so that you cannot get much reputation from controversial opinions (like you can still get net-positive rep from answers that have been downvoted more than they have been upvoted). Commented Oct 5 at 3:21
  • 4
    This answer made me see that perhaps the problem of "too-many-things-closed-as-opinion-based" can be solved with incremental change and not a wholesale "bolted on" new subarea. I'm a (salty old) professional engineer, and periodically I see a closed question where i go "ugh, this got closed, unnecessary strictness." Maybe we just give high-rep people a button that says "i can actually use this discussion in my profession," and clicking it adds some "special marker" and re-opens the question but as community wiki. Several button variations and label/markers can be possible, as data might guide. Commented Oct 8 at 14:08
  • If we're going to have an entirely separate set of rules for those questions, we should also have an entirely separate website for them. Otherwise this will cause a terrible confusion. Commented Oct 13 at 22:57
25

Opinion-based content allows for a considerable amount of room in defining what makes a good question. What guidelines would you like community members to see when asking these types of questions?

Are they actually going to be used? because we had guidelines for people asking questions, but they were replaced with AI slop a while back.

The question we need to ask ourselves is... what kind of opinion based questions are we not going to allow. For example, are we going to allow questions comparing different SaaS solutions, either by price and/or by feature? Are we going to allow "What is the best practice way to do X?", even when it has a properly worded "How do i do X" dupe that has a good answer?

What is an example of a good useful opinion based question that the team wants to exist here? It's clear (at least to me, given we've never pushed to change the guidelines to allow opinion based content) the meta community doesn't generally want opinion based questions here, so getting us to decide what should be allowed seems kinda... out of place to me.

7
  • 7
    Yeah, I think determining "what makes a good/high-quality opinion-based question" is sort of the key here. The SO blog post Good Subjective, Bad Subjective seems like a decent starting point. (That post also points out that what is now the Software Engineering Stack Exchange site originally arose specifically out of needing a place for more subjective programming/development-related questions...) Commented Oct 2 at 17:40
  • 1
    @V2Blast, I was just reading that blog post last week, balpha pointed me to it. Perhaps we could discuss it further in the near future to refine or adopt it as guidelines. Commented Oct 2 at 19:18
  • 1
    Presenting good guidelines is something we want to be able to offer, but presenting good guidelines and adherence to them are, of course, two different things, and you can only do the latter with the former. So we want to start with thinking about guidelines first. Commented Oct 2 at 19:22
  • 2
    I would personally not allow price comparisons; that's a personal and budget choice for an individual anyway. I can imagine that some kind of feature-oriented discussions, within the larger framework of accomplishing something, may have a some sort of reusable value, but that seems like the kind of thing that you know when you see it. So, it's not as easy to lay out, I have been spending quite a bit of time looking at discussion posts to try and get a feel for better guidelines or signals Commented Oct 2 at 19:25
  • 3
    @Hoid I feel a lot like that post, and the context behind it should have come out a lot earlier. Also, the two recommendations sites. The third factor is - how prepared the community folks are to step in and help moderate if things go bad, and winning over the community we have now. On a smaller scale, and with much more personal trust - I've tried (and failed!) to do that sort of thing on MSE when I was a mod. As much as the KPI seems on "new user numbers"- I think its worth looking at what it takes to win over the more active userbase to these ideas. Commented Oct 2 at 21:32
  • 5
    What's the unique selling point and benefits to the people who're on this site now and what does it bring the community we have, rather than the community we might? Commented Oct 2 at 21:33
  • 4
    it also doesn't really... solve anything does it? the gripe people on the outside have with SO is how strict content curation is. I don't think this will even begin to address that issue. Commented Oct 2 at 21:35
19

Can you give a couple hypothetical examples of "well-reasoned, opinion-based questions"? I'm struggling to imagine what kinds of questions you're envisioning in this category.

4
  • 5
    Everyone is. That's probably a bad sign but you could just lean back and wait for what happens. Commented Oct 8 at 19:09
  • Someone asks, "How do I do X?", and gets 10 different (good) answers. That question and all 10 answers get upvoted over time. This is a good question. But if that question was worded as, "What's the best practice for doing X?" Or "What's the best way to do X?" then the question will usually be quickly closed as opinion based. The fact that the difference between a "good" question and a "bad" one can be just a tweak in wording without changing the actual question, implies many "potentially good" questions are getting closed. (The closer could instead just fix the wording, but that's rare.) Commented Nov 10 at 15:37
  • 1
    @TTT: Questions with superlatives (like best, fastest, safest) almost never have a definitive answer. It seems we agree that the best way to handle those would be to fix the wording match what the author probably intended (better, faster, safer). If those are instead treated as opinion-based questions, we deprive the knowledge base of new content, the asker of concrete options, and end up with a sea of opinions without substantial peer review. Commented Nov 10 at 16:03
  • It would be great if the community tried to determine if a question simply needs to be tweaked before DV'ing and voting to close. The DV's in particular make it hard to overcome even if someone later tries to clean it up. Your last sentence is also a great point. It's likely already happening with the roll-out of the new feature. Commented Nov 10 at 22:23
18

We've observed that many valuable questions are closed as 'opinion-based' because they don't fit our traditional format for objective Q&A.

How do you (throughout: I mean the staff, collectively) know this?

Why do you presume to be able to judge what is "valuable" in our Q&A?

Have you written questions (and answers)?

Have you participated in the meta discussion in which standards and criteria for "value" were set?

Have you attempted to understand the reasoning given for the guidelines of the "traditional format" (i.e., not a discussion forum)? Specifically as relates to opinion? Even more specifically, from the discussion on meta, have you read https://stackoverflow.com/help/dont-ask , and considered deeply the reasoning given there (to my understanding, by former staff)?

17

One quality standard should be providing details in the question. "I want to program, so what language should I use?" is a terrible question, regardless of objectivity/subjectivity, because most programming languages can be very useful for programming. And "in 2025" would not make it any better. People looking for opinions should share what truly distinguishes their needs, goals, or context.

17

Like I mentioned in a comment this sounds like another attempt at Discussions. I'm not against this (I think the feature has merit), but like I also noted, part of the reason Discussions failed is because of the lack of tools you state you're committing to putting in a new attempt.

I did, admittedly, spend a good amount of time in Discussions, almost entirely curating. This wasn't a great experience for such users; it was impossible for us to track our flags and we couldn't even retract them. If a flag was declined, for example, I had no idea it happened, let alone why. I can see the tools that the moderators have now, and I can also understand why it was difficult for them; like others have mentioned in the past you can only access the flags if you navigate to the home page of the feature, and they don't appear in the main site mod pages at all.

Quality is important as well; a lot of the posts on the old Discussion area were very low hanging fruit and not interesting. Unfortunately, as much as SO might not want it, giving curators the ability to close such low quality questions is likely needed; those posts don't get engagement from the users SO needs them to (the SMEs) and (from prior experience) often attracted LLM content. It wasn't a good experience for anyone.

In terms of your points about showing such questions on the ask feed, please gives users the ability to opt out seeing these within the preferences, like with the Staging Ground, and add a search feature for explicitly searching for them. There are users that don't want to see SG posts and I suspect the same is going to apply to these posts. I would, honestly, likely want use a different custom filter for such questions so that they don't "invade" my normal feeds.

If someone asks an opinionated question, but not as a "DiscussionV2", what does SO Inc think would be the correct path; Closure? Migration? Something else? What happens to any reputation changes if the post is migrated from "Question" to "DiscussionsV2"? We also, likely, would want to avoid overlaps with Software/Hardware Recommondations; would "DiscussionsV2" have an option for migration to those sites?

There's a lot of history around such a feature, as the last attempt failed; this really puts SO on the back foot here. If you truly want this to succeed any release likely needs to be feature rich from the start. Having a "MRE" product that lacks the ability for the community to utilise and curate properly, and (as much as SO might not want them to) avoid, is only going to end up with the community disliking it again; you need the community to engage with it for true success, high volumes of low quality content *isntZ a success as people will learn to not trust the content. Yes, making it feature rich from day one is a (significantly) larger effort before a release, which might be wasted if it fails again, but I'd suggest that with that effort there's a far better chance of success.

15

Don't mistake entertainment for knowledge distribution

Having a lively opinionated discussion might be fun, but often enough is also a waste of time with little to nothing that can be learned from it. Don't believe me?

  • Q: What is the one book that every programmer should have read? A: There is no such book.
  • Q: Is PyTorch or TensorFlow better for Deep Learning projects? A: Both are really well suited.
  • Q: Can AI replace programmers? A: Not yet. Don't ask me when, I really don't know.
  • Q: How to get really good at programming? A: {study, practice, compare} a lot
  • Q: Why do so many people like Rust? A: Because of its features (if only somebody would ask for them).
  • Q: Why are programmers so weird? A: They aren't.
  • Q: What is the best for ..? A: Nobody knows unless you tell us your exact requirements.
  • Q: Why is the singleton pattern not used more often? A: Difficult to say, but there may be sunshine or rain on the weekend.

And did you learn a lot? I would guess not. I just made them up and I could go on. I think there are many questions that one cannot learn much from them and only wastes time. I don't think we miss a lot there. We miss only a very modest possible knowledge gain while risking lots of curation effort. But the company seems to think differently. Hopefully it won't go wrong. (Collectives, Discussions, AI generated answers)

However, if we wanted the modest possible knowledge gain to be included, maybe it would help to:

  • Most important: avoid such questions at big costs, always try to make a real Q&A out of it first. Only if that doesn't work (and often it will actually work) ask that other kind of open ended question.
  • Make it about a specific as possible situation? Asking for a book, say what you know and what you want to learn. Asking for a comparison, give at least three specific use cases. Asking for advantages, specify the areas of interest (or use cases).
  • Do not answer what is best, should I, how can one ... type of questions? Only answer "how is it typically done" type of questions instead. Answers then would optimally link to existing code.
  • Do not ask for recommendations if possible. Ask for advantages and disadvantages with regard to specific requirements.
  • Let real experts give the opinionated answers. Avoid simple questions that only invite bike-shedding.
  • Avoid A vs B (eg. Redis vs. Memcached) questions. This is something like the XY problem. People ask for A vs. B but they really want to know what is best for their use case. Let them explain their use case and do not limit answers to only A or B.
  • Expect answers to be substantial, i.e. not only an opinion (I can have multiple ones at the same time about anything) but an actual chain of arguments.

But I also see some silver linings at the horizon. I could imagine that:

  • Why questions might work if you can get the actual authors to answer them. Typically we don't know why certain aspects of a programming language are like they are for example, but sometimes the actual designer is available and can comment (I remember at least one such case) and that would still be only an opinion but an interesting one.
  • Best practice questions might work if actual experts answer and the scope is reasonably limited and people avoid bickering over details.

Maybe it would also be good to create a list of good example vs. bad examples. Something like:

  • Bad: How important is it to reach 90% test coverage?
  • Good: Why is a high test coverage important and how much test coverage is typically achieved? or How do people typically determine the trade-off between effort and benefit for test coverages?

All in all it might become a lot of work, especially with curation when there are multiple content types surely we will need a system to somehow migrate content from one type to another or mark content of one type as duplicate of content of another type. And who will do that work? Please do not introduce anything without such a system. And this kind of knowledge might also age even faster than the pure factual knowledge we typically have. Think about trending sort by default there.

However, I actually see some potential if done right, but I find it difficult to give a comprehensive guide how to do it right now. There would still be millions of questions people might come up with that aren't a good fit for a knowledge library.

Basically always ask yourself: what are people supposed to learn from that? If there is no (lasting) knowledge inside, it's not a good idea.

5
  • I think you make some good points in the end, but I also dispute your opening examples– the very thing you abstracted away, the discussion itself, is precisely where I feel the learning comes from. Certainly not always; there's definitely chance for wasted time, no doubt– but the value from those discussions comes from participating in them (or reading through), not extracting "an answer"... there is no single answer, that'd be the whole point of a discussion format in my mind. Otherwise, we should just use Q&A, frankly. The scoping surely needs work, but don't downplay discussion itself. Commented Oct 3 at 20:15
  • That said, I do like the point you make about trying to ground subjective discussions in some sense of more lasting value/ learning... it feels fitting and would align better with traditional Q&A in that way. It also just sounds really hard to do, too, which I totally agree with you about. Commented Oct 3 at 20:19
  • 4
    @zcoop98 Thanks for the interesting comments. Regarding the point that the learning comes from discussions, would you as a passive (reading) participant really want to read everything or just a summary of the different positions and arguments? Would the discussion be the end product or rather an intermediate step? I kind of imaged there would maybe not be a single answer, but that people would converge to a couple of possible answers all valid somehow and different in the end? So maybe no answers at all instead? This would then be more like Reddit. I personally find Reddit not really useful. Commented Oct 3 at 21:59
  • 4
    "I just made them up and I could go on." Literally all these examples have actually been asked. The ones that weren't deleted illustrate why this experiment is such a bad idea. Also, curation of answers to a single question alone is a herculean task already (good luck finding the roughly 50% of duplicate answers over 5+ pages for example, which keep coming). Then each of these answers attract 30+ comments that usually devolve into a contest about who is more knowledgable. The accepted answer mostly is a rhetorical question or advice on how to reformulate the initial question. Commented Oct 4 at 0:20
  • 1
    @user4157124 The company's point is that there are lots of such useful questions waiting, which they found out by looking at closed questions. Maybe they should give a list of say 20 such questions that they think would be promising so we can better judge them. For 50% duplicate answers we could try more draconian moderation measures maybe, like suspension from this feature in ever greater intervals for posting duplicates. Commented Oct 4 at 5:40
15

Most of the time when I'm looking for a solution, to a problem, because Stack Overflow's own search isn't up to it I'm searching using an external search engine with a prompt like site:stackoverflow.com how to foo the bar If the new question types live in the same space as current questions my search result is going to be watered down with the new question types when I'm only looking for the tried and trusted kind.

Please make sure I can also filter out subjective questions from a search with an external search engine, not just from some user settings in my profile which doesn't apply to these searches.

2
  • How do you think they'd be able to do this? One thing I could imagine is them using a different path, while you are using site:stackoverflow.com/questions with a search engine supporting it. Commented Oct 6 at 2:51
  • We have not progressed this far with any development work, but we are exploring ideas to apply labels, which could enable us to use it as a filter mechanism for search, making it better optimized to either exclude or find specific items. Good call out though. I will put an internal ticket on the board for this one. Commented Oct 9 at 21:44
15

We are focused on attracting any quality technical questions; we do not intend to attract generic homework questions, or frivolous conversations

I urge you to figure out the purpose of the new question types and how to keep them to it as a priority before launching them.

There should be a way to keep a focus. I always thought Discussions was a good idea. But the implementation was ultimately doomed for several reasons. Mainly the lack of focus. One of the most popular discussions was what music you listen to while programming. That, I believe, was not what Discussions was for. There were many other topics that were all over the place but not really within the spectrum of technical conversations. Some were "boat programming", many were random questions. There was no real unity of purpose.

I mentioned this problem before, so I will just include the quote here again:

There was a post about why Documentation failed where Jon Ericson cited Horyun Song:

Horyun makes a wonderful analogy involving chairs. Imagine walking into a room with these two setups:

Chaos vs. Organization

The right hand side is clearly more welcoming since the chairs are arranged in a way that welcomes (affords) sitting. Without clear organization, Documentation started to look a lot more like the the chairs on the left. Private beta users saw a clean slate and users at launch walked into a work in progress. Some topics were better organized than others, but our focus on content creation distracted from content curation.

The same thing is repeating with Discussions. But we never had the right side chairs because:

By design, there was never a clear definition of what Discussions is for, since the idea was to see what participants wanted to do there.

Only leads to the left side of the picture. There needs to be something that conducts organising the content.

5
  • 2
    I mean... there's no reason discussions, with the right features, can't be organized. but i'll believe stack capable of it when that's what we get, :shrug: the labels in the new proposed question list design seemed fairly organized, if the system they build can deliver that. Commented Oct 8 at 4:40
  • 1
    Put another way, i don't believe disorder has to be a given, for these new types of "questions" to exist Commented Oct 8 at 4:42
  • 3
    That's the point. The system should be able to give us order and the company should seek order. Unlike what happened with Discussions which was to neither have any way to organise, nor to even seek that. A goal for Discussions was to just leave it and wait for it to grow into something specific. Commented Oct 8 at 4:45
  • I looked into discussions quite a bit, as well as the old attempt at programming.se, and some of the conversation at the time. I think we have plenty of learnings to look at to make this work and be genuinely helpful. We want to keep this strictly technical oriented, but making sure that these types of questions are well labeled at a bare minimum is huge for it to work. Commented Oct 9 at 21:19
  • For the organization of it specifically, I think it comes down to signaling what kind of answer or direction the user is ultimately looking for. It can turn a generic opinionated question into something interesting that people will want to engage with and impart what they know. I think that could go a long way to making this work well. Commented Oct 9 at 21:20
14

What kind of tools would you like to see that allow you to curate your question feeds to include only the content types you are interested in?

I'd like to be able to use watched/ignored tags to curate my question feeds... but currently, watching tags (and enabling SG posts to appear) makes the question lists worse by randomly injecting tagged questions at the top, out of order from the rest of the content rather than simply highlighting this content.

But as far as this new content type is concerned.. we simply need a labeling system that supports both this new content type and SG posts, with a filter that lets you pick and choose which types are shown.

1
  • 4
    This is a requirement for this feature. We likely will start with using the experiment opt-out feature to keep people out of it if they don't want to see it. But the end state is to be able to let users have some sort of labeling system so they can keep all opinion-based content out of their experience, or maybe a specific set of filters where it's all blocked except for a particular tag. Commented Oct 2 at 16:13
10

Given this quote:

Simplified posting experience: We're exploring simplifying the process of asking questions on Stack Overflow, so that any technical question has a place and can find an answer.

In what way will this simplify the posting experience? Are you going to have some kind of AI inspect the question and determine whether or not it is opinion based and have it automatically route the question to being an discussion opinion based question? or... I'm just not sure how giving people two different kinds of posts they could make and making them decide would be simpler.

The simplest solution would be for there to only be one route, asking a question, and having our guidelines simply expand to meet whatever new criteria the company wants to force the community to accept. As long as this asking process involves getting the asker to choose what kind of question they are asking, it's going to have the same problems discussions had where people were routinely asking regular questions as discussions.

5
  • 2
    Maybe the community could reclassify a question if the OP chose wrongly? Commented Oct 2 at 21:09
  • that would be ideal, but doesn't work if these are stored as a different content type that better supports discussion Commented Oct 2 at 21:11
  • Maybe all questions finally go through the SG and this is where the community can decide wether a question is opinion based or belongs as a regular question, hopefully only a few get misclassified early on. Commented Oct 5 at 21:02
  • An AI to help you post the question to the right site in the network might have some value. Like a single ask-question form that lets you decide which site to post on at the end - with AI or keyword-based suggestions, maybe with excerpts to the sites rules Commented Oct 14 at 10:45
  • @julaine thus far nothing they’ve done with ai has been accurate, but sure that’s a theory Commented Oct 14 at 13:42
10

How are you going to segregate this content for SEO purposes? In other words, when I google something, are subjective discussions and actual fact-based content going to look the same? Or will there be a clear way to tell them apart without clicking on every link?

One of the most infuriating things is searching for a problem, then reading through 25 pages of a forum discussion that never actually gets to an answer. That's why I click on links to Stack Overflow first. It's really quick and easy to tell if there's an actual answer to the question. Opinion-based questions have no true answer by definition, so intermixing them with regular Stack Overflow content would greatly reduce the value of seeing a SO link in your search results and thus make people less likely to click on it.

In the past, we've created separate sub-sites for handling more subjective content (think Software Recommendations, Code Review, etc.). That gives them a home with a different URL and logo that are easy to distinguish from the standard Q&A sites. Wouldn't something like that serve the purpose without diminishing the value of the existing site?

Remember, nobody on this site actually knows anybody else. We're all just Internet strangers. You may value the opinion of someone that you know and trust, but the opinion of a complete stranger is beyond worthless. You can trust their answers in a Q&A format because answers can be tested and verified (also how academic research works). Putting random people's opinions mixed in with actual factual information would only make people skeptical of anything they find on this site.

14
  • 1
    Probably we would vote on opinions with the idea that upvoted opinions are somewhat trustworthy. Commented Oct 7 at 5:21
  • 1
    @NoDataDumpNoContribution how do you vote on opinion? Me saying I like chocolate ice-cream is not something you can evaluate. Commented Oct 7 at 8:27
  • @talex You saying that chocolate contains cacao and therefore a tiny bit more healthy than non chocolate ice cream is probably something I could find reasonable. Or simply because I like chocolate ice cream too. Hopefully a bit more of the first. But I can in general estimate how convincing (for me) I find an opinion, whatever that means for others. Commented Oct 7 at 9:12
  • 2
    @NoDataDumpNoContribution so it turns voting into popularity contest. How useful for me knowledge that 100 user on SO prefer strawberry ice-cream? Commented Oct 7 at 9:15
  • 1
    @talex It's very useful if you are an ice cream manufacturer. Commented Oct 7 at 15:20
  • @talex Yes, and I see your point. Since it's still about business, people might actually like to know what the popular opinions are. And there will always be at least some facts as basis of the opinions, if we actually let the experts speak. But in case you see zero value, you should have a simple switch to block the content. I wouldn't want to force anyone to anything but I would also strive to give people the freedom to try it out if they want. I would read such discussions and vote on them, at least initially until I decide what the average quality is and if it's really worth it or not. Commented Oct 7 at 15:21
  • @NoDataDumpNoContribution well you already have this option. We have Software Engineering. Commented Oct 8 at 6:04
  • 1
    @talex Software Engineering is very restrictive after the renaming with what subjective content they allow. But I wouldn't mind to discuss there. There or here I don't mind as long as there might be a place for it. Commented Oct 8 at 6:39
  • That's a good question on the SEO piece. I have not participated in any conversations on that quite yet. I would guess it will end up looking similar, though, but with different signals to show the count of replies or something. Good call out though. Commented Oct 9 at 21:34
  • Even though this probably feels a bit like Discussions 2.0, its genuinely not intended to just be Discussion 2.0. We did take learnings from it, so it's gonna share some stuff, but we do see this as a different thing. That being said, the 25 page forum experience is something we are being mindful of. It will likely take new unique curation tools to prevent that from happening, maybe thread locking or limiting the number of people that can participate in threaded replies after a certain amount of time to keep it more focused. Commented Oct 9 at 21:39
  • We are also considering an idea for a 'community verified' label to apply to questions or answers to opinion-based questions that allow the community to signal that enough people agree with a solution or answer provided as the best solution. But that is more of a conceptual thing and really just the community accepting answers instead of the asker at the end of the day. More to come on what we are thinking about, though. Commented Oct 9 at 21:42
  • @Hoid I think you missed my point. It's not about the number of replies, it's about whether there was a resolution and how to find it. Also, with opinion-based questions, how many people agree is irrelevant. There is no correct answer, by definition. Marking something "Community Verified" simply endorses one particular opinion and further blurs the line between fact (what this site is about) and opinion (which is largely worthless). Commented Oct 29 at 17:40
  • @bta No, I understood. I think you might be misunderstanding the intent of the experiment. It is to allow opinion-based questions and accept that a question might get multiple subjective or preference-specific answers. A community-verified route would just be a way for the community to say this is probably the best answer, as an artefact for someone who might later find themselves in a similar situation. Commented Oct 29 at 17:54
  • 1
    @Hoid That's exactly my point. "Best" is subjective. The opinion of Internet strangers is beyond meaningless and should only be taken with the largest possible grain of salt. Compare that to normal SO questions where answers can be provably correct. Our sharp separation between fact and opinion is a significant reason people trust SO in the first place. Please ensure that opinion-based content is clearly marked as such (ideally in search engine results as well) so that they're easy to filter out. Creating a separate site for them would be the easiest solution. Commented Oct 29 at 18:08
9

With no rep for answers, will closing apply to opinion based questions the same as for regular questions? Is the community going to be expected to police comment answers, which closing does not affect? Or are comment answers or threads the goal here, instead of self-contained answers?

Also, you say stopping spam is a goal. However, the line between an opinion post and spam can be much thinner than for an objective post. When we see what could be marketing copy for a recommendation, do (or when do) you want us to try to remove it as spam? And perhaps more importantly, are mods going to be ready and supported in handling these flags?

1
  • 5
    Regarding your second paragraph: I suspect that generally, the kind of spam they're talking about here is blatant, off-topic spam posted by bots/bot farms – not simply users subtly (or not-so-subtly) promoting their own product. The latter generally happens at a scale that can be handled by community flagging and mods; the former tends to be overwhelming in scale and difficult to handle without staff assistance, if proper safeguards are not in place. Commented Oct 2 at 17:45
9

The last few years, you're bending the Stack Overflow formula more and more. I can already see the first signs of it being close to the breaking point. I don't think this is something you can just glue back together if it breaks. All the users will leak out though the cracks.

9

There's a fundamental contradiction in how this is framed: by definition, a question can't be both "well-reasoned" and "opinion-based":

In our upcoming experiments, we will explore allowing well-reasoned, opinion-based questions to sit alongside our traditional Q&A.

If the answers to a question can be reasonably defended, then it's not opinion-based. If they can't be, then the question isn't "well-reasoned." There are even clear guidelines about which subjective questions are acceptable.

Also, the original point of Software Engineering Stack Exchange to allow questions that were somewhat more subjective than what was traditionally allowed on Stack Overflow.

That being said, I don't understand exactly what need this is supposed to be filling. People can already post well-reasoned opinion-based questions - as long as people can reasonably defend the answers, you can probably already post the question either here or on Software Engineering SE.

Also:

While this strict format is the foundation of our site's quality, it also means our library of knowledge has lost out on crucial technical discussions.

As someone who actually remembers what wading through technical discussion forums was like before Stack Overflow, we're not missing much. The entire point of Stack Overflow was that that model was badly broken and made it hard to find the actual information you needed.

3
  • 1
    Exactly. Commented Oct 14 at 22:44
  • 1
    I've been to panel discussions of experts where my impression was that people had opinions and still reasoned very well about them. Maybe the definitions do not cover the full reality. On the other hand, these occasions were very rare. Might not be worth the effort for only a few potential hits. Commented Oct 15 at 6:02
  • @Hoid speaking of the link user4157124 just posted, since we now apparently have a defined experiment, where is the success criteria and metrics under test? Or are you going to keep arguing you don't know what success looks like until after it's deployed? (If you do that the assumption will be its a post-facto justification, not a scientific experiment) Commented Oct 26 at 1:58
8

As with so many ideas in the last few years, this again seems to come from people who either forgot or never learned the lessons from Stack Overflow history. There are very good reasons why opinion-based questions are not allowed and nothing in the announcement gives me cause to hope any of the problems with these types of questions will be adequately addressed. You say

This isn’t an attempt to diminish the valuable and high-quality questions and answers we have

but you might very well achieve that result without even attempting to do so, as those who do not understand SO history are doomed to repeat it.

However none of this will fly without the community. As long as the downvote arrow still includes "not useful" as a downvote reason, all users with downvote privileges are not just allowed to but explicitly welcomed to downvote content they do not find useful. For me, that will probably include every single piece of opinion based content. I implore all users to make use of that privilege freely.

One more thing - the OP asks

How should quality discussion-oriented content be rewarded or incentivized?

Any my answer to that is not at all. If you truly believe that this content is valuable and that there is a demand for this, then you should have no trouble finding enough participants in the community without promising any shinies as a reward.

7

This sounds good on paper, but I have mainly one question:

What kind of content do you want to attract and why?

From my experience, most of the opinion-based questions that we closed and deleted were stuff that either didn't provide any value to the programmers or was useful only at the time when the question was asked. For example:

What kind of software can be written with PHP? A: Anything you'd like.

No value whatsoever. But it is sure to attract many software ideas.

Which JS framework is the most mature? A: JQuery (or something else that was relevant at the time)

JS frameworks come and go and it's difficult to provide an answer that will stand the test of time. Opinions like this can quickly change. This is why when you Google this, you will get links to Quora and Reddit first.

One can argue that if I want to search for opinions, it is useful for me to find posts like this. But is Stack Overflow the place for it?

If you want the current opinion, you'll have to ask a new question. Looking at old questions will just confuse you. And this is pretty much the model that sites like Reddit employ. The newest stuff is what people read, and the old discussions are essentially dead and archived in read-only mode. Resurrecting them is frowned upon. For Stack Overflow, it has always been the opposite. The old and well-established questions are what most users read. So what kind of benefit does our site gain from attracting forum/chat-style questions which don't fit our model?

Couldn't you just redirect such questions to Reddit instead? I know I'd rather ask it there than here.

3
  • 1
    We could potentially update outdated opinion based answers, although I'm not sure it would be a good idea. Something like "JQuery was fine but not anymore". Commented Oct 24 at 17:29
  • @NoDataDumpNoContribution Wouldn't that be changing the meaning of the answer? It's the complete opposite of what the author wanted to say. Commented Oct 24 at 21:58
  • 1
    Depends I'd say. If we take "JQuery is the best" as containing an implicit "currently" and later add "not anymore" we have not contradicted the previous version in any way but just added information. But even just adding information changes the meaning. Who knows if the original author agrees with it. We have a general problem with our model and aging content, unless we would also age votes away. In that case we could just add another answer saying "not anymore". Just wanted to point to something that could be a way out of the problem. Commented Oct 24 at 22:25
6

At the risk of sounding naive (I have only been on SO for 14 years), I really don't understand what exactly is meant by an "opinion-based" question. It looks to me like almost every question turns out to be opinion-based. (Self-referentially, even the question "What is an opinion-based question?" is opinion-based.)

  • Why do you ever answer a question that has already been answered? Because, in your opinion, a different answer would be better. Often, you have no expectation that the other answer authors will agree with you -- you expect that their opinion will remain that their answer is better. To put it simply, the answers are opinion-based.
  • On sites like Parenting.se or Workplace.se, opinion-based questions and answers are common, and are valued. These sites function just fine. They don't need a different interface or different infrastructure. They just have different taboos, for example they will close open-ended questions that don't make it clear what problem needs to be solved. Opinion-based questions are not inherently a problem for the existing SE system.
  • Many highly upvoted questions with very technical answers are in essence opinion-based, even on Mathematics.SE (arguably the SE site with the strictest sense of "right answers" and "wrong answers", and of course it has a similar anti-opinion-based policy.)
  • As a totally random example from the "Hot Network Questions" sidebar, this question is obviously opinion-based, but it seems prima facie like a valid question that invites specific answers, which could be valuable to future users. It is easy to find such examples.

This question was closed recently for being opinion-based after having consistent engagement for 15 years. Expert opinions are clearly valued by the community! Both the question and 5 of the answers are from users with over 10k rep. The closure makes no sense, neither from the perspective of SE users nor SE goals. It only makes sense from the knee-jerk "opinion-based == bad!!" over-simplification that I am arguing against.

In short, even after reading all the other answers, I don't understand the hate for opinion-based questions, and I see tons of opinion-based questions that are loved by the community. So I think when people say "opinion-based", they mean something else.

  • If the problem is that the question's bar for engagement is very low so there is too much engagement, creating a mess of low quality content, then we should recognize that as what we are trying to address (either as now via suppression or as proposed via moving such cases to a different infrastructure).
  • If the problem is that high engagement leads to large reputation effects that don't reflect whatever it is reputation is supposed to reflect, then we should recognize that as an issue to address, and find a way to directly address that issue (an issue not just limited to opinion-based questions), similar to how the existing design keeps meta reputation from polluting regular reputation.
  • In practice, every SE site has its anti-patterns that cause questions to get closed, and if "opinion-based" is just a catch-all term referring to certain anti-patterns ("how can I learn X" / "what is the best language for Y" / "given situation X what should I do" / etc.), then we should recognize that, and focus our attention on the anti-patterns.
  • If the problem is that people tend to start unproductively arguing with each other, then we should again recognize this as an XY problem, where the unproductive arguments are the real problem, and tools for fixing that problem should be developed (e.g. "this discussion has been moved to chat").

But there is no reason to prohibit the many opinion-based questions (like "what is the best way to understand X" when X is something technical) that are actually useful and appreciated by the community.

Even the proposed "new" opinion-based site parts will have anti-patterns that get questions closed, for the same reasons as before: to maintain a sustainable quality level. So I do not think the "new parts" will be particularly different from the old parts.

In my opinion, the best route forward would be to eliminate the unclear/incorrect umbrella term "opinion-based" and replace it with concrete (site-specific) lists of closure-warranting anti-patterns, where each anti-pattern is accompanied by a description of why it is a problem for the site. For example each anti-pattern could be a "question" here on meta where people vote on whether the pattern merits closure, and the answers and comments would clarify exactly what sorts of questions are being referred to, and why they should be closed. This would allow expert-opinion based questions to remain, while still eliminating the low quality ones. Which is, after all, the goal.

4
  • 1
    POB questions are questions which only attract answers that cannot be verified independently by another person. For example, "what is your favourite book?", "what is the funniest line of code you have ever seen?", "which language do you think is better, C++ or Rust?". All of these attract opinions, i.e. something that is only within one person's mind. Such questions quickly gather a large number of answers and serve no use on site that's meant to be a repository of programming solutions. Commented Nov 26 at 2:40
  • 2
    And I know my comment repeats what my answer says, but it's important to highlight what POB questions are. Just because an answer is opinionated doesn't disqualify the question. As you said, probably most answers share some kind of opinion. The problem is when the question doesn't seek out a solution, but rather polls for open-ended replies. Commented Nov 26 at 2:44
  • 1
    the "bar for engagement" and "unproductive argument" points are addressed by the existing guidelines for how to write a "constructive subjective" question (at least they are addressed by it in my mind). "how can I learn X" is addressed by /help/dont-ask- it shouldn't take a whole book to answer (but I think there's an argument that "how did you learn X, and what did you find to be effective" could be "constructive subjective") Commented Nov 26 at 3:13
  • 1
    "what is the best language for Y" -> see /help/dont-ask. perhaps with a lot of workshopping and setting contextual constraints, this could fit the SO Q&A format, but I don't know. || "given situation X what should I do" I don't see an immediate problem with a question like this, conceptually. the determining factor would probably be what exactly the domain (excuse my abuse and misapplication of math language) of X is, and what the range (in order of magnitude) of things that could be done is to achieve the stated goal Commented Nov 26 at 3:14
4

Okay, I had some time to sleep over it and I want to try a second time. This time fully optimistic. I want to make it happen but how? This is the million dollar question. It failed in the past for programmers (even good subjective was still not good enough) and it failed for discussions (drowned in spam), so can this be avoided and what actually makes really great discussions™?

I think that..

Really great discussions demand a really great basis/introduction

Typically we are happy if a question doesn't get closed, i.e. the bare minimum to be answerable. But that's not enough for a discussion. A great discussion must include a great question, a question worthy of upvotes (discussion votes which are of course different of normal votes). And a great discussion question must be discussed beforehand in order to optimize for greatness.

I propose that discussion type questions allow responses only above a certain score (say 5) and only after at least 24 hours have passed since creation.

There is no rush. A great discussion can take time. Discussions can have something like a staging ground and learn from our experience with the staging ground.

I think that..

Really great discussions need experts discussing the subjects.

Often I regret having read something. How could I discourage everyone and their relatives somewhat (not completely) from joining in.

I propose that people giving responses to these type of questions should in one sentence state the relevant experience they have at the beginning of their response. It's perfectly fine to say: I taught it to myself 30 years ago and used it heavily since then.

Tell me from which side you are coming. You build, you sell, you use or you repair the things? It's relevant for the discussion and a diverse discussion panel is actually good.

Order of display could be random but not per score and there won't be winners anyway. That's not the point. One could even display public support only until after the discussion. I'm a bit undecided there. Votes make sense but displaying it too prominently not.

And finally I think that..

Really great discussions may be somewhat entertaining or somewhat philosophical, but at the core they are about things programmers (and related) do during their occupation, something practical?

We could do entertainment (Which line of code produces the funiest output?) or discuss the metaphysics of programming (Has code run if nobody checks its output?) but it wouldn't contribute to a knowledge library. We must concentrate on discussion topics with practical relevance for programmers for their work.

I propose to include strict moderation tools and clear messaging right from the beginning. We wouldn't want to demotivate people to discuss programming topics but it must be clear that it's not for fun or in vain, the purpose is to generate practical (expert) insights. Discussions that do not fulfill that purpose should not happen (close reason, still needs to be detailed).

All that together and possibly other things too might result in useful discussions. But I'm not sure we will find enough people actually wanting to do all this. Actually, it will be quite a bit of an effort.

2
  • 6
    +1 but if we really want good discussions, those will probably be fairly rare and not cause Stack Overflow to suddenly get significantly more (good-quality) posts. Also, what do you think about reusing some of the Staging Ground tooling for these discussion questions (for the first phase) but with a different approval process (e.g. your suggested five upvotes which ofc don't exist in the SG right now)? Commented Oct 4 at 22:40
  • @dan1st I think a staging ground for discussions would be great. I prefer to have it integrated in the main site though. The minimum would be a review queue. The ability to short track good discussions would be nice though. Commented Oct 5 at 9:06
4

I get a sense it's an attempt to take a slice off of the programming pie that is happening on discord right now, and I don't see how successful it will be. When people ask for opinion it very often naturally derails offtangently into other related topics. It works fine in a chat stream, but makes it less useful in terms of retroactive searchability which has always been the point of SO.

-2

Banning opinion-based questions or discussions isn't a problem. A problem that I experienced is that questions seeking for "best practice" have often been downvoted and closed as tending to attract (only) opinion-based answers, although they could have been improved by clarifying "best" like adding aspects or asking if there are authoritative recommendations like RFCs or PSR specifications.

So, please don't allow opinionated discussions. That would be another useless experiment playing around with Stack Overflow instead of fixing its real problems that have been addressed and discussed for years already.

2
  • 1
    I agree. Many questions do not have a straight, single, correct answer because the final judgement is opinion-based and sensitive to a lot of context. But official recommendations, well-accepted best-practices and provable downsides are often a piece of knowledge that you must have when dealing with certain problems. And this knowledge could be the answer(s) to such questions. Commented Oct 14 at 10:52
  • If they could have been clarified, then they could also be reopened. What's the problem here? Commented Oct 24 at 14:41
-8

I am, um, in favour of this.

For as long as I've been using this site, I've chafed against the very strict rules on content, comments etc. It'd be quite nice to see a wider range of questions, maybe leading to interesting questions.

This is a classic example of an "opinion-based" question which was very useful to a lot of people.

I don't exactly understand where all of this is going, but as long as you move with care and not undue haste, I'm cautiously positive about the new direction.

6
  • 7
    That question is a prime example of why discussions just don't work here: it has 16 total answers of which 6 are deleted. The whole point of SO is that there aren't a plethora of answers that you have to sift through to find the one bit that is relevant to you, because that makes the site no different from using a search engine or asking an LLM. The draw of SO's one-answer-to-one-question model is that saves you time by entirely cutting out the need to do that type of research. Commented Oct 6 at 8:33
  • 4
    My experience is the exact opposite of yours. For me, an LLM only gives you one answer, and it may not be right. Search engines these days frequently return a bunch of sites which are superficially different but are essentially just copies of each other. Commented Oct 6 at 11:42
  • 3
    If you're only getting one answer from an LLM you're using it wrong. They're called chat bots for a reason. Do you ever refine your search terms after you get garbage results? Commented Oct 6 at 15:41
  • 7
    Steve, the question you've failed to ask is "why have search engines become useless?" And the answer is that they elected to prioritise number of results over quality. If we allow the same thing to happen on Stack Overflow via allowing opinion-based questions, it will cease to be one of the few trustable sites for programming answers. That's why I think it's such a bad idea. Commented Oct 6 at 15:51
  • @IanKemp-SOdeadbyAIgreed That question has detailed answers from the developers of both tools. This is an incredible resource, even if it does not fit the narrow definition of what this site is for. Commented Oct 14 at 10:49
  • 2
    @julaine And there are 999 other opinion-based questions that don't have such good answers. We operate on numbers here, and they don't lie: that type of question invites low quality answers that cause a mess for curators and moderators, of whom there aren't enough to handle such messes, which is precisely why we forestall them from happening by closing such questions. It's a problem of resource scarcity, nothing more or less. Commented Oct 14 at 15:41

You must log in to answer this question.

Start asking to get answers

Find the answer to your question by asking.

Ask question

Explore related questions

See similar questions with these tags.