An online debate tool facilitates the act of debating by helping to manage the structure of argumentation. This distinguishes it from general purpose communication tools such as wikis and forums. Some online debate tools provide graphical representations of arguments, but this is not a requirement.

This wiki page and tag gives a list and characterization of debate tools. Debate tools were previously discussed here.

Literature

There exists an academic literature on argument mapping and other tools (computer aided or not) for assisting debate. The most recent survey seems to be "Computer-supported argumentation: A review of the state of the art" written in June 2009, which lists 50 tools (starting on page 94).

Online Deliberation is a related discipline that asks what are the effects of online discussions, when are they effective, and how to design better systems.

List of debate tools

Debate Map

Summary: Tree-based mapping of beliefs, arguments, and evidence.

first mentioned:
- a comment by Venryx
pros:
- Collaborative creation, editing, and evaluation of debate/argument maps.
- Open source. (under the MIT license)
- Developed using modern web technologies. (react-js, mobx, firestore)
- Ability to enter both formal arguments (premises and conclusion), or less structured "single-premise arguments".
- Rating system for the truth/probability of claims, as well as the relevance/validity of arguments.
- Tree-based structure which can extend very deep without loss of clarity or usability.
- Integrated term/definition system. Terms can be defined once, then used anywhere, with hover-based definition display.
cons:
- Has a learning curve for casual users, as content must conform to the argument<-premise structure at each level.
- Not yet made usable on mobile devices.

DebateArt

Summary: Debating platform with rich one-on-one debates functionality and advanced discussions forum.

pros:
- Clean and convenient design.
- Advanced and flexible one-on-one debating system.
- Separate forum for casual discussions.
- Private messaging system.
- Great performance.
- Friendly community.
- Active and thorough moderation.
cons:
- Has a learning curve for casual users.
- No dedicated mobile version.

debategraph.org

Summary: This... is pretty much exactly what we were looking for, isn't it? Though it doesn't do anything with probabilities.

first mentioned:
- a comment by Peer Infinity
pros:
- collaboratively edit argument maps
cons:
- it doesn't do anything with probabilities.
- Do not zoom out too much!

Argunet

Summary: Argunet enables you to create argument maps of complex debates online or offline, on your own or in a team.

first mentioned:
- the original article
pros:
- collaboratively edit argument maps
cons:
- not entirely straightforward to use, Morendil had trouble figuring out how to move boxes around.

bCisive Online

Summary: a simple canvas for creating a tree diagram of a debate.

first mentioned:
- the original article
pros:
- easy to use
cons:
- all it does is let you make the tree diagram, it doesn't do anything else with the data
examples:
- a map of Morendil's current thinking on cryonics

Flow

Summary: a specialized form of note taking called "flowing" within the policy/CEDA/NDT debate community.

first mentioned:
- a comment by JenniferRM
pros:
- lots of people have used this technique, and it has been proven to work well
cons:
- it requires a very specific format for the debate

PyMC

Summary: a DSL in python for (non-recursive) Bayesian models and Bayesian probability computations.

first mentioned:
- a comment by Steve_Rayhawk
pros:
- it does Bayesian calculations
cons:
- requires literacy in python and bayesian statistics

MACOSPOL

first mentioned:
- a comment by Morendil
examples:
- mapped controversies

Scott Aaronson's worldview manager

Summary: this is designed to point out hidden contradictions (or at least tensions) between one's beliefs, by using programmed in implications to exhibit (possibly long) inferential chains that demonstrate a contradiction.

first mentioned:
- a comment by wnoise
pros:
- it does lots of stuff
cons:
- it's kinda complicated
examples:
- sample worldview
- The model of libertarian ideas

Canonizer.com

Summary: Canonizer.com is a wiki system with added camp and survey capabilities. The system provides a rigorous way to measure scientific / moral expert consensus. It is designed for collaborative development of concise descriptions of various competing scientific or moral theories, and the best arguments for such. People can join the camps representing such, giving a quantitative survey or measure of consensus compared to all others. Proposed changes to supported camps go into a review mode for one week. Any supporters of a camp can object to any such proposed change during this time. If it survives a week with no objection, it goes live, guaranteeing unanimous agreement to such changes to the petition by all current signers. If anyone does object, the camp can be forked (taking all supporters of the 'improvement'), or the info can be included in a sporting sub camp.

The karma or 'canonization' system enables the readers to select any algorithm they wish on the side bar to 'find the good stuff'. For example, you can compare the mind expert scientific consensus with the default general population consensus. Each camp has a forum to discuss and debate further improvements for camps. The general idea is to debate things in the forums, or elsewhere, and summarize everyone's final / current / state of the art view in the camp statements. A history of everything is maintained, providing a dynamic quantitative measure of how well accepted any theory is, as ever more theory falsifying (when experts abandon a falsified camp) scientific data / new arguments... come in.

first mentioned:
- a comment by PeerInfinity
pros:
- the whole canonization thing
cons:
- it's kinda complicated
examples:
- the main list of canonized camps

Explore-Ideas.com

Summary: explore-ideas.com is a graph structure forum where users start with a topic and follow arguments they agree with, creating a personalized 'story'.

pros: users can link any two comments and merge ideas from different discussions into a single logical argument, as well as make loops in reasoning. Each user comes to his personal 'win' ending based on arguments (s)he agrees with. There is no global 'win' or 'lose' argument.

This forum encourages dynamic debate that goes beyond pro/con binary approach, similar to that employed in Proofs and Refutations.

cons: UI is rudimentary.

Debate.fm

Summary: A simple platform to start a debate on any topic. Mainly focused at general user participation.

pros: Simple structured content - side by side. Mainly focused at pro/con binary approach
cons: Till now not ready for academic use.

cartargrapher

"a simple argument mapping app, made using Google’s visualization API, jquery, and python, and running on Google’s AppEngine. Note: at this point, I don’t guarantee the persistence of saved argument maps!" - John MacFarlane

Consider.it

Graphically represents people's agreement with a statement and which arguments were most used. The arguments themselves are not subjects of further investigation though. Check out this use-case of public decisions in Seattle.

Ideas for new tools

Based on MediaWiki, PHP, GraphViz, and maybe XML
Summary: a tool that we make ourselves, so that it works the way we want it to work
first mentioned:
- a comment by PeerInfinity
pros:
- we're writing it, so we can make it work how we want
cons:
- we would need to write it from scratch
examples:
- a conversation about AI

Brass Tacks

Structured debate: a set of rules which debate software could help enforce. Some data design is on paper, not yet transcribed. The plan is to write this first as a MediaWiki extension. some mockups

Features that a debate tool should have

from almost everyone:
- an easy to use interface
from Morendil:
- a conclusion or a decision, which is to be "tested" by the use of the tool
- various hypotheses, which are offered in support or in opposition to the conclusion, with degrees of plausibility
- logical structure, such as "X follows from Y"
- challenges to logical structure, such as "X may not necessarily follow from Y, if you grant Z"
- elements of evidence, which make hypotheses more or less probable
- recursive relations between these elements
from PhilGoetz:
- an XML-based representation of the data
from PeerInfinity
- generates its results from an annotated log of a debate
- collaboratively editable, possibly using MediaWiki
- multiple outfut formats: graphs, tables, the raw data
from Johnicholas:
- Compose in ordinary ASCII or UTF-8
- Compose primarily a running-text argument, indicating the formal structure with annotations
- Export as a prettified document, still mostly running text (html and LaTeX)
- Export as a diagram (automatically layed out, perhaps by graphviz)
- Export as a bayes net (in possibly several bayes net formats)
- Export as a machine-checkable proof (in possibly several formats)
from Eliezer Yudkowsky:
- prevents online arguments from retracing the same points over and over.
- not just graphical with boxes, because that makes poor use of screen real estate.
- not have lots of fancy argument types and patterns, because no one really uses that stuff
- a karma system, because otherwise there's no way to find the good stuff.

(So, now that everything's all neatly arranged in a list, the next step is to decide whether we want to start using any of these tools, or if we want to create our own.)

LWers interested in developing debate tools

Curtis SerVaas
.impact has discussed making argument mapping software
The "Collaborative Argumentation Analysis" Facebook Group has a lot of links/discussion/people.

AI ALIGNMENT FORUM
AF