informedness

When negative this is still true for the absolutely value of Informedness, but the information has been used to force an incorrect response.

Informedness and Kappa have the advantage that chance level is defined to be 0, and they have the form of a probability.

Informedness has the stronger property that it is the probability that an informed decision is made (rather than a guess), when positive.

It is also known as deltap' and generalizes from the dichotomous to the multiclass case as Informedness.

Some metrics come from regression coefficients: the markedness and the informedness, and their geometric mean, the Matthews correlation coefficient.

The component regression coefficients of the Matthews correlation coefficient are markedness (deltap) and informedness (deltap').

The discrimination is equal also to Informedness, deskewed WRAcc and Gini Coefficient in the single point case (single parameterization or single system).

A direct approach to debiasing and renormalizing Accuracy is Cohen's kappa, whilst Informedness has been shown to be a Kappa-family debiased renormalization of Recall.

Evaluation: From Precision, Recall and F-Measure to ROC, Informedness, Markedness & Correlation"."

Informedness has been shown to have desirable characteristics for Machine Learning versus other common definitions of Kappa such as Cohen Kappa and Fleiss Kappa.

The use of a single index is "not generally to be recommended", but Informedness or Youden's index is the probability of an informed decision (as opposed to a random guess).

These measures all have the advantage that 0 represents chance performance whilst 1 represents perfect performance, and -1 represents the "perverse" case of full informedness used to always give the wrong response.

However, Informedness and Markedness are Kappa-like renormalizations of Recall and Precision, and their geometric mean Matthews correlation coefficient thus acts like a debiased F-measure.

Kappa is also used to compare performance in Machine Learning but the directional version known as Informedness or Youden's J statistic is argued to be more appropriate for supervised learning.

Markedness and Informedness correspond to different directions of information flow and generalize Youden's J statistic, the deltap statistics and (as their geometric mean) the Matthews Correlation Coefficient to more than two classes.

Matthews correlation coefficient is the geometric mean of the regression coefficient of the problem and its dual, where the component regression coefficients of the Matthews correlation coefficient are Markedness (deltap) and Informedness (deltap').

Note, however, that the F-measures do not take the true negatives into account, and that measures such as the Phi coefficient, Matthews correlation coefficient, Informedness or Cohen's kappa may be preferable to assess the performance of a binary classifier.

West coast residents are the most distinct audience, in "opposition" to all others, on the main horizontal axis. The first axis refers to Informedness – a factor regrouping respondents’ views of information sources, their usage of information sources and their self-assessed levels of information.

The survey, which is being designed in the light of parallel work currently being undertaken by other ESRC-funded research projects on the public understanding of science, will measure a combination of background, psychological and social factors in relation to people's expressed levels of interest in, attitudes towards, and informedness about the world of science.