On 2015 Nov 03, Lydia Maniatis commented:
As is the case with “Bayesians” in general, the authors here perform a sleight-of-hand: They make highly predictable predictions, to which they have attached some type of “Bayesian” rationale; the prediction is borne out; they claim (invalidly) that their “Bayesian framework” has been validated.
The authors' proposition is that increasing complexity of a "contour" (via increasing bending) decreases its detectability. We are repeatedly told that this is a well-known fact:
“A number of recent studies have demonstrated that...detection performance declines with larger turning angles” (p. 1)
“Of course...it is well-known that contour curvature decreases detectability...” (p. 5).
“Contour curvature is well known to influence human detection of contours” (p. 12).
Lo and behold, the authors' results show that “ subjects are sensitive to the complexity of the target contour's shape, as expected under the Bayesian framework and the assumed generative model. This finding gives strong prima facie support for the Bayesian approach...” (p. 8). Thus, our predictable prediction comes out as expected, and is treated as corroboration of our fundamentally post-hoc model. This train of thought is analogous to my claiming that invisible angels push the sun up every morning, and consider the coming of the dawn as prima facie evidence for my theological framework. But in fact, my angel hypothesis can only be corroborated by testing its unique components - the existence of invisible angels. It happens to be vague and untestable. Similarly, the results of this study can only validate the “Bayesian framework” by clarifying and testing its uniquely “Bayesian” assumptions (whatever these may be), not by straightforwardly modeling "well-known" facts.
In addition, the authors frame their question in a way that doesn't reflect a real perceptual problem, but is amenable to their “model.” They state that “The detection of coherent objects among noisy backgrounds is an essential function of perceptual organization, allowing the visual system to distinguish discrete, whole forms from random clutter” (p. 1). As I look around me, all I see are discrete, whole forms. None is set against a background of noise. Nor are their long, skinny objects (“open contours”). The problem is framed this way because it corresponds nicely to the authors' “hammer.” The task is an awkward, not a natural one, akin to exploring motor patterns by tying subjects legs together. It is not an obvious candidate for modeling natural perceptual processes; we are told that conditions were set so that, in a pilot study, subjects performed near 75% “correct.” Results were, predictably, mixed.
The claims made are easy to falsify. Specifically, the authors are suggesting that subjects performance in detecting the “contours” presented is due to “noisy” encoding of turning angles, thus “depressing their performance relative to an ideal observer in possession of perfect image data. “ (p. 14). The definition of contours as chains of points of identical luminance in a “noisy” background, as well as the reference to “perfect image data” reveals a certain naivete on the part of the authors vis a vis basic principles of visual perception. Their model would obviously fail to predict performance of subjects shown images that produce illusory contours, or amodal completions, for example. It would not even predict grouping of points with gaps between them – for example, a straight contour composed of identical black pixels alternated with white ones.
Finally, one of the authors, (Feldman) has repeatedly and strenuously argued against the “frequentist” definition of probability (e.g. Feldman, 2015), contrasting it with the belief-based “Bayesian” definition. Here, he inscrutably cross-breeds “frequentism” and “Bayesianism,” referring, for example, to a “Bernoulli Bayesian decision problem ” (p. 13)). Thus, it is not clear where, for Bayesians, “frequentism” ends and belief begins.
References
Feldman, Jacob. "Bayesian models of perception: a tutorial introduction." Wagemans, J eds (2014).
This comment, imported by Hypothesis from PubMed Commons, is licensed under CC BY.