On 2017 May 29, Lydia Maniatis commented:
Comment 2:
There seems to have been a kind of natural selection in vision science (and of course not only vision science) in which the following practice has come to dominate: The results of ad hoc measurements made under arbitrary (poorly rationalized) conditions and fitted to “models” with the help of ad hoc post hoc mathematical adjustments are treated as though they amounted to, or could amount to, functional principles.
Thus, here, the data generated by a particular task are reified; the data patterns are labelled “attention filters,” and the latter are treated as though they corresponded to a fundamental principle of visual processing. But principles have generality, while the "attention filter" moniker is here applied in a strictly ad hoc fashion:
First, the model is based on an arbitrary definition of color in terms of isolated ""colors" on a "neutral" background (i.e. conditions producing the perception of particular color patches on a neutral background), whose attributes we are told are “fully described by the relative stimulation of long, medium and short wavelength sensitive retinal cones.” These conditions and, thus, the specific patterns of stimulation correlated with them, constitute only one of an infinite number of possible conditions and thus of patterns of stimulation. (The naive equating of cone activity with color perception is a manifestation of the conceptual problems discussed in my earlier comment.)
Second, the model is ad hoc (“particularized”); “The inference process is illustrated by the model of selective attention illustrated in Fig. 1B particularized for the present experiments.” What would the generalized form of the model look like?
Third, the results only apply to individual subject/context combinations: “The model’s optimally predictive filter fk(i)fk(i) is called the observed attention filter. It typically is a very good [post hoc] predictor of a subject’s observed centroid judgments.† Therefore, we say for short that fk(i)fk(i) is the subject’s attention filter for attending to color CkCk in that context.”
It is the case that different colors vary in their salience. We could perform any number of experiments under any number of conditions with any number of observers, and generate various numbers that reflected this fact. Our experiments would, hopefully, succeed in reproducing the general facts, but the actual numbers would differ. Unless underpinned by potentially informative rationalizations guiding experimental conditions, none of these quantifications would carry any more theoretical weight than any of the others (the value-added via quantification would be zero). There is, in other words, nothing special about the numbers generated by Sun et al (2017). They make no testable claims; their specific "predictions" are all post hoc. Their results are entirely self-referential.
This comment, imported by Hypothesis from PubMed Commons, is licensed under CC BY.