Reviewer #1 (Public review):
Summary:
In this paper, the authors combine a well-controlled decision-making task with a secondary probe task in order to understand how covert attention is shaped and how it influences the ongoing decision process. The authors report that the likelihood of overtly attending an alternative is shaped both by its decision relevance and its decision value. Further, covert attentional allocation comes at the expense of overt attentional allocation and attenuates the impact that covert gazes have on choice. Importantly, covert attentional allocation is dissociable from pre-saccadic activity. This paper sheds new light on the role of covert attention in decision-making. From an experimental aspect, the authors make excellent use of behavioural and process-tracing methods, presenting an exemplary paradigm that could be valuable to researchers working in related fields.
Strengths:
(1) The paper utilises a very rich and clever experimental design, which allows for probing covert attention at the level of a single trial. Extending the paradigm to ternary choices was an excellent addition. The decision task is also well-controlled. Overall, the results are very clearly presented, and the paper is very well written.
(2) The paper addresses important yet overlooked questions in decision neuroscience: what influences covert attention during decision-making and what is the functional relevance of covert attentional shifts. It is impressive that the authors are able to tackle these questions using behavioural and eye-tracking data alone.
(3) The authors thoroughly check that the secondary probe task can indeed be used as a proxy for covert attention. Checking that covert attentional allocation is dissociable from pre-saccadic activity was an excellent control.
Weaknesses:
(1) It is not clear why the decision task is described as "value-guided" instead of "perceptual". Participants receive momentary reward on the basis of their overall accuracy, but this is common practice in perceptual tasks. A value-based analogue of this task would provide trial-by-trial reward as a function of the perceptual magnitude (decision value) of the chosen stimulus. On a related note, the secondary task was not incentivised. The authors should further justify this choice.
(2) The authors do a great job in describing the determinants of covert attention. However, the relevant analyses are rather "phenomenological". It would be useful to try and dig further into the data in order to understand at a deeper, causal level these determinants. I suggest doing so by utilising in full the rich behavioural and overt attention data this paradigm offers. Specifically, the authors show that the higher the value of an alternative, the higher the likelihood this alternative is covertly attended. Decision values, however, could impact aspects of saccadic behaviour that directly influence covert attentional allocation (saccadic speed, dwell times, locus of gaze). At a more global level, decision value and/ or value difference could affect sampling behaviour (frequency of switching) or decision times, which can manifest in probe accuracy. Overall: a) overt sampling behaviour is at present reduced to the presence of saccades; but saccadic behaviour could be decomposed into richer metrics, b) although the task is "free-response", decision times are not analysed. Metrics based on a) and b) could be tested as mediating factors, enabling the authors to better understand the causal determinants of covert attention.
(3) The authors claim that covert attention attenuates: a) the impact of the last fixation on choice, b) the "time advantage" of the alternative that was overtly attended for longer. To further qualify these claims as functional/causal, further analyses are required. A few suggestions follow below. On trials where the "unattended" probe letter was successfully reported, the last fixation may exhibit different characteristics, which could explain away its reduced impact. For example, it may differ in duration, or it might correspond to a "switching" (rather than "staying" on the same alternative) saccade. These potential covariates need to be further examined. Additionally, correctly reporting unattended probes could come at the expense of decision accuracy due to dual task demands. If that is the case, then the reported attenuation of the impact of the last fixation could just be due to noisier responses. Similar points can be raised about the "time advantage", especially given that decision times do not feature in any of the analyses. More difficult decisions may lead to higher probe accuracy but also to prolonged decision times. The authors quantify the "time advantage" using cumulative fixation time, but perhaps relative metrics (e.g., relative fixation time or cumulative fixation time normalised by decision time) are better suited for this analysis.