Reviewer #2 (Public Review):
The authors attempt to show distinct contributions of selective attention and neuromodulators (both cholinergic and catecholaminergic) during a spatial attention task. To do this, they had participants perform a Posner cueing task using random dot motion stimuli, with a typical 80/20 split of valid to invalidly cued trials. In addition, they designed a within-subjects paradigm wherein participants took placebo (PLA), Donepezil (DNP), or Atomoxetine (ATX). Both behaviour and EEG measures were taken in order to investigate the interaction or lack thereof of Drug and Cue factors with respect to these measures, and relative timing of EEG differences to derive potential neuromechanistic similarities/differences. In this context, an interaction of Drug and Cue factors (e.g. faster valid vs invalid RTs in ATX vs PLA) might indicate a role of that neuromodulator in the mechanisms of spatial attention. This is in fact not what they found, rather most findings pointed towards a lack of interaction of Drug and Cue, hence the central thesis of the paper of distinct contributions of neuromodulator and selective attention.
Strengths:<br /> - The experimental design is well done, especially the blinding of the drug taken in each session. However, it is an important caveat to any results that participants were obviously aware they had taken an active drug in ATX condition (Supp Info).<br /> - The analyses are in general quite solidly performed, with most analysis choices relating to behaviour and EEG making sense, albeit with exceptions below.<br /> - The research question and how it relates to the experiment is very interesting, and the question worthy of consideration.
Weaknesses:<br /> - The main weakness of the paper lies in the strength of evidence provided, and how the results tally with each other. To begin with, there are a lot of significance tests performed here, increasing the chances of false positives. Multiple comparison testing is only performed across time in the EEG results, and not across post-hoc comparisons throughout the paper. In and of itself, it does not invalidate any result per se, but it does colour the interpretation of any results of weak significance, of which there are quite a few. For example, the effect of Drug on d' and subsequent post-hoc comparisons, also effect of ATX on CPP amplitude and others.<br /> - The lack of an overall RT effect of Drug leaves any DDM result a little underwhelming. How do these results tally? One potential avenue for lack of RT effect in ATX condition is increased drift rate but also increased non-decision time, working against each other. However, it may be difficult to validate these results theoretically.<br /> - There is an interaction between ATX and Cue in terms of drift rate, this goes against the main thesis of the paper of distinct and non-interacting contributions of neuromodulators and attention. This finding is then ignored. There is also a greater EDAN later for ATX compared to PLA later in the results, which would also indicate interaction of neuromodulators and attention but this is also somewhat ignored.<br /> - The CPP results are somewhat unclear. Although there is an effect of ATX on drift rate algorithmically, there is no effect of ATX on CPP slope. On the other hand, even though there is no effect of DNP on drift rate, there is an effect of DNP on CPP slope. Perhaps one may say that the effect of DNP on drift rate trended towards significance, but overall the combination of effects here is a little unconvincing. In addition, there is an effect of ATX on CPP amplitude, but how does this tally with behaviour? Would you expect greater CPP amplitude to lead to faster or slower RTs? The authors do recognise this discrepancy in the Discussion, but discount it by saying the relationship between algorithmic and CPP parameters in terms of DDM is unclear, which undermines the reasoning behind the CPP analyses (and especially the one correlating CPP slope with DDM drift rate).<br /> - The posterior component effects are problematic. The main issue is the lack of clarification of and justification for the choice of posterior component. The analysis is introduced in the context of the target selection signal the N2pc/N2c, but the component which follows is defined relative to Cue, albeit post-target. Thus this analysis tells us the effect of Cue on early posterior (possibly) visual ERP components, but it is not related to target selection as it is pooled across target/distractor. Even if we ignore this, the results themselves wrt Drug lack context. There is a trending lower amplitude for ATX at later latencies at temporo-parietal electrodes, and more positive for DNP, relative to PLA. Is this what one would expect given behaviour? This is where the issue of correct component identification becomes critical in order to inform any priors on expected ERP results given behaviour.
Given the issues above; mainly a) weak statistical evidence, b) contradictory behavioural and EEG evidence, and c) lack of theoretical background to inform priors on what to expect from the EEG results in order to develop a coherent narrative, I would say that what remains is moderate/incomplete evidence towards the thesis of the paper. This work is however a very fruitful effort at approaching the research question as to whether there is an interaction of neuromodulators and spatial attention. I commend the authors on a transparent and rigorous analysis of the current data.