5,649 Matching Annotations
  1. Dec 2023
    1. Author Response

      The following is the authors’ response to the original reviews.

      We would like to thank the reviewers for their strong interest in our studies and their excellent suggestions for improvement.

      Reviewer #1:

      Weaknesses:

      Comment 1. The authors identified NPR-15 and ASJ neurons that are involved in both molecular and behavioral responses to pathogen attack. This finding, by itself, is significant. However, how the NPR-15/ASJ circuit regulates the interplay between the two defense strategies was not explored. Therefore, emphasizing the interplay in the title and the abstract is misleading.

      Response to comment 1. We have removed the word “interplay.”

      Comment 2. Although the discovery of a single GPCR regulating both immunity and avoidance behavior is significant and novel, NPR-15 is not the first GPCR identified with these functions. Previously, the same lab reported that the GPCR OCTR-1 also regulates immunity and avoidance behavior through ASH and ASI neurons respectively (PMID: 29117551). This point was not mentioned in the current manuscript.

      Response to Comment 2. We’d like to clarify that it remains unclear whether OCTR-1 itself controls both immunity and behavior (PMID: 29117551). The reference study showed that OCTR-1-expressing neurons ASH and ASI control immunity and behavior, respectively. We modified the manuscript to make this point clearer: “While OCTR-1-expressing neurons ASI play a role in avoidance (34), the specific role of OCTR-1 in ASH and ASI neurons remains unclear. “

      Comment 3. The authors discovered that NPR-15 regulates avoidance behavior via the TRPM gene, GON-2. Only two factors (GON-2 and GTL-2) were examined in this study, and GON-2 happens to function through the intestine.

      Response to comment 3. We studied GON-2 and GTL-2 because a recent screen of intestinal TRPM genes showed that they are the only two involved in the control of pathogen avoidance. We modified the manuscript to make this rationale clearer: “Because transient receptor potential melastatin (TRPM) ion channels, GON-2 and GTL-2, are required for pathogen avoidance (32), we studied whether they may be part of the NPR-15 pathway that controls pathogen avoidance”

      Comment 3b. It is possible that NPR-15 may broadly regulate multiple effectors in multiple tissues. Confining the regulation to the amphid sensory neuron-intestinal axis, as stated in the title and elsewhere in the manuscript, is not accurate.

      Response to comment 3b. We agree that NPR-15 may broadly regulate multiple effectors in different tissues. Indeed, we have shown that the transcriptional activity of ELT-2, HLH-30, DAF-16, and PMK-1 is higher in npr-15 than in WT animals. We found that expression of NPR-15 only in ASJ cells rescues both the survival and behavioral phenotypes of npr-15 animals (Figs. 4F and 5C).

      Comment 4. The C. elegans nervous system is simple, and hermaphrodites only have 302 neurons. Individual neurons possessing multiple regulatory functions is expected. Whether this is conserved in mammals and other vertebrates is unknown, because in higher animals, neurons and neuronal circuits could be more specialized.

      Response to Comment 4. We agreed. We have removed the statements discussing conservation in that manner.

      Comment 5. A key question, that is, why would NPR-15 suppress immunity (which is bad for defense) but enhance avoidance behavior (which is good for defense), is not addressed or explained. This could be due to temporal regulation, for example, upon pathogen exposure, NPR-15 could regulate behavior to avoid the pathogen, but after infection, NPR-15 could suppress excessive immune responses or quench the responses for the resolution of infection.

      Response to comment 5. We found that NPR-15 controls the expression of immune genes in the absence of an infection. Without further experiments, we think it would be too speculative to discuss the possibility of a temporal regulation. However, we modified the manuscript to address the control of both molecular and behavioral immunity by NPR-15. The revised discussion reads: “Our findings shed light on the role of NPR-15 in the control of the immune response. NPR-15 seems to suppress specific immune genes while activating pathogen avoidance behavior to minimize potential tissue damage and the metabolic energy cost associated with activating the molecular immune response against pathogen infections. Overall, the control of immune activation is essential for maintaining homeostasis and preventing excessive tissue damage caused by an overly aggressive and energy-costly response against pathogens (60-63).”

      Comment 6. Discussion appears timid in scope and contains some repetitive statements. Point 5 can be addressed in the Discussion.

      Response to comment 6. We have removed repetitive concepts and modified the discussion as mentioned in the response to point 5.

      Comment 7. Overall, the authors presented an impactful study that identified specific molecules and neuronal cells that regulate both molecular and behavioral immune responses to pathogen attack. Most conclusions are supported by solid evidence. However, some statements are overreaching, for example, regulation of the interplay between molecular and behavioral immune responses was emphasized but not explored. Nonetheless, this study reported a significant and novel discovery and has laid a foundation for investigating such an interplay in the future.

      Response to comment 7: We removed the statements that may have appeared to be overreaching and addressed the weakness raised by the reviewer. The revised discussion reads “Our findings shed light on the role of NPR-15 in the control of the immune response. NPR-15 seems to suppress specific immune genes while activating pathogen avoidance behavior to minimize potential tissue damage and the metabolic energy cost associated with activating the molecular immune response against pathogen infections. Overall, the control of immune activation is essential for maintaining homeostasis and preventing excessive tissue damage caused by an overly aggressive and energy-costly response against pathogens (60-63).”

      Recommendations for the authors:

      Recommendations 1. The title, abstract and some statements in the main text need to be re-written to reflect the fact that regulation of the interplay between molecular and behavioral immune responses was not explored in this study.

      Response to recommendations 1. We modified the title and abstract accordingly.

      Recommendations 2. It should be mentioned in the manuscript that OCTR-1 is the first GPCR that was identified to regulate both immunity and avoidance behavior.

      Response to recommendation 2. We addressed this issue as discussed in the response to comment 2.

      Recommendations 3. Repetitive statements should be removed from Discussion.

      Response to recommendations 3. The statements were removed.

      Recommendations 4. It is surprising to see that pmk-1 RNAi did not affect the survival of npr-15(tm12539) animals against S. aureus because PMK-1 has a general role in defense against S. aureus infection.

      Response to recommendations 4. We agree. However, the RNAi studies were validated using mutants (Fig. S3B).

      Recommendations 4b. Also, the rationale for using skn-1 RNAi as a control was not given. These need to be explained adequately in the manuscript.

      Response to recommendations 4b. There’s no need to include skn-1 RNAi and we removed the data.

      Recommendations 5. The conclusion that the lack of avoidance behavior by NPR-15 loss-of-function is independent of immunity and neuropeptide genes was drawn entirely based on experiments with RNAi of individual genes. Functional redundancy among genes could render RNAi of individual genes ineffective, thus masking the dependence of avoidance behavior on these genes. More experiments are needed to support this conclusion, or the wording of the conclusion need to be changed.

      Response to recommendations 5. We modified the conclusion to address this issue: “Given the possibility of functional redundancy among these genes, we cannot rule out the possibility that different combinations may play a role in controlling avoidance behavior.”

      Recommendations 6. What is representation factor in Fig. 2B and 2C?

      Response to recommendations 5. Figure 2B shows significantly enriched terms with a Q value < 0.1, sorted by P values. Figure 2 C shows the representation factor that is calculated using a tool, http://nemates.org/MA/progs/overlap_stats.html. The calculation is based on the number of genes in set 1, the number of genes in set 2, and the Overlap between set 1 and set 2, as well as the number of genes in the genome.

      We corrected the Figure legends and included the corresponding information in Material and Methods.

      Recommendations 7. The legend of Fig. 6 was wrong and should be changed to 'GPCR/NPR-15 suppressed immune response and enhanced avoidance behavior via sensory neurons'.

      Response to recommendations 7. Thank you for pointing this out. We changed the legend.

      Reviewer #2:

      Comments 1. There is some variance in lawn occupancy of wt strains between the different trials in WT animals (e.g. in Fig. 1: 25 for wt vs 60% for npr mutant; S1c 5% for wt and 60% for npr mutant).

      Response to comment 1. We appreciate the observation. We did notice some variation in both the WT and npr-15(tm12539) animals during our study. Notably, the variation appeared to be more in the WT compared to the npr-15(tm12539) animals. However, it's important to note that these variations did not significantly affect the outcome of our findings. We calculated the means, standard deviation, and standard error across different experimental trials that are presented in the manuscript (Table S2) (new Table). It's worth noting that these variations did not significantly impact the observed differences in lawn occupancy between the wild-type (WT) and npr-15 mutant strains.

      We addressed this issue in the revised manuscript: “Interestingly, we noticed that the variation in lawn occupancy is greater in WT than in npr-15(tm12539) animals across experiments (Table S2), which suggests that the strong lack of avoidance of npr-15(tm12539) somehow counteracts the experimental variation”

      Comment 2. Does this reflect rates of migration or re-occupancy in WT?

      Response to comment 2. We did not observe any re-occupancy in either the WT or npr-15 animals at 24-hour time points (which we mostly use in this study) or beyond. To address the comment, we performed a new experiment and found that the re-occupancy of npr-15 mutants is comparable to that of WT animals at 4 hours post-exposure (Figure S1B).

      Comment 3. Does pathogen avoidance persist and/or the rate of avoidance differ in npr mutant worms?

      Response to comment 3. As illustrated in new Figure S1B, the avoidance behavior in response to pathogens remained consistent even when we extended our observations up to 48 hours (Figure S1B).

      Comment 4. if animals were exposed then re-exposed, could the authors to determine whether a learned avoidance was similarly affected by this mutation by assessing rate changes?

      Response to comment 4. We conducted the proposed experiment and observed that the WT animals learned to avoid the pathogen but not npr-15(tm12539) mutants (Figure S1C). The revised manuscript reads: “We also found that npr-15(tm12539) exhibited reduced learned avoidance compared to WT animals (Figure S1C).”

      Comment 5: Is there any difference in gene expression of animals that have migrated off the lawn to those remaining on the lawn (e.g. in partial lawn experiments?).

      Response to comment 5. This is an interesting question that has not been addressed in the field yet. While we think the study is exciting, we believe that it is outside the scope of our work. All the gene expression studies performed here are in non-avoiding conditions.

      Comment 6. No concerns but the P values in the legends are a pain to read. Why not put them in figures as in above figures.

      Response to comment 6. We included the P values as suggested.

      Recommendations for the authors:

      Recommendation 1. Fig. 1/S1. Comments: There is some variance in lawn occupancy of wt strains between the different trials in WT animals (e.g. in Fig. 1: 25 for wt vs 60% for npr mutant; S1c 5% for wt and 60% for npr mutant).

      Response to recommendation 1. We addressed this issue as discussed in the response to comment 1.

      Recommendation 2. Fig. 1/S1. Comments. Does this reflect rates of migration or re-occupancy in WT?

      Response to recommendation 2. We have responded to this issue in comment 2.

      Recommendations 3. Fig. 1/S1. Comments. Does pathogen avoidance persist and/or the rate of avoidance differ in npr mutant worms.

      Response to recommendation 3. We have responded to this issue in comment 3.

      Recommendation 4. Fig. 1/S1. Comments B. and if animals were exposed then re- exposed, could the authors to determine whether a learned avoidance was similarly affected by this mutation by assessing rate changes?

      Response to recommendation 4: We have responded to this issue in comment 4 above.

      Recommendation 5. Fig. 2/S2. Comment: Is there any difference in gene expression of animals that have migrated off the lawn to those remaining on the lawn (e.g. in partial lawn expts?).

      Response to recommendation 5. We have responded to this issue in comment 5 above.

      Recommendation 6. Fig. 3/S3. Comment. No concerns but the P values in the legends are a pain to read. Why not put them in figures as in above figures.

      Response to recommendation 6. We included the P values.

      Recommendation 7. Fig. 5. Comments: The authors suggest that the ASJ/NPR15 effect to limit avoidance acts via inhibition of GON-2 in the intestine. The observation that GON-2 inhibition effects on pathogen avoidance occur independently of neurons could suggest that it is a redundant way of accomplishing the same thing, which then makes one wonder if or what the connection is exists between the neuron and the gut. The effect of ASJ via NPR on pathogen avoidance is not neuropeptide dependent, which they show. So how the neuronal-gut communication works. Specific Transmitters... perhaps.

      Response to Recommendation 7 Fig. 5. Thanks for this observation. To address the recommendation, we modified the discussion: “Our research additionally indicates that the regulation of NPR-15-mediated avoidance is not influenced by intestinal immune and neuropeptide genes. Given the potential for functional redundancy and our focus on genes upregulated in the absence of NPR-15, we cannot entirely rule out the possibility that unexamined immune effectors or neuropeptides, not transcriptionally controlled by NPR-15, might be involved. Different intestinal signals may also participate in the NPR-15 pathway that controls pathogen avoidance.”

      Recommendation 8. Comment. Since ASJ neurons control entry into dauer, perhaps isn't surprising that DAF-16 showed up as an NPR-15. induced factor (and dauer worms are resistant to a lot of stressors); that said dauer hormones might be involved as well. Is there any evidence that DAF-16 down-regulates GON-2 expression (see Murphy, Kenyon et al. 2005), and along these lines would GON-2 RNAi work in a DAF-16 mutant? I think addressing these issues are the subject of future studies.

      Response to recommendation 8. We checked the data in the study by Murphy, Kenyon et al., and found that the gon-2 gene was not downregulated.

      Recommendation 9. Minor: Regarding the description to Fig. 5. "Consistently with our previous findings, we found that only " The adverb form of consistent should not be used here.

      Response to recommendation 9. Thank you for pointing this out. The description of Figure 5 was corrected.

    1. Author Response

      The following is the authors’ response to the original reviews.

      Reviewer #1:

      A weakness of the paper is that the power of the model is illustrated for only one specific set of parameters, added in a stepwise manner and the comparison to one specific empirical TGM, assumed to be prototypical; And that this comparison remains descriptive. (That is could a different selection of parameters lead to similar results and is there TGM data which matches these settings less well.)

      The fact that the comparisons in the paper are descriptive is a central point of criticism from both reviewers. As mentioned in my preliminary response, I intentionally did not optimise the model to a specific TGM or show an explicit metric of fitness. As I now explicitly mention in the new experimental section of the paper:

      “The previous analyses were descriptive in the sense that they did not quantify how much the generated TGMs resembled a specific empirical TGM. This was deliberate, because empirical TGMs vary across subjects and experiments, and I aimed at characterising them as generally as possible by looking at some characteristic features in broad terms. For example, while TGMs typically have a strong diagonal and horizontal/vertical bars of high accuracy, questions such as when these effects emerge and for how long are highly dependent on the experimental paradigm. For the same reason, I did not optimise the model hyperparameters, limiting myself to observing the behaviour of the model across some characteristic configurations”

      And, in the Discussion:

      “The demonstrations here are not meant to be tailored to a specific data set, and are, for the most part, intentionally qualitative. TGMs do vary across experiments and subjects; and the hyperparameters of the model can be explicitly optimised to specific scientific questions, data sets, and even individuals. In order to explore the space of configurations effectively, an automatic optimisation of the hyperparameter space using, for instance, Bayesian optimisation (Lorenz, et al., 2017) could be advantageous. This may lead to the identification of very specific (spatial, spectral and temporal) features in the data that may be neurobiologically interpreted.”

      Nonetheless, it is possible to fit the model to a specific TGMs by using a explicit metric of fitness. For illustration, this is what I did in the new experimental section Fitting and empirical TGM, where I used correlation with an empirical TGM to optimise two temporal parameters: the rise slope and the fall slope. As can be seen in the Figure 8, the correlation with the empirical TGM was as high as 0.7, even though I did not fit the other parameters of the model. As mentioned in the paragraph above, more sophisticated techniques such as Bayesian optimisation might be necessary for a more exhaustive exploration, but this would be beyond the scope of the current paper.

      I would also like to point out that fitting the parameters in a step-wise manner was a necessity for interpretation. I suggest to think of the way we use F-tests in regression analyses as a comparison: if we want to know how important a feature is, we compare the model with and without this feature and see how much we loss.

      It further remained unclear to me, which implications may be drawn from the generative model, following from the capacities to mimic this specific TGM (i) for more complex cases, such as the comparison between experimental conditions, and (ii) about the complex nature of neural processes involved.

      Following on the previous points, the object of this paper (besides presenting the model and the associated toolbox) was not to mimic a specific TGM, but to characterise the main features that we generally see across studies in the field. To clarify this, I have added Figure 2 (previously a Supplemental Information figure), and added the following to the Results section:

      “Figure 2 shows a TGM for an example subject, where some archetypal characteristics are highlighted. In the experiments below, specifically, I focus on the strong narrow diagonal at the beginning of the trial, the broadening of accuracy later in the trial, and the vertical/horizontal bars of higher-than-chance accuracy. Importantly, this specific example in Figure 2 is only meant as a reference, and therefore I did not optimise the model hyperparameters to this TGM (except in the last subsection), or showed any quantitative metric of similarity.”

      I mention the possibility of using the model to explore more complex cases in the Introduction, although doing so here would be out of scope:

      “Other experimental paradigms, including motor tasks and decision making, can be investigated with genephys”

      Towards this end, I would appreciate (i) a more profound explanation of the conclusions that can be drawn from this specific showcase, including potential limitations, as well as wider considerations of how scientists may empower the generative model to (ii) understand their experimental data better and (iii) which added value the model may have in understanding the nature of underlying brain mechanism (rather than a mere technical characterization of sensor data).

      To better illustrate how to use genephys to explore a specific data set, I have added a section (Fitting an empirical TGM) where I show how to fit specific hyperparameters to an empirical TGM in a simple manner.

      In the Introduction, I briefly mentioned:

      “This (not exhaustive) list of effects was considered given previous literature (Shah, et al., 2004; Mazaheri & Jensen, 2006; Makeig, et al., 2002; Vidaurre, et al., 2021), and each effect may be underpinned by distinct neural mechanisms. For example, it is not completely clear the extent to which stimulus processing is sustained by oscillations, and disentangling these effects can help resolving this question”

      In the Discussion, I have further commented:

      “Genephys has different available types of effect, including phase resets, additive damped oscillations, amplitude modulations, and non-oscillatory responses. All of these elements, which may relate to distinct neurobiological mechanisms, are configurable and can be combined to generate a plethora of TGMs that, in turn, can be contrasted to specific empirical TGMs. This way, we can gain insight on what mechanisms might be at play in a given task.

      The demonstrations here are not meant to be tailored to a specific data set, and are, for the most part, intentionally qualitative. TGMs do vary across experiments and subjects; and the hyperparameters of the model can be explicitly optimised to specific scientific questions, data sets, and even individuals. In order to explore the space of configurations effectively, an automatic optimisation of the hyperparameter space using, for instance, Bayesian optimisation (Lorenz, et al., 2017) could be advantageous. This may lead to the identification of very specific (spatial, spectral and temporal) features in the data that may be neurobiologically interpreted. “

      On p. 15 "Having a diversity of frequencies but not of latencies produces another regular pattern consisting of alternating, parallel bands of higher/lower than baseline accuracy. This, shown in the bottom left panel, is not what we see in real data either. Having a diversity of latencies but not of frequencies gets us closer to a realistic pattern, as we see in the top right panel." The terms frequency and latency seem to be confused.

      The Reviewer is right. I have corrected this now. Thank you.

      Reviewer #2:

      The results of comparisons between simulations and real data are not always clear for an inexperienced reader. For example, the comparisons are qualitative rather than quantitative, making it hard to draw firm conclusions. Relatedly, it is unclear whether the chosen parameterizations are the only/best ones to generate the observed patterns or whether others are possible. In the case of the latter, it is unclear what we can actually conclude about underlying signal generators. It would have been different if the model was directly fitted to empirical data, maybe of different cognitive conditions. Finally, the neurobiological interpretation of different signal properties is not discussed. Therefore, taken together, in its currently presented form, it is unclear how this method could be used exactly to further our understanding of the brain.

      This critique coincides with that of Reviewer 1. In the current version, I made more clear the fact that I am not fitting a specific empirical TGM and why, and that, instead, I am referring to general features that appear broadly throughout the literature. See more detailed changes below.

      Regarding whether the chosen parameterizations are the only/best ones to generate the observed patterns, the Discussion reflects this limitation:

      “Also importantly, I have shown that standard decoding analysis can differentiate between these explanations only to some extent. For example, the effects induced by phase-resetting and the use of additive oscillatory components are not enormously different in terms of the resulting TGMs. In future work, alternatives to standard decoding analysis and TGMs might be used to disentangle these sources of variation (Vidaurre, et al., 2019). ”

      And

      “Importantly, the list of effects that I have explored here is not exhaustive …”

      Of course, since the list of signal features I have explored is not exhaustive, it cannot be claimed without a doubt that these features are the ones generating the properties we observe in real TGMs. The model, however, is a step forward in that direction, as it provides us with a tool to at least rule out some causes.

      Firstly, it was not entirely clear to me from the introduction what gap exactly the model is supposed to fill: is it about variance in neural responses in general, about which signal properties are responsible for decoding, or about capturing stability of signals? It seems like it does all of these, but this needs to be made clearer in the introduction. It would be helpful to emphasize exactly what insights the model can provide that are unable to be obtained with the current methods.

      I have now made this explicit in in the Introduction, as suggested:

      “To gain insight into what aspects of the signal underpin decoding accuracy, and therefore the most stable aspects of stimulus processing, I introduce a generative model”

      To help illustrating what insights the model can provide, I have added the following sentence as an example:

      “For example, it is not completely clear the extent to which stimulus processing is sustained by oscillations, and disentangling these effects can help resolving this question.”

      Furthermore, I was unclear on why these specific properties were chosen (lines 71 to 78). Is there evidence from neuroscience to suggest that these signal properties are especially important for neural processing? Or, if the logic has more to do with signal processing, why are these specific properties the most important to include?

      To clarify this the text now reads:

      “In the model, when a channel responds, it can do it in different ways: (i) by phase-resetting the ongoing oscillation to a given target phase and then entraining to a given frequency, (ii) by an additive oscillatory response independent of the ongoing oscillation, (iii) by modulating the amplitude of the stimulus-relevant oscillations, or (iv) by an additive non-oscillatory (slower) response. This (not exhaustive) list of effects was considered given previous literature (Shah, et al., 2004; Mazaheri & Jensen, 2006; Makeig, et al., 2002; Vidaurre, et al., 2021), and each effect may be underpinned by distinct neural mechanisms”

      The general narrative and focus of the paper could also be improved. It might help to start off with an outline of what the goal is at the start of the paper and then explicitly discuss how each of the steps works toward that goal. For example, I got the idea that the goal was to capture specific properties of an empirical TGM. If this was the case, the empirical TGM could be placed in the main body of the text as a reference picture for all simulated TGMs. For each simulation step, it could be emphasized more clearly exactly which features of the TGM is captured and what that means for interpreting these features in real data.

      Thank you. To clarify the purpose of the paper better, I have brought Figure 2 to the front (before a Supplementary Figure), and in the first part of Results I have now added:

      “Figure 2 shows a TGM for an example subject, where some archetypal characteristics are highlighted. In the experiments below, specifically, I focus on the strong narrow diagonal at the beginning of the trial, the broadening of accuracy later in the trial, and the vertical/horizontal bars of higher-than-chance accuracy. Importantly, this specific example in Figure 2 is only meant as a reference, and therefore I did not optimise the model hyperparameters to this TGM (except in the last subsection), or showed any quantitative metric of similarity. ”

      I have enunciated the goals more clearly in the Introduction:

      “To gain insight into what aspects of the signal underpin decoding accuracy, and therefore the most stable aspects of stimulus processing, …”

      Relatedly, it would be good to connect the various signal properties to possible neurobiological mechanisms. I appreciate that the author tries to remain neutral on this in the introduction, but I think it would greatly increase the implications of the analysis if it is made clearer how it could eventually help us understand neural processes.

      The Reviewer is right in pointing out that I preferred to remain neutral on this. While I have still kept that tone of neutrality throughout the paper, I have now included the following sentence as an example of a neurobiological question that could be investigated with the model:

      “For example, it is not completely clear the extent to which stimulus processing is sustained by oscillations, and disentangling these effects can help resolving this question.”

      And, more generally,

      “Genephys has different available types of effect, including phase resets, additive damped oscillations, amplitude modulations, and non-oscillatory responses. All of these elements, which may relate to distinct neurobiological mechanisms, are configurable and can be combined to generate a plethora of TGMs that, in turn, can be contrasted to specific empirical TGMs. This way, we can gain insight on what mechanisms might be at play in a given task. ”

      Line 57: this sentence is very long, making it hard to follow, could you break up into smaller parts?

      Thank you. The sentence is fragmented now.

      Please replace angular frequencies with frequencies in Hertz for clarity.

      Here I have preferred to stick to angular frequencies because it is more general than if I talk about Hertz, because that would entail having a specific sampling frequency. I think doing so would create confusion precisely of the sorts that I am trying to clarify in this revision: that is, that these results are not specific of one TGM but reflect general features that we see broadly in the literature.

      There are quite some types throughout the paper, please recheck

      Thank you. I have revised and have made my best to clear them out.

    2. Author Response

      The following is the authors’ response to the original reviews.

      Reviewer #1:

      A weakness of the paper is that the power of the model is illustrated for only one specific set of parameters, added in a stepwise manner and the comparison to one specific empirical TGM, assumed to be prototypical; And that this comparison remains descriptive. (That is could a different selection of parameters lead to similar results and is there TGM data which matches these settings less well.)

      The fact that the comparisons in the paper are descriptive is a central point of criticism from both reviewers. As mentioned in my preliminary response, I intentionally did not optimise the model to a specific TGM or show an explicit metric of fitness. As I now explicitly mention in the new experimental section of the paper:

      “The previous analyses were descriptive in the sense that they did not quantify how much the generated TGMs resembled a specific empirical TGM. This was deliberate, because empirical TGMs vary across subjects and experiments, and I aimed at characterising them as generally as possible by looking at some characteristic features in broad terms. For example, while TGMs typically have a strong diagonal and horizontal/vertical bars of high accuracy, questions such as when these effects emerge and for how long are highly dependent on the experimental paradigm. For the same reason, I did not optimise the model hyperparameters, limiting myself to observing the behaviour of the model across some characteristic configurations”

      And, in the Discussion:

      “The demonstrations here are not meant to be tailored to a specific data set, and are, for the most part, intentionally qualitative. TGMs do vary across experiments and subjects; and the hyperparameters of the model can be explicitly optimised to specific scientific questions, data sets, and even individuals. In order to explore the space of configurations effectively, an automatic optimisation of the hyperparameter space using, for instance, Bayesian optimisation (Lorenz, et al., 2017) could be advantageous. This may lead to the identification of very specific (spatial, spectral and temporal) features in the data that may be neurobiologically interpreted.”

      Nonetheless, it is possible to fit the model to a specific TGMs by using a explicit metric of fitness. For illustration, this is what I did in the new experimental section Fitting and empirical TGM, where I used correlation with an empirical TGM to optimise two temporal parameters: the rise slope and the fall slope. As can be seen in the Figure 8, the correlation with the empirical TGM was as high as 0.7, even though I did not fit the other parameters of the model. As mentioned in the paragraph above, more sophisticated techniques such as Bayesian optimisation might be necessary for a more exhaustive exploration, but this would be beyond the scope of the current paper.

      I would also like to point out that fitting the parameters in a step-wise manner was a necessity for interpretation. I suggest to think of the way we use F-tests in regression analyses as a comparison: if we want to know how important a feature is, we compare the model with and without this feature and see how much we loss.

      It further remained unclear to me, which implications may be drawn from the generative model, following from the capacities to mimic this specific TGM (i) for more complex cases, such as the comparison between experimental conditions, and (ii) about the complex nature of neural processes involved.

      Following on the previous points, the object of this paper (besides presenting the model and the associated toolbox) was not to mimic a specific TGM, but to characterise the main features that we generally see across studies in the field. To clarify this, I have added Figure 2 (previously a Supplemental Information figure), and added the following to the Results section:

      “Figure 2 shows a TGM for an example subject, where some archetypal characteristics are highlighted. In the experiments below, specifically, I focus on the strong narrow diagonal at the beginning of the trial, the broadening of accuracy later in the trial, and the vertical/horizontal bars of higher-than-chance accuracy. Importantly, this specific example in Figure 2 is only meant as a reference, and therefore I did not optimise the model hyperparameters to this TGM (except in the last subsection), or showed any quantitative metric of similarity.”

      I mention the possibility of using the model to explore more complex cases in the Introduction, although doing so here would be out of scope:

      “Other experimental paradigms, including motor tasks and decision making, can be investigated with genephys”

      Towards this end, I would appreciate (i) a more profound explanation of the conclusions that can be drawn from this specific showcase, including potential limitations, as well as wider considerations of how scientists may empower the generative model to (ii) understand their experimental data better and (iii) which added value the model may have in understanding the nature of underlying brain mechanism (rather than a mere technical characterization of sensor data).

      To better illustrate how to use genephys to explore a specific data set, I have added a section (Fitting an empirical TGM) where I show how to fit specific hyperparameters to an empirical TGM in a simple manner.

      In the Introduction, I briefly mentioned:

      “This (not exhaustive) list of effects was considered given previous literature (Shah, et al., 2004; Mazaheri & Jensen, 2006; Makeig, et al., 2002; Vidaurre, et al., 2021), and each effect may be underpinned by distinct neural mechanisms. For example, it is not completely clear the extent to which stimulus processing is sustained by oscillations, and disentangling these effects can help resolving this question”

      In the Discussion, I have further commented:

      “Genephys has different available types of effect, including phase resets, additive damped oscillations, amplitude modulations, and non-oscillatory responses. All of these elements, which may relate to distinct neurobiological mechanisms, are configurable and can be combined to generate a plethora of TGMs that, in turn, can be contrasted to specific empirical TGMs. This way, we can gain insight on what mechanisms might be at play in a given task.

      The demonstrations here are not meant to be tailored to a specific data set, and are, for the most part, intentionally qualitative. TGMs do vary across experiments and subjects; and the hyperparameters of the model can be explicitly optimised to specific scientific questions, data sets, and even individuals. In order to explore the space of configurations effectively, an automatic optimisation of the hyperparameter space using, for instance, Bayesian optimisation (Lorenz, et al., 2017) could be advantageous. This may lead to the identification of very specific (spatial, spectral and temporal) features in the data that may be neurobiologically interpreted. “

      On p. 15 "Having a diversity of frequencies but not of latencies produces another regular pattern consisting of alternating, parallel bands of higher/lower than baseline accuracy. This, shown in the bottom left panel, is not what we see in real data either. Having a diversity of latencies but not of frequencies gets us closer to a realistic pattern, as we see in the top right panel." The terms frequency and latency seem to be confused.

      The Reviewer is right. I have corrected this now. Thank you.

      Reviewer #2:

      The results of comparisons between simulations and real data are not always clear for an inexperienced reader. For example, the comparisons are qualitative rather than quantitative, making it hard to draw firm conclusions. Relatedly, it is unclear whether the chosen parameterizations are the only/best ones to generate the observed patterns or whether others are possible. In the case of the latter, it is unclear what we can actually conclude about underlying signal generators. It would have been different if the model was directly fitted to empirical data, maybe of different cognitive conditions. Finally, the neurobiological interpretation of different signal properties is not discussed. Therefore, taken together, in its currently presented form, it is unclear how this method could be used exactly to further our understanding of the brain.

      This critique coincides with that of Reviewer 1. In the current version, I made more clear the fact that I am not fitting a specific empirical TGM and why, and that, instead, I am referring to general features that appear broadly throughout the literature. See more detailed changes below.

      Regarding whether the chosen parameterizations are the only/best ones to generate the observed patterns, the Discussion reflects this limitation:

      “Also importantly, I have shown that standard decoding analysis can differentiate between these explanations only to some extent. For example, the effects induced by phase-resetting and the use of additive oscillatory components are not enormously different in terms of the resulting TGMs. In future work, alternatives to standard decoding analysis and TGMs might be used to disentangle these sources of variation (Vidaurre, et al., 2019). ”

      And

      “Importantly, the list of effects that I have explored here is not exhaustive …”

      Of course, since the list of signal features I have explored is not exhaustive, it cannot be claimed without a doubt that these features are the ones generating the properties we observe in real TGMs. The model, however, is a step forward in that direction, as it provides us with a tool to at least rule out some causes.

      Firstly, it was not entirely clear to me from the introduction what gap exactly the model is supposed to fill: is it about variance in neural responses in general, about which signal properties are responsible for decoding, or about capturing stability of signals? It seems like it does all of these, but this needs to be made clearer in the introduction. It would be helpful to emphasize exactly what insights the model can provide that are unable to be obtained with the current methods.

      I have now made this explicit in in the Introduction, as suggested:

      “To gain insight into what aspects of the signal underpin decoding accuracy, and therefore the most stable aspects of stimulus processing, I introduce a generative model”

      To help illustrating what insights the model can provide, I have added the following sentence as an example:

      “For example, it is not completely clear the extent to which stimulus processing is sustained by oscillations, and disentangling these effects can help resolving this question.”

      Furthermore, I was unclear on why these specific properties were chosen (lines 71 to 78). Is there evidence from neuroscience to suggest that these signal properties are especially important for neural processing? Or, if the logic has more to do with signal processing, why are these specific properties the most important to include?

      To clarify this the text now reads:

      “In the model, when a channel responds, it can do it in different ways: (i) by phase-resetting the ongoing oscillation to a given target phase and then entraining to a given frequency, (ii) by an additive oscillatory response independent of the ongoing oscillation, (iii) by modulating the amplitude of the stimulus-relevant oscillations, or (iv) by an additive non-oscillatory (slower) response. This (not exhaustive) list of effects was considered given previous literature (Shah, et al., 2004; Mazaheri & Jensen, 2006; Makeig, et al., 2002; Vidaurre, et al., 2021), and each effect may be underpinned by distinct neural mechanisms”

      The general narrative and focus of the paper could also be improved. It might help to start off with an outline of what the goal is at the start of the paper and then explicitly discuss how each of the steps works toward that goal. For example, I got the idea that the goal was to capture specific properties of an empirical TGM. If this was the case, the empirical TGM could be placed in the main body of the text as a reference picture for all simulated TGMs. For each simulation step, it could be emphasized more clearly exactly which features of the TGM is captured and what that means for interpreting these features in real data.

      Thank you. To clarify the purpose of the paper better, I have brought Figure 2 to the front (before a Supplementary Figure), and in the first part of Results I have now added:

      “Figure 2 shows a TGM for an example subject, where some archetypal characteristics are highlighted. In the experiments below, specifically, I focus on the strong narrow diagonal at the beginning of the trial, the broadening of accuracy later in the trial, and the vertical/horizontal bars of higher-than-chance accuracy. Importantly, this specific example in Figure 2 is only meant as a reference, and therefore I did not optimise the model hyperparameters to this TGM (except in the last subsection), or showed any quantitative metric of similarity. ”

      I have enunciated the goals more clearly in the Introduction:

      “To gain insight into what aspects of the signal underpin decoding accuracy, and therefore the most stable aspects of stimulus processing, …”

      Relatedly, it would be good to connect the various signal properties to possible neurobiological mechanisms. I appreciate that the author tries to remain neutral on this in the introduction, but I think it would greatly increase the implications of the analysis if it is made clearer how it could eventually help us understand neural processes.

      The Reviewer is right in pointing out that I preferred to remain neutral on this. While I have still kept that tone of neutrality throughout the paper, I have now included the following sentence as an example of a neurobiological question that could be investigated with the model:

      “For example, it is not completely clear the extent to which stimulus processing is sustained by oscillations, and disentangling these effects can help resolving this question.”

      And, more generally,

      “Genephys has different available types of effect, including phase resets, additive damped oscillations, amplitude modulations, and non-oscillatory responses. All of these elements, which may relate to distinct neurobiological mechanisms, are configurable and can be combined to generate a plethora of TGMs that, in turn, can be contrasted to specific empirical TGMs. This way, we can gain insight on what mechanisms might be at play in a given task. ”

      Line 57: this sentence is very long, making it hard to follow, could you break up into smaller parts?

      Thank you. The sentence is fragmented now.

      Please replace angular frequencies with frequencies in Hertz for clarity.

      Here I have preferred to stick to angular frequencies because it is more general than if I talk about Hertz, because that would entail having a specific sampling frequency. I think doing so would create confusion precisely of the sorts that I am trying to clarify in this revision: that is, that these results are not specific of one TGM but reflect general features that we see broadly in the literature.

      There are quite some types throughout the paper, please recheck

      Thank you. I have revised and have made my best to clear them out.

    1. Author Response

      The following is the authors’ response to the original reviews.

      We are grateful for the comments and suggestions from the reviewers and have followed the recommendation in producing our revised manuscript. We have modified the text and performed additional statistical analysis as detailed below, which we believe has improved the overall manuscript.

      Reviewer #1 (Public Review):

      Establishing direct links between the neuronal connectivity information of connectomics datasets with circuit physiology and behavior and exciting current research area in neurobiology. Until recently, studies of aggression in Drosophila had been conducted largely in males, and many of the neurons involved in this behavior are male-specific clusters. Since the currently available fly brain connectomes come from female brains, their applicability for the study of the circuitry underlying aggressive behavior is very limited.

      The authors have previously used the Janelia hemibrain connectome paired with behavior analysis to show that activating either the aIPg or pC1d cell types can induce short-term aggression in females, while activation of other PC1 clusters (a-c and e) does not. Here they expand on those findings, showing that optogenetic stimulation of aIPg neurons was sufficient to promote an aggressive internal state lasting at least 10 minutes following a 30-second activation. In addition, the authors show that while stimulation of PC1d alone is not sufficient to induce this persistent aggressive state, simultaneous activation of PC1d + PC1e is, suggesting a synergistic effect. Connectomics analysis performed in the authors' previous study had shown that PC1d and aIPg are interconnected. However, silencing pC1d neuronal activity did not reduce aIPg-evoked persistent aggression, indicating that the aggressive state did not depend on pC1d-aIPg recurrent connectivity.

      The conclusions are well supported by the data, and the results presented in this manuscript represent an important contribution to our understanding of the neuronal circuitry underlying female aggression.

      Reviewer #1 (Recommendations For The Authors):

      1. Previously, the authors have shown that the activation of PC1e alone does not induce female aggression. In this study, they investigate the role of aIPg, PC1d, or PC1d+e on aggression persistence, but they do not explore the effect of activation of PC1e alone. It is possible that PC1e activation may not produce an immediate short-term effect but could lead to a gradual increase in aggression over time, potentially explaining at least in part the observed effect upon PC1d+e activation. Incorporating an examination of the long-term impact of PC1e activation on aggression could provide valuable information.

      We did perform mixed pair experiments with the pC1e-SS1 line from the Schretter et al. (2020) paper and did not find any significant changes in aggression over time in this setup as well. We have now added a reference to these experiments in the revised submission in lines 135 to 136.

      1. Some important controls are missing: flies with the genetic combinations employed in the activation experiments shown in Figure 2 but in the absence of activation and under the exact same conditions and for a similar observation period.

      For Figure 2, we used an empty split-Gal4 driver as a genetic control for our activation paradigms. As these flies contain the same number of copies of mini-white while not labeling the targeted cell types, we believe that they provide an appropriate control for these experiments. The control information is specified in all figure legends as well.

      1. The quantification shown in Fig 3- Supplementary Figure 1 shows no effect during stimulation (13 s + 15s), but based on the plots of Figure 3, there may be an effect of silencing PC1d on aIPg-induced aggression during the initial 13 second period. Those two time periods (13 s vs 15 s) could be quantified separately to determine if this is the case.

      We examined the two stimulation periods separately and did not find any significant differences in either period (13s period, p = 0.2978; 15s period, p = 0.6650). We have now added this into the figure legend for Figure 3 and Figure 3 supplement 1.

      1. Expression of Kir2.1 in pC1d neurons while aIPg neurons were activated did not suppress aggression after aIPg stimulation, suggesting that connections from pC1d neurons are not necessary for the persistent aggressive state promoted by aIPg. Since previously the authors have shown that TNT-mediated inhibition of aIPg reduces aggression, the reciprocal experiment would be informative: determining if stimulation of PC1d+e no longer produces persistent aggression when aIPg neurons are silenced.

      In this manuscript, we were primarily testing if the connections from aIPg to pC1d were necessary for the persistent aggressive state induced by aIPg activation. Therefore, we believe the suggested experiment is beyond the scope of the current manuscript.

      1. How many times was each experiment repeated? This is important information and should be in the methods section for each type of experiment or in each figure legend.

      We have now added this information in the appropriate figure legends.

      1. Determining the effect on persistent aggression of silencing sNPF (for example via RNAi or Crispr-Cas9 mediated mutagenesis) in aIPG neurons would be an important addition to the manuscript. If peptidergic signaling is underlying the persistence phenotype of aIPg neurons, that would explain why the recurrent connectivity found between those cells and the PC1 cluster does not play a role.

      We agree with the reviewer that this would be a logical next step in extending this work.

      Reviewer #2 (Public Review):

      The mechanisms that mediate female aggression remain poorly understood. Chiu, Schretter, and colleagues, employed circuit dissection techniques to tease apart the specific roles of particular doublesex and fruitless expressing neurons in the fly Drosophila in generating a persistent aggressive state. They find that activating the fruitless positive alPg neurons, generated an aggressive state that persisted for >10min after the stimulation ended. Similarly, activating the doublesex positive pC1de neurons also generated a persistent state. Activating pC1d or pC1e individually did not induce a persistent state. Interestingly, while neural activation of alPGs and pC1d+e neurons induced persistent behavioural states it did not induce persistent activity in the neurons being activated.

      The conclusions of this paper are well supported by the data, there were only a few points where clarification might help:

      1. Figure 3 is a little confusing. This is a circuit behavioural epistasis experiment where the authors activate alPg with CsChrimson while inhibiting pC1d with Kir2.1. In Fig. 2 flies were separated for 10 min following stimulation which allowed for identification of a persistent state. However, in Fig 3 it appears as if flies were allowed to freely interact during and immediately post-stimulation. It is unclear why flies were not separated as in Fig. 2, which makes it difficult to compare the two results. Some discussion of this point would help. Also, from the rasters it appears as if inhibition of pC1d reduced aggression induced by alPg during the stimulation period. Is this true?

      We thank the reviewer for pointing out the need for clarification and we have modified the legend in Figure 3 to address the points raised. The flies were allowed to freely interact during the experiments shown in Figure 3 and we have added this information to the figure legend. To obtain a high level of aggressive behavior that would make it easier to observe a suppression of aggression, the epistasis experiments were performed with freely moving same-genotype pairs. The level of aggression triggered by the generation 1 LexA line labeling aIPg was lower than that observed when using with the aIPg-SS GAL4 line. The experiment was performed as in Schretter et al. (2020) where we found that aIPg activation induced persistent fighting in same genotype pairs. We have added a brief explanation in lines 152 to 155.

      Inhibition of pC1d does not significantly reduce the overall aggression induced by aIPg stimulation in the 13s + 15s period. We also examined the differences within the two stimulation periods and did not find any significant differences (13s period, p = 0.2978; 15s period, p = 0.6650). We have now added this information to the figure legends for Figure 3 and Figure 3 supplement 1.

      1. pC1e neurons also have recurrent connectivity with alPg neurons. It might help to also discuss the potential role of this arm of the microcircuit.

      We thank the review for this suggestion. The number of synapses that aIPg sends back to pC1e is a very low proportion of its total output (0.177%). However, based on the experiments that we have performed, we cannot rule out that this microcircuit might contribute to maintaining persistence. We have added this point into the discussion in lines 210 to 211.

      Reviewer #2 (Recommendations For The Authors):

      1. Line 129-130: A citation for group-housed flies showing lower aggression would be helpful.

      We have now added in the reference to Chiu et al. (2021), as they showed this effect for females, in line 130.

      1. Figure 2 - figure supplement 1: In the legend, change "when pC1d neurons were stimulation" to "when pC1d neurons were stimulated".

      We thank the reviewer for finding this error and have now corrected this.

      Reviewer #3 (Public Review):

      Two studies published in 2020 independently identified the alPg, pC1d, and pC1e neurons to be involved in initiating and maintaining a state of aggression in female Drosophila. Both studies combined behavioural analyses, optogenitic manipulation of neurons, and connectomics. One of these studies proposed that the extensive interconnections seen between the alPg and pC1d+e neurons might represent a recurrent motif known to support persistent behvioural states in other systems. In this manuscript, the authors test this idea and report that their data do not support it. Specifically, they report that alPg or pC1d+e (but not pC1d alone) can initiate a persistent state of aggression. But they find that the persistent aggressive state is maintained even when the pC1d neurons are inactivated. Finally, they show that neither of these neurons themselves sustains neuronal activity upon stimulation, nor do either of them induce a persistent activity in the other. Together, their data suggest that the recurrent connection between alPg and pC1d is not what supports the persistent state. The data underlying these claims are convincing. A possibility to explore before ruling out recurrent motifs (at this circuit level) in maintaining aggression is that the connections between alPg and pC1e can compensate for the loss of pC1e. Overall, the study is important and will be of interest to those who study the circuit basis of persistent behavioural states, but also to neuroscientists in general.

      Reviewer #3 (Recommendations For The Authors):

      I enjoyed reading this manuscript for its clarity in writing and data presentation.

      I would like the authors to comment on the possibility that pC1e can compensate for the loss of pC1d. It is possible that if they silence both pC1d+e in the context of alPg activation, the persistent aggression is lost?

      We agree with the reviewer that this is an intriguing hypothesis. In order to examine if pC1e does compensate for pC1d, we would need to also activate pC1e while inhibiting pC1d. However, such an experiment is not currently possible as we do not have a LexA line that specifically labels either pC1d or pC1e alone.

      For the pC1d+e silencing experiments, we were primarily testing to see if the most prominent recurrent connection, which is between pC1d and aIPg, was responsible for the behavioral persistence. We agree with the reviewer that this would be a logical follow up experiment to be performed in the future.

      Have the authors looked for activity in the pC1e neuron upon simulation of alPg? (Deutsch et al 2020 observed many regions in the brain that maintained sustained activity upon pC1d+e stimulation.)

      We have not examined this activity. We agree that this would be a good follow up experiment; however, we believe it is beyond the scope of the current work.

      Would the more appropriate experiment in Figure 4c be the co-stimulation of pC1d+e while imaging from alPg?

      For these experiments, we were testing to see if the most prominent recurrent connection, which is between pC1d and aIPg, was responsible for the behavioral persistence. We agree with the reviewer that this would be a good follow up experiment

    1. Author Response

      Reviewer #1 (Public Review):

      Summary:

      This study uses whole genome sequencing to characterise the population structure and genetic diversity of a collection of 58 isolates of E. coli associated with neonatal meningitis (NMEC) from seven countries, including 52 isolates that the authors sequenced themselves and a further 6 publicly available genome sequences. Additionally, the study used sequencing to investigate three case studies of apparent relapse. The data show that in all three cases, the relapse was caused by the same NMEC strain as the initial infection. In two cases they also found evidence for gut persistence of the NMEC strain, which may act as a reservoir for persistence and reinfection in neonates. This finding is of clinical importance as it suggests that decolonisation of the gut could be helpful in preventing relapse of meningitis in NMEC patients.

      Strengths:

      The study presents complete genome sequences for n=18 diverse isolates, which will serve as useful references for future studies of NMEC. The genomic analyses are high quality, the population genomic analyses are comprehensive and the case study investigations are convincing.

      We agree

      Weaknesses:

      The NMEC collection described in the study includes isolates from just seven countries. The majority (n=51/58, 88%) are from high-income countries in Europe, Australia, or North America; the rest are from Cambodia (n=7, 12%). Therefore it is not clear how well the results reflect the global diversity of NMEC, nor the populations of NMEC affecting the most populous regions.

      The virulence factors section highlights several potentially interesting genes that are present at apparently high frequency in the NMEC genomes; however, without knowing their frequency in the broader E. coli population it is hard to know the significance of this.

      We acknowledged the limitations of our NMEC collection in the Discussion. We agree the prevalence of virulence factors in our collection is interesting. The limited size of our collection prevented further evaluation of the prevalence of these virulence factors in a broader E. coli population.

      Reviewer #2 (Public Review):

      Summary:

      In this work, the authors present a robust genomic dataset profiling 58 isolates of neonatal meningitis-causing E. coli (NMEC), the largest such cohort to be profiled to date. The authors provide genomic information on virulence and antibiotic resistance genomic markers, as well as serotype and capsule information. They go on to probe three cases in which infants presented with recurrent febrile infection and meningitis and provide evidence indicating that the original isolate is likely causing the second infection and that an asymptomatic reservoir exists in the gut. Accompanying these results, the authors demonstrate that gut dysbiosis coincides with the meningitis.

      Strengths:

      The genomics work is meticulously done, utilizing long-read sequencing.

      The cohort of isolates is the largest to be sampled to date.

      The findings are significant, illuminating the presence of a gut reservoir in infants with repeating infection.

      We agree

      Weaknesses:

      Although the cohort of isolates is large, there is no global representation, entirely omitting Africa and the Americas. This is acknowledged by the group in the discussion, however, it would make the study much more compelling if there was global representation.

      We agree. In the Discussion we state this is likely a reflection of the difficulty in acquiring isolates causing neonatal meningitis, in particular from countries with limited microbiology and pathology resources.

      Reviewer #3 (Public Review):

      Summary:

      In this manuscript, Schembri et al performed a molecular analysis by WGS of 52 E. coli strains identified as "causing neonatal meningitis" from several countries and isolated from 1974 to 2020. Sequence types, virulence genes content as well as antibiotic-resistant genes are depicted. In the second part, they also described three cases of relapse and analysed their respective strains as well as the microbiome of three neonates during their relapse. For one patient the same E. coli strain was found in blood and stool (this patient had no meningitis). For two patients microbiome analysis revealed a severe dysbiosis.

      Major comments:

      Although the authors announce in their title that they study E. coli that cause neonatal meningitis and in methods stipulate that they had a collection of 52 NMEC, we found in Supplementary Table 1, 29 strains (therefore most of the strains) isolated from blood and not CSF. This is a major limitation since only strains isolated from CSF can be designated with certainty as NMEC even if a pleiocytose is observed in the CSF. A very troubling data is the description of patient two with a relapse infection. As stated in the text line 225, CSF microscopy was normal and culture was negative for this patient! Therefore it is clear that patient without meningitis has been included in this study.

      We have reviewed the clinical data for our 52 NMEC isolates, noting that for some of the older Finish isolates we relied on previous publications. This data is shown in Table S1. To address the Reviewer’s comment, we have added the following text to the methods section (new text underlined).

      ‘The collection comprised 42 isolates from confirmed meningitis cases (29 cultured from CSF and 13 cultured from blood) and 10 isolates from clinically diagnosed meningitis cases (all cultured from blood).’

      Patient 2 was initially diagnosed with meningitis based on a positive blood culture in the presence of CSF pleocytosis (>300 WBCs, >95% polymorphs). We understand there may be some confusion with reference to a relapsed infection, which we now more accurately describe as recrudescent invasive infection in the revised manuscript.

      Another major limitation (not stated in the discussion) is the absence of clinical information on neonates especially the weeks of gestation. It is well known that the risk of infection is dramatically increased in preterm neonates due to their immature immunity. Therefore E. coli causing infection in preterm neonates are not comparable to those causing infection in term neonates notably in their virulence gene content. Indeed, it is mentioned that at least eight strains did not possess a capsule, we can speculate that neonates were preterm, but this information is lacking. The ages of neonates are also lacking. The possible source of infection is not mentioned, notably urinary tract infection. This may have also an impact on the content of VF.

      We agree. In the Discussion we now note the following (new text underlined):

      ‘… we did not have clinical data on the weeks of gestation for all patients, and thus could not compare virulence factors from NMEC isolated from preterm versus term infants.’

      Submission to Medrxiv, a requirement for review of our manuscript at eLife, necessitated the removal of some patient identifying information, including precise age and detailed medical history.

      Sequence analysis reveals the predominance of ST95 and ST1193 in this collection. The high incidence of ST95 is not surprising and well previously described, therefore, the concluding sentence line 132 indicating that ST95 E. coli should exhibit specific virulence features associated with their capacity to cause NM does not add anything. On the contrary, the high incidence of ST1193 is of interest and should have been discussed more in detail. Which specific virulence factors do they harbor? Any hypothesis explaining their emergence in neonates?

      We compared the virulence factors of ST95 and ST1193 and summarized this information in Figure 4. We also discussed how the K1 polysialic acid capsule in ST95 and ST1193 could contribute to the emergence of these STs in NM. Specifically, we stated the following: ‘We speculate this is due to the prevailing K1 polysialic acid capsule serotype found in ST95 and the newly emerged ST1193 clone [22, 37] in combination with other virulence factors [15, 28, 29] (Figure 4) and the immature immune system of preterm infants.’

      In the paragraph depicted the VF it is only stated that ST95 contained significantly more VF than the ST1193 strains. And so what? By the way "significantly" is not documented: n=?, p=?

      We compared the prevalence of known virulence factors between ST95 and ST1193, and showed that ST95 strains in our collection contained significantly more virulence factors than the ST1193 strains. The P-value and the statistical test used were included in Supplementary Figure 3. To address the reviewers concern, we have now also added this to the main manuscript text as follows (new text underlined):

      ‘Direct comparison of virulence factors between ST95 and ST1193, the two most dominant NMEC STs, revealed that the ST95 isolates (n = 20) contained significantly more virulence factors than the ST1193 isolates (n=9), p-value < 0.001, Mann-Whitney two-tailed unpaired test (Supplementary Table 1, Supplementary Figure 3).’

      The complete sequence of 18 strains is not clear. Results of Supplementary Table 2 are presented in the text and are not discussed.

      NMEC isolates that were completely sequenced in this study are indicated in bold and marked with an asterisk in Figure 1. This information is indicated in the figure legend and was provided in the original submission. All information regarding genomic island composition and location, virulence genes and plasmid and prophage diversity is included in Supplementary Table 2. This information is highly descriptive and thus we elected not to include it as text in the main manuscript.

      46 years is a very long time for such a small number of strains, making it difficult to put forward epidemiological or evolutionary theories. In the analysis of antibiotic resistance, there are no ESBLs. However, Ding's article (reference 34) and other authors showed that ESBLs are emerging in E. coli neonatal infection. These strains are a major threat that should be studied, unfortunately, the authors haven't had the opportunity to characterize such strains in their manuscript.

      We agree 46 years is a long time-span. The study by Ding et al examined 56 isolates comprised of 25 different STs isolated in China from 2009-2015, with ST1193 (n=12) and ST95 (n=10) the most common. Our study examined 58 isolates comprised of 22 different STs isolated in seven different geographic regions from 1974-2020, with ST1193 (n=9) and ST95 (n=20) the most common. Thus, despite differences in the geographic regions from which isolates in the two studies were sourced, there are similarities in the most common STs identified. The fact that we observed less antibiotic resistance, including a lack of ESBL genes, in ST1193 is likely due to the different regions from which the isolates were sourced. We acknowledged and discussed the potential of ST1193 harbouring multidrug resistance including ESBLs in our manuscript as follows:

      ‘Concerningly, the ST1193 strains examined here carry genes encoding several aminoglycoside-modifying enzymes, generating a resistance profile that may lead to the clinical failure of empiric regimens such as ampicillin and gentamicin, a therapeutic combination used in many settings to treat NM and early-onset sepsis [35, 36]. This, in combination with reports of co-resistance to third-generation cephalosporins for some ST1193 strains [22, 34], would limit the choice of antibiotic treatment.’

      Second part of the manuscript:

      The three patients who relapsed had a late neonatal infection (> 3 days) with respective ages of 6 days, 7 weeks, and 3 weeks. We do not know whether they are former preterm newborns (no term specified) or whether they have received antibiotics in the meantime.

      As noted above, patient ages were not disclosed to comply with submission to Medrxiv, a requirement for review of our manuscript at eLife.

      Patient 1: Although this patient had a pleiocytose in CSF, the culture was negative which is surprising and no explanation is provided. Therefore, the diagnosis of meningitis is not certain. Pleiocytose without meningitis has been previously described in neonates with severe sepsis. Line 215: no immunological abnormalities were identified (no details are given).

      We respectfully disagree with the reviewer. The diagnosis of meningitis is made unequivocally by the presence of a clearly abnormal CSF microscopy (2430 WBCs) and an invasive E. coli from blood culture. This does not seem controversial to the authors. We had believed it unnecessary to include this corroborative evidence, but have added the following to support our assertion:

      ‘The child was diagnosed with meningitis based on a cerebrospinal fluid (CSF) pleocytosis (>2000 white blood cells; WBCs, low glucose, elevated protein), positive CSF E. coli PCR and a positive blood culture for E. coli (MS21522).’

      On the contrary, the authors are surprised by the statement that CSF pleocytosis occurs in neonatal sepsis ‘without meningitis’ and do not know of any definitions of neonatal meningitis that are not tied to the presence of a CSF pleocytosis. Furthermore, the later isolation of E. coli from the CSF during the relapsed infection re-enforces the initial diagnosis.

      Patient 2: This patient had a recurrence of bacteremia without meningitis (line 225: CSF microscopy was normal and culture negative!). This case should be deleted.

      In a similar vein to the previous comment, we respectfully assert that this patient has clear evidence of meningitis (330 WBCs in the CSF, taken 24h after initiation of antibiotic treatment). In this case, molecular testing was not performed as, under the principle of diagnostic stewardship, it was not considered necessary by the clinical microbiologists and treating clinicians following the culture of E. coli in the bloodstream. We agree that this is not a case of recurrent meningitis, but our intention was to highlight the recrudescence of an invasive infection (urinary sepsis requiring admission to hospital and intravenous antibiotics) which we hypothesise has arisen from the intestinal reservoir. We did not state that all patients suffered from relapsed meningitis.

      Despite this, to address this reviewers concern, we have changed all reference to ‘relapsed infection’ to now read ‘recrudescent invasive infection’ in the revised manuscript.

      Patient 3: This patient had two relapses which is exceptional and may suggest the existence of a congenital malformation or a neurological complication such as abscess or empyema therefore, "imaging studies" should be detailed.

      This patient underwent extensive imaging investigation to rule out a hidden source. This included repeated MRI imaging of head and spine, CT imaging of head and chest, USS imaging of abdomen and pelvis and nuclear medicine imaging to detect a subtle meningeal defect and CSF leak. All tests were normal, and no abscess or empyema found.

      We have modified the text to include this information:

      Text in original submission: ‘Imaging studies and immunological work-up were normal.’

      New text in revised manuscript (underlined): ‘Extensive imaging studies including repeated MRI imaging of the head and spine, CT imaging of the head and chest, ultrasound imaging of abdomen and pelvis, and nuclear medicine imaging did not show a congenital malformation or abscess. Immunological work-up did not show a known primary immunodeficiency. At two years of age, speech delay is reported but no other developmental abnormality.’

      The authors suggest a link between intestinal dysbiosis and relapse in three patients. However, the fecal microbiomes of patients without relapse were not analysed, so no comparison is possible. Moreover, dysbiosis after several weeks of antibiotic treatment in a patient hospitalized for a long time is not unexpected. Therefore, it's impossible to make any assumption or draw any conclusion. This part of the manuscript is purely descriptive. Finally, the authors should be more prudent when they state in line 289 "we also provide direct evidence to implicate the gut as a reservoir [...] antibiotic treatment". Indeed the gut colonization of the mothers with the same strain may be also a reservoir (as stated in the discussion line 336). Finally, the authors do not discuss the potential role of ceftriaxone vs cefotaxime in the dysbiosis observed. Ceftriaxone may have a major impact on the microbiota due to its digestive elimination.

      We addressed the limitations of our study in the Discussion, including that we did not have access to urine or stool samples from the mother of the infants that suffered recrudescence, and thus cannot rule out mother-to-child transmission as a mechanism of reinfection. We have now added that we did not have clinical data on the weeks of gestation for all patients, and thus could not compare virulence factors from NMEC isolated from preterm versus term infants. The limitations of our study are summarised as follows in the Discussion (new text underlined):

      ‘This study had several limitations. First, our NMEC strain collection was restricted to seven geographic regions, a reflection of the difficulty in acquiring strains causing this disease. Second, we did not have access to a complete set of stool samples spanning pre- and post-treatment in the patients that suffered NM and recrudescent invasive infection. This impacted our capacity to monitor E. coli persistence and evaluate the effect of antibiotic treatment on changes in the microbiome over time. Third, we did not have access to urine or stool samples from the mother of the infants that suffered recrudescence, and thus cannot rule out mother-to-child transmission as a mechanism of reinfection. Finally, we did not have clinical data on the weeks of gestation for all patients, and thus could not compare virulence factors from NMEC isolated from preterm versus term infants.’

    1. Author Response

      The following is the authors’ response to the original reviews.

      Public Reviews:

      Reviewer #1 (Public Review):

      Summary:

      Shibl et al., studied the possible role of dicarboxylate metabolite azelaic acid (Aze) in modulating the response of different bacteria, it was used as a carbon source by Phycobacter and possibly toxic for Alteromonas. The experiments were well conducted using transcriptomics, transcriptional factor coexpression networks, uptake experiments, and chemical methods to unravel the uptake, catabolism, and toxicity of Aze on these two bacteria. They identified a putative Aze TRAP transporter in bacteria and showed that Aze is assimilated through fatty acid degradation in Phycobacter. Meanwhile, in Alteromonas it is suggested that Aze inhibits the ribosome and/or protein synthesis, and that efflux pumps shuttles Aze outside the cytoplasm. Further on, they demonstrate that seawater amended with Aze selects for microbes that can catabolize Aze.

      Major strengths:

      The manuscript is well written and very clear. Through the combination of gene expression, transcriptional factor co-expression networks, uptake experiments, and chemical methods Shibl et al., showed that Aze has a different response in two bacteria.

      Major weakness:

      There is no confirmation of the Aze TRAP transporters through mutagenesis.

      Impact on the field:

      Metabolites exert a significant influence on microbial communities in the ocean, playing a crucial role in their composition, dynamics, and biogeochemical cycles. This research highlights the intriguing capacity of a single metabolite to induce contrasting responses in distinct bacterial species, underscoring its role in shaping microbial interactions and ecosystem functions.

      We thank the reviewer for their comments on the paper and we appreciate their suggestion to confirm the activity of Aze TRAP transporters through mutagenesis. We agree that this would be a valuable addition to the study, and we mention in the text that “Despite numerous attempts, our efforts to knock-out azeTSL in Phycobacter failed.”

      The success rate of mutagenesis experiments is often low and time-consuming. There are a few reasons why our knock-out experiments with Phycobacter have not been successful. Despite using several modified protocols for electroporation, no Phycobacter colonies grew on the antibiotic plate. We then tried the homologous recombination approach for conjugation but were not successful in selecting for Phycobacter cells, even when grown in high salinity conditions that favor Phycobacter and disfavor the carrier, E. coli . While we would love to include a mutagen to confirm the function of this cluster, the task seems to be unattainable at the moment .

      Reviewer #2 (Public Review):

      This study explores the breadth of effects of one important metabolite, azelaic acid, on marine microbes, and reveals in-depth its pathway of uptake and catabolism in one model bacterial strain. This compound is known to be widely produced by phytoplankton and plants, and to have complex effects on associated microbiomes.

      This work uses transcriptomics to assay the response of two strains that show contrasting responses to the metabolite: one catabolizes the compound and assimilates the carbon, while the other shows growth inhibition and stress response. A highly induced TRAP transporter, adjacent to a previously identified regulator, is inferred to be the specific uptake system for azelaic acid. However the transport function was not directly tested via genetic or biochemical methods. Nevertheless, this is a significant finding that will be useful for exploring the distribution of azelaic acid uptake capability across metagenomes and other bacteria.

      The authors use pulse-chase style metabolomics experiments to beautifully demonstrate the fate of azelaic acid through catabolic pathways. They also measure an assimilation rate per cell, though it remains unclear how this measured rate relates to natural systems. The metabolomics approach is an elegant way to show carbon flux through cells, and could serve as a model for future studies.

      The study seeks to extend the results from two model strains to complex communities, using seawater mesocosm experiments and soil/Arabidopsis experiments. The seawater experiments show a community shift in mesocosms with added azelaic acid. However, the mechanisms for the shift were not determined; further work is necessary to demonstrate which community members are directly assimilating the compound vs. benefitting indirectly or experiencing inhibition. In my opinion the soil and Arabidopsis experiments are quite preliminary. I appreciate the authors' desire to broaden the scope beyond marine systems, but I believe any conclusions regarding different modes of action in aquatic vs terrestrial microbial communities are speculative at this stage.

      This work is a nice illustration of how we can begin to tease apart the effects of chemical currencies on marine ecosystems. A key strength of this work is the combination of transcriptomics and metabolomics methods, along with assaying the impacts of the metabolite on both model strains of bacteria and whole communities. Given the sheer number of compounds that probably play critical roles in community interactions, a key challenge for the field will be navigating the tradeoffs between breadth and depth in future studies of metabolite impacts. This study offers a good compromise and will be a useful model for future studies.

      We thank the reviewer for their thoughtful comments on the manuscript. We appreciate their feedback on the breadth of effects of Aze on marine microbes, and their insights into the strengths and limitations of our study.

      We agree that the specific mechanisms underlying community-level shifts in seawater mesocosm experiments with added Aze are not yet fully understood and we believe such work is beyond the scope of this paper and warrants an in-depth study of its own. This can perhaps be conducted at a larger scale by using a combination of meta-omics and targeted enrichment to identify the community members directly assimilating Aze, as well as those that are benefitting indirectly or experiencing inhibition.

      We also agree that the soil and Arabidopsis experiments are exploratory. However, we believe that these experiments are a valuable first step in highlighting the potential for Aze to have different modes of action in aquatic versus terrestrial microbial communities. Our interest in contrasting bacterial molecular responses in terrestrial plant rhizospheres and marine algal phycospheres stems from the fact that both environments share similar molecules and related bacteria, yet exhibit significantly different evolutionary histories and fluid dynamic profiles (Seymour et al 2017, Nature Microbiol ). Although more is known about Aze in Arabidopsis than phytoplankton, there are still gaps in this knowledge. For example, recent work has shown that Aze and derivatives can be secreted into soil (Korenblum et al 2020, PNAS ), but whether Aze directly influences microbial communities in soil as we have shown in seawater has not been explored. Thus, we feel our preliminary experiments in soil are important to provide such a distinction with seawater. Additional studies in these systems to further investigate the importance of Aze, which were beyond the scope of this current work, would be quite beneficial.

      Reviewer #1 (Recommendations For The Authors):

      General comments:

      A complete supplemental file of differentially expressed genes should be provided in the supplemental. Please add tables with the entire DESeq output for Aze additions in the genomes of Phycobacter (0.5 and 8 h) and Alteromonas (0.5 h). While it makes sense to focus the paper on Aze related genes, the full dataset should be made available in a more curated form than just the raw reads in the SRA.

      We thank the reviewer for this suggestion. We have included three more sheets in Supplementary Table 1 file where readers can find the entire DESeq outputs of Phycobacter (0.5 and 8 h) and Alteromonas (0.5 h) experiments.

      Specific comments:

      • L82 indicates the TRAP transporter for Aze. Looking at the table for gene expression of Phycobacter there are 26 significantly enriched transport genes at 0.5 h other than the putative Aze TRAP transporter. Even though the TRAP transporter is likely transporting Aze, it would be good to let the readers know that other transporters showed transcript enrichment.

      Thank you for this helpful comment. We modified the sentence accordingly to read as follows: “Among 26 enriched transporter genes in our dataset, a C 4 - dicarboxylate tripartite ATP-independent periplasmic (TRAP) transporter substrate-binding protein (INS80_RS11065) was the most and the third most upregulated gene in Phycobacter grown on Aze at 0.5 and 8 hours, respectively.”

      • Figure 1: There are many genes enriched from -1 to 1. Is there a cut off, p-val (can you add it to the caption)? It would be good to have a dashed line or something that indicates the -1 and 1 log2 fold change in the figure.

      We thank the reviewer for this suggestion. We added the following sentence to the legend of Fig. 1: “Genes were considered DE with a p -adjusted value of < 0.05 and a log2 fold-change of ≥ ±0.50.”

      • Supplementary tables: Add a title on all the supplementary tables. It's hard to tell what each one of the tables means without looking at the text and content of each tables.

      A short descriptive title is now added to all supplementary tables.

      • Not sure if it matters, though Table S1 was not available in the attached files, though it is in the complete pdf.

      Table S1 is now in the attached files and the DESeq output has been added to it as suggested in the general comment above.

      Reviewer #2 (Recommendations For The Authors):

      Here I offer some more specific suggestions and comments on the methods and presentation.

      I recommend being careful throughout with the language regarding conclusions. For instance, the study does not directly demonstrate the activity of the TRAP transporter (as mentioned above), and does not directly demonstrate that the bacteria that increase in abundance in the mesocosm experiments are actually assimilating azelaic acid.

      We thank the reviewer for this comment. We agree that further studies are required to get definitive answers regarding the direct activity of the transporter genes and direct assimilation of Aze by bacteria in the mesocosm. These complex experiments would require establishing a reproducible workflow for knocking out genes and further isotope labeling experiments to track Aze assimilation in a natural setting. To that end, we were keen on using language throughout the manuscript indicating that transporter activity is putative. We went through the manuscript again to make sure it was clear that the transporter activity is putative at this time and is not confirmed. For the mesocosms, we cannot rule out that the changes in community structure is not due to other factors besides Aze. We have added this sentence in the discussion of the mesocosm experiments to indicate that the observed changes in microbial community cannot be directly attributed to Aze activity and may be a byproduct of other mechanisms.

      Additionally, I find the soil and plant experiments to be very preliminary, and would personally recommend removing them from the manuscript. This is of course the authors' choice, but I find they detract from an otherwise more solid story. I wonder whether 16 hours was sufficient to see community changes and whether adding azelaic acid directly into the plant is necessary or relevant. The study does not measure any plant immune responses so I caution against drawing conclusions about the mechanism. It seems the connection to plant immunity was already shown in the literature, in which case I'm not sure whether these experiments presented here really add anything new to the paper.

      We thank the reviewer for these comments. Our 16-hour sampling time point (similar to the seawater experiment) represents an overnight incubation period that should allow sufficient change in the natural microbial composition yet avoids the long-term succession of microbes with high metabolic capacities that may outcompete the rest of the community at long incubation periods. Deciding on this length of incubation was also informed by the uptake rate of Aze and its influence on either bacteria assimilating it as a carbon source or being inhibited by it.

      Since no significant changes were observed in the soil, it was necessary to test the hypothesis that the plant host might be indirectly influencing the rhizosphere microbial communities by infiltrating A. thaliana leaves with Aze. As the reviewer mentions, the association between Aze and plant immunity was previously shown; however, the overall influence on the microbial community has not been fully explored yet. The soil and plant experiments were meant to serve an exploratory purpose and we find them necessary to keep in the manuscript as a first step in comparing the mode of action of Aze within marine and terrestrial ecosystems. They are by no means the answer to what role Aze plays in soil systems, but rather they are the starting point. We hope that our results encourage some readers to investigate similar common metabolites to further elucidate the molecular underpinnings of microbial modulation in both environments.

      Regarding the transcriptomics data, I am not clear on why the "expression ratio" -- i.e. the fraction of pathway genes that were differentially abundant -- was used. I would not expect all transcripts in a pathway to behave the same way in response to a perturbation, due to variation in half-life/stability, post-transcriptional and post-translational regulation, etc. I recommend removing the expression ratio (right panel) from Figure 1. The left panel shows the data more clearly and more directly.

      We thank the reviewer for their insight and we agree that not all transcripts in a pathway behave the same way. However, we find the expression ratio panel visually informative to highlight the importance of a pathway in response to Aze, taking into consideration the total number of key genes involved in a pathway. For example, despite the larger number of DE genes associated with the Amino Acid Metabolism & Degradation pathway compared to the Fatty Acid Degradation pathway, the expression ratio for the former in each transcriptome is lower than its Fatty Acid Degradation counterpart, indicating that the response of key fatty acid degradation genes to Aze is more pronounced. We have qualified the reasons for including expression ratios in Figure 1 legend.

      Overall I enjoyed reading the manuscript and applaud the authors on a nice contribution to this important field.

    1. Author Response

      The following is the authors’ response to the previous reviews.

      Public Reviews:

      Reviewer #1 (Public Review):

      Peng et al develop a computational method to predict/rank transcription factors (TFs) according to their likelihood of being pioneer transcription factors--factors that are capable of binding nucleosomes--using ChIP-seq for 225 human transcription factors, MNase-seq and DNase-seq data from five cell lines. The authors developed relatively straightforward, easy to interpret computational methods that leverage the potential for MNase-seq to enable relatively precise identification of the nucleosome dyad. Using an established smoothing approach and local peak identification methods to estimate positions together with identification of ChIP-seq peaks and motifs within those peaks which they referred to as "ChIP-seq motifs", they were able to quantify "motif profiles" and their density in nucleosome regions (NRs) and nucleosome depleted regions (NDRs) relative to their estimated nucleosome dyad positions. Using these profiles, they arrived at an odd-ratio based motif enrichment score along with a Fisher's exact test to assess the odds and significance that a given transcription factor's ChIP-seq motifs are enriched in NRs compared to NDRs, hence, its potential to be a pioneer transcription factor. They showed that known pioneer transcription factors had among the highest enrichment scores, and they could identify a number of relatively novel pioneer TFs with high enrichment scores and relatively high expression in their corresponding cell line. They used multiple validation approaches including (1) calculating the ROC-AUC and Matthews correlation coefficient (MCC) and generating ROC and precision-recall curves associated with their enrichment score based on 32 known pioneer TFs among their 225 TFs which they used as positives and the remaining TFs (among the 225) as negatives; (2) use of the literature to note that known pioneer TFs that acted as key regulators of embryonic stem cell differentiation had a highest enrichment scores; (3) comparison of their enrichment scores to three classes of TFs defined by protein microarray and electromobility shift assays (1. strong binder to free and nucleosomal DNA, 2. weak binder to free and nucleosomal DNA, 3. strong binding to free but not nucleosomal DNA); and (4) correlation between their calculated TF motif nucleosome end/dyad binding ratio and relevant data from an NCAP-SELEX experiment. They also characterize the spatial distribution of TF motif binding relative to the dyad by (1) correlating TF motif density and nucleosome occupancy and (2) clustering TF motif binding profiles relative to their distance from the dyad and identifying 6 clusters.

      The strengths of this paper are the use of MNase-seq data to define relatively precise dyad positions and ChIP-seq data together with motif analysis to arrive at relatively accurate TF binding profiles relative to dyad positions in NRs as well as in NDRs. This allowed them to use a relatively simple odds ratio based enrichment score which performs well in identifying known pioneer TFs. Moreover, their validation approaches either produced highly significant or reasonable, trending results.

      The weaknesses of the paper are relatively minor, and the authors do a good job describing the limitations of the data and approach.

      Reviewer #2 (Public Review):

      In this study, the authors utilize a compendium of public genomic data to identify transcription factors (TF) that can identify their DNA binding motifs in the presence of nuclosome-wrapped chromatin and convert the chromatin to open chromatin. This class of TFs are termed Pioneer TFs (PTFs). A major strength of the study is the concept, whose premise is that motifs bound by PTFs (assessed by ChIP-seq for the respective TFs) should be present in both "closed" nucleosome wrapped DNA regions (measured by MNase-seq) as well as open regions (measured by DNAseI-seq) because the PTFs are able to open the chromatin. Use of multiple ENCODE cell lines, including the H1 stem cell line, enabled the authors to assess if binding at motifs changes from closed to open. Typical, non-PTF TFs are expected to only bind motifs in open chromatin regions (measured by DNaseI-seq) and not in regions closed in any cell type. This study contributes to the field a validation of PTFs that are already known to have pioneering activity and presents an interesting approach to quantify PTF activity.

      For this reviewer, there were a few notable limitations. One was the uncertainty regarding whether expression of the respective TFs across cell types was taken into account. This would help inform if a TF would be able to open chromatin. Another limitation was the cell types used. While understandable that these cell types were used, because of their deep epigenetic phenotyping and public availability, they are mostly transformed and do not bear close similarity to lineages in a healthy organism. Next, the methods used to identify PTFs were not made available in an easy-to-use tool for other researchers who may seek to identify PTFs in their cell type(s) of interest. Lastly, some terms used were not define explicitly (e.g., meaning of dyads) and the language in the manuscript was often difficult to follow and contained improper English grammar.

      Reviewer #3 (Public Review):

      Peng et al. designed a computational framework for identifying pioneer factors using epigenomic data from five cell types. The identification of pioneer factors is important for our understanding of the epigenetic and transcriptional regulation of cells. A computational approach toward this goal can significantly reduce the burden of labor-intensive experimental validation.

      The authors have addressed my previous comments.

      The main issue identified in this re-review is based on the authors' additional experiments to investigate the reproducibility of the pioneer factors identified in the previously analysis that anchored on H1 ESCs.

      The additional analysis that uses the other four cell types (HepG2, HeLa-S3, MCF-7, and K562) as anchors reveals the low reproducibility/concordance and high dependence on the selection of anchor cell type in the computational framework. In particular, now several stem cell related TFs (e.g. ESRRB, POU5F1) are ranked markedly higher when H1 ESC is not used as the anchor cell type as shown in Supplementary Figure 5.

      Of note, the authors have now removed the shape labels that denote Yamanaka factors in Figure 2c (revised manuscript) that was presented in the main Figure 2a in the initial submission. The NFYs and ESRRB labels in Supplementary 4a are also removed and the boxplot comparing NFYs and ESRRB with other TF are also removed in this figure. Removing these results effectively hides the issues of the computational framework we identified in this revision. Please justify why this was done.

      In summary, these new results reveal significant limitations of the proposed computational framework for identifying pioneer factors. The current identifications appear to be highly dependent on the choice of cell types.

      Response: We thank all reviewers for their thoughtful and constructive comments and suggestions, which helped us to strengthen our paper. Following the suggestions, we have further addressed the reviewer’s comments and the detailed responses are itemized below.

      Reviewer #1 (Recommendations For The Authors):

      The following few minor mistakes/discrepancies/omissions should be addressed:

      1. In Figure 3, the Nucleosome Occupancy curves and legend are orange and the Binding Motif Profiles are blue; however, the y-axis label for Nucleosome occupancy profile is blue, and the y-axis label of Binding motif profile is orange. The colors seem to be switched, or I'm missing something.

      Response: We thank the reviewer for pointing it out. We have changed the colors to make it consistent.

      1. The text at the bottom of p. 11 of the main manuscript describing Supplementary Fig. 5 states: "If we repeat our anaysis by redefining differentially open regions as those closed in differentiated cell lines and open in H1 embryonic cell line, then ESSRB and Yamanaka pioneer transcription factor POU5F1 (OCT4) showed significantly higher enrichment scores (Supplementary Figure 5)." However, Supplementary Fig. 5 legend states: "Enrichment analysis of different TFs using the differentially open from one cell line (shown in the title) and conserved open regions from other four cell lines.". These two descriptions of the differential chromatin criteria used in the analysis don't appear to match. The description in the text is the one that makes much more sense to me. The legend should be written a little more clearly and reflect the statement in the main text. One can see from the cut and paste the "analysis" is also misspelled.

      Response: We have rewritten the legend of Supplementary Figure 5 to make it clear and consistent. The misspelling has also been corrected.

      1. It might be helpful to add that a random classifier would yield a constant precision recall (PR) curve (as a function of Recall) with the Precision = P/(P+N) or the fraction of positives for all plotted PR curves which in the case of Fig. 2a is 32/225 = 0.142, for example.

      Response: We thank the reviewer for the suggestions. We have added the fraction of positives for Figure 2.

      1. On p. 17 line 513, the authors refer to "Supplementary 7, 9 and 13". I'm assuming it's "Supplementary Tables 7, 9 and 13".

      Response: It has been corrected.

      1. On p. 18 line 539, "essays" should be "assays".

      Response: It has been corrected.

      Reviewer #2 (Recommendations For The Authors):

      We are satisfied with the revisions in this version of the manuscript.

      Reviewer #3 (Public Review):

      The main issue identified in this re-review is based on the authors' additional experiments to investigate the reproducibility of the pioneer factors identified in the previously analysis that anchored on H1 ESCs.

      The additional analysis that uses the other four cell types (HepG2, HeLa-S3, MCF-7, and K562) as anchors reveals the low reproducibility/concordance and high dependence on the selection of anchor cell type in the computational framework. In particular, now several stem cell related TFs (e.g. ESRRB, POU5F1) are ranked markedly higher when H1 ESC is not used as the anchor cell type as shown in Supplementary Figure 5.

      Of note, the authors have now removed the shape labels that denote Yamanaka factors in Figure 2c (revised manuscript) that was presented in the main Figure 2a in the initial submission. The NFYs and ESRRB labels in Supplementary 4a are also removed and the boxplot comparing NFYs and ESRRB with other TF are also removed in this figure. Removing these results effectively hides the issues of the computational framework we identified in this revision. Please justify why this was done.

      In summary, these new results reveal significant limitations of the proposed computational framework for identifying pioneer factors. The current identifications appear to be highly dependent on the choice of cell types.

      Response: We would like to clarify that our enrichment score used for TF classification, defined by Equation 3, is expected to be cell-type specific. The value of the enrichment score is modulated by a number of factors beyond the property of a TF to act as a PTF, such as the abundance of a given TF in a given cell line, cell type-specific nucleosome binding maps and interactions with other TFs. Thus, it is expected that the enrichment scores calculated for the same TF in different cell lines should be quantitatively different. Following the initial suggestion of Reviewer 3, we have diversified our analysis by using different cell lines as anchors. This analysis showed that most PTFs that we identified could be confirmed based on different cell lines, when comparing the relative enrichment scores within each cell line. On the other hand, it is not expected that the values of enrichment scores of a given TF should be similar across different cell lines.

      Regarding a specific comment about ESRRB and POU5F1, these TFs are known pioneer factors with roles in reprogramming of somatic cells into induced pluripotent stem cells and suppressing cell differentiation. They have the ability to open closed chromatin regions in the differentiated cell lines. Therefore, if we redefine the differentially open regions as those closed in differentiated cell lines and open in H1 embryonic cell line, these pioneer factors are expected to have high enrichment scores. Indeed, our new results validated the roles of these PTFs in cell reprogramming. As mentioned above, their enrichment scores in different cell lines are not expected to be the same.

      We also would like to clarify that no results were removed during the update of the figures, and all modifications of the manuscript following the suggestions of the reviewers were only made to improve the figures and make them clearer and the message more straightforward.

    1. Author Response

      The following is the authors’ response to the previous reviews.

      We would like to thank the Editors and Reviewers for their additional comments and constructive feedback on our manuscript. We have made minor adjustments to the figures and texts based on their suggestions, including improved images in Figure 1 and correction of figure labels.

      Reviewer #1 (Public Review):

      In their previous paper (Lari et al, 2019; Azra Lari Arvind Arul Nambi Rajan Rima Sandhu Taylor Reiter Rachel Montpetit Barry P Young Chris JR Loewen Ben Montpetit (2019) A nuclear role for the DEAD-box protein Dbp5 in tRNA export eLife 8:e48410.) as well as in the current manuscript the authors states that Dbp5 is involved in the export of tRNA that is independent of and parallel to Los1. They state that Dbp5 binds to the tRNA independent of known tRNA export proteins. The obtained conclusion is both intriguing and innovative, since it suggests that there are other variables, beyond the ones previously identified as tRNA factors, that might interact with Dbp5 to facilitate the export process. In order to find out additional factors aiding this process the authors may employ total RNA-associated protein purification (TRAPP) experiments ( Shchepachevto et al., 2019; Shchepachev V, Bresson S, Spanos C, Petfalski E, Fischer L, Rappsilber J, Tollervey D. Defining the RNA interactome by total RNA-associated protein purification. Mol Syst Biol. 2019 Apr 8;15(4):e8689. doi: 10.15252/msb.20188689. PMID: 30962360; PMCID: PMC6452921) to identify extra factors involved in conjunction with Dbp5. The process elucidates hitherto uninvestigated tRNA export components that function in conjunction with Dbp5.

      Author Response: We greatly appreciate this suggestion and agree with the reviewer that identification of the composition of the export competent Dbp5 containing tRNA complex is a critical next step for understanding the mechanism of Dbp5 mediated tRNA export, which will form the foundation of a future investigation in the laboratory and warrants its own study.

      Reviewer #1 (Public Review):

      Various reports suggest that eukaryotic translation elongation factor 1 eEF1A is involved tRNA export Bohnsack et al., 2002 (Bohnsack MT, Regener K, Schwappach B, Saffrich R, Paraskeva E, Hartmann E, Görlich D. Exp5 exports eEF1A via tRNA from nuclei and synergizes with other transport pathways to confine translation to the cytoplasm. EMBO J. 2002 Nov 15;21(22):620515. doi: 10.1093/emboj/cdf613. PMID: 12426392; PMCID: PMC137205), Grosshans etal., 2002; Grosshans H, Hurt E, Simos G. An aminoacylation-dependent nuclear tRNA export pathway in yeast. Genes Dev. 2000 Apr 1;14(7):830-40. PMID: 10766739; PMCID: PMC316491). The presence of mutations in eEF1A has been seen to hinder the nuclear export process of all transfer RNAs (tRNAs). eEF1A has been shown to interact with Los1 aiding in tRNA export. The authors can also explore the crosstalk between Dbp5 and eEF1A in this study. Additionally, suppressor screening analysis in dbp5R423A , los1∆dbp5R423A los1∆msn∆dbp5R423A could shed more light on this.

      Author Response: Thank you for this suggestion and raising an important possible role for Dbp5 in eEF1A mediated tRNA export. Based on more recent investigation of eEF1A function in tRNA export (PMID: 25838545), it is likely that eEF1A functions in re-export of charged tRNAs specifically (likely in conjunction with Msn5). The current manuscript has largely focused on the role of Dbp5 in pre-tRNA export, but a more careful mechanistic characterization of Dbp5 and re-export will be conducted in follow-up studies given the physical interaction between Dbp5 and spliced tRNAs we previously reported. Similarly, suppressor screens with the Dbp5 and los1Δmsn5Δ mutants will likely be a useful tool in identifying additional tRNA export factors and we thank the reviewer for this suggestion.

      Reviewer #1 (Public Review):

      The addition of Gle1 is potentially novel but it's unclear why the authors didn't address the potential involvement of IP6.

      Author Response: The text has been revised to highlight the importance of InsP6 in Gle1 mediated activation of Dbp5. This includes referencing InsP6 throughout the manuscript during discussions of Gle1 activation of Dbp5 and lines 401-404 discussing the potential role for the small molecule in regulating mRNA and tRNA export in different cellular contexts (e.g., stress and disease).

    1. Author Response

      The following is the authors’ response to the original reviews.

      Public Reviews:

      Reviewer #1 (Public Review):

      Weaknesses:

      Reviewer comment: Here, the activity of SWIFT molecules was assessed in single cell types with or without BKlotho expression. Ultimately, the ability of the SWIFT molecules to activate Wnt signaling in a cell type-specific manner should be tested in the context of many different cellular identities that express BKlotho to different extents. It would be good to demonstrate that Wnt activation by SWIFT correlates with BKlotho expression level in multiple cell types - such data would strengthen the claim of cell-type specificity.

      Response: We agree with the reviewer’s comment, it would be interesting to correlate the signaling level to the expression levels of βKlotho. The tools to carry out such an experiment are not currently available, as this would require a culture system that allows efficient growth of different cell types, and the reagents to detect both the receptor protein levels of βKlotho (as well as FZD/LRP) and signaling levels. We did perform an additional experiment to further support this targeting approach using a 2-layered (transwell) cell culture system. In this culture system, one cell type is put into the top well and the other cell type is put into the bottom well. Molecules to be tested were added to the media which is shared and freely diffuse across the two cell types. In this 2-layer cell system, the results again demonstrate the ability of the SWIFT molecules to specifically induce signaling only in βKlotho expressing hepatoma Huh7 cells and not in non-targeting HEK293 cells. This new data is included as Fig. 3H in the revised manuscript.

      Reviewer comment: The study does not address whether the targeted cells express FGFR1c/2c/3c and whether the FGF21 full-length moiety or the 39F7 IgG moiety of SWIFT molecules could unintentionally activate FGF signaling in these cells.

      Response: We agree with the reviewer’s comment. The receptor βKlotho and its binders (FGF21 and 39F7) were used to test the BRAID/SWIFT concept, the effects on FGF signaling were not the focus of the current study. This comment has now been added to the revised manuscript in the discussion. Inclusion of αGFP controls in the study also suggests the observed reporter activity in the targeted scenario is unlikely caused indirectly by any unexpected FGF signaling.

      Reviewer #2 (Public Review):

      Weaknesses:

      Reviewer comment: The study shows the SWIFT approach works in vitro using cell lines, primary human hepatocytes, and human intestinal organoids, but it lacks an in vivo animal model or clinical validation. The applicability of this approach to therapy is still unknown.

      Response: The βKlotho binder, 39F7, is specific to the human receptor and does not cross react with mouse. Unfortunately, we are not able to test these SWIFTs in a mouse model.

      Reviewer comment: The success of SWIFT depends on the presence and expression of the bridging receptor (βKlotho) on target cells. The approach may fail if the target receptor is not expressed or available.

      Response: We agree with the reviewer, the SWIFT molecules should not induce signaling on cells where bridging receptor is not expressed, therefore, achieving target cell specificity. As pointed out by the reviewer, finding the right bridging receptor on the target cell is critical.

      Reviewer #1 (Recommendations For The Authors):

      Reviewer comment 1: One way to further validate the specificity of SWIFT molecules would be to apply them to a mix of different cell types and quantify BKlotho level and Wnt reporter activity at the single cell level, potentially through imaging, FACS, or transcriptomics.

      Response: We agree with the reviewer’s comment, it would be interesting to correlate the signaling level to the expression levels of βKlotho. The tools to carry out such an experiment are not currently available, as this would require a culture system that allows efficient growth of different cell types, and the reagents to detect both the receptor protein levels of βKlotho (as well as FZD/LRP) and signaling levels. We did perform an additional experiment to further support this targeting approach using a 2-layered (transwell) cell culture system. In this culture system, one cell type is put into the top well and the other cell type is put into the bottom well. Molecules to be tested were added to the media which is shared and freely diffuse across the two cell types. In this 2-layer cell system, the results again demonstrate the ability of the SWIFT molecules to specifically induce signaling only in βKlotho expressing hepatoma Huh7 cells and not in non-targeting HEK293 cells. This new data is included as Fig. 3H in the revised manuscript.

      Reviewer comment 2: The experiments presented demonstrate activation of one signaling pathway in cells specifically expressing a target receptor rather than demonstrating "the feasibility of combining different signaling pathways" as stated in the abstract.

      Response: We thank the reviewer for pointing this out and have adjusted the sentence accordingly.

      Reviewer comment 3: What are the biological consequences of activating Wnt signaling in cells expressing BKlotho and why is that of interest? Could these biological outcomes be used as an additional, perhaps more consequential, readout for SWIFT activity?

      Response: βKlotho is expressed on several different cell types that include hepatocytes, WAT, BAT, and certain regions in CNS. Our studies here focused on the WNT signaling pathway, and βKlotho/FGF21/39F7 receptor ligand system was used to illustrate the BRAID/SWIFT cell targeting concept. Whether these molecules may additional modulate endocrine FGF signaling and metabolic homeostasis, and whether there is any interaction between βKlotho and Wnt signaling pathways could be the subject of future studies. This is now added to the revised manuscript.

      Reviewer comment 4: The manuscript would benefit from a careful review to improve wording and address grammatical errors.

      Response: We thank the reviewer for this suggestion, and we have now had another round of language editing by a professional service.

      Reviewer #2 (Recommendations For The Authors):

      Reviewer comment 1. The expression of KLB in Fig 3G and 4B seems way too low and may not represent the amount on the cell surface. Did the authors validate the expression on the cell surface?

      Response: In both figures we have displayed the expression level normalized to housekeeping gene ACTB. Housekeeping genes such as ACTB can be among the most abundant transcripts in a cell. The observation that KLB mRNA detection is below ACTB mRNA levels is expected and we would argue not too low. The average real-time PCR cycle threshold (Ct) for KLB in Huh7 and primary hepatocytes was 18 and 24 respectively. To avoid any confusion, we have now displayed the expression data normalized to HEK293 and intestinal organoids as a fold difference in a new Figure 3G and 4B.

      Comment 2. Fig 3G needs statistical significance.

      Response: We thank the reviewer for highlighting this, we have now included the statistical analysis in an updated Figure 3G.

    1. Author Response

      The following is the authors’ response to the original reviews.

      Public Reviews:

      Reviewer #1 (Public Review):

      In the manuscript there is not much comparison between the crystal and cryoEM structures provided, and on inspection they appear to be very similar. The crystal structures also reveal parts of the CC domains in Las1, which is not present in the cryoEM structures. It is interesting the CC domains in Sc and Cj are quite different as illustrated in Figure 4B. They also seem to be somewhat disconnected from the rest of the complex (more so for Cj), even though that's not apparent in Figures 2-4. Despite this, it would be very useful to show the cryoEM densities when describing the catalytic site and C-terminal domain interactions, for example, as this can be very useful to increase confidence in the model and proposed mechanisms.

      We thank the reviewer for this suggestion. We have added a figure (Figure 5- Figure supplement 3) to show cryo-EM and crystal densities of key amino acids, when describing the catalytic site and C-terminal domain interactions. In analyzing the interaction between Las1 and Grc3, we have also provided additional comparisons of the crystal structure and the cryo-EM structure (Figure 5, Figure 5-figure supplement 1, 2 and 3, Figure 6, Figure 6-figure supplement 1).

      The description of the complex as a butterfly is engaging, and from a certain angle it can be made to look as such; this was also described previously in (Pillon et al., 2019, NSMB) for the same complex from a different organism (Ct). However, it is a bit misleading, because the complex is actually C2 symmetric. Under this symmetry, the 'body' would consist of two 'heads' one pointing up, one down facing towards the back, and one wing would have its back toward the viewer, the other the front. The structures presented here in Sc and Cj seem quite similar to the previous structure of the same complex in Ct, though the latter was only solved with cryoEM, and was also lacking the structure of the CC domain in Las1.

      We thank the reviewer for pointing out this issue. We have re-wrote these sentences and changed the butterfly description of Las1-Grc3 complex in the revised manuscript.

      For the model suggested in Figure 8, perhaps in the 'weak activity' state, the LCT in Las1 could still be connected to Grc3, via the LCT, rather than disconnected as shown. This could facilitate faster assembly of the 'high activity' state. The complex is described as 'compact and stable', but from the structure and this image, it appears more dynamic, which would serve its purpose and the illustrated model better. The two copies of HEPN appear to have more connective area, meaning they are indeed more likely to remain assembled in the 'weak activity' state. On the other hand, HEPN in one protein appears to have less binding surface with PNK in Grc3, and even less so with the CTD (both PNK and CTD being from the other associated protein), meaning these bindings could release easily to form the 'weak activity' state.

      There is also the potential to speculate that the GCT is bound to HEPN near the catalytic area in the 'weak activity' state. The reduced activity when the GCT residues are replaced by Alanine could then be explained by the complex not being able to assemble as quickly upon binding of the substrate, as it could if the GCT remained bound, rather than by a conformational change that it induces upon binding. The conformational change is also likely to be influenced by the combined binding of PNK and CTD in the assembled state, which also contact HEPN, rather than by GCT alone.

      We thank the reviewer for this suggestion. We have revised our model in the new Figure 8 of our revised manuscript. We apologize for the un-clarity description of the 'weak activity' state in our model. In fact, we believe that Las1 is in a "weakly activity" state before binding to Grc3 and is in a "highly activity" state when it forms a complex with Grc3. We strongly agree that the Las1-Grc3 complex is more dynamic than compact and stable, so it is easy to change its active state. We have changed our description and revised our model in the revised manuscript.

      When comparing the structure of the HEPN domain in the lone Las1 protein to the structure of Las1-HEPN in the Las1-Grc3 complex, it is mentioned that 'large conformational changes are observed'. These could be described a bit better. The conformational change is ~3-4Å C-alpha RMSD across all ~150 residues in the domain (~90 residues forming a stable core that only changes by ~1Å). There is also a shift in the associated HEPN domain in Las1B domain compared to the bound HEPN in the Las1-Grc3 complex, as shown in Figure 7D: ~1Å shift and ~12degrees rotation. This does point to the conformation of HEPN changing upon complex formation, as does the relative positions of the HEPN domains in Las1A and Las1B. The conformational change and relative shift could indeed by key for the catalysis of the substrate as mentioned.

      We thank the reviewer for this great suggestion. We have replaced the sentence describing the conformational changes in our revised manuscript.

      Overall, the structures presented should be very useful in further study of this system, even though the exact dynamics and how the substrate is bound are aspects that are perhaps not fully clear yet. The addition of the structures of the CC domain in two different organisms and the Las1 HEPN domain (not in complex with Grc3) as new structural information should allow for increasing our understanding of the overall complex and its mechanism.

      We thank this reviewer for these encouraging comments, which helped us with greatly improving our manuscript.

      Reviewer #2 (Public Review):

      In this manuscript, Chen et al. determined the structural basis for pre-RNA processing by Las1-Grc3 endoribonuclease and polynucleotide kinase complexes from S. cerevisiae (Sc) and C. jadinii (Cj). Using a robust set of biochemical assays, the authors identify that the sc- and CjLas1-Grc3 complexes can cleave the ITS2 sequence in two specific locations, including a novel C2' location. The authors then determined X-ray crystallography and cryo-EM structures of the ScLas1-Grc3 and CjLas1-Grc3 complexes, providing structural insight that is complimentary to previously reported Las1-Grc3 structures from C. thermophilum (Pillon et al., 2019, NSMB). The authors further explore the importance of multiple Las1 and Grc3 domains and interaction interfaces for RNA binding, RNA cleavage activity, and Las1-Grc3 complex formation. Finally, evidence is presented that suggests Las1 undergoes a conformational change upon Grc3 binding that stabilizes the Las1 HEPN active site, providing a possible rationale for the stimulation of Las1 cleavage by Grc3.

      Several of the conclusions in this manuscript are supported by the data provided, particularly the identification and validation of the second cleavage site in the ITS2. However, several aspects of the structural analysis and complimentary biochemical assays would need to be addressed to fully support the conclusions drawn by the authors.

      We thank the reviewer for the positive comments.

      • There is a lack of clarity regarding the number of replicates performed for the biochemical experiments throughout the manuscript. This information is critical for establishing the rigor of these biochemical experiments.

      We apologize for not providing the detailed information on the number of replicates of biochemical experiments. All the biochemical experiments were repeated three times. We have provided this information in the figure legends.

      • The authors conclude that Rat1-Rai1 can degrade the phosphorylated P1 and P2 products of ITS2 (lines 160-162, Figure 1H). However, the data in Fig. 1H shows complete degradation of 5'Phos-P2 and 5'Phos-P4 of ITS2, while the P1 and 5'Phos-P3 fragments remain in-tact. Additional clarification for this discrepancy should be provided.

      We thank the reviewer for pointing out this issue. “phosphorylated P1 and P2 products” should be “phosphorylated P2 and P4 products”. We have corrected this clerical error. In addition, we have also provided an explanation for why phosphorylated P3 product show only partial degradation. We suspect that P3 product may be too short to completely degrade.

      • The authors determined X-ray crystal structures of the ScLas1-Grc3 (PDB:7Y18) and CjLas1-Grc3 (PDB:7Y17) complexes, which represents the bulk of the manuscript. However, there are major concerns with the structural models for ScLas1-Grc3 (PDB:7Y18) and CjLas1-Grc3 (PDB:7Y17). These structures have extremely high clashscores (>100) as well as a significant number of RSRZ outliers, sidechain rotamer outliers, bond angle outliers, and bond length outliers. Moreover, both structures have extensive regions that have been modeled without corresponding electron density, and other regions where the model clearly does not fit the experimental density. These concerns make it difficult to determine whether the structural data fully support several of the conclusions in the manuscript. A more careful and thorough reevaluation of the models is important for providing confidence in these structural conclusions.

      We thank the reviewer for pointing out this issue. We have used the cryo-EM datasets to further validate our conclusions of the manuscript. We analyzed the active site of Las1-Grc3 complex and the interactions between Las1 and Grc3 using the cyro-EM structures and presented new figures (Figure 5- Figure supplement 1, Figure 5- Figure supplement 2, Figure 5- Figure supplement 3, Figure 6- Figure supplement 1) in our revised manuscript. Both the refinement and validation statistical parameters of the cryo-EM datasets are within a reasonable range (Table 2), which will provide confidence for our structure conclusions. The X-ray crystal structures of ScLas1-Grc3 (PDB:7Y18) and CjLas1-Grc3 (PDB:7Y17) complexes has high calshscores and many outliers, which is mainly due to the great flexibility of Las1-Grc3 complex, especially the CC domain of Las1. We have improved our crystal structure models with better refinement and validation of statistical parameters. The clashscores of ScLas1-Grc3 complex and CjLas1-Grc3 complex are 25 and 45, respectively. There are no rotamer outliers and C-beta outliers to report for both ScLas1-Grc3 complex and CjLas1-Grc3 complex.

      • The presentation of the cryo-EM datasets is underdeveloped in the results section drawing and the contribution of these structures towards supporting the main conclusions of the manuscript are unclear. An in-depth comparison of the structures generated from X-ray crystallography and cryo-EM would have greatly strengthened the structural conclusions made for the ScLas1-Grc3 and CjLas1-Grc3 complexes.

      We thank the reviewer for this suggestion. We have performed structural comparisons between X-ray crystal structure and cyro-EM structure in analyzing the active site of Las1-Grc3 complex and the interactions between Las1 and Grc3 (Figure 5- Figure supplement 1, Figure 5- Figure supplement 2, Figure 6- Figure supplement 1). We have also added a figure (Figure 5- Figure supplement 3) to show cryo-EM and crystal densities of the Las1 active site as well as the key amino acids for Las1 and Grc3 interactions. These comparisons and densities have greatly strengthened our structural conclusions.

      • The authors conclude that truncation of the CC-domain contributes to Las1 IRS2 binding and cleavage (lines 220-222, Fig. 4C). However, these assays show that internal deletion of the CC-domain alone has minimal effect on cleavage (Fig 4C, sample 3). The loss in ITS2 cleavage activity is only seen when truncating the LCT and LCT+CC-domain (Fig 4C, sample 2 and 4, respectively). Consistently, the authors later show that Las1 is unable to interact with Grc3 when the LCT domain is deleted (Fig. 6 and Fig. 6-figure supplement 2). These data indicate the LCT plays a critical role in Las1-Grc3 complex formation and subsequent Las1 cleavage activity. However, it is unclear how this data supports the stated conclusion that the CC-domain is important for LasI cleavage.

      Our EMSA data shows that the CC domain contributes to the binding of ITS2 RNA (Figure 4D), suggesting that the CC domain may play a role of ITS2 RNA stabilization in the Las1 cutting reaction. The in vitro RNA cleavage assays (Figure 4C) indicate that the LCT is important for Las1 cleavage because it plays a critical role in the formation of the Las1-Grc3 complex. Compared with LCT, the CC domain, although not particularly important for Las1 cutting ITS2, still has some influence (Fig 4C, sample 1 and 3, sample 2 and 4,). Therefore, we conclude that the CC domain may mainly play a role in the stabilization of ITS2 RNA, thereby enhancing ITS2 RNA cleavage.

      • The authors conclude that the HEPN domains undergo a conformational change upon Grc3 binding, which is important for stabilization of the Las1 active site and Grc3-mediated activation of Las1. This conclusion is based on structural comparison of the HEPN domains from the CjLas1-Grc3 complex (PDB:7Y17) and the structure of the isolated HEPN domain dimer (PDB:7Y16). However, it is also possible that the conformational changes observed in the HEPN domain are due to truncation of the Las1 CC and CGT domains. A rationale for excluding this possibility would have strengthened this section of the manuscript.

      We thank the reviewer for pointing out this issue. We agree that the complete Las1 structure information is helpful in illuminating the conformational activation of the Las1 by Grc3. We screened about 1200 crystallization conditions with full-length Las1 proteins, but ultimately did not obtain any crystals, probably due to flexibility. The CC domain exhibits a certain degree of flexibility, which has not been observed in the structure obtained from electron microscopy. The LCT is involved in binding to the CTD domain of Grc3. The coordination of the active center of HEPN domains by LCT and CC domains is unlikely due to the limited nuclease activity observed in full-length Las1. The conformational changes of the active center are essential for HEPN nuclease activation. Our structure shows that the GCTs of Grc3 interact with the active residues of Las1 HEPN domains, which probably induce conformational changes in the active center of the HEPN domain to activate Las1. Of course, we cannot exclude the possibility that truncation of the Las1 CC and LCT domains will result in little conformational change in the HEPN domains. We have explained this possibility in our revised manuscript.

      Reviewer #1 (Recommendations For The Authors):

      1) It would be very useful to show the cryoEM densities when describing the catalytic site and C-terminal domain interactions.

      The new Figure 5-figure supplement 2 have showed the Cyro-EM densities of the catalytic site of ScLas1 and the C-terminal domain of ScGrc3.

      2) "ScLas1 cleaves the 33-nt ITS2 at C2 site to theoretically generate a 10-nt 5′-terminal product and a 23-nt 3′-terminal product (Figure 1A). Our merger data shows that the final 5′-terminal and 3′-terminal product bands are at nearly the same horizontal position on the gel (Figure 1B), indicating that they are similar in size." These two sentences seem to contradict, i.e. 10-nt and 23-nt are similar in size even though they are different lengths?

      We apologize for the contradiction in these two sentences mentioned above. We have re-wrote these two sentences in the revised manuscript.

      3) We observed four cleavage bands of approximately 23-nt (P2), 14-nt (P3), 10-nt (P1), and 9-nt (P4) in length (Figure 1C). "

      Figure 1C. The bands show 23 nt, 22 nt, 21nt, 14 nt, 13nt, and 11nt, so this text does not seem to describe the figure.

      We have re-wrote this sentence in the revised manuscript.

      4) "We obtained similar cleavage results with a longer 81-nt ITS2 RNA substrate 6 (Figure 1D, E). " Figure 1D,E. The lengths in Figure 1E do not correspond to all bands in Figure 1E, e.g. the 13 nt band, though the others do, e.g. 14 nt, 30nt, 37nt, etc.

      In order to better evaluate the size of the cut product, we used an RNA marker as a comparison. The RNA marker will have more bands than the cleavage products. To further confirm the cleavage site of C2′, we also mapped the cleavage sites of the 81-nt ITS2 using reverse transcription coupling sequencing methods (Figure 1F).

      5) In Figure 3, domains are colored different but it's hard to know which are different proteins.

      We have added a diagram in Figure 3 to show the Las1-Grc3 complex structure, and it is now clear how Las1 and Grc3 are assembled into a tetramer.

      6) Line 267. "we screened a lot of crystallization conditions with full-length Las1 proteins" How many? Rough numbers ok, but 'a lot' is not very informative

      We have provided the approximate numbers of crystallization conditions in our revised manuscript.

      Reviewer #2 (Recommendations For The Authors):

      1) The authors missed an excellent opportunity to compare and contrast the ScLas1-Grc3 and CjLas1-Grc3 complex structures presented here with that of the previously determined CtLas1-Grc3 structure (Pillon et al., 2019, NSMB). For example, His130 in the ScLas1-Grc3 complex active site adopts a similar conformation to His142 in the TcLas1-Grc3 complex active site (Pillon et al., 2019, NSMB). Interestingly, the analogous His134 active site residue in the CjLas1-Grc3 adopts an alternative (maybe inactive) conformation. This observation could provide a structural rationale for the activation of scLas1 and TcLas1 by Grc3, while also providing a rationale for the fairly weak activation of CjGrc3 by CjGrc3.

      We thank the reviewer for this suggestion. We have performed structural comparisons between ScLas1-Grc3, CjLas1-Grc3 and CtLas1-Grc3 complexes, especially the Las1 nuclease active center. We added two figures (Figure7-figure supplement 3A and 3B) in the revised manuscript to contrast and highlight the conformational differences of active amino acids in active centers between ScLas1-Grc3, CtLas1-Grc3 and CjLas1-Grc3. These structural comparisons provide stronger evidence that further reinforces the conclusions of our manuscript.

      2) Can the authors speculate as to whether the structural data can provide any insight into how the Las1-Grc3 may cleave both C2 and C2' positions in the ITS2 RNA? This commentary would further strengthen the discussion section of the manuscript.

      We thank the reviewer for this suggestion. We have provided a speculation in the discussion section of the revised manuscript.

      We think that the structural data may provide some insight into how Las1-Grc3 complex cleaves ITS2 RNA at both C2 and C2' positions. The Las1-Grc3 tetramer complex has one nuclease active center and two kinase active centers. The nuclease active center consists of two Las1 molecules in a symmetric manner, while the kinase active center consists of only one Grc3 molecule. The ITS2 RNA is predicted to form a stem-loop structure. The symmetrical nuclease active center recognizes the stem region of ITS2 RNA and makes it easy to perform C2 and C2' cleavages on both sides of the stem. C2 and C2' cleavage products are further phosphorylated by two Grc3 kinase active centers, respectively.

      3) The method used for the plasmid generation, expression, and purification of the Las1 truncations and the Las1 and Grc3 point mutants should be provided in the methods section.

      The method used for the plasmid generation, expression, and purification of the Las1 truncations and the Las1 and Grc3 point mutants have be provided in the methods section.

      4) The exact amino acid cutoffs for the truncated forms of Las1 used for the biochemical assays in Fig. 4 should be provided.

      We have provided the exact amino acid cutoffs for the truncated forms of Las1 in the figure legend of Figure 4C.

      5) The models associated with the cryo-EM datasets should be deposited in the PDB.

      The models associated with the Cryo-EM datasets have be deposited in the PDB with the following accession codes: 8J5Y (ScLas1-Grc3 complex), and 8J60 (CjLas1-Grc3 complex).

      6) Lines 232-234: Arg129 should be changed to His134.

      We have corrected it.

      7) Figure 5B: the bottom half of the HEPN active site has been labeled incorrectly. The labels should be Arg129, His130, and His134 (from left to right).

      We have corrected it.

      8) Line 252: "multitudinous" should be changed to "multiple."

      We have corrected it.

    1. Author Response

      We are grateful to the reviewers for their thorough and thoughtful critiques, including their agreement on the significant value of this dataset. We intend to respond to their comments in full with a revision in the near future. However, we would like to make an initial comment at this stage. A key concern raised by the reviewers was that the analyses described do not adequately support the claim that "movie-watching data can identify retinotopic regions" (quoted from R2, similar sentiment expressed by R1). To be clear, we agree with this assessment. Our primary aim was not to identify visual areas with movie-watching data. Rather, our focus was on how movies can reveal fine-grained organization in infant visual cortex, which would support their potential utility for understanding the development of dynamic visual processing. To demonstrate this potential, we tested and found that maps of visual activity generated from movies are significantly similar to those generated by a retinotopy task. Nevertheless, we did not intend to argue that movie-based maps are sufficiently accurate to replace task-based retinotopic maps when defining visual areas, nor did we test this possibility. We accept that this point was unclear in the original manuscript and will make edits to avoid this miscommunication. We also plan to incorporate the reviewers’ many other helpful recommendations, including addressing concerns about the clarity of the presentation and double dipping, as well as adding several new analyses we hope will provide greater confidence in the findings and interpretation.

    1. Author Response

      The following is the authors’ response to the original reviews.

      We would like the reviewers for their positive and useful comments. Below please find our answers to the issues raised.

      Reviewer #1 (Public Review):

      Overall, the experiments are well-designed and the results of the study are exciting. We have one major concern, as well as a few minor comments that are detailed in the following.

      Major:

      1) The authors suggest that "Visuomotor experience induces functional and structural plasticity of chandelier cells". One puzzling thing here, however, is that mice constantly experience visuomotor coupling throughout life which is not different from experience in the virtual tunnel. Why do the authors think that the coupled experience in the VR induces stronger experience-dependent changes than the coupled experience in the home cage? Could this be a time-dependent effect (e.g. arousal levels could systematically decrease with the number of head-fixed VR sessions)? The control experiment here would be to have a group of mice that experience similar visual flow without coupling between movement and visual flow feedback.

      Either change would be experience-dependent of course, but having the "visuomotor experience dependent" in the title might be a bit strong given the lack of control for that. We would suggest changing the pitch of the manuscript to one of the conclusions the authors can make cleanly (e.g. Figure 4).

      Although the plasticity is induced by the visuomotor experience in the tunnel, we agree that we do not know what aspect of the repeated exposure to the virtual tunnel caused the plasticity. We cannot rule out that it was the exposure to the visual stimuli alone that caused it. Therefore, we rephrased sentences that suggested that it was the coupling between visual stimuli and motor behavior that was responsible for the plasticity. We also changed the title to “Experience Shapes Chandelier Cell Function and Structure in the Visual Cortex”.

      We do believe that training the mice in the virtual tunnel does significantly increase experience with coupled visuomotor activity, though. In their home cage, mice are mostly active in the dark and there is litle space to run.

      Minor:

      2). "ChCs shape the communication hierarchy of cortical networks providing visual and contextual information." We are not sure what this means.

      We thank the reviewer for helping to raise clarity and we rephrased this sentence to: “…ChCs may establish a hierarchical relationship among cortical networks.”

      3) "respond to locomotion and visuomotor mismatch, indicating arousal-related activity" This is not clear. We think we understand what the authors mean but would suggest rephrasing.

      Agreed. We rephrased this sentence to: "...respond to events that are known to increase arousal levels, such as locomotion and visuomotor mismatch.”

      4) 'based on morphological properties revealed that 87% (287/329) of labeled neurons were ChCs" Please specify the morphological properties used for the classification somewhere in the methods.

      We added that the neurons were positioned at the border of L1 and L2 and had a dendrite reaching into layer 1.

      5) We may have missed this - in the patch clamp experiment (Fig.1 H-K), please add information about how many mice/slices these experiments were performed in.

      We have added the information to the legend of Fig. 1.

      6) "These findings suggest that the rabies-labeled L1-4 neurons providing monosynaptic input to ChCs are predominantly inhibitory neurons". We are not sure this conclusion is warranted given the sparse set of neurons labelled and the low number of cells recorded in the paired patch experiment. We would suggest properly testing (e.g. stain for GABA on the rabies data) or rephrasing.

      We weakened the statement to: “These findings suggest that the rabies-labeled L1-4 neurons providing monosynaptic input to ChCs may include many inhibitory neurons.”

      7) Figure 2E. A direct comparison of dF/F across different cell types can be subject to a problematic interpretation. The transfer function from spikes to calcium can be different from cell type to cell type. Additionally, the two cell populations have been marked with different constructs (despite the fact that it's the same GECI) further reducing the reliability of dF/F comparisons. We would recommend using a different representation here that does not rely on a direct comparison of dF/F responses (e.g. like the "response strength" used in Figure 3B). Assuming calcium dynamics are different in ChCs and PyCs - this similarity in calcium response is likely a coincidence.

      We have removed the quantification in this figure.

      8) If ChCs are more strongly driven by locomotion and arousal, then it's a bit counterintuitive that at the beginning of the visual corridor when locomotion speed consistently increases, the activity of ChCs consistently decreases. This does not appear to be driven by suppression by visual stimuli as it is present also in the first and last 20cm of the tunnel where there are no visual stimuli. How do the authors explain this?

      We do believe that this is suppression driven by visual stimuli. Although on average the strongest visual suppression happens between 20-80 cm, neurons that have their receptive fields toward the center of the visual field will already respond to the stimuli before the mouse reaches the 20 cm location of the tunnel. In addition, although the visual stimuli are the strongest sensory inputs, the background of the visual part of the tunnel has a black and white noise patern, which might already mildly suppress ChC activity. Both arguments are supported by the observation that the visual PyCs (V-PyCs, blue line) in Fig. 4D are already activated at the beginning of the tunnel and that the activity of V-PyCs matches well with the suppression of ChC activity.

      9) The authors mention that "ChC responses underwent sensory-evoked plasticity during the repeated visual exposure, even though the visual stimuli were different from those encountered during training in the virtual tunnel". How would this work? And would this mean all visual responses are reduced? What is special about the visual experience in the virtual tunnel? It does not inherently differ from visual experience in the home cage, given that the test stimuli (full field gratings) are different from both.

      As mentioned in our answer to point 1, the exposure to visual stimuli is strongly increased since, firstly, they are presented during the dark phase when the mice are most active and, secondly, they do not get these types of visual inputs in their home cage.

      10) Just as a point to consider for future experiments: For the open-loop control experiments, the visual flow is constant (20cm/s) - ideally, this would be a replay of the running speed the mouse previously generated to match statistics.

      We agree with this point and will implement replay of earlier sessions in future experiments.

      11) We would recommend specifying the parameters used for neuropil correction in the methods section.

      This is described on page 24, under “preprocessing”. We also refer to the analysis package (Spectral Segmentation - SpecSeg) in which the neuropil correction as used by us here is explained in more detail.

      12) If we understand correctly, the F0 used for the dF/F calculation is different from that used for division. Why is this?

      We apologize for this mistake, which was based on an older version of the software. We have now corrected this in the revised manuscript.

      13) Authors compare neuronal responses using "baseline-corrected average". Please specify the parameters of the baseline correction (i.e. what is used as baseline here).

      In the revised version we have now beter explained this in the methods, page 24, under “Passive Sessions”.

      Reviewer #2 (Public Review):

      Summary:

      Seignete et al. investigated the potential roles of axo-axonic (chandelier) cells (ChCs) in a sensory system, namely visual processing. As introduced by the authors, the axo-axonic cell type has remained (and still is) somehow mysterious in its function. Seignete and colleagues leveraged the development of a transgenic mouse line selective for ChC, and applied a very wide range of techniques: transsynaptic rabies tracing, optogenetic input activation, in vitro electrophysiology, 2-photon recording in vivo, behavior and chemogenetic manipulations, to precisely determine the contribution of ChCs to the primary visual cortex network.

      The main findings are 1) the identification of synaptic inputs to ChC, with a majority of local, deep layer principal neurons (PN), 2) the demonstration that ChC is strongly and synchronously activated by visual stimuli with low specificity in naive animals, 3) the recruitment of ChC by arousal/visuomotor mismatch, 4) the induction of functional and structural plasticity at the ChC-PN module, and, 5) the weak disinhibition of PNs induced by ChCs silencing. All these findings are strongly supported by experimental data and thoroughly compared to available evidence.

      Strengths:

      This article reports an impressive range of very demanding experiments, which were well executed and analyzed, and are presented in a very clear and balanced manner. Moreover, the manuscript is well- writen throughout, making it appealing to future readers. It has also been a pleasure to review this article.

      In sum, this is an impressive study and an excellent manuscript, that presents no major flaws.

      Notably, this study is one of the first studies to report on the activities and potential roles of axo-axonic cells in an active, integrated brain process, beyond locomotion as reported and published in V1. This type of research was much awaited in the fields of interneuron and vision research.

      Weaknesses:

      There are no fundamental weaknesses; the later mainly concern the presentation of the main results. The main weakness may be that the different sections appear somehow disconnected conceptually.

      Additionally, some parts deserve a more in-depth clarification/simplification of concepts and analytic methods for scientists outside the subfield of V1 research. Indeed, this paper will be of key interest to researchers of various backgrounds.

      Reviewer #3 (Public Review):

      Summary:

      The authors set out to characterize the anatomical connectivity profile and the functional responses of chandelier cells (ChCs) in the mouse primary visual cortex. Using retrograde rabies tracing, optogenetics, and in vitro electrophysiology, they found that the primary source of input to ChCs are local layer 5 pyramidal cells, as well as long-range thalamic and cortical connections. ChCs provided input to local layer 2/3 pyramidal neurons, but did not receive reciprocal connections.

      With two-photon calcium imaging recordings during passive viewing of drifting gratings, the authors showed that ChCs exhibit weakly selective visual responses, high correlations within their own population, and strong responses during periods of arousal (assessed by locomotion and pupil size). These results were replicated and extended in experiments with natural images and prediction of receptive field structure using a convolutional neural network.

      Furthermore, the authors employed a learned visuomotor task in a virtual corridor to show that ChCs exhibit strong responses to mismatches between visual flow and locomotion, locomotion-related activation (similar to what was shown above), and visually-evoked suppression. They also showed the existence of two clusters of pyramidal neurons with functionally different responses - a cluster with "classically visual" responses and a cluster with locomotion- and mismatch-driven responses (the later more correlated with ChCs). Comparing naive and trained mice, the authors found that visual responses of ChCs are suppressed following task learning, accompanied by a shortening of the axon initial segment (AIS) of pyramidal cells and an increase in the proportion of AIS contacted by ChCs. However, additional controls would be required to identify which component(s) of the experimental paradigm led to the functional and anatomical changes observed.

      Finally, using a chemogenetic inactivation of ChCs, the authors propose weak connectivity to pyramidal cells (due to small effects in pyramidal cell activity). However, these results are not unequivocally supported, as the baseline activity of ChCs before inactivation is considerably lower, suggesting a potentially confounding homeostatic plasticity mechanism might already be operating.

      Strengths:

      The authors bring a comprehensive, state-of-the-art methodology to bear, including rabies tracing, in vivo two-photon calcium imaging, in vitro electrophysiology, optogenetics and chemogenetics, and deep neural networks. Their analyses and statistical tests are sound and for the most part, support their claims. Their results are in line with previous findings and extend them to the primary visual cortex.

      Weaknesses:

      • Some of the results (e.g. arousal-related responses) are not entirely surprising given that similar results exist in other cortical areas.

      We agree that previous studies have shown arousal-related responses of ChC cells and our study confirms those findings. However, this is not the main message of the article and we present many findings that are novel.

      • Control analyses regarding locomotion paterns before and atier learning the task (Figure 5), and additional control experiments to identify whether functional and anatomical changes following task learning were due to learning, repeated visual exposure, exposure to reward, or visuomotor experience would strengthen the claims made.

      In figure 5 we excluded running trials, so locomotion paterns are unlikely to play a major role. We agree that testing what are the factors that contribute to the observed plasticity are important to investigate in future experiments.

      • The strength of the results of the chemogenetics experiment is impacted by the lower baseline activity of ChCs that express the KORD receptor. At present, it is not possible to exclude the presence of homeostatic plasticity in the network before the inactivation takes place.

      Although we do not know why there is a difference in the baseline df/f (e.g. expression levels), we consider it unlikely that expression of the KORD receptor itself without exposure to the ligand causes reduction of ChC activity. Moreover, we are not sure how homeostatic plasticity in the network would occur selectively in KORD-expressing ChCs. Finally, we do not find evidence for a relationship between lower ChC calcium signals and the effects of ChC silencing on PyC activity. We performed an additional analysis in which we correlated baseline ChC activity (before salvinorin B injection) with the effect of ChC silencing on PyC activity (post – pre) across mice, and found that this correlation was not significant (R = 0.41, p = 0.18).

      Reviewer #1 (Recommendations For The Authors):

      In the spirit of openness of the scientific discussion, all our feedback and recommendations to the authors are included in the public reviews.

      Reviewer #2 (Recommendations For The Authors):

      Most of my comments and suggestions concern the presentation of the data, to (hopefully) help and convey as clearly as possible the messages of this important article.

      Main

      The main weakness of the paper may be that the different sections appear somehow disconnected conceptually. This is particularly true for:

      -structural plasticity: how can we link this finding with the rest of the study? Are there ways to correlate this finding with physiological recordings in individual animals, or to directly test whether particular functional types of PNs (visual, non-visual) undergo plasticity at their AIS?

      This is a very interesting question that may be addressed in future experiments.

      -the indirect finding suggesting that ChC weakly inhibits PNs using chemogenetic silencing of PNs. Do chemogenetic manipulations of ChCs affect PN responses in visual paradigm and/or modify the induction of structural plasticity at the ChC-AIS connection?

      This is also a very interesting question for future work.

      Additionally, some parts would deserve a more in-depth clarification/simplification of concepts and analytic methods (OSI, DSI, MEI...) for scientists outside the subfield of V1 research. Indeed, this paper will be of key interest to researchers of various backgrounds.

      In the revised manuscript we briefly explain what an MEI is when first introduced, and introduce the abbreviations OSI and DSI at the correct location. We believe orientation and direction selectivity are well-known concepts for the audience reading this article.

      Minor

      These are discussed by order of appearance in the text.

      Abstract

      The alternative interpretation of error/mismatch negativity to explain ChC activation deserves to appear in the abstract. Arousal consistency in prediction should be in the introduction. "In mice running in a virtual tunnel, ChCs respond strongly to locomotion and halting visual flow, suggesting arousal-related activity."

      This comment holds for the end of the introduction and the beginning of the discussion, as well.

      "These findings suggest that ChCs provide an arousal-related signal to layer 2/3 pyramidal cells that may modulate their activity". This statement appears to be in contradiction with the weak effect mentioned just before. This comment holds for the end of the introduction.

      The full sentence was: “These findings suggest that ChCs provide an arousal-related signal to layer 2/3 pyramidal cells that may modulate their activity and/or gate plasticity of L2/3 PyCs in V1.” Our results show that activity of layer 2/3 pyramidal cells is modulated (albeit weakly) and it is well possible that ChCs regulate plasticity at the AIS. Therefore, we do not believe that this statement contradicts the weak direct effect of ChCs on layer 2/3 pyramidal cell activity. Therefore , we think that this statement does not contradict the weak direct effect of ChCs on layer 2/3 pyramidal cell activity.

      We changed the last sentence of the introduction to “Our findings suggest that ChCs predominantly respond to arousal related to locomotion or unexpected events/stimuli, and act to weakly modulate activity and/or gate plasticity of L2/3 PyCs in V1.”

      Introduction First paragraph

      Coming from a field outside of vision research, it is not obvious to me what has been learned from interneuron classes in the past. An example would be welcome in the introduction.

      The literature on the role of different interneuron types in visual processing and plasticity is too large to pick one or two examples. For the sake of conciseness, we have therefore provided some important references and reviews for the interested readers (references 1 to 10).

      Interneuron "subtypes" seem to refer to main classes (e.g. PV+): please rephrase accordingly (ChC being a type and PV+ ChC a subtype).

      We changed interneuron “subtypes” to “types” and left L2/3 pyramidal cell “subtypes” unchanged.

      Second paragraph

      Beyond the reversal potential of GABA-ARs at the axon initial segment, GABA may inhibit action potential generation in various conditions (Lipkin et al. 2023, DOI: 10.1523/JNEUROSCI.0605-23.2023 : should be cited).

      We added this citation.

      Fourth paragraph

      "ChCs alter the number of synapses at the AIS based on the activity of their postsynaptic targets": the concept of alteration is too vague to let the reader grasp the concept: could the authors rephrase?

      We have rephrased the sentence to:

      “…ChCs increase the number of synapses at the AIS if their postsynaptic targets are chemogenetically activated…”

      Results 1) ChCs receive input from long-range sources and L5 PyCs in V1 It is not clear how morphological identification of ChC was performed. Did dendrites and/or axons of starter cells occasionally overlap as can be expected, complicating the cell-by-cell morphological classification?

      "Most labeled neurons were located on the border between L1 and L2/3 and displayed typical ChC morphology": maybe clarify that this concerns neurons expressing eYFP-TVA?

      We assessed the location (at the border of L1 and L2) and spatial distribution of the labeled cells and whether they had a dendrite extending upwards towards into L1. We have now indicated this in the results section and clarified that these neurons express eYFP-TVA.

      -Likewise the following would benefit from clarification " This is further supported by the distributed localization of the labeled neurons": it would also help here to remind the reader of the labelling (presumably retrogradely-labeled mCherrry+ neurons).

      We have now clarified in the text that these are mCherry+ neurons labeled by the rabies virus

      2) Chandelier cells are modulated by arousal and show high correlations

      -The authors indicate that the results "(suggest) that ChCs distribute a synchronized signal during high arousal." : it would be stronger to defend this claim by showing a higher ChC-ChC correlation during "arousal" vs. baseline (i.e. analyze high arousal epochs outside of movement). It may be difficult to perform this analysis due to low fluorescence changes outside running episodes, but this should be discussed accordingly. In this respect, the title of the section is more in line with the data presented.

      We believe our statement is correct. The activity of ChCs is highly synchronized and their firing rates increase during arousal. We do not state that synchronization increases with arousal.

      -A brief explanation of DSI and OSI meaning would be nice for the audience that will definitely extend beyond vision research given the importance of this study.

      See above

      3) ChCs are weakly selective to visual information

      -I may very well miss the point, but the equivalence in response strength among cell classes (Fig3B) seems inconsistent with the wider distribution of high response strength in ChCs (Fig3C). Perhaps a graphical representation taking into account the distribution of single data points in Fig3B would help resolve this discrepancy.

      This is because in panel C the response strengths are normalized. We now also state this in the legend to avoid confusion.

      -"clearly oriented edge-like paterns with sharp ON and OFF regions": it would help if a representative example was highlighted in Figure 3F.

      The majority of L2/3 pyramidal MEIs presented in this panel show this patern.

      -It is interesting and surprising that properties of ChCs appear more distinct from those of L5 PNs than from those of L2-3 PNs (Fig 3G-J), given the fact that V1 ChCs were found by the authors to derive their inputs from V1 L5 PNs (please see comments of the discussion for this specific point).

      How ChCs respond based on L5 input depends strongly on how the connections between L5 and ChCs are organized. Similarity between responses of L5 and ChC neurons is not required.

      4) Locomotion and visuomotor mismatch drive chandelier cell activity in a virtual tunnel This is the least convincing part in terms of presentation.

      -It is unclear where/when visuomotor mismatch has been induced in the tunnel: please clarify in the text and in Fig 4B.

      We realized that the title of the paragraphs was indeed confusing. In fig. 4A-D and the first paragraph about the virtual tunnel, we do not discuss the visuomotor mismatch. This comes later, when we describe the results in Fig. 4E. The titles have been changed.

      -No result on visuomotor mismatch is reported in the text of this section, while this is presented in the subsequent section: this needs to be corrected (merge this section with the next?).

      We agree, apologies for the confusion. See above.

      -It would be interesting to further analyze responses to CS and US. Regarding the US: is water rewarding in non-water-restricted mice? This should be mentioned.

      We realized that we did not mention that the mice were water restricted during behavioral training and during the imaging sessions when mice performed the virtual tunnel task. We have now added this to the methods section. Sorry for the omission.

      -Along this line: was water sometimes omited? This would provide a complementary way to test the prediction error theory for ChC activation with an alternative modality.

      We never omited the water reward. It would be interesting to test this in a future experiment.

      5) ChCs have similar response properties as non-visual PyCs

      • It would help to explicitly mention that in Ai65 mice, only Cre and Flp+ cells express tdTomato (here Vipr2 and PV+).

      We added the following sentence: “In these mice, tdTomato was only expressed in cells expressing both Vipr2 and PV.”

      6) Visuomotor experience in the virtual tunnel induces plasticity of ChC-AIS connectivity

      • In relation to the previous section, Jung et al. (doi.org/10.1038/s41593-023-01380-x) recently reported that motor learning reduced ChC-ChC synchrony in M2. Did the author observe a similar change in ChC- ChC synchrony with visual experience/habituation to the task? If available, these data should be reported to help build a clearer picture of ChC functions in the neocortex.

      We tested this and also found reduced correlations between ChCs in trained mice vs naïve mice. We added this as text on p14 in the results section.

      • The low number of ChC boutons' appositions per AIS may be misleading: "While the average number of ChC boutons per AIS remained constant (~2-3 ChC boutons/AIS)"). It would be helpful to make it clear that these are "virally" labelled boutons, as opposed to absolute numbers, if compared with the detailed quantification of Schneider-Mizell et al, 2021 (7.4 boutons per AIS in average; doi: 10.7554/eLife.73783.).

      We added "virally labeled"

      • It may be difficult to clearly isolate boutons in light microscopic images of ChC boutons. could the authors comment on this and explain how they solved this issue (in the methods section for instance)?

      We elaborated on our definition of a bouton under confocal microscopy conditions. We also added that the analysis was performed under blinded conditions for the experimenter (i.e. the experimenter did not know whether the images came from trained or untrained mice).

      • Is there any suggestion for heterogeneity/selectivity for a subset of PNs (the distribution does not seem to show this, though)? It would be interesting to discuss this and try to link this finding to the rest of the study a bit more directly. Future work could also investigate if genetically defined PN types undergo different pre-synaptic plasticity at their AISs (e.g. work cited by the authors by O'Toole et al, 2023 doi: 10.1016/j.neuron.2023.08.015 -this reference can be updated as well, since the work has been published in the meantime).

      In our data, we did not find evidence for heterogeneity or selectivity of targeting, also not in the physiology using KORD (see below). We do agree that it is an interesting question and deserves atention in future experiments. We also updated the reference.

      7) ChCs weakly inhibit PyC activity independent of locomotion speed

      The authors state that "recent work in adult mice has reported hyperpolarizing and shunting effects in prelimbic cortex, S1 and hippocampus (18, 26, 27)": however, to my knowledge studies presented in refs 26 & 27 found reduced activity/firing of PNs upon optogenetic activation of ChCs in vivo, but did not perform intracellular recordings to assess GABA-A reversal potential at the AIS. I would like to kindly ask the authors to correct this sentence.

      If the polarity of responses is discussed, they may rather refer to the corresponding literature including Rinetti Vargas et al (doi: 10.1016/j.celrep.2017.06.030), Lipkin et al (doi: 10.1523/JNEUROSCI.0605- 23.2023), and Khirug et al (doi: 10.1523/JNEUROSCI.0908-08.2008.).

      We added the reference to Lipkin et al and changed the sentence so that it matches the references..

      • In an atempt to link findings from several parts of the article, did the authors investigate whether chemogenetic effects were different in visual vs non-visual PNs? As ChCs are functionally related to visual PNs, one might indeed speculate that these cells are synaptically connected.

      We did not find evidence for selectivity in the chemogenetic effect. We compared the chemogenetic effect to locomotion modulation (see text accompanying Fig 7.) – based on our observation that non- visual PyCs were more strongly modulated by locomotion (see Fig. 4) – but did not find any significant correlation.

      • " We first looked at the average activity of neurons in both essions.": sessions

      Thank you for noticing. We corrected this.

      Discussion

      Summary of findings

      -It would be worthwhile to include in the summary the finding of mismatch-related activity, that appears to explain more convincingly ChC activation than arousal per se (with the data available).

      We updated the summary of the discussion accordingly.

      -Moreover, the last part of the article (weak inhibition of PNs by ChCs), despite being very important, is not mentioned.

      We now mention this in the summary of the discussion (“Finally, ChCs only weakly inhibit PyCs.”)

      Discussion of findings

      -" Optogenetic activation of cortical feedback": it is not clear what the authors mean by cortical feedback. As RS was retrogradely labeled, this region may rather provide feedforward inhibition to V1 via ChCs.

      Retrosplenial cortex is a higher order cortical area and only provides feedback to V1.

      -"This means that each ChC receives input from many L5 PyCs, which could explain the low selectivity of ChC responses we observed to natural images compared to those of L2/3 and L5 PyCs". : perhaps state explicitly that the convergence of many PN inputs each carrying different RF/visual properties "averages out" in ChC (as you do a few lines below for MEI).

      At this point, we do not know how the connections from L5 to ChCs are organized. Whether this converge results in “average out” is therefore not so certain. We have made an atempt to clarify the situation. (“This convergence of L5 PyC inputs, if not strongly organized, could explain the low selectivity of ChC responses we observed to natural images compared to those of L2/3 and L5 PyCs.”)

      -"However, we did not identify neuromodulatory inputs to ChCs in our rabies tracing experiment. Possibly, these inputs act predominantly through extrasynaptic receptors and were therefore not labeled by the transsynaptic rabies approach.": here, the authors should cite the work by Lu et al (doi: 10.1038/nn.4624) which found basal forebrain (diagonal band of Broca) cholinergic inputs to ChC of the PFC in the Nkx2.1CreER mouse model. Moreover, the authors should discuss potential technical differences (?) responsible for this discrepancy. Beyond the extrasynaptic release of neuromodulators, rabies strains may display different tropism profiles for neuron classes.

      We have now added a sentence discussing this and added the reference in the revised manuscript.

      -The section dedicated to prediction error is particularly interesting and relevant. In my opinion, this interpretation should be further emphasized in the abstract and summary of findings paragraph in the discussion (as already indicated).

      Yes, we agree and have added some emphasis.

      -" These findings are thus in contrast with the general notion that ChCs exert powerful control over PyC output (28, 78), but consistent with computational simulations predicting a relatively small inhibitory effect of GABAergic innervation of the AIS, possibly involving shunting inhibition (79, 80)." These findings are also consistent with results from PFC and dCA1 studies showing, with electrophysiological recordings combined with optogenetic stimulation of ChCs, that a small proportion of putative PNs was inhibited upon ChC stimulation (doi: 10.1038/nn.4624 doi: 10.1016/j.neuron.2021.09.033).

      Perhaps the effect of ChCs is limited in all these experiments by a suboptimal efficiency of ChC targeting. Moreover, inhibition might be restricted to a subset of PNs carrying a specific function. This could be discussed.

      We added an explanation for the weak effects of silencing to the discussion and stated that our results are in line with findings in PFC and CA1. (“One explanation for the weak effects we observed is the high variability in the number of GABAergic boutons that PyCs receive at their AISs. Possibly, only a smaller fraction of PyCs with high numbers of AIS synapses are inhibited when ChCs are active. Indeed, we find that only a small fraction of PyCs increased their activity upon chemogenetic silencing of ChCs, in line with findings by others showing that manipulating ChC activity in vivo has relatively weak effects on small populations of PyCs (27, 28).”)

      Although we cannot rule out that ChC targeting is suboptimal in our and other experiments, the expression of the KORD receptor as visualized by mCyRFP1 fluorescence appeared very strong. In addition, the common notion in the ChC field is that ChCs exert powerful control over PyC firing. Even suboptimal labeling should in that case show clear inhibitory effects. Similar experiments with PV+ interneurons would show very convincing inhibition, even if labeling is suboptimal. To keep the discussion concise, we prefer to leave this particular point out.

      -" ChC activation could prevent homeostatic AIS shortening of L2/3 PyCs if their activity occurs during behaviorally relevant, arousal inducing events": this postulate seems to be very interesting but is not very clear and lacks some mechanistic speculation.

      We considered elaborating more on this hypothesis. However – given that it is merely a speculation at this point – we do not wish to lengthen the discussion further on this point.

      • A reference to previous studies demonstrating high levels of synchronous ChC activities is missing: the authors may cite Dudok et al., Schneider-Mizell et al., and Jung et al. (and discuss a change in synchrony with learning or habituation in the case of this study; see above).

      We have now also referred to these papers in the context of high correlations between ChCs.

      Methods

      Beyond references to reagents (eg antibodies, viruses), lot numbers should be provided whenever this is possible. Indeed, there might be strong lot-to-lot variations in specificity and efficiency.

      Reviewer #3 (Recommendations For The Authors):

      Major:

      • (Figure 5) Control analysis missing. Mice before and after training in VR will almost definitely exhibit different running paterns when viewing driftng gratings. Since ChCs are strongly modulated by locomotion, assess whether results depend on changes in running.

      Although we did not compare locomotion paterns before and after training, we removed all trials in which the mice were running (see methods). Therefore, we can exclude that these results are caused by changes in running behavior.

      • (Figure 5 & 6) What would happen with simple passive visual experience, not in a visuomotor task? What if there was no reward? What if there was an open-loop experiment with random reward? To which specific aspect of the experiment are the results atributable?

      These are indeed very interesting questions that may be tested in future experiments.

      (Figure 7 B, H) The pre-injection ChC activity in the KORD group is less than 50% of that in control mice! Discuss the effect of such a shift in baseline. Plasticity of PyCs even before ChC inactivation?

      See answer to the above question in the public section of reviewer 3.

      • (Figure 3 H) Contrast tuning results, as far as I understand, come only from the CNN. However, if I understood correctly, during the passive viewing of gratings there were already different contrasts. Why not show contrast tuning there? Do the results disagree?

      We did indeed show stimuli at different contrasts during the passive viewing of gratings. Although the results from those recordings were not optimal for defining contrast sensitivity, they also showed that ChC responses were less modulated by contrast than PyCs.

      Minor: - (Figure 3) Explain the potential impact of different indicators 8m vs 6f due to different baselines and dynamics.

      We believe there is no impact of different indicators, because for the CNN analyses we estimated spikes using CASCADE. This toolbox is specifically designed to generalize across different calcium indicators. Although GCaMP8m was not included in their training set, the wide variety of indicators used provides a solid basis for generalizable spike estimation. Importantly, comparisons between L2/3 PyCs and ChCs also would not be affected by this concern.

      • (Figure 4) NV-PyCs. Would you call all of these mismatch-responsive neurons? Discuss the difference in the percentage of neurons (more than 50% of total PyCs here, compared to significantly less - up to 40% in previous studies, as far as I'm aware)

      Not all NV-PyCs appeared to be mismatch-responsive neurons.

      • (Figure 6 D) No error bars?

      This is a representation of the fraction of all contacted AISs, which has no error bars indeed.

      • (Figure 6 E-F and H-I) These pairs of panels contain essentially the same information. The first panel of each pair seems redundant.

      We prefer to keep both plots in place, as in this case the skewness of the histogram can be helpful, which is less clear in the boxplot (which in itself displays the quantiles beter).

      • The equation for direction tuning still has ang_ori, instead of ang_dir which I'm assuming should be there.

      Thank you for noticing, we corrected it.

      • The response for drifting gratings is calculated from a different interval (0.2-1.2s) compared to natural images (0-0.5s). Why?

      Because we used spike probability in the case of the natural images to shorten the signal, and the visual stimuli were presented for 0.5 s (instead of 1 s as with the gratings).

      Very minor:

      • It would be helpful for equations to have numbers.

      Done

      • Sparsity equation. Beter to have it as a general equation, with N instead of 40. Then below it can be explained that N is the number of images = 40.

      Done

      • "The similarity of these MEIs with those we found for ChCs is in line with the idea that ChCs are driven by input from a large number of L5 PyCs (but do not exclude alternative explanations)." - in parenthesis it should be does not exclude.

      Corrected.

      • "In contrast, the response strength of PyCs was only mildly and non-significantly reduced after training"

      • statistically non-significant..

      Corrected.

      "We first looked at the average activity of neurons in both essions." - sessions

      Corrected.

      • (Figure 7 C) Explain what points and error bars represent

      Done.

    1. Author Response

      Reviewer #2 (Public Review):

      The study from Gumaste et al investigates whether mice can use changes of intermittency, a temporal odor feature, to locate an odor source. First, the study tries to demonstrate that mice can discriminate between low and high intermittency and that their performance is not affected by the odor used or the frequency of odor whiffs. Then, they show that there is a correlation between glomerular responses (OSNs and mitral cells) and intermittency. Finally, they conclude that sniffing frequency impacts the behavioral discrimination of intermittency as well as its neural representation. Overall, the authors seek to demonstrate that intermittency is an odor-plume property that can inform olfactory navigation.

      The paper explored an interesting question, the use of intermittency of an odor plume as a behavioral cue, which is a new and intriguing hypothesis. However, it falls short in demonstrating that the animal is actually sensitive to intermittency but not other flow parameters, and is missing some important details.

      Major concerns

      1) One of the cornerstones of this paper consists in showing that mice are behaviorally able to distinguish among different intermittency values (high or low), across a variety of different stimuli and without confounds such as the number of whiffs or concentration. However, I could not find in the paper a convincing explanation of how these confounds were tested. It is clear that the authors repeat their measurements in different conditions (low or high concentration, and different whiff numbers) but it is not specified how: do the authors mix all stimuli in the same session, and so the animals simply generalize across all the stimuli and only consider intermittency for the behavioral choices? Or do authors repeat different sessions for different parameters? For example: do they perform two separate sessions with low concentration and high concentration? If this last one is the case, I would argue that this is not enough proof that animals generalize across concentrations, as the animals might simply use concentration as a cue and change the decision criteria at each session. Please clarify.

      We appreciate the reviewer pointing out our oversight in including this information in the manuscript. Trials of the two gain values (which modulate the maximum concentration) are presented interleaved within a session. These trials are solely separated for post-session analysis to test the effect of gain on animal performance. To make this point clearer we have included the following text on line 952 of the manuscript:

      “Additionally, trials of a gain of 0.5 and a gain of 1 are interwoven randomly during the session with each unique stimulus being presented at both a gain of 0.5 and 0.1. Thus, after the initial engagement trials, animals are presented with a total of 28 trials at a gain of 0.5 and 28 trials at a gain of 0.1.”

      Additionally, to address one of the reviewer’s overarching points, that the manuscript “falls short in demonstrating that the animal is actually sensitive to intermittency but not other flow parameters,” we would like to highlight that through our olfactometer design (described in the Olfactometer Design subsection of the Methods section and illustrated in Figure 1C) the flow rate is held constant throughout the experiment. To further ensure that the animal is not using flowrate or other experimental conditions to perform the task, we tested all animals on a “no odor” condition in which the vial of odor is replaced with a vial of mineral oil. In this condition, their hit rate significantly lowered, as shown in Figure 2C and described in Lines 240- 245:

      “Animals’ hit rate also significantly decreased when tested on the Go/No-Go task with the odor vial replaced with mineral oil (n=12 mice, two-sample t-test Naturalistic: odor hit rate = 0.87 ±0.01, no odor hit rate= 0.23 ±0.05, p<0.0001; two-sample t-test Binary Naturalistic: odor hit rate= 0.89±0.01, no odor hit rate= 0.18±0.07, p<0.0001; two-sample t-test Synthetic: odor hit rate= 0.86±0.007, no odor hit rate= 0.23±0.07, p<0.0001), confirming that mice are using odor to perform the task.”

      2) It looks to me that the measure of intermittency strongly depends on the set. What is the logic of setting a specific threshold? Do the results hold when this threshold changes within a reasonable range? The same questions (maybe even more important) go for the measure of glomerular intermittence. Unfortunately, a sensitivity analysis for both measures is missing, which makes it hard to interpret the results.

      We assume the reviewer suggests that we could have tested discrimination at various Intermittency thresholds. This is indeed wat we did, though not by varying the threshold parametrically (due to abovementioned time constraints), but rather qualitatively/categorically. We tested our mice on 3 stimulus "types" (Figure 1F): actual continuous plume concentration traces (naturalistic), thresholded traces (binarized by threshold 0.1) and square wave (odor agnostic periodic binary). Further, each was tested at 2 gain levels. Figure 2B demonstrates mice discriminate similarly across these 3 widely differing stimuli, while traces were spanning most of the range of possible intermittencies. Reducing the threshold by 1 or 2 orders would skew the range of trials toward many more CS+ trials. We hence conclude that the mice are robustly discriminating and that the paradigm chosen and its associated constraints provide a reasonable test of "intermittency space".

      We agree nonetheless that future work should address your suggestion directly by implementing an alternate paradigm. For example, in such a paradigm, mice may be trained to discriminate high vs low intermittencies at varying absolute levels (e.g. 1 vs 0.9 and 0.1 vs 0), etc., however that was well outside the scope of what we aimed to test.

      See Figure 1- Supplement 1A. We varied the threshold half a log unit around the 0.1 threshold used in the neuro-behavioral research. As expected, the higher the odor threshold, the more left-shifted the curve. You can see that the monotonic relationship is qualitatively the same across thresholds.

      3) The logic of choosing the decision boundary for the discrimination task is not clear: low intermittency is considered to be below 0.15 and high intermittency is considered to be between 0.2 and 0.8. Do these values correspond to natural intermittency distribution? How were these values chosen?

      Intermittency drops as function of distance from the source (downwind). It also has a close to normal (with kurtosis) distribution across wind, peaking at the center (see e.g. Crimaldi 2002, Connor 2018). So, animals may encounter any and all intermittencies (0-1). Given our Go/No-Go paradigm we had to set a CS-/CS+ boundary. Typically, to generate an adequate psychometric curve using this paradign, either the CS- or CS+ stimuli need to represent a wide range of values of which the animals are required to compare against a narrow range (or single value). Again, bounded by effective behavioral paradigm design, the number of CS+ and CS- trials need to be even in order to appropriately motivate animals to engage in the task. Thus, considering the entire range of intermittency values animals can encounter while navigating through a plume in conjunction with effective behavioral design, we arrived at our chosen values for low and high intermittency.

      As you can see in Figure 1- Supplement 1A (and also reviewer #1, comment 2), I=0.15 is roughly at the knee where the monotonic decrease begins to asymptote. This is roughly true for all 3 concentration thresholds. Consequently, I=0.2-0.8 effectively samples the region where intermittency clearly relates to distance to the source, which is where we hypothesize animals.

      4) Only 2 odors were used in the whole study and some results were in disagreement between the two odors. By looking at only two odors it is very difficult to make a general conclusion about intermittency encoding in the OB.

      We agree 2 odors are limited, but we were constrained in terms of number of tests that we could run on our cohort of animals. Nonetheless intermittency of both odors is clearly discriminable. As explained to comment 3 by Reviewer 1:

      “We indeed considered several odorants and associated properties. Given time constrains we were limited to 2 stimuli of which we had to vary many parameters (type, I, gain, sniffing) in assessing both discrimination and neural processing.”

      “Additionally, these two odorants recruit glomeruli in different regions of the dorsal olfactory bulb, have different functional groups and elicit different spatiotemporal response properties in the olfactory bulb (Figure 6- figure supplement 1A, stated on line 507). Both odorants are fruit-associated odors with neutral preference indices (Saraiva et al., 2016, Fletcher, 2012). Thus, while we do not explore a panel of odorants, we do explore the generalizability of intermittency processing with two distinct odorants.”

      We decided to test 2 monomolecular odorants (2-heptanone and methyl valerate) as these have been widely used in rodent olfactory bulb imaging, providing distinct and clear glomerular response patterns. They are both fruity smelling odors, implying a relationship to edible food (at least, for humans). Methyl valerate is a methyl ester of pentanoic acid with a fruity (apple) smell and 2-Heptanone is a ketone with a fruity (green banana) smell.

      5) Assuming that all the above issues are resolved, one can conclude that intermittency can be perceived by an animal. The study puts a strong accent on the fact that this feature could be used for navigation. I understand that it is extremely hard to demonstrate that this feature is actually used for navigation, however, the analysis of relevance of this measure is missing. Even if it is used in navigation, most probably this would be in combination with other features, thus its relative importance needs to be discussed, or even better, established.

      We fully appreciate the reviewers reasoning. Our approach indeed intended to establish a conditio sine qua non: if mice could not discriminate these stimuli they would likely not be able to use intermittency in general for navigation (at least for the odorants tested, for the intermittency ranges tested). We show however that they can, and hence they could use it. To demonstrate their use of intermittency alone or combined with other modalities or properties is well beyond the scope of this manuscript and we agree is a very interesting endeavor.

      We discussed other temporal properties on line 58-71 and 657-664 and other general properties on lines 46-56. The relative roles were briefly addressed on lines 664-676 and we hesitate to speculate beyond this.

    1. Author Response

      Reviewer #1 (Public Review):

      With MERGEseq, the authors sought to develop a scalable and accessible method for getting both projectome and transcriptome information at the single-cell level from multiple projection targets within a single animal. MERGEseq uses a retro rAAV2 to deliver a 15-nucleotide barcode driven by a CAG promoter with co-expression of eGFP to enrich barcoded cells using FACS. Injection of this rAAV2 in distinct regions (with each injection region distinguished by a unique barcode that is specific to the virus used) allows retrograde trafficking and expression of the barcodes in cells that project to the injected region. In this manuscript, rAAVs harboring 5 unique barcodes were stereotactically delivered to 5 targets of the mouse: dorsomedial striatum (DMS), mediodorsal thalamic nucleus (MD), basal amygdala (BLA), lateral hypothalamus (LH), and agranular insular cortex (AI). After a 6-week period to allow for viral transduction and expression, the ventromedial prefrontal cortex (vmPFC) was harvested for scRNAseq. vmPFC scRNAseq data were validated against previously published PFC datasets, demonstrating that MERGEseq does not disrupt transcript expression and identifies the same principal cell types as annotated in previous studies. Importantly, MERGEseq enabled the identification of cell types in the vmPFC that project to distinct areas, with separation occurring largely based on cell type and cortical layer. The application of stringent criteria for barcode index determination is rigorous and improves confidence that barcoded cells are correctly identified. The observation that all barcoded cells were excitatory is consistent with prior work, although it is not clear if viral tropism contributes to this in some way. In a parallel experiment, FAC-sorted cells (vmPFC cells expressing EGFP) were isolated as a comparison. Notably, EGFP+ cells were exclusively excitatory neurons, consistent with literature showing PFC projection neurons are excitatory. Next, barcode analysis was combined with transcriptional identification of neuronal subtypes to define general projection patterns and single-cell projection patterns, which were validated by the DMS and MD in situ using retrograde tracing in combination with RNA FISH. MERGEseq data were also used to identify transcriptional differences between neurons with dedicated and bifurcated projections. DMS+LH and DMS+MD projecting neurons had distinct transcriptional profiles, unlike cells with other targets. RNA FISH for marker gene Pou3f and retrograde tracing from DMS+LH projecting cells demonstrate enrichment of this gene in this projection population. Finally, machine-learning was used to predict projection targets based on transcriptional profiles. In this dataset, 50 highly variable genes (HVGs) were optimal for predicting projection patterns, though this might vary in different circuits. Overall, the results of this manuscript are well presented and include rigorous validation for select vmPFC targets with in situ techniques. The application of unique barcodes for retro-AAV delivery is an accessible tool that other labs can implement to study other brain circuits.

      Ultimately, MERGEseq is a subtle conceptual advancement over VECTORseq (retro-AAV delivered transgenes rather than barcodes, in combination with scRNAseq) that offers higher confidence in the described projectome diversity in comparison. The use of a retrograde AAV inherently limits the number of projection areas that can be assessed, a weakness compared to anterograde approaches such as MAPseq/BARseq. However, BARseq demands more time and resources; further, the use of the highly toxic Sindbis virus limits the application of this technique. This manuscript builds upon previous work by utilizing machine learning to predict projection targets. BARseq2 could be used to rigorously validate predicted projectomes and gain single-cell information regarding target neurons. Overall, MERGEseq is an accessible technique that can be used across many animal models and serve as an important starting point to define circuits at the single-cell level.

      We thank reviewer for the comprehensive review. We are grateful for reviewer’s recognition of the conceptual advancement of MERGE-seq and the rigorous criteria we applied for projection barcode determination. We have revised the Introduction to highlight advancements in our method. We also discussed the balance of transcriptomic comprehensiveness against spatial resolution in the revised Discussion. Reviewer’s comments have been invaluable in enhancing the clarity and depth of our manuscript.

      Reviewer #2 (Public Review):

      Investigating the relationship between transcriptomic profiles, their axonal projection and collateralization patterns will help define neuronal cell types in the mammalian central nervous system. The study by Xu et al. combined multiple retrograde viruses with barcodes and single-cell RNA-sequencing (MERGE-seq) to determine the projection and collateralization patterns of transcriptomically defined ventral medial prefrontal cortex (vmPFC) projection neurons. They found a complex relationship: the same transcriptomically defined cell types project to multiple target regions, and the same target region receives input from multiple transcriptomic types of vmPFC neurons. Further, collateralization patterns of vmPFC to the five target regions they investigated are highly non-random.

      While many of the biological conclusions are not surprising given recent studies on the collateralization patterns of vmPFC neurons using single neuron tracing and other methods that integrate transcriptomics and projections, MERGE-seq provides validation, at the single cell level, collateralization patterns of individual vmPFC neurons, and thus offer new and valuable information over what has been published. The method can also be used to study collateralization patterns of other neuron types.

      Some of the conclusions the authors draw depend on the efficiency of retrograde labeling, which was not determined. Without quantitative information on retrograde labeling efficiency, and unless such efficiency is close to 100%, these conclusions are likely misleading.

      We thank reviewer for recognizing the contributions of our MERGE-seq technique in advancing the understanding of projection patterns of vmPFC neurons. We concur that while our conclusions align with previous findings, our single-cell level analysis provides additional depth to the existing knowledge of the field. We acknowledge the challenge to quantify retrograde labeling efficiency to draw quantitive conclusions based on our findings. Alternatively, we have used fMOST-based single-neuron tracing data and analysis to validate our projection patterns and ensure the robustness of our conclusions in the revised manuscript. We also more explicitly clarified the limitations of the quantitive conclusion drawn from MERGE-seq in the revised Discussion. The insights of reviewer are greatly appreciated and will inform the improvement of our research methodology.

      Reviewer #3 (Public Review):

      This manuscript describes a multiplexed approach for the identification of transcriptional features of neurons projecting to specific target areas at the single-cell level. This approach, called MERGE-seq, begins with multiplexed retrograde tracing by injecting distinctly barcoded rAAV-retro viruses into different target areas. The transcriptomes and barcoding of neurons in the source area are then characterized by single-cell RNA sequencing (scRNAseq) on the 10xGenomics platform. The projection targets of barcoded neurons in the source area can be inferred by matching the detected barcodes to the barcode sequences to of rAAV-retro viruses injected into the target areas.

      The authors validated their approach by injecting five rAAV-retro GFP viruses, each encoding a different barcode, into five known targets of the ventromedial prefrontal cortex (vmPFC). The transcriptomes and barcoding of vmPFC neurons were then analyzed by scRNA-seq with or without enrichment of retrogradely labeled neurons based on GFP fluorescence. The authors confirmed the previously described heterogeneity of vmPFC neurons. In addition, they showed that most transcriptionally defined cell types project to multiple targets and that the five targets received projections from multiple transcriptomic types. The authors further characterized the transcriptomic features of barcoded vmPFC neurons with different projection patterns and defined Pou3f1 as a marker gene of neurons extending collateral branches to the dorsomedial striatum and lateral hypothalamus.

      Overall, the results of the manuscript are convincing: the transcriptomic vmPFC cell types defined by scRNAseq in this study appear to correlate well with previous studies, the bifurcated projection patterns inferred by barcoding are validated using dual-color retro-AAV tracing, and marker genes for projection-specific cell subclasses are validated in retrogradely labeled vmPFC using RNA FISH for marker detection.

      The concept of combining retrograde tracing and scRNAseq is not new. Previous studies have applied recombinase-expressing viruses capable of retrograde labeling, such as CAV, rabies virus, and AAV2-Retro, to retrogradely label and induce the expression of fluorescence markers in projection neurons, therefore facilitating enrichment and analysis of neurons projecting to a specific target. Multiplexed analysis can be achieved with the combination of different reporter viruses or viruses expressing different recombinases and appropriate reporter mouse lines. The advantages of MERGE-seq include that no transgenic lines are required and that it could be applied at even higher levels of multiplexity.

      We thank reviewer for the insightful review of our manuscript and the recognition of the advantages of MERGE-seq. We appreciate reviewer acknowledged the robust validation of the method through dual-color retro-AAV tracing and RNA FISH, and the confirmation of previous findings on vmPFC neuronal heterogeneity and collateral projection patterns. We provided additional joint analysis with fMOST-based single-neuron projectome data (Gao et al., 2022, Nature Neuroscience) to further validate the projection patterns (>= 3 targets) that cannot be easily validated with dual-color retro-AAV tracing.

      However, previously existing datasets that have already profiled this region with scRNAseq have not been utilized to their full extent. Therefore, for the proper context with prior literature, bioinformatic integration of these scRNAseq and prior scRNAseq data is needed.

      Moreover, robust detection of barcodes in neurons labeled by barcoded AAV-retro viruses remains a challenge. The authors should clearly discuss the difficulties with barcode detection in this approach, as well as discuss potential solutions, which are important for others interested in its approach.

      While this study is limited to the five known targets of vmPFC, the results suggest that MERGE-seq is a valuable tool that could be used in the future to characterize projection targets and transcriptomes of neurons in a multiplexed manner. As MERGE-seq uses AAVs to deliver barcodes, this method has the potential for application in model organisms for which transgenic lines are not available. Further improvements in experimental design and data analysis should be considered when applying MERGE-seq to poorly characterized source areas or with increased multiplexity of target areas.

      In summary, this is a valuable approach, but the authors should clearly provide the context for their study within the existing literature, transparently discuss the limitations of MERGE-seq, as well as suggest improvements for the future.

      We appreciate your positive assessment of MERGE-seq as a valuable approach with future potential. As recommended, we have performed integration analysis with existing vmPFC scRNA-seq studies, including Bhattacherjee et al., 2019, Lui et al., 2021, Yao at al., 2021, and specifically recently published MERFISH data of PFC (Bhattacherjee et al., 2023).

      In the revised Discussion, we have transparently addressed the current limitations of MERGE-seq, including imperfect retrograde labeling efficiency, variable barcode recovery rates and cell loss during dissociation. We also addressed the challenges in detecting and recovering projection barcodes and suggested potential solutions such as using FAC-sorted EGFP-negative cells for control and applying single-molecule FISH techniques. We sincerely appreciate reviewer’s rigorous and insightful feedback, which has substantially strengthened our manuscript.

    1. Author Response

      Reviewer #1 (Public Review):

      In this paper, the authors develop new models of sequential effects in a simple Bernoulli learning task. In particular, the authors show evidence for both a "precision-cost" model (precise posteriors are costly) and an "unpredictabilitycost" model (expectations of unpredictable outcomes are costly). Detailed analyses of experimental data partially support the model predictions.

      Strengths:

      • Well-written and clear.

      • Addresses a long-standing empirical puzzle.

      • Rigorous modeling.

      Weaknesses:

      • No model adequately explains all of the data.

      • New empirical dataset is somewhat incremental.

      • Aspects of the modeling appear weakly motivated (particularly the unpredictability model).

      • Missing discussion of some relevant literature.

      We thank Reviewer #1 for her/his positive comments on our work and her/his comments and suggestions.

      Reviewer #2 (Public Review):

      This paper argues for an explanation of sequential effects in prediction based on the computational cost of representing probability distributions. This argument is made by contrasting two cost-based models with several other models in accounting for first- and second-order dependencies in people's choices. The empirical and modeling work is well done, and the results are compelling.

      We thank Reviewer #2 for her/his positive comments on our work.

      The main weaknesses of the paper are as follows:

      1) The main argument is against accounts of dependency based on sensitivity to statistics (ie. modeling the timeseries as having dependencies it doesn't have). However, such models are not included in the model comparison, which makes it difficult to compare these hypotheses.

      Many models in the sequential-effects literature (Refs. [7-12] in the manuscript) are ‘leaky-integration’ models that interpret sequential effects as resulting from an attempt to learn the statistics of a sequence of stimuli, through exponentiallydecaying counts of the simple patterns in the sequence (e.g., single stimuli, repetitions, and alternations). In some studies, the ‘forgetting’ of remote observations that results from the exponential decay is justified by the fact that people live in environments that are usually changing: it is thus natural that they should expect that the statistics underlying the task’s stimuli undergo changes (although in most experiments, they do not), and if they expect changes, then they should discard old observations that are not anymore relevant. This theoretical justification raises the question as to why subjects do not seem to learn that the generative parameters in these tasks are in fact not changing — all the more as other studies suggest that subjects are able to learn the statistics of changes (and consistently they are able to adapt their inference) when the environment does undergo changes (Refs. [42,57]).

      Our models are derived from a different approach: we derive behavior from the resolution of a problem of constrained optimization of the inference process. It is not a phenomenological model. When the constraint that weighs on the inference process is a cost on the precision of the posterior, as measured by its entropy, we find that the resulting posterior is one in which remote observations are ‘forgotten’, through an exponentially discount, i.e., we recover the predictions of the leaky-integration models, which past studies have empirically found to be reasonably good accounts of sequential effects. (Thus these models are already in our model comparison.) In our framework, the sequential effects do not stem from the subjects’ irrevocable belief that the statistics of the stimuli change from time to time, but rather from the difficulty that they have in representing precise belief; a rather different theoretical justification.

      Furthermore, we show that a large fraction of subjects are not best-fitted by precision-cost models (i.e., they are not best-fitted by leaky integration), but instead they are best fitted by unpredictability-cost models. These models suggest a different explanation of sequential effects: that they result from the subjects favoring predictable environments, in their inference. In the revised version of the manuscript, we have made clearer that the derivation of the optimal posterior under a precision cost results in the exponential forgetting of remote observations, as in the leaky-integration models. We mention it in the abstract, in the Introduction (l. 76-78), in the Results when presenting the precision-cost models (l. 264-278), and in the Discussion (l.706-716).

      2) The task is not incentivized in any way. Since incentives are known to affect probability-matching behaviors, this seems important. In particular, we might expect incentives would trade off against computational costs - people should increase the precision of their representations if it generates more reward.

      We thank Reviewer #2 for her/his attention to our paper and for her/his comments. As for the point on the models, see answer above (point 1).

      As for the point on incentivization: we agree that it would be very interesting to measure whether and to which extent the performance of subjects increases with the level of incentivization. Here, however, we wanted, first, to establish that subjects’ behavior could be understood as resulting from inference under a cost, and second, to examine the sensitivity of their predictions to the underlying generative probability — rather than to manipulating a tradeoff involving this cost (e.g. with financial reward). We note that we do find that subjects are sensitive to the generative probability, which implies that they exhibit some degree of motivation to put some effort in the task (which is the goal of incentivization), in spite of the lack of economic incentives. But it would indeed be interesting to know how the potential sensitivity to reward interacts with the sensitivity to the generative probability. Furthermore, as Reviewer #2 mentions, some studies show that incentives affect probability-matching behavior: it is then unclear whether the introduction of incentives in our task would change the inference of subjects (through a modification of the optimal trade-off that we model); or whether it would change their probability-matching behavior, as modeled by our generalized probability-matching response-selection strategy; or both. Note that we disentangled both aspects in our modeling and that our conclusions are about the inference, not the response-selection strategy. We deem the incentivization effects very much worth investigating; but they fall outside of the scope of our paper.

      We now mention this point in the Discussion of the revised manuscript (l. 828-840).

      3) The sample size is relatively small (20 participants). Even though a relatively large amount of data is collected from each participant, this does make it more difficult to evaluate the second-order dependencies in particular (Figure 6), where there are large error bars and the current analysis uses a threshold of p < .05 across a large number of tests hence creating a high false-discovery risk.

      Indeed we agree with Reviewer #2 that as the number of tests increases, so does the probability that at least one null hypothesis is rejected at a given level, even if the null hypothesis is correct. But in the panels a, b and c of Figure 6, about half of the tests are rejected, which is very unlikely under the null hypothesis that there is no effect of the stimulus history on the prediction, all the more as the signs of the non-significant results are in most cases consistent with the direction of the significant results. (In panel e, which reports a finer analysis in which the number of subjects is essentially divided by 2, about a fourth of the tests are rejected, and here also the non-significant results are almost all in the same direction as the significant ones.)

      However, we agree that there remains a risk of false discovery, thus we applied a Bonferroni-Holm-Šidák correction to the p-values in order to mitigate this risk. With these more conservative p-values, a lower number of tests are rejected, but in most cases in Fig. 6abc the effects remain significant. In particular, we are confident that there is a repulsive effect of the third-to-last stimulus in the case of Fig. 6c, while there is an attractive effect in the other cases.

      In the revised manuscript, Figure 6 now reports whether the tests are rejected when the p-values are corrected with the Bonferroni-Holm-Šidák correction.

      (We also applied this correction to the p-values of the tests in Fig. 2, which has more data: the corrected p-values are all below 1e-13, which we now indicate in the caption of this figure.)

      4) In the key analyses in Figure 4, we see model predictions averaged across participants. This can be misleading, as the average of many models can produce behavior outside the class of functions the models themselves can generate. It would be helpful to see the distribution of raw model predictions (ideally compared against individual data from humans). Minimally, showing predictions from representative models in each class would provide insight into where specific models are getting things right and wrong, which is not apparent from the model comparison.

      In the main text of the original manuscript, we showed the behavior of the pooled responses of the best-fitting models, and we agree with Reviewer #2 that it did not make clear to the reader that the apparent ability of the models to reproduce the subjects’ behavioral patterns was not a misleading byproduct of the averaging of different models. In the original version of the manuscript, we had put a figure showing the behavior of each individual model (each cost type with each Markov order) in the Methods section of the paper; but this could easily be overlooked, and indeed it would be beneficial for the reader to be shown the typical behaviors of the models, in the main text. We have reorganized the presentation of the models’ behaviors: the first panels in Fig. 4 (in the main text) are now dedicated to showing the individual sequential effects of the precision-cost and of the unpredictabilitycost models with Markov order 0 and 1. The Figure 4 is reproduced in the response to Reviewer #1, above, along with comments on the sequential effects produced by these models (and also on the impact of the generalized probability-matching response-selection strategy, in comparison with the traditional probability matching). We believe that this figure makes clearer how the individual models are able to reproduce the patterns in subjects’ predictions — in particular it shows that this ability of the models is not just an artifact of the averaging of many models, as was the legitimate concern of Reviewer #2. We have left the illustration of the firstorder sequential effects of the other models (with Markov order 2 and 3) in the Methods section (Fig. 7), so as not to overload Fig. 4, and because they do not bring new critical conceptual points.

      As for the higher-order sequential effects, the updated Figure 5, also reproduced above in the responses to Reviewer #1, now includes the sequential effects obtained with the precision-cost model of a Bernoulli observer (m=0), in addition to the precision-cost model of a Markov observer (m=1) and to the unpredictabilitycost model of a Markov observer (m=3), in order to better illustrate the behaviors of the different models. The higher-order sequential effects of the other models can be found in Fig. 8 in Methods.

      Reviewer #3 (Public Review):

      This manuscript offers a novel account of history biases in perceptual decisions in terms of bounded rationality, more specifically in terms of finite resources strategy. Bridging two works of literature on the suboptimalities of human decision-making (cognitive biases and bounded rationality) is very valuable per se; the theoretical framework is well derived, building upon the authors' previous work; and the choice of experiment and analysis to test their hypothesis is adequate. However, I do have important concerns regarding the work that do not enable me to fully grasp the impact of the work. Most importantly, I am not sure whether the hypothesis whereby inference is biased towards avoiding high precision posterior is equivalent or not to the standard hypothesis that inference "leaks" across time due to the belief that the environment is not stationary. This and other important issues are detailed below. I also think that the clarity and architecture of the manuscript could be greatly improved.

      We thank Reviewer #3 for her/his positive comments on our work and her/his comments and suggestions.

      1) At this point it remains unclear what is the relationship between the finite resources hypothesis (the only bounded rationality hypothesis supported by the data) and more standard accounts of historical effects in terms of adaptation to a (believed to be) changing environment. The Discussion suggests that the two approaches are similar (if not identical) at the algorithmic level: in one case, the posterior belief is stretched (compared to the Bayesian observer for stationary environments) due to precision cost, in other because of possible changes in the environment. Are the two formalisms equivalent? Or could the two accounts provide dissociable predictions for a different task? In other words, if the finite resources hypothesis is not meant to be taken as brain circuits explicitly minimizing the cost (as stated by the authors), and if it produces the same type of behavior as more classical accounts: is the hypothesis testable experimentally?

      We agree with Reviewer #3 that the relation between our approach and other approaches in the literature should be made clearer to the reader.

      Since the 1990s, in the psychology and neuroscience literature, many models of perception and decision-making have featured an exponential decay of past observations, resulting in an emphasis, in decisions, of the more recent evidence (‘leaky integration’, Refs. [7-12, 76-86]). In the context of sequential effects, this mechanism has found a theoretical justification in the idea that people believe that statistics typically change, and thus that remote observations should indeed be discarded [8,12]. In inference tasks with binary signals, in which the optimal Bayesian posterior is in many cases a Beta distribution whose two parameters are the counts of the two signals, one way to conveniently incorporate a forgetting mechanism is to replace these counts with exponentially-filtered counts, in which more recent observations have more weight (e.g., Ref. [12]).

      Our approach to sequential effects is not grounded in the history of leakyintegration models: we assume, first, that subjects attempt at learning the statistics of the signals presented to them (this is also the assumption in many studies [712]), and second, that their inference is subject to a cost, which prevents them from reaching the optimal, Bayesian posterior; but under the constraint of this cost, they choose the optimal posterior. We formalize this as a problem of constrained optimization.

      The two formalisms are thus not equivalent. Beyond the fact that we clearly state the problem which we assume the brain is solving, we do not propose that the origin of sequential effects resides in an adaptation to putatively changing environments: instead, we assume that they originate in a cognitive cost internal to the decision-maker. If this cost is proportional to the entropy of the posterior, as in our precision cost, then the optimal approximate posterior is one in which remote observations are ‘forgotten’ through an exponential filter, as in the leakyintegration models. In other words, in the context of this task and with this kind of cost, the models are, as Reviewer #3 writes, identical at the algorithmic level. As for the unpredictability cost, it does not result in a solution that resembles leaky integration; about half the subjects, however, are best fitted by unpredictabilitycost models. We thus provide a different rationale for sequential effects — that the brain favors predictive environment, in its inference — and this alternative account is successful in capturing the behavior of a large fraction of the subjects.

      In the revised manuscript, we now clarify that the precision cost results in leaky integration, in the abstract, in the Introduction (l. 76-78), in our presentation of the precision-cost models (Results section, l. 264-275), and in the Discussion (l. 706716). (We also refer Reviewer #3 to our response to the first comment of Reviewer #2, above.)

      Finally, Reviewer #3 asks the interesting question as to whether the “two accounts provide dissociable predictions for a different task”. Given that the leakyintegration approach is justified by an adaptation to potential changes, and our approach relies on the hypothesis that precision in beliefs is costly, one way to disentangle the two would be to eliminate the sequential nature of the task and presenting instead observations simultaneously. This would eliminate the mere notion of change across time. In this case, the leaky account would predict that subjects’ inference becomes optimal (because the leak should disappear in the absence of change), while in the second approach the precision cost would still weigh on the inference, and result in approximate posteriors that are “wider” (less precise) than the optimal one. The resulting divergence in the predictions of these models is very interesting, but out of the scope of this study on sequential effects.

      2) The current analysis of history effects may be confounded by effects of the motor responses (independently from the correct response), e.g. a tendency to repeat motor responses instead of (or on top of) tracking the distribution of stimuli.

      We thank Reviewer #3 for pointing out the possibility that subjects may have a tendency to repeat motor responses that is not related to their inference.

      We note that in Urai et al., 2017, as in many other sensory 2AFC tasks, successive trials are independent: the stimulus at a given trial is a random event independent of the stimulus at the preceding trial; the response at a given trial should in principle be independent of the stimulus at the preceding trial; and the response at the preceding trial conveys no information about the response that should be given at the current trial (although subjects might exhibit a serial dependency in their responses). By contrast, in our task an event is more likely than not to be followed by the same event (because observing this event suggests that its probability is greater than .5); and a prediction at a given trial should be correlated with the stimuli at the preceding trials, and with the predictions at the preceding trials. In a logit model (or any other GLM), this would mean that the predictors exhibit multicollinearity, i.e., they are strongly correlated. Multicollinearity does not reduce the predictive power of a model, but it makes the identification of parameters extremely unreliable: in other words, we wouldn’t be able to confidently attribute to each predictor (e.g., the past observations and the past responses) a reliable weight in the subjects’ decisions. Furthermore, our study shows that past stimuli can yield both attractive and repulsive effects, depending on the exact sequence of past observations. To capture this in a (generalized) linear model, we would have to introduce interaction terms for each possible past sequence, resulting in a very high number of parameters to be identified.

      However, this does not preclude the possibility that subjects may have a motor propensity to repeat responses. In order to take this hypothesis into account, we examined the behavior and the ability to capture subjects’ data of models in which the response-selection strategy allows for the possibility of repeating, or alternating, the preceding response. Specifically, we consider models that are identical to those in our study, except for the response-selection strategy, which is an extension of the generalized probability-matching strategy, in which a parameter eta, greater than -1 and lower than 1, determines the probability that the model subject repeats its preceding response, or conversely alternates and chooses the other response. With probability 1-|η|, the model subject follows the generalized probability-matching response-selection strategy (parameterized by κ). With probability |η|, the model subject repeats the preceding response, if η > 0, or chooses the other response, if η < 0. We included the possibility of an alternation bias (negative η), but we find that no subject is best-fitted by a negative η, thus we focus on the repetition bias (positive η). We fit the models by maximizing their likelihoods, and we compared, using the Bayesian Information Criterion (BIC), the quality of their fit to that of the original models that do not include a repetition propensity.

      Taking into account the repetition bias of subjects leaves the assignment of subjects into two families of inference cost mostly unchanged. We find that for 26% of subjects the introduction of the repetition propensity does not improve the fit (as measured by the BIC) and can therefore be discarded. For 47% of subjects, the fit is better with the repetition propensity (lower BIC), and the best-fitting inference model (i.e., the type of cost, precision or unpredictability, and the Markov order) is the same with or without repetition propensity. Thus for 73% (=26+47) of subjects, allowing for a repetition propensity does not change the inference model. We also find that the best-fitting parameters λ and κ, for these subjects, are very stable, when allowing or not for the repetition propensity. For 11% of subjects, the fit is better with the repetition propensity, and the cost type of the inference model is the same (as without the repetition propensity), but the Markov order changes. For the remaining 16%, both the cost type and the Markov order change.

      Thus for a majority of subjects, the BIC is improved when a repetition propensity is included, suggesting that there is indeed a tendency to repeat responses, independent of the subjects’ inference process and generative stimulus probability. In Figure 7, in Methods, we show the behavior of the models without repetition propensity, and with repetition propensity, with a parameter η = 0.2 close to the average best-fitting value of eta across subjects. We show, in Methods, that (i) the unconditional probability of a prediction A, p(A), is the same with and without repetition propensity, and that (ii) the conditional probabilities p(A|A) and p(A|B) when η≠0 are weighted means of the unconditional probability p(A) and of the conditional probabilities when eta=0 (see p. 47-49 of the revised manuscript).

      In summary, our results suggest that a majority of subjects do exhibit a propensity to repeat their responses. Most subjects, however, are best-fitted by the same inference model, with or without repetition propensity, and the parameters λ and κ are stable, across these two cases; this speaks to the robustness of our model fitting. We conclude that the models of inference under a cost capture essential aspects of the behavioral data, which does not exclude, and is not confounded by, the existence of a tendency, in subjects, to repeat motor responses.

      In the revised manuscript, we present this analysis in Methods (p.47-49), and we refer to it in the main text (l. 353-356 and 400-406).

      3) The authors assume that subjects should reach their asymptotic behavior after passively viewing the first 200 trials but this should be assessed in the data rather than hypothesized. Especially since the subjects are passively looking during the first part of the block, they may well pay very little attention to the statistics.

      The assumptions that subjects reach their asymptotic behavior after being presented with 200 observations in the passive trials should indeed be tested. To that end, we compared the behavior of the subjects in the first 100 active trials with their behavior in the remaining 100 active trials. The results of this analysis are shown in Figure 9.

      For most values of the stimulus generative probability, the unconditional proportions of predictions A, in the first and the second half (panel a, solid and dashed gray lines), are not significantly different (panel a, white dots), except for two values (p-value < 0.05; panel a, filled dots). Although in most cases the difference between the two is not significant, in the second half the proportions of prediction A seem slightly closer to the extremes (0 and 1), i.e., closer to the optimal proportions. As for the sequential effects, they appear very similar in the two halves of trials. We conclude that for the purpose of our analysis we can reasonably consider that the behavior of the subjects is stationary throughout the task.

      4) The experiment methods are described quite poorly: when is the feedback provided? What is the horizontal bar at the bottom of the display? What happens in the analysis with timeout trials and what percentage of trials do they represent? Most importantly, what were the subjects told about the structure of the task? Are they told that probabilities change over blocks but are maintained constant within each block?

      We thank Reviewer #3 for her/his close attention to the details of our experiment. Here are the answers to the reviewer’s questions:

      • The feedback (i.e., a lightning strike on the left or the right rod, with the rod and the battery turning yellow if the strike is on the side predicted by the subject,) is immediate, i.e., it is provided right after the subject makes a prediction, with no delay. We now indicate this in the caption of Figure 1.

      • The task is presented to the subjects as a game in which predicting the correct location of the lightning strike results in electric power being collected in the battery. The horizontal bar at the bottom of the display is a gauge that indicates the amount of power collected in the current block of trials. It has no operational value in the task. We now mention it in the Methods section (l. 872-874).

      • The timeout trials were not included in the analysis. The timeout trials represented 1.27% of the trials, on average (across subjects); and for 95% of the subjects the timeout trials represented less than 2.5% of the trials. This information was added in Methods (l. 887-889).

      • Each new block of trials was presented to the subject as the lightning strikes occurring in a different town. The 200 passive trials at the beginning of each block, in which subjects were asked to observe a sequence of 200 strikes, were presented as the ‘track record’ for that town, and the instructions indicated that it was ‘useful’ to know this track record. No information was given on the mechanism governing the locations of the strikes. In the main text of the revised manuscript, we now include these details when describing the task (p. 6).

    1. Author Response

      Reviewer #1 (Public Review):

      Sun et al. investigated the circuit mechanism of a novel type of synaptic plasticity in the projection from the visual cortex to the auditory cortex (VC-AC), which is thought to play an important role in visuo-auditory associative learning. The key question behind this paper is what is the role of CCK positive projection from the entorhinal cortex in the plasticity of VC-AC projections? They discover that the strength of VC-AC projections does not change when pairing the stimulation of this pathway with the acoustic stimulation of the auditory cortex (AC) unless CCK is applied to the AC or CCK positive projection from the entorhinal cortex to auditory cortex (EC-AC) is optogenetically stimulated. In contrast, optogenetically stimulating VC-AC projections, which express a lower level of CCK than the EC-AC projection, do not induce such synaptic plasticity. Interestingly, the data also indicates that even if the EC-AC pathway is stimulated 500ms ahead of the pairing of stimulating VC-AC pathway and the AC, the VC-AC synaptic strength can still be potentiated, consistent with the long-lasting nature of CCK as a neuropeptide. By performing a fear conditioning assay, the authors demonstrate that the CCK signaling is indeed required for the association of visual and auditory cues.

      The proposed mechanism is interesting because it not only helps explain the heterosynaptic plasticity of the visual-auditory projection but also will provide insight into how the entorhinal cortex as an association area contributes to the association of visual and auditory cues. Nevertheless, this study suffers from the lack of a few key experiments, which prevents drawing a conclusion on the contribution of CCK release from the EC-AC projection to the plasticity of the VC→AC projection.

      We are grateful for the constructive comments provided by the reviewers and appreciate the significant effort they have dedicated to reviewing our manuscript. To enhance our study and strengthen our conclusions, we have made the following revisions in response to their feedback.

      1) One main conclusion from figures 1-3 is that CCK released from the EC-AC projection is required for the plasticity of VC-AC projection in addition to pairing VALS with noise/electrical stimulation. But the data in those figures cannot exclude alternative explanations that CCK alone or the pairing CCK with either VALS or noise are sufficient to make the VC-AC synaptic connection more potent. It concerns the mechanism underlying the effect of CCK: CCK may function simply as a neuromodulator to regulate the excitatory synaptic transmission, but not to promote long term synaptic plasticity.

      Thanks for the valuable comment and pointing out the weakness. In response to the comment, we have conducted additional control experiments to reinforce our conclusions. These include: For Figure 1G, we introduced three control groups: CCK alone (Figure1-figure supplement 1F-G), CCK + presynaptic activation of VC-to-AC inputs (Figure 1-figure supplement 1H-I), and CCK + postsynaptic firing induced by noise (Figure 1-figure supplement 1J-K). Our findings from these control experiments indicate that in all three scenarios, there was no potentiation of the VC-to-AC inputs. Further details can be found in Figure 1-figure supplement 1F-K.

      For Figure 2E, we introduced three control groups: HFS laser EC-to-AC alone (Figure 2-figure supplement 1H-I), HFS laser EC-to-AC + presynaptic activation of VC-to-AC inputs (Figure 2-figure supplement 1L-M), and HFS laser + postsynaptic firing induced by noise (Figure 2-figure supplement 1P-Q). And we found that in all three scenarios, the VC-to-AC inputs were not significantly potentiated. Please see details in Figure 2-figure supplement 1.

      Given that our in vivo results already demonstrated that neither HFS laser EC-to-AC alone, nor its combination with presynaptic or postsynaptic activation, potentiated the VC-to-AC inputs, we did not replicate these control groups in our ex vivo setup. These additional experiments enhance the robustness of our findings and address the initial concerns raised.

      2) Similar issue exists in Fig. 2H and 3J. Without proper controls, it is impossible to tell whether all three conditions (HFLSEA, VALA, noise/electrical stimulation) are necessary for potentiated AC responses to acoustic/electrical stimulation.

      Same as above, we have conducted additional control experiments to reinforce our conclusions. These include:

      For Figure 2H, we also tested the noise response in the above three control groups: HFS laser EC to AC alone (Figure 2-figure supplement 1J-K), HFS laser EC-to-AC + presynaptic activation of VC-to-AC inputs (Figure 2-figure supplement 1N-O), and HFS laser + postsynaptic firing induced by noise (Figure 2-figure supplement 1R-S). And we found that fEPSPs evoked by noise stimuli were significantly potentiated after HFS laser EC-to-AC + Post (Figure 2-figure supplement 1R-S). However, there was no potentiation observed following HFS laser EC-to-AC alone (Figure 2-figure supplement 1J-K) and HFS laser EC-to-AC + Pre (Figure 2-figure supplement 1N-O).

      These results suggest that both HFS laser targeting the EC-to-AC projection and noise-induced AC firing are required to potentiate the AC's response to acoustic stimuli. In contrast, activation of the VC-to-AC projection is not necessary. This finding aligns with our previous research (Li et al., 2014).

      Given the similarity in experimental design, we opted not to replicate these specific control groups in our ex vivo setup.

      These additional control experiments have been crucial in reinforcing the conclusions of our study.

      3) Fig. 2E and 3G show that the stimulation of CCK-positive EC-AC projection is required for the plasticity of VC-AC projection. Considering most EC-AC projection neurons co-release glutamate and CCK, however, we cannot tell if CCK or glutamate or both matter to this type of plasticity. Even though the long delay in Fig 5B is consistent with the neuropeptide nature of CCK, direct experimental evidence is needed, since it is where the novelty of the paper is.

      Thank you for your constructive feedback. In response to the suggestions, for Figure 2E, we have incorporated two additional experiments: one with a CCKB receptor (CCKBR) antagonist and another with ACSF infused into the AC prior to HFS laser EC-to-AC + Pre/Post Pairing (Figures 2N-P). Our findings demonstrate that the CCKBR antagonist effectively inhibited the potentiation of the VC-to-AC inputs following the HFS laser EC-to-AC + Pre/Post Pairing. Conversely, ACSF did not exhibit this inhibitory effect. For further information, please refer to Figures 2N-P. Given the similarity in experimental design, we opted not to replicate these groups in our ex vivo setup.

      4) In Fig. 6, the authors examined the necessity of CCK for the generation of the visuo-auditory association. The experimental approach of injection CCK receptor blocker or CCK-4 is not specific to the EC-AC pathway. There is neither a link between VC-AC plasticity nor this behavioral result. Thus, the explanatory power of this experiment is limited in the context set up by the first 5 figures.

      Thank you for highlighting this area for improvement. To enhance the explanatory power of our behavioral experiments, we conducted the following additional studies:

      1) Assessing the Necessity of CCK+ EC-to-AC Projection in Establishing Visuo-Auditory Association:

      We bilaterally injected AAV9-syn-DIO-hM4Di-eYFP or AAV9-syn-DIO-eYFP into the EC and implanted cannulae in the AC of Cck Ires-Cre mice. During the encoding phase, we inactivated the CCK+ EC-to-AC pathway via CNO infusion into the AC. Our results show that this inactivation prevents the behavioral establishment of an association between the visual stimulus (VS) and auditory stimulus (AS), without affecting the fear conditioning memory to the AS (Figure 6B, beige).

      2) Determining the Role of VC-to-AC Projection in Establishing Visuo-Auditory Association: We bilaterally injected AAV9-syn-hM4Di-eYFP or AAV9-syn-eYFP into the visual cortex (VC) and also implanted cannulae in the AC of Cck Ires-Cre mice. Inactivating the VC-to-AC pathway during the encoding phase with CNO infusion in the AC, we observed that this inactivation hinders the establishment of a behavioral association between VS and AS, but does not interfere with the fear conditioning memory to the AS (Figure 6B, red).

      3) Investigating the Importance of CCK+ EC-to-AC Projection in Recalling Recent Visuo-Auditory Association:

      Again, AAV9-syn-DIO-hM4Di-eYFP or AAV9-syn-DIO-eYFP was injected bilaterally into the EC, and cannulae were implanted in the AC of Cck Ires-Cre mice. By inactivating the CCK+ EC-AC pathway during the retrieval phase with CNO infusion into the AC, we found that such inactivation disrupted the recall of the recent association between VS and AS behaviorally, yet did not affect the fear conditioning memory to the AS (Figure 6D, beige).

      4) Assessing the Necessity of VC-to-AC Projection in Recalling Recent Association Memory: For this experiment, AAV9-syn-hM4Di-eYFP or AAV9-syn-DIO-eYFP was injected bilaterally into the VC, and cannulae were placed in the AC of Cck Ires-Cre mice. Inactivating the VC-AC pathway during the retrieval phase with CNO infusion in the AC led to the discovery that this inactivation disrupted the behavioral recall of the recent association between VS and AS but did not disrupt the fear conditioning memory to the AS (Figure 6D, red).

      These additional experiments significantly contribute to our understanding of the roles played by the CCK+ EC-AC and VC-AC projections in both the establishment and recall of visuo-auditory associative memories.

      5) In page 16, line 322-326, the authors concluded that to induce the plasticity of VC→AC projection, Delay 1 should be longer than 10 ms and Delay 2 should be longer than 0 ms. This conclusion was not fully supported by the data from Figure 5B-D, because there is no data point between -65 ms and 10 ms for Delay 1 (for example 0 ms), and no negative values for Delay 2.

      We rewrote this paragraph and hope it is more accurate now.

      “Taken together, our study indicates that significant potentiation of the VC-to-AC inputs can be observed (Figure 5D, black cube) across five pairing trials with a 10-second inter-trial interval, under certain tested conditions: (i) the frequency of repetitive laser stimulation of the CCK+ entorhinal cortex (EC) to AC projection was maintained at 10 Hz or higher (as we did not test frequencies between 1 to 10 Hz), (ii) Delay 1 was set within the tested range of 10 to 535 ms (noting the absence of data between -65 to 10 ms), and (iii) Delay 2 was within the range of 0 to 200 ms (acknowledging that negative values for Delay 2 were not explored).”

      Reviewer #2 (Public Review):

      The manuscript by Sun et al., investigates the synaptic plasticity underlying visuo-auditory association. Through a series of in vivo and ex vivo electrophysiology recordings, the authors show that high-frequency stimulation (HFLS) of the cholecystokinin (CCK) positive neurons in the entorhino-auditory projection paired with an auditory stimulus can evoke long-term potentiation (LTP) of the visuo-auditory projection. However, LTP of the visuo-auditory projection could not be elicited by HFLS of the visuo-auditory projection itself or by an unpaired stimulus. They further demonstrate that auditory stimulus pairing with CCK is required to elicit LTP of the visuo-auditory projection as well as visuo-auditory association in a fear conditioning behavioral experiment. As they found elevated expression of CCK in entorhinal neurons which project to the auditory cortex, they conclude that HFLS of the entorhino-auditory projection causes CCK release.

      Strengths:

      The authors use an elegant approach with Chrimson and Chronos to stimulate different auditory inputs in the same mouse in vivo and also in slice and demonstrate that potentiation of the visuo-auditory projection is dependent on HFLS of the entorhino-auditory projection paired with auditory stimulus. Furthermore, they test several parameters in a systematic fashion, generating a comprehensive analysis of the plasticity changes that regulate visuo-auditory association.

      Weaknesses:

      In their previous publications (Chen et al., 2019; Li et al., 2014; Zhang et al., 2020), it has been established that HFLS of the entorhino-auditory projection and CKK release are important for visuo-auditory association via electrophysiology and behavioral experiments. The Chrimson and Chronos approach was applied by Zhang et al., 2020, where they already found that the visuo-auditory projection was potentiated through HFLS of entorhino-neocortical fibers. This manuscript extends those findings by testing different parameters of pairing, which may not represent a major conceptual advance. Unlike the electrophysiological recordings, drug infusion is used in behavioral manipulations to show that HFLS of the entorhino-auditory projection is important for visuo-auditory association. While the use of drugs to inhibit CKK receptors is important, it does not directly demonstrate that CCK release from the entorhino-auditory is necessary.

      We deeply appreciate the reviewer's constructive and insightful feedback. Building on our previous work (Zhang et al., 2020), which highlighted the potentiation of the VC-to-AC projection through high-frequency laser stimulation (HFS laser) of entorhino-neocortical fibers, our current study probes further into the intricacies of this process. We have thoroughly explored the specific conditions necessary for the potentiation of the VC-to-AC projection, assessing a wide range of parameters.

      A significant advancement in our current research is the elucidation of why HFS of the VC-to-AC pathway alone fails to induce potentiation, whereas HFS of the EC-to-AC pathway, coupled with Pre/Post Pairing, is effective. This critical distinction is linked to the heightened expression of CCK in EC neurons projecting to the AC, in contrast to those from the VC. In this revised version of our study, we have also demonstrated that HFS laser stimulation of the EC-to-AC CCK+ projection induces the release of endogenous CCK in the AC using a combination of a CCK sensor and fiber photometry.

      Behaviorally, our revised research emphasizes the vital role of the CCK+ EC-AC projection in both establishing and retrieving visuo-auditory memories, thereby highlighting its fundamental importance in memory processing. Moreover, our study confirms that the CCK+ EC-AC projection is not only crucial for memory formation and retrieval but also indicates that the VC-to-AC projection is the anatomical basis for establishing visuo-auditory associations and serves as the principal storage site for visuo-auditory associative memory. These findings represent significant strides in our understanding of synaptic plasticity and memory mechanisms.

      For the behavioral part, to build the link that HFS laser of the EC-to-AC CCK+ projection is important for visuo-auditory association in the behavioral context, we conducted the following additional behavioral studies (for details please see the response to comment 4 of reviewer 1):

      1) Assessing the Necessity of CCK+ EC-to-AC Projection in Establishing Visuo-Auditory Associative memories, by inactivating the pathway with inhibitory DREADD during the encoding phase.

      2) Investigating the Importance of CCK+ EC-to-AC Projection in Recalling Visuo-Auditory Association, by inactivating the pathway with inhibitory DREADD during the retrieving phase.

    1. Author Response

      Reviewer #1 (Public Review):

      This paper combines an array of techniques to study the role of cholecystokinin (CCK) in motor learning. Motor learning in a pellet reaching task is shown to depend on CCK, as both global and locally targeted CCK manipulations eliminate learning. This learning deficit is linked to reduced plasticity in the motor cortex, evidenced by both slice recordings and two-photon calcium imaging. Furthermore, CCK receptor agonists are shown to rescue motor cortex plasticity and learning in knockout mice. While the behavioral results are clear, the specific effects on learning are not directly tested, nor is the specificity pathway between rhinal CCK neurons and the motor cortex. In general, the results present interesting clues about the role of CCK in motor learning, though the specificity of the claims is not fully supported.

      Since all CCK manipulations were performed throughout learning, rather than after learning, it is not clear whether it is learning that is affected or if there is a more general motor deficit. Related to this point, Figure 1D appears to show a general reduction in reach distance in CCK-/- mice. A general motor deficit may be expected to produce decreased success on training day 1, which does not appear to be the case in Figure 1C and Figure 2B, but may be present to some degree in Figure 5B. Or, since the task is so difficult on day 1, a general motor deficit may not be observable. It is therefore inconclusive whether the behavioral effect is learning-specific.

      Thanks for your comments and suggestions.

      We have tested the basic movement ability of CCK-/- and WT mice and we found that there were no significant difference between CCK-/- and WT in terms of stride length, stride time, step cycle ratio and grasp force (Figure S1C, S1D, S1E, S1F). Besides, we also have tested the performance of mice injected with CCKBR antagonist or injected with hM4Di together with clozapine after learned the task (Figure S2D, S8D). The performance of mice before and after antagonist injection or chemogenetic manipulation were comparable. These results suggested that all the CCK manipulations did not cause general defects to the movement ability of mice.

      The paper implicates motor cortex-projecting CCK neurons in the rhinal cortex as being a key component in motor learning. However, the relative importance of this pathway in motor learning is not pinned down. The necessity of CCK in the motor cortex is tested by injecting CCK receptor antagonists into the contralateral motor cortex (Figure 2), though a control brain region is not tested (e.g. the ipsilateral motor cortex), so the specificity of the motor cortex is not demonstrated.

      Thanks for your comments and suggestions.

      In this study, we focus on the role played by CCK from the rhinal cortex to the motor cortex, and how CCK affects motor learning. The single pellet reaching task was selected to study the role of CCK from the rhinal cortex to the motor cortex in motor skill learning and the motor cortex is considered as the main area generates motor memory when training in this task (Komiyama et al., 2010; Peters et al., 2014; Richard et al., 2019). We emphasized that the importance of the motor cortex in motor learning, not meant that other brain areas where also receive CCK-positive neural projections from the rhinal cortex, for example hippocampus (spatial memory), are not important for the performance of this task. In fact, specifically inhibiting the projection from the rhinal cortex to the contrallateral motor cortex is not enough to suppress the motor learning ability of, but inhibiting projecting in both sides (contro- and ipsi-lateral) could suppress the learning ability of mice, suggesting that the whole motor cortex is critical for motor skill learning (Figure 6, S8). In this paper, we studied the relationship between the rhinal cortex and the motor cortex and the role played by CCK in this circuit. The specificity of the motor cortex is task-dependent, not the main purpose in this study.

      The learning-related source of CCK in the motor cortex is also unclear, since even though it is demonstrated that CCK neurons in the rhinal cortex project to the motor cortex in Figure 4D, Figure 4C shows that there is also a high concentration of CCK neurons locally within the motor cortex. Likewise, the importance of the projection from the rhinal cortex to the motor cortex is not specifically tested, as rhinal CCK neurons targeted for inactivation in Figure 5 include all CCK cells rather than motor cortex-projecting cells specifically.

      Thanks for your comments and suggestions.

      The specificity of the CCK-projection from the rhinal cortex to the motor cortex for motor skill learning was studies using chemogenetic methods in the revised version of the manuscript. We first determined that over 98% of neurons in the rhinal cortex that projected to the motor cortex are CCK positive (Figure 6A, S6A, S6B). Next, we injected the retro-Cre virus in the motor cortex and the Cre-dependent hM4Di in the rhinal cortex in C57BL/6 mice to specifically inhibit the CCK neurons from the rhinal cortex to the motor cortex. Compared to two control groups, the learning ability of the experimental group was significant suppressed, suggesting that CCK projections from the rhinal cortex to the motor cortex are critical for motor skill learning (Figure 6). Detailed description was added in the part of "Result" in the manuscript.

      CCK is suggested to play a role in producing reliable activity in the motor cortex through learning through two-photon imaging experiments. This is useful in demonstrating what looks like normal motor cortex activity in the presence of CCK receptor antagonist, indicating that the manipulations in Figure 2 are not merely shutting off the motor cortex. It is also notable that, as the paper points out, the activity appears less variable in the CCK manipulations (Figure 3G). However, this could be due to CCK manipulation mice having less-variable movements throughout training. The Hausdorff distance is used for quantification against this point in Figure 1E, though the use of the single largest distance between trajectories seems unlikely to give a robust measure of trajectory similarity, which is reinforced by the CCK-/- traces looking much less variable than WT traces in Figure 1D. The activity effects may therefore be expected from a general motor deficit if that deficit prevented the mice from normal exploratory movements and restricted the movement (and activity) to a consistently unsuccessful pattern.

      Thanks for your comments and suggestions.

      To totally suppress CCK receptors in the motor cortex, the antagonist is unavoidable to diffuse to the adjacent brain areas as the motor cortex is not regularly circular. But the area inhibited most should be the motor cortex. We applied the chemogenetics method to further determine the specificity of the motor cortex in the motor skill learning. Specific projection from the RC to the MC was inhibited bilaterally, which suppressed the motor learning ability.

      For a wild-type mouse, neurons were activated when it try to get the food pellet. Neuronal pattern corresponding to each trial will be remembered, and the patterns corresponding to successful movements will tend to be repeated. Manipulations of CCK prevented neurons from remembering the pattern they tried and repeated the pattern they tried before no matter it is successful or not. This is corresponding to the neuron-activation pattern showed in figure 3D, 3E and 3G, the population activities (neuronal activities) are comparable, while the trial-to-trial population correlation is a little bit higher for the CCK-manipulation groups on Day 1. In terms of the behavior, manipulations of CCK decreased the possibility to explore the best path to get food pellets and just repeating a reach for the food pellet like it was the first time. Besides, many tests including the movement ability of CCK-/-, performance of antagonist injection group and chemogenetics manipulation group after learning indicated that CCK-manipulation did not affect the basic movement ability.

      Hausdorff distance is the greatest of all the distances from a point in one set to the closest point in the other set. It is not just the largest distance between two trajectories, but comprehensively takes all points in each trajectory into consideration. Hausdorff distance is widely used to assess the variation of two trajectories. The similarity of the shapes of trajectories is not applied for analysis because it is not very effective to assess the performance of a mouse. The fixed location of the initial site and food site makes all trajectories are single lines in the same direction, thus, the shapes of the trajectories are very similar among different trials. Two trajectories with similar shape but far from each other (big Hausdorff distance) should be treated as big variation because, in terms of the final results, they are quite different (success vs. miss). Therefore, Hausdorff distance is more reliable to be applied for assessment of the performance of mice.

      Finally, slice experiments are used to demonstrate the lack of LTP in the motor cortex following CCK knockout, which is rescued by CCK receptor agonists. This is a nice experiment with a clear result, though it is unclear why there are such striking short-term depression effects from high-frequency stimulation observed in Figure 6A that are not observed in Figure 1H. Also, relating to the specificity of the proposed rhinal-motor pathway, these experiments do not demonstrate the source of CCK in the motor cortex, which may for example originate locally.

      Thanks for your comments.

      1. Because CCK4 is a small molecule, which degrades very fast with half-time less than 1 min in the rat serum and 13 min in the human serum, we injected the drug into the electrode recording dishes, while the ACSF was stopped flowing, leading to a relatively low oxygen condition. As it showed in Figure 6A, it cost about 15 min for the brain slices to recover. Compared with CCK4 manipulation, the depression of vehicle group is stronger, which could be due to the effects of CCK4 induced LTP after HFS compensated the depression.

      2. In the motor cortex, many CCK-positive neurons are γ-aminobutyric acid-ergic (GABAergic) neurons, in which the role played by CCK is not very clear (Whissell et al., 2015). However, evidence showed that GABA may inhibit the release of CCK in the neocortex (Yaksh et al., 1987). Many glutamatergic neurons in the neocortex also express CCK (Watakabe et al., 2012). In this study, the stimulation electrode was placed on the layer 1, where receives most CCK projections from the rhinal cortex, to release CCK from the rhinal cortex, but can not rule out the possibility that some CCK may release from the local CCK neurons (Figure 4B). We focused on the importance of CCK for neural plasticity in the motor cortex, but did not aim to figure out the role played by the cortical CCK-positive neurons, including inhibitory and excitatory neurons, in neuronal plasticity and motor skill learning by this experiment.

      Therefore, the specificity of the projections from the rhinal cortex to the motor cortex was further studied by chemogenetic manipulation. Inhibiting the activity of the projections suppressed the learning ability compared with two types of control manipulations, indicating the CCK projections from RC to the MC is critical for motor skill learning.

      Reviewer #2 (Public Review):

      This study aims to test whether and if so, how cholecystokinin (CCK) from the mice rhinal cortex influences neural activity in the motor cortex and motor learning behavior. While CCK has been previously shown to be involved in neural plasticity in other brain regions/behavioral contexts, this work is the first to demonstrate its relationship with motor cortical plasticity in the context of motor learning. The anatomical projection from the rhinal cortex to the motor cortex is also a novel and important finding and opens up new opportunities for studying the interactions between the limbic and motor systems. I think the results are convincing to support the claim that CCK and in particular CCK-expressing neurons in the rhinal cortex are critical for learning certain dexterous movements such as single pellet reaching. However, more work needs to be done, or at least the following concerns should be addressed, to support the hypothesis that it is specifically the projection from the rhinal cortex to the motor cortex that controls motor learning ability in mice.

      1)Because CCK is expressed in multiple brain regions, as the authors recognized, results from the CCK knock-out mice could be due to a global loss of neural plasticity. In comparison, the antagonist experiment is in my opinion the most convincing result to support the specific effect of CCK in the motor cortex. However, it is unclear to me whether the CCK knock-out mice exhibited an impaired ability to learn in general, i.e., not confined to motor skills. For instance, it would be very valuable to show whether these mice also had severe memory deficits; this would help the field to understand different or similar behavioral effects of CCK in the case of global vs. local loss of function. If the CCK knock-out mice only exhibited motor learning deficits, that would be surprising but also very interesting given previous studies on its effect in other brain areas.

      Thanks for your comments. According to the studies in our lab, we found that CCK is critical for the neural plasticity in the auditory cortex, hippocampus and the amygdala and CCK-/- mice performed much worse than wildtype mice in associative, spatial and fear memory (Li et al.,2014; Chen et al., 2019; Su et al. 2019; Feng et al. 2021).

      2) Related to my last point, I believe that normal neural plasticity should be essential to motor skill learning throughout development not just during the current task. Thus, it would be important to show whether these CCK knock-out mice present any motor deficits that could have resulted from a lack of CCK-mediated neural plasticity during development. If not, the authors should explain how this normal motor learning during development is consistent with their major hypothesis in this study (e.g., is CCK not critical for motor learning during early development).

      Thanks for your comments and suggestions.

      Development is mainly gene-guided which prepares the physical structure for learning, while learning is dependent on the neural plasticity and a period of experience (such as motor training in this research). Besides, development is deemed as "experience-expectant", using common environmental information, while learning is "experience-dependent", sensitive to the specific individual experiences (Greenough et al., 1987; Galván, 2010). Moreover, development costs longer time to form a specific ability of a species in general. The role of CCK plays in the development is not clear. Duchemin et al. (1987) studied the CCK gene expression level in the brain of rats pre- and postnatally. They found that the CCK mRNA was detectable on embryonic day 14 (E14) and gradually increased to the maximum level on postnatal day 14 (P14), indicating that CCK might participate in the development of rats. Paolo et al. (2007) mapped the expression of CCK in the mouse brain. Plentiful CCK expression was observed at E12.5 in the thalamus and spinal cord and by E17.5 CCK expression extended to the cortex, hippocampus and hypothalamus, suggesting that CCK might also regulate the development of mice. Paolo et al. (2004) found that CCK suppressed the migration of GnRH-1 through CCK-A receptor in the brain. Besides, postnatal early learning may participate in development. CCK-B receptor antagonist administration (postnatal 6 hours) suppressed the infant sheep get motor preference, indicating that CCK might be important for the development of mother preference of sheep. However, what the role CCK played in the development of motor system is not known.

      In this study, the performance of both CCK-/- and WT mice is at the same level without significant difference on Day one, in terms of the percentage of "miss", "no-grasp", "drop" and "success". Besides, the movement abilities, including stride length, stride time, step cycle ratio and grasp force, were comparable for both CCK-/- and WT mice (Figure S1C, S1D, S1E, S1F), suggesting that knockout of cck gene did not affect the basic movement ability. This could be because the development of basic movement ability is not learning-guided, but is physical structure-determined. However, all these tests were on physical level, but how CCK affected the motor system on the molecular and cellular level is not known. Therefore, we further applied CCK-BR antagonist and chemogenetic method to study the role of CCK in the motor learning.

      3)Lines 198-200 and Fig. 2C: The authors found that the vehicle group showed significantly increased "no grasp" behavior, and reasoned that the implantation of a cannula may have caused injuries to the motor cortex. In order to support their reasoning and make the control results more convincing, I think it would be helpful to show histology from both the antagonist and control groups and demonstrate motor cortical injury in some mice of the vehicle group but not the antagonist group. Otherwise, I'm a bit concerned that the methods used here could be a significant confounding factor contributing to motor deficits.

      Thanks for your comments and suggestions.

      The injury of the motor cortex can not be avoided, because the cannula was inserted below the surface of the cortex (Figure S2C). The significantly increased "no-grasp" rate is because the improvement of miss rate of the Vehicle group, which turned to "no-grasp" but failed to further improve to drop or success, while for the Antagonist group, there is no significant improving from "miss" to "no-grasp", leaving no change in the "no grasp".

      4) The authors showed that chemogenetic inhibition of CCK neurons in the rhinal cortex impaired motor skill learning in the pellet-reaching task. However, we know that the rhinal cortex projects to multiple brain regions besides the motor cortex (e.g., other cortical areas and the hippocampus). Thus, the conclusion/claim that the observed behavioral deficits resulted from inhibited rhinal-motor cortical projections is not strongly supported without more targeted loss-of-function or rescue experiments.

      It would also be very informative to the field to compare the specific behavioral deficits, if any, of inhibiting specific downstream targets of the rhinal CCK neurons. As a concrete example, the hippocampus may be involved in learning more sophisticated motor skills (as the authors pointed out in the Discussion) besides the motor cortex. It would be a critical result if the authors could either show or exclude the possibility that the motor learning deficits observed in CCK-/- mice were at least partially due to the inhibition of hippocampal plasticity. This echoes my earlier point (point 1) that it is unclear whether the effect of lacking CCK in knock-out mice is specific in the motor cortex or engages multiple brain regions.

      Lastly, because Fig. 4 only showed histology in the rhinal and motor cortices, I am not sure whether the motor cortex solely receives CCK input from the rhinal cortex. A more comprehensive viral tracing result could be important to both supporting the circuit-specificity of the observed behavior in this study and providing a clearer picture of where the motor cortex receives CCK inputs.

      Thanks for your comments.

      The specificity of the CCK-projection from the rhinal cortex to the motor cortex for motor skill learning was studies using chemogenetic methods in the revised version of the paper. We first determined that over 98% of neurons in the rhinal cortex that projected to the motor cortex are CCK positive (Figure 6A, S6A, S6B). Next, we injected the retro-Cre virus in the motor cortex and the Cre-dependent hM4Di in the rhinal cortex in C57BL/6 mice to specifically inhibit the CCK neurons from the rhinal cortex to the motor cortex. Compared to two control groups, the learning ability of the experimental group was significantly suppressed, suggesting that CCK projections from the rhinal cortex to the motor cortex are critical for motor skill learning (Figure 6). Detailed description was added in the part of "Result" in the manuscript.

      In this study, we focus on the role played by CCK from the rhinal cortex, and how CCK affects motor learning. The single pellet reaching task was selected to study the role of CCK from the rhinal cortex in motor skill learning and the motor cortex is considered as the main area generates motor memory when training in this task (Komiyama et al., 2010; Peters et al., 2014; Richard et al., 2019). We emphasized that the importance of the contrallateral motor cortex in motor learning, not meant that other brain areas where also receive CCK-positive neural projections from the rhina cortex, for example hippocampus (spatial memory), are not important for the performance of this task. In fact, specifically inhibiting the projection from the rhinal cortex to the contrallateral motor cortex is not enough to suppress the motor learning ability, but inhibiting projecting in both sides (contro- and ipsi-lateral) could suppress the learning ability of mice, suggesting that the whole motor cortex is critical for motor skill learning (Figure 6, S8). In our lab, we found that CCK projection from the entorhinal cortex to the hippocampus is critical for spatial memory formation (Su et al., 2019). Impaired hippocampus, to some extent, affected the performance in single pellet reaching task (Shwuhuey et al., 2007). Therefore, manipulation of CCK projections from the rhinal cortex to the hippocampus may also affect the performance in the single pellet reaching task. In this paper, we aim to study the relationship between the rhinal cortex and the motor cortex and the role played by CCK in this circuit. Other brain areas involved in the single pellet reaching task are not the core concern in this study.

      The motor cortex also receive CCK projections from other cortices, such as the contrallateral motor cortex, the deep layer of visual cortex and auditory cortex, and thalamus (Figure S4).

      5) I am glad to see the CCK4 rescue experiment to demonstrate the sufficiency of CCK in promoting motor learning. However, the rescue experiment lacked specificity: IP injection did not allow specific "gain of function" in the motor cortex but instead, the improved learning ability in CCK knock-out mice could be a result of a global effect of CCK4 across multiple brain regions. CCK4 injection specifically targeted at the motor cortex would be necessary to support the sufficiency of CCK-regulated neuroplasticity in the motor cortex to promote motor learning.

      Thanks for your comments.

      First, the specificity of the circuit were studied by injecting a Cre virus in the MC and a Cre-dependent hM4Di virus in the RC. After injection with clozapine, the motor learning ability were significantly suppressed compared with the saline control and the control virus combined with clozapine.

      Besides, we emphasized that the importance of the motor cortex in motor learning, not meant that other brain areas where also receive CCK-positive neuronal projections from the rhinal cortex, for example hippocampus (spatial memory), are not important for the performance of this task. Specific infusion the drug into the motor cortex is hard to rescue the motor learning ability of CCK-/- mice because the motor cortex is very large, varying from AP: -1.3 to 2.46 mm and ML: ±0.5 to ±2.75 mm and other areas receiving CCK projections from the rhinal cortex also could be important for motor learning. Actually, we tried to inject CCK into the motor cortex through a drug cannula, but the result showed that it is hard to compensate the knock out of cck gene in the whole brain, and rescue the motor learning ability (Figure S11D, S11E). Moreover, cannula implantation causes inescapable injury to the motor cortex, because the cannula must be inserted into the brain, so that the drug could be infused into the brain. This injury may affect the performance in the task, as the motor cortex is very critical for motor learning. Therefore, it is not the best method to be applied for motor skill rescuing.

      Furthermore, CCK4 molecules can be transported to the whole brain by i.p. injection, as CCK4 is capable to pass through brain blood barrier, which compensates the knockout of cck gene in the whole brain, leading to the rescuing of motor learning ability. Furthermore, i.p. injection is widely accepted for drug discovery because it is very convenient, simply manipulated and does not causes any direct injury on the brain. Thus, we applied i.p. injection not only for whole brain CCK compensation, but also for the further study of the application in drug discovery.

      Reviewer #3 (Public Review):

      The authors elucidated the roles of cholecystokinin (CCK)-expressing excitatory neurons, which project from the rhinal cortex to the motor cortex, in motor skill learning. The authors found CCK knock-out mice exhibited learning defects in the pellet reaching task while the baseline success rate of the knock-out mice was similar to that of the wild-type mice. Application of a CCK B receptor (CCKBR) antagonist into the motor cortex lowered the success rate in the motor task. The authors found the population activity which was observed in the in vivo calcium imaging during motor learning was elevated after motor learning, but this increase disappeared in CCK knock-out mice and animals with CCKBR antagonist administration. Anterograde and retrograde viral tracing revealed that CCK-expressing excitatory neurons in the rhinal cortex projected to the motor cortex. Chemogenetic inhibition of the CCK-expressing neurons in the rhinal cortex lowered the ability for motor learning. The application of a CCKBR agonist increased the motor learning ability of CCK knock-out animals as well as long-term potentiation (LTP) observed in the slice of the motor cortex.

      However, the manuscript contains several shortcomings:

      First, the "Discussion" has several statements that are only supported weakly by the results, for example, ll. 429-431, ll. 432-433, and ll. 447-448. In addition, most of the sentences in this section are not divided into subsections. The paragraphs should be composed in multiple subsections with appropriate subheadings, even though the initial section summarizing the results can lack a subheading.

      Thanks for your suggestions. The statements were revised and the discussion was divided into subsections.

      Second, it would be important that the authors showed which area(s) of the brain is affected by the CCKBR antagonist in the experiments described in ll. 166-206 and Fig. 2. The authors injected the drug into the motor cortex, but the chemical can spread to neighboring cortical areas (e.g. somatosensory cortex) or wider brain regions. If so, the blockade of the CCKBR in the brain areas other than the motor cortex could cause the defects of the motor task learning observed in these experiments. I think it is desirable that such a possibility should be excluded. Conversely, it is possible that the antagonist had an effect on a limited subarea of the motor cortex (e.g. only the primary motor cortex (M1)). In this case, the information about the field altered by the CCKBR blocker would be useful to interpret the results of the learning defects.

      Thanks for your comments and suggestions.

      The drug cannula was implanted in the motor cortex (coordinates: AP, 1.4 mm, ML, -/+1.6 mm, DV, 0.25 - 0.3 mm) contralateral to the dominant hand of the mice (Figure S2C). To totally inhibit CCKBR in the motor cortex, we injected over-dosage of antagonist into the motor cortex. Thus, we cannot totally exclude the possibility that some antagonist spread to the neighboring cortices. However, the fact is that the motor cortex is very large, varying from AP: -1.3 to 2.46 mm and ML: ±0.5 to ±2.75 mm. It is not easily to spread out of the motor cortex with high concentration.

      Third, the authors need to show bilateral data about their anterograde and retrograde tracking of CCK-expressing neurons in the rhinal cortex. In ll. 290-292, they described as follows: "Both anterograde and retrograde tracking results indicated that CCK-expressing neurons in the rhinal cortex projecting to the motor cortex were asymmetric, showing a preference for the ipsilateral hemisphere." However, they provided only unilateral data for the anterograde (Fig. 4B) and the retrograde (Fig. 4D) experiments.

      Thanks for your comments. Both anterograde and retrograde tracking data from bilateral hemisphere were added to the supplementary file (Figure S4).

      Fourth, unilateral (contralateral to the dominant forelimb) experiments are needed in the chemogenetic inhibition of the CCK neurons. In ll. 301-338 and Fig. 5, the authors inhibited the CCK -expressing neurons in both hemispheres by injecting the virus into both sides. However, the CCKBR antagonist injection into the motor cortex contralateral to the dominant forelimb caused defects in motor learning ability, as described in ll. 166-206. The authors also observed that the population neuronal activity in the motor cortex contralateral to the dominant forelimb changed in accordance with the improvement of the motor skill in ll. 208-269. Therefore, it may be the case that inhibition of CCK neurons only in the side contralateral to the dominant forelimb - not bilaterally, as the authors did - could cause the lowered ability of motor learning. Such unilateral inhibition can be carried out by unilateral injection of the virus. In relation to the point above, in the chemogenetic inhibition experiments, it would be important to show which neurons in which cortical area is inhibited. This could be done by examining the distributions of the mCherry-labeled somata in the rhinal cortex using histochemistry.

      Thanks for your comments and suggestions.

      The specific of the CCK-projection from the rhinal cortex to the motor cortex for motor skill learning was studied using chemogenetic methods in the revised version of the paper. We first determined that over 98% of neurons in the rhinal cortex that projected to the motor cortex are CCK positive by retrograde virus injection and immunostaining (Figure 6A, S6A, S6B). Next, we injected the retro-Cre virus in the motor cortex and the Cre-dependent hM4Di in the rhinal cortex in C57BL/6 mice to specifically inhibit the CCK neurons from the rhinal cortex to the motor cortex. Compared to two control groups, the learning ability of the experimental group was significant suppressed, suggesting that CCK projections from the rhinal cortex to the motor cortex are critical for motor skill learning (Figure 6). Furthermore, we also injected the retro-Cre virus into the single site of the motor cortex controlateral to the dominant forelimb together with Cre-dependent hM4Di virus in the rhinal cortex. The result showed that after injection of clozapine, the motor learning ability was not significantly suppressed, suggesting that the bilateral motor cortex is important for motor skill learning. This is consistent with the previous findings that the increased GluA1 expression were observed bilaterally in the motor cortex after training in the single pellet reaching task. Detailed description was added in the part of "Result" in the manuscript.

      Fifth, it would be valuable to further examine differences in task performance across sessions and groups. The paragraph in ll. 138-153 needs a comparison of the "miss" rates of CCK-/- animals between Day 1 vs. Day 6 (related to ll. 429- 431). This paragraph also needs comparisons of the "no-grasp" and "drop" rates of CCK-/- animals between Day 1 vs. Day 6 (related to ll. 432- 433). The paragraph in ll. 175-190 needs comparisons of success rates between Day 1 and Day 5/6 within the antagonist group (related to ll. 447-448).

      Thanks for your comments. The comparisons were made in the revised manuscript.

    1. Author Response

      Reviewer #1 (Public Review):

      This thorough study expands our understanding of BMP signaling, a conserved developmental pathway, involved in processes diverse such as body patterning and neurogenesis. The authors applied multiple, state-of-art strategies to the anthozoan Nematostella vectensis in order to first identify the direct BMP signaling targets - bound by the activated pSMAD1/5 protein - and then dissect the role of a novel pSMAD1/5 gradient modulator, zwim4-6. The list of target genes features multiple developmental regulators, many of which are bilaterally expressed, and which are notably shared between Drosophila and Xenopus. The analysis identified in particular zswim4-6 a novel nuclear modulator of the BMP pathway conserved also in vertebrates. A combination of both loss-of-function (injection of antisense morpholino oligonucleotide, CRISPR/Cas9 knockout, expression of dominant negative) and gain-of-function assays, and of transcriptome sequencing identified that zwim acts as a transcriptional repression of BMP signaling. Functional manipulation of zswim5 in zebrafish shows a conserved role in modulating BMP signaling in a vertebrate.

      The particular strength of the study lies in the careful and thorough analysis performed. This is solid developmental work, where one clear biological question is progressively dissected, with the most appropriate tools. The functional results are further validated by alternative approaches. Data is clearly presented and methods are detailed. I have a couple of comments.

      1) I was intrigued - as the authors - by the fact that the ChiP-Seq did not identify any known BMP ligand bound by pSMAD1/5. Are these genes found in the published ChiP-Seq data of the other species used for the comparative analysis? One hypothesis could be that there is a change in the regulatory interactions and that the initial set-up of the gradient requires indeed a feedback loop, which is then turned off at later gastrula. In this case, immunoprecipitation at early gastrula, prior to the set-up of the pSMAD1/5 gradient, could reveal a different scenario. Alternately, the regulation could be indirect, for example, through RGM, an additional regulator of BMP signaling expressed on the side of lower BMP activity, which is among the targets of the ChiP-Seq. This aspect could be discussed. Additionally, even if this is perhaps outside the scope of this study, I think it would be informative to further assess the effect of ZSWIM manipulation on RGM (and vice versa).

      Indeed, BMP genes are direct BMP signaling targets in Drosophila (dpp) (Deignan et al., 2016, https://doi.org/10.1371/journal.pgen.1006164) and frog (bmp2, bmp4, bmp5, bmp7) (Stevens et al., 2021, https://doi.org/10.1242/dev.145789). Of all these ligands, only the dorsally expressed Xenopus bmp2 is repressed by BMP signaling, while another dorsally expressed Xenopus BMP gene admp is not among the direct targets. All other BMP genes listed here are expressed in the pMad/pSMAD1/5/8-positive domain and are activated by BMP signaling.

      In Nematostella, we do not find BMP genes among the ChIP-Seq targets, but this is not that surprising considering the dynamics of the bmp2/4, bmp5-8 and chordin expression, as well as the location of the pSMAD1/5-positive cells. In late gastrulae/early planulae, Chordin appears to be shuttling BMP2/4 and BMP5-8 away from their production source and over to the gdf5-like side of the directive axis (Genikhovich et al., 2015; Leclere and Rentsch, 2014). By 4 dpf, chordin expression stops, and BMP2/4 and BMP5-8 start to be both expressed AND signal in the mesenteries. If bmp2/4 and bmp5-8 expression were directly suppressed by pSMAD1/5 (as is the case chordin or rgm expression), this mesenterial expression would not be possible. Therefore, in our opinion, it is most likely that at late gastrula and early planula the regulation of bmp2/4 and bmp5-8 expression by BMP signaling is indirect. We do not have an explanation for why gdf5-like (another BMP gene expressed on the “high pSMAD1/5” side) is not retrieved as a direct BMP target in our ChIP data. Since we do not understand well enough how BMP gene expression is regulated, we do not discuss this at length in the manuscript.

      As the Reviewer suggested, we analyzed the effect of ZSWIM4-6 KD on the expression of rgm. Expectedly, since it is expressed on the “low BMP side”, its expression was strongly expanded (Figure 6 - Figure Supplement 4)

      2) I do not fully understand the rationale behind the choice of performing the comparative assays in zebrafish: as the conservation was initially identified in Xenopus, I would have expected the experiment to be performed in frog. Furthermore, reading the phylogeny (Figure 4A), it is not obvious to me why ZSWIM5 was chosen for the assay (over the other paralog ZSWIM6). Could the Authors comment on this experiment further?

      The comparison was done in zebrafish because we were planning to generate zswim5 mutants, whose analysis is currently in progress. ZSWIM6 is not expressed at the developmental stages we were interested in, while ZSWIM5 was, based on available zebrafish expression data (White et al., 2017):

      Reviewer #2 (Public Review):

      The authors provide a nice resource of putative direct BMP target genes in Nematostella vectensis by performing ChIP-seq with an anti-pSmad1/5 antibody, while also performing bulk RNA-seq with BMP2/4 or GDF5 knockdown embryos. Genes that exhibit pSmad1/5 binding and have changes in transcription levels after BMP signaling loss were further annotated to identify those with conserved BMP response elements (BREs). Further characterization of one of the direct BMP target genes (zswim4-6) was performed by examining how expression changed following BMP receptor or ligand loss of function, as well as how loss or gain of function of zswim4-6 affected development and BMP signaling. The authors concluded that zswim4-6 modulates BMP signaling activity and likely acts as a pSMAD1/5 dependent co-repressor. However, the mechanism by which zswim4-6 affects the BMP gradient or interacts with pSMAD1/5 to repress target genes is not clear. The authors test the activity of a zswim4-6 homologue in zebrafish (zswim5) by over-expressing mRNA and find that pSMAD1/5/9 labeling is reduced and that embryos have a phenotype suggesting loss of BMP signaling, and conclude that zswim4-6 is a conserved regulator of BMP signaling. This conclusion needs further support to confirm BMP loss of function phenotypes in zswim5 over-expression embryos.

      Major comments

      1) The BMP direct target comparison was performed between Nematostella, Drosophila, and Xenopus, but not with existing data from zebrafish (Greenfeld 2021, Plos Biol). Given the functional analysis with zebrafish later in the paper it would be nice to see if there are conserved direct target genes in zebrafish, and in particular, is zswim5 (or other zswim genes) are direct targets. Since conservation of zswim4-6 as a direct BMP target between Nematostella and Xenopus seemed to be part of the rationale for further functional analysis, it would also be nice to know if this is a conserved target in zebrafish.

      Thank you for the suggestion. In the paper by Greenfeld et al., 2021, zebrafish zswim5 was downregulated approximately 2.4x in the bmp7 mutant at 6 hpf, while zswim6 was barely expressed and not affected at this stage. We added this information to the text of the manuscript. Expression of several other zebrafish zswim genes was also affected in the bmp7 mutant, but these genes do not appear relevant for our study since their corresponding orthologs are not identified as pSMAD1/5 ChIP-Seq targets in Nematostella. Notably, zebrafish zzswim5 is not clearly differentially expressed in BMP or Chd overexpression conditions (See Supplementary file 1 in Rogers et al. 2020). Importantly, in the paper, we wanted to compare ChiP-Seq data with ChIP-Seq data, however, unfortunately, no ChIP-Seq data for pSMAD1/5/8 is currently available for zebrafish, thus precluding comparisons.

      Related to this, in the discussion it is mentioned that zswim4/6 is also a direct BMP target in mouse hair follicle cells, but it wasn't obvious from looking at the supplemental data in that paper where this was drawn from.

      Please see Supplementary Table 1, second Excel sheet labeled “Mx ChIP_Seq” in Genander et al., 2014, https://doi.org/10.1016/j.stem.2014.09.009. Zswim4 has a single pSMAD1 peak associated with it, Zswim6 has two.

      2) The loss of zswim4-6 function via MO injection results in changes to pSmad1/5 staining, including a reduction in intensity in the endoderm and gain of intensity in the ectoderm, while over-expression results in a loss of intensity in the ectoderm and no apparent change in the endoderm. While this is interesting, it is not clear how zswim4-6 is functioning to modify BMP signaling, and how this might explain differential effects in ectoderm vs. endoderm. Is the assumption that the mechanism involves repression of chordin? And if so one could test the double knockdown of zswim4-6 and chordin and look for the rescue of pSad1/5 levels or morphological phenotype.

      We do not think that the mechanism of the ZSWIM4-6 action is via repression of Chordin. As loss of chordin leads to the loss of pSMAD1/5 in Nematostella (Genikhovich et al., 2015), the proposed experiment is, unfortunately, not feasible to test this hypothesis. Currently, we see two distinct effects of the modulation of zswim4-6 expression. First, it affects the pSMAD1/5 gradient, possibly by destabilizing nuclear SMAD1/5, as has been proposed by Wang et al., 2022 for the vertebrate Zswim4. This is in line with our results shown on Fig. 6C-F’ and Fig. 6-Figure supplement 3. In our opinion, the reaction of the genes expressed on the “high BMP” side of the directive axis to the overexpression or KD of ZSWIM4-6 (Fig. 6I-K’, 6N-P’) can be explained by these changes in the pSMAD1/5 signaling intensity. Secondly, zswim4-6 appears to promote pSMAD1/5-mediated gene repression. This is in line with the reaction of the genes expressed on the “low BMP” side of the directive axis (Fig. 6G-H’, 6L-M’, Fig. 6-Figure Supplement 4). These genes are repressed by BMP signaling, but they expand their expression upon zswim4-6 KD in spite of the increased pSMAD1/5. Our ChiP experiment (Fig. 6Q) supports this view.

      3) Several experiments are done to determine how zswim4-6 expression responds to the loss of function of different BMP ligands and receptors, with the conclusion being that swim4-6 is a BMP2/4 target but not a GDF5 target, with a lot of the discussion dedicated to this as well. However, the authors show a binary response to the loss of BMP2/4 function, where zswim4-6 is expressed normally until pSmad1/5 levels drop low enough, at which point expression is lost. Since the authors also show that GDF5 morphants do not have as strong a reduction in pSmad1/5 levels compared to BMP2/4 morphants, perhaps GDF5 plays a positive but redundant role in swim4-6 expression. To test this possibility the authors could inject suboptimal doses of BMP2/4 MO with GDF5 MO and look for synergy in the loss of zswim4-6 expression.

      Thanks for this great suggestion! We performed this experiment (Fig. 5H’’-L) and indeed, a suboptimal dose of BMP2/4MO + GDF5lMO results in a complete radialization of the embryo and abolished zswim4–6, similar to the effect of a high dose of BMP2/4. This result suggests that rather than being a ligand-specific signaling function, GDF5-like signaling alone still provides sufficiently high pSmad1/5 levels to activate zswim4-6 expression to apparent wildtype levels, demonstrating the sensitivity of this gene to even very low amounts of BMP signaling.

      4) The zswim4-6 morphant embryos show increased expression of zswim4-6 mRNA, which is said to indicate that zswim4-6 negatively regulates its own expression. However in zebrafish translation blocking MOs can sometimes stabilize target transcripts, causing an artifact that can be mistakenly assumed to be increased transcription (https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7162184/). Some additional controls here would be warranted for making this conclusion.

      Thanks for raising this important experimental consideration. To-date, we do not have any evidence for MO-mediated transcript stabilization in Nematostella, and we have not found such data in the literature on models other than zebrafish. mRNA stabilization by the MO also seemed unlikely because we were unable to KD zswim4-6 using several independent shRNAs - an effect we frequently observe with genes, whose activity negatively regulates their own expression. However, to test the possibility that zswim4-6MO binding stabilizes zswim4-6 mRNA, we injected mRNA containing the zswim4-6MO recognition sequence followed by the mCherry coding sequence (zswim4-6MO-mCherrry) with either zswim4-6MO or control MO. We could clearly detect mCherry fluorescence at 1 dpf if control MO was co-injected with the mRNA, but not if zswim4-6MO was coninjected with the mRNA. At 2 dpf (the stage at which we showed upregulation of zswim4-6 upon zswim4-6MO injection on Fig. 6I-I’), zswim4-6MO-mCherrry mRNA was undetectable by in situ hybridization with our standard FITC-labeled mCherry probe independent of whether zswim4-6MO-mCherrry mRNA was co-injected with the control MO or ZSWIM4-6MO, while hybridization with the FITC-labeled FoxA probe worked perfectly.

      Author response image 1.

      We are currently offering two alternative hypothesis for the observed increase in zswim4-6 levels in the paper rather than stating explicitly that ZSWIM4-6 negatively regulates its own expression: “The KD of zswim4-6 translation resulted in a strong upregulation of zswim4-6 transcription, especially in the ectoderm, suggesting that ZSWIM4-6 might either act as its own transcriptional repressor or that zswim4-6 transcription reacts to the increased ectodermal pSMAD1/5 (Fig. 6I-I’).” Given the sensitivity of zswim4-6 to even the weakest pSMAD1/5 signal (zswim4/6 is expressed upon GDF5-like KD, which drastically reduces pSMAD1/5 signaling intensity (see Fig. 1 and 2 in Genikhovich et al., 2015, http://doi.org/10.1016/j.celrep.2015.02.035 and Fig. 6-Figure supplement 3 of this paper), the latter option (that it reacts to the increased ectodermal pSMAD1/5) is, in our opinion, clearly the more probable one.

      5) Zswim4-6 is proposed to be a co-repressor of pSmad1/5 targets based on the occupancy of zswim4-6 at the chordin BRE (which is normally repressed by BMP signaling) and lack of occupancy at the gremlin BRE (normally activated by BMP signaling). This is a promising preliminary result but is based only on the analysis of two genes. Since the authors identified BREs in other direct target genes, examining more genes would better support the model.

      We suggest that ZSWIM4-6 may be a co-repressor of pSMAD1/5 targets because it is a nuclear protein (Fig. 4G), whose knockdown results in the expansion of the ectodermal expression of several genes repressed by pSMAD1/5 in spite of the expansion of pSMAD1/5 itself (Fig. 6G-H’, 6L-M’, Fig. 6-Figure Supplement 4). Our limited ChIP analysis supports this idea by showing that ZSWIM4-6 is bound to the pSMAD1/5 site of chordin (repressed by pSMAD1/5) but not on gremlin (activated by pSMAD1/5). We agree that adding the analysis of more targets in order to challenge our hypothesis would be good. However, given technical limitations (having to inject many thousands of eggs with the EF1a::ZSWIM4-6-GFP plasmid in order to get enough nuclei to extract sufficient immunoprecipitated chromatin for qPCR on 3 genes (chordin, gremlin, GAPDH) for each biological replicate, it is currently unfortunately not feasible to test more genes. It will be of great interest for follow up studies to generate a knock-in line with tagged zswim4-6 to analyze target binding on a genome-wide scale. We stress in the discussion that currently the power of our conclusion is low.

      6) The rationale for further examination of zswim4-6 function in Nematostella was based in part on it being a conserved direct BMP target in Nematostella and Xenopus. The analysis of zebrafish zswim5 function however does not examine whether zswim5 is a BMP target gene (direct or indirect). BMP inhibition followed by an in situ hybridization for zswim5 would establish whether its expression is activated downstream of BMP.

      In the paper by Greenfeld et al., 2021, zebrafish zswim5 was downregulated approximately 2.4x in the bmp7 mutant at 6 hpf. However, this gene was not among the 57 genes, which were considered to be direct BMP targets because their expression was affected by bmp7 mRNA injection into cycloheximide-treated bmp7 mutants (Greenfeld et al., 2021). We added this information to the text of the manuscript.

      7) Although there is a reduction in pSmad1/5/9 staining in zebrafish injected with zswim5 mRNA, it is difficult to tell whether the resulting morphological phenotypes closely resemble zebrafish with BMP pathway mutations (such as bmp2b). More analysis is warranted here to determine whether stereotypical BMP loss of function phenotypes are observed, such as dorsalization of the mesoderm and loss of ventral tail fin.

      We agree, and we have tuned down all zebrafish arguments. Analyses of zswim5 mutants are currently ongoing.

    1. Author Response

      Reviewer #1 (Public Review):

      Strengths:

      The study addresses an intriguing research question that fills a gap in existing literature, and was carefully designed and well-executed, with a series of experiments and control experiments.

      We thank the reviewer for the positive statement about the conception and execution of the study as well as the potential interest to the community within a broader field.

      Weaknesses:

      1) My main concern is the null effect of precision estimation pattern between cued and un-cued trials. It is well established that relative to the un-cued stimuli, the cued stimuli obtain more attentional resource and this study claimed serial attentional resource allocation during parallel feature value tracking. However, all Experiments 3a-c did not find any difference in precision estimates between these two types of trials.

      We would like to annotate that the terminology „cued versus uncured trials“ in the usual sense of distinguishing between stimuli being attended versus unattended is admittedly somewhat misleading in the current work. In cued and uncured trials of the present experiments 3a-c the allocation of attention is equal. The difference is that the color stream that is attended first is defined (knowable) in the cued but not in the uncued trials. In all cases subjects had to track both color streams and report any of the probed streams as accurately as possible. In other words, the overall allocation of attention in cued and uncured trials is the same. Also, the „cue“ did not provide any information regarding the following probe (no indication of likelihood for a probe in that stream as in an attention experiment). It was entirely irrelevant and was therefore expected not to alter subjects overall performance – as confirmed by the mentioned null-result. The performed test shows, that the reported bias of ~2:1 does not depend on whether in one set of the trials one stream is cued or not. The sole purpose of the “cue” was to subconsciously redirect attention briefly towards that particular stream at the start of each trial in order to ‘phase-reset’ any process, switching/oscillating feature-based resources over time. Performance imbalance across streams is hereby not altered by this phase-reset but remains constant since precision ratio is estimated across a large number of trials and durations. To clarify this issue, we rephrased relevant descriptions in the methods section.

      2) Results of Exp.1 in the main text were different from those in Figure.

      Thank you for spotting that error. We have corrected the figure accordingly.

      3) It would be helpful to add more details for the assignation of response 1 and response 2 to target 1 and target 2, respectively, in all experiments.

      For Experiment 2 and 3 only one response per trial was required by the subjects. This design was chosen to avoid potentially ambiguous response-target assignments.

      However in the first experiment, as the reviewer points out, subjects gave two color estimates (one for each of the tracked color streams) within each trial. Given that we intend to split subjects’ target-response differences (precisions) into two distributions (based on the idea that each stream is being maintained by an independent attentional resource), there are two possible ways of assigning responses:

      (1) We split responses into a best and worst independent of which response was given first.

      (2) Alternatively, we assign target-response pairs based on the order of response. The assumption would be, that the first response would be the one with the highest confidence and would be paired with the target closest. This pairing would occur independent of the second response, which is consequently paired with the remaining target. This leaves open the possibility of the second target-response difference being better than the first one due to resource fluctuations. In general, this strategy would be less ‘rigid’ in dividing the two precision-responses into ‘good’ and ‘bad’ responses and was consequently chosen.

      To avoid problems arising from the ambiguity of target-response assignments, in all following experiments (2/3), subjects were required to give one response per trial only. We will go into further detail on this issue with reviewer 3 as well, including a numerical example. The logic behind the target-response assignments in experiment 1 has been described in more detail in the methods.

      Reviewer #2 (Publlic Review):

      The authors asked the question about whether and how changing feature values within the same feature dimensions are tracked. Using a series of behavioral studies combined with modeling approaches, the authors report interesting results regarding a robust, uneven distribution of attentional resources between two changing feature values (in a 2:1 ratio), alternating at 1 Hz. Although the results are clear, it is important to rule out the possible biases due to computational processes. The results advanced our understanding of how parallel tracking of multiple feature values within the same dimension is achieved.

      We thank the reviewer for the summary, including the potential impact on the field and we look forward to clarify methodological imprecisions.

      Reviewer #3 (Public Review):

      The study is interesting and the results are informative in how well people can report colors of two superimposed dot clouds. It reveals that there are trade-offs between reporting two colors. However, I have a few basic but major concerns with the present study and its conclusions about people's abilities to continuously track color values and the rate at which attention may be allocated across the two streams which I am outlining below.

      We thank the reviewer for the positive description of our findings and look forward to address any remaining issues.

      1) The first concern regards the task that was used to measure continuous tracking of feature values, which in my view is ambiguous in whether it truly assesses active tracking of features or rather short-term memory of the last-seen colors. Specifically, participants were viewing two colored dot clouds that then turned gray, and were asked to report each of the colors they saw using continuous report. The test usually occurred after 6-8s (in Exp. 1 &2), so while not completely predictable, participants could easily perform the task without tracking both feature streams continuously and simply perform the color report based on the very last colors they saw. In other words, it does not seem necessary to know which color belonged to which stream, or what color it was before, to perform the task successfully. Thus, it is unclear to what extent this task is actually measuring active tracking, the same way tracking of spatial locations in multiple-object tracking tasks has been studied, which is the literature that the authors are trying to draw parallels to. In multiple-object tracking tasks, targets and nontarget objects look identical and so to keep track of which of the moving objects are targets, participants need to attend to them actively and selectively. (Similarly, the original feature-tracking study by Blaser et al., at least in their main experiment, people were asked to track an object superimposed on a second object which required continuous and selective tracking of that object).

      The reviewer addresses a very fundamental point regarding ‘tracking’ in general: Does tracking rely on attentional processes or mere perception.

      The reviewer posits that subjects may simply ‘report based on the very last color they saw’ without the need to track both features streams continuously. Our argument supported by a broad literature on change blindness, inattentional blindness and related phenomena (c.f. Rensink, 2000) is, that one cannot consciously report a changing feature-value without continuously attending to it, in particular when it moves around randomly in feature space. The report of a feature value at a random unpredictable time t by ‘identifying it’ includes its attentive processing immediately before t. Since the time of the probing identification is random, it must continue throughout the trial. We do also rule out any strategy in which subjects only start tracking after some time (the probe appears between 6-8sec after trial onset) since such a strategy would involve processes of temporal attention as well and increase difficulty.

      Lastly, the reviewer refers to Blaser et al. as an example in which attentive tracking would be required, since ‘an object [is] superimposed on a second object’. We do absolutely agree. However, the same design principle applies in the current experiment: Two objects with separate values in feature space, that continuously change, are superimposed, that is, spatially inseparable. We do believe that the continuous movement of the feature values through color space separates this work from previous feature-tracking studies like Re et al., in which the presented features remained static. The latter work gives rise to alternate explanations in terms of working memory (mentioned in the next point of the reviewer). Once feature values keep changing and are relevant, a process of updating their internal representations in order to grant access is required (i.e. attention).

      2) The main claim that tracking two colors relies on a shared and strictly limited resource is primarily based on the relation between the two responses people give, such that the first response about one color tends to be higher accuracy than for the second response of the other color across participants. In my view, this is a relatively weak version of looking at trade-offs in resources, and it would have been more compelling to show such trade-offs at a single-trial level, or assess them with well-established methods that have been developed to look at attentional bottlenecks such as attention-operating characteristics that allow quantifying the cost of adding an additional task in a precise and much more direct manner.

      The reviewer suggests showing trade-offs at a single trial level within subject, which is in essence what we have done in experiment 1. Testing both streams simultaneously, however, has the drawback of introducing interference effects during the report (Reporting the first stream may degrade the precision of reporting the second stream) as well as the mentioned ambiguity between targets and responses. The second and third experiment circumvent this by probing only one color stream, as to analyze the data with a minimal set of assumptions. As the dependent measure of ‘precision’ fluctuates highly across trials, we have to estimate an overall tracking resource by creating a ‘precision’ distribution across many trials.

      3) Finally, the data of the last experiment is taken as evidence that feature-based selection oscillates at 1Hz between the two streams. This is based on response errors changing across time points with respect to an exogenous cue that is thought to "reset" attentional allocation to one stream. Only one of three data sets (which uses relatively sparse temporal sampling) shows a significant interaction between cue and time, and given that there was no a priori prediction of when such interaction should occur, this result begs for a replication to ensure that this is not a false positive result. Furthermore, based on the analyses done in the paper, it may very well be the case that the presumed "switching rate" is entirely non-oscillatory based on a recent very important paper by Geoffrey Brookshire (2022, Nature Human Behavior) that demonstrates that frequency analysis are not just sensitive to periodic but also aperiodic temporal structures. The paper also has a series of suggested analyses that could be used here to further test the current conclusions.

      The reviewer is absolutely correct in doubting the oscillatory nature of the results in Exp3. Importantly, in our discussion we do not claim that a regular periodicity of the attentional process maintains both color streams. In contrast, we stress the point of ‘one-feature at a time’, indicating a constraint that entails alternation between two representations. We do not presume any sort of regularity of this process but, instead, consider the switching being determined by the recurrent processing of tuning towards one of the two relevant values. Our interpretation is therefore largely in line with Brookshires criticism of previous attentional oscillation studies. In fact, we entirely share the doubtful interpretation of attentional oscillations that transfer mathematical modelling onto functional processes. In our study we use the tool of Fourier transformation in a mere methodological manner, in order to quantify alternations between our color streams but not to imply an underlying oscillatory process. We cannot draw conclusions about underlying attentional oscillations especially since we quantify the alternation/switch only across one full and one half period, in exp3a and exp3b respectively.

      We make the distinction between oscillations as a methodological tool and functional cognitive process more clear in the paper.

    1. Author Response

      eLife Assessment:

      The fluorescently tagged SYT-1 mouse line will be useful for the field. Importantly, the authors used a comprehensive set of immunohistochemical and physiological experiments to demonstrate that the fluorescence tagging did not alter the function of SYT-1. These are important control experiments that will make the strain useful for physiological experiments in the future. However, the advance of this manuscript is less clear.

      We thank the editor for raising this point. In the revised manuscript, we performed additonal experiments including testing the expression level of Syt1-TDT and testing the co-labeling of Syt1-TDT with synaptic marker in situ. We also dicussed the advantage of our model compared with the existed ones in line 285 to 300 in the section of discusion. Briefly, we conclude the advance of our models as follows: First, the Syt1-TDT could label synapse in situ, especially in glomerular layer of olfactory bulb (compared with B6SJL-Tg(Thy1-Syt1/ECFP)1Sud/J (Han et al. 2005)). Second, we provided a potential usage of our model in the study of electrophysiological recording and imaging in vivo, as the electrophyiological properties of neurons from Syt1-TDT mice are normal (not be analyzed in B6.Cg-Tg(Thy1-YFP/Syp)10Jrs/J and B6;CBA-Tg(Thy1-spH)21Vnmu/J (Umemori et al. 2004; Li et al. 2005)), which might be result from the relative low expression of Syt1-TDT compared with the native Syt1. Third, the neurons from the transgenic mice can be used in ASF screening by skiping the procedure of immunostaining. It will save the cost of time, reagents and work.

      Reviewer #1 (Public Review):

      In this manuscript, Zhang and colleagues created a transgenic mouse strain that expresses SYT-1-tdt in all neurons. They showed that the labelled SYT-1 colocalizes with multiple synaptic markers and label synapses in different regions. More importantly, they showed that the transgenic expression does not alter synaptic function using ephys assays. This is a straightforward paper that generated a useful reagent that will be used broadly.

      We are grateful for the reviewer’s positive comments.

      Reviewer #2 (Public Review):

      Yang et al. produced a transgenic mouse line (Syt1-TDT) that could be used for labeling both excitatory and inhibitory synaptic sites in cultured neurons and in vivo neurons. The strength of the current study is to provide a series of thorough analyses to claim the applicability of this mouse line in the relevant neuroscience research field(s). The weakness is the potential impact/usefulness of this mouse line. To strengthen the merit of this mouse line, the authors should present evidence showing its advantage over other similar genetic approaches.

      We thank the reviewer for raising this point. To strengthen the merit of this mouse line, we tested the application of Syt1-TDT in labeling synapse in situ. We found that the Syt1-TDT is highly overlapped with synapsin in the brain slice, especially in hippocampus, cerebellum and olfactory bulb, which suggest a potential usage of our model in imaging synapse in vivo. We also compared our transgenic model with the existed ones in line 285 to 300 in the section of discussion in the revised manuscript:

      “Several fluorescently tagged synaptic protein transgenic mice model, such as YFP tagged synaptophysin and pHluorin tagged synaptobrevin have been developed to label synapses [49, 50]. While these models can label synapse well, it lacks the functional analysis of neurotransmitter release in the overexpressed neurons as synaptophysin and synaptobrevin were reported to play a role in regulating neurotransmitter release. Considering the overexpression of synaptobrevin or synaptophysin were reported to promote neurite elongation or enhance neurotransmitter secretion, the synaptic organization and synaptic transmission might be changed in these models. Weiping Han et al. in their previous work [47] have generated transgenic mice expressing a Syt1-ECFP fusion protein. The Syt1-ECFP mice expressed the fluorescent protein ECFP in the cortex, midbrain, and cerebellum. However, the expression pattern in their model showed some difference with ours: In the olfactory bulb, the Syt1-TDT signals were highly enriched in glomerular layer in our model, which was not observed in the previously reported Syt1-ECFP transgenic mice [47]. It suggested a potential application of our model in labeling synapse in glomerular layer of olfactory bulb compared with Syt1-ECFP transgenic mice.”

      Reviewer #3 (Public Review):

      Yang and colleagues provide a thorough characterization of a transgenic mouse model expressing fluorescently tagged synaptotagmin. In particular, they present key controls validating this mouse model as a tool, including co-localization of the tagged synaptotagmin with other synaptic markers as well as normalcy of synaptic transmission mediated by synaptic terminals expressing the tagged synaptotagmin. Importantly, the authors present data on the potential use of neuronal cultures obtained from these mice in synaptic co-culture assays. In these assays, synaptic cell adhesion molecules expressed on non-neuronal cell lines such as HEK-293 cells or COS cells are used to test the sufficiency of these molecules to trigger synapse assembly. This mouse model will be a useful addition to existing models expressing fluorescently-tagged synaptic vesicle proteins such as synaptophysin, synaptotagmin as well as synaptobrevin.

      We are grateful for the reviewer’s positive comments.

    1. Author Response

      Reviewer #1 (Public Review):

      Bakoyiannis et al. investigated the distinct contribution of ventral hippocampal outputs to the nucleus accumbens and medial prefrontal cortex on memory in mice exposed to a high-fat diet (HFD) beginning in adolescence. The authors first characterize the hippocampal to accumbens or mPFC circuits using intersectional viral approaches. They then replicate their previous finding that adolescent HFD contributes to the overactivation of the ventral hippocampus during contextual learning via quantification of c-fos+ cells. In this manuscript, the authors further explore the distinct contribution of these two outputs from the ventral hippocampus using chemogenetics to specifically inhibit one circuit or the other. Interestingly, the authors find that inhibition of either circuit returns c-fos+ cell number to control levels, but the effects on memory are dissociable. They demonstrate that inhibition of output to the NAc rescues HFD-induced deficits on object recognition, while inhibition of mPFC outputs rescues HFD-induced deficits on object location recall. The authors further confirmed that chemogenetic manipulations resulted in alterations in c-fos+ cells that were specific to CA1, and not CA3 or DG. Behaviorally, they excluded any contribution of anxiety on recall, finding no effect on the elevated plus maze.

      The strengths of this manuscript include robust behavioral findings that can be attributed to specific circuits. The conclusions of this paper are largely well supported by the data, although some of the methods could provide more detail and the statistical approaches used for analysis need improvement.

      We thank the Reviewer for thoroughly summarizing the main results of the study and for providing the comments that we address below.

      Reliance on only one measure of anxiety to exclude this as a confound on recall performance is a weakness of the manuscript. To be more convincing that anxiety is not a confound, more than one behavioral assay should be performed.

      Reviewer #2 (Public Review):

      Bakoyiannis et al. aim to analyze the impact of high-fat diet (HFD) intake during the preadolescent period on memory performances by optogenetically manipulating the circuits responsible for related memory performances. In previous work, they showed the possibility to rescue object-based memory impairments in HFD-exposed animals by silencing the ventral hippocampus (vHPC). Here they investigated further the projections to the nucleus accumbens (NAc) and medial prefrontal cortex (mPFC), 2 of the main monosynaptic targets of the vHPC.

      They used a precise strategy to target and manipulate only vHPC cells that project to either NAc or mPFC. They found that preadolescent HFD can induce different types of memory deficits related to different vHPC pathways. In particular, they found that silencing vHPC-NAc, but not vHPC-mPFC, pathway restored HFD-induced object recognition memory deficit. On the other side, silencing vHPC to mPFC, but not vHPC-NAc, pathway rescued HFD-induced object location memory deficits. Moreover, these pathways do not control anxiety-like behaviours since their inactivation has no effect on anxiety levels.

      We thank the Reviewer for summarizing the findings of the study and for their positive comments on our manuscript.

      The conclusions of the manuscript are mostly supported by the results, but there are some points and controls that need to be addressed and clarified:

      • While identifying the relevance of hippocampal cells projecting to NAc and mPFC, a missing control is to verify the activity of vHPC not projecting to these 2 regions in normal conditions or when the investigated pathways are manipulated. This control is essential to refine and bring novel results related to their previous discovery that vHPC overall is involved in the process.

      • A downstream effect of their optogenetic manipulation on NAc and mPFC cellular populations should be shown if they want to claim that their chemogenetic inhibition decrease the activation of the pathway and not only of vHPC projecting neurons.

      New c-Fos experiments were performed. Please see our response to points 4-5-6 in the “Essential Revision” section.

      Reviewer #3 (Public Review):

      "Obesogenic diet induces circuit-specific memory deficits in mice" by Bakoyiannis et al., investigates the role of specific ventral hippocampal circuits (specifically to nucleus accumbens and mPFC) in high-fat diet-induced memory deficits. The authors had previously shown that increases in activity in the ventral hippocampus accompany high-fat diet-induced memory deficits, and that inhibition of activity thereby normalizes those memory deficits. In this manuscript, the authors extend these findings to specific projections, showing that they normalize different types of memories by inhibiting the two different pathways.

      The strengths of the paper include the pathway-specific manipulations that reveal a difference between the two types of memory. The results are a modest step forward for the field of feeding and learning and memory and would be of interest to that subgroup of neuroscientists. However, the paper also has a number of weaknesses which I detail below.

      We thank the Reviewer for summarizing the finding of our study and for the positive feedback.

      1) First, the authors show an effect of cfos from both pathways in Figure 2 on object learning. However, the inactivation studies show a pathway-specific effect on object recognition and object location, with no experiments to delineate how this divergence occurs. The authors do not specify whether they compared cfos in the control group between NAc and mPFC projections (presumably they did some controls with each injection), which might reveal differences.

      We have added new groups and presented/analyzed the results for each pathway (either vHPC-NAc pathway or vHPC-mPFC pathway) separately for c-Fos (new Figure 2 and Figure 2-Figure Supplement 1) or behaviours (new Figure 3 and Figure 3-Figure Supplement 1). Please see our responses to points 2, 4-5-6 and 9 in the “Essential Revision” section.

      2) Related to this, it is unclear how the pathways end up diverging for memory if they do not show any differences in cfos during training. Perhaps there are pathway-specific differences in cfos following the ORM and OLM tests? It is difficult to support the claim that there are pathway differences in memory following inactivation if we do not see any pathway-specific change in activity.

      We thank the Reviewer for this comment. Please see our answer to point 7 in the “Essential Revision” section above.

      3) Figure 2 and Figure 3 are also hard to interpret because of the usage of a 1-way ANOVA which is not the appropriate statistical test when there are two independent variables (HFD and DREADD manipulation). Indeed, noticing the statistical test also reveals that a critical control missing: HFD -, hM4di+CNO +. It is possible that inactivation simply brings down cfos levels regardless of diet. While this might benefit memory in the case of HFD, it is critical to know whether the manipulation is specific to the overactivation caused by HFD or just provides a general decrease in activity.

      Based on this comment we added new HFD-hM4di+CNO+ groups and modified statistical analyses accordingly. Indeed, inactivation of each pathway (vHPC-NAc or vHPC-mPFC) decreases c-Fos in both HFD+ and HFD- (CD+) groups (new Figure 2) whereas it has opposite effect on behaviors, improving memory performance in HFD+ groups but impairing or having no effect in HFD- (CD+) groups (new Figure 3). We have corrected this in the manuscript (please see our responses to points 2 and 9 of “Essential Revision” section).

    1. Author Response

      The following is the authors’ response to the original reviews.

      eLife assessment

      This paper reports the fundamental discovery of adrenergic modulation of spontaneous firing through the inhibition of the Na+ leak channel NALCN in cartwheel cells in the dorsal cochlear nucleus. This study provides unequivocal evidence that the activation of alpha-2 adrenergic or GABA-B receptors inhibit NALCN currents to reduce neuronal excitability. The evidence supporting the conclusions is compelling, the electrophysiological data is high quality and the experimental design is rigorous.

      Public Reviews:

      Reviewer #1 (Public Review):

      This study uses electrophysiological techniques in vitro to address the role of the Na+ leak channel NALCN in various physiological functions in cartwheel interneurons of the dorsal cochlear nucleus. Comparing wild type and glycinergic neuron-specific knockout mice for NALCN, the authors show that these channels 1) are required for spontaneous firing, 2) are modulated by noradrenaline (NA, via alpha2 receptors) and GABA (through GABAB receptors), 3) how the modulation by NA enhances IPSCs in these neurons.

      This work builds on previous results from the Trussell's lab in terms of the physiology of cartwheel cells, and from other labs in terms of the role of NALCN channels, that have been characterized in more and more brain areas somewhat recently; for this reason, this study could be of interest for researchers that work in other preparations as well. The general conclusions are strongly supported by results that are clearly and elegantly presented.

      I have a few comments that, in my opinion, might help clarify some aspects of the manuscript.

      1. It is mentioned throughout the manuscript, including the abstract, that the results suggest a closed apposition of NALCN channels and alpha2 and GABAB receptors. From what I understand, this conclusion comes from the fact that GABAB receptors activate GIRK channels through a membrane-delimited mechanism. Is it possible that these receptors converge on other effectors, for example adenylate cyclase (see https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6374141/).

      We have now tested the role of adenylyl cyclase modulation in the control of NALCN, by saturating the cells with a cAMP analogue 8-Br-cAMP and found no effect on the NA response. These data are included in the paper. While further experiments are necessary, these results argue in favor of a direct gating by G-proteins.

      1. In Figure 2G, the neurons from NALCN KO mice appear to reach a significantly higher frequency than those from WT (figure 2E, 110 vs. 70 spikes/s). Was this higher frequency a feature of all experiments? The results mention a rundown of peak firing rate due to whole-cell dialysis, but, from what I understand, the control conditions should be similar for all experiments.

      The peak firing rates in control solutions for WT and KO CWC are not statistically different.

      1. Also in Figure 2, the firing patterns for neurons from WT and NALCN KO mice appear to be quite different, with spikes appearing to be generated during the hyperpolarization of the bursts in the second half of the current step for WT neurons but always during the depolarization in KO neurons. Was this always the case? If so, could NALCN channels be involved in this type of firing? Along these lines, it would be interesting to show an example of a firing pattern of neurons from WT mice in the presence of NA, which inhibits NALCN channels.

      The specific pattern of spikes in CWC is quite variable from trial-to-trial or cell-to-cell, as it is dependent on multiple CaV and calcium dependent K channels subtypes, and is not dependent on the genotypes used here. The primary effects observed in the KO are in background firing and sensitivity to NA, both reflected alterations in rheobase. The firing pattern example requested was shown in the raster plot of fig 2B2.

      1. It might be interesting to discuss how the hyperpolarization induced by the activation of GIRK channels and inhibition of NALCN channels could have different consequences due to their opposite effect on the input resistance.

      We considered this as a point of discussion, but decided that making sense of it would depend on assumptions about the location of the channels (dendritic vs somatic, distance to AIS) that we do not have data for. For example, a dendritic increase in resistance through NALCN block, leading to a hyperpolarization of the soma, might have actions similar to a somatic hyperpolarizing conductance increase by GIRK, as far as the voltage at the AIS is concerned.

      Reviewer #2 (Public Review):

      This is a very interesting paper with several important findings related to the working mechanism of the cartwheel cells (CWC) in the dorsal cochlear nucleus (DCN). These cells generate spontaneous firing that is inhibited by the activation of α2-adrenergic receptors, which also enhances the synaptic strength in the cells, but the mechanisms underlying the spontaneous firing and the dual regulation by α2-adrenergic receptor activation have remained elusive. By recording these cells with the NALCN sodium-leak channel conditionally knocked, the authors discovered that both the spontaneous firing and the regulation by noradrenaline (NA) require NALCN. Mechanistically, the authors found that activation of the adrenergic receptor or GABAB receptor inhibits NALCN. Interestingly, these receptor activations also suppress the low [Ca2+] "activation" of NALCN currents, suggesting crosstalk between the pathways. The finding of such dominant contribution of the NALCN conductance to the regulation of firing by NA is somewhat surprising considering that NA is known to regulate K+ conductances in many other neurons.

      The studies reveal the molecular mechanisms underlying well known regulations of the neuronal processes in the auditory pathway. The results will be important to the understanding of auditory information processing in particular, and, more generally, to the understanding of the regulation of inhibitory neurons and ion channels. The results are convincing and are clearly presented.

      Reviewer #3 (Public Review):

      The study by Ngodup and colleagues describes the contribution of sodium leak NALCN conductance on the effects of noradrenaline on cartwheel interneurons of the DCN. The manuscript is very well-written and the experiments are well-controlled. The scope of the study is of high biological relevance and recapitulates a primary finding of the Khaliq lab (Philippart et al., eLife, 2018) in ventral midbrain dopamine neurons, that Gi/o-coupled receptors inhibit NALCN current to reduce neuronal excitability. Together these studies provide unequivocable evidence for NALCN as a downstream target of these receptors. There are no major concerns. I have only minor suggestions:

      Minor

      1. As introduced in the introduction, NALCN is inhibited by extracellular calcium which has led to some discourse of the relevance of NALCN when recorded in 0.1 mM calcium. A strength of this study is the effect of NA on NALCN is recorded in physiological levels of calcium (1.2 mM). I suggest including the concentration of extracellular calcium in the aCSF in the Results section instead of relying on the reader to look to the Methods.

      Done.

      1. It would be interesting to include the basal membrane properties of the KO compared to wildtype, including membrane resistance and resting membrane potential. From the example recording in Figure 2, one might think that the KOs have lower membrane resistance, so it is interesting that the 2 mV hyperpolarization produced similar effects on rheobase. In addition, from the example in Figure 2G, it appears that NA has an effect on firing frequency with large current injection in the KO. Is this true in grouped data and if so, is there any speculation into how this occurs?

      We have included in the text a comparison of the input resistance in WT and KO. These were not different. This should not be too surprising given the wide range of values between animals, and the necessity to compare populations. Measurements of resting potential are complicated by the fact that CWC are normally spontaneously active. As was discussed in the text, peak firing frequency declined with time during recording in both control and KO, necessitating normalization as shown in Fig 2E-H.

      1. Please expand on the rationale for why GABAB and alpha2 must be physically close to NALCN. To my knowledge, the mechanism by which these receptors inhibit NALCN is not known. Must it be membrane-delimited?

      Given the known membrane delimited modulation of GIRK by GABAB, and that alpha2 and GABAB receptors appear to share the same population of NALCN channels, and that alpha2 receptors do not appear to target GIRK channels, we felt the simplest explanation would be coupling through G-proteins, with spatial segregation of different receptor/channel pools providing the means for separating GIRK and NALCN effects. Given that the alpha2 receptor is a Gi/o GPCR, we have now included in the revision new experiments using 8-Br-cAMP, as discussed above. These showed no effect on the NA response, consistent with a direct effect membrane delimited of G-proteins. We acknowledge however that further experiments are warranted.

      Reviewer #1 (Recommendations For The Authors):

      1. I suggest labeling the voltage traces in Figure 2 with WT and KO for easier comprehension; in addition, I suggest adding the average data to the plots in Figure 2, as in Figure 2-supplementary Figure 1 panel F.

      We have added the figure labels as requested. We chose not to add the average data as we noticed that averaging the full FI plots led to a smearing of the curves and a distortion in the apparent rheobase. Thus, we instead measured the rheobase for individual cells and report their average.

      1. For readers that are not familiar with the field, more details should be given about the electrical stimulation to evoke IPSCs in cartwheel cells, and what they represent.

      Done.

      1. The methods should mention if and how the concentrations of divalents were adjusted in the experiments with 0.1 extracellular Ca2+

      Done.

      Reviewer #2 (Recommendations For The Authors):

      I only have several minor comments.

      1. The total lack of spontaneous firing in CWCs in the NALCN KO (Fig. 1) is interesting and provides an opportunity to probe the in vivo function of such spontaneous firing. Besides being a little smaller, do the mutant mice have any sign of abnormality in sound signal processing?

      Figure 1 – Figure supplement 1 showed that there are no effects on auditory brainstem responses in the KO.

      1. Figs. 3&4 (and several other figures with voltage-clamp recordings), a line indicating zero current level would be useful.

      Done

      1. page 7, "Outward current generated by suppression of NALCN": it might be better to state as "Outward response generated by suppression of NALCN", as the authors correctly pointed out that the NA-induced apparently outward current response is largely a result of an inhibition of NALCN-mediated inward Na+ current. One way to clarify this might be to record at the Nernst potential of K+ to isolate the contribution of Na+ currents (unclear if K+- or Cs+-based pipette was used in the experiment in Fig 3).

      Text has been modified.

      1. Figs. 5,6&7: do the dashed lines indicate initial current level or zero current level?

      Initial current. See legends.

      1. The labeling of some of the bar graphs can be made more clear. For example, in Fig. 2K, the right two columns should be labeled as WT as well. Fig. 3C & Fig. 4C, the left two columns should be labeled as WT and the right two as KO.

      Added labels to Fig 2 as requested.

      1. Figs. 5-7: The suppression of low extracellular [Ca2+]-induced NALCN-dependent current by NA and baclofen is very interesting. As the tonic inhibition of NALCN by extracellular Ca2+ is likely through a Ca2+-sensing GPCR (CaSR) and G-proteins (lowering [Ca2+] releases the inhibition and generates inward current) (Lu et al. 2010), the action of NA and baclofen may all converge onto the same G-protein dependent pathway of the Ca2+-sensing receptor. I'd include this in the discussion to provide a potential mechanistic explanation of the interesting observation.

      This is indeed an interesting idea. We prefer not to discuss here, as 1) the source of Ca2+ sensitivity of the channel seems to be controversial (Chua et al 2020), and 2) the effect of Ca2+ reduction is enormously slower than the effect of the modulators (Fig 5-7), implying distinct mechanisms.

      Reviewer #3 (Recommendations For The Authors):

      Typos/general comments

      1. Figure 2 would be easier to comprehend with WT and KO labels as in the other figures. Done

      2. Page 11, size of the IPSCs in NA is missing the minus sign.

      Corrected.

      1. Is the y-axis correct on Figure 8B? This looks like it is doubling the size of the IPSC.

      Thank you for catching this mistake. The formula used to calculate % change was in error. We have corrected all the data analysis in the figure, which fortunately did not change the conclusion. Regarding the axis, note that the measurement was % change, not ratio of drug vs control.

    1. Author Response

      The following is the authors’ response to the original reviews.

      We thank the reviewers and editors for their constructive comments on the manuscript. We have extensively revised the manuscript based on these concerns and comments. The followings are the specific answers.

      Public Reviews:

      Reviewer #1 (Public Review):

      In the manuscript "Long‐read single‐cell sequencing reveals expressions of hypermutation clusters of isoforms in human liver cancer cells", S. Liu et al present a protocol combining 10x Genomics single-cell assay with Element LoopSeq synthetic long-read sequencing to study single nucleotide variants (SNVs) and gene fusions in Hepatocellular carcinoma (HCC) at single‐cell level. The authors were the first to combine LoopSeq synthetic long‐read sequencing technology and 10x Genomics barcoding for single cell sequencing. For each cell and each somatic mutation, they obtain fractions of mutated transcripts per gene and per each transcript isoform. The manuscript states that these values (as well as gene fusion information) provide better features for tumor-normal classification than gene expression levels. The authors identified many SNVs in genes of the human major histocompatibility complex (HLA) with up to 25 SNVs in the same molecule of HLA‐DQB1 transcript. The analysis shows that most mutations occur in HLA genes and suggests evolution pathways that led to these hypermutation clusters. Yet, very little is said about novel isoforms and alternative splicing in HCC cells, differences in isoform ratio between cells carrying different mutations, or diversity of alternative isoforms across cells. While the manuscript by Liu et al. presents a promising combination of technologies, it lacks significant insights, a comprehensive introduction, and has significant problems with data description and presentation.

      Answer: Thanks for the precious suggestion. Our long-read single-cell sequencing has discovered an average of 442 novel isoform transcripts per benign liver cell and 450 novel isoform transcripts per HCC cell per SCANTI v1.2 analysis. These are stated in the revised manuscript. The alternative splicing was detected by differential isoform expression as demonstrated in supplemental figures 6 and 7 and supplemental tables 8-11. The examples of differences in isoform ratio between cells carrying different mutations are now shown by DOCK8 and STEAP4 (figure 5 in the revised manuscript). A new section was added in the results to discuss the mutation expression of these two genes. The diversity of isoforms of the selected genes is shown in Supplemental Figure 10.

      This study showed how mutations in the same allele evolved in liver cancer. In particular, HLA hypermutations were found to develop from some specific sites of the molecules into large clusters of mutations in the same molecules. A new paragraph of introduction was added about the role of mutations in human cancer development. We also revised the figures to present the information better. All the HLA genes expressed only one known isoform, as shown in Figure 4 and Supplemental Figure 3, regardless of mutations.

      Major comments:

      1. The introduction section is scarce. It lacks description of important previous works focused on clustered mutations in cancers (for example, PMID35140399), on deriving the process of cancer development through somatic evolution (PMID32025013, from single cell data PMID32807900). Moreover, some key concepts e.g. mutational gene expression and mutational isoform expression are not defined. The introduction and the abstract contain slang expressions e.g. "protein mutation', a combination of terms I teach my students not to use.

      Answer: We appreciate the reviewer for the idea of more solid background introduction and term definition. We added a new paragraph in the introduction section to introduce the role of mutations and hypermutations in human cancers. Some important work has been cited. We added a new section in the "Methods" to define "mutation gene expression share" and "mutation isoform expression share". "Protein mutation" has been replaced by "genetic mutation".

      1. In the results section, to select the mutations of interest, the authors apply UMAP dimensionality reduction to the mutation isoforms expression and cluster samples in UMAP space, then select the mutations that are present only in one cluster, then apply UMAP to the selected mutations only and cluster the samples again. The motivation for such a procedure seems unclear, could it be replaced with a more straightforward feature selection?

      Answer: Thanks for raising up this important question. The goal of the analysis is an unbiased classification of the cell populations in the samples. We found that by removal of mutated isoform expressions that were at similar levels of all cells, the UMAP clustering generated clear segregation of three population cells. When the unique mutated isoform expressions from each group were applied, it generated highly distinct 8 groups of cells, with each group having a distinct mutation isoform expression pattern. If we force known knowledge into the mix of the analysis, it may generate unwanted bias. Specifically, the first UMAP was performed in an unbiased way to cluster cells, while the second step is a supervised approach by selecting the unique mutations in each cluster to identify the classifiers. The second UMAP matches the Benign/HCC labeling well.

      1. As I understand, the first "mutated isoform"-based UMAP clustering was built from expression levels of 205 "mutational isoforms". What was the purpose and outcome of the second "mutated isoform"based UMAP clustering (Figure 2E)? In the manuscript the authors just describe the clusters and do not draw any conclusions or use the results of the clustering anywhere further.

      Answer: Thanks for pointing this out. Figure 2E was generated from unique mutation isoform expressions in groups A, B, and C from Figure 2D. The purpose of Figure 2E is to investigate whether these unique mutation isoforms can further classify the cell populations free of prior biological knowledge. We added a sentence in the revision to clarify the purpose of the clustering. The conclusion from this analysis, including Figure 2F and Figure 3 (which is an extension of Figure 2E), is that HLA mutation isoform expressions dominated the classifications of cell populations.

      1. The authors just cluster the data three times based on expression levels of different sets of "mutational isoforms" and describe the clusters. What do we need to gather from these clustering attempts besides the set of 113 mutations used for further analysis? What was the point of the reclusterings? Did the authors observe improvement of the classification at each step?

      Answer: Thanks for asking this important question. The improvement of re-clustering to classify cell populations is the obvious segregation of 8 different groups of cells without any manual classification through prior knowledge. The distances among groups were far apart in comparison to the first clustering (figure 2B). Detailed subclassifications were achieved on cell populations that otherwise could not be segregated based on the first clustering.

      1. The alignment of short reads generated from hypermutated transcriptomes is non-trivial. The proposed approach could address the issue without the need for whole genome sequencing and offer insights about the cancer development through somatic evolution. Why didn't the authors use modern phylogenetic approaches in the "Evolution of mutations in HLA molecules" section or at least utilize the already performed clustering to infer cell lineages?

      Answer: We appreciate for the great question. For a single molecule mutation evolution, single gene clustering may not produce a desirable and robust effect. A simple evolution snowball chart in Figure 4B may be easier to be understood.

      1. I am not sure I understood the definition of "mutated gene expression levels" and "mutated isoform expression levels" in the "Mutational gene expression and fusion transcript enhanced transcriptome clustering of benign hepatocytes and HCC" section. The authors mention that gene lists included all the isoforms within the same range of standard deviation. If I understand it correctly, they are equal if there is only one expressed transcript isoform. In that case, this overlap is not surprising at all.

      Answer: We thank the reviewer for the great question. The definition of mutation gene expression level, mutation isoform expression level, and fusion gene expression level are now defined in the "Methods" section. In all HLA mutation transcripts, there were multiple transcripts with or without mutations for a single dominant isoform.

      1. "To investigate the roles of gene expression alterations that were not accompanied with isoform expression changes, UMAP analyses were performed based on the non‐overlapped genes." Venn diagrams (Sup Figure 8) show that there are much less "non-overlapped genes" than "genes that showed both gene and isoform level changes" for each SD threshold (for example, for SD>=0.8 59 vs 275). Could that be the reason why clustering based on the former group is worse i.e the cancer and normal cells are separated less clearly?

      Answer: The number of (attributes) genes could be a contributing factor in the segregation of cell populations. However, the number of attributes is not the underlying reason for worse performance for gene only classifier because much smaller isoforms/genes (22) overlap in SD>=1 outperformed a large number of genes (59) with SD>=0.8. It suggested that 59 gene expression classifier is less efficient in segregating the cell populations. To address this concern, we took SD>=0.8 as an example for demonstration if we subsampled the 275 overlapped genes/isoforms to 59 (equal to 59 non-overlapped genes in terms of number), we can still get better separation than the 59 DEG only. We repeated this subsampling process for three times. Similar results were found. The new data were inserted into supplemental Figure 8

      Reviewer #2 (Public Review):

      In the present study, Liu et al present an analysis of benign and HCC liver samples which were subjected to a new technology (LOOP-Seq) and paired WES. By integrating these data, the authors find isoforms, fusions and mutations which uniquely cluster within HCC samples, such as in the HLA locus, which serve as candidate leads for further investigation. The main appeal of the study is in the potential of LOOPSeq as a method to present isoform-resolved data without actually performing long-read sequencing. While this presents an exciting new method, the current study lacks systematic comparisons with other technologies/data to test the robustness, reproducibility and utility of LOOPSeq. Further, this study could be further improved by giving more physiologic context and examples from the analyses, thus providing a new resource to the HCC community. A few suggestions based on these are below:

      Answer: We appreciate the reviewer to raise up all the important questions and the great suggestions. The LOOPseq technology was compared with Oxford nanopore and PacBio long-read sequencing in our previous study. We have cited analysis in the introduction section of the paper. HLA mutation clusters in the single molecules are our finding with major physiological significance since these mutations may help liver cancer cells evade immune surveillance. We have extensively discussed the potential impact of these mutations on cancer development in the discussion. In addition, we added a new section of DOCK8 and STEAP4 mutation expressions in the results (page 11, new Figure 5) that are highly relevant to the pathogenesis of HCC.

      1. A primary consideration is that this seems to be the first implementation of LOOP-Seq, where the technology, while intriguing, has not been evaluated systematically. It seems like a standard 10x workflow is performed, where exons are selectively pulled down and amplified. Subsequent ultra-deep sequencing is assumed to give isoform-resolution of the sc-seq data. To demonstrate the utility of the approach it would benefit the study to compare the isoform-resolved results with studies where long-read sequencing was actually performed (ex: https://journals.lww.com/hep/Fulltext/2019/09000/Long_Read_RNA_Sequencing_Identifies_Alternativ e.19.aspx, https://www.jhep-reports.eu/article/S2589-5559(22)00021-0/fulltext, https://journals.plos.org/plosgenetics/article?id=10.1371/journal.pgen.1010342). Presumably, a fair amount of overlap should occur to justify the usage.

      Answer: We have discussed the utility of the methodology in comparison with the previous studies by these three groups in the revision (results, page 12).

      1. Related to this point, the sc-seq cell types and benign vs HCC genes should be compared with the wealth of data available for HCC sc-seq (https://www.nature.com/articles/s41467-022-322833, https://www.nature.com/articles/s41598-021-84693-w). These seem to be important to benchmark the technology in order to demonstrate that the probe-based selection and subsequent amplification does not bias cell type definition and clustering. In particular, https://www.nature.com/articles/s41586021-03974-6 seems quite relevant to compare mutational landscapes from the data.

      Answer: This is a great point. The consistency probe-based analysis was demonstrated in our previous analyses and the analyses mentioned in the comments. We further discussed it in the results section of the paper (page 12).

      1. From the initial UMAP clustering, it will be important to know what the identities are of the cells themselves. Presumably, there is quite a bit of immune cells and hepatocytes, but without giving identities, downstream mechanistic interpretation is difficult.

      Answer: When mutation analyses were combined with cell marker analysis, i.e., immune marker positive but negative in HLA mutation, we found only one bona fide immune cell in the HCC sample. Thus, immune cells may not be significant in the current analysis.

      1. In general, there are a fair amount of broad analyses, such as comparisons of hierarchical clustering of cell types, but very little physiologic interpretations of what these results mean. For example, among the cell clusters from Fig 6, knowing the pathways and cell annotations would help to contextualize these results. Without more biologically-meaningful aspects to highlight, most of the current appeal for the manuscript is dependent on the robustness of LOOP-seq and its implementation.

      Answer: To address this comment, a new pathway analysis was performed on the cluster results of Figure 6. A new supplemental table was generated. The results are now discussed on page 13.

      1. Many of the specific analyses are difficult and the methods are brief. Especially given that this technology is new and the dataset potentially useful, I would strongly recommend the authors set up a git repository, galaxy notebook or similar to maximize utility and reproducibility

      Answer: The script file has been uploaded to GIT to facilitate the reproducibility of the analysis. We also added a new pipeline description script in the methods (pages 19-20).

      1. The authors claim that clustering between benign and HCC samples was improved by including isoform & gene (Suppl fig 8). This seems like an important conclusion if true, especially to justify the use of longread implementation. Given that the combination of isoform + gene presents ~double the number of variables on which to cluster, it would be important to show that the improved separation on UMAP distance is actually due to the isoforms themselves and not just sampling more variables from either gene or isoform

      Answer: The number of (attributes) genes could be a contributing factor in the segregation of cell populations. However, the number of attributes is not the underlying reason for worse performance for gene only classifier because much smaller isoforms/genes (22) overlap in SD>=1 outperformed a large number of genes (58) with SD>=0.8. It suggested that 58 gene expression classifier is less efficient in segregating the cell populations. To address this comment, we performed random subsampling to reduce the isoform/gene overlap iterates, similar results were obtained. A new supplemental figure was generated to reflect the new analyses.

      1. SQANTI implementation to identify fusions relevant for the HCC/benign comparison. How do the fusions compare with those already identified for HCC? These analyses can be quite messy when performed on WES alone so it seems that having such deep RNA-seq would improve the capacity to see which fused genes are strongly expressed/suppressed. This doesn't seem as evident from current analysis. There are quite a bit of WES datasets which could be compared: https://www.nature.com/articles/ng.3252, https://www.nature.com/articles/s41467-01803276-y

      Answer: Exome sequencing is not an ideal tool to identify fusion genes. Very few fusion genes have been discovered based on RNA sequencing so far. The fusion genes discovered in the study appeared mostly novel. No exome sequencing was involved in the identification of fusion genes.

      1. Figure 4 is fairly unclear. The matrix graphs showing gene position mutations are tough to interpret and make out. Usually, gene track views with bars or lollipop graphs can make these results more readily interpretable. Also, how Figure 4 B infers causal directions from mutations is unclear.

      Answer: We appreciate the reviewer for pointing this out. We have revised the diagram in Figure 4A to reflect the proper distance between the mutations in HLA-DQB1 NM_002123. Since these are the positions in the same alleles (protein), the gene track view or lollipop graph may not show that properly. The mutation clusters started from an isolated mutation, and mutation did not revert to wild type sequence after occurring. Based on these two principles, we showed several mutation accumulation pathways leading to hypermutation clusters.

      Reviewer #3 (Public Review):

      The Liu, et al. manuscript focuses on the interesting topic of evaluating in an almost genome-wide-scale, the number of transcriptional isoforms and fusion gene are present in single cells across the annotated protein coding genome. They also seek to determine the occurrences of single nucleotide variations/mutations (SNV) in the same isoform molecule emanating from the same gene expressed in normal and normal and hepatocellular carcinoma (HCC) cells. This study has been accomplished using modified LoopSeq long‐read technology (developed by several of the authors) and single cell isolation (10X) technologies. While this effort addresses a timely and important biological question, the reader encounters several issues in their report that are problematic.:

      1. Much of the analysis of the evolution of mutations results and the biological effects of the fusion genes is conjecture and is not supported by empirical data. While their conclusions leave the reader with a sense that the results obtained from the LoopSeq has substantive biological implications. However, they are extended interpretations of the data. For example: The fusion protein likely functions as a decoy interference protein that negatively impacts the microtubule organization activity of EML4.(pg 9)... and other statements presented in a similar fashion.

      Answer: We thank the reviewer for the helpful comment. The mutation results were experimentally validated by exome sequencing on the same samples. Furthermore, these mutations were filtered by requiring their presence in three different transcriptomes. The biological significance of these mutations is probably the subject of investigation in the next phase. Since a large number of HLA mutations did not occur overnight, the analysis of the accumulation pathways for these mutations was warranted, given the extensive evidence of such a process. The impact of mutations on HLA molecules appeared obvious and should be discussed. For ACTR2-EML4 fusion, we revised it as "The loss of microtubule binding domain may negatively impact the microtubule organization activity of EML4 domain of the fusion protein." We only discussed the obvious impact due to the loss of a large protein domain.

      2, LoopSeq has the advantage of using short read sequencing analyses to characterize the exome capture results and thus benefits from low error rate compared to standard long-read sequencing techniques. However, there is no evidence obtained from standard long read sequencing that the isoforms observed with LoopSeq are obtained with parallel technologies such as long read technologies. It is not made clear how much discordance there is in comparing the LoopSeq results are with either PacBio or ONT long read technologies.

      Answer: The comparative analyses among LOOPSeq, Oxford nanopore, and PacBio sequencing were performed in our previous study. We have cited the study in our introduction.

      1. There is no proteome evidence (empirically derived or present in proteome databases) from the HCC and normal samples that confirms the presence or importance of the identified novel isoforms, nor is there support that indicate that changes in levels HLA genes translate to effects observed at the protein level. Since the stability and transport differences of isoforms from the same gene are often regulated at the post-transcriptional level, the biological importance of the isoform variations is unclear.

      Answer: Given the transcriptome sequencing data, we can only focus on the isoform variation analysis but not directly link to the protein level variation because of the post-transcriptional level regulation. We discussed this in the revised manuscript (page 14).

      4 It is unclear why certain thresholds were chosen for standard deviation (SD) <0.4 (page 5), SD >1.0 (pg 11).

      Answer: The threshold is flexible and arbitrary. We showed different thresholds, and the same conclusion holds. We just choose the thresholds with better separation and a reasonable number of genes/isoforms for the downstream analysis. (Supplemental Figure 6-7 with different thresholds and supplemental tables 4-12).

      1. HLA is known to accumulate considerable somatic variation. Of the many non-immunological genes determined to have multiple isoforms what are the isoform specific mutation rates in the same isoform molecule? Are the HLA genes unique in the number of mutations occurring in the same isoform?

      Answer: We thank the reviewer for this important suggestion. We now show mutation expression patterns in isoforms of DOCK8 and STEAP4 in Figure 5. A new section is added to discuss the mutation expression of these two genes. As shown in supplemental figure 10, HLA-DQB1, HLA-DRB1, HLA-B, and HLA-C, have only one known isoform detected,

      Editorial comments:

      The present study pairs single-cell seq with LoopSeq synthetic long-read sequencing on samples of HCC and benign liver to identify mutations and fusion transcripts specific to cancer cells. The authors present a potentially important resource; however the overall support remains incomplete.

      While the approach of evaluating isoform-specific changes at the cellular level to cancer seeks to address a timely and important topic, there is currently incomplete evidence in support of the major claims in the manuscript. In particular, major recommendations to provide stronger support for the combination of technologies and interpretation regarding cancer-associated genomic changes include: 1) systematic evaluation of UMAP-based clustering methods, to what subsets of data they are applied and subsequent interpretations, 2) direct comparisons of results with additional methods to quantify long-read sequencing data and those evaluating mutational consequences of HCC progression and 3) detailed expansion of the description of methods and rationale for selecting specific parameters and cell types for further analyses. Including these changes would significantly strengthen the support for utility of combining 10x single-cell with Loop-seq and provide compelling evidence for usage of this resource in dissecting HCC-associated molecular changes.

      Answer: We appreciate the frank and constructive comments. The goal of UMAP is to obtain biological knowledge through unbiased data selection. Systematically, we select classifiers without any prior knowledge (blind to the samples). In our case, classifiers with high standard deviation across all the cells were chosen. We stressed this in the result section. The comparison among LOOPSeq, PacBio, and Oxford nanopore was made in our previous study. We cited that analysis in this paper. Analysis detail and pipelines were added in the revised manuscript to improve the reproducibility. The mutation expression analysis was quite clear-cut. The clustering classified the HCC and benign liver cells by itself and identified a few cancer cells in the benign liver sample. All these were accomplished without applying any knowledge.

      Reviewer #1 (Recommendations For The Authors):

      Overall, there are numerous problems with data presentation and insufficient description, which authors could fix.

      1. Figure 4. A. It would be more clear if the figure showed the distribution of mutations in the molecule. Otherwise, it's hard to see if we see clusters of mutations or just 25 mutations spread uniformly across the transcript. B. It's unclear what the reader needs to take away from these columns of numbers.

      Answer: The mutation positions are now presented as proportion to the location in a molecule. Column B is the distribution of mutation molecules from left panel in each cluster of cells (from Figure 3A) and their sample origin (HCC or benign liver). We clarify it a little more in the legend of Figure 4A.

      1. As a reader, I did not understand how "mutated gene expression levels" and "mutated isoform expression levels" were calculated in terms of sequenced long reads

      Answer: We defined the term and calculations in the methods section of the revised manuscript.

      1. Page 6 "genes involving antigen presentation"

      Answer: The full sentence of the subtitle is" Mutations of genes involving antigen presentation dominated the mutation expression landscape."

      1. Page 6 "These unique mutational isoforms" - how are these isoforms unique?

      Answer: We take away most of the "unique" adjectives to describe the non-redundant mutations.

      1. Page 6. Unclear "All but one clusters contained cells co‐migrated with cells of their sources."

      "Among 113 mutation isoforms, the major histocompatibility complex (HLA) was the most prominent with 68 iterations (60.2%) (Supplemental Table 3, Figure 3B)" There is nothing about HLA in Figure 3B.

      Answer: We revised the sentence as "Cells in all but one clusters co-migrated with cells of their sources". The mutation isoform expressions were listed in supplemental Table 3. They are too small and become unreadable when put in the figure.

      1. Page 10 "genes or isoforms that across all samples had with expression standard deviations less than" - probably "with" should not be there.

      Answer: We correct the error and thank the reviewer for the comment.

      1. Page 11 "UMAP analysis was performed using genes with standard deviations {greater than or equal to} 1.0 (182 wild‐type genes) and standard deviations >0.4 (282 mutated genes)". What do "wild-type" and "mutated" mean here?

      Answer: We edited as "UMAP analysis was performed using gene expressions with standard deviations ≥ 1.0 (182 non-mutated genes) and gene mutation expression with standard deviations 0.4 (282 mutated genes)."

      1. I could not find the description of Supplementary Tables.

      Answer: The supplemental table legends are added in the revised manuscript.

      1. In the Discussion section, the authors mention that mutations were mainly expressed in a specific isoform of a gene for a given cell. I suggest to emphasize this point in the Results section and illustrate it with a comparison of abundance of mutated and non-mutated isoforms

      Answer: For HLA molecules, their expression appeared to be restricted to one known isoform, regardless of mutation status. This sentence is removed in the revision. A new section of DOCK8 and STEAP4 mutation expression is added to the result.

      1. It is also mentioned that mutations may have an impact on the RNA splicing process. The authors should compare the observed isoform ratio to a prediction of the effect of variants on splicing by SpliceAI or similar tools

      Answer: This sentence was removed from the discussion.

      1. Figure 3c: triangles corresponding to HLA-positive cells are hard to distinguish

      Answer: We provide a larger representation of the triangle and circle in figure 3c in the revision.

      Reviewer #2 (Recommendations For The Authors):

      Many of my comments could be addressed by spending time to provide the code/data and a walkthrough of analyses so that other users would be able to answer these questions on their own.

      Answer: We have included a script section in the revision to ensure the reproducibility of the analysis. The raw data had been uploaded to GEO (see Methods).

    1. Author Response

      The following is the authors’ response to the original reviews.

      Reviewer #1:

      1. The results that TF binding produces microdomains at medium and long linker DNA but not short linker is very interesting. Although the differences can be observed from the figure, it still lacks of quantitative comparison. It is not clear the exact definition of the microdomain observed from simulations and what numbers of microdomains can be identified under different conditions. A quantitative comparison of different conditions could also be provided.

      We thank the reviewer for this suggestion. Our intent was to show qualitatively how TF binding locations that we design can direct fiber folding and create microdomains, which we define in the paper as high frequency contact regions in the contact maps, similar to the TADs observed in HiC maps. Together with the fiber configurations, contact maps allow us to identify formation of such microdomains, and to observe how these microdomains change depending on the conditions we build into the model, such as TF binding region or linker DNA length.

      To address your point, we have added a clustering analysis of the contact matrices with nucleosome resolution and assign each contact along the genome position (nucleosome index) to a cluster. In Supporting Figure S6, we show how DBSCAN clustering provides a clustering distribution that quantitatively describes the microdomains observed in the matrices and estimates the number of microdomains. For example, in the 44 and 62 bp systems, the contacts along the genomic distance separate into 5, 2, and 1 nucleosome groups for topologies 1 to 3, and into 2 and 1 group for topology 4, respectively. In the 26 bp and Life-Like systems, where microdomains are more diffuse due to fiber rigidity or polymorphism, we see that the clustering results are not as TF-topology-dependent as in the 44 and 62 bp systems. We also decomposed the contact matrices into one dimensional plots that depict the magnitude of 𝑖, 𝑖 ± 𝑘 internucleosome interactions. We see that internucleosome patterns change with the TF binding topology, and that the 26 bp and Life-Like systems show the least changes.

      1. When increasing TF concentration, from 0 to 100%, it seems that both packing ratio and sedimentation coefficients are not sensitive to the TF concentrations after 25%. Is it due to the saturation of TF binding? How many TF binding sites are considered at each concentration?

      Yes, in most cases, at TF concentrations higher than 25%, the fiber compaction does not change due to saturation of TF binding. Although the TF concentrations are reached, such as 50%, 70%, or 100%, these do not influence the fiber architecture. A higher order folding and compaction cannot be reached due to excluded volume interactions that impede overlapping of beads in the model.<br /> We have clarified this in the manuscript.

      As stated in the Methods section, the TF concentration refers to the number of linker DNA beads that can engage in a constraint compared to the total number of linker DNA beads. Thus, at 25% TF, 25% of linker DNA beads are engaged in TF constraints. We have added a comment on this in the Results section.

      1. It is shown that the contact maps that reveal microdomains are ensemble-based maps and single trajectories do not show clear formation of microdomains. Does the formation of microdomains increase with the number of combined trajectories?

      The formation of microdomains occurs in each single trajectory. However, the microdomains formed in each trajectory can be different. That is why ensemble-based maps show clearer trends of microdomains that might not be as visible in single-trajectory maps. If we increase the number of trajectories, the macrodomains will be more visible and there will be more macrodomains in the contact map, but the formation of microdomains will not increase in each single trajectory.

      1. "As we see from Figure 4A, when the linker DNA is short, such as 26 and 35 bp, TF binding does not increase the packing ratio of the fiber." The results of 35bp cannot be found in Figure 4A. In addition, the color of 44 and 62 bp should be changed since they are very similar in the figure.

      Thank you for catching this. The results corresponding to the 35 bp system are presented in the Supporting Figure 7. We have changed the text to read “As we see from Figure 4A and Figure S7..”.

      We have changed the color of the 62 bp trace to blue in the plots of Figure 4. Consistently, we have also changed the color of the 62 bp fiber in Figure 2 and Figure 5.

      1. For modelling of TF binding at increasing concentrations, it is mentioned that in these three conditions, TFs are allowed to bind to any region. Do you mean TF can also bind to nucleosomal DNA? Nucleosome structure prevents the binding of many TFs.

      In our model, only linker DNA beads can engage in the constraints (bind TF).<br /> We have changed the text to read “TFs are allowed to bind to any linker DNA region”.

      1. The details of the Mnase-seq dataset and how NFRs are identified should be provided, such as the coverage of the data and what read fragments are selected for NFR mapping.

      MNase data in bedgraph format were downloaded from the Genome Expression Omnibus (GSM2083107) repository and loaded without further processing into the Genome Browser. NFRs were visually inspected and detected as genomic regions without peaks. As detailed in the GEO repository, the sequenced paired-end reads were mapped to the mm9 genome. Only uniquely mapped reads with no more than two mismatches were retained and reads with insert sizes less than 50 or larger than 500 bp were discarded.

      We have clarified this in the manuscript.

      1. The calculations of volume and area of the Eed promoter region should be further elucidated.

      Thank you. We now elaborate upon these calculations. In particular, the Eed promoter region is defined between cores 123 and 129. The x,y or x,y,z coordinates of those cores are used to create the bounding area or volume by defining the shape’s vertices.

      1. In Figure 3, it is not clear how different topology are identified.

      In Figure 3 the topology, or TF binding regions, is the same for each of the 10 contact maps as these emerge from trajectory replicas of the same system which we named Topology 1. Different microdomains are formed in each individual trajectory as the high-frequency regions appear in different locations on each contact map. However, when these 10 maps are summed, the ensemble contact map clearly shows consensus microdomains in each region where TF binds.

      Reviewer #2:

      To further improve the manuscript, I have the following suggestions/comments.

      1. While most of the conclusions in this paper follow from the evidence provided by the ximulations, the result in section 3.3 title "Gene locus repression is medicated by TF finding," may not follow from the results. In my opinion, repression is a more complex process, and many more factors (such as nucleosome positioning, nucleosome sliding, histone methylation, and other proteins such as PRC or HP1, etc) may be involved in repression. While compaction is often associated with repressed chromatin (heterochromatin), recent studies have shown that heterochromatin fibers are highly diverse, and compaction alone may not be the criteria for repression (eg. see Spracklin et al. Nat. Struct. Mol. Biol. 30, 38-51 (2023).). In this light, I would recommend slightly modifying the title to say, "TF binding-mediated compaction can help in gene locus repression" or something similar.

      Yes! We completely agree that gene repression is a very complex phenomenon that involves many factors that we are approaching by modeling starting from the simplest strategy. Thus, we have changed the subtitle to read “TF binding-mediated compaction as possible mechanism of gene locus repression”.

      1. Authors could also present the contact probability versus genomic distance. This may provide some generic features at nucleosome resolution, given the variability in linker length and LH density.

      We thank the reviewer for this suggestion. We have now calculated the contact probability for the EED gene with and without TF binding (Supporting Figure 8). We see that the contact probability corresponding to short range interactions (i ± 2, 3, 4, 5, and 6) is slightly lower for the EED gene upon TF binding. However, a striking increase in the contact probability upon TF binding is seen in the genomic region between 3 and 5 kb, which corresponds to local loop interactions. Thus, TF binding slightly decreases local interactions but increases chromatin loops. Such changes are not observed for the EED system with LH density 0.8 (Supporting Figure 9), further supporting the idea that an increase in LH density hampers the effect of TF binding for the EED gene architecture. <br /> We have now added these results to the manuscript.

      1. Write a short paragraph about the limitations of the model/study. For example, one of the limitations could be that, as of now, it has only the effect of a few proteins, but to predict repression, one may need to incorporate the effect of several proteins.

      We agree with the reviewer that our model is a simple, first-step approach. Nonetheless, even the simplest mathematical model can be enlightening in helping dissect essential factors. Here, our model clearly shows how TF binding location modulates fiber architecture and the interplay between TF binding and other chromatin elements, like linker DNA length, LH density, and histone acetylation. We have now stated in the Discussion section that although limited due to being implicit and not considering other protein partners, our model can provide insights on the regulation of chromatin architecture by protein binding. Future modeling with explicit protein binding or combination of several proteins will further help us understand genome folding regulation.

      1. The radius of gyration of 26 kb chromatin is around ~60nm in this paper. Is there any experimental measurement to compare (approximate order of magnitude)? While I do not know any measurement for Eed gene locus, I am aware of the results in the Boettiger et al. paper from Xiaowei Zhuang lab (Nature 2016). There, they find that the Rg of a 26 kb region is above 100nm. But that is for a different organism, a different set of genes. Also, see Sangram Kadam et al. Nature Communications 14 (1), 4108, 2023.

      Thank you for this suggestion. To the best of our knowledge, there are no radius of gyration measurements for the EED gene. Regarding the two papers you cite, in the paper from Boettiger et al. (1) they determine by microscopy experiments that Rg ∝ 𝐿! where 𝐿 is the genomic length and 𝑐 is 0.37 ± 0.02 for active chromatin (Figure 1d of the paper). In such case, the Rg for a 26 kb region would be 43 ± 9 nm. Considering that these are Drosophila cells, our value of 62 nm is in good agreement with that estimate. Regarding the Kadam et al. paper (2), by coarse grained modeling they find an Rg of around 100 nm for different genes. Considering that the radius of gyration depends on cell type and fiber configuration (see for example (3) for the dependency of Rg on loop number and persistence length), we believe that our measurements in the same ball park as experimental results and other theoretical modeling studies are good indicators of our model’s reasonableness.

      We have added this comparison to the manuscript.

      1. The reason why it is useful to compare some distance measurements (physical dimension) with experiments is the following: The contact map in Hi-C only gives relative contact probabilities. It does not give absolute contact probabilities. To convert a Hi-C map into a physical distance, one requires comparison with some experimentally measured 3D distance. The radius of gyration is an ideal quantity to compare. From my experience, the contact probability is often much smaller than 1, suggesting that the chromatin is more expanded. But this could be due to the effect of many other proteins in vivo and the crowding, etc. I do not expect this work to incorporate all those effects. However, it may be useful to make a comment about it in the manuscript.

      Thank you. We have added to the discussion a comment on our first-generation model of TF binding to chromatin and the neglect of many associated protein and RNA cofactors that certainly influence chromosome folding and domain formation on higher scales. Some distance measures are also added to the Results as mentioned above.

      References

      1. Boettiger,A.N., Bintu,B., Moffitt,J.R., Wang,S., Beliveau,B.J., Fudenberg,G., Imakaev,M., Mirny,L.A., Wu,C. and Zhuang,X. (2016) Super-resolution imaging reveals distinct chromatin folding for different epigenetic states. Nature, 529, 418–422.

      2. Kadam,S., Kumari,K., Manivannan,V., Dutta,S., Mitra,M.K. and Padinhateeri,R. (2023) Predicting scale-dependent chromatin polymer properties from systematic coarsegraining. Nat. Commun., 14, 4108.

      3. Wachsmuth,M., Knoch,T.A. and Rippe,K. (2016) Dynamic properties of independent chromatin domains measured by correlation spectroscopy in living cells. Epigenetics Chromatin, 9, 57.

    1. Author Response

      The following is the authors’ response to the original reviews.

      Reviewer #1 (Recommendations For The Authors):

      I have only a few very minor suggestions for improvement.

      • the text repeatedly uses the terms "central nervous system" and "enteric nervous system", which are not in standard use in the field. These terms are not defined until the bottom of p. 12 even though they are used earlier. It would be useful for the authors to explicitly describe their definitions of these terms earlier in the paper.

      Fixed.

      • the inclusion of four pre-trained models is a powerful and useful aspect of WormPsyQi. Would it be possible to develop a simple tool that, when given the user's images, could recommend which of the four models would be most appropriate?

      We appreciate the reviewer for bringing this up. To address this, we have now added an additional function in the pipeline to test all pre-trained models on representative input images. Before processing an entire dataset, users can view all segmentation results for images in Fiji to assess which model performed best, judged by the user. The GUI, running guide document, and manuscript have been modified accordingly.

      In addition, we would like to emphasize that the pre-trained models were developed by iterative analyses of many reporters, often with multiple rounds of parameter tuning; the results were validated post hoc to choose the optimal model for each reporter, and we have listed this information in Supplemental Table 1 to inform the choice of the pre-trained model for commonly used reporter types.

      • On p. 11 (and elsewhere), the differences in the performance of WormPsyQi and human experimenters are called "statistically insignificant". This statement is not particularly informative (absence of evidence is not evidence of absence). Can the authors provide a more rigorous analysis here - or provide an estimate of the typical effect size of the machine-vs-human difference?

      To address this, we have included additional analysis in Figure 2 – figure supplement 3. For two reporters - I5 GFP::CLA-1 and M4 GFP::RAB-3 - we compare WormPsyQi vs. labelers and inter-labeler puncta quantification. A high Pearson correlation coefficient (r2) reflects greater correspondence between two independent scoring methods. We chose these two test cases to demonstrate that the machine-vs-human effect size is reporter-dependent. For I5, where the CLA-1 signal is very discrete and S/N ratio is high, the discrepancy between WormPsyQi, labeler 1, and labeler 2 is minimal (r2=0.735); moreover, scoring correspondence depends on the labeler (r2=0.642 and 0.942, respectively). In other words, WormPsyQi mimics some labelers better than others, which is to be expected. For M4, where the RAB-3 signal is diffuse and synapse density is high in the ROI, the inter-labeler discrepancy is high (r2=0.083) and WormPsyQi vs labeler (1 or 2) discrepancy is slightly reduced (r2=0.322 and 0.116, respectively). The problematic regions for the M4 RAB-3 reporter are emphasized in Figure 6 - figure supplement 1A. Overall, the additional analysis suggests that the effect size is contingent on the reporter type and image quality, and importantly for scoring difficult strains WormPsyQi may average out inter-labeler scoring variability.

      • p. 12: "Again, relying on alternative reporters where possible..." This is an incomplete sentence - are some words missing?

      Edited.

      Reviewer #2 (Recommendations For The Authors):

      1. The authors effectively validated the sexually dimorphic synaptic connectivity by comparing the synapse puncta numbers of PHB>AVA, PHA>AVG, PHB>AVG, and ADL>AVA. However, these differences appear to be quite robust. It would be beneficial for the authors to test whether WormPsyQi can detect more subtle changes at the synapses, such as 10-20% changes in puncta number and fluorescence intensity.

      While the dimorphic strains were used to first validate WormPsyQi based on the ground truth of very well-characterized reporters, the reviewer reasonably asks whether our pipeline can pick up on more subtle differences. To address this, we have now included an additional figure (Figure 9 – figure supplement 2), where we performed pairwise comparisons between L4 and adult timepoints for the reporter M3 GFP::RAB-3. As reflected in panels A and C, although the difference between puncta number and mean intensity between L4 and adult is marginal (22% increase in puncta number and 13% increase in mean intensity from L4 to adult), WormPsyQi can pick it up as statistically significant.

      1. On page 10, the authors mentioned that "cell-specific RAB-3 reporters have a more diffuse synaptic signal compared to the punctate signal in CLA-1 reporters for the same neuron, as shown for the neuron pair ASK (Figure 4 -figure supplement 1B, C)". It is important to note that in this case, the reporter gene expressing RAB-3 is part of an extrachromosomal array, whereas the reporter gene expressing CLA-1 is integrated into the chromosome. It's possible that the observed difference in pattern may arise from variations in the transgenic strategies employed.

      To emphasize the difference in puncta features inherent to the reporter type, we have now added WormPsyQi segmentation results for ASK CLA-1 extrachromosomal reporter (otEx7455) next to the ASK CLA-1 integrant (otIs789) and ASK RAB-3 reporter (otEx7231) in Figure 4 – figure supplement 1C. Importantly, otEx7455 was integrated to generate otIs789, so they belong to the same transgenic line. Literature shows that RAB-3 and CLA-1 have different localization patterns and corresponding functions at presynaptic specializations, and this is qualitatively and quantitatively shown by the significant difference in puncta area size between RAB-3 and both CLA-1 reporters, i.e., both CLA-1 reporters have smaller, discrete puncta compared to RAB-3 (Figure 4 – figure supplement 1C). Quantitatively, in the case of ASK - where the synapse density is sparse enough that even diffuse RAB-3 puncta can be segmented without confounding adjacent puncta – overall puncta number between otEx7231 and otIs789 are similar. However, RAB-3 signal is diffuse and this poses quantification problems in cases where the synapse density is higher (e.g. AIB, SAA in Figure 4 – figure supplement 1D) and WormPsyQi fails to score puncta in these reporters since the signal is not punctate. As far as integrated vs. extrachromosomal reporters go, the reviewer is right in pointing out that some differences may be stemming from reporter type as our additional analysis between otIs789 and otEx7455 indeed shows fewer puncta in the latter owing to variable expressivity.

      1. The authors mentioned that having a cytoplasmic reporter in the background of the synaptic reporter enhanced performance. It would be more informative to provide comparative results with and without cytoplasmic reporters, particularly for scenarios involving dim signals or densely distributed signals.

      The presence of a cytoplasmic marker is critical in two specific scenarios: 1) images where the S/N ratio is poor, and 2) when the image S/N ratio is good, but the ROI is large, which would make the image processing computationally expensive.

      To demonstrate the first scenario, we have included an additional panel in Figure 4 – figure supplement 1(B) to show how WormPsyQi performs on the PHB>AVA GRASP reporter with and without the channel having cytoplasmic marker. The original image was processed as-is in the former case with both the synaptic marker in green and cytoplasmic marker in red; for comparison, only the green channel having synaptic marker was used to simulate a situation where the strain does not have a cytoplasmic marker. As shown in the figure, in the presence of background autofluorescence signal from the gut (which can be easily confounded with GRASP puncta depending on the worm’s orientation), WormPsyQi quantified GRASP puncta much more robustly with the cytoplasmic label; without the cytoplasmic marker, gut puncta are incorrectly segmented as synapses (highlighted with red arrows) while some dim synaptic puncta are not picked up (highlighted with yellow arrows).

      To demonstrate the second scenario, we now highlight the case of ASK CLA-1 in Figure 2 - figure supplement 4E. Additionally, we have emphasized in the manuscript that in cases where the S/N ratio is good and the image is restricted to a small ROI, WormPsyQi will perform well even in the absence of a cytoplasmic marker. This is equally important to note as having a specific cytoplasmic marker in the background may not always be feasible and, in fact, if the cytoplasmic marker is discontinuous or dim relative to puncta signal, using a suboptimal neurite mask for synapse segmentation would result in undercounting synapses.

      1. On page 12, the author stated "We also note that in several cases, GRASP quantification differed from EM scoring". However, the EM scoring is primarily based on a single sample, making it challenging to conduct a statistical analysis for the purpose of comparison.

      This is correct and is indeed a limitation of EM for this type of analysis. We have now reworded this sentence (page 14) to emphasize the reviewer’s point, and it is also elaborated further in the limitations section.

      1. In Figure 6F, the discrepancy between WormPsyQi and human quantification in the analysis of RAB-3 is observed. The author stated that "the RAB-3 signal was too diffuse to resolve all puncta". To better illustrate this discrepancy, it would be beneficial to include images highlighting the puncta that WormPsyQi cannot score, providing direct evidence that diffusing signals are not able to automatically detectable.

      To highlight puncta that were not segmented by WormPsyQi but were successfully scored manually, we have included arrows in Figure 6. In addition, for reporter M4p::GFP::RAB-3, we have included magnified insets in Figure 6 - figure supplement 1A to highlight the region where human annotator scores more puncta than WormPsyQi owing to the high synapse density. In future implementations, additional functionality can be built for separating these merged puncta into instances based on geometrical features such as shape and intensity contour.

      1. In Figure 9 S1D, the results from WormPsyQi and the manual are totally different. To address this notable discrepancy, the authors should highlight and illustrate the areas of discrepancy in the images. This visual representation can assist future users in identifying signal types that may not be well-suited for WormPsyQi analysis and inspire the development of new strategies to tackle such challenges.

      This is now addressed in additional figure panels in Figure 4 – figure supplement 1B and Figure 6 - figure supplement 1A.

      Reviewer #3 (Recommendations For The Authors):

      I found the comparison between manual quantification and WormPsyQi-based quantification to be very informative. In my opinion, quantifying the number of puncta is not the most tedious/difficult quantification even when done manually. Would the authors be able to include manual-WormPsyQi comparison for more time-consuming and potentially more prone to human error/bias quantifications such as puncta size or distribution patterns using a few markers with some inter/intra animal variabilities?

      To address this point, we have now included an additional figure supplement to Figure 2 (Figure 2 – figure supplement 4). We focused on the ASK GFP::CLA-1 reporter and had two human annotators manually label the masks of puncta for each worm by scanning Z-stacks and drawing all pixels belonging to each puncta in Fiji, which were then processed by WormPsyQi’s quantification pipeline to score puncta number, volume, and distribution. We also included a comparison of overall image processing time for each annotator and WormPsyQi. For features analyzed, the difference between WormPsyQi and human annotators for ASK CLA-1 is not statistically significant for multiple puncta features. Importantly, WormPsyQi reduces overall processing time by at least an order of magnitude, and while this is already advantageous for counting puncta, it is especially useful for other important puncta features since a) they may not be easily discernible, and b) it is extremely laborious to quantify them manually in large datasets when pixel-wise labels are required.

      The authors listed minimum human errors and biases as one of the benefits of WormPsyQi. For the markers with discrepancies in quantifications between human and WormPsyQi, have the authors encountered or considered human errors/biases as potential reasons for such discrepancies?

      This is the same point brought up by reviewer 1. We added Figure 2- figure supplement 3 to compare WormPsyQi to different human labelers, and show that because human labels can introduce systematic bias, WormPsyQi reduces such bias by scoring images using the same metric.

      The authors noted that WormPsyQi would be useful for comparing different genotypes/environments. Some mutants have known changes in synapse patterning/number. It would be helpful if the authors could validate WormPsyQi using some of the mutants with known synapse defects. For instance, zig-10 mutant increases the cholinergic synapse density just by a bit (Cherra and Jin, Neuron 2016), and nlr-1 mutant disrupts punctated localization of UNC-9 gap junction in the nerve ring (Meng and Yan, Neuron 2020), which could only be detectable by experts' eyes. It would be interesting to see if WormPsyQi picks up such subtle phenotypes.

      We agree that our pipeline would need to be tested in multiple paradigms to test its performance on detecting additional subtle phenotypes. In the context of this paper, we note that the developmental analysis of puncta in Figure 8 was performed to validate the ground truth from previous EM-based analyses (Witvliet et al., 2021), albeit the latter was limited by sample size. We extended this developmental analysis to the pharyngeal reporters, and in some cases the difference across timepoints was marginal (as emphasized by additional Figure 9 - figure supplement 2), but still detected by WormPsyQi. Lastly, our synapse localization analysis in Figure 10 assigns the probability of finding a synapse at a particular location along a neurite, which is not easily discernible by manual scoring.

      One of the benefits of the automated data analysis program is to be able to notice the differences you do not expect. For example, there are situations where you feel that in certain genotypes there is something different from wild type with their synapses but you can't tell what's different from wild type. In such cases, you may not know what to quantify. I think it would be beneficial if there were more parameters to be included in the default qualifications such as puncta number/size/intensity/distributions in the pipeline, so that the users may find unexpected phenotypes from one of the default quantifications.

      We apologize if this was not clearer in the manuscript where we first describe the pipeline in detail. To clarify, the output of WormPsyQi is a CSV file which includes several quantitative features, such as mean/max/min fluorescence intensity, puncta volume, and position. While most of our analyses are focused on puncta count, the user can perform downstream statistical analyses on all additional features scored to infer which features are most significantly variable across conditions. To make this clearer, we have elaborated the text when we first describe our pipeline, and along with the new Figure 2 - figure supplement 4, we hope that this point is clearer now.

      In addition, most proof-of-principle analysis we performed was focused on an ROI where we expect the synapses to localize. In practice, the user can input images and perform quantification across the entire image without biasing toward an ROI (this can be done in the GUI synapse corrector window) to also evaluate synaptic changes in regions outside the usual ROI.

      The authors stated that WormPsyQi could mitigate the problems stemming from scoring images with low signal-to-noise ratio or in regions with high background autofluorescence, laboriousness of scoring large datasets, and inter-dataset variability. Other than the 'laboriousness of scoring large datasets' it appeared to me that WormPsyQi does not do better than manual quantifications, especially inter-dataset variability, as the authors noted variability among the transgenes as one of the limitations of the toolkits. If two datasets are taken with completely different setups such as two independent arrays taken with two distinct confocal microscopes, would WormPsyQi make these two datasets comparable?

      We have included additional figure supplements to address the reviewer’s point. A significant advantage WormPsyQi offers over manual scoring is that it provides a standardized method of quantifying synapse features. As shown in Figure 2 – figure supplement 3, human labelers can introduce systematic bias (e.g. some over count puncta, while some undercount). In addition, while puncta number may be relatively easy to quantify, especially in a high-quality dataset, more subtle puncta features such as size, intensity, and distribution are much more laborious to quantify and require a priori knowledge of signal localization (Figure 2 – figure supplement 4, Figure 10). Altogether, our pipeline facilitates multiple measurements while also enabling robust quantification in hard-to-score cases such as the example shown for PHB>AVA reporter (Figure 4 - figure supplement 1B).

      Minor comments:

      Limitations are not quite specific to this work but those are general limitations to the concatemeric trans genes and fluorescently labeled synaptic proteins. I'd appreciate discussing specific limitations to WormPsyQi related to image acquisitions. For instance, for neurons with 3D structures would WormPsyQi be able to handle z-stacks closer to coverslip and stacks that are deeper side in a similar manner? Would the users need to be aware of such limitations when comparing different genotypes?

      To address the reviewer’s comment, we have elaborated the last paragraph in the limitations section to explicitly discuss where the user should exercise caution. The reviewer reasonably points out that the fluorescent signal away from the cover slip is typically dimmer, and neurite masking in this case is indeed compromised if dim to start with. In such cases, we recommend that the user either performs some preprocessing such as deconvolution, denoising, or contrast enhancement to boost the neurite signal, or segment synapses without the neurite mask if the puncta signal is brighter than that of the cytoplasmic marker. We hope that our additional figure supplements will clarify that WormPsyQi’s performance is contingent on reporter type and image quality, thus making it easier for the user to discern where automated quantification falls short and alternative reporters should be explored. In general, if puncta are not discernible to the user due to very poor S/N ratio, for instance, we do not recommend using WormPsyQi to process such datasets; this will be manifest in the results of the new “test all models” feature we added in the revised version.

      Some Rab-3 fusion proteins are described as RAB-3::GFP(BFP). Do these represent the C-terminal fusion of the fluorescent proteins? RAB-3 is a small GTPase with a lipid modification site at its C-terminus essential for its localization and function. Is it possible that the diffuse signal of some RAB-3 markers is caused by c-terminal fusion of the fluorescent protein?

      While we do have reporters with N- and C-terminal RAB-3 fusions for different neurons, we do not have both for the same neuron to perform a fair comparison. However, as noted in response to a previous comment by reviewer 2, RAB-3 and CLA-1 have distinct localization patterns at the synapse and this aligns with their distinct functions: while RAB-3 localizes at synaptic vesicles, CLA-1 is an active zone protein required for synaptic vesicle clustering. Accordingly, we have observed diffuse RAB-3 signal in reporters irrespective of where the protein is tagged, and while this is not problematic for ROIs with a low synapse density, it confounds quantification in synapse-dense regions. In contrast, CLA-1 puncta are typically easier to quantify more discretely, which is particularly relevant for features such synapse distribution, size, and intensity.

    1. Author Response

      The following is the authors’ response to the original reviews.

      Public Reviews:

      Reviewer #1 (Public Review):

      In this very strong and interesting paper the authors present a convincing series of experiments that reveal molecular mechanism of neuronal cell type diversification in the nervous system of Drosophila. The authors show that a homeodomain transcription factor, Bsh, fulfills several critical functions - repressing an alternative fate and inducing downstream homeodomain transcription factors with whom Bsh may collaborate to induce L4 and L5 fates (the author's accompanying paper reveals how Bsh can induce two distinct fates). The authors make elegant use of powerful genetic tools and an arsenal of satisfying cell identity markers.

      Thanks!

      I believe that this is an important study because it provides some fundamental insights into the conservation of neuronal diversification programs. It is very satisfying to see that similar organizational principles apply in different organisms to generate cell type diversity. The authors should also be commended for contextualizing their work very well, giving a broad, scholarly background to the problem of neuronal cell type diversification.

      Thanks!

      My one suggestion for the authors is to perhaps address in the Discussion (or experimentally address if they wish) how they reconcile that Bsh is on the one hand: (a) continuously expressed in L4/L4, (b) binding directly to a cohort of terminal effectors that are also continuously expressed but then, on the other hand, is not required for their maintaining L4 fate? A few questions: Is Bsh only NOT required for maintaining Ap expression or is it also NOT required for maintaining other terminal markers of L4? The former could be easily explained - Bsh simply kicks of Ap, Ap then autoregulates, but Bsh and Ap then continuously activate terminal effector genes. The second scenario would require a little more complex mechanism: Bsh binding of targets (with Notch) may open chromatin, but then once that's done, Bsh is no longer needed and Ap alone can continue to express genes. I feel that the authors should be at least discussing this. The postmitotic Bsh removal experiment in which they only checked Ap and depression of other markers is a little unsatisfying without further discussion (or experiments, such as testing terminal L4 markers). I hasten to add that this comment does not take away from my overall appreciation for the depth and quality of the data and the importance of their conclusions.

      Great suggestions, we will discuss these two hypotheses as requested.

      Bsh initiates Ap expression in L4 neurons which then maintain Ap expression independently of Bsh expression, likely through Ap autoregulation. During the synaptogenesis window, Ap expression becomes independent from Bsh expression, but Bsh and Ap are both still required to activate the synapse recognition molecule DIP-beta. Additionally, Bsh also shows putative binding to other L4 identity genes, e.g., those required for neurotransmitter choice, and electrophysiological properties, suggesting Bsh may initiate L4 identity genes as a suite of genes. The mechanism of maintaining identity features (e.g., morphology, synaptic connectivity, and functional properties) in the adult remains poorly understood. It is a great question whether primary HDTF Bsh maintains the expression of L4 identity genes in the adult. To test this, in our next project, we will specifically knock out Bsh in L4 neurons of the adult fly and examine the effect on L4 morphology, connectivity, and function properties.

      Reviewer #2 (Public Review):

      Summary:

      In this paper, the authors explore the role of the Homeodomain Transcription Factor Bsh in the specification of Lamina neuronal types in the optic lobe of Drosophila. Using the framework of terminal selector genes and compelling data, they investigate whether the same factor that establishes early cell identity is responsible for the acquisition of terminal features of the neuron (i.e., cell connectivity and synaptogenesis).

      Thanks for the positive words!

      The authors convincingly describe the sequential expression and activity of Bsh, termed here as 'primary HDTF', and of Ap in L4 or Pdm3 in L5 as 'secondary HDTFs' during the specification of these two neurons. The study demonstrates the requirement of Bsh to activate either Ap and Pdm3, and therefore to generate the L4 and L5 fates. Moreover, the authors show that in the absence of Bsh, L4 and L5 fates are transformed into a L1 or L3-like fates.

      Thanks!

      Finally, the authors used DamID and Bsh:DamID to profile the open chromatin signature and the Bsh binding sites in L4 neurons at the synaptogenesis stage. This allows the identification of putative Bsh target genes in L4, many of which were also found to be upregulated in L4 in a previous single-cell transcriptomic analysis. Among these genes, the paper focuses on Dip-β, a known regulator of L4 connectivity. They demonstrate that both Bsh and Ap are required for Dip-β, forming a feed-forward loop. Indeed, the loss of Bsh causes abnormal L4 synaptogenesis and therefore defects in several visual behaviors. The authors also propose the intriguing hypothesis that the expression of Bsh expanded the diversity of Lamina neurons from a 3 cell-type state to the current 5 cell-type state in the optic lobe.

      Thanks for the excellent summary of our findings!

      Strengths:

      Overall, this work presents a beautiful practical example of the framework of terminal selectors: Bsh acts hierarchically with Ap or Pdm3 to establish the L4 or L5 cell fates and, at least in L4, participates in the expression of terminal features of the neuron (i.e., synaptogenesis through Dip-β regulation).

      Thanks!

      The hierarchical interactions among Bsh and the activation of Ap and Pdm3 expression in L4 and L5, respectively, are well established experimentally. Using different genetic drivers, the authors show a window of competence during L4 neuron specification during which Bsh activates Ap expression. Later, as the neuron matures, Ap becomes independent of Bsh. This allows the authors to propose a coherent and well-supported model in which Bsh acts as a 'primary' selector that activates the expression of L4specific (Ap) and L5-specific (Pdm3) 'secondary' selector genes, that together establish neuronal fate.

      Thanks again!

      Importantly, the authors describe a striking cell fate change when Bsh is knocked down from L4/L5 progenitor cells. In such cases, L1 and L3 neurons are generated at the expense of L4 and L5. The paper demonstrates that Bsh in L4/L5 represses Zfh1, which in turn acts as the primary selector for L1/L3 fates. These results point to a model where the acquisition of Bsh during evolution might have provided the grounds for the generation of new cell types, L4 and L5, expanding lamina neuronal diversity for a more refined visual behaviors in flies. This is an intriguing and novel hypothesis that should be tested from an evo-devo standpoint, for instance by identifying a species when L4 and L5 do not exist and/or Bsh is not expressed in L neurons.

      Thanks for the appreciation of our findings!

      To gain insight into how Bsh regulates neuronal fate and terminal features, the authors have profiled the open chromatin landscape and Bsh binding sites in L4 neurons at mid-pupation using the DamID technique. The paper describes a number of genes that have Bsh binding peaks in their regulatory regions and that are differentially expressed in L4 neurons, based on available scRNAseq data. Although the manuscript does not explore this candidate list in depth, many of these genes belong to classes that might explain terminal features of L4 neurons, such as neurotransmitter identity, neuropeptides or cytoskeletal regulators. Interestingly, one of these upregulated genes with a Bsh peak is Dip-β, an immunoglobulin superfamily protein that has been described by previous work from the author's lab to be relevant to establish L4 proper connectivity. This work proves that Bsh and Ap work in a feed-forward loop to regulate Dip-β expression, and therefore to establish normal L4 synapses. Furthermore, Bsh loss of function in L4 causes impairs visual behaviors.<br /> Thanks for the excellent summary of our findings.

      Weaknesses:

      ● The last paragraph of the introduction is written using rhetorical questions and does not read well. I suggest rewriting it in a more conventional direct style to improve readability.

      We agree and have updated the text as suggested.

      ● A significant concern is the way in which information is conveyed in the Figures. Throughout the paper, understanding of the experimental results is hindered by the lack of information in the Figure headers. Specifically, the genetic driver used for each panel should be adequately noted, together with the age of the brain and the experimental condition. For example, R27G05-Gal4 drives early expression in LPCs and L4/L5, while the 31C06-AD, 34G07-DBD Split-Gal4 combination drives expression in older L4 neurons, and the use of one or the other to drive Bsh-KD has dramatic differences in Ap expression. The indication of the driver used in each panel will facilitate the reader's grasp of the experimental results.

      We agree and have updated the figure annotation.

      ● Bsh role in L4/L5 cell fate: o It is not clear whether Tll+/Bsh+ LPCs are the precursors of L4/L5. Morphologically, these cells sit very close to L5, but are much more distant from L4.

      Our current data show L4 and L5 neurons are generated by different LPCs. However, currently, we don’t have tools to demonstrate which subset of LPCs generate which lamina neuron type. We are currently working on a follow-up manuscript on LPC heterogeneity, but those experiments have just barely been started.

      ● Somatic CRISPR knockout of Bsh seems to have a weaker phenotype than the knockdown using RNAi. However, in several experiments down the line, the authors use CRISPR-KO rather than RNAi to knock down Bsh activity: it should be explained why the authors made this decision. Alternatively, a null mutant could be used to consolidate the loss of function phenotype, although this is not strictly necessary given that the RNAi is highly efficient and almost completely abolishes Bsh protein.

      The reason we chose CRISPR-KO (L4-specific Gal4, uas-Cas9, and uas-Bsh-sgRNAs) is that it effectively removed Bsh expression from the majority of L4 neurons. However, it failed to knock down Bsh in L4 neurons using L4-split Gal4 and Bsh-RNAi because L4-split Gal4 expression depends on Bsh. We have updated this explanation in the text.

      ● Line 102: Rephrase "R27G05-Gal4 is expressed in all LPCs and turned off in lamina neurons" to "is turned off as lamina neurons mature", as it is kept on for a significant amount of time after the neurons have already been specified.

      Thanks; we have made that change.

      ● Line 121: "(a) that all known lamina neuron markers become independent of Bsh regulation in neurons" is not an accurate statement, as the markers tested were not shown to be dependent on Bsh in the first place.

      Good point. We have rephrased it as “that all known lamina neuron markers are independent of Bsh regulation in neurons”.

      ● Lines 129-134: Make explicit that the LPC-Gal4 was used in this experiment. This is especially important here, as these results are opposite to the Bsh Loss of Function in L4 neurons described in the previous section. This will help clarify the window of competence in which Bsh establishes L4/L5 neuronal identities through ap/pdm3 expression.

      Thanks! We have updated Gal4 information in the text for every manipulation.

      ● DamID and Bsh binding profile:

      ● Figure 5 - figure supplement 1C-E: The genotype of the Control in (C) has to be described within the panel. As it is, it can be confused with a wild type brain, when it is in fact a Bsh-KO mutant.

      Great point! Thank you for catching this and we have updated it.

      ● It Is not clear how L4-specific Differentially Expressed Genes were found. Are these genes DEG between Lamina neurons types, or are they upregulated genes with respect to all neuronal clusters? If the latter is the case, it could explain the discrepancy between scRNAseq DEGs and Bsh peaks in L4 neurons.

      We did not use “L4-specific Differentially Expressed Genes”. Instead, we used all genes that are significantly transcribed in L4 neurons (line 209-213).

      ● Dip-β regulation:

      ● Line 234: It is not clear why CRISPR KO is used in this case, when Bsh-RNAi presents a stronger phenotype.

      As we explained above, the reason we chose CRISPR-KO (L4-specific Gal4, uas-Cas9, and uas-BshsgRNAs) is that it effectively removed Bsh expression from the majority of L4 neurons. However, it failed to knock down Bsh in L4 neurons using L4-split Gal4 and Bsh-RNAi because L4-split Gal4 expression depends on Bsh. We have updated this explanation in the text.

      ● Figure 6N-R shows results using LPC-Gal4. It is not clear why this driver was used, as it makes a less accurate comparison with the other panels in the figure, which use L4-Split-Gal4. This discrepancy should be acknowledged and explained, or the experiment repeated with L4-Split-Gal4>Ap-RNAi.

      I think you mean 6J-M shows results using LPC-Gal4. We first tried L4-Split-Gal4>Ap-RNAi but it failed to knock down Ap because L4-Split-Gal4 expression depends on Ap. We have added this to the text.

      ● Line 271: It is also possible that L4 activity is dispensable for motion detection and only L5 is required.

      Thanks! Work from Tuthill et al, 2013 showed that L5 is not required for any motion detection. We have included this citation in the text.

      ● Discussion: It is necessary to de-emphasize the relevance of HDTFs, or at least acknowledge that other, non-homeodomain TFs, can act as selector genes to determine neuronal identity. By restricting the discussion to HDTFs, it is not mentioned that other classes of TFs could follow the same PrimarySecondary selector activation logic.

      That is a great point, thank you! We have included this in the discussion.

    1. Author Response:

      We thank all reviewers for their comments and effort to improve our paper. We appreciate that the writing can be clarified overall, and some sections need more elaboration. We will provide these in the next revision within the coming months. Particularly, we will focus on some common themes identified by all reviewers:

      1. We will clarify that the coarse-grained brain surfaces are an output of our algorithm alone and not to be directly/naively likened to actual brain surfaces, e.g. in terms of the location or shape of the folds. Our analysis purely focuses on the likeliness in terms of whole-brain morphometrics between actual brains and coarse-grained brains. Specifically on the point of “thickening” of the brain: this is anatomically well-founded, as less folded brains have a “thicker” cortex than more folded brains, when they are all normalised to the same size. This is fundamentally why the universal scaling law also applies to these coarse-grained brains. We will provide more detail to highlight this.

      2. We will clarify the motivation behind our coarse-graining procedure better: mathematically, this is directly inspired by box-counting algorithms in fractal geometry; but this algorithm also has elegant parallels with other algorithms which we will highlight.

      3. The age effects are demonstrated here in a small sample as a proof-of-principle, but we will update our latest results using ~100 subjects from the CamCAN data demonstrating the same effect. We have additionally described and verified these age effects in more detail in a separate preprint (https://arxiv.org/abs/2311.13501) with ~1500 subjects, and additionally showed that scale-dependent metrics substantially improve understanding and applications such as brain age prediction.

      4. We have independently also received the feedback that we need to clarify how our method interacts with different resolution of the original MRI. We will add this as a new set of results, demonstrating that the MRI acquisition resolution (within a reasonable range) has a very small effect, as our method takes the reconstructed surfaces as a starting point.

      5. We agree that it may be confusing to emphasise a constant K in the first set of results across species, and then later highlight a changing K in the human ageing results. We will clarify that in the first set of results, we find a “constant” K relative to a changing S: The range in K across melted primate brains is approx 0.1, whereas in S it is over 1.2. In other words, S changes are an order of magnitude higher than K changes. Hence, we described K as “constant” relative to S. Nevertheless, K shows subtle changes within individuals, which is what we are describing in the human ageing results. These changes are within the range of K values described in the across species results.

      6. Finally, we will also make sure to summarise our specific contributions beyond existing work:

        (i) Showing for the first time that representative primate species follow the exact same fractal scaling – as opposed to previous work showing that they have a similar fractal dimension, i.e. slope, but not necessarily the same offset, as previous methods had no consistent way of comparing offsets.

        (ii) Previous work could also not show direct agreement in morphometrics between the coarse-grained brains of primate species and other non-primate mammalian species.

        (iii) Demonstrating in proof-of-principle that multiscale morphometrics, in practice, can have much larger effect sizes for classification applications. This moves beyond our previous work where we only showed the scaling law across and within species, but all on one (native) scale with comparable effect sizes for classification applications.

    1. Author Response

      Reviewer #2 (Public Review):

      Weaknesses:

      The paper contains multiple instances of non-scientific language, as indicated below. It would also benefit from additional details on the cryo-EM structure determination in the Methods and inclusion of commonly accepted requirements for cryo-EM structures, like examples of 2D class averages, raw micrographs, and FSC curves (between half-maps as well as between rigid-body fitted (or refined) atomic models of the different polymorphs and their corresponding maps). In addition, cryo-EM maps for the control experiments F1 and F2 should be presented in Figure 9.

      We will include the suggested data on the Cryo-EM analyses in a revised version of the preprint. We did not collect data on the sample used for the seeds in the cross seeding experiments because we had already confirmed in multiple datasets that the conditions in F1 and F2 reproducibly produce fibrils of Type 1 and Type 3, respectively. In a revised version we will include the analyses of several more datasets at the F1 and F2 conditions to support this statement.

      Reviewer #3 (Public Review):

      Weaknesses:

      1. The authors reveal that both Type 1 monofilament fibril polymorph (reminiscent of JOS-like polymorph) and Type 5 polymorph (akin to tissue-amplified-like polymorph) can both form under the same condition. Additionally, this condition also fosters the formation of flat ribbon-like fibril across different batches. Notably, at pH 5.8, variations in experimental groups yield disparate abundance ratios between polymorph 3B and 3C, indicating a degree of instability in fibrillar formation. The variability would potentially pose challenges for replicability in subsequent research. In light of these situations, I propose the following recommendations:

      (1) An explicit elucidation of the factors contributing to these divergent outcomes under similar experimental conditions is warranted. This should include an exploration of whether variations in purified protein batches are contributing factors to the observed heterogeneity.

      We are in complete agreement that understanding the factors that lead to polymorph variability is of utmost importance (and was the impetus for the manuscript itself). However the number of variables to explore is overwhelming and we will continue to investigate this in our future research. Regarding the variability between batches of purified protein, we also think that this could be a factor in the polymorph variability observed for otherwise “identical” aggregation conditions, particularly at pH 7 where the largest variety of polymorphs have been observed. While our data still indicates that Type 1,2 and 3 polymorphs are strongly selected by pH, the selection between interface variants 3B vs. 3C and 2A vs. 2B might also be affected by protein purity. Our standard purification protocol produces a single band by coomassie-stained SDS-PAGE however minor truncations and other impurities below a few percent would go undetected and, given the proposed roles of the N and C-termini in secondary nucleation, could have a large effect on polymorph selection and seeding. In line with the reviewer’s comments we now include a batch number for each EM dataset. While no new conclusions can be drawn from the inclusion of this additional data, we feel that it is important to acknowledge the possible role of batch to batch variability.

      (2) To enhance the robustness of the conclusions, additional replicates of the experiments under the same condition should be conducted, ideally a minimum of three times.

      The pH 5.8 conditions that yield Type 3 fibrils has already been repeated several times in the original manuscript. The pH 7.4 conditions were only mentioned twice, once as an unseeded and once as a cross-seeded fibrilization. We solved a second Type 1 structure from a second dataset from the same protein batch fibrillized under similar conditions at pH 7.4 but with the addition of inositol trisphosphate in the hopes that we could replicate one of the in vivo polymorphs. However only the Type 1 polymorphs were observed and so we will add this data point to the revised manuscript. We are currently screening more fibrils produced at pH 7.0 and will include any replicates of Type 5 or the Type 1M polymorphs or of new structures that are obtained at these conditions… however, as noted in the original manuscript, reproducibility at this pH might be difficult because there appears to be a wider range of accessible polymorphs. As will be mentioned in the revised version, the Type 5 structure was solved from a manually picked set of fibers that represented 10-20% of the observed fibrils. The remaining fibers in the sample comprised polymorphs that could not be analyzed due to their inhomogeneity or lack of twist.

      (3) Further investigation into whether different polymorphs formed under the same buffer condition could lead to distinct toxicological and pathology effects would be a valuable addition to the study.

      The correlation of toxicity with structure would in principle be interesting. However the Type 1 and Type 3 polymorphs formed at pH 5.8 and 7.4 are not likely to be biologically relevant. The pH 7 polymorphs (Type 5 and 1M) would be more interesting because they form under the same conditions and might be related to some disease relevant structures. Still, it is rare that a single polymorph appears at 7.0 (the Type 5 represented only 10-20% of the fibrils in the sample and the Type 1M also had unidentified double-filament fibrils in the sample). We plan to pursue this line of research and hope to include it in a future publication.

      1. The cross-seeding study presented in the manuscript demonstrates the pivotal role of pH conditions in dictating conformation. However, an intriguing aspect that emerges is the potential role of seed concentration in determining the resultant product structure. This raises a critical question: at what specific seed concentration does the determining factor for polymorph selection shift from pH condition to seed concentration? A methodological robust approach to address this should be conducted through a series of experiments across a range of seed concentrations. Such an approach could delineate a clear boundary at which seed concentration begins to predominantly dictate the conformation, as opposed to pH conditions. Incorporating this aspect into the study would not only clarify the interplay between seed concentration and pH conditions, but also add a fascinating dimension to the understanding of polymorph selection mechanisms.

      A more complete analysis of the mechanisms of aggregation, including the effect of seed concentration and the resulting polymorph specificity of the process, are all very important for our understanding of the aggregation pathways of alpha-synuclein and are currently the topic of ongoing investigations in our lab.

      Furthermore, the study prompts additional queries regarding the behavior of cross-seeding production under the same pH conditions when employing seeds of distinct conformation. Evidence from various studies, such as those involving E46K and G51D cross-seeding, suggests that seed structure plays a crucial role in dictating polymorph selection. A key question is whether these products consistently mirror the structure of their respective seeds.

      We thank the reviewer for reminding us to include a reference to these studies as a clear example of polymorph selection by cross-seeding which we will do in the revised version. Unfortunately, it is not 100% clear from the G51D cross seeding manuscript (https://doi.org/10.1038/s41467-021-26433-2) what conditions were used in the cross-seeding since different conditions were used for the seedless wild-type and mutant aggregations… however it appears that the wild-type without seeds was Tris pH 7.5 (although at 37C the pH could have dropped to 7-ish) and the cross-seeded wild-type was in Phosphate buffer at pH 7.0. In the E46K cross-seeding manuscript, it appears that pH 7.5 Tris was used for all fibrilizations (https://doi.org/10.1073/pnas.2012435118). In any event, both results point to the fact that at pH 7.0-7.5 under low-seed conditions (0.5%) the Type 4 polymorph can propagate in a seed specific manner.

      1. In the Results section of "The buffer environment can dictate polymorph during seeded nucleation", the authors reference previous cell biological and biochemical assays to support the polymorph-specific seeding of MSA and PD patients under the same buffer conditions. This discussion is juxtaposed with recent research that compares the in vivo biological activities of hPFF, ampLB as well as LB, particularly in terms of seeding activity and pathology. Notably, this research suggests that ampLB, rather than hPFF, can accurately model the key aspects of Lewy Body Diseases (LBD) (refer to: https://doi.org/10.1038/s41467-023-42705-5). The critical issue here is the need to reconcile the phenomena observed in vitro with those in in-vivo or in-cell models. Given the low seed concentration reported in these studies, it is imperative for the authors to provide a more detailed explanation as to why the possible similar conformation could lead to divergent pathologies, including differences in cell-type preference and seeding capability.

      We thank the reviewer for bring this recent report to our attention. The findings that ampLB and hPFF have different PK digestion patterns and that only the former is able to model key aspects of Lewy Body disease are in support of the seed-specific nature of some types of alpha-synuclein aggregation. We will add more discussion regarding the significant role that seed type and seed conditions likely play in polymorph selection.

      1. In the Method section of "Image processing", the authors describe the helical reconstruction procedure, without mentioning much detail about the 3D reconstruction and refinement process. For the benefit of reproducibility and to facilitate a deeper understanding among readers, the authors should enrich this part to include more comprehensive information, akin to the level of detail found in similar studies (refer to: https://doi.org/10.1038/nature23002).

      As suggested by reviewer #2, we will add more comprehensive information on the 3D reconstruction and refinement process to a revised version.

      1. The abbreviation of amino acids should be unified. In the Results section "On the structural heterogeneity of Type 1 polymorphs", the amino acids are denoted using three-letter abbreviation. Conversely, in the same section under "On the structural heterogeneity of Type 2 and 3 structures", amino acids are abbreviated using the one-letter format. For clarity and consistency, it is essential that a standardized format for amino acid abbreviations be adopted throughout the manuscript.

      That makes perfect sense and will be corrected in a revised version.

      Reviewing Editor:

      After discussion among the reviewers, it was decided that point 2 in Reviewer #3's Public Review (about the experiments with different concentrations of seeds) would probably lie outside the scope of a reasonable revision for this work.

      We agree as stated above and will continue to work on this important point.

    1. Author Response

      The following is the authors’ response to the original reviews.

      Public Reviews:

      Reviewer #1 (Public Review):

      Strengths

      This paper is well situated theoretically within the habit learning/OCD literature.

      Daily training in a motor-learning task, delivered via smartphone, was innovative, ecologically valid and more likely to assay habitual behaviors specifically. Daily training is also more similar to studies with non-humans, making a better link with that literature. The use of a sequential-learning task (cf. tasks that require a single response) is also more ecologically valid.

      The in-laboratory tests (after the 1 month of training) allowed the researchers to test if the OCD group preferred familiar, but more difficult, sequences over newer, simpler sequences.

      The authors achieved their aims in that two groups of participants (patients with OCD and controls) engaged with the task over the course of 30 days. The repeated nature of the task meant that 'overtraining' was almost certainly established, and automaticity was demonstrated. This allowed the authors to test their hypotheses about habit learning. The results are supportive of the authors' conclusions.

      Response: We truly appreciate the positive assessment of referee 1, particularly the consideration that our study is theoretically strong and that ‘the results are supportive of the authors' conclusions’. This is an important external endorsement of our conclusions, contrasting somewhat with the views of referee 2.

      Weaknesses

      The sample size was relatively small. Some potentially interesting individual differences within the OCD group could have been examined more thoroughly with a bigger sample (e.g., preference for familiar sequences). A larger sample may have allowed the statistical testing of any effects due to medication status. The authors were not able to test one criterion of habits, namely resistance to devaluation, due to the nature of the task

      Response: We agree with the reviewer that the proof of principle established in our study opens new avenues for research into the psychological and behavioral determinants of the heterogeneity of this clinical population. However, considering the study timeline and the pandemic constraints, a bigger sample was not possible. Our sample can indeed be considered small if one compares it with current online studies, which do not require in-person/laboratory testing, thus being much easier to recruit and conduct. However, given the nature of our protocol (with 2 demanding test phases, 1-month engagement per participant and the inclusion of OCD patients without comorbidities only) and the fact that this study also involved laboratory testing, we consider our sample size reasonable and comparable to other laboratory studies (typically comprising on average between 30-50 participants in each group).

      This article is likely to be impactful -- the delivery of a task across 30 days to a patient group is innovative and represents a new approach for the study of habit learning that is superior to an inlaboratory approach.

      An interesting aspect of this manuscript is that it prompts a comparison with previous studies of goal-directed/habitual responding in OCD that used devaluation protocols, and which may have had their effects due to deficits in goal-directed behavior and not enhanced habit learning per se.

      Response: Thank you for acknowledging the impact of our study, in particular the unique ability of our task to interrogate the habit system.

      Reviewer #2 (Public Review):

      In this study, the researchers employed a recently developed smartphone application to provide 30 days of training on action sequences to both OCD patients and healthy volunteers. The study tested learning and automaticity-related measures and investigated the effects of several factors on these measures. Upon training completion, the researchers conducted two preference tests comparing a learned and unlearned action sequences under different conditions. While the study provides some interesting findings, I have a few substantial concerns:

      1. Throughout the entire paper, the authors' interpretations and claims revolve around the domain of habits and goal-directed behavior, despite the methods and evidence clearly focusing on motor sequence learning/procedural learning/skill learning. There is no evidence to support this framing and interpretation and thus I find them overreaching and hyperbolic, and I think they should be avoided. Although skills and habits share many characteristics, they are meaningfully distinguishable and should not be conflated or mixed up. Furthermore, if anything, the evidence in this study suggests that participants attained procedural learning, but these actions did not become habitual, as they remained deliberate actions that were not chosen to be performed when they were not in line with participants' current goals.

      Response: We acknowledge that the research on habit learning is a topic of current controversy, especially when it comes to how to induce and measure habits in humans. Therefore, within this context referee’s 2 criticism could be expected. Across distinct fields of research, different methodologies have been used to measure habits, which represent relatively stereotyped and autonomous behavioral sequences enacted in response to a specific stimulus without consideration, at the time of initiation of the sequence, of the value of the outcome or any representation of the relationship that exists between the response and the outcome. Hence these are stimulus-bound responses which may or may not require the implementation of a skill during subsequent performance. Behavioral neuroscientists define habits similarly, as stimulus-response associations which are independent of reward or outcome, and use devaluation or contingency degradation strategies to probe habits (Dickinson and Weiskrantz, 1985; Tricomi et al., 2009). Others conceptualize habits as a form of procedural memory, along with skills, and use motor sequence learning paradigms to investigate and dissect different components of habit learning such as action selection, execution and consolidation (Abrahamse et al., 2013; Doyon et al., 2003; Squire et al., 1993). It is also generally agreed that the autonomous nature of habits and the fluid proficiency of skills are both usually achieved with many hours of training or practice, respectively (Haith and Krakauer, 2018).

      We consider that Balleine and Dezfouli (2019) made an excellent attempt to bring all these different criteria within a single framework, which we have followed. We also consider that our discussion in fact followed a rather cautious approach to interpretation solely in terms of goaldirected versus habitual control.

      Referee 2 does not actually specify criteria by which they define habits and skills, except for asserting that skilled behavior is goal-directed, without mentioning what the actual goal of the implantation of such skill is in the present study: the fulfillment of a habit? We assume that their definition of habit hinges on the effects of devaluation, as a single criterion of habit, but which according to Balleine and Dezfouli (2019) is only 1 of their 4 listed criteria. We carefully addressed this specific criterion in our manuscript: “We were not, however, able to test the fourth criterion, of resistance to devaluation. Therefore, we are unable to firmly conclude that the action sequences are habits rather than, for example, goal-directed skills. Regardless of whether the trained action sequences can be defined as habits or goal-directed motor skills, it has to be considered…”. Therefore, we took due care in our conclusions concerning habits and thus found the referee’s comment misleading and unfair.

      We note that our trained motor sequences did in fact fulfil the other 3 criteria listed by Balleine and Dezfouli (2019), unlike many studies employing only devaluation (e.g. Tricomi et al 2009; Gillan et al 2011). Moreover, we cited a recent study using very similar methodology where the devaluation test was applied and shown to support the habit hypothesis (Gera et al., 2022).

      Whether the initiation of the trained motor sequences in experiment 3 (arbitration) is underpinned by an action-outcome association (or not) has no bearing on whether those sequences were under stimulus-response control after training (experiment 1). Transitions between habitual and goal-directed control over behavior are quite well established in the experimental literature, especially when choice opportunities become available (Bouton et al (2021), Frölich et al (2023), or a new goal-directed schemata is recruited to fulfill a habit (Fouyssac et al, 2022). This switching between habits and goal-directed responding may reflect the coordination of these systems in producing effective behavior in the real world.

      • Fouyssac M, Peña-Oliver Y, Puaud M, Lim NTY, Giuliano C, Everitt BJ, Belin D. (2021).Negative Urgency Exacerbates Relapse to Cocaine Seeking After Abstinence. Biological Psychiatry. doi: 10.1016/j.biopsych.2021.10.009

      • Frölich S, Esmeyer M, Endrass T, Smolka MN and Kiebel SJ (2023) Interaction between habits as action sequences and goal-directed behavior under time pressure. Front. Neurosci. 16:996957. doi: 10.3389/fnins.2022.996957

      • Bouton ME. 2021. Context, attention, and the switch between habit and goal-direction in behavior. Learn Behav 49:349– 362. doi:10.3758/s13420-021-00488-z

      1. Some methodological aspects need more detail and clarification.

      2. There are concerns regarding some of the analyses, which require addressing.

      Response: We thank referee 2 for their detailed review of the methods and analyses of our study and for the helpful feedback, which clearly helps improve our manuscript. We will clarify the methodological aspects in detail and conduct the suggested analysis. Please see below our answers to the specific points raised.

      Introduction:

      1. It is stated that "extensive training of sequential actions would more rapidly engage the 'habit system' as compared to single-action instrumental learning". In an attempt to describe the rationale for this statement the authors describe the concept of action chunking, its benefits and relevance to habits but there is no explanation for why sequential actions would engage the habit system more rapidly than a single-action. Clarifying this would be helpful.

      Response: We agree that there is no evidence that action sequences become habitual more readily than single actions, although action sequences clearly allow ‘chunking’ and thus likely engage neural networks including the putamen which are implicated in habit learning as well as skill. In our revised manuscript we will instead state: “we have recently postulated that extensive training of sequential actions could be a means for rapidly engaging the ‘habit system’ (Robbins et al., 2019)]”

      DONE in page 2

      1. In the Hypothesis section the authors state: “we expected that OCD patients... show enhanced habit attainment through a greater preference for performing familiar app sequences when given the choice to select any other, easier sequence”. I find it particularly difficult to interpret preference for familiar sequences as enhanced habit attainment.

      Response: We agree that choice of the familiar response sequence should not be a necessary criterion for habitual control although choice for a familiar sequence is, in fact, not inconsistent with this hypothesis. In a recent study, Zmigrod et al (2022) found that 'aversion to novelty' was a relevant factor in the subjective measurement of habitual tendencies. It should also be noted that this preference was present in patients with OCD. If one assumes instead, like the referee, that the familiar sequence is goal-directed, then it contravenes the well-known 'egodystonia' of OCD which suggests that such tendencies are not goal-directed.

      To clarify our hypothesis, we will amend the sentence to the following: “Finally, we expected that OCD patients would generally report greater habits, as well as attribute higher intrinsic value to the familiar app sequences manifested by a greater preference for performing them when given the choice to select any other, easier sequence”.

      DONE in page 5. We have now rephrased it: “Additionally, we hypothesized that OCD patients would generally display stronger habits and assign greater intrinsic value to the familiar app sequences, evidenced by a marked preference for executing them even when presented with a simpler alternative sequence.”

      A few notes on the task description and other task components:

      1. It would be useful to give more details on the task. This includes more details on the time/condition of the gradual removal of visual and auditory stimuli and also on the within practice dynamic structure (i.e., different levels appear in the video).

      Response: These details will be included in the revised manuscript. Thank you for pointing out the need for further clarification of the task design.

      Done in page 7

      1. Some more information on engagement-related exclusion criteria would be useful (what happened if participants did not use the app for more than one day, how many times were allowed to skip a day etc.).

      Response: This additional information will be added to the revised manuscript. If participants omitted to train for more than 2 days, the researcher would send a reminder to the participant to request to catch up. If the participant would not react accordingly and a third day would be skipped, then the researcher would call to understand the reasons for the lack of engagement and gauge motivation. The participant would be excluded if more than 5 sequential days of training were missed. Only 2 participants were excluded given their lack of engagement.

      Done in page 8

      1. According to the (very useful) video demonstrating the task and the paper describing the task in detail (Banca et al., 2020), the task seems to include other relevant components that were not mentioned in this paper. I refer to the daily speed test, the daily random switch test, and daily ratings of each sequence's enjoyment and confidence of knowledge.

      If these components were not included in this procedure, then the deviations from the procedure described in the video and Banca al. (2020) should be explicitly mentioned. If these components were included, at least some of them may be relevant, at least in part, to automaticity, habitual action control, formulation of participants' enjoyment from the app etc. I think these components should be mentioned and analyzed (or at least provide an explanation for why it has been decided not to analyze them).

      This is also true for the reward removal (extinction) from the 21st day onwards which is potentially of particular relevance for the research questions.

      Response: The task procedure was indeed the same as detailed in Banca et al., 2020. We did not include these extra components in this current manuscript for reasons of succinctness and because the manuscript was already rather longer than a common research article, given that we present three different, though highly inter-dependent, experiments in order to answer key interrelated questions in an optimal manner. However, since referee 2 considers this additional analysis to be important, we will be happy to include it in the supplementary material of the revised manuscript.

      These additional components of the task as well as the respective analysis are now described in the Supplementary Materials.

      Training engagement analysis:

      1. I find referring to the number of trials including successful and unsuccessful trials as representing participants "commitment to training" (e.g. in Figure legend 2b) potentially inadequate. Given that participants need at least 20 successful trials to complete each practice, more errors would lead to more trials. Therefore, I think this measure may mostly represent weaker performance (of the OCD patients as shown in Figure 2b). Therefore, I find the number of performed practice runs, as used in Figure 2a (which should be perfectly aligned with the number of successful trials), a "clean" and proper measure of engagement/commitment to training.

      Response: We acknowledge referee’s concern on this matter and agree to replace the y-axis variable of Figure 2b to the number of performed practices (thus aligning with Figure 2a). This amendment will remove any potential effect of weaker performance on the engagement measurement and will provide clearer results.

      We have now decided to remove this figure as it does not add much to figure 2a. Instead, we replaced figure 2b and 2c for new plots, following new analysis linked to the next reviewer request (point 10)

      1. Also, to provide stronger support for the claim about different diurnal training patterns (as presented in Figure 2c and the text) between patients and healthy individuals, it would be beneficial to conduct a statistical test comparing the two distributions. If the results of this test are not significant, I suggest emphasizing that this is a descriptive finding.

      Response: Done, see revised Figure 2b and 2c. We have assessed the diurnal training patterns within each group using circular statistics, followed by independent-sample statistical testing of those circular distributions with the Watson’s U2 test ( Landler et al., 2021). While OCD participants have a group effect of practice with a significant peak at ~18:00, and HV participants have an earlier significant peak at ~15:00, the Watson’s U test did not find statistical betweengroup differences.

      • Landler L, Ruxton GD, Malkemper EP. Advice on comparing two independent samples of circular data in biology. Scientific reports. 2021 Oct 13;11(1):20337.

      Learning results:

      1. When describing the Learning results (p10) I think it would be useful to provide the descriptive stats for the MT0 parameter (as done above for the other two parameters).

      Response: Thank you for pointing this out. The descriptive stats for MT0 will be added to the revised version of the manuscript.

      Done page 11

      1. Sensitivity of sequence duration and IKI consistency (C) to reward:

      I think it is important to add details on how incorrect trials were handled when calculating ∆MT (or C) and ∆R, specifically in cases where the trial preceding a successful trial was unsuccessful. If incorrect trials were simply ignored, this may not adequately represent trial-by-trial changes, particularly when testing the effect of a trial's outcome on performance change in the next trial.

      Response: This is an important question. Our analysis protocol was designed to ensure that incorrect trials do not contaminate or confound the results. To estimate the trial-to-trial difference in ∆MT (or C) and ∆R, we exclusively included pairs of contiguous trials where participants achieved correct performance and received feedback scores for both trials. For example, if a participant made a performance error on trial 23, we did not include ∆R or ∆MT estimates for the pairs of trials 23-22 and 24-23. Instead of excluding incorrect trials from our analyses, we retained them in our time series but assigned them a NaN (not a number) value in Matlab. As a result, ∆R and ∆MT was not defined for those two pairs of trials. Similarly for C. This approach ensured that our analyses are not confounded by incremental or decremental feedback scores between noncontiguous trials. In the past, when assessing the timing of correct actions during skilled sequence performance, we also considered events that were preceded and followed by correct actions. This excluded effects such as post-error slowing from contaminating our results (Herrojo Ruiz et al., 2009, 2019). Therefore, we do not believe that any further reanalysis is required.

      • Ruiz MH, Jabusch HC, Altenmüller E. Detecting wrong notes in advance: neuronal correlates of error monitoring in pianists. Cerebral cortex. 2009 Nov 1;19(11):2625-39.

      • Bury G, García-Huéscar M, Bhattacharya J, Ruiz MH. Cardiac afferent activity modulates early neural signature of error detection during skilled performance. NeuroImage. 2019 Oct 1;199:704-17.

      1. I have a serious concern with respect to how the sensitivity of sequence duration to reward is framed and analyzed. Since reward is proportional to performance, a reduction in reward essentially indicates a trial with poor performance, and thus even regression to the mean (along with a floor effect in performance [asymptote]) could explain the observed effects. It is possible that even occasional poor performance could lead to a participant demonstrating this effect, potentially regardless of the reward. Accordingly, the reduced improvement in performance following a reward decrease as a function of training length described in Figure 5b legend may reflect training-induced increased performance that leaves less room for improvement after poor trials, which are no longer as poor as before. To address this concern, controlling for performance (e.g., by taking into consideration the baseline MT for the previous trial) may be helpful. If the authors can conduct such an analysis and still show the observed effect, it would establish the validity of their findings."

      Response: Thank you for raising this point. This has been done, see updated Figures 5 and 6. After normalizing the ∆MT(n+1) := MT(n+1) – MT(n) difference values by dividing them with the baseline MT(n) at trial n, we obtain the same results. Similar results are also obtained for IKI consistency (C).

      See below our initial response from June 2023.

      Thank you for raising this point. Figure 5b illustrates two distinct effects of reward changes on behavioral adaptation, which are expected based on previous research.

      I. Practice effects: Firstly, we observe that as participants progress across bins of practice, the degree of improvement in behavior (reflected by faster movement time, MT) following a decrease in reward (∆R−) diminishes, consistent with our expectations based on previous work. Conversely, we found that ∆MT does not change across bins of practices following an increase in reward (∆R+).

      We appreciate the reviewer’s suggestion regarding controlling for the reference movement time (MT) in the previous trial when examining the practice effect in the p(∆T|∆R−) and p(∆T|∆R+) distributions. In the revised manuscript, we will conduct the proposed control analysis to better understand whether the sensitivity of MT to score decrements changes across practice when normalising MT to the reference level on each trial. But see below for a preliminary control analysis.

      II. Asymmetry of the effect of ∆R− and ∆R+ on performance: Figure 5b also depicts the distinct impact of score increments and decrements on behavioural changes. When aggregating data across practice bins, we consistently observed that the centre of the p(∆T|∆R−) distribution was smaller (more negative) than that of p(∆T|∆R+). This suggests that participants exhibited a greater acceleration following a drop in scores compared to a relative score increase, and this effect persisted throughout the practice sessions. Importantly, this enhanced sensitivity to losses or negative feedback (or relative drops in scores) aligns with previous research findings (Galea et al., 2015; Pekny et al., 2014; van Mastrigt et al., 2020).

      We have conducted a preliminary control analysis to exclude the potential impact that reference movement time (MT) values could have on our analysis. We have assessed the asymmetry between behavioural responses to ∆R− and ∆R+ using the following analysis: We estimated the proportion of trials in which participants exhibited speed-up (∆T < 0) or slow-down (∆T > 0) behaviour following ∆R− and ∆R+ across different practice bins (bins 1 to 4). By discretising the series of behavioural changes (∆T) into binary values (+1 for slowing down, -1 for speeding up), we can assess the type of changes (speed-up, slow-down) without the absolute ∆T or T values contributing to our results. We obtained several key findings:

      • Consistent with expectations (sanity check), participants exhibited more instances of speeding up than slowing down across all reward conditions.

      • Participants demonstrated a higher frequency of speeding up following ∆R− compared to ∆R+, and this asymmetry persisted throughout the practice sessions (greater proportion of -1 events than +1 events). 53% events were speed-up events in the in the p(∆T|∆R+) distribution for the first bin of practices, and 55% for the last bin. Regarding p(∆T|∆R-), there were 63% speed-up events throughout each bin of practices, with this proportion exhibiting no change over time.

      • Accordingly, the asymmetry of reward changes on behavioural adaptations, as revealed by this analysis, remained consistent across the practice bins.

      Thus, these preliminary findings provide an initial response to referee 2 and offer valuable insights into the asymmetrical effects of positive/negative reward changes on behavioural adaptations. We plan to include these results in the revised manuscript, as well as the full control analysis suggested by the referee. We will further expand upon their interpretation and implications.

      1. Another way to support the claim of reward change directionality effects on performance (rather than performance on performance), at least to some extent, would be to analyze the data from the last 10 days of the training, during which no rewards were given (pretending for analysis purposes that the reward was calculated and presented to participants). If the effect persists, it is less unlikely that the effect in question can be attributed to the reward dynamics.

      Response: The reviewer’s concern is addressed in the previous quesQon. Also, this analysis would not be possible because our Gaussian fit analyses use the Qme series of conQnuous reward scores, in which ∆R− or ∆R+ are embedded. These events cannot be analyzed once reward feedback is removed because we do not have behavioral events following ∆R− or ∆R+ anymore.

      Done

      1. This concern is also relevant and should be considered with respect to the sensitivity of IKI consistency (C) to reward. While the relationship between previous reward/performance and future performance in terms of C is of a different structure, the similar potential confounding effects could still be present.

      Response: We will conduct this analysis for the revised manuscript, similarly to the control analysis suggested by referee 2 on MT. Our preliminary control analysis, as explained above, suggests that the fundamental asymmetry in the effect of ∆R+ and ∆R+ on behavioral changes persists when excluding the impact of reference performance values in our Gaussian fit analysis.

      Done. See updated Figure 6. The results are very similar once we normalize the IKI consistency index C with the IKI of the baseline performance at trial n.

      1. Another related question (which is also of general interest) is whether the preferred app sequence (as indicated by the participants for Phase B) was consistently the one that yielded more reward? Was the continuous sequence the preferred one? This might tell something about the effectiveness of the reward in the task.

      Response: We have now conducted this analysis. There is in fact no evidence to conclude that the continuously rewarded sequence was the preferred one. The result shows that 54.5% of HV and 29% of the OCD sample considered the continuous sequence to be their preferred one, a nonstatistically significant difference. Note that this preference may not necessarily be linked simply to programmed reward. The overall preference may be influenced by many other factors, such as, for example, the aesthetic appeal of particular combinations of finger movements.

      Regarding both experiments 2 and 3:

      1. The change in context in experiment 2 and 3 is substantial and include many different components. These changes should be mentioned in more detail in the Results section before describing the results of experiments 2 and 3.

      Response: Following referee’s advice, we will move these details (currently written in the Methods section) to the Results section, when we introduce Phase B and before describing the results of experiments 2 and 3.

      Done in page 21

      Experiment 2:

      1. In Experiment 2, the authors sometimes refer to the "explicit preference task" as testing for habitual and goal-seeking sequences. However, I do not think there is any justification for interpreting it as such. The other framings used by the authors - testing whether trained action sequences gain intrinsic/rewarding properties or value, and preference for familiar versus novel action sequences - are more suitable and justified. In support of the point I raised here, assigning intrinsic rewarding properties to the learned sequences and thereby preferring these sequences can be conceptually aligned with goal-directed behavior just as much as it could be with habit.

      Response: We clearly defined the theoretical framing of experiment 2 as a test of whether trained action sequences gain intrinsic value and we are pleased to hear that the referee agrees with this framing. If the referee is referring to the paragraph below (in the Discussion), we actually do acknowledge within this paragraph that a preference for the trained sequences can either be conceptually aligned with a habit OR a goal-directed behavior.

      “On the other hand, we are describing here two potential sources of evidence in favor of enhanced habit formation in OCD. First, OCD patients show a bias towards the previously trained, apparently disadvantageous, action sequences. In terms of the discussion above, this could possibly be reinterpreted as a narrowing of goals in OCD (Robbins et al., 2019) underlying compulsive behavior, in favor of its intrinsic outcomes”

      This narrowing of goals model of OCD refers to a hypothetically transiQonal stage of compulsion development driven by behavior having an abnormally strong, goal-directed nature, typically linked to specific values and concerns.

      If the referee is referring to the penulQmate sentence of hypothesis secQon, this has been amended in response to Q5. We cannot find any other possible instances in this manuscript stating that experiment 2 is a test of habitual or goal-directed behavior.

      Experiment 3:

      1. Similar to Experiment 2, I find the framing of arbitration between goal-directed/habitual behavior in Experiment 3 inadequate and unjustified. The results of the experiment suggest that participants were primarily goal-directed and there is no evidence to support the idea that this reevaluation led participants to switch from habitual to goal-directed behavior.

      Also, given the explicit choice of the sequence to perform participants had to make prior to performing it, it is reasonable to assume that this experiment mainly tested bias towards familiar sequence/stimulus and/or towards intrinsic reward associated with the sequence in value-based decision making.

      Response: This comment is aligned with (and follows) the referee’s criticism of experiment 1 not achieving automatic and habitual actions. We have addressed this matter above, in response 1 to Referee 2.

      Mobile-app performance effect on symptomatology: exploratory analyses:

      1. Maybe it would be worth testing if the patients with improved symptomatology (that contribute some of their symptom improvement to the app) also chose to play more during the training stage.

      Response: We have conducted analysis to address this relevant question. There is no correlation between the YBOCS score change and the number of total practices, meaning that the patients who improved symptomatology post training did not necessarily chose to play the app more during the training stage (rs = 0.25, p = 0.15). Additionally, we have statistically compared the improvers (patients with reduced YBOCS scores post-training) and the non-improvers (patients with unchanged or increased YBOCS scores post-training) in their number of app completed practices during the training phase and no differences were observed (U = 169, p = 0.19).

      The result from the correlational analysis has been added to the revised manuscript (page 28).

      Discussion:

      1. Based on my earlier comments highlighting the inadequacy and mis-framing of the work in terms of habit and goal-directed behavior, I suggest that the discussion section be substantially revised to reflect these concerns.

      Response: We do not agree that the work is either "inadequate or mis-framed" and will not therefore be substantially revising the Discussion. We will however clarify further the interpretation we have made and make explicit the alternative viewpoint of the referee. For example, we will retitle experiment 3 as “Re-evaluation of the learned action sequence: possible test of goal/habit arbitration” to acknowledge the referee’s viewpoint as well as our own interpretation.

      Done

      1. In the sentence "Nevertheless, OCD patients disadvantageously preferred the previously trained/familiar action sequence under certain conditions" the term "disadvantageously" is not necessarily accurate. While there was potentially more effort required, considering the possible presence of intrinsic reward and chunking, this preference may not necessarily be disadvantageous. Therefore, a more cautious and accurate phrasing that better reflects the associated results would be useful.

      Response: We recognize that the term "disadvantageously" may be semantically ambiguous for some readers and therefore we will remove it.

      Done

      Materials and Methods:

      1. The authors mention: "The novel sequence (in condition 3) was a 6-move sequence of similar complexity and difficulty as the app sequences, but only learned on the day, before starting this task (therefore, not overtrained)." - for the sake of completeness, more details on the pre-training done on that day would be useful.

      Response: Details of the learning procedure of the novel sequence (in condition 3, experiment 3) will be provided in the methods of the revised version of the manuscript.

      Done in page 40

      Minor comments:

      1. In the section discussing the sensitivity of sequence duration to reward, the authors state that they only analyzed continuous reward trials because "a larger number of trials in each subsample were available to fit the Gaussian distributions, due to feedback being provided on all trials." However, feedback was also provided on all trials in the variable reward condition, even though the reward was not necessarily aligned with participants' performance. Therefore, it may be beneficial to rephrase this statement for clarity.

      Response: We will follow this referee’s advice and will rephrase the sentence for clarity.

      Done. See page 16.

      1. With regard to experiment 2 (Preference for familiar versus novel action sequences) in the following statement "A positive correlation between COHS and the app sequence choice (Pearson r = 0.36, p = 0.005) further showed that those participants with greater habitual tendencies had a greater propensity to prefer the trained app sequence under this condition." I find the use of the word "further" here potentially misleading.

      Response: The word "further" will be removed.

      Done

      Reviewer #1 (Recommendations For The Authors):

      This is a very interesting manuscript, which was a pleasure to review. I have some minor comments you may wish to consider.

      1. I believe that it is possible to include videos as elements in eLife articles - please consider if you can do this to demonstrate the action sequence on the smartphone. I followed the YouTube video, and it was very helpful to see exactly what participants did, but it would be better to attach the video directly, if possible.

      Response: This is a great idea and we will definitely attach our video demonstrating the task to the revised manuscript (Version of Record) if the eLife editors allow.

      We ask permission to the editor to add the video

      1. The abstract states that the study uses a "novel smartphone app" but is the same one as described in Banca et al. Suggest writing simply "smartphone app".

      Response: We will remove the word novel.

      Done

      1. Some of the hypotheses described in the second half of the Hypothesis section could be stated more explicitly. For example: "We also hypothesized that the acquisition of learning and automaticity would differ between the two action sequences based on their associated rewarded schedule (continuous versus variable) and reward valence (positive or negative)." The subsequent sentence explains the prediction for the schedule but what is the hypothesized direction for reward valence? More detail is subsequently given on p. 14, Results, but it would be better to bring these details up to the Introduction. "We additionally examined differential effects of positive and negative feedback changes on performance to build on previous work demonstrating enhanced sensitivity to negative feedback in patients with OCD (Apergis-Schoute et al 2023, Becker et al., 2014; Kanen et al., 2019)." In general, the second part of the Hypothesis section is a bit dense, sometimes with two predictions per sentence. It could be useful for the reader if hypotheses were enumerated and/or if a distinction was made among the hypotheses with respect to their importance.

      We fully revised the hypothesis section, on page 5, following this reviewer’s suggestion. We think this section is much clearer now, in our revised manuscript.

      Response: Thank you for pointing out the need for clarity in our hypothesis section. This is a very important point and we will carefully rewrite our hypothesis in the revised manuscript to make them as clear as possible.

      1. Did medication status correlate with symptom severity in the OCD group (e.g., higher symptoms for the 6 participants on SSRI+antipsychotics?). Could this, or SSRI-only status, have impacted results in any way? I appreciate that there is no way to test medication status statistically but readers may be interested in your thoughts on this aspect.

      Response: We have now conducted exploratory analysis to assess the potential effect of medication in the following output measures: app engagement (as measured by completed practices), explicit preference and YBOCS change post-training. The patients who were on combined therapy (SSRIs + antipsychotic) did not perform significantly different in these measures as compared to the remaining patients and no other effects of interest were observed. Their symptomatology was indeed slightly more severe but not statistically significant [Y-BOCS combined = 26.2 (6.5); Y-BOCS SSRI only = 23.8 (6.1); Y-BOCS No Med = 23.8 (2.2), mean(std)]. Only one patient showed symptom improvement after the app training, another became worse and the remaining patients on combined therapy remain stable during the month.

      Palminteri et al (2011) found that unmedicated OCD patients exhibited instrumental learning deficits, which were fully alleviated with SSRI treatment. Therefore, it is possible that the SSRI medication (present in our sample) may have reduced habit formation and facilitated behavioral arbitration. However, since the effect goes against the habit hypothesis, it has is unlikely that it has confounded our measure of automaticity. If anything, medication rendered experiment 2 and 3 more goal-oriented. We agree that further studies are warranted to address the effect of SSRIs on these measures.

      1. You could explain earlier why devaluation could not be tested here (it is only explained in the Limitations section near the end)

      Response: The revised manuscript will be amended to account for this note.

      Done in page 25.

      1. Capitalize 'makey-makey', I didn't realize there was a product called Makey Makey until I Googled it.

      Response: Sure. We will capitalize 'Makey-Makey'. Thank you for pointing this out!

      Done

      Reviewer #2 (Recommendations For The Authors):

      Recommendations for the authors (ordered by the paper sections):

      In the introduction

      1. regarding this part "We used a period of 1-month's training to enable effective consolidation, required for habitual action control or skill retention to occur. This acknowledged previous studies showing that practice alone is insufficient for habit development as it also requires off-line consolidation computations, through longer periods of time (de Wit et al., 2018) and sleep (Nusbaum et al., 2018; Walker et al., 2003)." I advise the authors to re-check whether what is attributed here to de Wit et al. (2018) is indeed justified (if I remember correctly they have not mentioned anything about off-line consolidation computations).

      Response: When we revise the manuscript, we will remove the de Wit et al. (2018) citation from this sentence.

      Done

      in the Outline paragraph

      1. it stated: "We continuously collected data online, in real time, thus enabling measurements of procedural learning as well as automaticity development." I think this wording implies that the fact that the data was collected online in real time was advantageous in that it enabled to assess measurements of procedural learning and automaticity development, which in my understanding is not the case.

      Response: To make this sentence clearer, we will change it to the following: ‘We continuously collected data online, to monitor engagement and performance in real time and to enable acquisition of sufficient data to analyze, à posteriori, procedural learning and automaticity development’.

      Done in page 4: ‘We collected data online continuously to monitor engagement and performance in real-time. This approach ensured we acquired sufficient data for subsequent analysis of procedural learning and automaticity development’.

      1. In the final sentence of this paragraph "or and" should be changed to "or/end".

      Response: This was a typo. The word ‘and’ will be removed.

      Done

      1. In Figure 1c - Note that in the figure legend it says "Each sequence comprises 3 single press moves, 2 two-finger moves..." whereas in the example shown in the figure it's the other way around (2 single press moves and 3 two-finger moves).

      Response: Thank you so much for spotting this! The example shown in the figure is incorrect. We apologize for the mistake. It should depict 3 single press moves, 2 two-finger moves and 1 three- finger move. The figure will be amended.

      Done

      In the results section:

      1. Regarding the "were followed by a positive ring tone and the unsuccessful ones by a negative ring tone", I suggest mentioning that there was also a positive visual (rewarding) effect.

      Response: Thank you. A mention to the visual effect will be added for both the positive (successful) and negative (unsuccessful) trials. Done in page 7

      1. p 10. - Note a typo in the following sentence where the word "which" appears twice consecutively:

      "Furthermore, both groups exhibited similar motor durations at asymptote which, which combined with the previous conclusion, indicates that OCD patients improved their motor learning more than controls, but to the same asymptote."

      Response: Thank you for spotting this typo. The second word will be removed. Done

      1. I have a few suggestions with respect to Figure 3:

      2. keeping the y-axes scale similar in all subplots would be more visually informative.

      Here we kept the y-axes scale similar in all subplots, except one of them, which was important to keep to capture all the data.

      1. For the subplots in 3b I would recommend for the transparent regions, instead of the IQR, to use the median +/- 1.57 * IQR/sqrt(n) which is equivalent to how the notches are calculated in a box-plot figure (It is referred to as an approximate 95% confidence interval for the median). This should make the transparent area narrower and thus better communicate the results.

      Done

      1. I think the significant levels mentioned in figure legend 3b (which are referring to the group effect measured for each reward schedule type separately) is not mentioned in the text. While not crucial, maybe consider adding it in the text.

      We don’t think this is necessary and may actually lead to confusion because in the text we report a Kruskal–Wallis H test (which is the most appropriate statistical test), including their H and p values for the group and reward effects. Since in the figure we separated the analysis and plots for variable and continuous reward schedules (for visual purposes) , we reported a U test separated for each reward schedule. Therefore, we consider that the correct statistics are reported in the appropriate places of the manuscript.

      Response: Thank you for this very helpful suggestion. We will amend figure 3 accordingly.

      1. In the Automaticity results (pp. 12 and 13) when describing the Descriptive stats the wrong parameter indicator are used (DL instead of CL and nD instead of nC.

      Response: Thank you for noticing it. We will amend.

      Done

      1. In Sensitivity of IKI consistency (C) to reward results:

      In Figure 6a legend: with respect to "... and for reward increments (∆R+, purple) and decrements (∆R-, green)" - note that there are also additional colors indicating these ∆Rs.

      Response: Done. We had used a 2 x 2 color scheme: green hues for ∆R-, and purple hues for ∆R+. Then, OCD is denoted by dark colors, and HV by light colors. This represents all four colors used in the figure. For instance, OCD and ∆R- is dark green, whereas OCD and ∆R+ is denoted by dark purple.

      1. p.21 - the YBOCS abbreviation appears before the full form is spelled out in the text.

      Response: In the revised version, we will make sure the YBOCS abbreviation will be spelled out the first time it is mentioned.

      Done in page 24

      Experiments 2 and 3:

      1. If there is a reason behind presenting the conditions sequentially rather than using intermixed trials in experiments 2 and 3, it would be useful to mention it in the text.

      Response: Experiment 2 could have used intermixed trials. However, we were concerned that the use of intermixed trials in experiment 3 would increase excessively the memory load of the task, which could then be a confound.

      Done in page 41

      1. I wonder whether the presentation order of the conditions in experiments 2 and 3 affected participants' results? Maybe it is worth adding this factor to the analysis.

      Response: As we mentioned both in the methods and results sections, we counterbalanced all the conditions across participants, in both experiments 2 and 3. This procedure ensures no order effects.

      Experiment 2:

      1. Regarding this sentence (pp. 21-22): "However, some participants still preferred the app sequence, specifically those with greater habitual tendencies, including patients who considered the app training beneficial." I think the part that mentions that there are "patients who considered the app training beneficial" appears below and it may confuse the reader. I suggest either providing a brief explanation or indicating that further details will be provided later in the text ("see below in...").

      Response: We will clarify this section.

      We added “see below exploratory analyses of “Mobile-app performance effect on symptomatology”” in the end of the sentence so that the reader knows this is further explained below. Page 25

      1. Finally, in addition to subgrouping maybe it is worth testing whether there is a correlation between the YBOCS score change and the app-sequences preference (as to learn if the more they change their YBOCS the more they prefer the learned sequences and vice versa?)

      Response: Thank you for suggesting this relevant correlational analysis, which we have now conducted. Indeed, there is a correlation between the YBOCS score change and the preference for the app-sequences, meaning that the higher the symptom improvement after the month training, the greater the preference for the familiar/learned sequence. This is particularly the case for the experimental condition 2, when subjects are required to choose between the trained app sequence and any 3-move sequence (rs = 0.35, p=0.04). A trend was observed for the correlation between the YBOCS score change and the preference for the app-sequences in experimental condition 1 (app preferred sequence versus any 6-move sequence): rs = 0.30, p=0.09.

      This finding represents an additional corroboration of our conclusion that the app seems to be more beneficial to patients more prone to routine habits, who are somewhat more averse to novelty.

      This analysis was added in page 24, 25 and page 35.

      Experiment 3:

      1. You mention "The task was conducted in a new context, which has been shown to promote reengagement of the goal system (Bouton, 2021)." In my understanding this observation is true also for experiment 2. In such case it should be stated earlier (probably under: "Phase B: Tests of actionsequence preference and goal/habit arbitration").

      Response: As answered above in (Q17), we will follow this referee 2’s suggestion and describe the contextual details of experiments 2 and 3 in the Results section, when we introduce Phase B.

      Done in page 21.

      1. w.r.t this sentence - "...that sequence (Figure 8b, no group effects (p = 0.210 and BF = 0.742, anecdotal evidence)" I would add what the anecdotal evidence refers (as done in other parts of the paper), to prevent potential confusion.

      Response: OK, this will be added.

      Added on page 27

      Discussion:

      1. w.r.t. "Here we have trained a clinical population with moderately high baseline levels of stress and anxiety, with training sessions of a higher order of magnitude than in previous studies (de Wit et al., 2018, 2018; Gera et al., 2022) (30 days instead of 3 days)." The Gera et al. 2022 (was more than 3 days), you probably meant Gera et al. 2023 ("Characterizing habit learning in the human brain at the individual and group levels: a multi-modal MRI study", for which 3 days is true).

      Response: Thank you for pointing this out. We will keep the citation to Gera et al 2022 given its relevance to the sentence but we will remove the information inside the parenthesis. This amendment will solve the issue raised here.

      Done in page 32

      1. w.r.t "to a simple 2-element sequence with less training (Gera et al., 2022)" - it's a 3-element sequence in practice.

      Response: Thank you for this correction. We will amend this sentence accordingly.

      Done in page 32

      1. (p.30) w.r.t "and enhanced error-related negativity amplitudes in OCD" - a bit more context of what the negative amplitudes refer to would be useful (So the reader understands it refers to electrophysiology).

      Response: We will add a sentence in our revised manuscript addressing this matter. This sentence has been removed in the revised manuscript

      Supplementary materials:

      1. under "Sample size for the reward sensitivity analysis":

      It is stated "One practice corresponded to 20 correctly performed sequences. We therefore split the total number of correct sequences into four bins." I was not able to follow this reasoning here (20 correct trials in practice => splitting the data the 4 bins). More clarity here would be useful.

      Response: We will clarify this procedure of our analysis in the revised version of the manuscript. Thanks.

      Done. See Supplementary materials.

      1. Also, maybe I am missing something, but I couldn't understand why the number of sequences available per bin is different for the calculation of ∆MT and C. Aren't any two consecutive sequences that are good for the calculation of one of these measures also good for the calculation of the other?

      Response: Thank you for pointing this out. Indeed, the number of trials was the same for both analyses, ∆MT and C. We had saved an incorrect variable as number of trials. We will amend the text.

      We have re-analyzed the trial number data. The average number of trials per bin both for the ∆MT and C analyses was 109 (9) in the HV and 127 (12) in OCD groups. Although the number was on average larger in the patient group, we did not find significant differences between groups (p = 0.47).

      When assessing the p(∆T|∆R+) and p(∆T|∆R-) separately, more trials were available for p(∆T|∆R+), 107 (10) , than for p(∆T|∆R-), and 98 (8). These trial numbers differed significantly (p = 0.0046), but were identical for ∆MT and C analyses.

      Done. Included in Supplementary materials.

      Minor comments:

      1. Not crucial, but maybe for the sake of consistency consider merging the "Self-reported habit tendencies" section and the "Other self-reported symptoms" section, preferably where the latter is currently placed.

      Response: We fully understand the referee’s rationale underlying this suggestion. We indeed considered initially presenting the self-reported questionnaires all together, in a last, single section of the results, as suggested by the referee. However, we decided to report the higher habitual tendencies of OCD as an initial set of results, not only because it is a novel and important finding (which justifies it to be highlighted) but also because it is essential to the understanding of some of the remaining results presented.

      1. In some figure legends the percentage of the interval of the mentioned confidence intervals (probably 95%) is missing. I suggest adding it.

      Response: OK, this will be added.

      Done

      1. The NHS abbreviation appears without spelling out the full form.

      Response: This will be amended accordingly.

      I removed NHS as it is not relevant.

      1. In p.38 the citation (Rouder et al., 2012) is duplicated (appears twice consecutively).

      Response: Thank you for pointing this out. We will amend accordingly.

      Done

      In the results section:

      1. The authors mention: "To promote motivation, the total points achieved on each daily training sessions were also shown, so participants could see how well they improved across days". Yet, if the score is based on the number of practices, it may not represent participants improvement in case in some days more practices are performed. I suggest to clarify this point.

      Response: The goal of providing the scoring feedback was, as explained in the sentence, to gauge motivation and inform the subject about their performance. Having this goal in mind, it does not really matter if one day their scoring would be higher simply because they would have done more practice on that day. Participants could easily understand that the scoring reflected their performance on each practice so they would realize that the more practice, the greater their improvement and that the scoring would increase across days of practice. We will amend the sentence to the following: "To promote motivation, the total points achieved on each training session (i.e. practice) was also shown, so participants could see how well they improved across practice and across days".

      Done in page 7 and 8.

    1. Author Response

      Reviewer #3 (Public Review):

      [...] Weaknesses:

      The study produces a large amount of data that is in general cohesive and support the main conclusions, but more thorough considerations on some of their findings may be helpful, as exemplified by the following:

      1) the effect of microglial ablation on chloral hydrate-induced RORR in Fig. 1B appears to be not the same as other anesthetics. what does this mean?

      2) Macrophage ablation impedes anesthesia emergence from pentobarbital (Fig. 3C). how may this occur?

      3) examination of the potential effect of microglial depletion on dendritic spine density is interesting but the experimental design does not seem to align well with the PPR and eEPSC data, which indicate a reduction in presynaptic release (Fig.10E) and increase of postsynaptic function (Fig. 10H), respectively. The PPR data seems to suggest a presynaptic effect of microglia; ablation.

      This reviewer may confused the brain regions between our spine quantification (Figure 11) and patch-clamp recording (Figure 10). In our spine quantification, all evaluations were conducted in the mPFC. However, the patch-clamp recording were performed in SON (Figure 10 B-F) and LC (Figure 10 G-K), different brain regions from our spine quantification. As one of our conclusion, microglia differentially modulate the activity of neuronal network in a brain region-specific manner, neurons in different brain regions may exhibit different electrophysiological alterations upon microglial depletion. Therefore, this comment might be a factual error.

    1. Author Response

      The following is the authors’ response to the original reviews.

      Public Reviews:

      Reviewer #1 (Public Review):

      This is an interesting, timely and informative article. The authors used publicly available data (made available by a funding agency) to examine some of the academic characteristics of the individuals recipients of the National Institutes of Health (NIH) k99/R00 award program during the entire history of this funding mechanism (17 years, total ~ 4 billion US dollars (annual investment of ~230 million USD)). The analysis focuses on the pedigree and the NIH funding portfolio of the institutions hosting the k99 awardees as postdoctoral researchers and the institutions hiring these individuals. The authors also analyze the data by gender, by whether the R00 portion of the awards eventually gets activated and based on whether the awardees stayed/were hired as faculty at their k99 (postdoctoral) host institution or moved elsewhere. The authors further sought to examine the rates of funding for those in systematically marginalized groups by analyzing the patterns of receiving k99 awards and hiring k99 awardees at historically black colleges and universities.

      The goals and analysis are reasonable and the limitations of the data are described adequately. It is worth noting that some of the observed funding and hiring traits are in line with the Matthew effect in science (https://www.science.org/doi/10.1126/science.159.3810.56) and in science funding (https://www.pnas.org/doi/10.1073/pnas.1719557115). Overall, the article is a valuable addition to the research culture literature examining the academic funding and hiring traits in the United States. The findings can provide further insights for the leadership at funding and hiring institutions and science policy makers for individual and large-scale improvements that can benefit the scientific community.

      Thank you for these comments. We have incorporated the articles referenced on the Matthew effect into the first paragraph of the Discussion our revised preprint.

      Reviewer #2 (Public Review):

      Early career funding success has an immense impact on later funding success and faculty persistence, as evidenced by well-documented "rich-get-richer" or "Matthew effect" phenomena in science (e.g., Bol et al. 2018, PNAS). Woitowich et al. examined publicly available data on the distribution of the National Institutes of Health's K99/R00 awards - an early career postdoc-to-faculty transition funding mechanism - and showed that although 85% of K99 awardees successfully transitioned into faculty, disparities in subsequent R01 grant obtainment emerged along three characteristics: researcher mobility, gender, and institution. Men who moved to a top-25 NIH funded institution in their postdoc-to-faculty transition experienced the shortest median time to receiving a R01 award, 4.6 years, in contrast to the median 7.4 years for women working at less well-funded schools who remained at their postdoc institutions. This result is consistent with prior evidence of funding disparities by gender and institution type. The finding that researcher mobility has the largest effect on subsequent funding success is key and novel, and enhances previous work showing the relationship between mobility and ones' access to resources, collaborators, or research objects (e.g., Sugimoto and Larivière, 2023, Equity for Women in Science (Harvard University Press)).

      These results empirically demonstrate that even after receiving a prestigious early career grant, researchers with less mobility belonging to disadvantaged groups at less-resourced institutions continue to experience barriers that delay them from receiving their next major grant. This result has important policy implications aimed at reducing funding disparities - mainly that interventions that focus solely on early career or early stage investigator funding alone will not achieve the desired outcome of improving faculty diversity.

      The authors also highlight two incredible facts: No postdoc at a historically Black college or university (HBCU) has been awarded a K99 since the program's launch. And out of all 2,847 R00 awards given thus far, only two have been made to faculty at HBCUs. Given the track record of HBCUs for improving diversity in STEM contexts, this distribution of awards is a massive oversight that demands attention.

      At no fault of the authors, the analysis is limited to only examining K99 awardees and not those who applied but did not receive the award. This limitation is solely due to the lack of data made publicly available by the NIH. If this data were available, this study would have been able to compare the trajectory of winners versus losers and therefore could potentially quantify the impact of the award itself on later funding success, much like the landmark Bol et al. (2018) paper that followed the careers of winners of an early career grant scheme in the Netherlands. Such an analysis would also provide new insights that would inform policy.

      Although data on applications versus awards for the K99/R00 mechanism are limited, there exists data for applicant race and ethnicity for the 2007-2017 period, which were made available by a Freedom of Information Act request through the now defunct Rescuing Biomedical Research Initiative: https://web.archive.org/web/20180723171128/http://rescuingbiomedicalresearch.org/blog/examining-distribution-k99r00-awards-race/. These results are not presently discussed in the paper, but are highly relevant given the discussion of K99 award impacts on the sociodemographic composition of U.S. biomedical faculty. From 2007 to 2017, the K99 award rate for white applicants was 31.0% compared to 26.7% for Asian applicants and 16.2% for Black applicants. In terms of award totals, these funding rates amount to 1,384 awards to white applicants, 610 to Asian applicants, and 25 to Black applicants for the entire 2007-2017 period. And in terms of R00 awards, or successful faculty transitions: whereas 77.0% of white K99 awardees received an R00 award, the conversion rate for Asian and Black K99 awardees was lower, at 76.1% and 60.0%, respectively. Regarding this K99-to-R00 transition rate, Woitowich et al. found no difference by gender (Table 2). These results are consistent with a growing body of literature that shows that while there have been improvements to equity in funding outcomes by gender, similar improvements for achieving racial equity are lagging.

      The conclusions are well-supported by the data, and limitations of the data and the name-gender matching algorithm are described satisfactorily.

      One aspect that the authors should expand or comment on is the change in the rate of K99 to R00 conversions. Since 2016, while the absolute number of K99 and R00 awards has been increasing, the percentage of R00 conversions appears to be decreasing, especially in 2020 and 2021. This observation is not clearly stated or shown in Figure 1 but is an important point - if the effectiveness of the K99/R00 mechanism for postdoc-to-faculty transitions has been decreasing lately, then something is undermining the purpose of this mechanism. This result bears emphasis and potentially discussion for possible reasons for why this is happening.

      Thank you for these insightful comments. We now calculate a rolling conversion rate for K99 to R00 awards which shows there is not as much of a decline in conversion from K99 to R00 (Fig 1B). We still see a slight decline in 2021 and 2022. 468 K99 awards are from 2020 or later so they may still convert to the R00 phase. Thus it is difficult to draw conclusions about 2021/2022 yet. As more time passes, we may better be able to determine whether or not significant alteration from normal occurred in these years, presumably due to pressures from the Covid-19 pandemic. We also thank you for providing the details of the FOIA request. We have included a discussion of these data in the discussion.

      Reviewer #3 (Public Review):

      The researchers aim add to the literature on faculty career pathways with particular attention to how gender disparities persist in the career and funding opportunities of researchers. The researchers also examine aspects of institutional prestige that can further amplify funding and career disparities. While some factors about individuals' pathways to faculty lines are known, including the prospects of certain K award recipients, the current study provides the only known examination of the K99/R00 awardees and their pathways.

      Strengths:

      The authors establish a clear overview of the institutional locations of K99 and R00 awardees and the pathways for K99-to-R00 researchers and the gendered and institutional patterns of such pathways. For example, there's a clear institutional hierarchy of hiring for K99/R00 researchers that echo previous research on the rigid faculty hiring networks across fields, and a pivotal difference in the time between awards that can impact faculty careers. Moreover, there's regional clusters of hiring in certain parts of the US where multiple research universities are located. Moreover, documenting the pathways of HBCU faculty is an important extension of the Wapman et al. study (among others from that research group), and provides a more nuanced look at the pathways of faculty beyond the oft-discussed high status institutions. (However, there is a need for more refinement in this segment of the analyses as discussed further below.). Also, the authors provide important caveats throughout the manuscript about the study's findings that show careful attention to the complexity of these patterns and attempting to limit misinterpretations of readers.

      Weaknesses:

      The authors reference institutional prestige in relation to some of the findings, but there's no specific measure of institutional prestige included in the analyses. If being identified as a top 25 NIH-funded institution is the proximate measure for prestige in the study, then more justification of how that relates to previous studies' measures of institutional prestige and status are needed to further clarify the interpretations offered in the manuscript.

      The identification of institutional funding disparities impacting HBCUs is an important finding and highlights another aspect of how faculty at these institutions are under resourced and arguably undervalued in their research contributions. However, a lingering question exists: why compare HBCUs with Harvard? What are the theoretical and/or methodological justifications for such comparisons? This comparison lends itself to reifying the status hierarchy of institutions that perpetuate funding and career inequalities at the heart of the current manuscript. If aggregating all HBCU faculty together, then a comparable grouping for comparison is needed, not just one institution. Perhaps looking at the top 25 NIH funded institutions could be one way of providing a clearer comparison. Related to this point is the confusing inclusion of Gallaudet in Figure 6 as it is not an officially identified HBCU. Was this institution also included in the HBCU-related calculations?

      Thank you for this comment. We agree this comparison perpetuates the perception of the prestige hierarchy and is problematic. We now compare all institutions in the top 25 NIH funding category to all HBCUs. Thank you also for identifying our error in mis-coding Gallaudet as an HBCU. We have corrected this in the current version.

      There is a clear connection that is missed in the current iteration of the manuscript derived from the work of Robert Merton and others about cumulative advantages in science and the "Matthew effect." While aspects of this connection are noted in the manuscript such as well-resourced institutions (those with the most NIH funding in this circumstance) hire each others' K99/R00 awardees, elaborating on these connections are important for readers to understand the central processes of how a rigid hierarchy of funding and career opportunities exist around these pathways. The work the authors build on from Daniel Larremore, Aaron Clauset, and their colleagues have also incorporated these important theoretical connections from the sociology of knowledge and science, and it would provide a more interdisciplinary lens and further depth to understanding the faculty career inequalities documented in the current study.

      Reviewer #1 (Recommendations For The Authors):

      Comments to authors:

      1. For the benefit of general reader, it would be informative to mention the amount of annual NIH investment in the k99 funding mechanism in the text (230 awards representing a ~ 230 million US dollars investment).

      Thank you for this suggestion. We have added that this is ~$25 million investment annually.

      1. It is worth noting that some of the observed funding and hiring traits resemble the Matthew effect, discussed in: The Matthew effect in science: https://www.science.org/doi/10.1126/science.159.3810.56

      The Matthew effect in science funding: https://www.pnas.org/doi/10.1073/pnas.1719557115

      It would be of value to cite these for further context for the readers.

      Thank you for this suggestion. We have included these references and briefly discussed the Matthew effect in the first paragraph of the Discussion.

      1. Figs 3, 6 and Fig S1 are hard to read without zooming in due to their format and don't work great within a letter size page but can work if they are also linked to a zoomable web version. It would make sense to have an online navigable/searchable/selectable version. But when the reader zooms out, there are patterns that reflect what points the authors are making (though those could be illustrated differently). These figures are really made for online webapp visualization (such as Shiny in R).

      We agree with this comment and have used the “googleVis()” package in R to put together interactive Sankey diagrams. These can be found at: https://dantyrr.github.io/K99-R00-analysis/ and they are referenced in the manuscript.

      1. The abstract states 85% of awardees get R00 awards. That appears to come from 198/234 (page 6) though it's not explicitly stated, and other ratios give different answers (e.g., 1-304/3475 = 91%) but the 85% seems to be the right one. That first paragraph of the results could be clearer. Also, in the middle of page three the number given is 90% so something is inconsistent. For Figure 1A, given the methodology it should be possible to calculate a rolling conversion rate as "R00(t) / K99(t-1)" (and a similarly-calculated cumulative rate).

      Thank you for catching these errors. These were introduced because there are R00 awardees that did not have extramural K99 awards. These are intramural NIH K99 awardees but there is no public data on these awardees. The correct number is 78% of K99 awardees that transitioned to the R00 phase. We have also calculated the rolling conversion rate which is 89% if you exclude the first 2 years of the program (when the first awardees were within the 2-yr K99 period) and final 2 years (when most recent K99 awardees were still within their first 2 years of the K99 period).

      1. Assuming that 85% is the correct number, is there any information/insight into why ~1/6 of awardees do not continue to R00, which seems high given that only two years passes - that's a lot of awardees not getting R00 positions.

      We are unsure of why these don’t convert. In the revised version of the manuscript, we speculate on this in the 4th paragraph of the discussion:

      The factors that prevented the other 302 K99 awardees from 2019 and earlier unable to convert their K99-R00 grants is cause for concern within our greater academic community. Possible explanations include leaving the biomedical workforce, accepting tenure-track positions or other positions abroad, or by simply not successfully securing a tenable tenure-track offer.

      1. It looks like perhaps a non-zero number of K99s are just one year and not two (e.g., see 2006 in Fig 1A, which should not appear if all 2006 awards were 2 years). What is the typical percentage of K99s not activated for a second year, and is this a sizable % of the 15% not converting to R00?

      This is an interesting question. We didn’t originally look into this and the dataset that we originally downloaded from NIH reporter included a significant number of duplicates for the grants because year 1 of the K99 was listed on its own line and year 2 was listed on a different line. The first step in curating the data was to delete the duplicate values so we only had one entry per person. Unfortunately based on sorting of the data tables, sometimes the year 1 appeared above year 2 and at other times year 2 appeared before year 1. Because none of the data we were interested in are benchmarked to K99 start date, we removed the duplicate values non-specifically. With the dataset we currently have, we would not be able to tell which individuals dropped out (didn’t convert to R00) during the first or second year of the K99. In order to do this we would have to download the raw data from NIH reporter again and curate it again. We may do this in the future but for the purpose of publishing the current manuscript we prefer to focus our efforts on other aspects of the revision.

      1. Further down page 3, the authors state that "men typically experience 2-3% greater funding success rates" is ambiguous, as rates are themselves a percentage. So, is it 2-3% greater as in 23% vs 20%, or is it 2-3% greater as in 20.6% vs 20%? Please clarify the language.

      Thank you for asking for this clarification. We have updated the text here to reflect that we mean “23% vs 20%”.

      1. Metrics such as time to first R01 are compared internally within the study set, which yields interesting insights, but more could be done to benchmark these metrics to non-K99 scientists.

      We agree with the reviewer that this would be ideal; however, we feel that it is out of the scope of this manuscript. We may examine this in the future.

      1. In the text, several times percentages are being referred to when the figures cited do not show percentages. For example (page 6) 'proportion of awardees that stayed at the same institution declined to about 20% where it has remained consistent (Fig 1B)' - Figure 1B does not show percentages, instead the reader would need to work out from the raw numbers what the pattern of percentages might look like. It's fine (great even) to provide the raw numbers, but would be great to show the percentages as well. This happened for multiple graphs.

      Thank you for this comment. We agree that showing the percentage would be beneficial so we have included the percentages in Figure 1 for the conversion rate. We also added a standalone figure panel for the rolling conversion rate for Figure 1. For Figure 4, we have also included a right Y-axis to better indicate the % women.

      1. Figure 4 - putting the %women on a 0-250 scale makes it difficult to see the changes in that curve. Please replot it as a separate graph with an appropriate scale (30-50%? 30-70%?)

      Thank you for this comment. We have made this edit.

      1. Figure 5 - The table appears inconsistent - the Moved/Stayed HR is 1.411 suggesting that moving is better for reducing time to R01, but then Woman/Man is 1.208, so one of these pairs needs to be written in the opposite order to have the table make sense (intended to be listed as 'better/worse'?)

      Thank you for noticing this. In the revised manuscript we have re-run the cox proportional hazard model using the R package “survival” and the function “coxph()”. There were minor differences in the hazard ratios using this package instead of Graphpad prism; however, the R package is much more widely used compared to prism for these types of analysis. We present the new data in the table in Figure 5B in the revised manuscript. We now present the “detrimental” cox hazard value for each variable (i.e. 0.7095 for the mobility [moved/stayed]). We also underlined the variable which was detrimental to receiving an R01 award earlier.

      1. Figure 5's graph appears strange. All the lines have an appearance of stochasticity but are actually multiples of each other, rising exactly in sync. Are these actually modeled lines? If so, why not instead actually draw the lines based on the real data from the real groups depicted, and give the n for each group?

      Thank you for picking this up. The software we originally used to plot the graphs did plot modeled lines instead of the actual data. We have re-run the cox proportional hazard model using the R “survival” package v3.5-5 and the coxph() and survfit() functions. The updated data are in Figure 5 of the revised manuscript.

      1. Table 1 should note that each column sums to 100%.

      This is a good suggestion. In the revised manuscript, we have added a row to the table to indicate the column total N and %.

      1. The authors discuss how k99/R00 grant reviewing process may have to change but the k99 awards also impact the faculty hiring ecosystem as well. There are faculty hiring job ads explicitly requesting or indicating preference towards k99 holders and the results described in this article show that k99 awarding is biased towards particular demographics at select wealthy institutions. Of course, collective/central action is almost always more effective/impactful (especially in shorter time line) than individual elective action. In other words, NIH changing granting patterns would likely work better than encouraging faculty searches to change the weight they give to K99s, because there are many searches and just one NIH. But these are not mutually exclusive and individual action can still help when central action isn't done (if the NIH does not change the k99/R00 grant review process for more inclusive funding and does not increase the number of annual k99 awards hence the annual budget for this award mechanism) and it would be good to have this discussed in the manuscript.

      Thank you for this comment and thoughtful insights. We have included additional discussion on this in the final paragraph of the discussion.

      Reviewer #2 (Recommendations For The Authors):

      Thank you for conducting this important work. On top of some thoughts I have described in the public review (in particular, Chris Pickett's FOIA data on K99/R00 outcomes by applicant race and ethnicity), I only have a few comments for potential improvements to this paper:

      1. The comparison of K99-R00 transition rates by gender was interesting. However, I missed the analysis on the K99-R00 transition rates by institution (by type or by top-25 NIH funded institution versus not). I think this analysis may be buried somewhere in the more nuanced descriptions about faculty flows from one institution type to another, but I was not able to locate it. I wonder if the authors could consider dedicating a subsection to specifically describing the transition rate by institution type, creating a table equivalent to Table 2. This section would probably fit best somewhere before the authors dive into the nuances of self-hires and faculty flows.

      Said another way: As I was reading, I felt I was missing an answer to a simple question - are there differences in conversion rates by institution type (however you define institution type, as an MSI or non MSI, or top-25 NIH funded versus not)?

      Thank you for this suggestion. We have created the table (Table 3 and Table 4) in the revised manuscript. We also made a new figure (now figure 5 in the revised manuscript). This was an interesting way to look at the data and it is very clear that the number of K99 and R00 awards is heavily concentrated within the institutions that have the highest NIH funding. We have added a paragraph in the results in a new section entitled “K99 and R00 awards are concentrated within the highest funded institutions”.

      1. Regarding the comparison of HBCUs and Harvard: this analysis was elucidating, but I am not sure if the framing of this analysis as pertaining to "systematically marginalized groups" - see second sentence in the section, "Faculty doctorates differ between Harvard and HBCUs" is appropriate. While it is true that proportionally more faculty at HBCUs are from marginalized groups, there are also many faculty at HBCUs who are from privileged or advantaged backgrounds (e.g., white, men, educated at elite institutions). It would be more accurate to rephrase the second sentence to say something along the lines of, "We sought to examine the rates of funding for those at historically under-funded institutions." I recommend that the authors comb the paper for any other potential places in the text that conflate systemic marginalization with institution type, and rephrase as needed for accuracy.

      Thank you for pointing this out. This is an extremely important point and we have removed any instances we could find where we conflate systemically marginalized groups with institution type.

      1. I strongly recommend Sugimoto and Larivière (2023)'s new book, Equity for Women in Science, which has an entire section dedicated to previous work investigating how researcher mobility impacts access to resources, collaborations, et cetera (Chapter 5 on Mobility; other chapters on Funding are also relevant but I hone in on Mobility since this is such a key result of this work). I think this chapter would provide significant food-for-thought and background that could strengthen the Discussion section of the paper.

      Thank you for this suggestion. We have added some discussion of mobility in the first paragraph of the Discussion.

      1. I appreciated the subsection headings that described key results (e.g., "Institutions with the most NIH funding tend to hire K99/R00 awardees from other institutions with the most funding"; "K99/R00 awardee self-hires are more common at institutions with the top NIH funding.") This paper structure made it easier for me to ensure that I was getting the intended takeaway from a figure or section. But partway through the paper, the subheadings changed to being less declarative and therefore less informative (e.g., "Gender of K99/R00 awardees"; "Factors influencing K99/R00 awardee future funding success"). It would be great to rephrase these boilerplate subsection headers to be more declarative, like earlier subsection headings. For example, maybe say "Men receive the majority of K99 awards" or "No gender difference in the rate of conversion from K99 to R00" or something to that effect, depending on what result the authors wish to emphasize.

      Thank you for this comment. This is a very good point. We have re-worded the more generic headings in the revised version.

      1. Lastly, I would like to share a question that came to my mind that involves an additional analysis, but is work that is (probably) out-of-the-scope of this paper, but could instead be a separate paper or product. Circling back to Chris Pickett's FOIA-ed data on K99/R00 funding outcomes by applicant race and ethnicity (https://web.archive.org/web/20180723171128/http://rescuingbiomedicalresearch.org/blog/examining-distribution-k99r00-awards-race/): Given that Pickett's numbers provide incontrovertible information on the number of awards to various racial and ethnic groups, I wonder if it is possible to use this information as an "answer key" to (1) check the accuracy of an algorithm that assigns race based on name for applications in your analysis but for 2007-2017 period, and, (2) if the results are reasonable, then examine the dataset with race and ethnicity information. Some recent papers performing large-scale bibliometric analyses have applied such algorithms (e.g., see Kozlowski et al. 2022 PNAS Intersectional inequalities in science) and I wonder if they could be useful, or at least tested, here. Again, Pickett's data would serve as the benchmark to see if the algorithm produces numbers that are consistent with the actual funding outcomes; if they're not wildly off, or perhaps accurate for some groups but not others, there might be something here.

      This is a really insightful comment. We have discussed whether we could assign ethnicity based on an algorithm and check based on Chris Pickett’s data. We agree that it is beyond the scope of this article, but has potential for future research.

      Reviewer #3 (Recommendations For The Authors):

      -In the methods section, it would be helpful to provide an overview of the number of universities, departments, and faculty represented in the data analyzed in the study.

      Thank you for this comment. We agree with the reviewer. We have added a section to the results discussing the distribution of different types of institutions. We also added Table 3 and Table 4 and a new Figure 5 describing these. Regarding the faculty, we have discussed the demographics of the K99 and R00 awardees as best as we could. We do not have data on which faculty laboratories the K99 awardees were in when they received their awards. This information is not available through NIH reporter.

      -I would consider incorporating, or at least citing, Jeff Lockhart and colleagues' recent paper Nature Human Behavior article "Name-based demographic inference and the unequal distribution of misrecognition" about to provide readers with an additional resource and more information about the likelihood of misattribution and general cautionary notes about using gender and race/ethnicity ascription/imputation approaches and tools for research.

      Thank you for bringing this reference to our attention. We have incorporated this into the methods section describing our name-based gender determination.

      -In the next to last sentence under the final paragraph of the methods section, there looks to be a typo as it should read "K99 or R00," not "K00" as currently written.

      Thank you for catching this. We have now corrected it.

      -Clarifying some of the data and measures used are necessary to limit confusion and misinterpretations of the study's findings.

      Thank you. We have significantly updated the revised manuscript and hope that it is more clear.

      -Elaborating more on the gender inequality notable in the Cox proportional hazard model would strengthen the authors' point about persistent gender inequalities within the K99/R00 funding mechanism and pathways. In its current iteration, the findings are somewhat buried by the discussion of institutional differences, but when we look at the findings and the plot associated with the model, we notice that men have more advantages than women in funding and institutional location.

      Thank you for highlighting this. This is true and we have elaborated on the gender inequality in the revised version of the manuscript.

      -Also for the Cox proportional hazard model, I would consider exploring the inclusion of data that can further clarify the biomedical research infrastructure of institutions. For example, in the conversation about the differences between Princeton and other universities including other Ivies, it's important to note that Princeton does not have a medical school. Moreover, other institutions do not operate or are affiliated with a hospital. Adding more data to the model that can better contextualize the research infrastructure around researchers with NIH awards beyond the size of the NIH portfolio can shed light on possibly other important institutional differences that undergird these inequalities.

      Thank you for this comment. We have added additional details about the institutional type; however, to examine whether institutions are attached to a hospital (or are themselves as hospital like MGH etc.) or whether institutions include a medical school may be difficult. We would have to manually code these and then determine whether or not the award recipient was affiliated with a department within that entity or not. We believe that this is a fascinating question but that it is out of the scope of the present manuscript. This is something that we will look into for potential future publications.

      -Throughout the manuscript there's usage of "elite" and "prestigious" that are somewhat ambiguous regarding what exactly they are referring to about institutional characteristics. This is a common issue in the literature, but trying to clarify what these terms specifically mean for the current study and checking for consistent usage with limited interchangeability that can add confusion for readers about what is being referred to would give added strength to the conversation provided by the authors.

      Thank you for this suggestion. Based on these comments and those by the other reviewers, in the revised version of the manuscript, we have limited the use of “elite” and “prestigious” to describe institutions in order not to perpetuate biases toward certain institutions.

      -In relation to the discussion at the end of the manuscript of the longer time to award noted for researchers who stay at the same institutions, another possibility for the disparity could be their reliance for service work (e.g., hiring committees, departmental committees, supporting graduate students through mentoring and/or dissertation committee work, etc.) in their institutions given their knowledge of and experience within it.

      Thank you for this suggestion. We have added 2 sentences to the discussion reflecting this possibility.

      -Engaging with how STEM professional cultures can perpetuate these funding disparities and related hiring and career outcomes could enhance the contributions of the study. In relation to STEM professional cultures, engaging with the work of Mary Blair-Loy and Erin Cech in their recent book, Misconceiving Merit, could help provide additional insights for readers.

      Thank you for these comments. We have incorporated edits to the revised manuscript reflecting the work of Erin Cech and Mary Blair-Loy.

    1. Author Response

      Reviewer #1 (Public Review):

      Summary:

      In this study, the authors showed that activation of RelA and Stat3 in hepatocytes of DSS-treated mice induced CYPs and thereby produced primary bile acids, particularly CDCA, which exacerbated intestinal inflammation.

      Strengths:

      This study reveals the RelA/Stat3-dependent gene program in the liver influences intestinal homeostasis.

      Weaknesses:

      Additional evidence will strengthen the conclusion.

      1) In Fig. 1C, photos show that phosphorylation of RelA and Stat3 was induced in only a few hepatocytes. The authors conclude that activation of both RelA and Stat3 induces inflammatory pathways. Therefore, the authors should show that phosphorylation of RelA and Stat3 is induced in the same hepatocytes during DSS treatment.

      Experiments in progress and data will be submitted in the revised manuscript- Co-staining of pRela and pStat3(727) on treated liver sections.

      2) In Fig. 5, the authors treated mice with CDCA intraperitoneally. In this experiment, the concentration of CDCA in the colon of CDCA-treated mice should be shown.

      Experiments in progress and data will be submitted in the revised manuscript - Supplementation of CDCA to knockout animals and estimation of CDCA in the colon of DSS treated and untreated animals.

      Reviewer #2 (Public Review):

      Singh and colleagues employ a methodic approach to reveal the function of the transcription factors Rela and Stat3 in the regulation of the inflammatory response in the intestine.

      Strengths of the manuscript include the focus on the function of these transcription factors in hepatocytes and the discovery of their role in the systemic response to experimental colitis. While the systemic response to induce colitis is appreciated, the cellular and molecular mechanisms that drive such systemic response, especially those involving other organs beyond the intestine are an active area of research. As such, this study contributes to this conceptual advance. Additional strengths are the complementary biochemical and metabolomics approaches to describe the activation of these transcription factors in the liver and their requirement - specifically in hepatocytes - for the production of bile acids in response to colitis.

      Some weaknesses are noted in the presentation of the data, including a lack of comprehensive representation of findings in all conditions and genotypes tested.

      These will be incorporated in the revised version.

      Reviewer #3 (Public Review):

      Summary:

      The authors try to elucidate the molecular mechanisms underlying the intra-organ crosstalks that perpetuate intestinal permeability and inflammation.

      Strengths:

      This study identifies a hepatocyte-specific rela/stat3 network as a potential therapeutic target for intestinal diseases via the gut-liver axis using both murine models and human samples.

      Weaknesses:

      1) The mechanism by which DSS administration induces the activation of the Rela and Stat3 pathways and subsequent modification of the bile acid pathway remains clear. As the authors state, intestinal bacteria are one candidate, and this needs to be clarified. I recommend the authors investigate whether gut sterilization by administration of antibiotics or germ-free condition affects 1. the activation of the Rela and Stat3 pathway in the liver by DSS-treated WT mice and 2. the reduction of colitis in DSS-treated relaΔhepstat3Δhep mice.

      Experiments in progress and data will be submitted in the revised manuscript - Antibiotic treatment for 2/4 weeks, subsequently mice will be treated with DSS and the Rela and Stat3 phosphorylation will be tested using western blotting.

      2) It has not been shown whether DSS administration causes an increase in primary bile acids, represented by CDCA, in the colon of WT mice following activation of the Rela and Stat3 pathways, as demonstrated in Figure 6.

      We have demonstrated a enhanced level of CDCA in the colon following DSS treatment in the wild type animals in figure 4B.

      3) The implications of these results for IBD treatment, especially in what ways they may lead to therapeutic intervention, need to be discussed.

      These will be incorporated in the revised version.

    1. Author Response

      We decided to address the comments of the reviewers with additional experiments and modification of the text with the aim of submitting a new version of the report.

      We would like to underline that the current study is an extension of the work published in eLife (Atze et al., 2021). For this reason, and in agreement with eLife guidelines, we did not repeat all the background information on the method used to identify PG subunit isotopologues using mass spectrometry.

      Reviewer #1 (Public Review):

      Summary:

      Liang et. al., uses a previously devised full isotope labeling of peptidoglycan followed by mass spec to study the kinetics of Lpp tethering to PG and the hydrolysis of this bond by YafK.

      Strengths:

      -The labeling and mass spec analysis technique works very well to discern differentially labelled Tri-KR muropeptide containing new and old Lpp and PG.

      Weaknesses:

      -Only one line of experimentation using mass spec based analysis of labeled PG-Lpp is used to make all conclusions in the paper. The evidence is also not enough to fully deleanate the role of YafK.

      Our approach based on heavy isotope labelling and mass spectrometry has the power to identify and kinetically characterize the specific products of the reaction leading to the tethering of Lpp to PG and the hydrolysis of the corresponding bond. We therefore advocate that our experimentation is sufficient to obtain meaningful results without combining other lines of experimentation.

      -Only one mutant (YafK) is used to make the conclusion.

      The aim of the study is to determine the effect of the hydrolysis of the PG→Lpp bond on the dynamics of the tethering of Lpp to PG. Since YafK is the only enzyme catalyzing this reaction, it is appropriate to compare the wild-type strain to an isogenic yafK deletion mutant. Nonetheless, we carefully consider this comment and will investigate the dynamics of the tethering of Lpp to PG in mutants deficient in the production of the L,D-transpeptidases responsible for tethering Lpp to PG.

      -The paper makes a lot of 'implications' with minimal proof to support their hypothesis. Other lines of experimentations must be added to fully delineate their claims.

      See our answer to the first comment.

      -Time points to analyse Tri-KR isotopologues in Wt (0,10,20,40,60 min) and yafK mutant (0,15, 25, 40, 60 min) are not the same.

      The purpose of the experiments is to compare the kinetics of formation and hydrolysis of the PG→Lpp bond in the WT versus ΔyafK strains. Comparison of the kinetics is therefore possible even though the kinetics are not based on the exact same time points. Nonetheless, we will reproduce the kinetics experiment (see also answers to Reviewer 2) and use the same time points in these additional experiments.

      -Experiments to define physiological role of YafK are also missing

      We will investigate the effect of the yafK deletion on the formation of outer membrane vesicles.

      Reviewer #2 (Public Review):

      Summary:

      The authors of this study have sought to better understand the timing and location of the attachment of the lpp lipoprotein to the peptidoglycan in E. coli, and to determine whether YafK is the hydrolase that cleaves lpp from the peptidoglycan.

      Strengths:

      The method is relatively straightforward. The authors are able to draw some clear conclusions from their results, that lpp molecules get cleaved from the peptidoglycan and then re-attached, and that YafK is important for that cleavage.

      Weaknesses:

      However, the authors make a few other conclusions from their data which are harder to understand the logic of, or to feel confident in based on the existing data. They claim that their 5-time point kinetic data indicates that new lpp is not substantially added to lipidII before it is added to the peptidoglycan, and that instead lpp is attached primarily to old peptidoglycan. I believe that this conclusion comes from the comparison of Fig.s 3A and 3C, where it appears that new lpp is added to old peptidoglycan a few minutes before new lpp is added to new peptidoglycan. However, the very small difference in the timing of this result, the minimal number of time points and the complete lack of any presentation of calculated error in any of the data make this conclusion very tenuous. In addition, the authors conclude that lpp is not significantly attached to septal peptidoglycan. The logic behind this conclusion appears to be based on the same data, but the authors do not provide a quantitative model to support this idea.

      The reviewer is correct in stating that we claim that Lpp is not substantially added to lipid II before incorporation of the disaccharide-pentapeptide subunit into the expanding PG network. This conclusion is based on the paucity of PG-Lpp covalent adducts containing light PG and Lpp moieties at the earliest time points. To substantiate more thoroughly this finding, we will reproduce the kinetic experiments with more early time points. The paucity of the new→new PG-Lpp isotopologues also implies that Lpp might not be extensively tethered to septal peptidoglycan since the latter is assembled from newly synthesized PG (see our previous publication Atze et al. 2021 and references therein). Quantitatively, septal synthesis roughly accounts for one third of the total PG synthesis. It is therefore expected that tethering of Lpp to septal PG would represent one third of the total number of newly synthesized Lpp molecules tethered to PG. We therefore proposed that the paucity of new→new PG- Lpp isotopologues at early time points of the kinetics implies that Lpp is preferentially tethered to the side wall. This is only one of several conclusions that we reach in the present study and we were very careful in the wording of our results.

      -This work will have a moderate impact on the field of research in which the connections between the OM and are being studied in E. coli. Since lpp is not widely conserved in gram negatives, the impact across species is not clear. The authors do not discuss the impact of their work in depth.

      We respectfully disagree with this reviewer’s comment. The work reported in this article for E. coli opens the way to the analysis and comparison of the mechanisms of the tethering of proteins to PG in various bacteria. In addition, we would like to stress that the Gram-negative bacteria that produce Lpp-related proteins and tether them to the PG include other major pathogens such as Pseudomonas aeruginosa (DOI: 10.1128/spectrum.05217-22).

    1. Author Response

      eLife assessment

      The manuscript presents valuable evidence of temporal correlations during specific oscillatory activity between the prefrontal cortex, thalamic nucleus reuniens, and the hippocampus, in naturally sleeping animals. Such correlations represent solid evidence to support the notion that the thalamic nucleus reuniens participates in the hippocampal and prefrontal cortex dialogue subserving memory processes.

      Thank you for your assessment.

      Public Reviews:

      Reviewer #1 (Public Review):

      Summary:

      In this study, Basha and colleagues aim to test whether the thalamic nucleus reuniens can facilitate the hippocampus/prefrontal cortex coupling during sleep. Considering the importance of sleep in memory consolidation, this study is important to understand the functional interaction between these three majorly involved regions. This work suggests that the thalamic nucleus reuniens has a functional role in synchronizing the hippocampus and prefrontal cortex.

      Strengths:

      The authors performed recordings in naturally sleeping cats, and analysed the correlation between the main slow wave sleep oscillatory hallmarks: slow waves, spindles, and hippocampal ripples, and with reuniens' neurons firing. They also associated intracellular recordings to assess the reuniens-prefrontal connectivity, and computational models of large networks in which they determined that the coupling of oscillations is modulated by the strength of hippocampal-thalamic connections.

      Thank you for your positive evaluation.

      Weaknesses:

      The authors' main claim is made on slow waves and spindle coupling, which are recorded both in the prefrontal cortex and surprisingly in reuniens. Known to be generated in the cortex by cortico-thalamic mechanisms, the slow waves and spindles recorded in reuniens show no evidence of local generation in the reuniens, which is not anatomically equipped to generate such activities. Until shown differently, these oscillations recorded in reuniens are most likely volume-conducted from nearby cortices. Therefore, such a caveat is a major obstacle to analysing their correlation (in time or frequency domains) with oscillations in other regions.

      1. We fully agree with the reviewer that reuniens likely does not generate neither slow waves nor spindles. We do not make such claim, which we clearly stated in the discussion (lines 319-324). We propose that Reuniens neurons mediate different forms of activity. In the model, we introduced MD nucleus only because without MD we were unable to generate spindles. While the slow waves and spindles are generated in other thalamocortical regions, the REU neurons show these rhythms due to long-range projections from these regions to REU as has been shown in the model.

      2. Definitely, we cannot exclude some influence of volume conductance on obtained LFP recordings in REU nucleus. However, we show modulation of spiking activity within REU by spindles. Spike modulation cannot be explained by volume conductance but can be explained by either synaptic drive (likely the case here) or some intrinsic neuronal processes (like T-current).

      3. In our REU recordings for spike identification we used tetrode recordings. If slow waves and spindles are volume conducted, then slow waves and spindles recorded with tetrodes should have identical shape. Following reviewer comment, we took these recordings and subtracted one channel from another. The difference in signal during slow waves is in the order 0.1 mV. Considering that the distance between electrodes is in the order of 20 um, such a difference in voltage is major and can only be explained by local extracellular currents, likely due to synaptic activities originating in afferent structures.

      Finally, the choice of the animal model (cats) is the best suited one, as too few data, particularly anatomical ones regarding reuniens connectivity, are available to support functional results.

      1. Thalamus of majority of mammals (definitely primates and carnivores, including cats) contain local circuit interneurons (about 30 % of all neurons). A vast majority of studies in rodents (except LGN nucleus) report either absence or extremally low (i.e. Jager P, Moore G, Calpin P, et al. Dual midbrain and forebrain origins of thalamic inhibitory interneurons. eLife. 2021; 10: e59272.) number of thalamic interneurons. Therefore, studies on other species than rodents are necessary, and bring new information, which is impossible to obtain in rodents.

      2. Cats’ brain is much larger than the brain of mice or rats, therefore, the effects of volume conductance from cortex to REU are much smaller, if not negligible. The distance between REU and closest cortical structure (ectosylvian gyrus) in cats is about 15 mm.

      3. Indeed, there is much less anatomical data on cats as opposed to rodents. This is why, we performed experiments shown in the figure 1. This figure contains functional anatomy data. Antidromic responses show that recorded structure projects to stimulated structure. Orthodromic responses show that stimulated structure projects to recorded structure.

      Reviewer #2 (Public Review):

      Summary:

      The interplay between the medial prefrontal cortex and ventral hippocampal system is critical for many cognitive processes, including memory and its consolidation over time. A prominent idea in recent research is that this relationship is mediated at least in part by the midline nucleus reuniens with respect to consolidation in particular. Whereas the bulk of evidence has focused on neuroanatomy and the effects of temproary or permanent lesions of the nucleus reuniens, the current work examined the electrophysiology of these three structures and how they inter-relate, especially during sleep, which is anticipated to be critical for consolidation. They provide evidence from intercellular recordings of the bi-directional functional connectivity among these structures. There is an emphasis on the interactions between these regions during sleep, especially slow-wave sleep. They provide evidence, in cats, that cortical slow waves precede reuniens slow waves and hippocampal sharp-wave ripples, which may reflect prefrontal control of the timing of thalamic and hippocampal events, They also find evidence that hippocampal sharp wave ripples trigger thalamic firing and precede the onset of reuniens and medial prefrontal cortex spindles. The authors suggest that the effectiveness of bidirectional connections between the reuniens and the (ventral) CA1 is particularly strong during non-rapid eye movement sleep in the cat. This is a very interesting, complex study on a highly topical subject.

      Strengths:

      An excellent array of different electrophysiological techniques and analyses are conducted. The temporal relationships described are novel findings that suggest mechanisms behind the interactions between the key regions of interest. These may be of value for future experimental studies to test more directly their association with memory consolidation.

      We thank this reviewer for very positive evaluation of our study.

      Weaknesses:

      Given the complexity and number of findings provided, clearer explanation(s) and organisation that directed the specific value and importance of different findings would improve the paper. Most readers may then find it easier to follow the specific relevance of key approaches and findings and their emphasis. For example, the fact that bidirectional connections exist in the model system is not new per se. How and why the specific findings add to existing literature would have more impact if this information was addressed more directly in the written text and in the figure legends.

      Thank you for this comment. In the revised version, we will do our best to simplify presentation and more clearly explain our findings.

    1. Author Response

      The following is the authors’ response to the original reviews.

      Public Reviews:

      Reviewer #1 (Public Review):

      Activity has effects on the development of neural circuitry during almost any step of differentiation. In particular during specific time periods of circuit development, so-called critical periods (CP), altered neural activity can induce permanent changes in network excitability. In complex neural networks, it is often difficult to pinpoint the specific network components that are permanently altered by activity, and it often remains unclear how activity is integrated during the CP to set mature network excitability. This study combines electrophysiology with pharmacological and optogenetic manipulation in the Drosophila genetic model system to pinpoint the neural substrate that is influenced by altered activity during a critical period (CP) of larval locomotor circuit development. Moreover, it is then tested whether and how different manipulations of synaptic input are integrated during the CP to tune network excitability.

      Strengths:

      Based on previous work, during the CP, network activity is increased by feeding the GABA-AR antagonist PTX. This results in permanent network activity changes, as highly convincingly assayed by a prolonged recovery period following induced seizure and by altered intersegmental locomotor network coordination. This is then used to provide two important findings: First, compelling electro- and optophysiological experiments track the site of network change down to the level of single neurons and pre- versus postsynaptic specializations. In short, increased activity during the CP increases both the magnitude of excitatory and inhibitory synaptic transmission to the aCC motoneuron, but excitation is affected more strongly. This results in altered excitation inhibition ratios. Fine electrophysiology shows that excitatory synapse strengthening occurs postsynaptically. High-quality anatomy shows that dendrite size and numbers of synaptic contacts remain unaltered. It is a major accomplishment to track the tuning of network excitability during the CP down to the physiology of specific synapses to identified neurons.

      Second, additional experiments with single neuron resolution demonstrate that during the CP different forms of activity manipulation are integrated so that opposing manipulations can rescue altered setpoints. This provides novel insight into how developing neural network excitability is tuned, and it indicates that during the CP, training can rescue the effects of hyperactivity.

      Weaknesses:

      There are no major weaknesses to the findings presented, but the molecular cause that underlies increased motoneuron postsynaptic responsiveness as well as the mechanism that integrates different forms of activity during the CP remain unknown. It is clear that addressing these experimentally is beyond the scope of this study, but some discussion about different candidates would be helpful.

      We discuss likely mechanisms that underpin the increase in postsynaptic responsiveness below (Reviewer #1 (Recommendations For The Authors):, point 2). To address possible mechanisms that integrate different forms of activity we now include a new paragraph in the discussion.

      Reviewer #2 (Public Review):

      Summary:

      In this study, the authors use the tractable Drosophila embryonic/larval motor circuit to determine how manipulations of activity during a critical period (CP) modify the circuit in ways that persist into later developmental stages. Previously, this group demonstrated that manipulations to the aCC/MN-Ib neuron in embryonic stages enhance (or can rescue) susceptibility to seizures at later larval stages. Here, the authors demonstrate that following enhanced excitatory drive (by PTX feeding), the aCC neuron acquires increased sensitivity to cholinergic excitatory transmission, presumably due to increased postsynaptic receptor abundance and/or sensitivity, although this is not clarified. Although locomotion is not altered at later developmental larval stages, the authors suggest there is reduced "robustness" to induced seizures. The second part of the study then goes on to enhance inhibition during the CP in an attempt to counteract the enhanced excitation, and show that many aspects of the CP plasticity are rescued. The authors conclude that "average" E/I activity is integrated during the CP to determine the excitability of the mature locomotor network.

      Overall, this study provides compelling mechanistic insight into how a final motor output neuron changes in response to enhanced excitatory drive during a CP to change the functionality of the circuit at later mature developmental stages. The first part of this study is strong, clearly showing the changes in the aCC neuron that result from enhanced excitatory input. This includes very nice electrophysiology and imaging data that assess synaptic function and structure onto aCC neurons from pre-motor inputs resulting from PTX exposure during development. However, the later experiments in Figures 6 and 7 designed to counteract the CP plasticity are somewhat difficult to interpret. In particular, the specificity of the manipulations of the ch neuron intended to counteract the CP plasticity is unclear, given the complexities of how these changes impact the excitability of all neurons during development. It is clear that CP plasticity is largely rescued in later stages, but it is hard to know if downstream or secondary adaptations may be masking the PTX-induced plasticity normally observed. Nonetheless, this study provides an important advance in our understanding of what parameters change during CPs to calibrate network dynamics at later developmental stages.

      Reviewer #3 (Public Review):

      Summary:

      In Hunter, Coulson et al, the authors seek to expand our understanding of how neural activity during developmental critical periods might control the function of the nervous system later in life. To achieve increased excitation, the authors build on their previous results and apply picrotoxin 17-19 hours after egg-laying, which is a critical period of nervous system development. This early enhancement of excitation leads to multiple effects in third-instar larvae, including prolonged recovery from electroshock, increased synchronization of motor neuron networks, and increased AP firing frequency. Using optogenetics and whole-cell patch clamp electrophysiology, the authors elegantly show that picrotoxin-induced over-excitation leads to increased strength of excitatory inputs and not loss of inhibitory inputs. To enhance inhibition, the authors chose an approach that involved the stimulation of mechanosensory neurons; this counteracts picrotoxin-induced signs of increased excitation. This approach to enhancing inhibition requires further control experiments and validation.

      Strengths:

      • The authors confirm their previous results and show that 17-19 hours after egg laying is a critical period of nervous system development.

      • Using Ca2+/Sr2+ substitutions, the authors demonstrate that synaptic connections between A18a  aCC show increased mEPSP amplitudes. The authors show that this aCC input is what is driving enhanced excitation.

      • The authors demonstrate that the effects of over-excitation attributed to picrotoxin exposure are generalizable and also occur in bss mutant flies.

      Weaknesses:

      • The authors build on their previous work and argue that the critical period (17-19h after egg-laying) is a uniquely sensitive period of development. Have the authors already demonstrated that exposure to picrotoxin at L1 or L2 (and even early L3 if experimentally possible) does not lead to changes in induced seizure at L3? This would further the authors' hypothesis of the uniqueness of the 17-19h AEL period. If this has already been established in prior publications, then this needs to be further explained. I do note in Gaicehllo and Baines (2015) that Fig 2E shows the identification of the 17-19h window.

      This is a pertinent comment. We now have evidence that activity manipulation (in this instance by increasing temperature, which recapitulates the effect of PTX) is not effective at larval stages (L1 to L3) but remains effective between 17-19hrs AEL. This observation forms part of a separate study where we explore the role of circadian activity on embryonic and larval neuronal development. We include a brief statement to address this comment in the revision (first paragraph of Results).

      • Regarding experiments in Fig 2, authors only report changes in AP firing frequency. Can the authors also report other metrics of excitability, including measures of intrinsic excitability with and without picrotoxin exposure (including RMP, Rm)? Was a different amount of current injection needed to evoke stable 5-10 Hz firing with and without picrotoxin? In the representative figure (Fig. 2A), it appears that the baseline firing frequencies are different prior to optogenetic stimulation.

      No differences in RM, Rin or capacitance were observed due to PTX. This is now included in the revision along with an explanation that different levels of current injection were used to measure effects to excitatory vs inhibitory synaptic drive. We did not specifically monitor the amount of current required to maintain stable firing.

      • The ch-related experiments require further controls and explanation. Regarding experiments in Fig 6, what is the effect of ch neuron stimulation alone on time lag and AP frequency? Can the authors further clarify what is known about connections between aCC and ch neurons? It is difficult for this reviewer to conceptualize how enhancing ch-mediated inhibition would worsen seizures. While the cited study (Carreira-Rosario et al 2021) convincingly shows that inhibition of mechanosensory input leads to excessive spontaneous network activity, has it been shown that the converse - stimulation of ch neurons - indeed enhances network inhibition?

      • The interpretation of ch-related experiments is further complicated by the explanation in the Discussion that ch neuron stimulation depolarizes aCC neurons; this seems to undercut the authors' previous explanation that the increased E:I ratio is corrected by enhanced inhibition from ch neurons. The idea that ch neurons are placing neurons in a depolarized refractory state is not substantiated by data in the paper or citations.

      To respond to these two points combined: The reviewer is correct in stating that additional experiments will be required to fully understand mechanism. We believe that cholinergic (excitatory) chordotonal input to aCC may be an important component for setting the rhythm of the locomotor CPG. Indeed, it may be that CPG rhythm is a key factor during the CP. Our observations suggest optogenetic stimulation of Ch neurons alone is sufficient to induce large, ~400-, currents that resemble endogenous spontaneous rhythmic currents (SRCs) associated with CPG activity. SRCs occur with a characteristic frequency of ~1Hz, and we have some unpublished data that suggests it is possible to change this frequency using ch stimulation. This data therefore unifies prior work (Carreira-Rosario et al., 2021 description of a brake) with our own (observation that ch depolarize aCC). However, we do not include this speculation in the Discussion because the experiments we have conducted were pilots. They may be expanded upon and included in future work.

      • In the Discussion, the authors suggest that enhanced proprioception leading to seizures is reminiscent of neurological conditions. This seems to be an oversimplification. Connecting abnormal proprioception to seizures is quite different from connecting abnormal proprioception to disorders of coordination. This should be revised.

      Because this is peripheral to our main study, we have deleted this from the revision.

      Reviewer #1 (Recommendations For The Authors):

      1. Although the authors have to be commended for the scrutiny with which they pinpoint a site of circuit change, it cannot be excluded that other parts of the circuit also undergo adjustments in response to activity manipulation during the CP, e.g. the membrane properties of the interneurons. This is not a problem but should be discussed.

      We agree with this comment and have added the following text to the discussion……’However, we recognise that other parts of the locomotor network may also undergo change due to CP manipulation. The advantage of this system is that most of these elements are now open to specific manipulation through cell-specific genetic drivers’. (Discussion paragraph 3)

      1. It is surprising that there is no discussion of the potential molecular cause for the observed increases in postsynaptic responses to SV release from cholinergic neurons. Given that there are no differences in postsynaptic structure, puncta number etc., the subunit composition of the nAChR seems an obvious guess. What is known about the nAChRs subunit composition on aCC, and when during development do the receptors/different subunits become expressed? A paragraph in the discussion on this issue would be highly relevant to the manuscript.

      Our own work (unpublished) together with a recent paper from the Littleton lab (https://www.sciencedirect.com/science/article/pii/S0896627323005810?via%3Dihub#mmc2) suggests that aCC expresses the majority, if not all, of the 7 alpha and 3 beta subunits that compromise nAChRs. The situation is further complicated by the fact that these receptors are pentameric and are composed of various subunits – the composition significantly altering channel kinetics. Less is known about expression timelines for each receptor subunit, and certainly not in aCC. We already include the following sentence in the results text……’ A change in the frequency of mini excitatory postsynaptic potentials (mEPSPs, a.k.a. minis) would suggest the adaptation is primarily presynaptic (e.g. increased probability of release), whilst a change in distribution and/or amplitude of minis is more consistent with a mechanism acting postsynaptically (e.g. increased or altered receptor subunits).’ Given that we know next to nothing about the nAChR subunit composition in aCC and how this might change due to CP manipulation, we feel it better not to speculate further. To help the reader, we include the following sentence in the discussion……’The precise mechanism contributing to increased mini amplitude remains to be determined, but a plausible scenario may involve change in cholinergic subunit composition.’ (Discussion paragraph 3)

      1. It would be important to provide the p-values for Figures 1B and C, especially because it seems that the inhibition also becomes stronger upon PTX treatment during the CP. There is no statistical testing mentioned, was no test done or was it not significant? It is agreed that the effect size is clearly stronger for the increased excitation than for the increased inhibition, but looking at the data suggests that the effect on excitation is not much more significant than the effect on inhibition.

      The reviewer is referring to Fig 2B&C. P values have been added to both main text and to the figure legend.

      1. Associated with the point above, in the discussion line 407 and below the authors come back to this point and reason that it is surprising that increased excitation is not compensated for by homeostatic mechanisms. It is concluded that homeostatic compensation brings the system back to a setpoint that is defined during the critical period, but the setpoint is set higher in this case. However, an alternative explanation is that GABA administration during the critical period causes the excitation set point to be too high, but this is then partially counteracted in a homeostatic manner by increasing inhibition. If the p-values in Figures 2B and C are rather similar, this might even be the favorable interpretation.

      We believe the reviewer means ‘PTX administration’ and not GABA. This is an interesting idea and one we had not really considered. We address this comment by adding the following text………. ‘Alternatively, whilst the increased inhibition we observe is not statistically significant (p = 0.15), it is close and has a medium effect size (Cohen’s d = 0.78), and thus may be indicative of an attempt by the locomotor network to rebalance activity back towards a genetically pre-determined level. In this regard, it may just not have sufficient range to be able to counter the increase in excitation due to CP manipulation.’ (Discussion paragraph 5)

      1. To asses the magnitudes of A18a-mediated excitation and A31k-mediated inhibition to aCC, changes in aCC firing frequency were measured. For this aCC was injected with current to fire at all. However, the current injections were chosen to cause firing at 5-10 Hz. During a crawling burst, aCC fires well above 100Hz (Kadas et al., 2017). Are the effects also visible at such firing frequencies, or at least across different firing frequencies? I am not asking for additional experiments, but maybe the data are there and can be referred to?

      Spiking in aCC occurs as burst firing, evoked by cholinergic synaptic drive, that lasts for ~300ms and achieving firing frequencies of between 50-100Hz (Kadas et al., 2017 and our own unpublished data). We did not test for effects to excitation or inhibition at these higher frequencies. We now make this explicit in the discussion by adding the following sentence……’The firing frequencies that we imposed (1-10Hz) are also lower than seen during fictive locomotion (Kadas et al., 2017), which shows burst firing lasting for ~300 ms and achieving spike frequencies of up to 100Hz.’ (Discussion paragraph 3)

      1. In Figure 3B some minis are demarked by green arrows and others are not. Were the non-marked ones not included in the analysis, and what were the criteria to mark some and others not? This is particularly important because the cumulative distribution of minis is analyzed in Figure 3D, and this depends crucially on what qualifies as mini and what does not.

      All mini’s are marked by green arrows. The events not marked are not mini’s. Drosophila neurons are small and have an unfavourable dendritic structure for recording minis. Thus, we carefully analyse traces by eye taking only events that show very rapid rise times and slower, exponential decay (the typical mini shape). There are, however, other events which are most likely single/multiple channel openings, which due to filtering are rounded. We now include this same trace, greatly expanded, as Fig S1D to show how we identified minis from non-minis.

      1. The asynchronous release experiment under Sr2+ seems an elegant way to analyze minis upon optogenetic stimulation of an identified presynaptic cholinergic neuron. I suggest being a little more conservative with the term asynchronous release (or replacing it), which is usually the release of many single vesicles that follow AP-mediated synaptic transmission and has nicely been demonstrated at the Drosophila NMJ (Besse et al., 2007). Also, please show the trace in Figure S2A under Sr2+ at a higher pA magnification, it is really hard to see the minis there.

      We have adopted a previously published technique that, in our view, correctly uses the term ‘asynchronous release’. This is not to say that all asynchronous release occurs via the same mechanism. Indeed, the papers that report the technique we use predate Besse 2007. We also expand the trace in Fig S1A (not S2A as wrongly indicated).

      Reviewer #2 (Recommendations For The Authors):

      1. Can the authors explain what they think is the parameter of "activity" being measured in the locomotor circuit (mainly aCC) during the CP? Is the aCC neuron simply summing (perhaps through a proxy like Ca2+) total excitation/inhibition over time during the CP?

      Reviewer #1 also requests that we discuss how activity is ‘measured’ and thus we now include a dedicated paragraph in the discussion to address this concern. Whether aCC sums ‘average’ activity or perhaps is influenced by activity extremes remains uncertain. Our data is consistent with the former but further work is required to validate our conclusion. This work will be published in due course.

      Related to understanding this concept, could the authors' silence activity (using Kir2.1, TNT, or BoNT) from each of the monosynaptic premotor inputs in otherwise wildtype and following PTX exposure to determine how the circuit responds when each of the monosynaptic inputs are silenced? This might inform the role they play in instructing how activity is measured over time during the CP.

      This is an excellent suggestion and, indeed, we have planned such experiments. Silencing specific neurons, whilst manipulating the CP, may well result in more significant network instability due to the setting of multiple (and physiologically inappropriate) homeostatic set points. Such studies go beyond the scope of the present study and thus we prefer not to speculate at this early stage, but to wait for experimental data.

      On a related note, the authors focus on just 2 premotor inputs, presumably due to the availability of specific drivers. But do the authors know how many other inputs (other ACh, Gaba, and glutamate) onto aCC there are, and to what extent do the authors think these are changed in similar or distinct ways? Is it implied that all neurons are similarly altered by the manipulations?

      The connectome details the number and types of neurons that directly contact the aCC motoneuron (Zarin et al., 2019). In terms of cholinergic excitors, the results present in Figure 3 suggest that most (all?) inputs are strengthened following embryonic PTX exposure. However, to conclude this would be highly speculative and thus we refrain from doing so in the manuscript. As other single-neuron driver lines become available, such expts will hopefully be possible.

      1. If PTX treatment does indeed increase CPG synchronicity, shouldn't there be a readout of this effect on larval locomotion? While the speed of locomotion wasn't significantly impacted, perhaps another parameter was altered.

      It is quite possible that other aspects of locomotion are being altered (turning, rearing, etc), but we have not analysed for these more subtle behaviours. Indeed, although not statistically significant, there is a modest reduction in average velocity in larvae derived from PTX-exposed embryos. We see similar reductions in characterised seizure mutants which also show increased synchronicity (Streit et al., 2016).

      1. In Figure 2 and elsewhere, what is the baseline level of AP firing rate in each aCC neuron, before optogenetic stimulation? Is this informative about how PTX exposure alters excitability to begin with, perhaps by changing intrinsic excitability.

      We now include this data in the relevant results section. Interestingly, following exposure to PTX, basal firing was significantly increased in A18a (excitatory premotor) but not in A31k (inhibitory premotor). This reflects our experiment in which we conclude that excitatory drive to aCC is increased relative to inhibitory synaptic drive. Thus, this measure seemingly validates our conclusion that E:I balance has been altered following activity-manipulation during the CP.

      1. Figure 3: The apparent increase in mini amplitude is very small (4.1 vs 4.5 pA); is this physiologically meaningful? Although the authors say the decrease in mini freq is not significant in Fig. 3B after PTX, it does appear rather large, a 40% reduction (5 vs 3 Hz).

      We must be guided by statistics in drawing conclusions, but the reader can interpret our data as they wish. Minis measure quantal release and thus to appreciate how small change can, when combined over the many receptors present, influence cell physiology, one needs to compare spiking activity. We show in Fig 2 that such change is sufficient to increase the excitatory synaptic drive provided by the A18a neuron. The seemingly larger reduction in mini frequency is intriguing and may reflect additional change, but without further experiments we cannot draw firm conclusions.

      1. The clever vibration assay is a good one to induce the activation of mechanosensory neurons, but the specificity of the changes induced by this is difficult to ascertain. One possibility would be to silence the output of the ch neurons (by expression to tetanus or botulinum toxin) and still put the larvae through the same vibration during the CP to see if the rescue is lost.

      We agree that further experiments are required to fully understand underlying mechanism(s). However, we will not be able to complete such follow-on expts in a timely manner and thus, these must wait and form the basis of future studies.

      Minor points 1. Typos - there are numerous areas where it seems a comma is used inappropriately (e.g. lines 28, 69, 77, 104, 348, 365, etc). Suggest line editing the final "version of record".

      Checked and corrected.

      1. It would be of benefit to show the genotypes of the larvae in the various experimental manipulations in the relevant figure legends. This reviewer could not follow exactly how each experiment was done as it was not always clear which driver was being used to express which transgene in what genetic background.

      Done

      Reviewer #3 (Recommendations For The Authors):

      • Please provide sample videos of electroshock-induced seizures (e.g. Fig 1B). Is it clear that the period of immobility after electroshock is a seizure (perhaps defined as hyperactivity originating from the brain)? I acknowledge the Baines group is quite skilled in this technique and perhaps there is a straightforward answer or citation to include.

      We refer the reader to Marley and Baines 2011 which contains videos of seizure activity (first paragraph of Results).

      • Seizures are generated in the brain and travel to the periphery. Do the authors think it is possible that the peripheral manipulations in this manuscript might be controlling the behavioral readout of seizures without affecting hypersynchronous activity in the brain?

      We include the following statement (in methods) to provide our best understanding for how peripheral electroshock induces seizure………. ‘Strong peripheral stimulation likely causes excessive and synchronous synaptic excitation within the CNS resulting in seizure. However, the precise mechanism of this effect remains to be determined.’ Moreover, we feel it unlikely that manipulation of Ch neurons, by vibration, would suppress the effects we observe via peripheral mechanisms. Indeed, the Ch manipulation is limited to the embryonic CP, whilst our seizure assays are recorded many days later at L3.

      • How might enhancement of inhibition lead to worsened seizures? Is the enhancement of ch-related inhibition selectively affecting inhibitory circuits, thereby leading to a net increase in excitation?

      This is a difficult point to respond to at present. Enhanced inhibition per se might similarly disturb the encoding of an appropriate homeostatic setpoint(s) thus leaving a network open to being destabilized by a strong stimulus. Indeed, we have previously shown that increased inhibition during the CP results in the same effect (seizure) as increasing excitation (Giachello and Baines, 2015). Thus, presuming activation of Ch neurons during the CP translates to increased inhibition, then worsened seizure behaviour is a predictable effect. How this is achieved remains unknown and we prefer not to speculate here.

    1. Author Response

      The following is the authors’ response to the previous reviews.

      We are pleased that Reviewers 1 and 3 have recommended that the revised paper be published.

      Reviewer #2

      For point A: Their preliminary simulation in 3D looks also nice, although it’s referenced in the discussion but not actually included in manuscript - I would advise adding it even under the mention of preliminary.

      We appreciate the reviewer for liking our 3D results and suggesting to include them in the manuscript. However, these are preliminary results of our ongoing work. We are yet to establish the corresponding viscosity results quantitatively in the 3D simulations. Because the relationship between viscosity and relaxation time is not (always) linear in glass forming systems, we hesitate to report our results for publication. We hope to report the new results as part of a separate work.

      For point B/C: I see some of the points of the authors - although not all of it made it in the main text. I still have some points that puzzle me. For instance, the authors mention that a single value of viscosity (from Green-Kubo) is ”valid for all time scales and amplitude”. This sounds very surprising to me for a complex fluid even at equilibrium: doesn’t it for instance assume linear response (hence small amplitudes)? Fast vs slow probing of a complex medium should also matter (see refs previously mentioned). Related to this, it’s not clear how can self-propulsion not matter if one would shear the system at a finite time scale, given past work on motility-driven unjamming and the mechanism of the authors from facilitation ( wouldn’t shearing at time scales larger vs smaller than the typical time for given cells to spontaneously rearrange from self-propulsion change drastically the effective complex modulus of the system?)

      There might be a slight misunderstanding between the reviewer and us when

      we say ‘single value of viscosity is valid for all time-scales and amplitude’. Let us explain this point more carefully. In our problem, we are studying the dynamics of a many body system which is undergoing Brownian dynamics where the fluctuation-dissipation theorem need not be valid (as the friction and the selfpropulsion noise strength are not related via Fluctuation-Dissipation Theorem). Now, for us to use the concepts of linear-response (which in the present study are the Green-Kubo relations for the transport coefficients in terms of timecorrelations functions), we need to show that the within the simulation time, the system has reached state that could be described using an “equilibrium” probability measure. This is the precise reason we calculated the ergodicity measure, which is a way to show that all the phase-space have been sampled uniformly under the given Brownian dynamics. This suggests (does not prove) that the system has attained a stationary probability measure (i.e, near equilibrium) for the value of self-propulsion used. Now for this value of self-propulsion, the Green-Kubo relations hold for ‘any time-scale of the simulations’ so that we can perform a time average over the trajectories of the particles (which is an alias of the stationary probability measure under the values of self-propulsion used). If we change the amplitude of the self-propulsion, we need to again compute the ergodicity measure and show the stationarity of the probability measure. If the system is ergodic with respect to the new self-propulsion, we can again use Green-Kubo for the simulations. Note that we will definitely get a different value of viscosity under the new self-propulsion as the shear-stresses generated will be different but the Green-Kubo holds. If the system is not ergodic, for the self-propulsion with the new amplitude, we cannot use Green-Kubo relations. Also a priori, one cannot say what is a large/small amplitude of self-propulsion because it has to be compared with the intrinsic energy scale, which is encoded in the energy function, which is difficult to say without explicit calculations.

      This is what we meant when we said, ‘single value of viscosity is valid for all time-scales and amplitude’. It is valid for time-scales of the simulations for a given amplitude of self-propulsion only if the system is ergodic. Note that if the system is not ergodic, then the results of Ref. [14] (in the main text) could be questioned on theoretical grounds, because they were analyzed using 3 the equilibrium rigidity percolation theory. Nevertheless, the authors of Ref. [14] showed that equilibrium phase transition theory works in tissues. For these reasons, we have been, just like the Reviewer, puzzled that equilibrium ideas appear to be valid in the cell system. Additional theoretical work has to be done to clarify these links in tissues. Although this is not the last word, we hope this clarifies our view point.

      For point D: I agree with the simplicity argument, although the added sentence from the discussion “Furthermore, the physics of the dynamics in glass forming materials does not change in systems with and without attractive forces” seems a bit strong given works like Lois et al., PRL, 2008 or Koeze et al, PRL, 2018 finding fundamentally different physics of jamming with or without adhesion. In the two cited papers the authors only consider equilibrium transitions in systems with attraction using computer simulations. Apparently, jamming properties depend on the strength of attraction. There are no attempts to characterize the dynamics, the focus of our work.

      What we meant is that any universal relations, such as the Vogel-FulcherTammann relation, would still be valid. Of course, non-universal quantities such as glass transition temperature Tg or fragility will change. In our case, changing the adhesion strength would change ϕS, and the parameters in the VFT. However, our contention is that the overall finding that increase in viscosity followed by saturation is unlikely to change. We have added some clarifying statements in the manuscript to make this clear.

    1. Author Response

      We would like to thank the reviewers for their encouraging comments and useful feedback, which will enable us to improve the manuscript. We would like to briefly comment on some of the points they raised.

      1. We agree this is a fairly specialized pipeline that has some requirements in terms of photographic setup. We are working hard to make these requirements as minimal as possible. However, given the huge variability in camera angles, backgrounds, arrangement of brain slices, etc., making the pipeline fully automated for unconstrained photos is extremely challenging.

      2. In principle, it should be possible to extend our method to sagittal slices of the cerebellum or axial slices f the brainstem, but this would require collecting and labeling additional training data and thus remains as future work.

      3. Producing accurate surfaces with sparse photographs is a very challenging problem and also remains as future work. We have a conference article producing surfaces on MRI scans with sparse slices (https://doi.org/10.1007/978-3-031-43993-3_4) but we haven’t gotten it to work well on photographs yet.

      4. Another challenging issue that remains as future work is getting the pipeline to work well with nonlinear deformations, e.g., slices of fresh tissue. While incorporating nonlinear deformation into the model is trivial from the coding perspective, we have not been able to make it work at the level of robustness that we achieve with affine transformations. This is because the nonlinear model introduces huge ambiguity in the space of solutions: for example, if one adds identical small nonlinear deformations to every slice, the objective function barely changes.

      5. As we acknowledge in the manuscript, the validation of the reconstruction error (in mm) with synthetic data is indeed optimistic, but informative in the sense that they reflect the trends of the error as a function of slice thickness and its variability (“jitter”).

      6. Since we use a single central coronal slice in the direct evaluation, SAMSEG yields very high Dice scores for large structures with strong contrast (e.g., the lateral ventricles). However, Photo-SynthSeg provides better average results across the board, particularly when considering 3D analysis out of the coronal plane (see qualitative results in Figure 2 and results on volume correlations).

    1. Author Response:

      We would like to thank the editor and the three reviewers for their time and effort taken in reviewing our manuscript and providing constructive feedback. Unfortunately, the first author of this manuscript is no longer involved in academia, and does not wish to further revise this manuscript. However, we agree with the entirety of the feedback and critiques provided by the referees, and feel these points should be taken into account when interpreting our results and conclusions.

    1. Author Response

      The following is the authors’ response to the original reviews.

      Reviewer #1 (Public Review):

      This work challenges previously published results regarding the presence and abundance of 6mA in the Drosophila genome, as well as the claim that the TET or DMAD enzyme serves as the "eraser" of this DNA methylation mark and its roles in development. This information is needed to clarify these questions in the field. I am less familiar with the biochemical approaches in this work, so my comments are mainly on the genetic analyses. Generally speaking, the methods for fly husbandry and treatment seem to be in accordance with those established in the field.

      Response : We thank the reviewer for his/her work and positive assessment of our manuscript.

      Reviewer #2 (Public Review):

      DNA adenine methylation (6mA) is a rediscovered modification that has been described in a wide range of eukaryotes. However, 6mA presence in eukaryote remains controversial due to the low abundance of its modification in eukaryotic genome. In this manuscript, Boulet et al. re-investigate 6mA presence in drosophila using axenic or conventional fly to avoid contaminants from feeding bacteria. By using these flies, they find that 6mA is rare but present in the drosophila genome by performing LC/MS/MS. They also find that the loss of TET (also known as DMAD) does not impact 6mA levels in drosophila, contrary to previous studies. In addition, the authors find that TET is required for fly development in its enzymatic activity-independent manner.

      The strength of this study is, that compared to previous studies of 6mA in drosophila, the authors employed axenic or conventional fly for 6mA analysis. These fly strains make it possible to analyze 6mA presence in drosophila without bacterial contaminant. Therefore, showing data of 6mA abundance in drosophila by performing LC-MS/MS in this manuscript is more convincing as compared with previous studies. Intriguingly, the authors find that the conserved iron-binding motif required for the catalytic activity of TET is dispensable for its function. This finding could be important to reveal TET function in organisms whose genomic 5mC levels are very low.

      The manuscript in this paper is well written but some aspects of data analysis and discussion need to be clarified and extended.

      1. It is convincing that an increase in 6mA levels is not observed in TETnull presented in Fig1. But it seems 6mA levels are altered in Ax.TET1/2 compared with Ax.TETwt and Ax.TETnull presented in Fig1f (and also WT vs TET1/2 presented in Fig1g). Is it sure that no statistically significant were not observed between Ax.TET1/2 and Ax.TETwt?

      2. The representing data of in vitro demethylation assay presented in Fig.3 is convincing, but it is not well discussed and analyzed why these results are contrary to previous reports (Yao et al., 2018 and Zhang et al., 2015).

      We thank the reviewer for his/her work and positive assessment of our manuscript.

      (1) We repeated our statistical analyses and confirmed that there is no significant difference between wildtype and tet1/2 mutant embryos in axenic conditions (Welch two sample t-test : p=0.075).

      (2) We added some elements in the revised manuscript to discuss the possible reasons for the discrepancies with previous reports. Notably both studies performed the in vitro demethylation assays over a much longer time course and with different sources of recombinant proteins. Zhang et al. purified TET catalytic domain from human cells (HEK293T) and observed around 2.5% of 6mA demethylation at 30 min and less than 25% after 10 hours of incubation as measured by HPLC-MS/MS analyses. Yao et al. incubated recombinant TET catalytic domain with 6mA DNA for 3h and observed a 25% decrease in 6mA levels as measured by dot blot. These results suggest that drosophila TET may oxidize 6mA, but with a much lower affinity than 5mC since with observed a near complete oxidation of 5mC after 1 minute and no decrease in 6mA levels after 30 minutes of reaction (for identical concentrations of substrate and enzyme). It is possible too that the preparation of TET catalytic domain in different systems changes its enzymatic activity, potentially in relation with distinct post-translational modifications. Still, as already mentioned in our manuscript, extensive biochemical analyses of the distant TET homolog from the fungus Coprinopsis cinerea (Mu et al., Nature Chem Biol 2022) strongly argue that TET enzymes do not harbor the residues required to serve as 6mA demethylase.

      Reviewer #1 (Recommendations For The Authors):

      Here are one comment (#1) and a couple of questions (#2-3) that could be addressed in the future, in order to understand the roles of 6mA and TET. Even though #2 and #3 are likely beyond the scope of this paper, #1 should be addressed within the scope of this work and compared with previous reports.

      1. The phenotypic analyses in Fig. 4 should use tet_null/Deficiency and tet_CD/Deficiency for their potential phenotypes. This needs to be addressed since both the tet_null and the tet_CD were generated using the same starting fly line (GFP knock-in). Using a deficiency chromosome and testing these alleles in hemizygotes would be helpful to eliminate any secondary effects due to genetic background issues.

      Thanks for this comment. Actually, tet_null and tet_CD were not generated using the same starting lines. Whereas tet_cd was generated (by CRISPR) using the tet-GFP knock-in line, tet_null was generated by FRT site recombination between two PBac insertions (Delatte et al. 2016). As for tet1 and tet2 (used in allelic combination in Fig 4 J-L), they correspond to two distinct mutant alleles generated by CRISPR (Zhang et al. 2015). We have clarified this in the M&M (page 9).

      1. Regarding the estimated "200 to 400 methylated adenines per haplogenome", is there any insight into where are they located in the genome?

      It is an interesting question and we initially used SMRT-seq sequencing to obtain this kind of information. As it turned out that this technique gives a high level of false positive, we should consider with caution the interpretation of these data and we decided not to include them in the manuscript. Still, we characterized the genomic features of the 6mA detected using stringent criteria (mQV>100, cov>25x in the fusion dataset and triplicated across samples of the same genotype). Both in wild type and tet_null, 6mA were dispersed along each chromosome although few of them were found on chromosome X. In both cases there appeared to be a higher accumulation of 6mAs on the histone locus and the transposon-rich tip of chromosome X, but 6mA density remained below 1.3/kb in other genomic regions. Comparisons with annotated genomic regions indicated that 6mA were enriched in long interspersed nuclear elements (LINEs) and satellite repeats, and depleted in 3’UTR and exons, but there was no significant difference in their repartition between the two genetic contexts. Besides, motif analyses showed similar enrichments in both conditions, with GAG triplet accounting for more than one quarter of all the sites. Whether this reflects the specificity of a putative adenine methylase or a technical bias associated the with SMTR-seq technology remains to be established.

      1. The TET-GFP and TET-CD-GFP knock-in lines give proper nuclear localization and could be used to identify genomic regions bound with full-length TET and TET-CD using anti-GFP for ChIP-seq or CUT&RUN (or CUT&TAG).

      Indeed, this is a line of research that we are following up and will be part of another study. Actually, our ChIP-seq experiments indicate that they bind on the same genomic regions.

      Reviewer #2 (Recommendations For The Authors):

      • I think the major findings of this paper are showing 6mA present in drosophila by using xenic or conventional breeding conditions and finding that TET function independently of its catalytic activity is essential for fly development. The authors could have been more precise in title and abstract to emphasize these findings.

      We have now modified the abstract to try to emphasize these findings.

      • The authors claim that any increase of 6mA levels was not observed in both TETnull and TET1/2, but it is not sufficiently convincing. Because it seems 6mA levels were increased in Ax. tet1/2 embryo as compared with in Ax.wt embryo (Fig.1). In this scenario, 6mA abundance in both TETnull and TET1/2 mutant are supposed to be the same. It would be better to re-analyze data carefully and discuss if 6mA levels were significantly increased in TET1/2, and why 6mA levels are different between TETnull and TET1/2. Additionally, the authors describe that the TET null mutant is pupal lethal, while the TET1/2 survivor is available. The text suggests that TET1/2 could have partial functionality on fly development (Fig.4). It would be better to check whether the N-terminus of TET is expressed in the TET1/2 mutant.

      Indeed, the increase in 6mA levels in Ax. tet1/2 embryo seems consequent (although it is not statistically significant) and no increase was observed in Ax tet_null embryos. Thus, the putative effect on 6mA levels in tet1/2 embryos may not be directly due to the absence of TET function. We now mention in the revised manuscript (page 6) that “the apparent increase in 6mA levels in tet1/2 axenic embryos was not reproduced in tet_null embryos, suggesting that it does not simply reflect the tet loss of function, and that it was not statistically significant”. Besides, we do not have an antibody to check whether the N-terminus of TET is expressed in the tet1/2 mutants, but the western blot published by Zhang et al 2015 shows that tet2 mutation leads to the expression of TET N-terminal domain. This N-terminal domain could have partial TET functionality and/or interfere with the function of other factors (notably those implicated in 6mA metabolism).

      • The authors show that SMRT-seq data did not reveal an increase in 6mA levels in loss of TET (Fig.2). It is convincing that total 6mA abundance was not altered by loss of TET. But were 6mA-accumulated locus/regions observed in WT not altered by loss of TET?

      Please refer to our answer to reviewer 1 on that point.

      • It remains unclear that the TET proteins the authors prepared do not exhibit 6mA demethylate activity in vitro, contrary to what was reported in previous papers (Fig.3). I think the preparation of recombinant proteins may make different results between this and previous papers. Yao et al., 2018 and Zhang et al., 2015 used recombinant proteins purified from Human cells or insect cells, while the author purified them from E.Coli. Additionally, it's mentioned that VK Rao et al., 2020 demonstrated cdk5-mediated phosphorylation of Tet3 increases its in catalytic activity in vitro. These previous reports suggest modification of TET could change demethylase activity. More analysis and discussion are needed to support the conclusion.

      Thanks for your insights. This in an important point and we added the following elements in the revised manuscript to discuss possible reasons for the discrepancies with previous reports (pages 7-8): “Our results contrast with previous reports showing that recombinant drosophila TET demethylates 6mA on dsDNA in vitro (Yao et al. 2018; Zhang et al., 2015a). However, both studies ran much longer reactions (up to 10 hours) and used different sources of recombinant protein (drosophila TET catalytic domain purified from human HEK293T cells). Notably, Zhang et al. (2015a) only found around 2.5% of 6mA demethylation at 30 min and less than 25% after 10 hours of incubation as measured by HPLC-MS/MS analyses. These results suggest that drosophila TET may oxidize 6mA, but with a much lower affinity than 5mC since with observed a near complete oxidation of 5mC after 1 min. and no significant decrease in 6mA levels after 30 min. of reaction (for identical concentrations of substrate and enzyme). It is possible too that the preparation of TET catalytic domain in different systems changes its enzymatic activity, potentially in relation to distinct post-translational modifications.”

    1. Author Response

      1. Reviewer 1 raised the concern that the images shown in the figures seem inconsistent with the quantitative data.

      Our provisional response: The quantitative data are based on many samples and the photographs are just supposed to show illustrations of example data. Because of the volume containing P1a cells, is impossible to present a single confocal image that covers all P1a neurons and would therefore correspond more closely to the quantitative data. We chose to illustrate the quantitative data using single confocal images which contain both Hr38+/GFP+ and Hr38-/GFP+ neurons, to demonstate that we can distinguish clearly which P1a neurons are positive or negative for for Hr38 expression. This can be clarified in the figure legends. If it is imperative to show images(s) to reflect the statistics, we can do that but will need to present multiple confocal images for each condition, which could be messy and confusing.

      1. Reviewer 2 states: "the major weakness is the calibration of the temporal resolution of HI-CatFISH in Figure 4 and Figure Supplement 4. According to Figure Supplement 4C, close to 100% of the Hr38-positive cells are already labeled with the exonic probe 30min post-stimulation, which is not reflected in Figure 4B (there, the expression level of the exonic probe peaks 60min post-induction)”.

      The confusion may arise because we drew the illustration diagram (Fig. 4B) based on the quantitative data in Fig.S4B, which plots the intensity of Hr38 exonic ISH signals, while the reviewer may be comparing the illustration to the time course based on Fig.S4C, which shows the % positive cells, a binary measure. In the illustration (fig.4B), we wrote 'Hr38 expression level', not '%Hr38 positive cells.’ We can clarify this in the figure legend. If the reviewers prefer, we can add a threshold line in the diagram corresponding to the % positive cells at maximum.

    1. Author Response

      The following is the authors’ response to the original reviews.

      Reviewer #1

      The study provides a complete comparative interactome analysis of α-arrestin in both humans and drosophila. The authors have presented interactomes of six humans and twelve Drosophila α-arrestins using affinity purification/mass spectrometry (AP/MS). The constructed interactomes helped to find α-arrestins binding partners through common protein motifs. The authors have used bioinformatic tools and experimental data in human cells to identify the roles of TXNIP and ARRDC5: TXNIP-HADC2 interaction and ARRDC5-V-type ATPase interaction. The study reveals the PPI network for α-arrestins and examines the functions of α-arrestins in both humans and Drosophila.

      Comments

      I will like to congratulate the authors and the corresponding authors of this manuscript for bringing together such an elaborate study on α-arrestin and conducting a comparative study in drosophila and humans.

      Introduction:

      The introduction provides a rationale behind why the comparison between humans and Drosophila is carried out.

      • Even though this is a research manuscript, including existing literature on similar comparison of α-arrestin from other articles will invite a wide readership.

      Results:

      The results cover all the necessary points concluded from the experiments and computational analysis.

      1) The authors could point out the similarity of the α-arrestin in both humans and Drosophila. While comparing α-arrestin in both humans and Drosophila If percentage homology between α-arrestin of both Drosophila and humans needs to be calculated.

      Thank you for your insightful feedback. As suggested by reviewer, we determined percentage homology of α-arrestin protein sequences from human and Drosophila using Clustal Omega. This homology is now illustrated as a heatmap in revised Figure S5. Please note that only the values with percentage homology of 40% or higher are selectively labeled.

      • Citing the direct connecting genes from the network in the text will invite citations and a wider readership.

      Figures:

      The images are elaborate and well-made.

      2) The authors could use a direct connected gene-gene network that pointing interactions. This can be used by other readers working on the same topic and ensure reproducibility and citations.

      We appreciate your valuable comment. Based on the reviewer’s suggestion, we have developed a new website in which one can navigate the gene-gene networks of α-arrestins. These direct connected gene-gene networks are housed in the network data exchange (NDEx) project. Additionally, we have included gene ontology and protein class details for α-arrestins’ interactors in these set of networks, offering a more comprehensive view of α-arrestins’ interactomes.

      On page 24 lines 15-18, we have revised the manuscript to introduce the newly developed website, as follows.

      “Lastly, to assist the research community, we have made comprehensive α-arrestin interactome maps on our website (big.hanyang.ac.kr/alphaArrestin_PPIN). Researchers can search and download their interactomes of interest as well as access information on potential cellular functions and protein class associated with these interactomes.”  

      3-1) The co-expression interactions represented as figures should reveal interaction among the α-arrestin and other genes. Which are the sub-network genes does the α- arrestin interact to/ with from the sub-network? The arrows are only pointing at the sub-networks. The figures do not reveal their interaction. Kindly reveal the interaction in the figure with the proper nodes in the figure.

      3-2) Figure 2: the network attached in both human and drosophila is well represented. The green lines from α-arrestin indicate the strength of the interaction. Several smaller expression networks are seen. But "α-arrestin" in both organisms seems highly disconnected from all the genes. Connected genes have edges, not arrows. If α-arrestin can be shown connected to these gene-gene networks will help in identifying which genes connect with which gene through α-arrestin. This can be used by other readers working on the same topic and ensure reproducibility and citations.

      Thank you for your valuable comment. In response to the reviewer’s recommendation, we’ve added supplementary figure, Figure S4, which illustrates direct interaction between α-arrestin and protein components of clustered complexes (or sub-networks) in addition to the associations shown between α-arrestins and the clustered complexes in Figure 2. We believe that this newly incorporated information regarding direct protein interactions will invite citations and wider readership as the reviewer pointed out.

      On page 12 line 27 to page 13 line 5, we have revised the manuscript to cite the direction interactions between ARRDC3 and proteins involved in ubiquitination-dependent proteolysis, as follows.

      “While the association of ARRDC3 with these ubiquitination-dependent proteolysis complexes is statistically insignificant, ARRDC3 does interact with individual components of these complexes such as NEDD4, NEDD4L, WWP1, and ITCH (Figure S4A). This suggest their functional relevance in this context, as previously reported in both literatures and databases (Nabhan et al., 2010; Shea et al., 2012; Szklarczyk et al., 2015; Warde-Farley et al., 2010) (Puca & Brou, 2014; Xiao et al., 2018).”

      Direct interaction between α-arrestins and protein components of clustered complexes are illustrated in the newly added figure, Figure S4.

      4-1) Figure 4. The Protein blot image was blurred. Kindly provide a higher-resolution image.

      4-2) Figure 5. B. - The authors can provide images with higher resolution blot images. The bands were not visible.

      We appreciate for valuable comment. Unfortunately, the protein blot image was scanned from the original film and the images we provided in the figure represent the highest resolution that we have obtained to date. Raw, uncropped images are shown in Author response image 1 and 2.

      Author response image 1.

      Raw image of Figure 4B

      Author response image 2.

      Raw image of Figure 5B

      5) Figure: 5. A. - I see non-specific amplifications in the gel images. Are these blotting images? or the gel images that were changed to "Grayscale"? Non-specific amplification may imply that the experiment was not repeated and standardized. Was it gel images or blot images?

      We appreciate your insightful comment. The images in Figure 5A represent western blot bands from co-immunoprecipitation assay for analysis of the interaction between TXNIP and HDAC2 proteins. Since immunoblotting using immunoprecipitates can usually detect some non-specific bands from heavy (~ 50 kDa) and light (~25 kDa) chains of the target antibody or from multiple co-immunoprecipitated proteins, we assume that the vague non-specific bands in Figure 5A might be a heavy chain of TXNIP or HDAC2 antibody or an unclear non-specific band. Because target bands showed strong intensity and very clear pattern compared to the non-specific bands in the co-immunoprecipitation assay, we believe that this data is sufficient to support the interaction of TXNIP with HDAC2. Finally, In the revised Figure 5A, we’ve modified the labeling for different experimental conditions, namely siCon and siTXNIP treatments, and added expected size of proteins (kDa), as shown below.

      6) Figure 5. A. RT-PCR analysis: What was your expected size of the amplifications? the ladder indicated is in KDa. Is that right?

      We appreciate your insightful questions. As mentioned above, Figure 5A shows the blotting images of co-immunoprecipitation analysis, and the ladder indicates the molecular weight (kDa) of protein markers. For clearer interpretation, the expected size of target proteins has been added in Figure 5A in the revised manuscript.

      7) How were the band intensities determined?

      Thank you for your question. For quantification of immunoblot results, the densities of target protein bands were analyzed with Image J, as we described in the Materials and Methods.

      Discussion:

      The authors have utilized and discussed the conclusion they draw from their study. But could highlight more on ARRDCs and why it was selected out of the other arrestins. The authors have provided future work directions associated with their work.

      8) Why were only ARRDCs presented amongst all the arrestin in the main part of the manuscript?

      We’re grateful for your valuable feedback. The reason we focused on α-arrestins was that α-arrestins have been discovered relatively recently, especially when compared to more established visual/ β-arrestin proteins in the same arrestin family but the biological functions of many α-arrestins remain largely unexplored, with notable exceptions in the budding yeast model and a few α-arrestins in mammals and invertebrate species. Most importantly, comparative study highlighting the shared or unique features of α-arrestins is yet to be undertaken. To gain a more comprehensive understanding of these unexplored α-arrestins across multiple species, we’ve centered our research on the ARRDCs within the arrestin protein family.

      On page 21 lines 8-17, we’ve edited the manuscript to emphasize the importance of a comparative study on α-arrestins, as detailed below.

      “According to a phylogenetic analysis of arrestin family proteins, α-arrestins were shown to be ubiquitously conserved from yeast to human (Alvarez, 2008). However, compared to the more established visual/ β-arrestin proteins, α-arrestins have been discovered more recently and much of their molecular mechanisms and functions remain mostly unexplored except for budding yeast model (Zbieralski & Wawrzycka, 2022). Based on the high-confidence interactomes of α-arrestins from human and Drosophila, we identified conserved and specific functions of these α-arrestins. Furthermore, we uncovered molecular functions of newly discovered function of human specific α-arrestins, TXNIP and ARRDC5. We anticipate that the discovery made here will enhance current understanding of α-arrestins.”

      9) The discussion could be elaborated more by utilizing the data.

      We appreciate your insightful feedback. Based on the reviewer’s suggestion, we’ve enhanced the discussion in the manuscript to provide a clearer interpretation of our results. First, we’ve added description of conserved protein complexes significantly associated with α-arrestins, stated on page 22 lines 5-12 and lines 23-26.

      Page 22 lines 5-12: “The integrative map of protein complexes also highlighted both conserved and unique relationships between α-arrestins and diverse functional protein complexes. For instance, protein complexes involved in ubiquitination-dependent proteolysis, proteasome, RNA splicing, and intracellular transport (motor proteins) were prevalently linked with α-arrestins in both human and Drosophila. To more precisely identify conserved PPIs associated with α-arrestins, we undertook ortholog predictions within the α-arrestins’ interactomes. This revealed 58 orthologous interaction groups that were observed to be conserved between human and Drosophila (Figure 3).”

      Page 22 lines 23-26: “Additionally, interaction between α-arrestins and entities like motor proteins, small GTPase, ATP binding proteins, and endosomal trafficking components were identified to be conserved. Further validation of these interactions could unveil molecular mechanisms consistently associated with these cellular functions.”

      Secondly, we’ve added description of role of ARRDC5 in osteoclast maturation, as stated on page 23 lines 22-24.

      “Conversely, depletion of ARRDC5 reduces osteoclast maturation, underscoring the pivotal role of ARRDC5 in osteoclast development and function (Figure S9A and B).”

      Lastly, we examined the association between α-arrestins’ interactomes and human diseases, incorporating our findings into the discussion. The newly introduced figure based on the result is Figure S10.

      On page 24 lines 10-14, we’ve added discussion on Figure S10 as follows.

      “We further explored association between α-arrestins’ interactomes and disease pathways (Figure S10). Notably, the interactomes of α-arrestins in human showed clear links to specific diseases. For instance, ARRDC5 is closely associated with disease resulting from viral infection and cardiovascular conditions. ARRDC2, ARRDC4, and TXNIP share common association with certain neurodegenerative diseases, while ARRDC1 is implicated in cancer.”

      Supplementary figures:

      The authors have a rigorous amount of work added together for the success of this manuscript.

      10) The reference section needs editing before publication. Maybe the arrangement was disturbed during compiling.

      Thank you for your valuable comment. Based on the reviewer’s suggestion, we have rearranged the reference section to enhance its clarity. Below are excerpts from the update reference section in the manuscript.

      “Adenuga, D., & Rahman, I. (2010). Protein kinase CK2-mediated phosphorylation of HDAC2 regulates co-repressor formation, deacetylase activity and acetylation of HDAC2 by cigarette smoke and aldehydes. Arch Biochem Biophys, 498(1), 62-73. doi:10.1016/j.abb.2010.04.002

      Adenuga, D., Yao, H., March, T. H., Seagrave, J., & Rahman, I. (2009). Histone Deacetylase 2 Is Phosphorylated, Ubiquitinated, and Degraded by Cigarette Smoke. American Journal of Respiratory Cell and Molecular Biology, 40(4), 464-473. doi:10.1165/rcmb.2008-0255OC

      Akalin, A., Franke, V., Vlahovicek, K., Mason, C. E., & Schubeler, D. (2015). Genomation: a toolkit to summarize, annotate and visualize genomic intervals. Bioinformatics, 31(7), 1127-1129. doi:10.1093/bioinformatics/btu775

      Alvarez, C. E. (2008). On the origins of arrestin and rhodopsin. BMC Evol Biol, 8, 222. doi:10.1186/1471-2148-8-222”

      11) many important references were missing.

      We appreciate and agree with the reviewer’s comment. In response to the reviewer’s recommendation, we’ve thoroughly reviewed the manuscript and below are sections of the manuscript where around 20 new references have been added.

      On page 8 lines 12-14:

      “Utilizing the known affinities between short linear motifs in α-arrestins and protein domains in interactomes(El-Gebali et al., 2019; UniProt Consortium, 2018) “

      On page 8 lines 19-22:

      “One of the most well-known short-linear motifs in α-arrestin is PPxY, which is reported to bind with high affinity to the WW domain found in various proteins, including ubiquitin ligases (Ingham, Gish, & Pawson, 2004; Macias et al., 1996; Sudol, Chen, Bougeret, Einbond, & Bork, 1995)”

      On page 9 lines 3-6:

      “Next, we conducted enrichment analyses of Pfam proteins domains (El-Gebali et al., 2019; Huang da, Sherman, & Lempicki, 2009b) among interactome of each α-arrestin to investigate known and novel protein domains commonly or specifically associated (Figure S3A; Table S5).”

      On page 9 lines 7-10:

      “HECT and C2 domains are well known to be embedded in the E3 ubiquitin ligases such as NEDD4, HECW2, and ITCH along with WW domains (Ingham et al., 2004; Melino et al., 2008; Rotin & Kumar, 2009; Scheffner, Nuber, & Huibregtse, 1995; Weber, Polo, & Maspero, 2019)”

      On page 10 lines 12-16:

      “In fact, the known binding partners, NEDD4, WWP2, WWP1, and ITCH in human and CG42797, Su(dx), Nedd4, Yki, Smurf, and HERC2 in Drosophila, that were detected in our data are related to ubiquitin ligases and protein degradation (C. Chen & Matesic, 2007; Ingham et al., 2004; Y. Kwon et al., 2013; Marin, 2010; Melino et al., 2008; Rotin & Kumar, 2009) (Figure 1E; Figure S2F).”

      On page 13 lines 20-21:

      “Given that α-arrestins are widely conserved in metazoans (Alvarez, 2008; DeWire, Ahn, Lefkowitz, & Shenoy, 2007), “

      On page 14 lines 12-17:

      “The most prominent functional modules shared across both species were the ubiquitin-dependent proteolysis, endosomal trafficking, and small GTPase binding modules, which are in agreement with the well-described functions of α-arrestins in membrane receptor degradation through ubiquitination and vesicle trafficking (Dores et al., 2015; S. O. Han et al., 2013; Y. Kwon et al., 2013; Nabhan et al., 2012; Puca & Brou, 2014; Puca et al., 2013; Shea et al., 2012; Xiao et al., 2018; Zbieralski & Wawrzycka, 2022) (Figure 3).”  

      Reviewer #2

      In this manuscript, the authors present a novel interactome focused on human and fly alpha-arrestin family proteins and demonstrate its application in understanding the functions of these proteins. Initially, the authors employed AP/MS analysis, a popular method for mapping protein-protein interactions (PPIs) by isolating protein complexes. Through rigorous statistical and manual quality control procedures, they established two robust interactomes, consisting of 6 baits and 307 prey proteins for humans, and 12 baits and 467 prey proteins for flies. To gain insights into the gene function, the authors investigated the interactors of alpha-arrestin proteins through various functional analyses, such as gene set enrichment. Furthermore, by comparing the interactors between humans and flies, the authors described both conserved and species-specific functions of the alpha-arrestin proteins. To validate their findings, the authors performed several experimental validations for TXNIP and ARRDC5 using ATAC-seq, siRNA knockdown, and tissue staining assays. The experimental results strongly support the predicted functions of the alpha-arrestin proteins and underscore their importance. `

      I would like to suggest the following analyses to further enhance the study:

      1) It would be valuable if the authors could present a side-by-side comparison of the interactomes of alpha-arrestin proteins, both before and after this study. This visual summary network would demonstrate the extent to which this work expanded the existing interactome, emphasizing the overall contribution of this study to the investigation of the alpha-arrestin protein family.

      We greatly appreciate your insightful feedback. In response to the reviewer’s suggestion, we’ve depicted a network of known PPIs associated with α-arrestins (Figure S2C and D). Furthermore, by comparing our high-confidence PPIs to these known sets, we found that the overlaps are statistically significant and the high-confidence PPIs of α-arrestins broaden the existing interactome (Figure S2E).

      From page 7 line 26 to page 8 line 8, we’ve detailed this side-by-side comparisons of existing interactome and newly discovered high-confidence PPIs of α-arrestins, as outline below.

      “As a result, we successfully identified many known interaction partners of α-arrestins such as NEDD4, WWP2, WWP1, ITCH and TSG101, previously documented in both literatures and PPI databases (Figure S2C-F) (Colland et al., 2004; Dotimas et al., 2016; Draheim et al., 2010; Mellacheruvu et al., 2013; Nabhan et al., 2012; Nishinaka et al., 2004; Puca & Brou, 2014; Szklarczyk et al., 2015; Warde-Farley et al., 2010; Wu et al., 2013). Additionally, we greatly expanded repertoire of PPIs associated with α-arrestins in human and Drosophila, resulting in 390 PPIs between six α-arrestins and 307 prey proteins in human, and 740 PPIs between twelve α-arrestins and 467 prey proteins in Drosophila (Figure S2E). These are subsequently referred to as ‘high-confidence PPIs’ (Table S3).”

      2) While the authors conducted several analyses exploring protein function, there is a need to further explore the implications of the interactome in human diseases. For instance, it would be beneficial to investigate the association of the newly identified interactome members with specific human diseases. Including such investigations would strengthen the link between the interactome and human disease contexts.

      Thank you for your valuable comment. As suggested by the reviewer, we examined the association between α-arrestins’ interactomes and human diseases, incorporating our findings into the discussion. The newly introduced figure based on the result is Figure S10.

      On page 24 lines 10-14, we’ve added discussion on Figure S10 as follows.

      “We further explored association between α-arrestins’ interactomes and disease pathways (Figure S10). Notably, the interactomes of α-arrestins in human showed clear links to specific diseases. For instance, ARRDC5 is closely associated with disease resulting from viral infection and cardiovascular conditions. ARRDC2, ARRDC4, and TXNIP share common association with certain neurodegenerative diseases, while ARRDC1 is implicated in cancer.”

      Reviewer #3:

      Lee, Kyungtae and colleagues have discovered and mapped out alpha-arrestin interactomes in both human and Drosophila through the affinity purification/mass spectrometry and the SAINTexpress method. They found the high confident interactomes, consisting of 390 protein-protein interactions (PPIs) between six human alpha-arrestins and 307 preproteins, as well as 740 PPIs between twelve Drosophila alpha-arrestins and 467 prey proteins. To define and characterize these identified alpha-arrestin interactomes, the team employed a variety of widely recognized bioinformatics tools. These included protein domain enrichment analysis, PANTHER for protein class enrichment, DAVID for subcellular localization analysis, COMPLEAT for the identification of functional complexes, and DIOPT to identify evolutionary conserved interactomes. Through these analyses, they confirmed known alpha-arrestin interactors' role and associated functions such as ubiquitin ligase and protease. Furthermore, they found unexpected biological functions in the newly discovered interactomes, including RNA splicing and helicase, GTPase-activating proteins, ATP synthase. The authors carried out further study into the role of human TXNIP in transcription and epigenetic regulation, as well as the role of ARRDC5 in osteoclast differentiation. This study holds important value as the newly identified alpha-arrestin interactomes are likely aiding functional studies of this group of proteins. Despite the overall support from data for the paper's conclusions, certain elements related to data quantification, interpretation, and presentation demand more detailed explanation and clarification.

      1) In Figure 1B, it is shown that human alpha-arrestins were N-GFP tagged (N-terminal) and Drosophila alpha-arrestins were C-GFP (C-terminal). However, the rationale of why the authors used different tags for human and fly proteins was not explained in the main text and methods.

      We appreciate your valuable comment. Both N- and C-terminally tagged α-arrestins have been used previously. Given that our study aims to increase the repertoire of α-arrestin interacting proteins, where GFP is added might not be a concern. We note that GFP is a relatively bulky tag, and tagging a protein with GFP can potentially abolish the interaction with some of the binding proteins. Follow-up studies utilizing different approaches for detecting protein-protein interactions, such as BioID and yeast two-hybrid, will allow us to build more comprehensive α-arrestin interactomes.

      2) In Figure 2A, there seems to be an error for labeling the GAL4p/GAL80p complex that includes NOTCH2, NOTCH1 and TSC2.

      Thank you for comment. We double-checked COMPLEAT (protein COMPLex Enrichment Analysis Tool) database for the name of protein complex consisting of NOTCH1, NOTCH2, AND TSC2. The database indeed labeled this complex as the “GAL4p/GAL80p complex”. However, given the potential for mis-annotation (since we could not ascertain the relevance of these proteins to the “GAL4p/GAL80p complex”), we chose to exclude this protein complex from the network. The update protein complex network is illustrated in the revised Figure 2A.

      3) In Figure 5, given that knockdown of TXNIP did not affect the levels and nuclear localization of HDAC2, the authors suggest that TXNIP might modulate HDAC2 activity. However, the ChiP assay suggest a different model - TXNIP-HDAC2 interaction might inhibit the chromatin occupancy of HDAC2, reducing histone deacetylation and increasing global chromatin accessibly. The authors need to propose a model consistent with these sets of all data.

      We greatly appreciate your detailed feedback. Our data indicates a global decrease in chromatin accessibility (Figure 4C-G) and a diminished interaction between TXNIP and HDAC2 under depletion of TXNIP (Figure 5A). Additionally, we observed an increased occupancy of HDAC2 and subsequent histone deacetylation at TXNIP-target promoter regions (Figure 5C) without any changes in the HDAC2 expression level (Figure 5A) in TXNIP- knockdown cells. From these observations, we infer that the interaction between TXNIP-HDAC2 might suppress the function of HDAC2, a major gene silencer affecting the formation of condensed or accessible chromatin by deacetylating activity. Although we checked whether TXNIP could induce cytosolic retention of HDAC2 to inhibit nuclear function of HDAC2, TNXIP knockdown did not alter its subcellular localization (Figure 5B).

      To elucidate the mechanism by which TXNIP inhibits the function of HDAC2, we further investigated the effect of TXNIP on the levels of HDAC2 phosphorylation, which is known to be crucial for its deacetylase activity and the formation of transcriptional repressive complex. However, as shown in the Figure S8C and D, the knockdown of TXNIP did not affect the HDAC2 phosphorylation status, as well as the interaction between HDAC2 and other components in NuRD complex in the immunoblotting and co-IP assays, respectively. The results suggest that TXNIP may inhibit the function of HDAC2 independently of these factors.

      Following the reviewer’s suggestion, we carefully provided a proposed model describing the possible role of TXNIP in transcriptional regulation through interaction with HDAC2 and co-repressor complex in Figure S8E.

      Description of these newly added figures can be found in the revised manuscript from page 18 line 7 to 27, as outlined below.

      “HDAC2 typically operates within the mammalian nucleus as part of co-repressor complexes as it lacks ability to bind to DNA directly (Hassig, Fleischer, Billin, Schreiber, & Ayer, 1997). The nucleosome remodeling and deacetylation (NuRD) complex is one of the well-recognized co-repressor complexes that contains HDAC2 (Kelly & Cowley, 2013; Seto & Yoshida, 2014) and we sought to determine if depletion of TXNIP affects interaction between HDAC2 and other components in this NuRD complex. While HDAC2 interacted with MBD3 and MTA1 under normal condition, the interaction between HDAC2 and MBD3 or MTA1 was not affected upon TXNIP depletion (Figure S8C). Next, given that HDAC2 phosphorylation is known to influence its enzymatic activity and stability (Adenuga & Rahman, 2010; Adenuga, Yao, March, Seagrave, & Rahman, 2009; Bahl & Seto, 2021; Tsai & Seto, 2002), we tested if TXNIP depletion alters phosphorylation status of HDAC2. The result indicated, however, that phosphorylation status of HDAC2 does not change upon TXNIP depletion (Figure S8D). In summary, our findings suggest a model where TXNIP plays a role in transcriptional regulation independent of these factors (Figure S8E). When TXNIP is present, it directly interacts with HDAC2, a key component of transcriptional co-repressor complex. This interaction suppresses the HDAC2 ‘s recruitment to target genomic regions, leading to the histone acetylation of target loci possibly through active complex including histone acetyltransferase (HAT). As a result, transcriptional activation of target gene occurs. In contrast, when TXNIP expression is diminished, the interaction between TXNIP and HDAC2 weakens. This restores histone deacetylating activity of HDAC2 in the co-repressor complex, leading to subsequent repression of target gene transcription.”

      4) The authors showed that ectopic expression of ARRDC5 increased osteoclast differentiation and function. Does loss of ARDDC5 lead to defects in osteoclast function and fate determination?

      We appreciate your valuable comment. We have confirmed the endogenous expression of ARRDC5 in osteoclasts and conducted a loss-of-function study using shARRDC5. As determined by qPCR, ARRDC5 was endogenously expressed very low in osteoclasts. Even during RANKL-induced osteoclast differentiation, the CT value (29-31) for ARRDC5 expression was high in osteoclasts compared to the CT value (17-24) for the expression of marker genes Cathepsin K, TRAP, and NFATc1. Even though its endogenous expression was very low, we generated ARRDC5 knockdown cells by infecting BMMs with lentivirus expressing shRNA of ARRDC5 and subsequently differentiated the cells into mature osteoclasts. After five days of differentiation, we observed a significant decrease in the total number of TRAP-positive multinucleated cells (No. of TRAP+ MNCs) in shARRDC5 cells compared to that in the control cells. This result indicates that the loss of ARRDC5 leads to defects in osteoclast differentiation. Result of this loss-of-function study using shARRDC5 is depicted in Figure S9A and B.

      In the revised manuscript, following sentence explaining Figure S9A and B was added on page 19 lines 15-17 as follows.

      “Depletion of ARRDC5 using short hairpin RNA (shRNA) impaired osteoclast differentiation, further affirming its crucial role in this differentiation process (Figure S9A and B).”

      5) From Figure 6D, the authors argued that ARRDC5 overexpression resulted in more V-ATPase signals: however, there is no quantification. Quantification of the confocal images will foster the conclusion. Also, western blots for V-ATPase proteins will provide an alternative way to determine the effects of ARRDC5.

      We appreciate your insightful feedback. As suggested by the reviewer, we quantified V-type ATPase signals using confocal images, which were shown in Figure 6D. The ImageJ program was employed for integrated density measurements, and the integrated density of GFP-GFP overexpressing osteoclasts was set to 1 for relative comparison. The result in the revised Figure 6D revealed a significant increase in V-type ATPase signals in GFP-ARRDC5 overexpressing osteoclasts compared to that in GFP-GFP overexpressing osteoclasts, as outlined below.

      We also agree with the reviewer’s comment that Western blot for V-ATPase proteins will be an alternative way to determine the effects of ARRDC5 in osteoclast differentiation. We have confirmed no different expression of V-type ATPase between GFP-GFP and GFP-ARRDC5 overexpressing osteoclasts using qPCR and western blot analysis. The corresponding western blot result is shown in the revised Figure S9C.

      In addition, the corresponding qPCR that measures the expression level of V-type ATPase between GFP-GFP and GFP-ARRDC5 overexpressing osteoclasts is shown in Author response image 3.

      Author response image 3.

      Moreover, based on the references, the V-type ATPase is localized at the plasma membrane during osteoclast differentiation (Toyomura et al., 2003). Although mRNA and protein expression levels were similar in both cells, localization of V-ATPase in plasma membrane was significantly increased in GFP-ARRDC5 overexpressing osteoclasts compared to that in GFP-GFP osteoclasts, as shown in the revised Figure 6D above.

      6) The results from Figure 6D did not support the authors' argument that ARRDC5 might control the membrane localization of the V-ATPase, as bafilomycin is the V-ATPase inhibitor. ARRDC5 knockdown experiments will help to determine whether ARRDC5 can control the membrane localization of the V-ATPase in osteoclast.

      Thank you for your insightful comment. V-type ATPase has been reported to play an important role in the differentiation and function of osteoclasts (Feng et al., 2009; Qin et al., 2012). Given that various subunits of the V-type ATPase interact with ARRDC5 (Figure 6A), we speculated that ARRDC5 might be involved in the function of this complex and play a role in osteoclast differentiation and function. As answered above, GFP-ARRDC5 overexpressing osteoclasts showed a similar expression level of V-type ATPase to GFP-GFP cells but exhibited increased V-type ATPase signals at the cell membrane compared to those in GFP-GFP cells (Figure 6D). Additionally, co-localization of ARRDC5 and V-type ATPase was observed in the osteoclast membrane (Figure 6D), as predicted by the human ARRDC5-centric PPI network. On the other side, bafilomycin A1, a V-type ATPase inhibitor, not only blocked localization of V-type ATPase to plasma membrane in GFP-ARRDC5 overexpressing osteoclasts, but also reduced ARRDC5 signals (Figure 6D). These results indicate that ARRDC5 plays a role in osteoclast differentiation and function by interacting with V-type ATPase and promoting the localization of V-type ATPase to plasma membrane in osteoclasts.

      V-type ATPase present in osteoclast membrane is important to cell fusion, maturation, and function during osteoclast differentiation (Feng et al., 2009; Qin et al., 2012). GFP-ARRDC5 overexpressing osteoclasts showed a significant increase of V-type ATPase signals in the cell membrane compared to GFP-GFP cells (Figure 6D), and also significantly increased cell fusion (No. of TRAP+ MNCs in Figure 6B) and resorption activity (resorption pit formation in Figure 6C). However, ARRDC5 knockdown in osteoclasts (shARRDC5 cells) showed a significant decrease in No. of TRAP+ MNCs compared to that in the control cells, indicating that the loss of ARRDC5 leads to defects in cell fusion during osteoclast differentiation (Figure S9A and B). As described above, the endogenous expression of ARRDC5 was very low in osteoclasts and could be specifically expressed in a certain timepoint during the differentiation. Therefore, to better understand the interaction with V-type ATPase of ARRDC5 in osteoclasts, ARRDC5 overexpression is more suitable than its knockdown.

      Part of the manuscript on page 19 line 21 to page 20 line 6 was edited to support our statement, as outlined below.

      “The V-type ATPase is localized at the osteoclast plasma membrane (Toyomura et al., 2003) and its localization is important for cell fusion, maturation, and function during osteoclast differentiation (Feng et al., 2009; Qin et al., 2012). Furthermore, its localization is disrupted by bafilomycin A1, which is shown to attenuate the transport of the V-type ATPase to the membrane (Matsumoto & Nakanishi-Matsui, 2019). We analyzed changes in the expression level and localization of V-type ATPase, especially V-type ATPase V1 domain subunit (ATP6V1), in GFP-GFP and GFP-ARRDC5 overexpressing osteoclasts. The level of V-type ATPase expression did not change in osteoclasts regardless of ARRDC5 expression levels (Figure S9C). GFP signals were detected at the cell membrane when GFP-ARRDC5 was overexpressed, indicating that ARRDC5 might also localize to the osteoclast plasma membrane (Figure 6D; Figure S9D). In addition, we detected more V-type ATPase signals at the cell membrane in the GFP-ARRDC5 overexpressing osteoclasts, and ARRDC5 and V-type ATPase were co-localized at the osteoclast membrane (Figure 6D; Figure S9D).”

      7) The tables (excel files) do not have proper names for each table S numbers. Please correct the name of excel files for readers.

      We appreciate your valuable comments. In response to the reviewer’s suggestion, we’ve renamed excel files to more appropriate titles for easier readability. List of renamed tables (excel files) are shown below.

      Table S1. List of α-arrestins from human and Drosophila Table S2. Evaluation sets of α-arrestins PPIs Table S3. Summary tables of SAINTexpress results Table S4. Protein domains and short linear motifs in the α-arrestin interactomes Table S5. Enriched Pfam domains in the α-arrestin interactomes Table S6. Subcellular localizations of α-arrestin interactomes Table S7. Summary of protein complexes and cellular components associated with α-arrestin Table S8. Orthologous relationship of α-arrestin interactomes between human and Drosophila Table S9. Summary of ATAC- and RNA-seq read counts before and after processing Table S10. Differential accessibility of ACRs and gene expression Table S11. Summary of ATAC-seq peaks located in promoters and gene expression level Table S12. List of primer sequences used in this study

      8) http://big.hanyang.ac.kr/alphaArrestin_Fly link does not work. Please fix the link.

      We appreciate your comment. In response to the reviewer’s comment, we have made comprehensive α-arrestin interactome maps on our new website (big.hanyang.ac.kr/alphaArrestin_PPIN) and confirmed that users can be re-directed to networks housed in NDEx.

      Author response image 4.

      Screen shot of the first page of the newly developed website.

      Website address: big.hanyang.ac.kr/‌‌‌‌‌‍‍‍‌‌alphaArrestin_PPIN

      Author response image 5.

      Screen shot of the gene-gene network involving α-arrestin in human.

    1. Author Response

      eLife assessment

      This study presents valuable insights into the epigenetic landscape in adult kidney podocytes. A series of solid experiments demonstrate that genes that are regulated by a key kidney transcription factor, Mafb, are essential for H3K4me3 methylation and recruitment of Wt1 to Nphs1 and Nphs2. This new information provides insights into the potential relationship and coordination of transcription factors in regulating target genes in podocytes in glomerular diseases, although the conclusion that MafB is generally required for Wt1 to bind to podocyte-specific promoters is incomplete and should be extended beyond two or three genes.

      We thank the reviewers and editors for critically reading our manuscript and their insightful comments. We will strive to revise

      Reviewer #1 (Public Review):

      Summary:

      In their manuscript, Massa and colleagues provide a map of the epigenetic landscape in podocytes and analyze the role of the transcription factor MafB in podocyte gene expression. They initially map the histone profile in adult podocytes of the mouse by assaying three different histone methylation marks, namely H3K4me3, H3K4me1, and H3K27me3 for active, primed, and repressed states. They then perform Wt1- and MafB-ChIP-Seq analysis to identify respective direct targets of those transcription factors. Subsequently, they employ an inducible MafB knockout model and show that homozygous knockout mice show proteinuria and FSGS, suggesting an important role for MafB in podocyte homeostasis. RNA-Seq analysis in mice two daysafter tamoxifen application identified direct and indirect MafB target genes. Finally, the authors turn to a constitutive MafB knockout model, carry out anti-H3K4me3 and anti-Wt1 ChIP experiments, and examine selected promoters. One main conclusion from this work is that MafB opens chromatin and thus facilitates the binding of other transcription factors like Wt1 to podocyte-specific genes.

      Strengths and weaknesses:

      The authors have performed an impressive number of experiments and generated very valuable data. They use state-of the-art technology and the data are presented well and are sound. This being said the manuscript contains significant novel data, but also experiments that are already available in some sort. The histone profile in adult mouse podocytes is novel and provides an interesting map of epigenetic marks in this particular cell type. It is maybe not too surprising that podocyte-differentiation genes have different chromatin accessibility than genes associated with general development. The Wt1-ChIP has been done before by several labs but is certainly an important control in this work. The MafB-ChIP is new. The inducible MafB knockout model including the identification of Tcf21 as a target gene has been published by others in 2020 (and is acknowledged by the authors). The experiments addressing the potential role of MafB in chromatin opening are new. I find that the data are certainly compatible with the model put forward by the authors, but they are not compelling.

      We agree that additional data on changes in chromatin accessibility in the absence of Mafb would help to support our model and we will be working towards this data for a revised version of the manuscript.

      Reviewer #2 (Public Review):

      Summary:

      The authors investigate the role of MafB in regulating podocyte genes. Mafb is required for podocyte differentiation and maintenance. Mutations of this gene cause FSGS in mice and humans. They profiled MafB binding genome-wide in isolated glomeruli and defined overlap with Wt1. They provide evidence that Mafb is required for Wt1 binding and H3K4me3 methylation at the promoters of two essential podocyte genes, Nphs1 and Nphs2 Understanding how the action of different transcription factors is coordinated to control gene expression - the main goal of this paper - is an important line of investigation.

      While the main conclusion of the paper is supported by their data, the scope is limited. Additional ChIP-seq experiments and data analysis are needed to solidify and extend their conclusions.

      Strengths:

      1) Performing ChIP-seq for histone modifications on isolated podocytes provides valuable cell-type-specific information. Similarly, profiling Mafb and Wt1 in isolated glomeruli provides podocyte-specific binding patterns because these transcription factors (TFs) are not expressed in other cell types in glomeruli. The significant overlap of their Wt1 binding genome-wide withthat of prior published work is reassuring. RNA-seq on isolated podocytes provides the appropriate cell-type specific gene expression data to integrate with ChIP-seq data. Together, the RNA-seq and ChIP-seq data are valuable resources for other investigators examining gene regulation in mouse podocytes.

      2) The phenotype analysis of their FSGS model is convincing and well done.

      3) Testing how Wt1 binding is affected by loss of Mafb provides insight into how these key podocyte TFs may cooperate to regulate genes.

      Weaknesses:

      1) The conclusion that Mafb is required for Wt1 binding and H3K4me3 methylation is based solely on ChIP-PCR at two gene promoters (Nphs1, Nphs2). This result should be validated and extended by ChIP-seq. Mafb and Wt1 binding overlap at more than 200 sites. If their model is correct, it is likely that Wt1 binding would be affected at other genomic sites. This result would add strong support to their model of how Wt1 and Mafb cooperate to regulate genes in podocytes. Moreover, ChIP-seq would define whether the dependence of Wt1 on Mafb is also evident at distal regulatory regions (defined H3K4me1, which is typically found at predicted enhancers).

      We agree that a genome wide analysis of chromatin accessibility would help corroborating our model and will work towards this data for a revised version.

      2) The FSGS model generated by the authors involved conditional deletion of Mafb in podocytes at 8 weeks of age. They found that this resulted in reduced expression of Nphs1 and Nphs2 within 48 hours post-deletion. However, they investigated Wt1 binding and H3K4me3 genomic binding in Mafb homozygous null embryos. While this result provides information about podocyte differentiation, it does not address the maintenance of expression of these essential podocyte genes in the adult kidney. Because post-natal deletion of Mafb led to FSGS and reduced expression of Nphs1/2, ChIP-seq should be performed on the adult conditional mutants in order to provide mechanistic information about the disease.

      The fact that the phenotype in Mafb conditional mutant animals is progressive means that epigenetic changes are also likely to be quantitative. Indeed, Nphs1/Nphs2 are still expressed 6 weeks after Mafb deletion, albeit at lower levels. Since ChIP-seq experiments are not necessarily quantitative, we believe it may be difficult to detect statistically significant changes in this model. We will discuss this limitation of our study in a revised version of our manuscript.

      3) H3K4me1 binds enhancer regions. The authors performed ChIP-seq to profile H3K4me1 in isolated podocytes. However, there was no analysis reported of these results. It would be valuable to determine if Wt1 and Mafb co-localize at predicted enhancers in podocytes and if Wt1 binding is lost at these regions in Mafb mutant glomeruli.

      We well reanalyse the data taking the reviewer’s comments into account.

    1. Author Response

      The following is the authors’ response to the current reviews.

      For the final Version of Record the following changes will be included: 1. Figure 4: Example traces replaced with a more representative simulation run that is more similar to the mean. 2. Methods: Description of the alignment procedure expanded to explain the algorithm steps better.


      The following is the authors’ response to the previous reviews

      We are grateful for the positive and insightful feedback from the editors and reviewers. These constructive comments have contributed to the enhancement of our work. We have revised the manuscript, addressing each of the comments raised. In addition, based on the commentary provided, we have introduced two new figures that offer a deeper understanding of our research findings:

      In new Figure 7, we present the analysis of the difference in onset times between motion and flash responses. This figure also includes a simple illustration elucidating the origins of these differences, highlighting the varying engagement of receptive fields by these stimuli. The data presented in this figure were initially featured in the main text of the original manuscript. Figure 11 offers a detailed comparison of the temporal and spatial characteristics of the synthetic presynaptic signals driving optimal DS in SACs. We compare these characteristics with the properties extracted from recorded glutamate release. Our analysis suggests that the sluggish dynamics observed in biological signals impede effective directional integration. Below are the detailed point-by-point responses to reviewers comments.

      Reviewer #1 (Public Review):

      Summary:

      Direction selectivity (DS) in the visual system is first observed in the radiating dendrites of starburst amacrine cells (SACs). Studies over the last two decades have aimed to understand the mechanisms that underlie these unique properties. Most recently, a 'space-time' model has garnered special attention. This model is based on two fundamental features of the circuit. First, distinct anatomical types of bipolar cells (BCs) are connected to proximal/distal regions of each of the SAC dendritic sectors (Kim et al., 2014). Second, that input across the length of the starburst is kinetically diverse, a hypothesis that has been only recently demonstrated experimentally using iGluSnFR imaging (Srivastava et al., 2022). However, the stark kinetic distinctions, i.e., the sustained/transient nature of BC input to SACs dendrites appear to be present mainly in responses to stationary stimuli. When BC receptive field properties are probed using white noise stimuli, the kinetic differences between BCs are relatively subtle or nonexistent (Gaynes et al., 2022; Strauss et al., 2022, Srivastava et al., 2022). Thus, if and how BCs contribute to direction selectivity driven by moving spots that are commonly used to probe the circuit remains to be clarified. To address this issue, Gaynes et al., combine evolutionary computational modeling (Ankri et al., 2020) with two-photon iGluSnFR imaging to address to what degree BCs contribute to the generation of direction selectivity in the starburst dendrites in response to stimuli that are commonly used experimentally.

      Strengths:

      Combining theoretical models and iGluSnFR imaging is a powerful approach as it first provides a basic intuition on what is required for the generation of robust DS, and then tests the extent to which the experimentally measured BC output meets these requirements.

      The conclusion of this study builds on the previous literature and comprehensively considers the diverse BC receptive field properties that may contribute to DS (e.g. size, lag, rise time, decay time).

      By 'evolving' bipolar inputs to produce robust DS in a model network, these authors provide a sound framework for understanding which kinetic properties could potentially be important for driving downstream DS. They suggest that response delay/decay kinetics, rather than the center/surround dynamics are likely to be most relevant (albeit the latter could generate asymmetric responses to radiating/looming stimuli).

      Weaknesses:

      Finally, these authors report that the experimentally measured BC responses are far from optimal for generating DS. Thus, the BC-based DS mechanism does not appear to explain the robust DS observed experimentally (even with mutual inhibition blocked). Nevertheless, I feel the comprehensive description of BC kinetics and the solid assessment of the extent to which they may shape DS in SAC dendrites, is a significant advancement in the field.

      Reviewer #2 (Public Review):

      Summary:

      In this study, the authors sought to understand how the receptive fields of bipolar cells contribute to direction selectivity in starburst amacrine cell (SAC) dendrites, their post synaptic partners. In previous literature, this contribution is primarily conceptualized as the 'space-time wiring model', whereby bipolar cells with slow-release kinetics synapse onto proximal dendrites while bipolar cells with faster kinetics synapse more distally, leading to maximal summation of the slow proximal and fast distal depolarizations in response to motion away from the soma. The space-time wiring contribution to SAC direction selectivity has been extensively tested in previous literature using connectomic, functional, and modeling approaches. However, the authors argue that previous functional studies of bipolar cell kinetics have focused on static stimuli, which may not accurately represent the spatiotemporal properties of the bipolar cell receptive field in response to movement. Moreover, this group and others have recently shown that bipolar cell signal processing can change directionally when visual stimuli starts within the receptive field rather than passing through it, complicating the interpretation of moving stimuli that start within a bipolar cell of interest's receptive field (e.g. stimulating only one branch of a SAC or expanding/contracting rings). Thus, the authors choose to focus on modeling and functionally mapping bipolar cell kinetics in response to moving stimuli across the entire SAC dendritic field.

      General Comments

      There have been several studies that have addressed the contribution of space-time wiring to SAC process direction selectivity. The impact of this project is to show that this contribution is limited. First, the optimal solution obtained by the evolutionary algorithm to generate DS processes is slow proximal and fast distal inputs - exactly what is predicted by space-time wiring, which is exactly what is required of the HRC model. Hence, this result seems expected and it's not clear what the alternative hypothesis is. Second, the experimental results based on glutamate imaging to assess the kinetics of glutamate release under conditions of visual stimulation across a large region of retina confirm previous observations but were important to test. Third, by combining their model model with this experiment data, they conclude that even the optimal space-time wiring is not sufficient to explain the SAC process DS. The results of this approach might be more impactful if the authors come to some conclusion as to what factors do determine the direction selectivity of the SAC process since they have argued that all the current models are not sufficient.

      Reviewer #3 (Public Review):

      Gaynes et al. investigated the presynaptic and postsynaptic mechanisms of starburst amacrine cell (SAC) direction selectivity in the mouse retina by computational modeling and glutamate sensitivity (iGluSnFR) imaging methods. Using the SAC computational simulation, the authors initially tested bipolar cell contributions (space-time wiring model, presynaptic effect) and SAC axial resistance contributions (postsynaptic effect) to the SAC DS. Then, the authors conducted two-photon iGluSnFR imaging from SACs to examine the presynaptic glutamate release, and found seven clusters of ON-responding and six clusters of OFF-responding bipolar cells. They were categorized based on their response kinetics: delay, onset phase, decay time, and others. Finally, the authors generated a model consisting of multiple clusters of bipolar cells on proximal and distal SAC dendrites. When the SAC DS was measured using this model, they found that the space-time wiring model accounted for only a fraction of SAC DS.

      The article has many interesting findings, and the data presentation is superb. Strengths and weaknesses are summarized below.

      Major Strengths:

      • The authors utilized solid technology to conduct computational modeling with Neuron software and a machine-learning approach based on evolutionary algorithms. Results are effectively and thoroughly presented.

      • The space-time wiring model was evaluated by changing bipolar cell response properties in the proximal and distal SAC dendrites. Many response parameters in bipolar cells are compared, and DSI was compared in Figure 3.

      • Two-photon microscopy was used to measure the bipolar cell glutamate outputs onto SACs by conducting iGluSnFR imaging. All the data sets, including images and transients, are elegantly presented. The authors analyzed the response based on various parameters, which generated more than several response clusters. The clustering is convincing.

      Major Weaknesses:

      • In Figure 9, the authors generated the bipolar cell cluster alignment based on the space-time wiring model. The space-time wiring model has been proposed based on the EM study that distinct types of bipolar cells synapse on distinct parts of SAC dendrites (Green et al 2016, Kim et al 2014). While this is one of the representative Reicardt models, it is not fully agreed upon in the field (see Stincic et al 2016). While the authors' approach of testing the space-time wiring model and conclusions is interesting and appreciated, the authors could address more issues: mainly two clusters were used to generate the model, but more numbers of clusters should be applied. Although the location of each cluster on the SAC dendrites is unknown, the authors should know the populations of clusters by iGluSnFR experiments. Furthermore, the authors could provide more suggestive mechanisms after declining postsynaptic factors and the space-time wiring model.

      The reviewer is correct that the proximal and more distal SAC dendrites sample from different IPL depths. It should be theoretically possible to match the functional clusters we measured with anatomical bipolar cell identities. However, the stratifications of these cells have significant overlaps (Figure 6-S2), and previous attempts to match iGluSnFR signals to anatomy proved to be challenging (Franke et al., 2017; Gaynes et al., 2022; Matsumoto et al., 2019; Srivastava et al., 2022; Strauss et al., 2022). In the revised version of the manuscript, we reorder the functional clusters based on their transiency, which has a higher correlation to stratification depth (Franke et al., 2017).

      We have examined a scenario in which the presynaptic population comprises more than two clusters. We constructed synthetic models whose input structure was as in Figure 10 (old Figure 9). The optimal configuration for the most proximal and distal inputs closely resembled the proximal-distal model reported in Figure 2. However, we observed a nearly linear variation in the shape of the optimal mid-range inputs, transitioning from proximal-like to distal-like responses as the distance increased. We consider this outcome to be expected based on the structure of the space-time wiring model (Kim et al., 2014). Interestingly, this was not the case with models incorporating physiologically recorded signals. As we show in Figure 10, the most common optimal directional tuning was seen when the bipolar drive consisted of two main populations, both in the ON and OFF SACs.

      Finally, we believe that uncovering additional mechanisms that underlie directional selectivity in SACs represents a crucial challenge for the field to tackle. It is highly probable that achieving directional selectivity involves a complex interplay of multiple factors. This includes the organization of the presynaptic circuit, which we have partially addressed in this study, as well as the influence of postsynaptic active conductances and feedback loops involving other SACs and presynaptic cells. We have expanded the discussion section to describe the possible mechanisms

      • The computational modeling demonstrates intriguing results: SAC dendritic morphology produces dendritic isolation, and a massive input overcomes the dendritic isolation (Figure 1). This modeling seems to be generated by basic dendritic cable properties. However, it has been reported that SAC dendrites express Kv3 and voltage-gated Ca channels. It seems to be that these channels are not incorporated in this model.

      The reviewer's observation is accurate; the model depicted in Figure 1 did not include voltage-gated channels. Our goal was to study electrotonic isolation, which is often measured in passive models. However, while we did not incorporate voltage-gated potassium channels implicitly in the models, our simulations are rooted in previous models that were fine-tuned using empirical data. As potassium channels are expected to influence the experimentally recorded input resistance, we have indirectly accounted for their impact on the interdendritic signal propagation.

      In subsequent model iterations, we have integrated voltage-gated calcium channels into our simulations to assess the signal responsible for driving synaptic release. We show that nonlinear voltage dependence of the calcium currents enhances compartmentalization of the local calcium levels (Figure 2), but did not significantly influence local voltages. Therefore, calcium channels do not appear to have a major impact on electrotonic distances.

      • In Figure 5B, representative traces are shown responding to moving bars in horizontal directions. These did not show different responses to two directional stimuli. It is unclear whether directional preference was not detected, which was shown by Yonehara's group recently (Matsumoto et al 2021). Or that was not investigated as described in the Discussion.

      Indeed, we observed no discernible directional differences in bipolar responses. This phenomenon can be primarily attributed to the fact that the signals originating from the limited number of directionally-tuned release sites are overshadowed by the release from non-directionally-tuned units (Matsumoto et al., 2021). In the revised discussion, we have acknowledged this limitation in our recorded data.

      • The authors found seven ON clusters and six OFF clusters, which are supposed to be bipolar cell terminals. However, bipolar cells reported to provide synaptic inputs are T-7, T-6, and multiple T-5s for ON SACs and T-1, T-2, and T-3s for OFF SACs. The number of types is less than the number of clusters. Potentially, clusters might belong to glutamatergic amacrine cells. These points are not fully discussed.

      We have expanded the discussion section to address these points.

      Reviewer #1 (Recommendations For The Authors):

      Major comments

      1. One of the main conclusions of this study is that diverse BC kinetics contribute to DS (Fig. 9). The authors nicely demonstrate using modeling that the experimentally measured BC kinetics are far from ideal. However, this conclusion is based on a model that almost exclusively relies on just two of the 7 putative BC types (e.g., C1 & C6 for On SACs) placed optimally along the dendrites, which raises two important caveats.

      First, given that other BC types are likely to contribute, the effects of two distinct types are likely to be diluted. Thus, the contribution of BCs to DS is likely to be significantly overestimated. Second, given that the dendrites of 10-30 SACs cross each point in the honeycomb, for the given model to work, each BC would need to connect extremely selectively to SACs. i.e., at a given point, a sustained input must only connect to the more proximal dendritic segments, while avoiding entirely the distal segments of overlapping SAC dendrites. Thus, their model requires extremely selective wiring for which there is no evidence. In fact, there is evidence to the contrary provided by Ding et al. 2016, which showed that the type 7 (proximally biased) and type 5 (distally biased) populations had a substantial overlap (assuming these BC types correspond to kinetically diverse clusters).

      We wholeheartedly concur with the reviewer's perspective that our findings have led to an overestimation of the space-time wiring mechanism's role in SAC directional selectivity (DS). We have adjusted our discussion to emphasize this point. In light of this, our assertion that, even with the most favorable distribution of synaptic inputs, the space-time wiring model still does not fully account for the experimentally-determined directional tuning in SAC, remains valid.

      With regard to the model, it would also be worth comparing results to previous starburst models (e.g., Tukker et al,. 2004), which demonstrated a robust DS in SAC dendrites in the absence of kinetically diverse BC input. Why is the cell-intrinsic DS so weak in the present model?

      We have directly explored this question in the synthetic model (Figures 2, 3). Despite variances in the anatomy of SACs and the distribution of bipolar inputs between our model and the study by (Tukker et al., 2004), we observed remarkably similar levels of directional selectivity index computed from the voltage response (approximately 10%, as shown in Figure 3, 'Identical BCs').

      The primary distinction emerged in the degree of DS amplification mediated by calcium currents. Tukker et al., 2004 reported considerably higher DS compared to our findings, despite employing similar formulations for voltage-gated calcium channel models. The key factor driving this difference lies in the fact that Tukker et al., 2004 measured amplification in proximity to the threshold of calcium channel activation. Even minor variations in membrane potentials near this threshold can lead to substantial differences in calcium influx, especially when outward stimulation results in a calcium spike. In fact, recently, Robert Smith’s group revisited the threshold-based mechanism and concluded that it often fails to produce robust DS due to the heterogeneity of membrane potentials among different terminal dendrites (Wu et al., 2023).

      Our models were trained on five different stimuli velocities whose synaptic integration produced substantially different peak amplitudes. Consequently, the spike threshold alone couldn't reliably distinguish between inward and outward directions across all five conditions, resulting in reduced directional performance in our simulations. In the revised Figure 2-S2 we directly explore the performance of the model with identical BC formulations, trained on a single velocity. We find a dramatic enhancement of calcium DS (DSI=66%) in this condition compared to an identical model trained on 5 velocities (DSI=17%). Thus, evolutionary search is capable of finding the threshold-based solution, but only when the training is performed on a single stimulus velocity (Figure 2-S2). This solution did not generalize to multiple stimuli speeds because, as mentioned above, they lead to different postsynaptic depolarization levels (Figure 2, 2-S1). Instead, the algorithm converged on a set of postsynaptic paraments leading to less nonlinear calcium channel activation over a broader voltage range, ensuring effective DS performance over multiple velocities and heterogenous local potentials (Wu et al., 2023).

      1. Functionally distinct responses across different regions of interest (ROIs) were used to classify BC input. ROIs were obtained from multiple scan fields and retinas and combined into a single dataset for functional clustering. However, the consistency of the cluster distribution across these replicates has not been addressed. As BCs can exhibit different functional properties dependant on the state/health of the retina, it is important to know whether certain functional clusters may originate disproportionately from a particular experiment, as it implies that each cluster does not represent a different stable functional/anatomical population.

      We acknowledge that the state of the preparation can significantly impact signal dynamics. In response to this important consideration, we have incorporated details about the distribution of functional clusters in various experiments in the revised version of the manuscript (Figure 6-S1, and discussion).

      Other comments:

      1. Interpreting iGluSnFR signals: Since the sensor is expressed uniformly across the SAC dendrite, it is important to clarify why the measured F signals are considered synaptic responses. Could spillover contribute to the generation of slower responses?

      We do not believe spillover can explain slower responses because the sluggish clusters often responded significantly (up to 500ms) sooner to moving bars (Figures 6, 6-S3). We acknowledge and discuss this possibility of spillover in the revised discussion.

      1. One striking finding is the diversity of BCs RF sizes (Fig. 7C). Some BCs have RF that are far larger than their dendritic fields. It will be useful to discuss the potential mechanisms that may underlie large BC RFs.

      We changed the discussion to address this question.

      1. SAC DS is independent of dendritic isolation: The authors claim that dendritic isolation does not significantly impact DS. However, while this might be true for a linear motion through the receptive field, dendritic isolation probably matters for more dynamic stimuli. For example, DSGCs can encode rapid changes in objection direction, as DS is computed over fine spatiotemporal scales relying on SACs (Murphy-Baum et al., 2022). This could not occur if SAC dendrites were not well electrically isolated from each other.

      We believe that this is an accurate interpretation of our findings. Our research suggests that dendritic isolation is likely not a critical factor in the space-time wiring mechanism. However, as we demonstrate that this particular mechanism cannot fully account for the observed levels of DS in SACs, other mechanisms must be important. As previous studies revealed that dendritic isolation enhances SAC DS (for example, Koren et al., 2017), dendritic independence likely contributes to directional performance within SACs by these additional mechanisms.

      1. Figure 4: From what I understand, the BC inputs for the electrotonic connectivity variations evolved much like they were for the original model without axial resistance constraints. This makes sense, since stronger/weaker inputs with different temporal kernels may be appropriate for each condition, hence why the axial resistance wasn't changed post-evolution, which would have likely caused the DS to drop. If that is the case, however, I wonder how the best DS attainable by the final model which is constrained to the radial arrangement of realistic BC inputs (without being able to fit much more optimal sustained-transient BCs to their circumstance) would be impacted. Is dendritic isolation similarly unimportant when the pre-synaptic story isn't ideal?

      We have explored this question directly by allowing the evolutionary algorithm to modify the passive and active characteristics of the postsynaptic SAC. Our findings are summarized in Figure 9-S1. We observed a correlation between DSI levels and membrane/axial resistance values in SACs in the evolved models. Better DS was seen with leaky membranes (higher isolation) and lower axial resistance (lower isolation). While it is clear that postsynaptic parameters can influence synaptic integration, they can not fully compensate for inadequate presynaptic dynamics.

      1. BC are shown to contribute to DS across velocities (Fig. 9), which contrasts with results from Srivastava et al., (2022) that showed BCs contribute to DS at lower velocities. However, this discrepancy can easily be explained by the choice of moving spots. In this study, the sweeping bars had dynamic width (targeting pixel dwell time of 2s), which means for higher velocities the bar is significantly wider. While in the previous study, the width of the stimulus was kept constant, and thus for higher velocities, the sustained/transient kinetic differences of BCs are less clear (Srivastava et al., 2021). The author's should discuss this explicitly, to avoid discrepancies between these two studies the reader might otherwise perceive.

      We value reveiwer’s feedback, and in response, we have included an additional paragraph in the manuscript addressing the distinctions in directional tuning that arise from the space-time model presented in this work, in comparison to earlier studies.

      1. Methods: It will be good to discuss how ROIs sizes and positions were selected (pixel correlations?)

      We have included a more detailed explanation of the clustering procedure

      • Lines 614 describe whole-cell patch clamp techniques, which are not used in this study.

      We used patch-clamp to record the waveforms shown in Figure 2-S2

      1. Figure 6: Diversity of Glut responses to motion in ON and OFF SACs, caption typos?

      2. "Left:" without "Right:" to describe the population (I presume) viewed as an image

      3. If there should still be A,C and B,D to group the ON and OFF halves, maybe it should be mentioned in the caption

      Thank you for bringing this to our attention, the legends were fixed.

      References:

      Kim, J. S., Greene, M. J., Zlateski, A., Lee, K., Richardson, M., Turaga, S. C., Purcaro, M., Balkam, M., Robinson, A., Behabadi, B. F., Campos, M., Denk, W., Seung, H. S., & EyeWirers (2014). Space-time wiring specificity supports direction selectivity in the retina. Nature, 509(7500), 331-336. https://doi.org/10.1038/nature13240

      Gaynes, J. A., Budoff, S. A., Grybko, M. J., Hunt, J. B., & Poleg-Polsky, A. (2022). Classical center-surround receptive fields facilitate novel object detection in retinal bipolar cells. Nature communications, 13(1), 5575. https://doi.org/10.1038/s41467-022-32761-8

      Murphy-Baum B. and Awatramani GB (2022). Parallel processing in active dendrites during periods of intense spiking activity, Cell Reports, Volume 38, Issue 8,

      Srivastava P, de Rosenroll G., MatsumotoA., Michaels T., Turple Z., Jain V, Sethuramanujam S, Murphy-Baum B, Yonehara K., Awatramani, G.B. (2022) Spatiotemporal properties of glutamate input support direction selectivity in the dendrites of retinal starburst amacrine cells eLife 11:e81533

      Strauss, S., Korympidou, M. M., Ran, Y., Franke, K., Schubert, T., Baden, T., Berens, P., Euler, T., & Vlasits, A. L. (2022). Center-surround interactions underlie bipolar cell motion sensitivity in the mouse retina. Nature communications, 13(1), 5574. https://doi.org/10.1038/s41467-022-32762-7

      Tukker, J. J., Taylor, W. R., & Smith, R. G. (2004). Direction selectivity in a model of the starburst amacrine cell. Visual neuroscience, 21(4), 611-625. https://doi.org/10.1017/S0952523804214109

      Reviewer #2 (Recommendations For The Authors):

      Specific comments

      1. Line 223. The statement a model trained on only optimal DSI would produce "negligible absolute differences in calcium levels." is unclear. This needs to be better explained.

      We have modified and expanded this paragraph to make it more clear

      1. Figure 4. The authors use this model to test the hypothesis that space time wiring contribution to SAC process DS requires dendritic isolation. They do this by increasing axial resistance around the soma of their model neuron to isolate each dendrite. They found comparable DS was achieved in both conditions, indicating that the space-time wiring model works in two cases of high and low dendritic isolation. However, to test the claim that "specific details of postsynaptic integration appear to play a lesser role" (line 274) the authors may consider allowing the axial resistance to change as a part of the model rather than testing two extreme states.

      Membrane and axial resistances (and active parameters) were allowed to change as part of model evolution in most simulations presented in this manuscript. We have added the information on the final resistance values reached in the evolved models in Figure 9-S1

      1. Figure 6: To study glutamatergic input onto SACs, the authors expressed iGLuSnFR in ChAT-Cre mice and grouped similarly responding pixels into ROIs and separated these responses into functional groups based on cluster analysis (Figure 5). The alignment of the responses in Figure 6A was confusing. It appears that average responses for each cluster are aligned based on the peak observed during the stimulus in each direction, but it is unclear how they are aligned relative to each other or what this timing is relative to location of the stimulus (i.e. what is time 0 in 6A?).

      The displayed traces represent the average responses to horizontally moving bars (speed = 0.5mm/s), either moving to the left or right. To achieve this alignment, we employed a procedure consistent with our recent publication (Gaynes et al., 2022), which we have now detailed more comprehensively. Here's the step-by-step process we followed:

      1. Determination of half-maximum rise times: Initially, we calculated the half-maximum rise times for glutamate signals recorded in response to left and right-moving stimuli.

      2. Calculation of mean rise time: We then computed the mean of these rise times, which served as a reference point for alignment.

      3. Alignment procedure: To illustrate the alignment process, consider an example. Suppose the 50% rise time for responses to left-moving stimuli occurs at 3 seconds, while responses to right-moving stimuli occur 4 seconds after stimulation onset. This discrepancy suggests that the RF of the cell is shifted to the right from the center of the display (assuming a stimulation speed of 0.5mm/s on the retina, the RF's position would be approximately 250μm from the midline). To align these responses, we shifted both waveforms by 500ms so that their 50% rise times coincided at 3.5 seconds. Importantly, 3.5 seconds would represent the 50% rise time of the ROI if it were precisely centered on the display. This alignment effectively removed any spatial position dependence from the ROIs.

      4. Comparative analysis and clustering: With the responses now aligned, we were able to compare their shapes and subsequently cluster the ROIs into distinct functional clusters. For clarity, we opted to highlight the time of response peak for cluster 1. Although this peak closely aligned with the calculated time of stimulus motion over the center of the 'shifted RF' in the adjusted time frame, it provided a more straightforward comparison between response dynamics.

      1. The authors need to do a better job explaining how their results differ from Ezra-Tsur et al 2021, which uses the same sort of model to address the same question. The discussion about this study (lines 425-435) are based on how a more constrained version of these models work better but they do not directly address the difference in conclusion with regards to mechanisms that contribute to SAC process direction selectivity.

      We have expanded the discussion related to mechanisms that contribute to DS in SACs and discuss the differences between our studies.

      Minor point: The authors use the word "probe" to refer to visual stimulus. This is confusing because "probe" is also used to refer to sensors.

      In the revised manuscript, we minimized the usage of ‘probe’ to reference visual stimuli

      Reviewer #3 (Recommendations For The Authors):

      Writing and figure presentations are excellent.

      Thank you!

      References:

      Franke, K., Berens, P., Schubert, T., Bethge, M., Euler, T., & Baden, T. (2017). Inhibition decorrelates visual feature representations in the inner retina. Nature, 542(7642), 439-444. https://doi.org/10.1038/nature21394

      Gaynes, J. A., Budoff, S. A., Grybko, M. J., Hunt, J. B., & Poleg-Polsky, A. (2022). Classical Center-Surround Receptive Fields Facilitate Novel Object Detection in Retinal Bipolar Cells. Nat Commun, 13(1), 5575. https://doi.org/https://doi.org/10.1038/s41467-022-32761-8

      Kim, J. S., Greene, M. J., Zlateski, A., Lee, K., Richardson, M., Turaga, S. C., Purcaro, M., Balkam, M., Robinson, A., Behabadi, B. F., Campos, M., Denk, W., Seung, H. S., & EyeWirers. (2014). Space-time wiring specificity supports direction selectivity in the retina. Nature, 509(7500), 331-336. https://doi.org/10.1038/nature13240

      Matsumoto, A., Agbariah, W., Nolte, S. S., Andrawos, R., Levi, H., Sabbah, S., & Yonehara, K. (2021). Direction selectivity in retinal bipolar cell axon terminals. Neuron. https://doi.org/10.1016/j.neuron.2021.07.008

      Matsumoto, A., Briggman, K. L., & Yonehara, K. (2019). Spatiotemporally Asymmetric Excitation Supports Mammalian Retinal Motion Sensitivity. Curr Biol. https://doi.org/10.1016/j.cub.2019.08.048

      Srivastava, P., de Rosenroll, G., Matsumoto, A., Michaels, T., Turple, Z., Jain, V., Sethuramanujam, S., Murphy-Baum, B. L., Yonehara, K., & Awatramani, G. B. (2022). Spatiotemporal properties of glutamate input support direction selectivity in the dendrites of retinal starburst amacrine cells. Elife, 11. https://doi.org/10.7554/eLife.81533

      Strauss, S., Korympidou, M. M., Ran, Y., Franke, K., Schubert, T., Baden, T., Berens, P., Euler, T., & Vlasits, A. L. (2022). Center-surround interactions underlie bipolar cell motion sensing in the mouse retina. Nat Commun, 13(1), 5574. https://doi.org/https://doi.org/10.1038/s41467-022-32762-7

      Tukker, J. J., Taylor, W. R., & Smith, R. G. (2004). Direction selectivity in a model of the starburst amacrine cell. Vis Neurosci, 21(4), 611-625. http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?cmd=Retrieve&db=PubMed&dopt=Citation&list_uids=15579224

      Wu, J., Kim, Y. J., Dacey, D. M., Troy, J. B., & Smith, R. G. (2023). Two mechanisms for direction selectivity in a model of the primate starburst amacrine cell. Vis Neurosci, 40, E003. https://doi.org/10.1017/S0952523823000019

    1. Author Response

      The following is the authors’ response to the original reviews.

      Public Reviews:

      Reviewer #1 (Public Review):

      The authors sought to understand the neurocomputational mechanisms of how acute stress impacts human effortful prosocial behavior. Functional neuroimaging during an effort-based decision task and computational modeling were employed. Two major results are reported: 1) Compared to controls, participants who experienced acute stress were less willing to exert effort for others, with a more prominent effect for those who were more selfish; 2) More stressed participants exhibited an increase in activation in the dorsal anterior cingulate cortex and anterior insula that are critical for self-benefiting behaviour. The authors conclude that their findings have important insights into how acute stress affects prosociality and its associated neural mechanisms.

      Overall, there are several strengths in this well-written manuscript. The experimental design along with acute stress induction procedures were well controlled, the data analyses were reasonable and informative, and the results from the computational modeling provide important insights (e.g., subjective values). Despite these strengths, there were some weaknesses regarding potential confounding factors in both the experimental design and methodological approach, including selective reporting of only some aspects of this complex dataset, and the interpretation of the observations. These detract from from the overall impact of the manuscript. In particular, the stress manipulation and pro-social task are both effortful, raising the possibility that stressed participants were more fatigued. Other concerns include the opportunity for social dynamics or cues during task administration, the baseline social value orientation (SVO) in each group, and the possibility of a different SVO in individuals with selfish tendencies. Finally, Figure 4 should specify whether the depicted prosocial choices include all five levels of effort.

      We thank the reviewer for their comments and suggestions. In our response to the recommendations for the author below, we have dealt with the reviewer’s concerns: - we added additional analysis on the role of fatigue and block effects to the supplementary materials. - we provided further information about the role of social cues and dynamics during task administration. - we showed there were no baseline group differences in SVO angle. - we clarified that Figure 4 refers to the proportion of prosocial choices across all effort levels.

      Reviewer #2 (Public Review):

      This manuscript describes an interesting study assessing the impact of acute stress on neural activity and helping behavior in young, healthy men. Strengths of the study include a combination of neuroimaging and psychoneuroendocrine measures, as well as computational modeling of prosocial behavior. Weaknesses include complex, difficult to understand 3-way interactions that the sample size may not be large enough to reliably test. Nonetheless, the study and results provide useful information for researchers seeking to better understand the influence of stress on the neural bases of complex behavior.

      The stressor was effective at eliciting physiological and psychological stress responses as shown in Figure 2.

      Higher perceived stress in more selfish participants (lower social value orientation (SVO) angle) was associated with lower prosocial responding (Figure 4). How can we reconcile this finding with the finding (presented on page 15) that those with a more prosocial SVO showed a significant decline in dACC activation to subjective value at increasing levels of perceived stress? This seems contrary to the behavioral response.

      A larger issue with the study is that the power analysis presented on page 23 is based on a 2 (between: stress v. control) by 2 (within: self v. other) design. Most of the reported findings come from analyses of 3-way interactions. How can the readers have confidence in the reliability of results from 3-way interaction analyses, which were not powered to detect such effects?

      We thank the reviewer for their comments and suggestions. When considering the influence of dACC activation on the behavioural response (i.e., proportion of prosocial choices), it is important to consider the difference in activation to SVself relative to SVother: - The difference in activation to SVself relative to SVother negatively predicted the proportion of prosocial choices, so more activation to SVself relative to SVother predicted a lower proportion of prosocial choices. - Similarly, SVO angle negatively predicted the difference in activation to SVself relative to SVother, so more activation to SVself relative to SVother was related to a lower (more individualistic) SVO angle (this is shown by the interaction between Recipient and SVO angle in Figure 4; right panel). In both cases, differences in prosociality (i.e. SVO angle or the proportion of prosocial choices) were related to differences in dACC activation to SVself relative to SVother.

      Thus, we agree the finding that those participants with a more prosocial SVO showed a significant decline in dACC activation to SV overall (across SVself and SVother) at increasing levels of perceived stress is difficult to interpret. We expected a three-way interaction between Recipient, SVO angle and Perceived Stress to mirror the behavioural results, rather than a two-way interaction between SVO angle and Perceived Stress. We have now acknowledged this in the Discussion, whilst also highlighting the work of Schulreich et al. (2022) who report a related finding.

      We have now added the following section to the results:

      “When linking activation difference in dACC and AI to behaviour, we found that – independent of the stress manipulation – the difference in activation between SVself and SVother in the dACC predicted the proportion of prosocial choices. Thus, greater activation to SVself relative to SVother predicted a lower proportion of prosocial choices (B=-0.704, SE=0.339, P=0.041). This relationship was not present in the AI (B=-0.423, SE=0.332, P=0.205).”

      And we have added the following to the discussion:

      “Additionally, participants with a more prosocial SVO showed reduced responses in the dACC to SV (across both self and other trials) at greater levels of perceived stress (Figure 4; middle panel). This suggests that more prosocial individuals may become less sensitive to SV overall following stress, whilst the responses of more individualistic participants to SV do not change under stress. Trying to link these activation differences to changes in effortful prosocial behaviour is difficult given the absence of the three-way interaction between SVO angle, Perceived Stress and Recipient, which would have mirrored the behavioural results. Overall, differences in activation between SVself and SVother in the dACC predicted the proportion of prosocial choices, so greater activation to SVself relative to SVother predicted a lower proportion of prosocial choices. Thus, it remains unclear how activation differences to SV across both self trials and other trials relates to changes in prosocial behaviour under stress. Schulreich et al. (2022) found that a decline in charitable donations following increases in cortisol in high mentalisers was related to a reduced representation of value for donations in the right dlPFC. Whilst there are important differences between the present study and Schulriech et al. (2022), such as the way in which prosocial behaviour was measured, both studies suggest that existing differences in social preferences and abilities (i.e., mentalising, SVO) can have a detrimental effect on the neural representations of value following acute stress. Establishing how these changes in neural representations of value impact behaviour following acute stress is a challenge for future work.”

      Concerning the power calculation, we have acknowledged this as a limitation in the discussion.

      “Our power calculation was based on a 2 x 2 design (Group x Recipient), however, several of our key findings involved three-way interactions (e.g. between Group, Recipient and Effort). Thus, future studies should aim to replicate our effects with larger sample sizes to ensure the robustness of these effects.

      Recommendations for the authors

      Reviewer #1 (Recommendations For The Authors):

      1. The authors employed an integrative approach on inducing acute stress by combining the strengths of MIST and TSST, as shown by a robust stress response in cortisol. However, some concerns regarding the stress manipulation and the effort-based task need to be addressed. The authors justified the order of deployment as necessary to maintain stress responses throughout the scanning period. It is unclear whether and how potential order effects were controlled, and whether the effort-task performance in the front and back of the line might have different effects in a 90-minute experiment.

      Moreover, the stress manipulation itself involved a complex mental arithmetic task, which might have influenced participants' willingness to exert effort for others in the prosocial task. As shown in Figure 3, the proportion of participants working decreases as the effort levels increase for both self and other conditions in the stress and control groups. It is thus possible that participants could consider the prosocial task as an opportunity to take a break from the demanding arithmetic task. It would be helpful to present results from the different runs, particularly for the pre and post three runs.

      We thank the reviewer for highlighting this potential issue. We have added several analyses to the supplementary analysis to explore potential block effects and fatigue effects. Here we provide a summary of the key findings.

      Firstly, we investigated participants’ ratings of the effort levels, which they experienced immediately before and after the study, to investigate potential fatigue effects. We found that following the experiment compared to the before, participants in the stress group rated squeezing to the required effort levels as more physically demanding compared to the control group (p=.037). There were no group differences in how much more effort they reported exerting (p=.824) or how uncomfortable it was (p=.351) compared to before the experiment. Thus, overall the stress group found it more physically demanding to squeeze to the effort levels following the experiment. Crucially, however, increases in how physically demanding participants found it to squeeze to the required effort levels were not correlated with the number of effortful choices in the Self and Other condition in either group (all Ps >0.4). This suggests that whilst stressed participants rated squeezing to the required effort level as more physically demanding following the task relative to before, this was not related to how often participants exerted effort for self or other rewards.

      Secondly, we investigated potential block effects. We repeated the mixed effects logistic regression reported in the manuscript but included the interaction between the factors Group, Recipient and Block (1:6) in the model. Although both groups showed a decline in the number of effortful choices during the experiment, the two-way interaction between Group and Block (p=.188) nor the three-way interaction between Group, Recipient and Block were significant (p=.138). This shows that whilst there was a decline in the number of effortful choices throughout the experiment, this was not more pronounced in the stress group, nor was it more pronounced in the stress group for self relative to other effortful choices compared to the control group. Additionally, the key three-way interaction between Group, Recipient and Block was unaffected when controlling for potential block effects. We now also plot the data by block in the supplementary materials (Figure S3).

      Please see the section in the Supplementary Material and a summary of these analyses also appears in the manuscript in the Results section

      “We conducted additional analyses to rule out the influence of potential fatigue and block effects (see Fatigue and block effects in the Supplementary Materials). In short, the stress group rated squeezing to the required effort level as more physically demanding immediately after the experiment compared to before, which was not seen in the control group (Figure S2). However, this was not related to the number of effortful choices for self or other rewards (Table S2). Moreover, when we conducted the same mixed effects logistic regression on participants’ choices but also included the interaction between Group, Recipient and Block, there was no significant three-way interaction between these factors, nor a significant two-way interaction between Group and Block (Figure S3). Additionally, the three-way interaction between Group, Recipient and Effort was unaffected when controlling for potential block effects (Type III Wald test χ2[4]=22.06, P<0.001). Thus, whilst the stress group rated squeezing to the required effort level as more physically demanding following the experiment, this was not related to the number of effortful choices (for self or other) and the effects of Block on effortful choices (for self or other) did not differ between the group. Thus, changes in how physically demanding participants rated squeezing to the effort levels did not influence decisions to exert effort.”

      1. It would be useful to know whether the authors controlled for factors such as familiarity or gender among participants that might influence their choices on the task. If participants were able to interact or observe each other, it is possible that social dynamics played a role in their behavior, which could confound the interpretation of their results. It would be beneficial if the authors could provide further information on how the task was administered and whether any social cues were present.

      For the experimental design, although salivary samples and subjective pressure were measured, did the authors measure participants' subjective ratings of other negative emotions?

      Participants did not have the chance to see or interact with the participants in the “other” condition. Participants were told at the start of the experiment that they would be earning money for the next participant in the study, called Thomas. Thus, as all participants were men, the name of the participants was gender matched. Moreover, as they did not see or interact with the next participant, familiarity was controlled across participants.

      We have now added a section p. 8 to clarify this:

      “As all participants were men, the name of the next participant was gender matched (all participants were told he was called Thomas; see Methods). Moreover, as participants did not see or interact with the next participant, familiarity was controlled across participants.”

      We have now added a plot to the supplementary materials (Figure S4) showing the changes in the ratings of the emotions. Apart from the emotions anxious and disgusted, all other emotions (calm, happy, bad, sad, surprised, angry) showed a significant sample timepoint (1:8) by group (stress, control) interaction, thus mirroring the results for the perceived stress ratings. We now refer to this figure in the manuscript on p. 8:

      “for changes in other emotions during the experiment please see Figure S4”

      1. Regarding the data analysis section, the authors' analysis is careful overall and the results about SVO are interesting. It would be interesting to know if baseline SVO was similar across both stress and control groups, and if there were any differences in SVO among participants with more individualistic or selfish tendencies. Regarding Figure 4, it would be helpful if the authors clarified whether the vertical coordinate "prosocial choices" is a combination of the five levels of effort or if it is specific to one level. Additionally, it would be useful to explore whether there is a correlation between SVO and prosocial choices and whether effort level could be used as a covariate to control for potential confounding effects. These suggestions could improve the clarity and strength of their contributions.

      There were no differences in SVO angle between the control group and stress group (p=.956). There was also a significant correlation between SVO angle and the proportion of prosocial choices across the whole sample. This has now been reported in the manuscript on p. 13:

      “There were no existing differences in SVO angle between the groups (control group mean = 19.33, SD = 8.67; stress group mean = 19.23, SD=8.14; p=0.956). We found that across the whole sample – independent of the stress manipulation – there was a significant correlation between SVO angle and the proportion of prosocial choices (r=0.225, P=0.032). So, as expected, those with a more prosocial SVO angle showed a higher proportion of prosocial choices in the task.

      To clarify, the variable “% prosocial choices” is a combination of all the five effort levels. In other words, we took the total number of prosocial choices (‘work’ for other) across all effort levels relative to the total number of effortful choices. We have now clarified this in the manuscript on p. 13. As this was a combination of all effort levels (and reward levels), it was not possible to include effort level as a covariate.

      “This measure combined all reward and effort levels.”

      1. It is noteworthy that in the dACC, an effect was observed with regard to the interaction between perceived stress and SVO angle. Considering this observation, another suggestion would be for the authors to include visualization in Figure 4 to present the results of this interaction. This could help readers better comprehend the findings and provide a clearer representation of the results.

      We have now updated Figure 4 so that it has three panels showing the behavioural and neural results concerning SVO angle as well as the relationship between SVO angle and activation to SVself and SVother in the dACC.

      1. It would be helpful for readers if the authors could label all statistical plots with appropriate statistical values, effect sizes, and their respective significance levels. By doing so, readers would be able to quickly identify major findings of this study and gauge the degree of significance associated with each plot. The authors should consider including such information in their statistical plots to enhance the comprehensibility of the study results.

      We have added statistical values (e.g., beta estimates), including indicators of significance to the plots.

      1. The authors selected ROIs based on previous work on stress-related and effort-based decision making (i.e., AI and dACC). While other brain regions may also play a role in decision making and social cognition, the authors could choose to focus on these specific ROIs due to their relevance to the experimental question and hypotheses of this study such as prosocial, mentalizing and subjective values.

      We agree that several other ROIs may have also been of interest. However, we decided to restrict our analysis to the dACC and the AI as these two ROIs were the focus of a previous study using the same prosocial effort paradigm (Lockwood et al. 2022) and multiple studies suggest these regions are sensitive to stress effects.

      1. The authors chose to use one sample t-test with AUC as a covariate to examine brain activations across all participants regardless of their stress or control condition. This approach could identify brain regions that are associated with perceived stress. However, the authors didn't conduct a simple two sample t-test between stress and control groups since their research question and hypotheses focused on the neurocomputational mechanisms underlying prosocial decision-making during stress. Regarding the different stages of decision-making, such as offer, force, and outcome, the authors did not conduct specific analyses for each stage. Instead, they used the computational model to estimate the subjective value of each option at each stage, which allowed them to examine the neural correlates of different value-related parameters across the entire decision-making process. However, it would be interesting to examine the role of different stages as well.

      Our design matrix modelled three events during each trial: the offer, force, and outcome phase (as per Lockwood et al. 2022). However, our hypotheses and research question for the effects of acute stress concerned the offer phase, i.e. when participants were deciding whether to exert effort or not (work vs. rest). Therefore, we decided to limit our reporting to this event. We have clarified this on p. 32 in the Methods:

      “Our hypotheses and research questions concerning the effects of acute stress concerned the offer phase, i.e., when participants were deciding whether to exert effort or not (work vs. rest). Therefore, we limited our reporting to this event.”

      1. The authors' findings pertaining to individual differences are intriguing, particularly for individuals with selfish tendencies to exhibit lower pro-social tendencies under stress. Additionally, group variations in effortful behavior related to benfitting others, relative to oneself, are more evident at lower effort levels rather than higher ones. The authors could dedicate more space in the discussion section to discuss the potential mechanisms involved and address the absence of pertinent theoretical support.

      We have now extended the discussion to further outline potential mechanisms. Broadly, we interpret our findings in terms of compromised executive functioning under acute stress: “downregulation of the brain’s ‘executive control network’ (Hermans et al., 2014)”. In the original submission, we focused on changes in inhibition and shifts to habitual/automatic processing. We have now expanded this to include a section on cognitive flexibility (see below). Note that changes in executive functioning have been widely reported following stress (see Shields et al., 2016 for a meta-analyses). However, which specific executive functions influenced our observed changes in prosocial behaviour is an exciting avenue for future work.

      We have added this section on p. 20-21 concerning cognitive flexibility:

      “The dlPFC has also been implicated in cognitive flexibility under acute stress. For example, Kalia et al. (2018) used functional near infrared spectroscopy to show that reduced cognitive flexibility under stress was related to changes in activation in the dlPFC in men. In our study, participants in the control group were more likely to exert effort for self rewards compared to other rewards at higher, but not at lower, levels of effort. Whilst participants in the stress group favoured exerting effort for self rewards at every effort level (Figure 3). This consistent preference for self rewards compared to other rewards at all effort level suggests that stressed participants did not adapt their social behaviour in response to changing contextual information. This supports multiple studies showing reduced cognitive flexibility under stress (Goldfarb et al., 2017; Kalia et al., 2018; Raio et al., 2017; Shields et al., 2016). An exciting avenue for future work is to test whether individual differences in executive functions, such as inhibition and cognitive flexibility, predict changes in social behaviour following acute stress. This would be analogous to the finding in non-social domains, where greater working memory capacity protects against stress-induced changes in learning (Otto et al., 2013).

      Reviewer #2 (Recommendations For The Authors):

      The manuscript suggests that the stress group made more selfish responses than the control group at lower, but not higher, levels of effort (as shown in Figure 3). I recommend that Figure 3, showing these data, be modified for clarity. Currently, data for the between-subjects comparison (Control and Stress groups) are linked by a dashed line. This linkage (at least in my mind) connotes that these data points are from the same people at different times. In fact, the within-subjects data are not linked by a line, but are noted by different colored symbols. Please reconsider how these data are presented.

      We have redrawn Figure 3. For each effort level, the self vs. other manipulation is shown on the x axis and the two groups (Control vs. Stress) are shown by black and grey lines. For each group, the lines are connected to show that the Self vs. Other manipulation is a within-subject manipulation.

    1. Author Response

      The following is the authors’ response to the original reviews.

      Thank you for the response and reviews of our manuscript eLife-RP-RA-2023-86638 “Energetics of the Microsporidian Polar Tube Invasion Machinery”. We are grateful for the comments and constructive criticism from all three reviewers, which have helped us to improve our manuscript.

      As a summary to the editor, we here provide a list of the major revisions we have implemented to address all the comments provided by the referees.

      1. We added Supplementary Section A.9 and Figure S4 to explain the details of calculation and have magnified sketches of flow fields.

      2. We clarified the term "required pressure" to "required pressure differences", and explained that the same pressure differences can be achieved by either positive or negative pressure. We invoke the fact that the spore wall buckled inward to deduce that germination is a negative pressure process.

      3. We only rank the hypotheses based on calculation of total energy requirement. The peak pressure and peak power requirement calculations are now just for quantitative reference. The ranking of hypotheses does not change.

      4. We clarified the definition of topological connections in Section "Systematic evaluation of possible topological configurations of a spore," making it explicit that the topological questions listed only involved the "original PT content" (not PT space at all time).

      Thank you again for the opportunity to revise our work. We attach a point-by-point response to the referees below.

      Public Reviews:

      Reviewer #1 (Public Review):

      1. The authors used mathematical models to explore the mechanism(s) underlying the process of polar tube extrusion and the transport of the sporoplasm and nucleus through this structure. They combined this with experimental observations of the structure of the tube during extrusion using serial block face EM providing 3 dimensional data on this process. They also examined the effect of hyperosmolar media on this process to evaluate which model fit the predicted observed behavior of the polar tube in these various media solutions.

      We thank the reviewer for their accurate summary of our work. One subtle point, however, is that we examine the effect of hyperviscous media on the polar tube extrusion process, rather than hyperosmolar media. In Supplementary Section A.6 of our updated manuscript, we have shown that the changes in osmolarity due to methylcellulose is negligible.

      1. Overall, this work resulted in the authors arriving at a model of this process that fit the data (model 5, E-OE-PTPV-ExP). This model is consistent with other data in the literature and provides support for the concept that the polar tube functions by eversion (unfolding like a finger of a glove) and that the expanding polar vacuole is part of this process. Finally, the authors provide important new insights into the buckling of the spore wall (and possible cavitation) as providing force for the nucleus to be transported via the polar tube. This is an important observation that has not been in previous models of this process.

      We thank the reviewer for acknowledging the novelty and importance of our study.

      Reviewer #2 (Public Review):

      1. Microsporidia has a special invasion mechanism, which the polar tube (PT) ejects from mature spores at ultra-fast speeds, to penetrate the host and transfer the cargo to host. This work generated models for the physical basis of polar tube firing and cargo transport through the polar tube. They also use a combination of experiments and theory to elucidate possible biophysical mechanisms of microsporidia. Moreover, their approach also provided the potential applications of such biophysical approaches to other cellular architecture.

      We thank the reviewer for their accurate summary and acknowledging the potential applications on other organisms.

      1. The conclusions of this paper are mostly well supported by data, but some analyses need to be clarified. According to the model 5 (E-OE-PTPV-ExP) in P42 Fig. 6, is the posterior vacuole connected with the polar tube? If yes, how does the nucleus unconnected with the posterior vacuole enter the polar tube?

      As we mentioned in our glossary and detailed in Section "Systematic evaluation of possible topological configurations of a spore", Model 5 requires the "original PT content" (any material inside the PT prior to cargo entering the tube) to permit fluid flow to posterior vacuole and external environment post anchoring disc rupture, but cannot permit fluid flow to the sporoplasm that is transported through the tube. As the the germination process progresses, our model does not require the connection between PT and posterior vacuole to be maintained afterwards, and that creates space allowing sporoplasm (including nucleus) sporoplasm (including nucleus) to enter PT space through fluid entrainment. We have clarified the definitions in Section "Systematic evaluation of possible topological configurations of a spore" and have additional clarification in the caption of Fig. 6 in the updated manuscript.

      1. In Fig. 6, would the posterior vacuole become two parts after spore germination? One part is transported via the polar tube, and the other is still in the spore. I recommend this process requires more experiments to prove.

      According to our Model 5, the membrane connection between PT and posterior vacuole must be broken for the infectious cargo to extrude. However, our current data does not allow us to prove nor disprove the membrane fission event. In theory, the membrane content in PT can potentially be severed into multiple parts by Plateau-Rayleigh instability, an interfacial-tension-driven fluid thread breakup mechanism. Note that it is possible to have membrane fission at the time scale of germination process, as when the time scale of shearing is faster than the viscoelastic time of lipid membranes (roughly 10 msec), membrane fission can happen (Morlot & Roux 2013). For time scale longer than viscoelastic time of lipid membrane, protein complexes like dynamin would be required for membrane fission. Future cryo-EM study of the vacuole-PT connection at the anterior tip (and in the spore as a whole) is needed to clarify the physical process. We added this discussion in Section "Predictions and proposed future experiments".

      Reviewer #3 (Public Review):

      Abstract:

      The paper follows a recent study by the same team (Jaroenlak et al Plos Pathogens 2020), which documented the dramatic ejection dynamics of the polar tube (PT) in microsporidia using live-imaging and scanning electron microscopy. Although several key observations were reported in this paper (the 3D architecture of the PT within the spore, the speed and extent of the ejection process, the translocation dynamics of the nucleus during germination), the precise geometry of the PT during ejection remain inaccessible to imaging, making it difficult to physically understand the phenomenon.

      This paper aims to fill this gap with an indirect "data-driven" approach. By modeling the hydrodynamic dissipation for different unfolding mechanisms identified in the literature and by comparing the predictions with experiments of ejection in media of various viscosities, authors shows that data are compatible with an eversion (caterpillar-like) mechanism but not compatible with a "jack-in-the-box" scenario. In addition, the authors observe that most germinated spores exhibit an inward bulge, which they attribute to buckling due to internal negative pressure and which they suggest may be a mean of pushing the nucleus out of the PT during the final stage of ejection.

      We thank the reviewer for their accurate summary of our work.

      Major strengths:

      Probably the most impressive aspect of the study is the experimental analysis of the ejection dynamics (velocity, ejection length) in medium of various viscosities over 3 orders of magnitudes, which, combined with a modeling of the viscous drag of the PT tube, provides very convincing evidence that the unfolding mechanism is not a global displacement of the tube but rather an apical extension mechanism, where the motion is localized at the end of the tube. The systematic classification of the different unfolding scenarios, consistent with the previous literature, and their confrontation with data in terms of energy, pressure and velocity also constitute an original approach in microbiology where in-situ and real time geometry is often difficult to access.

      We thank the reviewer for acknowledging the novelty and importance of our study.

      Major weaknesses:

      1a. While the experimental part of the paper is clear, I had (and still have) a hard time understanding the modeling part. Overall, the different unfolding mechanisms should be much better explained, with much more informative sketches to justify the dissipation and pressure terms, magnifying the different areas where dissipation occurs, showing the velocity field and pressure field, etc.

      We thank the reviewer for their comments and suggestions. In the Figure S4 and SI Section A.9 of the updated manuscript, we have magnified the sketches with flow field, and added a detailed explanation of the derivations of dissipation terms.

      1b. In particular, a key parameter of eversion models is the geometry of the lubrication layers inside and outside the spore (h_sheath, h_slip). Where do the values of h_sheath and h_slip come from? What is the physical process that selects these parameters?

      As we described in SI Section A.9, h_sheath was set to be 25 nm based on the observed translucent space around PT in activated spores (Lom 1972), and h_slip was set to be 6 nm based on the observed gap thickness between PT and cargo (Takovarian et al. 2020). Although we don't expect these numbers to be the same for each spore, the uncertainty in these two parameters are much less than the uncertainty in cytoplasmic viscosity (which varies several orders of magnitude) and boundary slip length. Our sensitivity testing on cytoplasmic viscosity and boundary slip length thus covers any uncertainty in h_sheath or h_slip already.

      1c. For clarity, the figures showing the unfolding mechanics in the different scenarios should be in the main text, not in the supplemental materials.

      We have added Figure S4 and SI Section A.9 to explain the details of our sketches. We believe, however, putting all the details of the mechanics and how each term is derived in the main text may detract from the flow of the manuscript, and result in it being less accessible to readers who are not as familiar with the physics. We therefore decided to keep this information in supplemental materials.

      2a. The authors compute and discuss in several places "the pressure" required for ejection, but no pressure is indicated in the various sketches and no general "ejection mechanism" involving this pressure is mentioned in the paper.

      In the updated manuscript, we have changed the term “pressure” to “pressure difference” or “required pressure difference”. We did not calculate the detailed pressure field around each structure, but only estimated the required pressure difference to overcome the drag force and drive fluid flow in various spaces. We also clarified this point in Section "Developing a mathematical model for PT energetics".

      Also, as we mentioned in Section “Posterior vacuole expansion and the role of osmotic pressure”, we made no assumptions on how the pressure difference is generated in this paper. The unfolding mechanism of polar tube, how eversion is sustained, and the driving mechanism are ongoing research projects, and we decided not to make premature comments on that without strong support from experiments or simulation results.

      2b. What is this "required pressure" and to what element does it apply?

      The “required pressure” in the manuscript indicates the required pressure difference between the spore and the tip of the polar tube for it to push the tip forward and sustain the fluid flow within the polar tube. In the updated manuscript, we thus changed the term “required pressure” to “required pressure difference”. We also added this clarification to Section "Developing a mathematical model for PT energetics".

      2c. I understand that the article focuses on the dissipation required to the deployment of the PT but I find it difficult to discuss the unfolding mechanism without having any idea on the driving mechanism of the movement. How could eversion be initiated and sustained?

      As we mentioned in Section “Posterior vacuole expansion and the role of osmotic pressure”, we made no assumptions on how the energy, pressure or power is generated in this paper. We agree that the unfolding mechanism of the polar tube, how eversion is sustained, and the driving mechanism are important questions, and these are ongoing research projects. As no assumptions about this are required for our models, we decided not to comment on these aspects without strong support from experiments or simulation results. We have clarified this in Section “Posterior vacuole expansion and the role of osmotic pressure” of the updated manuscript.

      1. Finally, the authors do not explain how pressure, which appears to be a positive, driving quantity at the beginning of the process, can become negative to induce buckling at the end of ejection. Although the hypothesis of rapid translocation induced by buckling is interesting, a much better mechanistic description of the process is needed to support it.

      As discussed in Point 2-b above, the “required pressure” actually means “required pressure difference”. The same pressure difference can possibly be achieved by either positive pressure (the spore has a higher pressure than the ambient, pushing the fluid into PT) or negative pressure (the PT tip has a lower pressure than the ambient, sucking the fluid from the spore). Hydrodynamic dissipation analysis alone cannot tell the differences between positive or negative pressure, as it only tells you the required pressure differences between the spore and the polar tube tip. It will have to be inferred from the implied mechanisms or other evidence. We added these discussions in the 4th paragraph of Section "Developing a mathematical model for PT energetics" in the updated manuscript.

      That being said, from our observations of buckled spore walls, it is still sufficient to deduce that the polar tube ejection process is a negative pressure driven process. For the spore wall to buckle inwards, the ambient pressure has to be higher than the pressure within the spore, but that would contradict with the positive pressure hypothesis as elaborated above. We added these clarifications in the 2nd paragraph of Section "Models for the driving force behind cargo expulsion".

      References:

      Lom, J. (1972). On the structure of the extruded microsporidian polar filament. Zeitschrift Für Parasitenkunde, 38(3), 200–213.

      Takvorian, P. M., Han, B., Cali, A., Rice, W. J., Gunther, L., Macaluso, F., & Weiss, L. M. (2020). An Ultrastructural Study of the Extruded Polar Tube of Anncaliia algerae (Microsporidia). The Journal of Eukaryotic Microbiology, 67(1), 28–44.

      Morlot, S., & Roux, A. (2013). Mechanics of dynamin-mediated membrane fission. Annual Review of Biophysics, 42, 629–649.

      Reviewer #1 (Recommendations For The Authors):

      The work is solid and supported by the experimental data presented, the literature and the biophysical modeling.

      1. The model (Model 5) indicates that the polar tube is connected to the posterior vacuole and that the contents of this vacuole may be transported by the polar tube before the sporoplasm. This needs experimental validation in the future, which will require the identification of posterior vacuole markers (i.e. proteins specific to this structure). I find the topology of this idea difficult to understand. If the polar tube is outside of the sporoplasm membrane then how does it connect to the posterior vacuole? If the expanded posterior vacuole is still in the spore at the end of germination then how does the sporoplasm get out?

      Model 5 requires the "original PT content" (any material inside the PT prior to cargo entering the tube) to permit fluid flow to posterior vacuole and external environment post anchoring disc rupture, but cannot permit fluid flow to sporoplasm. As the germination process progresses, our model does not require the connection between PT and posterior vacuole to be maintained afterwards, and that creates space allowing sporoplasm (including nucleus) to enter PT space through fluid entrainment.

      We agree with the reviewer that the specific predictions from Model 5 need to be experimentally validated in the future, and identification of posterior vacuole markers is a good direction. We have mentioned this in Section "Predictions and proposed future experiments".

      1. I have always thought that the polaroplast was the initial cargo in the polar tube and that this formed the limiting membrane of the sporoplasm and nucleus after passage through the polar tube (i.e., the limiting membrane of the sporont).

      In this manuscript, we only analyze the possible topology of the organelles that are relevant for energy dissipation calculations. Our final hypothesis (E-OE-PTPV-ExP) indicates that there is a limiting membrane of the infectious cargo as they pass through PT, but the energy calculation cannot tell you where this membrane comes from. That being said, our final hypothesis is consistent with the common belief that polaroplast provides the limiting membrane of the sporoplasm, even though our analysis neither proved nor disproved it.

      1. I understand that the model indicates that during eversion the end of the PT moves away from the posterior vacuole allowing the sporoplasm access to the PT lumen, however, I am not clear how this process occurs (although I understand the reason that this model was the best fit for the available data). Does the model distinguish between connected (as in the PV is in the polar tube lumen) to the idea of it being in proximity (i.e. the PT is at the PV at the start of eversion)?

      As we mentioned in our reply to Point 1 of the same reviewer above, "connectivity" simply means whether fluid flow is permitted across the end connections among organelles and sub-spaces within the spores. For Model 5, the content of posterior vacuole can pass to the original PT content and to the external environment post anchoring disc disruption through fluid flow, but not to sporoplasm. However, as the germination progresses, the PT does not have to maintain its spatial proximity or membrane connection to posterior vacuole, as the topological connectivity questions are pertaining to the "original PT content". We clarified this point in Section "Systematic evaluation of possible topological configurations of a spore" in the updated manuscript.

      Reviewer #2 (Recommendations For The Authors):

      1. The connection of polar tube and posterior vacuole need to be analyzed by Cryo -EM.

      We thank the reviewer for their comments. This work is underway.

      Reviewer #3 (Recommendations For The Authors):

      1a. As stated in the public review, the explanation and description of the unfolding mechanism should be much better described and associated with clear sketches, magnifying all the areas where the flow shear rate is concentrated (surrounding zone, lubrication inside and outside the spore, etc) and drawing the velocity field, the boundary solid motion and pressure distribution in order to clearly understand, for each model, the dissipation and pressure terms given in figs. S2 and S3.

      In the updated manuscript, we added Figure S4 to enlarge all the regions where fluid shear is considered, with sketches of velocity fields.

      1b. This is particularly important for explaining the eversion models (see comment in the Public Review) but even the "jack-in-the-box" model sketched in Fig. S2 is confusing: Why does the blue tube disappear outside the spore? What happens to the tube in this case?

      The blue tube in the sketch of Model 1 in Fig. S2 is the fluid between the two outermost layers of PT, not the PT itself. We have clarified that in the newly added Fig. S4.

      1. Many ejection mechanisms based on the deployment of invaginated appendages have been described in the literature (e.g. Zuckerkandl Biol. Bull. 1950, Karabulut et al Nat. Com. 2022) and also mimicked for robotic applications (e.g. Hawkes et al Science Robotics 2017). Although this is not the main topic of the paper, it would be very useful if the authors could discuss in the introduction the most acceptable theory for motion generation (eversion driven by an overpressure in the spore?). In the current version, this comes too late in the discussion.

      As we discussed in Section “Lack of biophysical models explaining the microsporidian infection process”, PT eversion is the most widely accepted hypothesis because of experimental evidence (e.g. microscopic observations of PT extrusions, and pulse-labeling of half-ejected tubes). However, whether or not it is driven by an overpressure in the spore remains controversial. In fact, our observations of inwardly buckled spores indicates that the ejection process likely involves negative pressure.

      In our work, we thus take a data-driven approach to generate models for the physical basis of PT extrusion process, without immediately assuming that eversion is the correct hypothesis. It would therefore not make sense to have elaborated discussion on other eversion mechanisms in Introduction.

      1. About the physical constraints, I understand that the stored energy must be the same when the viscosity is changed (by conservation of energy), but what physical basis do you have for requiring that the power and pressure also be the same (lines 295-298)? For e.g. when a spring is stretched and released in a very viscous fluid without inertia, the total energy dissipated is the same whatever the viscosity but the power is not the same. The formulation of the chosen physical constraints should be better justified.

      We thank the reviewer for their feedback. In our updated manuscript, we only use total energy requirement for the ranking, and the peak pressure difference requirement and peak power requirements are calculated just for quantitative reference. The ranking of the 5 hypotheses does not change.

      1. About the mechanism for cargo translocation, authors should explain the physical origin of the hypothetical negative pressure. How could the initial positive pressure become negative?

      As we mentioned in our reply to Point 3 of the same reviewer in the public review, the “required pressure” actually means “required pressure difference”. The same pressure difference can possibly be achieved by either positive pressure (the spore has a higher pressure than the ambient, pushing the fluid into PT) or negative pressure (the PT tip has a lower pressure than the ambient, sucking the fluid from the spore). Hydrodynamic dissipation analysis alone cannot tell the differences between positive or negative pressure, as it only tells you the required pressure differences between the spore and the polar tube tip. It will have to be inferred from the implied mechanisms or other evidence. We added these discussions in the 4th paragraph of Section "Developing a mathematical model for PT energetics" in the updated manuscript.

      That being said, from our observations of buckled spore walls, it is still sufficient to deduce that the polar tube ejection process is a negative pressure driven process. For the spore wall to buckle inwards, the ambient pressure has to be higher than the pressure within the spore, but that would contradict with the positive pressure hypothesis as elaborated above. We added these clarifications in the 2nd paragraph of Section "Models for the driving force behind cargo expulsion".

      More minor comments:

      1. The videos are amazing but it is not clear if the PT is ejected through a bulk fluid or if the spores (and ejected PT) are in contact with a solid.

      As described in Supplementary Section A.6, purified spores were spotted on a coverslip and let water evaporate. 2.0 μL of germination buffer (10 mM Glycine-NaOH buffer pH 9.0 and 100 mM KCl) with different concentration (0%, 0.5%, 1%, 2%, 3%, 4%) of methylcellulose was added to the slide and place the coverslip on top. So the spore is attached to the coverslip and ejected through a bulk liquid of germination buffer.

      1. S2 caption: please be precise that H is the Heaviside step function.

      We have updated the captions for both Figure S2 and S3 to make it explicit.

      1. Line 233 a pi is missing, no?

      We thank the reviewer for their careful read. We have corrected that.

      1. The notations are quite unfortunate and confusing. In fluid mechanics capital D usually refers to the dissipation, capital C to the drag coefficient. It would be much clearer to call D the dissipation power (in Watt) and P the pressure requirement (in Pa), whatever the mechanism and put the different contribution (drag, lubrication, cytoplasm flow) in subscript.

      We thank the reviewer for their feedback. The notation of this paper is challenging as there are many symbols while keeping everything relatively intuitive to both people with biology background and physics background. We will keep these feedback in mind in our future work.

      1. Fig S2: what is D (in the formula of the total dissipation power)? Why not use R instead?

      D is the PT diameter, as we mentioned in the caption. We keep that as it is used in the definition of the shape factor.

      1. Fig S3 why the pressure requirement for the "jack-in-the-box" hypothesis is 2\mu (vLf(epsilon)/R^2)?

      We have now elaborated the calculation in SI Section A.9.

      1. Lines 486-497: Although shear thinning fluids have their viscosity that decreases with the shear rate, in most cases the resistance (stress) still increases with speed with these fluids. Is mucin a "velocity-weakening" fluid, i.e. a fluid in which stress decreases when shear rate increases.

      We agree that stress still increases with speed for most shear thinning fluids. The mechanical properties of mucin solution strongly depend on its compositions and buffers. In our discussion, we thus simply mention this possibility without claiming whether mucin (or other biopolymer environment that microsporidia species actually experience in vivo) is a velocity-weakening fluid or not.

    1. Author Response

      The following is the authors’ response to the original reviews.

      Reviewer #1 (Public Review):

      In this study, the authors investigated the role of MAM and the Notch signaling pathway in the onset of the atrophic phenotype in both in vivo and in vitro models. The rationale used to obtain the data is one of the main strengths of the study. Already from the reading, the reasoning scheme used by the authors in setting up the study and evaluating the data obtained is clear. Using both cellular and mouse models in vivo consolidates the data obtained. The authors also methodologically described all the choices made in the supplementary section. A weakness, on the other hand, is the failure to include averages and statistical data in the results that would give a quantifiable idea of the data obtained. To complete the picture, the authors could also investigate the possible involvement of the intrinsic apoptosis pathway as well as describe probable metabolic shifts to muscle cells in atrophic conditions. The rationale used by the authors to obtain the result is linear. The data obtained are useful for understanding the onset and characterization of the atrophic phenotype under disuse and microgravity conditions. The methods used are in line with those used in the field and can be a starting point for other studies. The cellular models are well described in the Materials and methods section. The selected mouse models followed a logical rationale and were in line with the intended aim.

      We thank this reviewer for comments that have led us to clarify several points.

      Reviewer #1 (Recommendations For The Authors):

      • In order to reinforce and justify the results obtained, I would suggest that the authors include numerical and statistical data in the results obtained.

      Answer) As the reviewer suggested, we have incorporated actual numerical and statistical data into each graph in all figures.

      • With the aim of better framing the picture of an atrophic muscle phenotype caused by microgravity or disuse, I would advise the authors to also focus on the possible involvement of the intrinsic apoptosis pathway. To this end, it would be interesting to assess a possible relationship between MAM and apoptosis. It would be useful to integrate this part into the discussion.

      Answer) It has been shown that suppression of Mfn2 expression attenuates calcium influx into mitochondria during apoptosis-inducing stimuli, thereby inhibiting apoptosis (Martins de Brito & Scorrano, Nature 2008), however, in our study, we found that apoptotic pathways, including Caspase3 or p-AKT were not significantly altered in differentiated human myocytes by microgravity for 7 days in culture, suggesting that microgravity-induced apoptosis is not an initial pathway to MAM. We have added these data in the new supplementary file 3 and mentioned it in the results.

      • In addition to TA, did the authors investigate what was seen in other muscles impacted by microgravity? If so, I would recommend supplementing what is available or, on the contrary, justifying the exclusivity of the choice of TA.

      Answer) It has been reported that the soleus, a slow-type muscle is more susceptible than the fast-type tibialis anterior muscle during gravity changes, so it makes more sense for the content of this study to analyze the soleus muscle. However, we chose the tibialis anterior muscle as our target because it provides the most stable results as a site for stem cell transplantation to observe muscle regeneration.

      • The authors affirm that there is an altered distribution and morphology of mitochondria under microgravity conditions. To corroborate this assertion, I would recommend including a morphological image that confirms it.

      Answer) The morphology of mitochondria in cultured myotubes, as observed by mitotracker staining in Figure 4G, varied widely, from finely divided to fused even within a single fiber compared to MFN2-mutated human iPS cells, making it difficult to conclude whether these changes were brought about by microgravity. Therefore, in this study, we have shown that they are reduced in microgravity by the difference in fluorescence intensity of mitotracker, which is directly proportional to mitochondrial activity.

      • It would be interesting if the authors would show whether there are changes in myosin expression or metabolic changes in cells subjected to microgravity and in the cell model with Mnf2 deletion. It would also be interesting to evaluate this in the presence of DAPT.

      Answer) As the reviewer’s suggestion, we have checked MYH1, MYH3, and MYH7 transcripts in differentiated myotubes under microgravity, with or without DAPT in the new supplementary file 12. We have added the data showing that not MYH1 but MYH7 transcript was partially recovered in the Results.

      A detailed description of the metabolic analyses with myogenic cells cultured in microgravity conditions will be published elsewhere (Sugiura et al., “Mitochondria aconitase is a main target for unloading-mediated mitochondria dysfunction toward muscle atrophy”, in preparation). We have described it in the Materials and methods of the manuscript.  

      Reviewer #2 (Public Review):

      In this study, the authors examined how the maintenance of mitochondrial-associated endoplasmic reticulum membranes (MAM) is critical for the prevention of muscle atrophy under microgravity conditions. They observed, a reduction in MAM in myotubes placed in a microgravity condition; in addition, MFN2-deficient human iPS cells showed a decrease in the number of MAM, similar to in myotubes differentiated under microgravity conditions, in addition to the activation of the Notch signaling pathway. The authors, moreover, observed that treatment with the gamma-secretase inhibitor with DAPT preserved the atrophic phenotype of differentiated myotubes in microgravity and improve the regenerative capacity of Mfn2-deficient muscle stem cells in dystrophic mice. The entire study was well conducted, bringing an interesting analysis in vitro and in vivo of aging conditions. In my opinion, it is necessary to improve the analysis of both genes and proteins to better support the conclusions

      The study can contribute to a better understanding of one of the major problems of aging, such as muscle atrophy and inhibition of muscle regeneration, emphasizing the importance of the NOTCH pathway in these pathological situations. The work will be of interest to all scientists working on aging

      We thank this reviewer for the positive comments and remarks that we have attempted to address.

      Reviewer #2 (Recommendations For The Authors):

      Results:

      In Figure 1b authors observed an increase in the transcripts of MuRF1 and FBXO32 after 7 days of microgravity condition. I suggest to investigate the protein expression of these genes to give more validation to this data.

      Answer) As the reviewer’s suggestion, we have investigated the western blotting with atrophic markers in microgravity samples. These data have been added in Figure 1D.

      Moreover, I suggest investigating not only Myogenin as an earlier gene of myotubes formation but also MRF4.

      Methods:

      I suggest when doing real-time PCR not to use a single gene as housekeeping but the average of three genes, to avoid the influence of a single housekeeping gene affecting the results.

      Answer) As the reviewer’s suggestion, we have investigated MRF4 expression by qPCR experiments with 3 different housekeeping genes (RPL13a, GAPDH, and ACTB). Our experiments showed no significant differences among these three housekeeping genes. We have added these data to Figure 1C and Methods in the manuscript.

    1. Author Response

      We thank the reviewers and editor for their careful evaluation of our manuscript, and we appreciate their favorable assessment of our work. Below, we clarify a few points concerning the relationship between our study and previous studies evaluating ligand docking to protein models.

      As reviewer 2 correctly notes, several previous assessments of AF2 models have simply excluded templates above a sequence identity cutoff when using AF2 to predict structures. Such AF2 predictions are still informed by all structures in the PDB before April 30, 2018, because these structures were used to train AF2—that is, to determine the tens of millions of parameters (“weights”) in the AF2 neural network. Machine learning methods nearly always perform better when evaluated on the data used to train them than when evaluated on other data. For this reason, we consider AF2 models only for proteins whose structures were not used to train AF2—that is, for proteins whose structures were not available in the PDB before April 30, 2018.

      Previous papers (including Beuming and Sherman, 2012, https://doi.org/10.1021/ci300411b) have shown a clear correlation between the binding pocket RMSD of a protein model and pose prediction accuracy based on that model. Our main findings are unexpected in light of these previous reports: we find that AF2 models yield pose prediction accuracy similar to that of traditional homology models despite having much better binding pocket RMSDs, and that AF2 models yield substantially worse pose prediction accuracy than experimentally determined structures with different ligands bound despite having similar binding pocket RMSDs.

      Reviewer 2 also correctly notes that previous papers have described AF2 models as “apo models,” because these models do not include coordinates for bound ligands. As noted by the AF2 developers (e.g., https://alphafold.ebi.ac.uk/faq), however, AF2 is designed to predict coordinates of protein atoms as they might appear in the PDB, and AF2 models are thus frequently consistent with structures in the presence of ligands even though those ligands are not included in the models. GPCR structures in the PDB, including those used to train AF2, nearly always contain a ligand in the orthosteric binding pocket. An AF2 model of a GPCR should thus not be viewed as an attempt to predict the GPCR’s structure in the unliganded (apo) state.

      Finally, we did not apply flexible docking in this study because previous work has found that standard flexible docking protocols typically improve pose prediction performance only when given prior information on which amino acid residues to treat as flexible. For example, previous studies that performed successful flexible docking to AF2 models generally used prior knowledge of the ligand’s experimentally determined binding pose to identify the residues to treat as flexible.

    1. Author Response

      Reviewer #3 (Public Review):

      Summary:

      The manuscript from Tariq and Maurici et al. presents important biochemical and biophysical data linking protein phosphorylation to phase separation behavior in the repressive arm of the Neurospora circadian clock. This is an important topic that contributes to what is likely a conceptual shift in the field. While I find the connection to the in vivo physiology of the clock to be still unclear, this can be a topic handled in future studies.

      Strengths: The ability to prepare purified versions of unphosphorylated FRQ and P-FRQ phosphorylated by CK-1 is a major advance that allowed the authors to characterize the role of phosphorylation in structural changes in FRQ and its impact on phase separation in vitro.

      Weaknesses: The major question that remains unanswered from my perspective is whether phase separation plays a key role in the feedback loop that sustains oscillation (for example by creating a nonlinear dependence on overall FRQ phosphorylation) or whether it has a distinct physiological role that is not required for sustained oscillation.

      The reviewer raises the key question regarding data suggesting LLPS and phase separated regions in circadian systems. To date condensates have been seen in cyanobacteria (Cohen et al, 2014, Pattanayak et al, 2020) where there are foci containing KaiA/C during the night, in Drosophila (Xiao et al, 2021) where PER and dCLK colocalize in nuclear foci near the periphery during the repressive phase, and in Neurospora (Bartholomai et al, 2022) where the RNA binding protein PRD-2 sequesters frq and ck1a transcripts in perinuclear phase separated regions. Because the proteins responsible for the phase separation in cyanobacteria and Drosophila are not known, it is not possible to seamlessly disrupt the separation to test its biological significance (Yuan et al, 2022), so only in Neurospora has it been possible to associate loss of phase separation with clock effects. There, loss of PRD-2, or mutation of its RNA-binding domains, results in a ~3 hr period lengthening as well as loss of perinuclear localization of frq transcripts. A very recent manuscript (Xie et al., 2024) calls into question both the importance and very existence of LLPS of clock proteins at least as regards to mammalian cells, noting that it may be an artefact of overexpression in some places where it is seen, and that at normal levels of expression there is no evidence for elevated levels at the nuclear periphery. Artefacts resulting from overexpression plainly cannot be a problem for our study nor for Xiao et al. 2021 as in both cases the relevant clock protein, FRQ or PER, was labeled at the endogenous locus and expressed under its native promoter. Also, it may be worth noting that although we called attention to enrichment of FRQ[NeonGreen] at the nuclear periphery, there remained abundant FRQ within the core of the nucleus in our live-cell imaging.

      Cohen SE, et al.: Dynamic localization of the cyanobacterial circadian clock proteins. Curr Biol 2014, 24:1836–1844, https://doi.org/10.1016/j.cub.2014.07.036.

      Pattanayak GK, et al.: Daily cycles of reversible protein condensation in cyanobacteria. Cell Rep 2020, 32:108032, https://doi.org/10.1016/j.celrep.2020.108032.

      Xiao Y, Yuan Y, Jimenez M, Soni N, Yadlapalli S: Clock proteins regulate spatiotemporal organization of clock genes to control circadian rhythms. Proc Natl Acad Sci U S A 2021, 118, https://doi.org/10.1073/pnas.2019756118.

      Bartholomai BM, Gladfelter AS, Loros JJ, Dunlap JC. 2022 PRD-2 mediates clock-regulated perinuclear localization of clock gene RNAs within the circadian cycle of Neurospora. Proc Natl Acad Sci U S A. 119(31):e2203078119. doi: 10.1073/pnas.2203078119.

      Yuan et al., Curr Biol 78: 102129, 2022. https://doi.org/10.1016/j.ceb.2022.102129

      Pancheng Xie, Xiaowen Xie, Congrong Ye, Kevin M. Dean, Isara Laothamatas , S K Tahajjul Taufique, Joseph Takahashi, Shin Yamazaki, Ying Xu, and Yi Liu (2024). Mammalian circadian clock proteins form dynamic interacting microbodies distinct from phase separation. Proc. Nat. Acad. Sci. USA. In press.

    1. Author Response

      The following is the authors’ response to the original reviews.

      We thank the reviewers and editors for their time and careful consideration of this study. Nearly every comment proved to be highly constructive and thoughtful, and as a result, the manuscript has undergone major revisions including the title, all figures, associated conclusions and web app. We feel that the revised resource provides a more systematic and comprehensive approach to correlating inter-individual transcript patterns across tissues for analysis of organ cross-talk. Moreover, the manuscript has been restructured to highlight utility of the web tool for queries of genes and pathways, as opposed to focused discrete examples of cherry-picked mechanisms. A few key revisions include:

      • Manuscript: All figures have been revised to place to explore broad pathway representation. These analyses have replaced the previous circadian and muscle-hippocampal figures to emphasize ability to recapitulate known physiology and remove the discovery portion which has not been validate experimentally.

      • Manuscript: The term “genetic correlation” or “genetically-derived” has been replaced throughout with “transcriptional”, “inter-individual”, or mostly just “correlations”.

      • Manuscript: A new figure (revised fig 2) has been added to evaluate the innate correlation structure of data used for common metabolic pathways, in addition an exploration of which tissues generally show more co-correlation and centrality among correlations.

      • Manuscript: A new figure (revised fig 4) has been added to highlight the utility of exploring gene ~ trait correlations in mouse populations, where controlled diets can be compared directly. These highlight sex hormone receptor correlations with the large amount of available clinical traits, which differ entirely depending on the tissue of expression and/or diet in mouse populations.

      • Web tool: Addition of a mouse section to query expression correlations among diverse inbred strains and associated traits from chow or HFHS diet within the hybrid mouse diversity panel.

      • Web tool: Overrepresentation analysis for pathway enrichments have been replaced with score-based gene set enrichment analyses and including network topology views for GSEA outputs.

      • Web tool: Associated github repository containing scripts for apps now include a detailed walk-through of the interface and definitions for each query and term.

      Public Reviews:

      Reviewer #1 (Public Review):

      Zhou et al. have set up a study to examine how metabolism is regulated across the organism by taking a combined approach looking at gene expression in multiple tissues, as well as analysis of the blood. Specifically, they have created a tool for easily analyzing data from GTEx across 18 tissues in 310 people. In principle, this approach should be expandable to any dataset where multiple tissues of data were collected from the same individuals. While not necessary, it would also raise my interest to see the "Mouse(coming soon)" selection functional, given that the authors have good access to multi-tissue transcriptomics done in similarly large mouse cohorts.

      Summary

      The authors have assembled a web tool that helps analyze multiple tissues' datasets together, with the aim of identifying how metabolic pathways and gene regulation are connected across tissues. This makes sense conceptually and the web tool is easy to use and runs reasonably quickly, considering the size of the data. I like the tool and I think the approach is necessary and surprisingly under-served; there is a lot of focus on multi-omics recently, but much less on doing a good job of integrating multi-tissue datasets even within a single omics layer.

      What I am less convinced about is the "Research Article" aspect of this paper. Studying circadian rhythm in GTEx data seems risky to me, given the huge range in circadian clock in the sample collection. I also wonder (although this is not even remotely in my expertise) whether the circadian rhythm also gets rather desynchronized in people dying of natural causes - although I suppose this could be said for any gene expression pathway. Similarly for looking at secreted proteins in Figure 4 looking at muscle-hippocampus transcript levels for ADAMTS17 doesn't make sense to me - of all tissue pairs to make a vignette about to demonstrate the method, this is not an intuitive choice to me. The "within muscle" results look fine but panels C-E-G look like noise to me...especially panel C and G are almost certainly noise, since those are pathways with gene counts of 2 and 1 respectively.

      I think this is an important effort and a good basis but a significant revision is necessary. This can devote more time and space to explaining the methodology and for ensuring that the results shown are actually significant. This could be done by checking a mix of negative controls (e.g. by shuffling gene labels and data) and a more comprehensive look at "positive" genes, so that it can be clearly shown that the genes shown in Fig 1 and 2 are not cherry-picked. For Figure 3, I suspect you would get almost an identical figure if instead of showing pan-tissue circadian clock correlations, you instead selected the electron transport chain, or the ribosome, or any other pathway that has genes that are expressed across all tissues. You show that colon and heart have relatively high connectivity to other tissues, but this may be common to other pathways as well.

      Response: We are thankful to the reviewer in their detailed assessment of the manuscript. The comments raised in both the public and suggested reviews clearly improved the revised study and helped to identify limitations. In general, we have removed data suggesting “discovery” using these generalized analyses, such as removing figures evaluating circadian rhythm genes and muscle-hippocampus correlations. These have been replaced with more thorough investigations of tissue correlation structure and potentially identified regions of data sparsity which are important for users to consider. Also, we have added a similar full detailed pipeline of mouse (HMDP) data and highlighted in the manuscript by showing transcript ~ trait correlations of sex hormone receptor genes which differ between organs and diets. Further responses to individual points are also provided below.

      Reviewer #2 (Public Review):

      Summary:

      Zhou et al. use publicly available GTEx data of 18 metabolic tissues from 310 individuals to explore gene expression correlation patterns within-tissue and across-tissues. They detect signatures of known metabolic signaling biology, such as ADIPOQ's role in fatty acid metabolism in adipose tissue. They also emphasize that their approach can help generate new hypotheses, such as the colon playing an important role in circadian clock maintenance. To aid researchers in querying their own genes of interest in metabolic tissues, they have developed an easy-to-use webtool (GD-CAT).

      This study makes reasonable conclusions from its data, and the webtool would be useful to researchers focused on metabolic signaling. However, some misconceptions need to be corrected, as well as greater clarification of the methodology used.

      Strengths:

      GTEx is a very powerful resource for many areas of biomedicine, and this study represents a valid use of gene co-expression network methodology. The authors do a good job of providing examples confirming known signaling biology as well as the potential to discover promising signatures of novel biology for follow-up and future studies. The webtool, GD-CAT, is easy to use and allows researchers with genes and tissues of interest to perform the same analyses in the same GTEx data.

      Weaknesses:

      A key weakness of the paper is that this study does not involve genetic correlations, which is used in the title and throughout the manuscript, but rather gene co-expression networks. The authors do mention the classic limitation that correlation does not imply causation, but this caveat is even more important given that these are not genetic correlations. Given that the goal of their study aligns closely with multi-tissue WGCNA, which is not a new idea (e.g., Talukdar et al. 2016; https://doi.org/10.1016/j.cels.2016.02.002), it is surprising that the authors only use WGCNA for its robust correlation estimation (bicor), but not its latent factor/module estimation, which could potentially capture cross-tissue signaling patterns. It is possible that the biological signals of interest would be drowned out by all the other variation in the data but given that this is a conventional step in WGCNA, it is a weakness that the authors do not use it or discuss it.

      Response: Thank you for the helpful and detailed suggestions regarding the study. The review raised some important points regarding methodological interpretations (ex. bicor-exclusive application as opposed to module-based approaches), as well as clarification of “genetic” inferences throughout the study. The comparison to module-based approaches has also now been discussed directly, pointing our considerations and advantages to each. We hope that the reviewer with our corrections to the misconceptions posed, many of which we feel were due to our insufficient description of methodological details and underlying interpretations. The revised manuscript, web portal and associated github provide much more detail and many more responses to specific points are provided below.

      Reviewer #3 (Public Review):

      Summary: A useful and potentially powerful analysis of gene expression correlations across major organ and tissue systems that exploits a subset of 310 humans from the GTEx collection (subjects for whom there are uniformly processed postmortem RNA-seq data for 18 tissues or organs). The analysis is complemented by a Shiny R application web service.

      The need for more multisystems analysis of transcript correlation is very well motivated by the authors. Their work should be contrasted with more simple comparisons of correlation structure within different organs and tissues, rather than actual correlations across organs and tissues.

      Strengths and Weaknesses: The strengths and limitations of this work trace back to the nature of the GTEx data set itself. The authors refer to the correlations of transcripts as "gene" and "genetic" correlations throughout. In fact, they name their web service "Genetically-Derived Correlations Across Tissues". But all GTEx subjects had strong exposure to unique environments and all correlations will be driven by developmental and environmental factors, age, sex differences, and shared and unshared pre- and postmortem technical artifacts. In fact we know that the heritability of transcript levels is generally low, often well under 25%, even studies of animals with tight environmental control.

      This criticism does not comment materially detract for the importance and utility of the correlations-whether genetic, GXE, or purely environmental-but it does mean that the authors should ideally restructure and reword text so as to NOT claim so much for "genetics". It may be possible to incorporate estimates of chip heritability of transcripts into this work if the genetic component of correlations is regarded as critical (all GTEx cases have genotypes).

      Appraisal of Work on the Field: There are two parts to this paper: 1. "case studies" of cross-tissue/organ correlations and 2. the creation of an R/Shiny application to make this type of analysis much more practical for any biologist. Both parts of the work are of high potential value, but neither is fully developed. My own opinion is that the R/Shiny component is the more important immediate contribution and that the "case studies" could be placed in the context of a more complete primer. Or Alternatively, the case studies could be their own independent contributions with more validation.

      Response: We thank the reviewer for their supportive and helpful comments. The discussion of usage of the term “genetic” has been removed entirely from the manuscript as this point was made by all reviewers. Further, we have revised the previous study to focus on more detailed investigations of why transcript isoforms seemed correlated between tissues and areas where datasets are insufficient to provide sufficient information (ex. Kidney in GTEx). As the reviewer points out, the previous “case studies” were unvalidated and incomplete and as a result, have been replaced. Additional points below have been revised to present a more comprehensive analyses of transcript correlations across tissues and improved web tool.

      (Recommendations For The Authors):

      As this manuscript is focused on the analytical process rather than the biological findings, the reviewer concerns are not a fundamental issue to subsequent acceptance of the paper, but some of the examples will need to be replaced or double-checked to ensure their biological and statistical relevance. To raise the scope and interest of the method developed, it would be seen very positively to include additional datasets, as the authors seem to have intended to have done, with a non-functional (and highlighted as such) selection for mouse data. Establishing that the authors can easily - and will easily - add additional datasets into their tool would greatly raise the reviewers' confidence in the methodology/resource aspect of this paper. This may also help address the significant concerns that all three reviewers raised with the biological examples, e.g. that GTEx data is so uncontrolled that studying environmentally-influenced traits such as circadian rhythm may be challenging or even impossible to do properly. Adding in a more highly controlled set of cross-tissue mouse data may be able to address both these concerns at once, i.e. the resource concern (can the website easily be updated with new data) and the biological concern (are the results from these vignettes actually statistically significant).

      Reviewer #1 (Recommendations For The Authors):

      Comments, in approximately reverse order of importance

      1. Some figure panels are not referenced in the text, e.g. Fig 1B and Figure 2E. Response: Thank you for pointing this out. We have revised every figure in the manuscript and additionally gone through to make sure every panel is referenced in the text.

      2. The authors mention "genetic data" several times but I don't see anything about DNA. By "genetic data" do you mean "transcriptome expression data," or something else?

      Response: This is an important point, also raised by all 3 reviewers. We have clarified in the abstract, results and discussion that correlations are between transcripts. As a result, all mentions of “genetics” or “genetic data” has been removed, with the exception of introducing mouse genetic reference panels.

      1. For Figure 3, the authors look at circadian clock data, but the GTEx data is from all sorts of different times of day from across the patient cohort depending on when the donor died, and I don't see this metadata actually mentioned anywhere. I see Arntl Clock and all the other circadian genes are highly coexpressed in each tissue (except not so strong in liver) but correlation across tissue seems more random. Also hypothalamus seems to be very strongly negatively correlated with spleen, but this large green block doesn't have significance? That is surprising to me, since the sample sizes are all equivalent I would expect any correlation remotely close to -1.0 to be highly significant.

      Response: The reviewer raises several important points with regard to the source of data and underlying interpretations. We have added a revised Fig 2, suggesting that representation of gene expression between tissues can be strongly biased by nature of samples (ex. differences in data that is available for each tissue) and also discussed considerations of the nature of sample origin in the limitations section. We have also used some of these points when introducing rationale for using mouse population data. As a result of comments from this reviewer and others, we have removed the circadian rhythm analysis and muscle-hippocampal figures from the revised study; however, specifically mentioned these cohort differences in the discussion section (lines 294-298). Circadian rhythm terms are also evaluated in Fig 2 and consistent with the reviewers concerns, less overall correlations are observed between transcripts across tissues when compared to other common GO terms assessed.

      1. Figure 4, this is all transcript-level data, so it is confusing to see protein nomenclature used, e.g. "expression of muscle ADAMTS17" should be "expression of muscle ADAMTS17" (ADAMTS17 the transcript should be in italics, in case the formatting is removed by the eLife portal). Same for FNDC5. In the figures you do have those in italics, so it is just an issue in the manuscript text. In general please look through the text and make sure whether you are referring really to a "gene," "transcript," or "protein." For instance, Figure 1 legend I think should be "A, All transcripts across the ... with local subcutaneous and muscle transcript expression." I know people still sometimes use "gene expression" to refer to transcripts, but now that proteomics is pretty mainstream, I would push for more careful vocabulary here.

      Response: Thank you for pointing these out. While we have replaced Fig 4 entirely as to limit the unvalidated discovery or research aspects of the paper, we have gone through the text and figures to check that the correct formatting is used for references to human genes (capitalized italics) or the newly-included mouse genes (lower-case italics).

      1. "Briefly, these data were filtered to retain genes which were detected across individuals where individuals were required to show counts > 0 in 1.2e6 gene-tissue combinations across all data." I don't quite understand the filtering metric here - what is 1.2 million gene-tissue combinations referring to? 20k genes times 18 tissues times 310 people is ~100 million measurements, but for a given gene across 310 people * 18 tissues that is only ~6000 quantifications per gene.

      Response: We apologize for this oversight, as the numbers were derived from the whole GTEx dataset in total and not the tissues used for the current study. We have clarified this point in the revised manuscript (methods section in Datasets used) and also removed confusing references to specific numbers of transcripts and tissues unless made clear.

      1. Generally I think your approach makes sense conceptually but... for the specific example used in e.g. figure 4, this only makes sense to me if applied to proteins and not to transcripts. Looking at the transcript levels per tissue for genes which are secreted could be interesting but this specific example is confusing, as is the tissue selected. I would not really expect much crosstalk between the hippocampus and the muscle, especially not in terms of secreted proteins.

      Response: This is a valid point, also raised by other reviewers. While we wanted to highlight the one potentially-new (ADAMTS7) and two established proteins (FNDC5 and ERFE) and their correlations, the fact that this direct circuit remains to be validated led us to replace the figure entirely. The point raised about inference of protein secretion compared to action; however, has been expanded upon in the results and discussion. We now show that complexities arise when using this approach to infer mechanisms of proteins which are primarily regulated post-transcriptionally. We provide a revised Supplemental Fig 4 showing that this general framework, when applied to expression of INS (insulin), almost exclusively captured pathways leading to its secretion and not action.

      1. It's not clear to me how correction for multiple testing is working in the analyses used in this manuscript. You mention q-values so I am sure it was done, I just don't see the precise method mentioned in the Methods section.

      Response: We apologize for this oversight and have included a specific mention of qvalue adjustment using BH methods, where our reasoning was the efficiency in run-time (compared to other qvalue methods). In addition, we provide a revised Fig 2 which suggests that innate correlation structure exists between tissues for a variety of pathways which should be considered. We also compare several empirical bicor pvalues and qvalue adjustments directly between these large pathways where much of the innate tissue correlation structure does appear present when BH qvalue adjustments are applied (revised Fig 2A).

      1. The piecharts in Figure 1 are interesting - I would actually be curious which tissues generally have closer coexpression. This would be an absolutely massive number of pairwise correlations to test, but maybe there is a smarter way to do it? For instance, for ADIPOQ, skeletal muscle has the best typical correlation, but would that be generally true just that many adipose genes have closer relationship between the two tissues?

      Response: This comment inspired us to perform a more systematic query of global gene-gene correlation structures, which is now shown as the revised Fig 2A. With respect to ADIPOQ, the reviewer is correct in that there does appear to be a general pattern of muscle genes showing stronger correlation with adipose genes. We emphasize and discuss there in the revised manuscript to point out that global trends of tissue correlation structure should be taken into account when looking at specific genes. Much of this innate co-correlation structure could be normalized by the BH qvalue adjustment (above); however, strongly correlated pathways like mitochondria showed selective patterns throughout thresholds (revised Fig 2A). Further, we analyze KEGG terms and general correlation structures (revised Fig 2B) to point out the converse, that some tissues are just poorly represented. Interpretation of correlated genes from these organ and pathway combinations should be especially considered in the framework that their poor representation in the dataset clearly impacted the global correlation structures. We have added these points to both results and discussion. In sum, we feel that this was a critical point to explore and attempted to provide a framework to identify/consider in the revised manuscript.

      1. The pathway enrichments in Figure 1 are more difficult for me to interpret, e.g. for ADIPOQ, the scWAT pathways make sense, but the enriched skeletal muscle pathways are less clearly relevant (rRNA processing?? Not impossible but no clear relevance either). What are the significances for these pathway enrichments? Is it even possible to select a gene that has no peripheral pathway enrichment, e.g. if you take some random Gm#### or olfactory receptor gene and run the analysis, are you also going to see significant pathways selected, as pathway enrichment often has a trend to overfit? The "within organ" does seem to make sense, but I am also just looking at 4 anecdotes here and it is unclear whether they are cherry picked because they did make sense. That is, it's unclear why you selected ADIPOQ and not APOE or HMGCR or etc. I also don't figure out how I can make these pathway enrichment plots using your website. I do get the pie chart but when I try the enrichment analysis block (NB: typo on your website, it says "Enrich-E-ment Analysis" with an extra E) I always get that "the selected tissue do not contain enough genes to generate positive the enrichment." (Also two typos in that phrase; authors should check and review extensively for improvements to the use of English.) After trying several genes I eventually got it to work. I think there is some significant overfitting here, as I am pretty sure that XIST expression in the white adipose tissue has nothing to do with olfactory signalling pathways, which are the top positive network (but with an n = 4 genes).

      Response: Several good points within this comment. 1) the pathway enrichments have been revised completely. The reviewer provided a helpful suggestion of a rank-based approach to query pathways, as opposed to the previous over-representation tests. After evaluating several different pathway enrichment tools based on correlated tissue expression transcripts, a rank- and weight-based test (GSEA) captured the most physiologic pathways observed from known actions of select secreted proteins. Therefore, revised pathway enrichments and web-tool queries unitize a GSEA approach which accounts for the rank and weight determined by correlation coefficient. In implementing these new pathway approaches, we feel that pathway terms perform significantly better at capturing mechanisms. 2) With respect to the selection genes, we wanted to provide a framework for investigating genes which encode secreted proteins that signal as a result of the abundance of the protein alone. This is a group-bias; however, and not necessarily reflective of trying to tackle the most important physiologic mechanisms underlying human disease. We agree with the reviewer in those evaluating genes such as APOE and cholesterol synthesis enzymes present an exciting opportunity, our expertise in interpretation and mechanistic confirmation is limited. 3) We have gone through the revised manuscript and attempted to correct all grammatical and/or spelling mistakes.

      1. The network figures I get on your website look actually more interesting than the ones you have in Figure 2, which only stay within a tissue. Making networks within a tissue is pretty easy I think for any biologist today, but the cross-tissue analysis is still fairly hard due to the size of the datasets and correlation matrices.

      Response: We greatly appreciate the reviewer’s enthusiasm for the network model generation aspect. We have tried to improve the figure generation and expanded the gene size selection for network generation in the web tool, both within and across tissues. We are working toward allowing users to select specific pathway terms and/or tissue genes to include in these networks as well, but will need more time to implement.

      1. I get a bug with making networks for certain genes, e.g. XIST - Liver does not work for plotting network graphs. Maybe XIST is a suppressed gene because it has zero expression in males? It is an interesting gene to look at as a "positive control" for many analyses, since it shows that sample sexing is done correctly for all samples.

      Response: The reviewer recognized a key consideration in underlying data structure for GTEx. In the revised manuscript, we evaluated tissue representation (or lack thereof) being a crucial factor in driving where significant relationships cannot be observed in tissues such as kidney, liver and spleen (Fig 2). Moreover, the representation of females (self-reported) in GTEx is less-than half of males (100 compared to 210 individuals). We have emphasized this point in the discussion where we specifically pointed out the lack of XIST Liver correlation being a product of data structure/availability and not reflecting real biologic mechanisms. We expanded on this point by highlighting the clear sex-bias in terms of representation.

      1. On the network diagram on your website, there doesn't seem to be any way to zoom in on the website itself? You can make a PDF which is nice but the text is often very small and hard to read.

      Response: We have revised the web interface plot parameters to create a more uniform graph.

      1. On a related note, is it possible to output the raw data and gene lists for the network graph? I would want to know what are those genes and their correlation coefficient.

      Response: We have enabled explore as .pdf or .svg graphics for the network and all plots. In addition, following pie chart generation at the top of the web app, users now have the ability to download a .csv file containing the bicor coefficients, regression pvalues and adjusted qvalues for all other gene-tissue combinations.

      1. Some functionality issues, e.g. on the "Scatter plot" block, I input a gene name again here. Shouldn't this use the same gene selected already at the top of the page? It seems confusing to again select the gene and tissue here, but maybe there is a reason for that.

      Response: It would be more intuitive to only display genes from a given selected tissue for scatterplots; however, we chose to keep all possible combinations with the [perhaps unnecessary] option of reselecting a tissue to allow users to query any specific gene without having to wait to run the pathways for all that correspond to a given tissues.

      1. Figure 4H should also probably be Figure 1A.

      Response: Good point, the revised Fig 1A is now a summary of the web tool

      I realize I have written a fairly critical review that will require most of the figures to be redone, but I think the underlying method is sound and the implementation by and end-user is quite simple, so I think your group should have no trouble addressing these points.

      Response: Your comments were really helpful and we feel that the tool has significantly improved as a result. So, we are thankful to the time and effort put toward helping here.

      Reviewer #2 (Recommendations For The Authors)

      Comments on the use of "genetic correlation"

      • The use of "genetic correlation" in title and throughout the manuscript is misleading. Should broadly be replaced with "gene expression correlation". Within genetics, "genetic correlation" generally refers to the correlation between traits due to genetic variation, as would be expected under pleiotropy (genetic variation that affects multiple traits). Here, I think the authors are somewhat conflating "genetic" (normally referring to genetic variation) with "gene" (because the data are gene expression phenotypes). I don't think they perform any genetic analysis in the manuscript. I hope I don't sound too harsh. I think the paper still has merit and value, but it is important to correct the terminology.

      Response: This was an important clarification raised by all reviewers. We apologize for the oversight. As a result, all mentions of “genetics” or “genetic data” has been removed, with the exception of introducing mouse genetic reference panels. These have generally been replaced with “transcript correlations”, “correlations” or “correlations across individuals” to avoid confusion.

      • The authors note an important limitation in the Discussion that correlations don't imply a specific causal model between two genes, and furthermore note that statistical procedures (mediation and Mendelian randomization) are dependent on assumptions and really only a well-designed experiment can completely determine the relationship. This is a very important point that I greatly appreciate. I think they could even further expand this discussion. The potential relationships between gene A and gene B are more complex than causal and reactive. For example, a genetic variant or environmental exposure could regulate a gene that then has a cascade of effects on other genes, including A and B. They belong to a shared causal pathway (and are potentially biologically interesting), but it's good to emphasize that correlations can reflect many underlying causal relationships, some more or less interesting biologically.

      Response: We thank the reviewer for pointing this out. We have expanded both the results and discussion sections to mention specifically how correlation between two genes can be due to a variety of parameters, often and not just encompassing their relationship. We mention the importance of considering genetic and environmental variables in these relationships as well which we feel will be an important “take-home message” for the reader. These points were also explored in the revised Fig 2 in terms of investigating broad pathway gene-gene correlation structures. As noted by the reviewer, contexts such as circadian rhythm or other variables in the data which are not fixed show much less overall significance in terms of broad relationships across organs.

      • It would be good for the authors to provide more context for the methods they use, even when they are fully published. For example, stating that biweight midcorrelation (bicor) is an approach for comparing to variables that is more robust to outliers than traditional correlations and is commonly used with gene co-expression correlation.

      Response: Thank you for pointing this out. A lack of method description was also an important reason for lack of clarity on other aspects so we have done our best to detail what exact approaches are being implemented and why. In the revised manuscript, we mention the usage if bicor values to limit influence of outlier individuals in driving regressions, but also point out that it is still a generalized linear model to assess relationships. We hope that the revised methods and expanded git repositories which detail each analysis provide much more transparency on what is being implemented.

      • Performing a similar analysis based on genetic correlation is an interesting idea, as it would potentially simplify the underlying causal models (removing variation that doesn't stem from genetic variants). I don't expect the authors to do this for this paper because it would be a significant amount of work (fitting and testing genetic correlations are not as straightforward). But still, an interesting idea to think about, and individuals in GTEx are genotyped I believe. Could be mentioned in the Discussion.

      Response: Absolutely. While we did not implement and models of genetic correlation (despite misusing the term) in this analysis. We have added to the discussion on how when genetic data is available, these approaches offer another way to tease out potentially causal interactions among the large amount of correlated data occurring for a variety of reasons.

      Comments on use of the term "local" and "regression"

      • "Local" is largely used to mean within-tissue, so how correlated gene X in tissue Y is with other genes in tissue Y. I think this needs to be defined explicitly early in the manuscript or possibly replaced with something like "within-tissue".

      Response: We have replaced al “local” mentions with “within-tissue” or simply name the tissue that the gene is expressed to avoid confusion with other terms of local (ex a transcript in proximity to where it is encoded on the genome).

      • "Regression" is also used frequently throughout, often when I think "correlation" would be more accurate. It's true that the regression coefficient is a function of the correlation between X and Y, but I don't think actual regression (the procedure) applies here. The coefficients being used are bicor, which I don't think relates as cleanly to linear regression.

      Response: Thank you for pointing this out. A lack of method description was also an important reason for lack of clarity on other aspects so we have done our best to detail what exact approaches are being implemented and why. In the revised manuscript, we mention the usage if bicor values to limit influence of outlier individuals in driving correlations, but also point out that it is still a generalized linear model to assess relationships. Further, we have removed usage of “regression” when referencing bicor values. We hope that the revised methods and expanded git repositories which detail each analysis provide much more transparency on what is being implemented.

      • "Further, pan-tissue correlations tend to be dominated by local regressions where a given gene is expressed. This is due to the fact that within-tissue correlations could capture both the regulatory and putative consequences of gene regulation, and distinguishing between the two presents a significant challenge" (lines 219-223). This sentence includes both "local" and "regressions" (and would be improved by my suggested changes I think), but I also don't fully understand the argument of "regulatory and putative consequences". I think the authors should elaborate further. In the examples, the within-tissue correlations do look stronger, suggesting within-tissue regulation that is quite strong and potentially secondary inter-tissue regulation. If that's the idea, I think it can be stated more clearly.

      Response: Thank you for pointing this out. We have revised the sentence to state the following:

      Further, many correlations tend to be dominated by genes expressed within the same organ. This could be due to the fact that, within-tissue correlations could capture both the pathways regulating expression of a gene, as well as potential consequences of changes in expression/function, and distinguishing between the two presents a significant challenge. For example, a GD-CAT query of insulin (INS) expression in pancreas shows exclusive enrichments in pancreas and corresponding pathway terms reflect regulatory mechanisms such as secretion and ion transport (Supplemental Fig 4).

      We feel that this point might not be intuitive, so have included a new figure (Supplemental Fig 4) which contains the tissue correlations and pathways for INS expression in pancreas. These analyses show an example where co-correlation structure seems almost entirely dominated by genes within the same organ (pancreas) and GSEA enrichments highlight many known pathways which are involved in regulating the expression/secretion of the gene/protein. We hope that this makes the point more clearly to the reader.

      Additional comments on Results:

      • I would break the titled Results sections into multiple paragraphs. For example, the first section (lines 84-129) has a few natural breakpoints that I noticed that would potentially make it feel less over-whelming to the reader.

      Response: We have broken up the results section into separate paragraphs in the revised manuscript. In addition, we have gone through to try and make sure that the amount of information per block/sentence focuses on key points.

      • "Expression of a gene and its corresponding protein can show substantial discordances depending on the dataset used" (line 224 of Results). This is a good point, and the authors could include citations here of studies that show discordance between transcripts and proteins, of which there are a good number. They could also add some biological context, such as saying differences could reflect post-translational regulation, etc.

      Response: Thank you for the supportive comment. We have referenced several comprehensive reviews of the topic, each of which contain tables summarizing details of mRNA-protein correlation. The revised discussion sentence is as follows:

      Expression of a gene and its corresponding protein can show substantial discordances depending on the dataset used. These have been discussed in detail39–41, but ranges of co-correlation can vary widely depending on the datasets used and approaches taken. We note that for genes encoding proteins where actions from acute secretion grossly outweigh patterns of gene expression, such as insulin, caution should be taken when interpreting results. As the depth and availability of tissue-specific proteomic levels across diverse individuals continues to increase, an exciting opportunity is presented to explore the applicability of these analyses and identify areas when gene expression is not a sufficient measure.

      1. Liu, Y., Beyer, A. & Aebersold, R. On the Dependency of Cellular Protein Levels on mRNA Abundance. Cell 165, 535–550 (2016).

      2. Maier, T., Güell, M. & Serrano, L. Correlation of mRNA and protein in complex biological samples. FEBS Letters 583, 3966–3973 (2009).

      3. Buccitelli, C. & Selbach, M. mRNAs, proteins and the emerging principles of gene expression control. Nat Rev Genet 21, 630–644 (2020).

      • In many ways, this work has similar goals to many studies that have performed multi-tissue WGCNA (e.g., Talukdar et al. 2016; https://doi.org/10.1016/j.cels.2016.02.002). In this manuscript, WGCNA's conventional approach to estimating robust correlations (bicor) is used, but they do not use WGCNA's data reduction/clustering functionality to estimate modules. Perhaps the modules would miss the signaling relationships of interest, being sort of lost in the presence of stronger signals that aren't relevant to the biological questions here. But I think it would be good for the authors to explain why they didn't use the full WGCNA approach.

      Response: This is an important point and we also feel that the previous lack of methodological details and discussion did a poor job at distinguishing why module-based approaches were not used. We wanted to be careful not to emphasize one approach being superior/inferior to another, rather point out the different considerations and when a direct correlation might inform a given question. As the reviewer points out, our general feeling is that adopting a simple gene-focused correlation approach allows users to view mechanisms through the lens of a single gene; however, this is limited in that these could be influenced by cumulative patterns of correlation structure (for example mitochondria in revised Fig 2A) which would be much more apparent in a module-based approach. This comment, in combination with the other listed above, was our motivation in exploring cumulative patterns of gene-gene correlations in the revised Fig 2. In the revised manuscript, we expanded on the results and discussion section to highlight utility of these types of approaches compared to module-based methods:

      The queries provided in GD-CAT use fairly simple linear models to infer organ-organ signaling; however, more sophisticated methods can also be applied in an informative fashion. For example, Koplev et al generated co-expression modules from 9 tissues in the STARNET dataset, where construction of a massive Bayesian network uncovered interactions between correlated modules6. These approaches expanded on analysis of STAGE data to construct network models using WGCNA across tissues and relating these resulting eigenvectors to outcomes42. The generalized approach of constructing cross-tissue gene regulatory modules presents appeal in that genes are able to be viewed in the context of a network with respect to all other gene-tissue combinations. In searching through these types of expanded networks, individuals can identify where the most compelling global relationships occur. One challenge with this type of approach; however, is that coregulated pathways and module members are highly subjective to parameters used to construct GRNs (for example reassignment threshold in WGCNA) and can be difficult in arriving at a “ground truth” for parameter selection. We note that the WGCNA package is also implemented in these analyses, but solely to perform gene-focused correlations using biweight midcorrelation to limit outlier inflation. While the midweight bicorrelation approach to calculate correlations could also be replaced with more sophisticated models, one consideration would be a concern of overfitting models and thus, biasing outcomes.

      Additional comments on Discussion:

      • In the second paragraph of the Discussion (lines 231-244), the authors mention that GD-CAT uses linear models to compare data between organs and point to other methods that use more complex or elaborate models. It's good to cite these methods, but I think they could more directly state that there are limitations to high complexity models, such as over-fitting.

      Response: Thank you for this suggestion. We have added a line (above) mentioning the overfitting concern.

      Comments on Methods:

      • The described gene filtration in the Methods of including genes with non-zero expression for 1.2e6 gene-tissue combinations is confusing. If there are 310 individuals and 18 tissues, for a given gene, aren't there only 5,580 possible data points? Might be helpful to contextualize the cut-off in terms of like the average number of individuals with non-zero expression within a tissue.

      Response: We apologize for this error. This number was pasted from a previous dataset used and not appropriate for this manuscript. In general, we have removed specific mentions of total number of gene_tissue correlation combinations, as these numbers reflect large but almost meaningless quantifications. Instead, we expanded the methods in terms of how individuals and genes filtered.

      • More details should be given about the gene ontology/pathway enrichment analysis. I suspect that a set-based approach (e.g., hypergeometric test) was used, rather than a score-based approach. The authors don't state what universe of genes were used, i.e., the overall set of genes that the reduced set of interest is compared to. Seems like this could or should vary with the tissues that are being compared. A score-based approach could be interesting to consider (https://www.biorxiv.org/content/10.1101/060012v3), using the genetic correlations as the score, as this would remove the unappealing feature of sets being dependent on correlation thresholds. This isn't something that I would demand of the published paper, but it could be an appealing approach for the authors to consider and confirm similar results to the set-based analysis.

      Response: This is an important point. Following this suggestion, we evaluated several different rank- and weight-based pathway enrichment tools, including FGSEA and others. Ultimately, we concluded that GSEA performed significantly better at 1) recapitulating known biology of select secreted protein genes and 2) leveraging the large numbers of genes occurring at qvalue cutoffs without having to further refine (ex. in the previous overrepresentation tests). For this reason, all pathway enrichments in the web tools and manuscripts not contain GSEA outputs and corresponding pathway enrichments or network graph visualizations. Thank you for this suggestion.

      Comments on figures:

      • I think there is a bit of a missed opportunity to use the figures to introduce and build up the story for readers. For example, in Figure 1, plotting ADIPOQ expression against a correlated gene in adipose (local) as well as peripheral tissues. This doesn't need to be done for every example, but I think it would help readers understand what the data are, and what's being detected before jumping into higher level summaries.

      Response: Thank you, this point also builds on others which recommended to restructure the manuscript and figures. In the revised manuscript, we first introduce the web tool (which was last previously), and immediately highlight comparisons of within- and across-organ correlations, such as ADIPOQ. We feel that the revised manuscript presents a superior structure in terms of demonstrating the key points and utility of looking at gene-gene correlations across tissues.

      • Figures 1 and 4 are missing the color scale legend for the bar plots, so it's impossible to tell how significant the enrichments are.

      Response: We apologize for the oversight. The pathways in the revised Fig 1 detail pathway network graphs among the top pathways which should make interpretation more intuitive. We have also gone through and made sure that GSEA enrichment pvalues are now present for all figures including pathways (revised Fig 1, Fig 3 and supplemental Fig 4).

      • The Figure 2 caption says that edges are colored based on correlation sign? Are there any negative correlations (red)? They all look blue to me. The caption could also state that edge weight reflects correlation magnitude (I assume). It would be ideal to include a legend that links a range of the depicted edge weights to their genetic correlation, though I don't know how feasible that may be depending on the package being used to plot the networks.

      Response: Good catch. We included in the revised manuscript the network edge parameters: Network edges represent positive (blue) and negative (red) correlations and the thicknesses are determined by coefficients. They are set for a range of bicor=0.6 (minimum to include) to bicor=0.99

      Related to seeing a dominant pattern of positive correlations, we agree that this observation is fascinating and gene-gene correlations being dominated by positive coefficients will be the topic of a closely-following manuscript from the lab

      • Figure 4A would be more informative as boxplots, which could still include Ssec score. This would allow the reader to get a sense of the variation in correlation p-value across all hippocampus transcripts.

      Response: Related to comments from this reviewer and others, we have removed the previous Fig 4 entirely from the manuscript to emphasize the ability of these gene-gene correlations to capture known biology and limit the extend of unvalidated “suggested” new mechanisms.

      Comments on GD-CAT

      • The online webtool worked nicely for me. It was easy to use and produce figures like in the manuscript. One suggestion is show data points in the scatter plot rather than just the regression line (if that's possible currently, I didn't figure it out). A regression line isn't that interesting to look at, but seeing how noisy the data look around it is something humans can usually interpret intuitively.

      Response: Thank you so much. We are excited that the web tool works sufficiently. We have also revised the individual gene-gene correlation tab to show individual data points instead of simple regression lines.

      Minor comments:

      Response: Thank you for these detailed improvements

      • This sentence is awkwardly constructed: "Here, we surveyed gene-gene genetic correlation structure for ~6.1x10^12 gene pairs across 18 metabolic tissues in 310 individuals where variation of genes such as FGF21, ADIPOQ, GCG and IL6 showed enrichments which recapitulate experimental observations" (lines 68-70). It's an important sentence because it's where in the Abstract/Introduction the authors succinctly state what they did, thus I would re-work it to something like: "Here, we surveyed gene expression correlation structure..., identifying genes, such as FGF21, ADIPOQ, GCG and IL6, that possess correlation networks that recapitulate known biological pathways."

      Response: The numbers of pairs examined and dataset size have been removed for clarity and we have revised this statement and results as a whole

      • Prefer swapping "signal" for "signaling" in line 53 of Abstract/Introduction.

      Response: Done

      • Remove extra period in line 208 of Results.

      Response: Removed

      • Change "well-establish" to "well-established" in line 247 of Discussion.

      Response: Replaced

      • Missing commas in line 302 of Methods.

      Response: added

      • Missing comma in line 485 of Figure 3 caption.

      Response: The previous Fig 3 has been removed

      • Typo in title of Figure 3E (change "Perihperal" to "Peripheral")

      Response: Thank you, changed

      • Add y-axis label to y-axis labels (relative cell proportions) to Supplemental Figures 1-3.

      Response: These labels have been added

      Reviewer #3 (Recommendations For The Authors):

      Minor technical comment: The authors refer to correlations between genes when they actually mean correlations between GTEX transcript isoform models. It is exceedingly important to keep this distinction clear in the reader's mind, a fact that is emphasized by the authors themselves when they comment on the potential value of similar proteomic assays to evaluate multiorgan system communication. GTEx has tried to do proteomics but I do not know of any open data yet.

      Response: Thank you for this point. We have gone through the manuscript and replaced “gene correlations” with “transcript” or other similar mentions. Related to the comment on GTEx proteomics, this is an important point as well. As the reviewer mentions, proteomics has been performed on GTEx data; however, given that this dataset contains only 6 sparsely-represented individuals, analyses such as the ones highlighted in our study remain highly limited. We have added the following to the discussion: As the depth and availability of tissue-specific proteomic levels across diverse individuals continues to increase, an exciting opportunity is presented to explore the applicability of these analyses and identify areas when gene expression is not a sufficient measure. For example, mass-spec proteomics was recently performed on GTEx42; however, given that these data represent 6 individuals, analyses utilizing well-powered inter-individual correlations such as ours which contain 310 individuals remain limited n applications.

      The R/Shiny companion application: The community utility of this application would be greatly improved by a link to a primer and more basic functionality. The Github site is a "work in progress" and does not include a readme file or explanation (that I could find) on the license.

      Response: Thank you, we are excited that the apps operate sufficiently. We have revised the github repository entirely to contain a full walk-through of app details and parameter selections. These are meant to walk users through each step of the pipeline and discuss what is being done at each step. We agree that this updated github repository allows users to understand the details of the R/Shiny app in much more detail. We also made all the app scripts, datasets, markdown/walkthrough files and docker image fully available to enhance accessibility.

    1. Author Response

      We appreciate the reviewers’ and editors’ advice on further improving this manuscript. We have provided point by point responses to the reviewers’ comments mentioned below. A revised version of this manuscript will be uploaded within a few weeks.

      Authors’ response to Reviewer 1 comments:

      • We appreciate the reviewer’s time in highlighting the strengths and weaknesses of this manuscript.

      • Per the reviewer’s advice, we will provide further description of the methods in a revised version of this manuscript.

      • The interpretation about the biological threat in response to elevated glycosuria in renal Glut2 KO mice is based on our observation that these mice exhibit changes in acute phase proteins measured using plasma proteomics. We will further discuss this in a revised version of this manuscript.

      • We acknowledge that this manuscript provides a resource for future mechanistic studies. Because multiple secreted proteins are changed between the control and experimental groups, some of them could be causal and others corelative in the context of enhancing compensatory glucose production in response to elevated glycosuria. Through future studies we will determine the causal proteins that trigger the increase in glucose production and identify the tissues that secrete these proteins.

      • We have shown previously (Cordeiro et al., Diabetologia 2022) that renal Glut2 deficiency doesn’t change insulin sensitivity (i.e. renal Glut2 KO mice don’t exhibit insulin resistance despite the activation of the HPA axis). It is likely that the massive glycosuria in renal Glut2 KO mice may overcome or mask the phenotype of insulin resistance potentially induced by an increase in the stress hormones.

      • In this manuscript, our major goal was to determine how elevated glycosuria leads to an increase in compensatory glucose production. We are not suggesting renal Glut2 as a therapeutic in this manuscript (that was already demonstrated in our previously published manuscript, Cordeiro et al., Diabetologia 2022).

      Authors’ response to Reviewer 2 comments:

      1) Renal Glut2 KO mice didn’t exhibit sex differences for the variables reported in our previous manuscript (Cordeiro et al., Diabetologia 2022). Therefore, in the present manuscript we decided to use male or female mice depending on their availability for each reported experiment. Per the reviewer’s advice, we will describe these details including age and sexes in each figure legend.

      2) For the method description, we have cited previous publications and mentioned ‘as described previously’. Based on the reviewer’s suggestion we will further describe the methods in detail to clarify the reviewer’s concerns. In addition, we will include age and sexes in the legends of each figure.

      3) For littermate controls, we had used Glut2loxp/loxp mice (which are like WT controls as described in Cordeiro et al., Diabetologia 2022) that were injected with tamoxifen exactly in the same way as the experimental mice. Het mice for Cre were not used as controls because they would have confounded the results as pointed out by the reviewer.

      4) Because elevated HPA activity is known to increase blood glucose levels, we suggested ‘the HPA axis may…..’. Given the nature of this manuscript, we agree the secreted proteins identified using plasma proteomics could contribute to enhanced glucose production directly or through secondary mechanisms. Afferent renal denervation using capsaicin reduced blood glucose levels concomitant with the suppression of the HPA axis in renal Glut2 KO mice. Based on these findings we speculated that the HPA axis may be partly responsible for increasing glucose production in renal Glut2 KO mice.

      We had considered using CRF antagonist and glucocorticoid receptor antagonists to determine the causal role of the HPA axis in contributing to the increase in glucose production in renal Glut2 KO mice. However, these drugs activate compensatory mechanisms including changes in insulin sensitivity. Therefore, use of these drugs would further confound the results instead of providing a clarity on the causal role of the HPA axis in enhancing glucose production in renal Glut2 KO mice.

      5) We understand the reviewer’s concerns whether the results reported here are translatable to humans. Please note that expression of SGLT2 is not kidney-specific; therefore, pleiotropic effects of SGLT2 inhibition in tissues other than the kidney cannot be excluded in animal models and humans. In contrast, the mouse model reported in this manuscript is kidney-specific Glut2 KO mice. Therefore, phenotype produced in renal Glut2 KO mice cannot be directly compared with that produced after SGLT2 inhibition. It may be too early to speculate whether the results reported in this manuscript are translatable to humans.

      In the referred research papers by the reviewer, the authors have used either models of different types of diabetes or included individuals with diabetes in their study. Notedly, diabetes itself affects the HPA axis independently of SGLT2 or GLUT2 inhibition. Therefore, it may not be appropriate to compare results obtained from animals or individuals with diabetes with that reported in this manuscript from renal Glut2 KO mice.

      6) Yes, we are currently performing mechanistic studies including assessment of mitochondrial function in renal Glut2 KO mice to determine whether and how the kidneys sense loss of glucose in urine.

      7) We apologize for the lack of methods description. We will provide additional method details in a revised version of this manuscript. All the assays were performed as per manufacturer’s instructions. Aliquots of the same samples were used for analyses of the hormones and for consistency across different assays.

    1. Author Response

      We highly appreciate the constructive feedback provided by the reviewers, which we believe will greatly improve the quality of our work. We were encouraged to see that our manuscript was considered to be “important”, of “great interest” as well as to “yield valuable results”.

      We also highly appreciate the overall positive eLife assessment. However, we were surprised to read that our “results range from solid from inadequate”. This especially applies given the positive and engaging nature of the reviews which seem to mainly concern the results interpretation being “inadequate” rather than the results themselves. Hence, we kindly request a reconsideration of this aspect of the assessment.

      Moreover, there is one Reviewer comment we would like to address directly. Reviewer #3 pointed out that “this study did not conduct a direct association analysis between MetS and cognitive levels without considering subgroup comparisons.” and that “After a thor-ough review of the methods and results sections” she/he “found no direct or strong evidence supporting the authors' claim that the identified latent variables were related to more severe MetS to worse cognitive performance. While a sub-group comparison was conducted, it did not adequately account for confounding factors such as educational level.”.

      We appreciate the observations of Reviewer #3 regarding the absence of a direct association analysis between Metabolic Syndrome (MetS) and cognitive levels without subgroup comparisons, and the lack of evidence linking latent variables to MetS severity and cognitive performance. Our apologies for any confusion caused by unclear presentation. Our study incorporated association analyses between MetS, brain structure, and cognition using MetS components, regional cortical thickness, and cognitive performance data in a PLS. These analyses were separately performed on the UK Biobank and HCHS datasets, due to their distinct cognitive assessments. We adjusted for age, sex, and education in the subgroup analyses by removing their effects from the input variables. The primary latent variables demonstrated significant associations with MetS components, cortical thickness, and cognitive scores, indicating that higher obesity, blood pressure, lipidemia, and glycemia levels correlate with lower cognitive performance. These relationships are detailed in supplementary figures S15b and S16b, with negligible loadings for age, sex, and education, confirming effective deconfounding. We acknowledge the reviewer's constructive feedback and will enhance the clarity of the Methods and Results sections, including conducting a mediation analysis.

      Furthermore, we strive to incorporate the Reviewers’ other suggestions into the analysis. The revision will include major changes to the manuscript.

      In response to Reviewer #1:

      • We will revise considering non-fasting plasma glucose as a surrogate marker of insuline resistance.

      • We will report Field IDs of the used UK Biobank variables.

      • We aim to moderate causal interpretations and reword the indicated passages for clarity.

      In response to Reviewer #2:

      • We will reconsider claims of binarizing vascular dementia and Alzheimer’s dementia pathophysiology.

      • We will further explore the cell type associations of the other latent variables.

      • We will expand the discussion regarding conclusions from our results and the future outlook.

      In response to Reviewer #3.

      • We will add an additional flowchart to detail the virtual histology analysis.

      • We will add a discussion of the second latent variable.

      • We will conduct a mediation analysis to statistically assess the mediation effect of brain structure on the relationship between MetS and cognitive performance.

      We are convinced that with these revisions, our manuscript will align even more closely with the high standards of eLife and make a strong contribution to its distinguished portfolio. We thank you for your consideration.

    1. Author Response

      The following is the authors’ response to the original reviews.

      We are grateful to the reviewers for their remarks, which significantly improved the paper. We repeated the biochemical assay concerning SIRT6 activity on H3-K27Ac and quantified the results as requested. Please find our detailed answers bellow each recommendation of the reviewers.

      Major recommendations:

      1. Grammatical errors are still common; the authors may need to consider an external editing service if they intend to fix the problems as they indicate that they believe the errors have been removed. The Results section is relatively clean, but parts of the Abstract, Introduction, and Discussion are more difficult to understand, and errors are especially common in the Methods section and those parts of the manuscript that are new in this revision.

      We corrected the grammatical errors.

      1. The introduction doesn't mention the other structures published; this is considered to be a serious deficiency as it prevents the reader from understanding the context for the contributions described here. Withholding the comparison with (or mention of) the previously published work to the last sentence of the Discussion seems misleading and does not give the reader adequate ability to judge the novelty of the results presented in this manuscript.

      A paragraph comparing our paper to the other structures published appear at the end of the discussion. We feel this is still the right place for such a paragraph.

      1. The addition of the assay for deacetylation is a significant improvement over the initial submission. This is important both for validating the importance of the acidic patch contacts and for helping to resolve the conflicting reports regarding activity on H3-K27Ac. Given the importance of this assay for the impact of the manuscript, it is not clear why the authors chose to 1) put the data in the supplement instead of in the main manuscript, and 2) provide only single samples without quantitation. These both seem to be significant limitations.

      We repeated the experiment and provided quantification of the results. We placed the figure in the main manuscript.

      1. The authors should add text or a table to the Methods section explaining which maps were used for each figure. By our count, there are 8 maps and 5 models (plus MD models) based on two datasets, but the relationships among them are not clearly stated, and the names of the maps (such as "Zn-finger focused" and "Rossman-Fold-Focused") might be changed to be more helpful to the reader (for example, the latter includes more than the Rossman fold and might be renamed "Sirt6-focused"). The authors should also explain how the maps were validated, which data were deposited in public repositories, and why some data were not deposited. For example, no statistics or methods regarding how particles were separated into integrated vs. non-integrated motion are provided for the CryoDRGN models. Further, the "two principle movements" described are depicted in 4 maps from two CryoDRGN runs using two separate sets of particles, but the relationships among them are not defined clearly. Finally, the connectivity of densities in Fig 8 are not obvious in the submitted maps. Until these points are addressed, the work is considered incomplete.

      AND

      1. The PDB model provided for review and submitted to the PDB database shows loosely bound DNA at the nucleosomal entry/exit points near the binding site of SIRT6, but the maps provided for review and submitted to the EMDB show stronger density for the canonical location of the DNA expected at these sites. The CryoDRGN maps support a more extended conformation, but these maps were not deposited or provided for review so their validity cannot be assessed.

      We added a section to the methods listing the different maps used for the figures. We deposited the map we used to trance the H2A N-terminal tail (EMD-18497). Unfortunately, we couldn’t deposit the cryoDRGN maps as the deposition system either accepts composite maps, where the consensus should be deposited too or experimental maps, where the deposition of half maps are mandatory. Nevertheless, the cryoDRGN maps are available upon request. We also added a supplementary figure (Supplementary Fig 6) to show how the cryoDRGN analyses were performed.

      1. The orientation, angle and threshold used in Fig 1 make it difficult to see the multiple DNA orientations that are visible in the deposited consensus map. Examination of the map suggests that the DNA model submitted to PDB corresponds to a weaker DNA conformation than is present in the map where both DNA conformations are visible. The authors should consider modeling both conformations in their deposited model to provide a more complete, accurate representation of the data. It is concerning that a key conclusion of the manuscript is that the DNA conformation changes upon SIRT6 binding, but density for the canonical position is observable in Fig 8a.

      Figure 1 is showing the overall representation of the SIRT6 bound nucleosome structure. We show the DNA linker orientations in the subsequent figure. Figure 8 (now Figure 9) shows the rearrangement of the SIRT6 Rossmann fold domain not the DNA linker.

      1. Figure 4 needs a more complete legend, indicating that it is a hybrid of the consensus structure (one color) and the MD simulations (another color). In general, the colors used in the figure should be changed to make the main points more accessible.

      As there is a color code for the histones, changing colors might be confusing. The figure legend mentions that panels c, d and e are from MD simulations.

      Minor recommendations:

      1. Figures 2c, e, and f are not referenced in the text.

      We now referenced all figure panels in the text.

      1. Consider moving Supp. 5C to Fig. 2 as the models in that figure come from the CryoDRGN maps and not the consensus map.

      Supplemental Figure 5c show the DNA linker deviation upon SIRT6 binding from another angle. We prefer to keep it there.

      1.) Supp Fig 3 is labeled "ZnF-nucleosome" refinement, but this appears to come from Data Set #2 processing. The map might be labeled ZnF-nucleosome but then a mask should be shown that excludes the Rossman Fold. It is not clear if this is a focused refinement or just a 2.9 A map that was merged with the "Rossman-fold" map.

      We changed both supplemental figures accordingly.

      1. The orientation of Fig 2 b and e do not show the differences in these models as well as panels c and f. Panels b and e could be replaced with the 4 CryoDRGN maps.

      The models reflect the cryoDRGN maps and panels c and f were added to clarify the movement.

      1. The MD description should emphasize that the H3 tails are moving with respect to the active site, as it currently suggests the active site is moving.

      In the results and in the discussion section we mention that we observe new conformations of the H3 tail, not of the active site.

      1. The authors refer to the "flexibility of the Rossmann fold domain," but the Rossman Fold domain isn't flexible, the linkage to the ZnF is flexible. Perhaps "observed conformational space" or "dynamic Rossman-fold domain position" are meant.

      The text was changed accordingly.

      1. The H2A C-terminal tail present in Fig 1 (bottom right) and Figure 3e is not present in the model in Fig 4a,b.

      The H2A tails conformation was not resolved in the cryoDRGN maps so we didn’t model it.

      1. The crosslinking agent used is not specified.

      The crosslinking agent used is specified more clearly in the methods.

      1. Supp Table 1 and EM methods do not agree on the magnification for Dataset #1. Verify nominal versus binned magnification and reported pixel size.<br /> The magnification in the methods was changed.

      2. Fig 3F showing the difference between affinity for H2A and H2A.Z-containing nucleosomes would be more convincing with a titration rather than the current comparison of a single concentration.

      We agree with this remark however, we find single concentration comparison is convincing enough for the purposes of this paper as it is not a central finding.

      1. Fig S1 legend; both the Zn-finger and helix bundle are stated to be shown in green.

      Figure S1 legend was changed.

    1. Author Response

      The following is the authors’ response to the original reviews.

      Response to Reviewers:

      Thank you for taking the time to review our manuscript and provide us with helpful comments. Your comments enabled us to improve the clarity of the manuscript, in particular:

      1. We improved the organization of the figures by associating each supplemental figure with a main-text figure using the eLife “figure supplements” format.

      2. We reduced the length of figure captions where possible.

      3. We improved organizational clarity by adding a brief organizational summary statement at the beginning of the results section which outlines the contents of the results subsections in the context of the introduction. We took particular care to use the same language, so the parallelism is clearer.

      4. In addition, we made various modifications to the main text to improve clarity for the reader. For this we asked specific help of our biologist co-authors to indicate which aspects would benefit from further clarification to enable the broad biology readership of eLife to comprehend our research better.

      Reviewer #1 (Public Review):

      The authors sought to resolve the coordinated functions of the two muscles that primarily power flight in birds (supracoracoideus and pectoralis), with particular focus on the pectoralis. Technology has limited the ability to resolve some details of pectoralis function, so the authors developed a model that can make accurate predictions about this muscle's function during flight. The authors first measured aerodynamic forces, wing shape changes, and pectoralis muscle activity in flying doves. They used cutting-edge techniques for the aerodynamic and wing shape measurements and they used well-established methods to measure activity and length of the pectoralis muscle. The authors then developed two mathematical models to estimate the instantaneous force vector produced by the pectoralis throughout the wing stroke. Finally, the authors applied their mathematical models to other-sized birds in order to compare muscle physiology across species.

      The strength of the methods is that they smoothly incorporate techniques from many complementary fields to generate a comprehensive model of pectoralis muscle function during flight. The high-speed structured-light technique for quantifying surface area during flight is novel and cutting-edge, as is the aerodynamic force platform used. These methods push the boundaries of what has historically been used to quantify their respective aspects of bird flight and their use here is exciting. The methods used for measuring muscle activation and length are standard in the field. Together, these provide both a strong conceptual foundation for the model and highlight its novelty. This model allows for estimations of muscle function that are not feasible to measure in live birds during flight at present. The weakness of this approach is that it relies heavily on a series of assumptions. While the research presented in this paper makes use of powerful methods from multiple fields, those methods each have assumptions inherent to them that simplify the biological system of study. This reduction in the complexity of phenomena allows the specific measurements to be made. In joining the techniques of multiple fields to study the greater complexity of the phenomenon of interest, the assumptions are all incorporated also. Furthermore, assumptions are inherent to mathematical modeling of biological phenomena. That being said, the authors acknowledge and justify their assumptions at each step and their model seems to be quite good at predicting muscle function.

      Indeed, the authors achieve their aims. They effectively integrate methods from multiple disciplines to explore the coordination and function of the pectoralis and supracoracoideus muscles during flight. The conclusions that the authors derive from their model address the intended research aim.

      The authors demonstrate the value of such interdisciplinary research, especially in studying complex behaviors that are difficult or infeasible to measure in living animals. Additionally, this work provides predictions for muscle function that can be tested empirically. These methods are certainly valuable for understanding flight but also have implications for biologists studying movement and muscle function more generally.

      Thank you for your thorough and positive review. We appreciate that you read our manuscript carefully and gave detailed feedback.

      Recommendations For The Authors:

      I thought that your manuscript was very interesting and your integration of techniques from multiple fields was effective. You address the weaknesses I highlighted in the public review well throughout the manuscript.

      Thank you for your well-measured feedback on this weakness and how we addressed it.

      I sometimes found that the manuscript was difficult to follow. With the interdisciplinary nature of your work, your manuscript has a lot of complexity. Your introduction is clear and I think that the last paragraph outlines your study very well. In the subsequent sections, the sub-headings are helpful, but I think your manuscript could be improved by indicating where those subsections fit into the phases you outline in your introduction (namely, muscle function, kinematics and aerodynamics, and mathematical modeling).

      Complied: throughout the manuscript we made modifications to improve the clarity. We also added a brief organizational summary statement at the beginning of the results section which outlines the contents of the results section in the context of the language introduced in the introduction. Finally, we reorganized the supplemental figures into eLife’s favored format of “figure supplements”, so that each extra figure is now associated with a figure in the main text. This should help the reader access information in an easier, hierarchical manner.

      Reviewer #2 (Public Review):

      In this work, the authors investigated the pectoralis work loop and the function of the supracoracoideus muscle in the down stroke during slow flight in doves. The aim of this study was to determine how aerodynamic force is generated, using simultaneous high-speed measurements of the wings' kinematics, aerodynamics, and activation and strain of pectoralis muscles during slow flight. The measurements show a reduction in the angle of attack during mid-downstroke, which induces a peak power factor and facilitates the tensioning of the supracoracoideus tendon with pectoralis power, which then can be released in the up-stroke. By combining the data with a muscle mechanics model, the timely tuning of elastic storage in the supracoracoideus tendon was examined and showed an improvement of the pectoralis work loop shape factor. Finally, other bird species were integrated into the model for a comparative investigation.

      The major strength of the methods is the simultaneous application of four high-speed techniques - to quantify kinematics, aerodynamics and muscle activation and strain - as well as the implementation of the time-resolved data into a muscle mechanics model. With a thorough analysis which supports the conclusions convincingly, the authors achieved their goal of reaching an improved understanding of the interplay of the pectoralis and supracoracoideus muscles during slow flight and the resulting energetic benefits.

      Thank you for your helpful and positive review. We appreciate that you summarized our manuscript accurately in a way that can help the reader.

      Recommendations For The Authors:

      The manuscript is very detailed and appears a bit long, including all the supplementary materials. It seems that the manuscript could easily have been separated into several publications, especially the comparative investigation including other extant bird species into the new model could have been a separate publication. This would have reduced the length of the supplements.

      Thank you for your feedback on our manuscript; we made numerous improvements to improve the readability. Hence, we decided to not cut the supplement short or split it into more papers. We chose eLife because we wanted to publish this study in one complete manuscript. This has three benefits: (1) The reader can find all information in one well-edited paper at one publisher that is open-access and high-quality. (2) The first author works in industry and gets no benefits from publishing multiple papers, and hence he opted to publish one with support of the author team. (3) The senior author is not interested in fragmented publishing. Rather, he writes fewer, more comprehensive integrative papers because that is ultimately more informative for the reader: one trusted published source has all that is important to know based on this completed research project. Overall, we weren’t able to find technical information that shouldn't go in the paper using the lens of reproducibility, so the supplement is relatively long. Combining three methods (kinematics, forces, muscles), of which two are only available in the senior author’s lab, and extensive math (two new integrative models plus scaling laws) requires sharing the information needed for replication for all approaches we combine.

      Also, some figure captions are very long and some of the content might have been included in the main text.

      Complied: thank you for helping us streamline the captions. We reviewed all the figure captions and removed material that is repeated in the main text, but not essential to understanding the figures. However, because of the length of the manuscript and our desire to make the manuscript readable and clear, we left all other text in the captions intact so they remain readable independently of the main text. This way, the reader does not have to go searching for information in the main text just to make sense of the figures. This is especially important because readers often read the figures first before deciding if they want to read the main text completely. In addition, we moved two panels from Figure 2 into its associated figure supplement, because it was not a main point in the text, and hence this helped reduce the length of the caption in figure 2.

    1. Author Response

      The authors wish to thank the Reviewers for valuable and constructive comments that will help up improve the paper’s quality.

      Public Reviews:

      Reviewer #1 (Public Review):

      Summary:

      This manuscript builds upon the authors' previous work on the cross-talk between transcription initiation and post-transcriptional events in yeast gene expression. These prior studies identified an mRNA 'imprinting' phenomenon linked to genes activated by the Rap1 transcription factor (TF), a surprising role for the Sfp1 TF in promoting RNA polymerase II (RNAPII) backtracking, and a role for the non-essential RNAPII subunits Rpb4/7 in the regulation of mRNA decay and translation. Here the authors aimed to extend these observations to provide a more coherent picture of the role of Sfp1 in transcription initiation and subsequent steps in gene expression. They provide evidence for (1) a physical interaction between Sfp1 and Rpb4, (2) Sfp1 binding and stabilization of mRNAs derived from genes whose promoters are bound by both Rap1 and Sfp1 and (3) an effect of Sfp1 on Rpb4 binding or conformation during transcription elongation.

      Strengths:

      This study provides evidence that a TF (yeast Sfp1), in addition to stimulating transcription initiation, can at some target genes interact with their mRNA transcripts and promote their stability. Sfp1 thus has a positive effect on two distinct regulatory steps. Furthermore, evidence is presented indicating that strong Sfp1 mRNA association requires both Rap1 and Sfp1 promoter binding and is increased at a sequence motif near the polyA track of many target mRNAs. Finally, they provide compelling evidence that Sfp1-bound mRNAs have higher levels of RNAPII backtracking and altered Rpb4 association or conformation compared to those not bound by Sfp1.

      Weaknesses:

      The Sfp1-Rpb4 association is supported only by a two-hybrid assay that is poorly described and lacks an important control. Furthermore, there is no evidence that this interaction is direct, nor are the interaction domains on either protein identified (or mutated to address function).

      Indeed, our two hybrid, immunoprecipitation and imaging results do not allow us to conclusively discern whether the interaction between Rpb4 and Sfp1 is direct or indirect. While the interaction holds significance, we consider the direct versus indirect distinction to be of secondary importance in the context of this paper. We intend to give more attention to this matter in our revised paper. In addition, we will make an effort to investigate an in vitro interaction between Sfp1 and Rpb4 by employing purified Sfp1 and Rpb4 proteins.

      The contention that Sfp1 nuclear export to the cytoplasm is transcription-dependent is not well supported by the experiments shown, which are not properly described in the text and are not accompanied by any primary data.

      We note that this assay has been developed and published in prior research by Lee, M. S., M. Henry, and P. A. Silver. (G&D, 1996) and was reported in a number of subsequent papers. Reassuringly, our conclusion is supported by the observation that Sfp1 binds to Pol II transcripts co-transcriptionally suggesting that Sfp1 is exported in the context of the mRNA.

      The presence of Sfp1 in P-bodies is of unclear relevance and the authors do not ask whether Sfp1-bound mRNAs are also present in these condensates.

      In the revised paper, we will indicate that we do not know whether RP mRNAs are present in the actual foci shown in Fig. 1B.

      Further analysis of Sfp1-bound mRNAs would be of interest, particularly to address the question of whether those from ribosomal protein genes and other growth-related genes that are known to display Sfp1 binding in their promoters are regulated (either stabilized or destabilized) by Sfp1.

      Fig. 4A, C and D show that RP mRNAs become destabilized in sfp1Δ cells.

      The authors need to discuss, and ideally address, the apparent paradox that their previous findings showed that Rap1 acts to destabilize its downstream transcripts, i.e. that it has the opposite effect of Sfp1 shown here.

      We would like to thank Reviewer 1 for this valuable comment. In the revised paper, we will delve into our hypothesis suggesting that Rap1 is likely responsible for regulating the imprinting of other proteins, that, in turn, lead to the destabilization of mRNAs, such as Rpb4.

      Finally, recent studies indicate that the drugs used here to measure mRNA stability induce a strong stress response accompanied by rapid and complex effects on transcription. Their relevance to mRNA stability in unstressed cells is questionable.

      Half-lives were determined mainly by the GRO analysis of optimally proliferating cells. This method does not requires any drug or stressful treatment. The results obtained by this method were consistent with the those obtained after thiolutin addition. Nevertheless, in our revised manuscript, we plan to supplement the half-life data with results obtained by subjecting cells to a temperature shift to 42°C, a natural method to block transcription in wild-type (WT) cells. This approach to determine half-lives has been previously reported in our publications, such as Lotan et al. (2005, 2007) and Goler Baron et al. (2008). This may rule out effects of the drug on halfe-life.

      Reviewer #2 (Public Review):

      Summary:

      The manuscript by Kelbert et al. presents results on the involvement of the yeast transcription factor Sfp1 in the stabilisation of transcripts whose synthesis it stimulates. Sfp1 is known to affect the synthesis of a number of important cellular transcripts, such as many of those that code for ribosomal proteins. The hypothesis that a transcription factor can remain bound to the nascent transcript and affect its cytoplasmic half-life is attractive, but the methods used to demonstrate the half-life effects and the association of Sfp1 with cytoplasmic transcripts remain to be fully validated, as explained in my comments on the results below:

      Comments on methodology and results:

      1. A two-hybrid-based assay for protein-protein interactions identified Sfp1, a transcription factor known for its effects on ribosomal protein gene expression, as interacting with Rpb4, a subunit of RNA polymerase II. Classical two-hybrid experiments depend on the presence of the tested proteins in the nucleus of yeast cells, suggesting that the observed interaction occurs in the nucleus. Unfortunately, the two-hybrid method cannot determine whether the interaction is direct or mediated by nucleic acids.

      Please see our response to comment 1 of Reviewer 1.

      1. Inactivation of nup49, a component of the nuclear pore complex, resulted in the redistribution of GFP-Sfp1 into the cytoplasm at the temperature non-permissive for the nup49-313 strain, suggesting that GFP-Sfp1 is a nucleo-cytoplasmic shuttling protein. This observation confirmed the dynamic nature of the nucleo-cytoplasmic distribution of Sfp1. For example, a similar redistribution to the cytoplasm was previously reported following rapamycin treatment and under starvation (Marion et al., PNAS 2004). In conjunction with the observation of an interaction with Rpb4, the authors observed slower nuclear import kinetics for GFP-Sfp1 in the absence of Rpb4 when cells were transferred to a glucose-containing medium after a period of starvation. Since the redistribution of GFP-Sfp1 was abolished in an rpb1-1/nup49-313 double mutant, the authors concluded that Sfp1 localisation to the cytoplasm depends on transcription. The double mutant yeast cells may show a variety of non-specific effects at the restrictive temperature, and whether transcription is required for Sfp1 cytoplasmic localisation remains incompletely demonstrated.

      We concur with Reviewer 2 that any heat inactivation of a temperature-sensitive (ts) protein can result in non-specific effects. In the instance of rpb1-1, these non-specific effects are anticipated because of the transcriptional arrest, which can eventually lead to a reduction in protein content. However, it is worth noting that this process takes some time, whereas the impact on export is more rapid. We note that that this assay has been developed and published in prior research by Pam Silver (op. cit.) and was reported in a number of subsequent papers. Reassuringly, our conclusion is supported by the observation that Sfp1 binds to Pol II transcripts co-transcriptionally.

      1. Under starvation conditions, which led to the presence of Sfp1 in the cytoplasm and have previously been correlated with a decrease in the transcription of Sfp1 target genes, the authors observed that a plasmid-based expressed GFP-Sfp1 accumulated in cytoplasmic foci. These foci were also labelled by P-body markers such as Dcp2 and Lsm1. The quality of the microscopic images provided does not allow to determine whether Rpb4-RFP colocalises with GFP-Sfp1.

      The submitted PDF figure is of low quality. We believe that high quality figure will be convincing.

      1. To understand to which RNA Sfp1 might bind, the authors used an N-terminally tagged fusion protein in a cross-linking and purification experiment. This method identified 264 transcripts for which the CRAC signal was considered positive and which mostly correspond to abundant mRNAs, including 74 ribosomal protein mRNAs or metabolic enzyme-abundant mRNAs such as PGK1. The authors did not provide evidence for the specificity of the observed CRAC signal, in particular, what would be the background of a similar experiment performed without UV cross-linking. In a validation experiment, the presence of several mRNAs in a purified SFP1 fraction was measured at levels that reflect the relative levels of RNA in a total RNA extract. Negative controls showing that abundant mRNAs not found in the CRAC experiment were clearly depleted from the purified fraction with Sfp1 would be crucial to assessing the specificity of the observed protein-RNA interactions. The CRAC-selected mRNAs were enriched for genes whose expression was previously shown to be upregulated upon Sfp1 overexpression (Albert et al., 2019). The presence of unspliced RPL30 pre-mRNA in the Sfp1 purification was interpreted as a sign of co-transcriptional assembly of Sfp1 into mRNA, but in the absence of valid negative controls, this hypothesis would require further experimental validation.

      We argue that the 264 CRAC+ genes represent a distinct group with many unique features. Moreover, many CRAC+ genes do not fall into the category of highly transcribed genes.

      The biological significance of the 264 CRAC+ mRNAs was demonstrated by various experiments; all are inconsistent with technical flaws. Some examples are:

      1. Fig. 2a and B show that most reads of CRAC+ mRNA were mapped to specific location – close the pA sites.
      2. Fig. 2C shows that most reads of CRAC+ mRNA were mapped to specific RNA motif.

      3. Most RiBi CRAC+ promoter contain Rap1 binding sites (p= 1.9x10-22), whereas the vast majority of RiBi CRAC- promoters do not contain Rap1 binding site. (Fig. 3C).

      4. Fig. 4A shows that RiBi CRAC+ mRNAs become destabilized due to Sfp1 deletion, whereas RiBi CRAC- mRNAs do not. Fig. 4B shows similar results due to

      5. Fig. 6B shows that the impact of Sfp1 on backtracking is substantially higher for CRAC+ than for CRAC- genes. This is most clearly visible in RiBi genes.

      6. Fig. 7A shows that the Sfp1-dependent changes along the transcription units is substantially more rigorous for CRAC+ than for CRAC-.

      7. Fig. S4B Shows that chromatin binding profile of Sfp1 is different for CRAC+ and CRAC- genes

      Moreover, only a portion of the RiBi mRNAs binds Sfp1, despite similar expression of all RiBi.

      Most importantly, these genes do not all fall into the category of highly transcribed genes. On the contrary, as depicted in Figure 6A (green dots), it is evident that CRAC+ genes exhibit a diverse range of Rpb3 ChIP and GRO signals. Furthermore, as illustrated in Figure 7A, when comparing CRAC+ to Q1 (the most highly transcribed genes), it becomes evident that the Rpb4/Rpb3 profile of CRAC+ genes is not a result of high transcription levels. In our revised paper, we will give increased attention to this matter in the Discussion section.

      1. To address the important question of whether co-transcriptional assembly of Spf1 with transcripts could alter their stability, the authors first used a reporter system in which the RPL30 transcription unit is transferred to vectors under different transcriptional contexts, as previously described by the Choder laboratory (Bregman et al. 2011). While RPL30 expressed under an ACT1 promoter was barely detectable, the highest levels of RNA were observed in the context of the native upstream RPL30 sequence when Rap1 binding sites were also present. Sfp1 showed better association with reporter mRNAs containing Rap1 binding sites in the promoter region. However, removal of the Rap1 binding sites from the reporter vector also led to a drastic decrease in reporter mRNA levels. Whether the fraction of co-purified RNA is nuclear and co-transcriptional or not cannot be inferred from these results.

      The proposed co-transcriptional binding of Sfp1 is based on the findings presented in Figure 5C and Figure S2D, as well as the observed binding of Sfp1 to transcripts containing introns, as shown in Figures 2D and 3B. Our conclusion, which we still uphold, was drawn from the results presented in Figure 3. These results led us to the assertion that the "RNA-binding capacity of Sfp1 is regulated by Rap1-binding sites located at the promoter." We maintain our stance on this conclusion. Indeed, the Rap1 binding site does impact mRNA levels, as highlighted by Reviewer 2. However, "construct E," which possesses a promoter with a Rap1 binding site, exhibits lower transcript levels compared to "construct F," which lacks such a binding site in its promoter. Despite this difference in transcript levels, Sfp1 was able to pull down the former transcript but not the latter, even though expression of the former gene is relatively low. Thus, the results appear to be more reliant on the specific capacity of Sfp1 to interact with the transcript rather than on the transcript's expression level.

      1. To complement the biochemical data presented in the first part of the manuscript, the authors turned to the deletion or rapid depletion of SFP1 and used labelling experiments to assess changes in the rate of synthesis, abundance, and decay of mRNAs under these conditions. An important observation was that in the absence of Sfp1, mRNAs encoding ribosomal protein genes not only had a reduced synthesis rate but also an increased degradation rate. This important observation needs careful validation, as genomic run-on experiments were used to measure half-lives, and this particular method was found to give results that correlated poorly with other measures of half-life in yeast (e.g. Chappelboim et al., 2022 for a comparison). Similarly, the use of thiolutin to block transcription as a method of assessing mRNA half-life has been reported to be problematic, as thiolutin can specifically inhibit the degradation of ribosomal protein mRNA (Pelechano & Perez-Ortin, 2008). Specific repressible reporters, such as those used by Baudrimont et al. (2017), would need to be tested to validate the effect of Sfp1 on the half-life of specific mRNAs. Also, it would be very difficult to infer from the images presented whether the rate of deadenylation is altered by Sfp1.

      Various methods exist for assessing mRNA half-lives (HLs), and each of them carries its own set of challenges and biases. Consequently, it becomes problematic to directly compare HL values of a specific mRNA when different methods are employed. The superiority of one particular method over others remains unclear. However, they all exhibit a high degree of reliability when it comes to comparing different strains under the identical conditions using a single method.

      Estimating half-lives through the GRO approach is a non-invasive method, applied on optimally proliferating cells, which has been employed in numerous publications. While no method is without its limitations, we consider this approach to be among the most dependable. Our HL determination using thiolutin to block transcription provided results that were consistent with the values obtained by the GRO approach.

      Nevertheless, in our revised manuscript, we plan to supplement the HL data, obtain by thiolutin, with results obtained by subjecting cells to a temperature shift to 42°C, a natural method to block transcription in wild-type (WT) cells. This approach to determine HLs has been previously reported in our publications, such as Lotan et al. (2005, 2007) and Goler Baron et al. (2008).

      1. The effects of SFP1 on transcription were investigated by chromatin purification with Rpb3, a subunit of RNA polymerase, and the results were compared with synthesis rates determined by genomic run-on experiments. The decrease in polII presence on transcripts in the absence of SFP1 was not accompanied by a marked decrease in transcript output, suggesting an effect of Sfp1 in ensuring robust transcription and avoiding RNA polymerase backtracking. To further investigate the phenotypes associated with the depletion or absence of Sfp1, the authors examined the presence of Rpb4 along transcription units compared to Rpb3. One effect of spf1 deficiency was that this ratio, which decreased from the start of transcription towards the end of transcripts, increased slightly. The results presented are largely correlative and could arise from the focus on very specific types of mRNAs, such as those of ribosomal protein genes, which are sensitive to stress and are targeted by very active RNA degradation mechanisms activated, for example, under heat stress (Bresson et al., 2020).

      Figure 7A illustrates a significant reduction in Rpb4/Rpb3 ratios along the transcription unit in WT cells. This reduction is notably more pronounced in CRAC+ genes compared to the highly transcribed quartile (Q1), which includes all ribosomal protein (RP) genes, and it is completely absent in sfp1∆ cells. Furthermore, it's important to highlight that the CRAC+ gene group displays a wide range of transcription rates, as measured by either Rpb3 ChIP or GRO (Figure 6A). Given these observations, it is challenging to reconcile how the heightened sensitivity of RP mRNA degradation in response to stress could account for the more pronounced differences in the configuration of the Pol II elongation complex that are detected in CRAC+ genes under standard culture conditions in wt cells.

      Correlative studies are particularly informative when a gene mutation eliminates a correlation, and this is precisely the type of study depicted in Figure 7B-C. The configuration of elongating Pol II (as reflected by Rpb4/Rpb3 ratios) and the backtracking index are both transcriptional outputs. It is difficult to envision how stress-induced destabilization of RP mRNAs could explain the twofold higher correlation between these two parameters observed in CRAC+ genes under non-stressful conditions in WT cells (Figure 7B).

      Furthermore, it's worth noting that in WT cells, CRAC+ genes did not display any apparent unusual destabilization, but rather exhibited higher (not lower) mRNA stability compared to CRAC- genes (Figure 7C).

      Strengths: - Diversity of experimental approaches used - Validation of large-scale results with appropriate reporters

      Weaknesses: - Choice of evaluation method to test mRNA half-life - Lack of controls for the CRAC results

    1. Author Response

      The following is the authors’ response to the original reviews.

      Reviewer #1 (Recommendations For The Authors):

      Weaknesses: One minor weakness in this study is the conclusion that the guide RNAs didn't seem to have unique effects on GnRH cFos expression or the reproductive phenotypes. Though the data indicate a 60-70% knockdown for both gRNA2 and gRNA3, 3 of the 4 gRNA2 mice had no cFos expression in GnRH neurons during the time of the LH surge, whereas all mice receiving gRNA3 had at least some cFos/GnRH co-expression. In addition, when mice were re-categorized based on reduction (>75%) in kisspeptin expression, most of the mice in the unilateral or bilateral groups received gRNA2, whereas many of the mice that received gRNA3 were in the "normal" group with no disruption in kisspeptin expression. Thus, additional experiments with increased sample sizes are needed, even if the efficacy of the ESR1 knockdown was comparable before concluding these 2 gRNAs don't result in unique reproductive effects.

      Response: A draw back of the CRISPR approach is the substantial mosaicism in gene knockdown that is unavoidable due to the nature of DNA repair in each cell relying on several competing pathways. As such, variable knockdown occurs in each mouse as shown in Fig.1C. In the case of the correlation between RP3V ESR1 knockdown and cFos in GnRH neurons (Fig.4C), three gRNA3 and four 4 gRNA2 mice look to be very similar with two gRNA3 mice having knockdown but normal cFos activation. The reasons for this are not known and it is very likely chance that these two (of nine) mice happened to have received gRNA3. This issue becomes exacerbated when animal group numbers unintentionally become smaller with the re-grouping on the basis of kisspeptin expression. The key point here is that each “kisspeptin grouping” remains mixed in terms of gRNA2 and gRNA3 mice so that gRNA3 mice did contribute to the “bilateral group” even if it was only one of four mice. The practicalities of repeating this work are substantial and we do not think justified. We would note that we have previously used Kiss-Cre mice to undertake CRISPR knockdown of ESR1 in RP3V kisspeptin neurons but this failed to target sufficient cells with Cas9 to be experimentally useful.

      In Figure 2B (gRNA2), there appear to be 4 mice (4 lines) that have a normal cycle length and then drop to 0 for the cycle length. However, in the Figure legend, it states that there were 3 gRNA2 mice that had a cycle length of 0. Can the authors clarify if it was 4 mice (as indicated in Figure 2B) or 3 mice (as indicated in the legend) that received gRNA2 and exhibited constant estrus?

      Response: We have now clarified in the text that 3 gRNA2 mice went into constant estrus, the other mouse was in constant diestrus, also scored as “0” cycles.

      In Figure 3H, there is one green data point that has an LH level of around 0.15 and % VGAT with ESR1 around 10%. However, that data point does not appear in Figures 3I and 3J, when you would expect it to be in a similar place (~10%) on the x-axis in those Figures. Was it excluded? If so, please elaborate on the justification for excluding that data point. Response: This was one of the three mice that exhibited no LH pulses so we were only able to report on mean LH levels.

      Similarly, in Figure 3K, there is a blue data point that is almost at 0 for both the x-axis and the y-axis. However, that data point does not show up in Figures 3L and 3M around 0 on the x-axis as you would expect. Can the authors clarify where this data point went in Figures 3L and 3M?

      Response: This was one of the three mice that exhibited no LH pulses so we were only able to report on mean LH levels.

      Reviewer #2 (Recommendations For The Authors):

      Finally, the study leaves unanswered the role of GABA itself. As there was no evident phenotype for the ESR1 knockdown in GABA neurons that do not coexpress kisspeptin, this suggests that GABA neurotransmission in the preoptic area is not involved in the estrogen regulation of LH secretion.

      Response: The current evidence for no substantial role of GABA from RP3V neurons in the LH surge agrees with our prior in vivo work showing that low frequency optogenetic stimulation of RP3V kisspeptin neurons (only GABA release) has no impact on LH secretion (doi: 10.1523/JNEUROSCI.0658-18.2018).

      1. Title. The present data do not clearly demonstrate the blockade of the LH surge. Thus, the statement that "abolishes the preovulatory surge" is an overinterpretation of the findings.

      Response: We agree and now use “suppresses the preovulatory surge”.

      1. Fig. 3. The numbers of individual data points per group change for the different LH pulse parameters, but they should not (Fig. 3 E-G).

      Response: This occurs because one mouse in each group had no LH pulses so that only a mean value was available for these mice.

      1. Fig. 4. (4B) The use of only one terminal blood collection (4B) is insufficient to comprehensively characterize the LH surge. It is not possible to conclude what was the actual effect on the LH surge, whether a blockade or altered amplitude or timing. Serial blood samples at 30- or 60-minute intervals should be used. For comparative purposes, the pulsatile LH secretion, which does not seem to be a major outcome in the study, was fully characterized (Fig. 3). (4C) The linear correlation between c-Fos/GnRH and RP3V/ESR1 appears to be well-fitted for gRNA2 (blue) but not gRNA3 (green). Although this is interpreted as an important result of the study, its description and consistency are not so clear. Authors should perform an Anova/ Kruskal-Wallis analysis of these data as a column graph (as in Fig. 4A, B) and discuss the discrepancies between gRNA2 and gRNA3.

      Response: As noted in the manuscript, we agree that a single point LH measurement is a relatively inaccurate assessment of the LH surge and very likely underlies much of the substantial variability between mice. However, the extended duration of cFos expression in GnRH neurons at the time of the surge is a much more accurate “single point” indicator and we feel that these results better reflect the state of surge activation. This was noted in the original manuscript.

      The linear correlations for the different preoptic regions are undertaken on the complete data set not on individual gRNA groups due to low N numbers in the sub-divided groups. However, column graphs of the RP3V and MPN look the same as Fig.4A and would not change the current interpretation. Please see comments to Reviewer 1 on discrepancies between gRNA2 and 3.

      1. Table. It is unclear why the % VGAT with ESR1 was not statistically reduced in the "bilateral" animals. Would this mean that the ESR1 knockdown was not effective in this subgroup with the more consistent effects?

      Response: Yes, this would be a reasonable interpretation suggesting that mice with kisspeptin ablation may have had a slightly different overall impact on ESR1 in VGAT neurons. However, this was not discernable from examining the anatomical distribution of AAV.

      1. Discussion 1st paragraph. It is interpreted that mice lacking kisspeptin expression "failed to exhibit an LH surge". This should be revised.

      Response: We believe that this is a correct statement. Mice lacking kisspeptin had LH surge values between 0.8 and 2.1 ng/ml that we would not consider consistent with being a surge.

      1. Immunohistochemistry. It is not clear in the text how a cross-reaction between goat antirabbit 568 (ERa) and goat antirabbit/streptavidin 647 (mChery) was avoided when used in the same reaction.

      Response: We were forced into this option due to the lack of different primary antisera to ESR1 and mCherry. We first stained for rabbit ESR1 detected by biotin anti-rabbit/ strep647 which resulted in confined nuclear staining (pseudo-blue; far red). The subsequent staining for rabbit mCherry was detected by goat anti-rabbit 568 that will indeed cross-react by binding to any free epitopes on the rabbit ESR1 primary antibody. However, this would not compromise interpretation as additional 568 labelling to the nucleus is essentially irrelevant when examining far red 647 nm emission and only mCherry cytoplasmic immunoreactivity was used to define the anatomical locations of the AAV spread. This is now clearly explained in the Methods section.

      1. Statistical analysis. It is unclear when repeated measures Wilcoxon tests were used in the manuscript.

      Response: Thank you for pointing this out. Only Wilcoxon paired test were used. Amended.

      1. Data Availability. Further reference to supplementary information files was not found in the manuscript.

      Response: A supplementary file with individual data for each mouse is now attached.

      Reviewer #3 (Recommendations For The Authors):

      Weaknesses:

      One aspect for which I have ambiguous feelings is the minimal level of detail regarding the HPG axis and its regulation by estrogens. This limited amount of detail allows for an easy read with the well-articulated introduction quickly presenting the framework of the study. Although not presenting the axis itself nor mentioning the position of GnRH neurons in this axis or its lack of ERα expression is not detrimental to the understanding of the study, presenting at least the position of GnRH neurons in the axis and their critical role for fertility would likely broaden the impact of this work beyond a rather specialist audience.

      Response: We agree that this would provide a more complete picture and have modified the Introduction.

      The expression of kisspeptin constitutes a key element for the analysis and conclusion of the present work. However, the quality of the kisspeptin immunostaining seems suboptimal based on the representative images. The staining primarily consists of light punctuated structures and it is very difficult to delineate cytoplasmic immunoreactive material defining the shape of neurons in LacZ animals. For some of the cells marked by an arrow, it is also sometimes difficult to determine whether the staining for ESR1 and Kp are in the same focal plane and thus belong to the same neurons. Although this co-expression is not critical for the conclusions of the study, this begs the question of whether Kp expression was determined directly at the microscope (where the focal plan can be adjusted) or on the picture (without possible focal adjustment). Moreover, in the representative image of Kp loss, several nuclei stained for fos (black) show superimposed brown staining looking like a dense nucleus (but smaller than an actual nucleus). This suggests some sort of condensed accumulation of Kp immunoproduct in the nucleus which is not commented. Given the critical importance of this reported change in Kp expression for the interpretation of the present results, it is important to provide strong evidence of the quality/nature of this staining and its analysis which may help interpret the observed functional phenotype.

      Response: The kisspeptin immunoreactivity represents both fiber and cytoplasmic staining that can be difficult to discern in some cases. The reviewer can be assured that all counts were undertaken “live” on the microscope so that the plane of focus was adjusted to establish co-labelling. Please note that the nuclear immunoreactivity is for ESR1 and not cFos. Regardless, we struggle to see condensed brown staining over the black nuclei as suggested by the Reviewer. The kisspeptin staining is light brown and confined to just a few fibers in Fig.5B.

      As acknowledged in the introduction, this study is not the first to use in vivo Crisp-Cas editing to demonstrate the role of kisspeptin neurons in the control of positive feedback. Although the present work achieved this indirectly by targeting VGAT neurons, I was surprised that the paper did not include more comparison of their results with those of Wang et al., 2019. In particular, why was the present approach more successful in achieving both lack of surge and complete acyclicity?

      Response: Wang et al., reported an ~60% reduction in ESR1 expression in Kiss1-Cre (Elias) driven Cas9-expressing cells in the AVPV. As they did not examine kisspeptin expression itself it is unknown to what degree their editing impacted upon kisspeptin neurons. The other differentiating factor was that Wang focussed on the AVPV that only contains a minority of the preoptic kisspeptin population whereas we targeted the AVPV and PeN together. Thus, we suspect that the Wang phenotype arises from insufficient ESR1 knockdown in just the AVPV sub-population of preoptic kisspeptin neurons. We have added a comment to the Discussion as requested.

      Moreover, why is it that targeting ESR1 in a selected fraction of GABAergic neurons can lead to a near-complete absence of Kp expression in this region? This is briefly discussed in the penultimate paragraph but mostly focuses on the non-kisspeptinergic GABA neurons rather than those co-expressing the two markers.

      Response: We have modified this section to try and make it clear that it is very likely that all RP3V kisspeptin neurons would have been targeted to express Cas9 in this mouse model. Our very recent unpublished RNA scope data show that >80% of RP3V kisspeptin neurons express Vgat mRNA in adult mice.

      • Unless I have missed it, the target sequence of the guide RNAs is not mentioned. For reproducibility purposes and to allow comparison with Wang et al., 2019, this information should be provided.

      Response: The target sequences for gRNA2 and gRNA3 were around exon 3 and are provided in the Supplementary files of McQuillan et al., 2022 (https://doi.org/10.1038/s41467-022-35243-z). The Wang et al study used the unusual strategy of designing sense and antisense gRNAs against the same sequence in Exon1.

      • The first result section is devoted to the design and validation of the guide RNA reports data that were recently published (McQuillan et al., 2022). It is actually acknowledged that the design was reported previously but as written it is not clear whether the actual validation was already reported. This should be said more clearly.

      Response: Clarified as requested.

      • What was the rationale for choosing gRNA 2 and 3 and not 3 and 6 like in the McQuillan study?

      Response: As all three gRNAs worked equally well, the choice of 2 and 3 was entirely pragmatic and only based upon quantities of packaged AAVs that we had produced and were available at the time.

      • Introduction, 4th paragraph: It would be clearer if GABAa receptor dynamics was replaced by GABAa receptors mediated neurotransmission or any other verbiage avoiding possible confusion with receptor mobility.

      Response: Clarified as requested.

      • The section reporting the location of ESR1 knockdown is really clear about the number of animals included in the functional analyses. This is less clear for the number of mice involved in the evaluation of the extent of ESR1 knockdown in the previous section. Specifically, the text reports that 8 and 9 mice received gRNA3 in PVpo and MPN respectively, but the figure shows 7 and 8. This is likely explained by the mouse that was excluded due to normal ESR1 despite the correct positioning of the injection site. It is thus unclear whether this mouse was included in the calculation of the mean percentage of neurons reported in the previous page. Logically, this mouse should have been removed from this analysis and it is assumed that the sample size reported in the text is incorrect.

      Response: thank you for picking this up - you are correct. In reviewing this point we realized that the gRNA-lacZ RP3V N numbers also were incorrect and have re-analyzed the data set completely resulting in even stronger significance levels.

      • In the section « CRISPR knockdown ESR1 in RP3V GABA-kisspeptin neurons », the extent of ESR1 knockdown is expressed in a counterintuitive manner as « <20% » which is thought to represent the percentage of cells expressing ESR1 rather than the actual knockdown (>80%). This should be clarified.

      Response: Corrected as noted.

      • Page 6, 3rd line before the last paragraph, there is a mismatch between the highest p value reported in the text (0.242) and the value reported in the table (0.0242).

      Response: Corrected thank you.

      • Similar to presenting F values for ANOVAs, H values should also be presented for Kruskal Wallis tests.

      Response: Values have been added.

      • Immunohistochemistry : Origin and reference numbers of all primary antibodies should be reported as well as citation of studies where they have been validated. Although these protocols are standard, information regarding the duration of incubation is necessary to allow replication or for comparison purposes.

      Response: We have included the RRID numbers for each of these antisera and added information on incubation times.

      • The section on data availability mentions the existence of supplementary files, but I see none.

      Response: These have now been attached.

      • There are several typos or redundancies to be corrected. Here are a few examples but the manuscript should be carefully double-checked.

      Introduction, 3rd paragraph, line 4: upregulated

      Introduction, 4th paragraph, 4th line: « to » or « through » not both.

      Page 7, line 11 : Kruskal

      Page 7, 6th line to the end: does this indicate 'the' general utility?

      Page 8, 2nd paragraph, line 13: Crispr

      Response: Thank you for these edits.

    1. Author Response

      The following is the authors’ response to the original reviews.

      Reviewer #1 (Recommendations for the Authors):

      The authors provide their data and code via Github, and that shiny apps allow easy access to their data. However, spending a few minutes with the snRNAseq app I could not figure out how to search for individual genes (e.g. DBH) on their web interface. Some changes could help to make this app more user-friendly.

      While it was not possible to easily modify the user interface of the snRNA-seq app itself, we have instead added two additional supplementary figures displaying screenshots and schematics with sequential instructions that provide a short tutorial showing how to search for individual genes and display either spatial gene expression (for the Visium SRT data) or gene expression by cluster or population (for the snRNA-seq data) in each interactive web app (Figure 3-figure supplement 20-21). We hope this makes the apps more accessible and assists users to more easily query specific genes that they are interested in.

      The first sentence of the abstract and line 70 on page 2 need to be revised for language / grammar / clarity.

      We have revised these two sentences. Line 70 on page 2 contained a typo / copy-paste error. Thank you for pointing this out.

      Reviewer #2 (Recommendations For The Authors):

      While the efforts of the authors to identify NE neurons in the LC is appreciated, the data fall a little short of conclusively calling these neurons solely noradrenergic as there is an apparent lack of overlap between TH and SLC6A2 in the spots. Undoubtedly, some spots contain both which is consistent with the RNA scope results, but there is clearly a pattern that shows spots that don't contain both. It would be worth testing the presence of other catecholamines in some of these certain spots particularly dopamine (Kempadoo et al. 2016, Takeuchi et al., 2016, Devoto et al. 2005).

      We agree this is an important point. To more rigorously investigate whether TH is co-expressed within cells that produce other catecholamines, particularly dopamine (DA) in addition to norepinephrine (NE), we have included additional analyses of the snRNA-seq and Visium data, as well as generated additional RNAscope data in the revised manuscript, as follows.

      (i) We investigated the spatial expression of DA neuron marker genes besides TH, including SLC6A3 (encoding the dopamine transporter), ALDH1A1, and SLC26A7 in the Visium samples (Figure 3-figure supplement 15), which shows that these genes are not strongly expressed within the manually annotated LC regions in the Visium samples (see Figure 2-figure supplement 1).

      (ii) We investigated expression of DA neuron marker genes SLC6A3, ALDH1A1, and SLC26A7 in the snRNA-seq clustering (updated heatmap in Figure 3-figure supplement 8), which shows minimal expression of these genes within the NE neuron cluster (cluster 6).

      (iii) Despite the data above suggesting little expression of markers for DA neurons within the human LC, we wanted to investigate this question more thoroughly with an orthogonal method given that relatively lower coverage in the sequencing approaches may miss expression, particularly for more lowly expressed transcripts. We generated new high-resolution RNAscope smFISH images at 40x magnification for samples from 3 additional donors (Br8689, Br5529, and Br5426) showing expression of NE neuron marker genes (DBH and TH), a 5-HT neuron marker gene (TPH2), and a DA neuron marker gene (SLC6A3) within individual cells within the LC regions in these samples. Expression of SLC6A3 within individual NE neurons (identified by co-expression of DBH and TH) was not apparent in these RNAscope images (Figure 3-figure supplement 16).

      Together with the previous high-magnification RNAscope images showing co-expression of NE neuron marker genes (DBH, TH, and SLC6A2) within individual NE neurons (Figure 3-figure supplement 4), these new results further strengthen the conclusion that the observed TH+ cells we profiled in the LC are NE-producing neurons. In our view, the lack of observed co-expression of TH and SLC6A2 within some individual Visium spots is likely due to sampling variability and relatively lower sequencing coverage in the Visium data, rather than a true lack of co-expression. We have included additional text in the Results and Discussion further discussing this issue.

      Likewise, given the low throughput of RNA scope, and the fact that it was not done in a systematic manner, it does not conclusively identify the cell types in the region. It might be worth a systematic survey of the cells in the region with both NE and DA markers. Otherwise, it is suggested that the authors be more conservative with their annotations.

      As discussed above, we have now generated additional high-magnification RNAscope images for 3 independent donors (Br8689, Br5529, and Br5426), visualizing expression of two NE neuron marker genes (DBH and TH), one 5-HT neuron marker gene (TPH2), and one DA neuron marker gene (SLC6A3, encoding the dopamine transporter) within individual cells within the LC region in each sample (Figure 3-figure supplement 16). Expression of the DA neuron marker gene (SLC6A3) within individual NE neuron cell bodies (identified by co-expression of DBH and TH) was not apparent in these RNAscope images. Together with our previous RNAscope images showing co-expression of DBH, TH, and SLC6A2 within individual cells (Figure 3-figure supplement 4), in our view, these results provide strong evidence that the observed TH+ cells in the LC are NE-producing neurons, and the data do not provide supporting evidence for the existence of DA-synthesizing neurons in the human LC.

      For the manual annotation, it would be useful to include HE tissue images to better understand how the annotations were derived especially because the annotations are not well corroborated by the clustering.

      We have now included the H&E stained histology images for the Visium samples in Figure 2-figure supplement 2A, which can be compared with the previous figures showing the manual annotations for the LC regions (Figure 2-figure supplement 1). The histology images can also be viewed at higher resolution through the Shiny web app (https://libd.shinyapps.io/locus-c_Visium/).

      The unsupervised clustering is certainly contingent on the number of genes detected, which is in turn dependent on the quality of the material and the success of the experiment. It is unclear from the methods whether the samples were pooled for clustering. If they were pooled, the author might consider using only the samples with UMIs > 500. The low UMI may represent free-floating RNA, suggesting issues with tissue permeabilization in turn influencing the ability to confidently associate genes with spots. Sticking with the higher quality sample may improve the ability to perform unsupervised clustering.

      For the spot-level unsupervised clustering using BayesSpace, our aim was to demonstrate whether it is feasible to segment the LC and non-LC regions in the Visium samples in a data-driven manner using a spatial clustering algorithm, instead of relying on manual annotations. We performed clustering across samples (i.e. pooled) -- we have included additional wording in the text and figure caption to clarify this. We agree with the reviewer there may be further optimizations possible, such as filtering out spots or samples with low UMI counts. However, filtering out low-UMI spots may also confound the clustering if low-UMI spots are associated with biological signal (e.g. preferentially located in white matter regions).

      Overall, we found that applying data-driven methods such as BayesSpace to segment the LC and non-LC regions did not perform sufficiently to rely on for our downstream analyses (Figure 2-figure supplement 6), and, in our view, further incremental optimizations were unlikely to reach sufficient performance and robustness, so we chose to rely on the manual annotations instead. In addition, as noted in the Results, this avoids potentially inflated false discoveries due to issues of circularity when performing differential gene expression testing between regions defined by unsupervised clustering on the same sets of genes (Gao et al. 2022). We included the BayesSpace results (Figure 2-figure supplement 6) to provide information and ideas to method developers interested in using this dataset as a test case for further development of spatial clustering algorithms. However, further adapting or optimizing these spatial clustering algorithms ourselves was not within the scope of our current work.

      It is not entirely clear why the authors used FANS, especially with the scored tissue. Do the authors think this could have negatively influenced the capture of the desired cell type since FANS can compromise the integrity of the nuclei? In other words, have the authors considered that this may have resulted in a loss rather than enrichment? The proportion of "NE" neurons in the snRNA-Seq data is less than 2% in all cases and at its lowest in sample 6522 which does not correspond well with the proportion of tissue that was manually annotated as containing NE cells, even when taken into consideration the potential size difference of cells. In the same vein, in some samples, there are more "5-HT" neurons in the region than "NE" according to the numbers.

      As noted in our initial response to reviewers (“Response to Public Review Comments”), we used FANS to enrich for neurons based on our previous success with this approach to identify relatively rare neuronal populations in other brain regions (e.g. nucleus accumbens and amygdala; Tran and Maynard et al. 2021). Based on this previous work, our rationale was that without neuronal enrichment, we could potentially miss the LC-NE population, given the relative scarcity and low absolute number of this neuronal population (e.g. estimates of ~50K total in the entire human LC).

      We do not have a definitive answer to the question of whether our use of FANS to enrich for neurons may have led to damage and contributed to the low recovery rate of LC-NE neurons (as well as the relatively increased levels of mitochondrial contamination compared to other brain regions / preparations in the human brain in our hands). Due to our limited tissue resources for this study, we did not have sufficient tissue to perform a direct comparison with non-sorted data. However, we agree with the reviewer that this is plausible, and warrants further investigation in future work. In particular, the relatively large size and fragility of LC-NE neurons, as well as our use of a standard cell straining approach (70 µm, which may not be ideal for this population), may also be contributing factors.

      Systematically optimizing the preparation to attempt to increase recovery rate (and decrease mitochondrial contamination) are important avenues for future work, and we have decided to share our data and experiences now to assist other groups performing related work. We have included additional wording in the Discussion to further highlight these issues.

      The majority of the snRNA-seq remained unannotated "ambiguous" neurons. It would be highly advantageous to include an annotation for these numerous cells.

      These nuclei were unidentifiable due to ambiguous marker gene expression profiles, i.e. expression of pan-neuronal marker genes without clear expression of either excitatory or inhibitory neuronal marker genes (see Figure 3A and Figure 3-figure supplement 8). Since we were not able to clearly identify these clusters, and due to our additional concerns regarding the data quality (e.g. low recovery rate of the NE neuron population of interest, potential cell damage, and mitochondrial contamination), we decided to label these neuronal clusters as “ambiguous” instead of assigning low-confidence cluster labels. We have included additional wording in the Results section to explain this issue.

      The most likely explanation for identifying serotonergic neurons in these samples is the inclusion of the Raphe Nucleus within the dissection, especially since these cells do not map to the LC per se. As such, is there a way to neuroanatomically define the potential inclusion of this region from these tissue blocks used? Or to the contrary, definitively demonstrate the exclusion of the Raphe?

      As noted in our initial response to reviewers (“Response to Public Review Comments”), our dissection strategy in this initial study precluded the ability to keep track of the exact orientation of the tissue sections on the Visium arrays with respect to their location within the brainstem. Therefore, it is not possible to definitively answer the question of whether the dissections included the raphe nucleus, and if so, which portion of it, based on neuroanatomy from the tissue blocks.

      However, during the course of this study and in parallel, ongoing work for other small, challenging brain regions, we developed a number of specialized technical and logistical strategies for keeping track of orientation and mounting serial sections from the same tissue block onto a single spatial array, which is extremely technically challenging. We are now well-prepared for addressing these issues in future studies, e.g. keeping track of the orientation of the dissections and potential inclusion of adjacent neuroanatomical structures. We have included additional details on this issue in the Discussion.

      Given that one sample (Visium capture area) was excluded as it did not seem to contain a representation of the LC for the profiling of "NE" cells, does it make sense to include this sample in the analysis of 5HT cells given the authors are trying to make claims about the cell composition in and around the LC? Since there appears to be little 5HT contribution from this sample and its inclusion results in inconsistency across experiments and not any notable advantages, the authors might want to reconsider its inclusion in the results.

      We identified a cluster of 5-HT neurons in the snRNA-seq data (Figure 3) and used the Visium samples to further investigate the spatial distribution of this population (Figure 3-figure supplement 9). For the enrichment analyses in the Visium data (Figure 3-figure supplement 9C), we used only the 8 Visium samples that passed quality control (QC). We included the 9th sample (which did not pass QC) in the spot plot visualizations (Figure 3-figure supplement 9A-B) for completeness, but did not base our main conclusions on this sample (in this sample, the tissue resource was likely depleted during earlier sections, so the section for the Visium sample was taken slightly past the extent of the LC within this tissue block). We have included additional wording in the Results section and figure captions to clarify this issue.

      For the RNAscope images, it would be useful to include (draw) the manual annotation of the LC to facilitate interpretation. This is especially useful for demonstrating the separate populations of 5HT and "NE" cells. In general, it would be useful to keep a hashed line perimeter for all sections processed by Visium.

      We have now added a dashed outline indicating the manually annotated LC region in the RNAscope image showing the full tissue section (Figure 3-figure supplement 11). The high-magnification RNAscope images (Figure 3-figure supplement 4, 16, and 17) show regions entirely within the LC regions -- we have included additional wording to note this in the figure captions. For the Visium spot

      plots, we either labeled spots within the annotated regions within the figures or included additional wording in the figure captions to refer to the figures showing the annotations (Figure 2-figure supplement 1).

      The authors state that they successfully mapped the NE neuron population from snRNA-seq to the manually annotated regions on the Visium slides. Based on the color-coded map, these results are not very convincing since the abundance of the given transcript profile is extremely low. Here again, it would help to draw a hashed line perimeter on the slide to denote the manually annotated region. Perhaps the authors could try a different strategy for mapping snRNA signal to the slide? However, it appears that the mapping worked better for the capture areas with higher UMI/genes counts. Perhaps the authors should consider using only the slides with high gene/UMI counts.

      We agree that the performance of these analyses (Figure 3-figure supplement 14) was not clearly described in the previous version of the manuscript. We have rewritten the corresponding paragraph in the Results section to make it more clear that the mapping (spot-level deconvolution) performance was relatively poor overall, and that we did not use these results for further downstream analyses. We did however want to include these results from the cell2location algorithm to provide information and data for method developers on the challenges of these types of analyses in our dataset (e.g. due to the presence of rare populations, relatively subtle differences in expression profiles between neuronal subpopulations, and potential issues due to large nuclei size and high transcriptional activity for NE neurons). While further approaches for these types of analyses exist, and additional optimizations such as subsetting samples or spots with high UMI counts could also be investigated, in our view, these further optimizations lie outside the scope of our current work. We have also added wording in the figure caption to refer to Figure 2-figure supplement 1, which displays the corresponding annotated LC regions per sample.

      It is hard to see if the RNA scope image Supplementary Figure 11 shows co-localization of SLC6A2, TH, and DBH. Having the individual image from each microscope filter along with the merged image is required to properly assess the colocalization of the signals.

      We updated the multi-channel RNAscope images to show both the merged channels and individual channels in separate panels (Figure 3-figure supplement 4, 16, and 17), which makes the visualization more clear. Thank you for this suggestion. (Note that the previous Supplementary Figure 11 has been re-numbered to Figure 3-figure supplement 4.)

      The heatmap showing the level of marker transcripts shows a much lower expression of specific markers, TH, DBH, SLC6A2 in NE vs other clusters looks surprisingly low (particularly TH), while the much broader marker SLC18A2 (monoamine transporter) is considerably more differential. What do the authors make of this finding?

      This is correct. In the snRNA-seq data, we observed that SLC18A2 is one of the most highly differentially expressed (DE) genes in the NE neuron cluster vs. other neuronal clusters, with a high level of expression in the NE neuron cluster (Figure 3C). Note that this heatmap shows the top 70 DE genes (excluding mitochondrial genes) out of the full list of 327 statistically significant DE genes with elevated expression in the NE neuron cluster (the full list of 327 genes is provided in Supplementary File 2C). While all four of these genes (DBH, TH, SLC6A2, and SLC18A2) are identified as statistically significant DE genes, SLC18A2 is the most highly DE out of these and has an especially high level of expression in the NE neuron cluster, as noted by the reviewer (Figure 3C). This could be due to the fact that SLC18A2 transcripts are expressed at higher absolute levels in these neurons than the transcripts that are more specific to LC-NE neurons. While it is true that SLC18A2 is a “broader” marker in the sense that it is found in more cell types -- e.g. cell types within brain nuclei that contain monoaminergic as well as brain nuclei that contain catecholaminergic cells -- expression of SLC18A2 within the LC is highly specific to the catecholaminergic LC-NE neurons given its specialized functional role within monoamine and catecholamine neurons in packaging amine neurotransmitters into synaptic vesicles. We note that SLC18A2 plays a specialized role that is critical to the core function of LC-NE neurons, and hence we are not particularly surprised with this finding and think that one possibility is that this differential expression appears more robustly due to higher absolute levels of the marker.

      While it is understandable that the authors decided to include cells/nuclei with high mitochondrial reads, further work is needed to ensure these cells are of sufficient quality to use in an unbiased way knowing that a high percentage of mitochondrial reads in nuclei sequencing is usually indicative of low-quality nuclei. This can be assessed by evaluating the quality of the nuclei with GWA, which stains an intact nuclear membrane acting as a measure of the integrity of the nuclei.

      To further investigate these results, we added additional analyses evaluating quality control (QC) metrics for the NE neuron cluster in the snRNA-seq data, which had an unusually high proportion of mitochondrial reads (Figure 3-figure supplement 2, shown also below in comments for Reviewer 3) (see also related Figure 3-figure supplement 1, 3, which were included in the manuscript previously). These additional QC analyses do not show any other problematic values for this cluster, other than the high mitochondrial proportion, so we do not believe this is purely a data quality issue. We are aware that this is an unexpected result -- in most cell populations, a high proportion of mitochondrial reads would be indicative of cell damage and poor data quality. However, we have recently also observed high mitochondrial proportions in other relatively rare neuronal populations characterized by large size and high metabolic demand. As discussed below for Reviewer 3, we believe that this is mitochondrial “contamination”, as there should be no mitochondrial reads per se within the nuclear compartment.

      However, it may be possible that in cell populations that have abundant levels of mitochondria and high transcript expression of mitochondrial transcripts in the cell body, that the likelihood of ambient RNA capture of mitochondrial transcripts during nuclear preparation may be higher than for other cell types that have lower expression of mitochondrial transcripts. Hence, we believe that our interpretation is likely correct, i.e. that a combination of technical and biological factors contributes to the inclusion of a relatively high amount of mitochondrial RNA within the droplets for these nuclei. We agree with the reviewer that this finding warrants further investigation in future work. However, in our current study, the tissue resource is depleted for any further experimental validation of this question, so we preferred to provide our data to the community in its current form, while transparently noting this unexpected finding in our results. We have included additional text in the Results section describing the new QC analyses shown in Figure 3-figure supplement 2.

      Minor comments:

      Line 319-321 could be written more clearly to indicate that due to the lack of resolution in a given spot, there are "contaminating reads" that reduce the precision of the cell profile. This reduced precision is likely what results in the "lack of conservation" across species.

      We have added additional wording to this sentence to clarify this point.

      In the discussion, the authors write that the analyses "unbiasedly identified a number of genes enriched in human LC", however, given the manual annotation of the region for each capture area, this resulted in a biased assessment of the spots.

      We have replaced this wording to refer to “untargeted, transcriptome-wide” analyses (i.e. analyses that are not based on a targeted panel of genes) instead of “unbiased”. We agree that the meaning of “unbiased” is ambiguous in this context.

      Reviewer #3 (Recommendations For The Authors):

      Major points:

      Overall, the discovery of some cells in the LC region that express serotonergic markers is intriguing. However, no evidence is presented that these neurons actually produce 5-HT. Perhaps more conservative language would be appropriate (i.e. "cells that possess mRNA signatures of serotonergic neurons" or something like that). Did these cells co-express other markers one would expect in 5-HT neurons like 5-HT autoreceptors and SLC6A18? Also would be useful to compare expression profiles of these putative 5-HT neurons with any published material on bona fide dorsal raphe 5-HT neurons. For the RNAscope confirmation in the supplementary material, it would be helpful to show each marker separately as well as the overlay, and to include representative higher magnification images like were provided for the ACH markers.

      Thank you for this comment. In order to further investigate the identity of these cells, we have investigated the expression of several additional genes including SLC6A18, 5-HT autoreceptor genes (HTR1A, HTR1B), marker genes for 5-HT neurons (SLC18A2, FEV), and marker genes for 5-HT neuronal subpopulations within the dorsal and median raphe nuclei from the literature (Ren et al. 2019), in both the Visium and the snRNA-seq data.

      We observed some expression of SLC18A2 and FEV within the same areas as SLC6A4 and TPH2 in the Visium samples (Figure 3-figure supplement 10A-B, reproduced below; note that SLC18A2 is also a marker gene for NE neurons located within the LC regions), consistent with Ren et al. (2019). However, we did not observe a strong or consistent expression signal for the 5-HT autoreceptors (HTR1A, HTR1B) (Figure 3-figure supplement 10C-D, reproduced below), and we observed zero expression of SLC6A18 in the Visium samples. In the snRNA-seq data, within the cluster identified as 5-HT neurons, we observed some expression of SLC18A2, low expression of FEV, and almost zero expression of SLC6A18 (Figure 3-figure supplement 8, reproduced below; note that SLC6A18 is not shown since it was removed during filtering for low-expressed genes). Similarly, we observed very low expression of the 5-HT autoreceptors (HTR1A, HTR1B) and the additional marker genes for 5-HT neuronal subpopulations from Ren et al. (2019) -- with the possible exception of the neuropeptide receptor gene HCRTR2, which was identified by Ren et al. (2019) within several clusters in both the dorsal and median raphe in mice (Figure 3-figure supplement 8, reproduced below).

      Overall, these additional results give us some further confidence that these are likely 5-HT neurons (due to expression of SLC18A2 and FEV), while also raising further questions (due to the absence of 5-HT autoreceptor genes HTR1A, HTR1B and 5-HT neuronal subpopulation marker genes). While we believe that the most likely explanation is the inclusion of 5-HT neurons from the edges of the adjacent dorsal raphe nuclei in our samples, we acknowledge that the evidence presented is not fully conclusive and does not identify specific subpopulations of 5-HT neurons. In addition, the limited size of our dataset (number of samples and cells) and the lack of information on sample orientation precludes any definitive identification of subpopulations based on their association with specific anatomical regions within the dorsal raphe nuclei. We have updated the manuscript by (i) adjusting our language in the Results and Discussion, (ii) including the additional analyses, supplementary figures, and reference to the literature (Ren et al. 2019) discussed above, and (iii) including additional wording in the Discussion on improvements to the dissection strategy that would allow these questions to be addressed in future studies via a focused molecular profiling of the dorsal raphe nuclei across the rostral-caudal axis.

      Regarding the RNAscope images, we have included additional images showing channels side-by-side and higher magnification, as suggested (and also discussed above for Reviewers 1 and 2). In addition, we have added an outline highlighting the LC region in Figure 3-figure supplement 11 (as suggested above by Reviewer 2), and included an additional high-magnification RNAscope image demonstrating co-expression of 5-HT neuron marker genes (TPH2 and SLC6A4) within individual cells (Figure 3-figure supplement 12).

      Concerning the snRNA-seq experiments, why were only 3 of the 5 donors used, particularly given the low number of LC-NE nuclear transcriptomes obtained? How were the 3 donors chosen from the 5 total donors and how many 100 um sections were used from each donor? Are the 295 nuclei obtained truly representative of the LC population or are they just the most resilient LC nuclei? How many LC nuclei would be estimated to be captured from staining the 100 um tissue sections?

      As discussed in our previous response to reviewers (“Response to Public Review Comments”), the reason we included only 3 of the 5 donors for the snRNA-seq assays was due to tissue availability on the tissue blocks. In this study, we were working with a finite tissue resource. Due to the logistics and thickness of the required tissue sections for Visium (10 μm) and snRNA-seq (100 μm), running Visium first allowed us to ensure that we could collect data from both assays -- if we ran snRNA-seq first and captured no neurons, the tissue block would be depleted. Due to resource depletion, we did not have sufficient available tissue remaining on all tissue blocks to run the snRNA-seq assay for all donors. We have conducted extensive piloting in other brain regions on the amount (mg) of tissue that is needed from various sized cryosections, and the LC is particularly difficult since these are small tissue blocks and the extent of the structure is small. Hence, in some of the subjects, we did not have sufficient tissue available for the snRNA-seq assay.

      We have included details on the number of 100 μm sections used for each donor in Methods -- this varied between 10-15 sections per donor, approximating 50-80 mg of tissue per donor.

      Regarding the question about the representativeness / resilience of the LC nuclei -- as discussed in our previous response to reviewers (“Response to Public Review Comments”) and above for Reviewer 2, we agree that this is a concern. As discussed above for Reviewer 2, it is plausible that our use of FANS may have contributed to cell damage and the low recovery rate of LC-NE neurons. The relatively large size and fragility of LC-NE neurons, as well as our use of a standard cell straining approach (70 µm, which may not be ideal for this population), may also be contributing factors. Due to our limited tissue resource, we did not have sufficient tissue to perform a direct comparison with non-sorted data.

      Systematically optimizing the preparation to attempt to increase recovery rate is an important avenue for future work. We have included additional discussion of this issue in the Discussion.

      Regarding the question about the number of expected nuclei, we have now included estimates of the number of cells per spot within the LC regions in the Visium data (see also related point below, and Figure 2-figure supplement 2B reproduced below), based on the H&E stained histology images and use of cell segmentation software (VistoSeg; Tippani et al. 2022). While we do not have any confident estimates of the number of expected nuclei in the snRNA-seq data, these estimates of cell density from the Visium data could, together with information on additional factors such as the accuracy of the tissue scoring and the effectiveness of FANS, be used to help derive an an expected number of nuclei in future studies. We have included additional wording in the Discussion to note that these estimates could be used in this manner during future studies.

      The LC displays rostral/caudal and dorsal/ventral differences, including where they project, which functions they regulate, and which parts are vulnerable in neurodegenerative disease (e.g. Loughlin et al., Neuroscience 18:291-306, 1986; Dahl et al., Nat Hum Behav 3:1203-14, 2019; Beardmore et al., J Alzheimer's Dis 83:5-22, 2021; Gilvesy et al., Acta Neuropathol 144:651-76, 2022; Madelung et al., Mov Disord 37:479-89, 2022). Which part(s) of the LC was captured for the SRT and snRNAseq experiments?

      As discussed in our previous response to reviewers (“Response to Public Review Comments”), a limitation of this study was that we did not record the orientation of the anatomy of the tissue sections, precluding our ability to annotate the tissue sections with the rostral/caudal and dorsal/ventral axis labels. We agree with the reviewer that additional spatial studies, in future work, could offer needed and important information about expression profiles across the spatial axes (rostral/caudal, ventral/dorsal) of the LC. Our study provides us with insight about optimizing the dissections for spatial assays, as well as bringing to light a number of technical and logistical issues that we had not initially foreseen. For example, during the course of this study and parallel, ongoing work in other, small, challenging regions, we have now developed a number of specialized technical and logistical strategies for keeping track of orientation and mounting serial sections from the same tissue block onto a single spatial array, which is extremely technically challenging. We are now well-prepared for addressing these issues in future studies with larger numbers of donors and samples in order to make these types of insights. We have included additional details in the Discussion to further discuss this point.

      The authors mention that in other human SRT studies, there are typically between 1-10 cells per expression spot. I imagine that this depends heavily on the part of the brain being studied and neuronal density. In this specific case, can the authors estimate how many LC cells were contained in each expression spot?

      We have now performed additional analyses to provide an estimate of the number of cells per spot in the Visium data (Figure 2-figure supplement 2B), based on the application of cell segmentation software (VistoSeg; Tippani et al. 2022) to identify cell bodies in the H&E stained histology images. We applied this methodology and calculated summary statistics within the annotated LC regions for 6 samples (see Methods), and found that the median number of cells per spot within the LC regions ranged from 2 to 5 per sample. We note that these estimates include both NE neurons and other cell types within the LC regions, and that applying cell segmentation software in this brain region is particularly challenging due to the wide range in cell body sizes, with NE neurons being especially large. We have included these updated estimates in the Results and Discussion, and additional details in Methods.

      Regarding comparison of human LC-associated genes with rat or mouse LC-associated genes (Fig. 2D-F), the authors speculate that the modest degree of overlap may be due to species differences between rodent and human and/or methodological differences (SRT vs microarray vs TRAP). Was there greater overlap between mouse and rat than between mouse/rat and human? If so, that is evidence for the former. If not, that is evidence for the latter. Also would be useful for more in-depth comparison with snRNA-seq data from mouse LC. https://www.biorxiv.org/content/10.1101/2022.06.30.498327v1

      Our comparisons with the mouse (Mulvey et al. 2018) and rat (Grimm et al. 2004) data showed that we observed a relatively higher overlap between the human vs. mouse data than the human vs. rat data (Figures 2F-G and 3D-E). However, we note that the substantially different technologies used (TRAP-seq in mouse vs. laser capture microdissection and microarrays in rat) make it difficult to confidently interpret the degree of overlap between the two studies, and a direct comparison of these alternative platforms (TRAP-seq vs. LCM / microarray) or species (mouse vs. rat) lies outside the scope of our study. We have included updated wording in the Results and Discussion to explain this issue and help interpret these results.

      Regarding the newer mouse study using snRNA-seq (Luskin and Li et al. 2022), we have extended our analyses to perform a more in-depth comparison with this study. Specifically, we have evaluated the expression of an additional set of GABAergic neuron marker genes from this study within our secondary clustering of inhibitory neurons in the snRNA-seq data (Figure 3-figure supplement 13B). We observe some evidence of cluster-specific expression of several genes, including CCK, PCSK1, PCSK2, PCSK1N, PENK, PNOC, SST, and TAC1. We have also included additional text describing these results in the Results section.

      The finding of ACHE expression in LC neurons is intriguing. Susan Greenfield has published a series of papers suggesting that ACHE has functions independent of ACH metabolism that contributes to cellular vulnerability in neurodegenerative disease. This might be worth mentioning.

      We thank the reviewer for pointing this out. We were very surprised too by the observed expression of SLC5A7 and ACHE in the LC regions (Visium data) and within the LC-NE neuron cluster (snRNA-seq data), coupled with absence of other typical cholinergic marker genes (e.g. CHAT, SLC18A3), and we do not have a compelling explanation or theory for this. Hence, the work of Susan Greenfield and colleagues suggesting non-cholinergic actions of ACHE, particularly in other catecholaminergic neuron populations (e.g. dopaminergic neurons in the substantia nigra) is very interesting. We have included references to this work and how it could inform interpretation of this expression (Greenfield 1991; Halliday and Greenfield 2012) in the Discussion.

      High mitochondrial reads from snRNA-seq can indicate lower quality. Can the authors comment on this and explain why they are confident in the snRNA-seq data from presumptive LC-NE neurons?

      As mentioned above for Reviewer 2, we have included additional analyses to further compare quality control (QC) metrics for the NE neuron cluster (which had an unusually high proportion of mitochondrial reads) against other neuronal and non-neuronal clusters and nuclei in the snRNA-seq data (Figure 3-figure supplement 2). These additional QC analyses do not show any other problematic values for this cluster. Specifically, we show that the QC metric values for sum UMIs and detected genes per droplet for the NE neuron cluster fall within the range for (A) other neurons and (B) all other nuclei (excluding droplets with ambiguous / unidentifiable neuronal signatures). In addition, we observe that the droplets with the highest mitochondrial percentages (>75%) (C-D), which also have unusually low number of detected genes (D), tend to be from the ambiguous category (droplets with ambiguous / unidentifiable neuronal signatures), suggesting that true low-quality droplets are correctly identified and included within the ambiguous category (e.g. consisting of a mixture of debris from partial damaged nuclei) instead of as NE neurons. Since our QC analyses for the NE neuron cluster do not show any problems other than the high mitochondrial percentage, we do not believe these are simply mis-classified low-quality droplets. We also note that we have recently observed high mitochondrial proportions in other relatively rare neuronal populations characterized by large size and high metabolic demand in human data. We believe that our interpretation is correct -- i.e. that a combination of technical and biological factors has led to the inclusion of a relatively high amount of mitochondrial RNA within the droplets for these nuclei. We have included these additional QC analyses (Figure 3-figure supplement 2) and further discussion of this issue in the Results section.

      The Discussion could be expanded. Because there is a lot known and/or assumed about the LC, discussing all of it is certainly beyond the scope of this manuscript. However, perhaps the authors could pick a few more for confirmation and hypothesis generation. For example, one of the most well studied and important aspects of the LC is its regulation by neuromodulatory inputs. It would be interesting for the authors to discuss the expression of receptors for CRF, cannabinoids, orexin, galanin, 5-HT, etc, particularly when compared with the available rodent TRAP and snRNA-seq data (https://www.biorxiv.org/content/10.1101/2022.06.30.498327v1) contained some surprises, such as very low expression of CRF1 in LC-NE neurons, suggesting that the powerful activation of LC cells by CRF is indirect. Does this hold up in humans?

      We have expanded the Discussion to include additional discussion and references on several points, as discussed also above. Indeed these are interesting questions and these neuromodulatory systems are all of interest in the context of signaling within the LC in terms of function of the LC-NE system. We note that the manuscript serves primarily as a data resource and will be useful in many different ways depending on the different goals and interests of the readers. This is precisely why we wanted to take the time to make accessible and easy to use tools to interrogate and visualize the data. We have provided screenshots in Author response image 1-4 from the Shiny visualization app for the Visium data (https://libd.shinyapps.io/locus-c_Visium/) querying several main receptors of the neuromodulatory systems that this reviewer is particularly interested in to illustrate how the visualization apps can readily be used to query specific genes and systems of interest.

      Author response image 1.

      CRHR1:

      Author response image 2.

      CNR1:

      Author response image 3.

      OXR1:

      Author response image 4.

      GALR1:

      Minor points:

      Line 46 add stress responses to the key functions of LC neurons

      We have added this point and included additional references to support the findings.

      Line 47 add that the LC was so named "blue spot" because of its signature production of neuromelanin pigment

      We have added this point.

      Line 49 LC's capacity to synthesize NE is not "unique" - several other brainstem/medullary nuclei also synthesize NE (e.g. A1-A7; LC is A6)

      We have updated this wording.

      Line 54 Although prior evidence indicated age-related LC cell loss in people without frank neurodegenerative disease, recent studies that are better powered and used unbiased stereological methods have refuted the idea that LC neurons die during normal aging (reviewed in Matchett et al., Acta Neuropathologica 141:631-50, 2021)

      We have updated this part of the Introduction to focus on cell loss in the LC in neurodegenerative disease and removed the older references describing studies that suggested LC neurons die in normal aging.

      Line 62 Would also be worth mentioning the role of the LC in other mood disorders where adrenergic drugs are often prescribed, such as PTSD (e.g. prazosin), opioid withdrawal (e.g. lofexidine), anxiety and depression (e.g. NE reuptake inhibitors).

      We have added additional references to these disorders and their treatment with noradrenergic drugs in the Introduction.

      Additional updates from Public Review Comments:

      We have also included the following updates, in response to additional reviewer comments received during the initial round of “Public Review Comments” and which are not already described in the responses to the “Recommendations for the Authors” above.

      ● We included updated wording in the Results section and Figure 1C caption to more clearly describe the number of donors included in the final SRT and snRNA-seq data used for analyses after all quality control (QC) steps (4 donors for SRT data, 3 donors for snRNA-seq data).

      ● Figure 3-figure supplement 1D (number of nuclei per cluster in unsupervised clustering of snRNA-seq data) has been updated to show percentages of nuclei per cluster.

      ● We have added comparisons between the lists of differentially expressed (DE) genes identified in the Visium and snRNA-seq data. To make these sets comparable, we have added (i) snRNA-seq DE testing results between the NE neuron cluster and all other clusters (instead of other neuronal clusters only, as shown in the main results in Figure 3) (excluding ambiguous neuronal) (Figure 3-figure supplement 6 and Supplementary File 2D), and (ii) calculated overlaps and comparisons between the sets of DE genes between the Visium data (pseudobulked LC vs. non-LC regions) and the snRNA-seq data (NE neuron cluster vs. all other clusters excluding ambiguous neuronal). This comparison generated a list of 51 genes that were identified as statistically significant DE genes (FDR < 0.05 and FC > 2) in both the Visium and the snRNA-seq data (Figure 3-figure supplement 7 and Supplementary File 2E).

      Other additional updates:

      We have added an additional data repository (Globus). Raw data files (FASTQ sequencing data files and high-resolution TIF image files) are now available via Globus from the WeberDivecha2023_locus_coeruleus data collection from the jhpce#globus01 Globus endpoint, which is also listed at http://research.libd.org/globus/. The Globus repository is not publicly accessible due to individually identifiable donor genetic variants in the FASTQ files. Approved users may request access from the corresponding authors. This data repository is listed in the Data Availability section.

    1. Author Response

      The following is the authors’ response to the original reviews.

      Reviewer #1 (Recommendations For The Authors):

      It is not clear if the cost-effectiveness cited refers exactly to the PAVE protocol. No line item costings are given. As far as I know, the AmpFire test is very expensive (some 6 USD) and AI-assisted colposcopy has at least formerly been very expensive.

      Response: As mentioned in the section on "Cost-effectiveness analysis," the cost-effectiveness results refer to "an early exercise to approximate the potential costs and benefits of a highly effective screening campaign delivered to women aged 30-49 years in the ~65 highest burden LMIC (Figure 1; Suppl Materials) and an HPV vaccination program delivered to girls aged 9-14 years". Because this modeling was intended to be a high-level approximation prior to the availability of micro-costing and use of a new microsimulation model reflecting the epidemiology of HPV in PAVE study sites, we used a bundled cost of US$15 per woman screened and managed appropriately, including the ~$6 cost of the ScreenFire test, triage with AVE for women with HPV positivity, and treatment based on risk stratification. Micro-costing and microsimulation model development for PAVE sites are ongoing alongside the study and will have the capability to reflect setting-specific differences in delivery costs, as well as different burdens of HPV and precancer. These refinements of costing and cost-effectiveness estimates are a high priority of the PAVE consortium

      Reviewer #2 (Recommendations For The Authors):

      As mentioned above, the description of phase 2 could be improved. I suggest that the inclusion of Implementation Science frameworks and tools could contribute to strengthening methods to measure implementation outcomes. Perhaps if the protocol and scope of the study allows it, I suggest that the authors evaluate the incorporation of the assessment of barriers and facilitators of implementation to inform future scaling up of the PAVE strategy. To do this, for example, some Implementation Science Frameworks, such as Conceptual Framework of Implementation Research (CFIR)1-2 could be useful. In addition, as the authors mentioned, future dissemination will need an effective communication strategy and to design it they will carry out a pilot study. The inclusion of CFIR framework or other similar framework, could contribute to identifying contextual factors that might affect implementation and contribute to designing an accurate implementation and dissemination strategy.

      The authors also mentioned that if the PAVE strategy is effective, it could replace the current standard of care. This fact would lead to the need to carry out a des-implementation process. This process needs stakeholders' engagement and political will, among other contextual factors (e.g., human resources, organizational changes, etc.). Implementation of new strategies needs that implementers perceive it as acceptable, adaptable, compatible and with greater advantages than the usual practice. In this sense, the analysis of implementation outcomes guided by CFIR framework could play an important role in this future des-implementation process.

      1. Damschroder, et al. Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implementation Sci 4, 50 (2009) https://doi.org/10.1186/1748-5908-4-50.

      2. Damschroder, L.J., Reardon, C.M., Widerquist, M.A.O. et al. The updated Consolidated Framework for Implementation Research based on user feedback. Implementation Sci 17, 75 (2022). https://doi.org/10.1186/s13012-022-01245-0

      Response: Phase 2 refers to limited aspects of PAVE implementation, mainly introducing the management algorithms and evaluating the acceptability by providers and patients. Based on preliminary results of PAVE in the efficacy analysis a more comprehensive implementation intervention is being planned.

      Reviewer #3 (Recommendations For The Authors):

      This is a very strong protocol and obviously the synthesis of many years' of work. I have some minor suggestions only.

      The issue raised as a weakness could be addressed by specifying that biopsy adequacy is evaluated by the local histopathologist. Those cases that don't contain at least some stroma and only superficial strips of epithelium should probably be assessed as "unsatisfactory" and excluded from triage performance calculations.

      While endocervical curettage is commonly performed in North America, resulting in good quality samples, there is considerable global variation in this practice. The procedure yielding high quality samples is usually somewhat painful due to the cervical dilation and may in fact be more painful than small biopsies.

      Response: We are undertaking a thorough evaluation of histology assessment together with the on-site pathologists and an external expert reviewer. It is critical that the study material be of good quality and that the diagnosis be highly accurate as these elements are critical for patient management but also for an adequate training of the AI algorithm. We are recommending to use for endocervical sampling a soft tissue by Histologics that provides excellent material and it is reported to be less painful than regular curette. Pathologists are requested to verify the quality of the sampling of this approach.

      The sentence starting at line 311 could add that, clinicians also record transformation type and/ or colposcopy adequacy.

      Response: Added

      The clinicians are reporting the VIA or the colposcopy impression and also the visibility of the SCJ.

      The manuscript could be strengthened by specifying what will happen to people who have HPV detected and are triage negative. Will they be recalled for follow-up HPV test at around 12 months or some other interval?

      Finally, will those who have been treated be recalled for a follow-up HPV test at around 12 months, particularly those treated with thermal ablation? Follow-up of people in whom HPV is detected, whether triage negative or positive (and treated) would strengthen the study and enhance participant safety. If this is already planned it would strengthen the manuscript to cover these aspects.

      Response: The PAVE strategy runs under a Consortium agreement and thus we cannot dictate specific protocols for follow-up. We are very eager to promote an adequate follow-up for those with a triage test negative, but the monitoring of its implementation is beyond PAVE. All settings have under their guidelines a yearly follow-up for any woman receiving thermal ablation and shorter intervals for those getting LEEP (LLETZ).

    1. Author Response

      The following is the authors’ response to the original reviews.

      eLife assessment

      This study offers an inventory of proteins and their phosphorylated sites that are up- and down-regulated in the adipose tissue and skeletal muscle of women with PCOS. The data were collected and analyzed using rigorous and validated methodology, making it a useful resource for identifying targets and strategies for future PCOS treatments. However, even though some of the predicted targets are compelling, further functional validation is required to ensure the accuracy of these identified targets. If confirmed, the findings of this study would be of significant interest to a wide range of readers.

      Thank you very much for the opportunity to carry out some final revisions to our manuscript and for the invitation to submit a revised version of our work for further consideration in eLife. We are grateful for the very constructive and thorough feedback provided. Consequently, our manuscript has undergone revisions to address the issues raised, providing additional data from mouse models showing that androgen receptor signaling has a direct effect on muscle fiber type.

      Public Reviews:

      Reviewer #1 (Public Review):

      In the manuscript, the authors tried to explore the molecular alterations of adipose tissue and skeletal muscle in PCOS by global proteomic and phosphorylation site analysis. In the study, the samples are valuable, while there are no repeats for MS and there are no functional studies for the indicted proteins, phosphorylation sites. The authors achieved their aims to some extent, but not enough.

      Response: Indeed, the samples are valuable but given the relatively high sensitivity and specificity of the method we don’t see why repeats for MS would increase the power of the study. The number of tissue samples analyzed would however do so. Although no functional studies have been done, we do show that hyperandrogenism is associated with a shift towards fewer type I fibers in skeletal muscle. In the revised manuscript we have added data showing that androgens (dihydrotestosterone, DHT) have a direct effect on reducing the number of type I muscle fibers in a PCOS-like mouse model. Prepubertal DHT exposure led to a dramatic decrease in type I fibers, and this effect was partly prevented by the androgen receptor antagonist flutamide (Fig. 4A). Moreover, while skeletal muscle specific AR knockout mice presented with fewer type I muscle fibers, they were protected against the DHT-induced type I muscle fiber loss (Fig. 4B).

      Reviewer #2 (Public Review):

      This study provides the proteomic and phosphoproteomics data for our understanding of the molecular alterations in adipose tissue and skeletal muscle from women with PCOS. This work is useful for understanding of the characteristics of PCOS, as it may provide potential targets and strategies for the future treatment of PCOS. While the manuscript presents interesting findings on omics and phenotypic research, the lack of in-depth mechanistic exploration limits its potential impact.

      The study primarily presents findings from omics and phenotypic research, but fails to provide a thorough investigation into the underlying mechanisms driving the observed results. Without a thorough elucidation of the mechanistic underpinnings, the significance and novelty of the study are compromised.

      Response: We do provide solid evidence that women with PCOS have a lower expression of proteins specific for type I muscle fibers. A comprehensive exploration of the mechanism driving the observed results is not within the scope of this paper. However, we have included experimental data from a PCOS-like mouse model to strengthen our results that hyperandrogenism has a direct effect on lowering the number of type I fibers. Prepubertal dihydrotestosterone (DHT) exposure led to a dramatic decrease in type I fibers, and this effect was abolished in DHT-exposed mice with skeletal muscle-specific deletion of the androgen receptor (Fig. 4B). Moreover, the decrease in type I fibers was partly prevented by the androgen receptor antagonist flutamide in wild-type mice (Fig. 4A). Notably, unchallenged skeletal muscle specific AR knockout mice had fewer type I muscle fiber. These data indicate that muscle AR signaling is important for normal muscle development, but that exaggerated muscle AR signaling leads to decreased abundance of type I muscle fibers in adult females.

      Reviewer #1 (Recommendations For The Authors):

      1. For participant recruitment the age should be considered.

      Response: The age of the women is shown in Table 1, the mean age was around 30 years. Cases and controls were matched for age, weight, and BMI at recruitment.

      1. The current method is that biopsies from 10 participants are collected as a sample, biopsy from 1 participant for MS and comprehensive analysis in the group may be better.

      Response: The skeletal muscle biopsies from the 10 controls and 10 women with PCOS at baseline and after 5 weeks of treatment were collected and analyzed as individual samples. For MS each sample was handled as individual samples with subsequent comprehensive analysis of each group. This has now been further clarified in the methods; paragraph Proteomic sample preparation and LC-MS/MS analysis.

      1. Figure 2C, it is not convincing that "The increased expression of perilipin-1 was confirmed by immunofluorescence staining of muscle biopsies".

      Response: we have quantified perilipin-1 staining in skeletal muscle cells from control and PCOS using ImageJ software (National Institutes of Health, Bethesda, MD, USA). The channels of the images were split and converted into 8-bit. The minimum and maximum thresholds were adjusted and kept constant for all the images. Regions of interest were drawn around the cells and empty space for background intensity measurement. The mean perilipin-1 intensity was measured and corrected by deducting the background. A total of 28 PCOS and 33 control cells were quantified. The quantification of perilipin-1 staining is included in Fig. 2D. Perilipin-1 staining was more abundant in skeletal muscle cells from women with PCOS.

      1. Figs.3F,4C,5C,6B, methods for the quantification are needed respectively.

      Response: For each of the graphs, a detailed description of how the stainings were quantified has been included in the Methods section; Histological analyses and immunofluorescence.

      Fig.3F; Fiber cross-sectional area was automatically determined using MyoVision v1.0 and the proportion of type I fibers was manually counted on ImageJ. A total of 579 fibers from seven controls (60-150 fibers per muscle section) and 177 fibers (15-80 fibers per muscle section) from women with PCOS were quantified. Data are expressed as mean ± SD and graphically depicted with each individual fiber quantified.

      Fig. 4C and 6B; Quantification of picrosirius red staining of adipose tissue before and after treatment with electrical stimulation was performed using a semi-automatic macro in ImageJ software. This macro allows for calculation of the total area (m2) and the % of collagen staining from each area adjusting the minimum and maximum thresholds.. Three different random pictures per section (4-5 sections/subject) were taken at 10x or 20x magnification using a regular bright field microscope (Olympus BX60 & PlanApo, 20x/0.7, Olympus, Japan). All images were analyzed on ImageJ software v1.47 (National Institutes of Health, Bethesda, MD, USA) using this protocol https://imagej.nih.gov/ij/docs/examples/stained-sections/index.html with the following modification; threshold min 0, max 2.

      Fig. 5C; Quantification of picrosirius red staining of skeletal muscle before and after treatment with electrical stimulation was performed using a semi-automatic macro in ImageJ software v1.47 (National Institutes of Health, Bethesda, MD, USA) using the same protocol as for adipose tissue described above. % of collagen staining was calculated on 8 – 10 images of different microscopic fields from each muscle sample.

      Reviewer #2 (Recommendations For The Authors):

      While the study presents some valuable research findings, it falls short in terms of providing a comprehensive understanding of the mechanistic basis of the observed outcomes. Further exploration and elucidation of the mechanisms involved would greatly enhance the quality and impact of the study. For example, the authors need to provide sufficient evidence to elucidate why PCOS patients exhibit changes in these proteins and phosphorylation sites, as well as how these changes may impact PCOS patients, such as whether they are related to fertility. It would be valuable to provide further mechanistic insights to enhance the scientific rigor of the study.

      I encourage the authors to further refine their research and resubmit the manuscript with a more robust and comprehensive exploration of the mechanistic aspects to strengthen its scientific merit.

      Response: PCOS is characterized by reproductive and metabolic features. Changes in protein expression and phosphorylation sites in skeletal muscle and adipose tissue likely impact metabolic function to a larger degree than fertility. With that said, altered muscle function may affect insulin resistance and inflammation, thereby potentially aggravating reproductive status including ovulatory cyclicity and fertility potential. We found that aldo-keto reductase family 1 members C1 (AKR1C1) and C3 (AKR1C3), which for example can convert androstenedione to testosterone, had a higher expression in skeletal muscle. Expression of AKR1C1 was strongly correlated to higher circulating testosterone levels (Spearman rho=0.65, P=0.002), suggesting that muscle may produce testosterone via the backdoor pathway (added to the second paragraph of the results section). Moreover, a lower expression of the mitochondrial acetyl-CoA synthetase 2 correlated with a higher HOMA-IR (Spearman rho=-0.46, P=0.04), suggesting that an impaired mitochondrial fatty acid beta-oxidation contributes to insulin resistance. There was indeed a lower expression of various mitochondrial matrix proteins, some involved in mitochondrial fatty acid beta-oxidation; enoyl acyl carrier protein reductase; enoyl-CoA delta isomerase 1, and acyl-CoA thioesterase 11 (R-HSA-77289, q=0.0008) in PCOS muscle (this has been added to the discussion).

      A comprehensive exploration of the mechanism driving these changes is not within the scope of this paper. However, we have added data from PCOS-like mice to strengthen the paper. This mouse model supports our hypothesis that androgens drive the shift towards less type I muscle fibers, an effect that can be partly reversed by blocking the androgen receptor with the antagonist flutamide (Fig. 4A). Prepubertal DHT exposure led to a dramatic decrease in type I fibers but this effect was not observed in DHT-exposed mice with skeletal muscle-specific deletion of the androgen receptor (Fig. 4B). These data strongly indicate that AR signaling is driving the decrease in type I muscle fibers in females.

  2. Nov 2023
    1. Author Response

      The following is the authors’ response to the original reviews.

      Response to Editor and Reviewers

      Terzioglu et al, Mitochondrial temperature homeostasis resists external metabolic stresses

      Editor:

      We greatly appreciate the specific direction of the editors in guiding us as to what experiments are needed to strengthen the manuscript for publication. We here summarize how we have handled this advice (please refer to response to specific reviewer points, below, for the details). Changes to the text are indicated by red text and marginal red boxes numbered as per the responses below.

      Benchmarking: we now include a direct calibration of MTY against temperature. Performing experiments on temperature probes localized to different subcellular and submitochondrial compartments would be interesting and potentially informative, but is a whole new study that would require a great deal of validation. Hopefully it will be implemented, but it would not change the basic conclusions from the current study.

      Probe localization: In addition to referring to previously published literature, and the existing Figures 3B, 4 and S4 indicating that both MTY and mito-gTEMP are localized in mitochondria (the latter in the matrix), we have conducted some simple experiments to determine the intramitochondrial localization of MTY, applying standard subfractionation protocols. The findings confirm our previous assumption that MTY is inner membrane-associated.

      Expected outcomes: Since, in most cases, it is not possible to do this simultaneously with fluorescence measurements, we rely mostly on previous literature which is fully cited, or on measurements conducted in parallel (e.g. respirometry, Fig. S5) or previously in our own laboratories (e.g. flow cytometry on TMRM-stained cells). We accept that specific inferences on causality, e.g. that the effect of anisomycin is mediated by decreased ATP usage, or that the effects of Gal medium are to enforce dependence on OXPHOS, are arguably an over-reach. We have therefore toned down these statements so as to focus on the mt temperature response to the treatments, rather than to the imputed downstream physiological effects thereof.

      Confounding factors: We tested (and excluded) possible confounding factors affecting MTY and report the findings in an expanded supplementary figure.

      Discussion of the model(s) proposed by Matta: We have now included this, as far as we considered appropriate for the eLife readership. However, not being theoretical physicists, we would greatly welcome a careful scrutiny of what we have written, by both the reviewer and handling editor.

      Reviewer #1:

      A1. Causality: We agree with the reviewer in that we cannot formally distinguish, in this study, whether metabolism is adjusted to maintain mitochondrial temperature, or whether mitochondrial temperature maintenance is a secondary consequence of metabolic changes induced by stress. We have added a note to the Discussion to this effect. On balance, we would argue that the many cases that we have documented here tend to favour the former assertion, although this does not constitute proof. Identification of a sensor of mitochondrial temperature changes and an associated signal transduction machinery to orchestrate responses to it would be needed to settle this, but we are obviously very far from this at present. We have added this point to the Discussion, as well.

      A2. Metabolic correlates: We concede that the reviewer has a valid point, although exploring its ramifications in detail is not straightforward. The effects of AOX on respiration and resistance to OXPHOS inhibitors are documented previously and are also included in the paper as a check (Fig. S5). Our starting assumptions were that cells grown in low glucose/galactose would depend more upon mitochondrial as opposed to glycolytic ATP production, whilst net ATP production in anisomycin-treated cells should be attenuated, due to decreased ATP demand. Nevertheless, there are a number of ways this could be achieved, especially if our suggestion that altered ATP production is balanced by decreased or increased futile ATP turnover geared to maintenance of mitochondrial temperature. For example, measuring total oxygen consumption, P to O ratio or steady-state levels of ATP (or any other metabolite) would not be definitive. To accommodate the reviewer’s point, we have made clear that the various treatments we applied are predicted to alter metabolism in the specified ways, based upon theoretical arguments and previous data. To establish the exact details of the metabolic changes that accompany these treatments would require tracer-based metabolomics over time (see Jang 2018, 10.1016/j.cell.2018.03.055), followed up by measurements of specified enzyme activities. Whilst this would be very useful data that may illuminate our observations, it is obviously beyond the scope of the present paper. We hope that future studies will eventually unravel the relationship between metabolic adaptation and mitochondrial temperature.

      A3. Combinations of inhibitors: We were (and remain) reluctant to cram the paper too full of unsubstantiated speculations. Most, though not all, of the combinations of OXPHOS inhibitors that failed to give a stable reading of MTY fluorescence involved oligomycin plus an inhibitor of respiration. Since we already know that a complete loss of membrane potential leads to leakage of the dye, we surmise that this is the most likely reason for the fluorescence instability. In the presence of oligomycin alone, the minimal respiratory electron flow sustained should suffice to maintain a membrane potential if balanced against proton leakage. Conversely, even when respiration is inhibited, ATP synthase alone should be able to generate a membrane potential. However, the membrane potential may collapse when both oligomycin and a respiratory chain inhibitor are simultaneously applied. We expanded our comment on this issue in the Discussion and referred to it, briefly, in the legend of Fig. S3A.

      A4. Figure 4A: We added the panel indicators to the figure.

      A5. Fig.7C: We have tried to tighten up the wording, for clarity. Yes, the blue trace was the relevant data, but we were comparing the effect of rotenone on cells treated with anisomycin for 1, 2….18 hours with cells not treated with anisomycin at all (i.e. blue trace, zero h time-point).

      A6. Meaning of ‘control iMEFS’ (Fig. 7C): We meant iMEFs not expressing AOX. We have made the statement more precise, accordingly.

      A7. Supplementary Movie S1: The movie was sent, to accompany the submission. If it is not accessible for review, please contact the handling editor.

      Reviewer #2:

      B1. Theoretical considerations (‘mitochondrial paradox’): Since we are not theoretical physicists, we have deferred to the reviewer’s expertise in these matters and quoted the suggested literature as succinctly as possible for the largely biological audience of eLife, sticking closely to the reviewer’s own words. In this light, we would invite the reviewer to scrutinize our added text (in a short additional section of the Discussion, for both this and point B3, below), and suggest any rewording that they consider appropriate.

      B2. Biological implications: We appreciate the point, but since the Discussion section is already long, we have just referred the reader to the treatment of Fahimi et al. We hope to expand on these issues in a separate paper, to be published elsewhere.

      B3. Theoretical considerations (Landauer’s principle and ATP synthase electrostatics): Once again, we have mentioned the issue as suggested, but would ask the reviewer to check the exact language we have used and propose any amendments they consider necessary.

      Reviewer #3:

      C1. Benchmark comparisons: We acknowledge that there are limitations to the use of each method of mitochondrial temperature assessment, and we now explain them more thoroughly in a new section of the Discussion. However, the fact that the two methods give approximately the same result constitutes a crucial validation. In addition, we verified the temperature-responsiveness of MTY fluorescence in free solution at physiological pH (see new supplementary figure panel, Fig. S2D), showing that the response is almost linear over the temperature range inferred in the experiments (35-65 ºC). Note, however, that the response curve generated cannot be used directly for calibration, due to the unknown contributions in vivo from cellular autofluorescence and quenching under OXPHOS-inhibited conditions, which may modify the signal, and will vary according to the amount of dye taken up in a given experiment. Because of this, the internal calibration used in each experiment is a far more reliable way of relating observed fluorescence changes to temperature. Note, however, that if the slight deviation from linearity seen at higher temperatures in the MTY fluorescence temperature-response curve (dotted line in Fig. S2D) reflects how the dye responds in vivo, MTY-based estimations of mitochondrial temperature may be over-estimated by ~2 ºC. This is now made clear in the text.

      C2. Basal temperature: The basal mitochondrial temperature (no inhibitors) as inferred from the mitogTEMP calibration curve was already in the paper (zero time points for iMEF(P) and iMEF(AOX) cells, Fig. 7A, 7B.

      C3. Other organelles: In principle, gTEMP could be targeted to other organelles, such as the nucleus, peroxisomes, ER, plasma membrane and so on, which would be highly informative in profiling intracellular temperature heterogeneities. However, this would require further rounds of recloning and expression, followed in each case by verification of intracellular targeting; obviously quite a large study beyond the scope of our present work. In any case, it would now best be undertaken using the improved, next-generation ratiometric probes (B-gTEMP), which is under way. We agree that this is an important question for future experimentation and have added a short extra section to the Discussion, accordingly.

      C4. Variation with external temperature: We implemented additional experiments to test this, subjecting cells to a mild heat- or cold-shock, and tracking MTY fluorescence both before and after the subsequent addition of oligomycin, with final internal calibration as before. The results were again qualitatively reproducible, but suggested that the combination of external temperature shock and bioenergetic stress. We show the details of the results of these experiments here, for the reviewer and others to inspect and consider. However, since they are not straightforwardly interpretable, we feel that they should be reserved for a future study which investigates the effects of external temperature changes on intramitochondrial temperature and bioenergetics in much greater detail. For these reasons we show the data here only, and not in the revised paper.

      Both cold shock (38→32 ºC) and heat shock (38→41 ºC) produced immediate shifts of mt temperature, but by lesser amounts than the external stresses applied, i.e. a cooling of 2-4 ºC in the first case and a warming of 0-2 ºC in the second. Over the following 10 min the mt temperature of the temperature-shocked cells held steady or drifted only slightly. These observations are broadly consistent with the general conclusions of the paper that mitochondrial temperature resists external stresses. However, the effect of then adding oligomycin was intriguingly different from that seen in control cells. In cold-shocked cells the mt temperature shift produced by oligomycin was several degrees less than in control cells and mitochondrial temperature then gradually readjusted upwards to near the starting value, suggesting the induction of thermogenic pathways to compensate for the decreased external temperature. In heat-shocked cells, the response to oligomycin was reproducibly triphasic: the initial cooling effect was less pronounced than in control cells, but was followed by rewarming and then by a prolonged and progressive cooling. This is obviously much harder to interpret, and will require substantial further studies to parse.

      C5. Other factors: Although this point is addressed in previous literature, we measured effects directly in solution (for MTY). Note, however, that it is not feasible to measure membrane potential simultaneously, due to the spectral overlap between e.g. TMRM and MTY. Nevertheless we were able to test the effects on MTY fluorescence of incremental changes in Ca2+, pH and ROS within the physiological range (see doi: 10.1073/pnas.95.12.6803, doi: 10.1074/jbc.M610491200 and doi: 10.3390/antiox10050731). The results clearly indicate that changes in any of these parameters has no effect on MTY fluorescence (new supplementary figure panels S3E, S3F and S3G).

      C6. Localization of probes: The existing Figures 3B, 4 and S4, as well as previous literature, indicate a mitochondrial localization both for MTY and mito-gTEMP. The matrix localization of proteins of the GFP reporter family tagged with the COX8 matrix-directed targeting signal used here is well established (e.g. see doi: 10.1016/S0076-6879(09)05016-2). To investigate the sub-mitochondrial localization of MTY we conducted a standard series of fractionation steps, using detergents, centrifugation and sonication. Whilst these do not provide absolute purity, they clearly indicate that MTY in energized mitochondria resides in or closely associated with the inner mitochondrial membrane. In two trials, in which mitochondria were fractionated into mitoplasts versus outer membrane/inter-membrane space fractions, an average 92% of the MTY fluorescence was retained in the mitoplast fraction (after subtracting autofluorescence from control samples not treated with MTY). After sonication, which should render most of the inner membrane pelletable as ‘inside out’ submitochondrial particles (SMPs), leaving most of the matrix contents in solution, 90% of the MTY fluorescence signal (again based on two trials, with background subtracted) was recovered in the SMP fraction, supporting the proposition that the dye is inner-membrane associated. These findings are now reported in the Results section and commented on in the appropriate section of the Discussion. We agree with the reviewer that it would be useful to target temperature probes, e.g. B-gTEMP, to specific sub- and extra-mitochondrial compartments (cytosol, MAMs, outer membrane, IMS, inner membrane or even specific protein complexes therein), so as to gauge the nature of intramitochondrial heat conduction between compartments and its radiation to the extramitochondrial environment. However, because it would be an extensive study in its own right, requiring careful validation of targeting, we feel this should be attempted as a follow-up study.

      C7. Use of probes in isolated mitochondria: In principle we see no reason why this should not work, but any result would be non-physiological, since the external environment of isolated mitochondria is not the complex protein- and organelle-rich environment of the cytoplasm, which must play a crucial role in modulating heat diffusion from the organelle. Such an experiment may be useful to assess how much temperature buffering is provided by the rest of the cytoplasm, even though it does not directly address the internal temperature of mitochondria in vivo. Accordingly, we added a sentence to the Discussion foreshadowing such an experiment.

      C8. Other probes and methods: See points C1 and C3 above. The reviewer’s suggestion could best be addressed using the superior B-gTEMP reporters engineered for specific expression in the nucleus and cytosol. This would be part of an extensive new study beyond the scope of the present work, but would of course be a further validation of its conclusions. We agree that multiple approaches are needed to address the issue of temperature differences within cells, in light of the surprising findings both of ourselves and of others, such as the study of Okabe et al (2012) to which the reviewer refers. This point too is now added to the Discussion.

      C9. Theoretical considerations: The critiques referred to are now briefly addressed in the revised Discussion, along with those raised by Reviewer 2. However, since we are not theoretical physicists we do not feel qualified to enter the debate further. As Baffou and colleagues point out, in https://doi.org/10.1038/nmeth.3552, “In order for the community to come to a consensus, we believe some effort will be required to identify the actual origin of the signal measured in these studies, both theoretically and experimentally“. Our experimental findings provide source data for this debate but do not resolve it.

    1. Author Response

      The following is the authors’ response to the original reviews.

      eLife assessment

      This study reports important findings regarding the systemic function of hemocytes controlling whole-body responses to oxidative stress. The evidence in support of the requirement for hemocytes in oxidative stress responses as well as the hemocyte single-nuclei analyses in the presence or absence of oxidative stress are convincing. In contrast, the genetic and physiological analyses that link the non-canonical DDR pathway to upd3/JNK expression and high susceptibility, and the inferences regarding the function of hemocytes in systemic metabolic control are incomplete and would benefit from more rigorous approaches. The work will be of interest to cell and developmental biologists working on animal metabolism, immunity, or stress responses.

      We would like to thank the editorial team for these positive comments on our manuscript and the constructive suggestions to improve our manuscript. We are now happy to send you our revised manuscript, which we improved according to the suggestions and valuable comments of the referees.

      Public Reviews:

      Reviewer #1 (Public Review):

      The study examines how hemocytes control whole-body responses to oxidative stress. Using single cell sequencing they identify several transcriptionally distinct populations of hemocytes, including one subset that show altered immune and stress gene expression. They also find that knockdown of DNA Damage Response (DDR) genes in hemocytes increases expression of the immune cytokine, upd3, and that both upd3 overexpression in hemocytes and hemocyte knockdown of DDR genes leads to increased lethality upon oxidative stress.

      Strengths

      1. The single cell analyses provide a clear description of how oxidative stress can cause distinct transcriptional changes in different populations of hemocytes. These results add to the emerging them in the field that there functionally different subpopulations of hemocytes that can control organismal responses to stress.

      2. The discovery that DDR genes are required upon oxidative stress to limit cytokine production and lethality provides interesting new insight into the DDR may play non-canonical roles in controlling organismal responses to stress.

      We are grateful to referee 1 to point out the importance and novelty of our snRNA-seq data and our findings on the role of DNA damage-modulated cytokine release by hemocytes during oxidative stress. We further extended these analyses in the revised manuscript by looking deeper into the transcriptomic alterations in fat body cells upon oxidative stress (Figure 4, Figure S4). We further provide additional data to support the connection of DNA damage signaling and regulation of upd3 release from hemocytes (Figure 6F). Here we show that upd3-deficiency can abrogate the increased susceptibility of flies with mei41 and tefu knockdown in hemocytes. In line with this finding, we also show that upd3null mutants show a reduced but not abolished susceptibility to oxidative stress overall (Figure 6F), underlining the role of upd3 as a mediator of oxidative stress response.

      Weaknesses

      1. In some ways the authors interpretation of the data - as indicated, for example, in the title, summary and model figure - don't quite match their data. From the title and model figure, it seems that the authors suggest that the DDR pathway induces JNK and Upd3 and that the upd3 leads to tissue wasting. However, the data suggest that the DDR actually limits upd3 production and susceptibility to death as suggested by several results:

      According to the referee’s suggestion, we revised the manuscript and adjusted our title, abstract and graphical summary to be more precise that DNA damage signaling seem to have a modulatory or regulatory effect on upd3 release. Furthermore, we provide now additional data to support the connection between DNA damage signaling and upd3 release. For example, we added several genetic “rescue” experiments to strengthen the epistasis that modulation of DNA damage signaling and the higher susceptibility of the fly is connected to altered upd3 levels (Figure 6F). We now provide additional data showing that the loss of upd3 rescues the susceptibility to oxidative stress in flies, which are deficient for DDR components in hemocytes.

      a. PQ normally doesn't induce upd3 but does lead to glycogen and TAG loss, suggesting that upd3 isn't connected to the PQ-induced wasting.

      Even though in our systemic gene expression analysis of upd3 expression, we could not detect a significant induction of upd3 upon PQ feeding. However, we found upd3 expression within our snRNAseq data in a distinct cluster of immune-activated hemocytes (Figure 3B, Cluster 6). Upon knockdown of the DNA damage signaling in hemocytes, the levels then increase to a detectable level in the whole fly. This supports our assumption that upd3 is needed upon oxidative stress to induce energy mobilization from the fat body, but needs to be tightly controlled to balance tissue wasting for energy mobilization. Furthermore, we found evidence in our new analysis of the snRNA-seq data of the fat body cells, that indeed we can find Jak/STAT activation in one cell cluster here, which could speak for an interaction of Cluster 6 hemocytes with cluster 6 fat body cells. A hypothesis we aim to explore in future studies.

      b. knockdown of DDR upregulates upd3 and leads to increased PQ-induced death. This would suggest that activation of DDR is normally required to limit, rather than serve as the trigger for upd3 production and death.

      Our data support the hypothesis that DDR signaling in hemocytes “modulates” upd3 levels upon oxidative stress. We now carefully revised the text and the graphical summary of the manuscript to emphasize that oxidative stress causes DNA damage, which subsequently induces the DNA damage signaling machinery. If this machinery is not sufficiently induced, for example by knockdown of tefu and mei-41, non-canonical DNA damage signaling is altered which induces JNK signaling and induces release of pro-inflammatory cytokines, including upd3. Whereas DNA damage itself is only slightly increase in the used DDR deficient lines (Figure 5C) and hemocytes do not undergo apoptosis (unaltered cell number on PQ (Figure 5B)), we conclude that loss of tefu, mei-41, or nbs1 causes dysregulation of inflammatory signaling cascades via non-canonical DNA damage signaling. However, oxidative stress itself seems to also induce upd3 release and DNA damage signaling in the same cell cluster, as shown by our snRNA-seq data (Figure 3B). Hence, we think that DNA damage signaling is needed as a rate-limiting step for upd3 release.

      c. hemocyte knockdown of either JNK activity or upd3 doesn't affect PQ-induced death, suggesting that they don't contribute to oxidative stress-induced death. It’s only when DDR is impaired (with DDR gene knockdown) that an increase in upd3 is seen (although no experiments addressed whether JNK was activated or involved in this induction of upd3), suggesting that DDR activation prevents upd3 induction upon oxidative stress.

      Whereas the double knockdown of upd3 or bsk and DDR genes was resulting in insufficient knockdown efficiencies, we added a rescue experiment where we combined upd3null mutants with knockdown of tefu and mei-41 in hemocytes and found a reduced susceptibility of DDR-deficient flies to oxidative stress.

      1. The connections between DDR, JNK and upd3 aren't fully developed. The experiments show that susceptibility to oxidative stress-induced death can be caused by a) knockdown of DDR genes, b) genetic overexpression of upd3, c) genetic activation of JNK. But whether these effects are all related and reflect a linear pathway requires a little more work. For example, one prediction of the proposed model is that the increased susceptibility to oxidative stress-induced death in the hemocyte DDR gene knockdowns would be suppressed (perhaps partially) by simultaneous knockdown of upd3 and/or JNK. These types of epistasis experiments would strengthen the model and the paper.

      As mentioned before, we had some technical difficulties combining the knockdown of bsk or upd3 with DDR genes. However, we added a new experiment in which we show that upd3null mutation can rescue the higher susceptibility of hemocytes with tefu and mei41 knockdown.

      1. The (potential) connections between DDR/JNK/UPD3 and the oxidative stress effects on depletion of nutrient (lipids and glycogen) stores was also not fully developed. However, it may be the case that, in this paper, the authors just want to speculate that the effects of hemocyte DDR/upd3 manipulation on viability upon oxidative stress involve changes in nutrient stores.

      In the revised version of the manuscript, we now provide a more thorough snRNA-seq analysis in the fat body upon PQ treatment to give more insights on the changes in the fat body upon PQ treatment. We added additional histological images of the abdominal fat body on control food and PQ food, to demonstrate the elimination of triglycerides from fat body with Oil-Red-O staining (Figure S1). We also analyzed now hemocyte-deficient (crq-Gal80ts>reaper) flies for their levels of triglycerides and carbohydrates during oxidative stress, to support our hypothesis that hemocytes are key players in the regulation of energy mobilization during oxidative stress. Loss of hemocytes (and therefore also their regulatory input on energy mobilization from the fat body) results in increased triglyceride storage in the fat body during steady state with a decreased consumption of these triglycerides on PQ food compared to control flies (Figure 1J). In contrast, glycogen storage and mobilization, which is mostly done in muscle, is not altered in these flies during oxidative stress (Figure 1L). Interestingly, free glucose levels are drastically reduced in hemocyte-deficient flies, which could be due to insufficient energy mobilization from the fat body and subsequently results in a higher susceptibility of these flies on oxidative stress (Figure 1K). Additionally, we aim to point out here that “functional” hemocytes are needed for effective response to oxidative stress, but this response has to be tightly balanced (see also new graphical abstract).

      Reviewer #2 (Public Review):

      Hersperger et al. investigated the importance of Drosophila immune cells, called hemocytes, in the response to oxidative stress in adult flies. They found that hemocytes are essential in this response, and using state-of-the-art single-cell transcriptomics, they identified expression changes at the level of individual hemocytes. This allowed them to cluster hemocytes into subgroups with different responses, which certainly represents very valuable work. One of the clusters appears to respond directly to oxidative stress and shows a very specific expression response that could be related to the observed systemic metabolic changes and energy mobilization. However, the association of these transcriptional changes in hemocytes with metabolic changes is not well established in this work. Using hemocyte-specific genetic manipulation, the authors convincingly show that the DNA damage response in hemocytes regulates JNK activity and subsequent expression of the JAK/STAT ligand Upd3. Silencing of the DNA damage response or excessive activation of JNK and Upd3 leads to increased susceptibility to oxidative stress. This nicely demonstrates the importance of tight control of JNK-Upd3 signaling in hemocytes during oxidative stress. However, it would have been nice to show here a link to systemic metabolic changes, as the authors conclude that it is tissue wasting caused by excessive Upd3 activation that leads to increased susceptibility, but metabolic changes were not analyzed in the manipulated flies.

      We thank the referee for the suggestion to better connect upd3 cytokine levels to energy mobilization from the fat body. We agree that this is an important point to support our hypothesis. First, we added now a detailed analysis of fat body cells in our snRNA-seq data to evaluate the changes induced in the fat body upon oxidative stress. We further added additional metabolic analyses of hemocyte-deficient flies (crq-Gal80ts>reaper) to support our hypothesis that hemocytes are key players in the regulation of energy mobilization during oxidative stress (see also answer to referee 1). Loss of the regulatory role of hemocytes in the energy mobilization and redistribution leads to a decreased consumption of these triglycerides on PQ food compared to control flies (Figure 1J). In contrast, glycogen storage and mobilization from muscle, is not affected in hemocyte-deficient flies during oxidative stress (Figure 1L). Interestingly, free glucose levels are drastically reduced in hemocyte-deficient flies compared to controls, which could be due to insufficient energy mobilization from the fat body resulting in a higher susceptibility to oxidative stress (Figure 1K). This data supports our assumption that “functional” hemocytes are needed for effective response to oxidative stress, but this response has to be tightly balanced (see also new graphical summary).

      The overall conclusion of this work, as presented by the authors, is that Upd3 expression in hemocytes under oxidative stress leads to tissue wasting, whereas in fact it has been shown that excessive hemocyte-specific Upd3 activation leads to increased susceptibility to oxidative stress (whether due to increased tissue wasting remains a question). The DNA damage response ensures tight control of JNK-Upd3, which is important. However, what role naturally occurring Upd3 expression plays in a single hemocyte cluster during oxidative stress has not been tested. What if the energy mobilization induced by this naturally occurring Upd3 expression during oxidative stress is actually beneficial, as the authors themselves state in the abstract - for potential tissue repair? It would have been useful to clarify in the manuscript that the observed pathological effects are due to overactivation of Upd3 (an important finding), but this does not necessarily mean that the observed expression of Upd3 in one cluster of hemocytes causes the pathology.

      We agree with the referee that the pathological effects and increased susceptibility to oxidative stress are mediated by over-activated hemocytes and enhanced cytokine release, including upd3 during oxidative stress. We edited the revised manuscript accordingly to imply a “regulatory” role of upd3, which we suspect and suggest as an important mediator for inter-organ communication between hemocytes and fat body. Whereas our used model for oxidative stress (15mM Paraquat feeding) is a severe insult from which most of the flies will not recover, we could not account and test how upd3 might influence tissue repair after injury, insults and infection. We believe that this is an important factor, we aim to explore in future studies.

      Reviewer #3 (Public Review):

      In this study, Kierdorf and colleagues investigated the function of hemocytes in oxidative stress response and found that non-canonical DNA damage response (DDR) is critical for controlling JNK activity and the expression of cytokine unpaired3. Hemocyte-mediated expression of upd3 and JNK determines the susceptibility to oxidative stress and systemic energy metabolism required for animal survival, suggesting a new role for hemocytes in the direct mediation of stress response and animal survival.

      Strength of the study:

      1. This study demonstrates the role of hemocytes in oxidative stress response in adults and provides novel insights into hemocytes in systemic stress response and animal homeostasis.

      2. The single-cell transcriptome profiling of adult hemocytes during Paraquat treatment, compared to controls, would be of broad interest to scientists in the field.

      We are grateful to these positive comments on our data and are excited that the referee pointed out the importance of our provided snRNA-seq analysis of hemocytes and other cell types during oxidative stress. In the revised, version we now extended this analysis and looked not only into hemocytes but also highlighted induced changes in the fat body (Figure 4).

      Weakness of the study:

      1. The authors claim that the non-canonical DNA damage response mechanism in hemocytes controls the susceptibility of animals through JNK and upd3 expression. However, the link between DDR-JNK/upd3 in oxidative stress response is incomplete and some of the descriptions do not match their data.

      In the revised manuscript, we aimed to strengthen the weaknesses pointed out by the referee. We now included additional genetic crosses to validate the connection of DDR signaling in hemocytes with upd3 release. For example, we added now survival studies where we show that upd3null mutation can rescue the higher susceptibility of flies with tefu and mei41 knockdown in hemocytes during oxidative stress. Furthermore, we added additional data to highlight the importance of hemocytes themselves as essential regulators of susceptibility to oxidative stress. We analyzed the hemocyte-deficient flies (crq-Gal80ts>reaper) for their triglyceride content and carbohydrate levels during oxidative stress (Figure 1 I-L). As outlined above, loss of hemocytes leads to a decreased consumption of these triglycerides on PQ food compared to control flies (Figure 1J). In contrast, glycogen storage and mobilization from muscle, is not affected in hemocyte-deficient flies during oxidative stress (Figure 1L). Interestingly, free glucose levels are drastically reduced in hemocyte-deficient flies, which could be due to insufficient energy mobilization from the fat body resulting in a higher susceptibility to oxidative stress (Figure 1K).

      1. The schematic diagram does not accurately represent the authors' findings and requires further modifications.

      We carefully revised the text throughout the manuscript describing our results and edited the graphical abstract to display that upd3 levels and hemocytes are essential to balance and modulate response to oxidative stress.

      Reviewer #1 (Recommendations For The Authors):

      The summary doesn't say too much about what the specific discoveries and results of the study are. The description is limited to just one sentence saying, "Here we describe the responses of hemocytes in adult Drosophila to oxidative stress and the essential role of non-canonical DNA damage repair activity in direct "responder" hemocytes to control JNK-mediated stress signaling, systemic levels of the cytokine upd3 and subsequently susceptibility to oxidative stress" which doesn't provide sufficient explanation of what the results were.

      In the revised version of our manuscript, we now provide further information for the reader to outline the findings of our study in a concise way in the summary.

      Reviewer #2 (Recommendations For The Authors):

      1. To strengthen the conclusion that the DDR response suppresses JNK, and thus Upd3, rescue of DDR by upd3 null mutation would help (knockdown by Hml>upd3IR might not work, RNAi seems problematic).

      We would like to thank the referee for this suggestion and included now a genetic experiment where we combined upd3null mutants with hemocyte-specific knockdown of mei-41 and tefu to test their susceptibility to oxidative stress. Our data indeed provide evidence that loss of upd3 rescues the higher susceptibility of flies with hemocyte-specific knockdown for tefu and mei-41 (Figure 6F). Furthermore, we see that upd3null mutants show a diminished susceptibility to oxidative stress compared to control flies (Figure 6F).

      1. To link the observed effects to systemic metabolic changes, it would be useful to measure glycogen and triglycerides in these flies as well:
      2. crq-Gal80ts>reaper to see what role hemocytes play in the observed metabolic changes.

      3. Hml-Upd3 overexpression and Upd3 null mutant (Upd3 RNAi seems to be problematic, we have similar experiences) to see if Upd3 overexpression leads to even more profound changes as suggested, and if Upd3 mutation at least partially suppresses the observed changes.

      We agree with the referee that analyzing the connection of hemocyte activation to metabolic changes should be demonstrated in our manuscript to support our claim that hemocytes are important regulators of energy mobilization during oxidative stress. Hence, we analyzed triglycerides and carbohydrate levels in hemocyte-deficient flies (crq-Gal80ts>reaper) during oxidative stress. Indeed, we found substantial differences in energy mobilization in these flies supporting the assumption that the higher susceptibility of hemocyte-deficient flies could be caused by substantial decrease in free glucose and inefficient lysis of triglycerides from the fat body (Figure 1I-K).

      1. To test whether the cause of the increased susceptibility to oxidative stress is due to Upd3 overactivation induced by DDR silencing, the authors should attempt to rescue DDR silencing with an Upd3 null mutation.

      The suggestion of the reviewer was included in the revised manuscript and as outlined above we now added this data set to our manuscript (Figure 6F). Indeed, we can now provide evidence that upd3null mutation rescues the higher susceptibility of flies with DDR knockdown in hemocytes.

      1. Lethality after PQ treatment varies widely (sometimes from 10 to 90%! as in Figure 5D) - is this normal? In some experiments the variability was much lower. In particular, Figure 5D is very problematic and for example the result with upd3 null mutant compared to control is not very convincing. This could be an important result to test whether Upd3, with normal expression likely coming from cluster 6, actually plays a beneficial role, whereas overexpression with Hml leads to pathology.

      We agree with the referee that it would be more convincing if the variation cross of survival experiments would be less. However, we included a lot of flies and vials in many individual experiments to test our hypothesis and variation in these survivals was always the case. These effects can be caused by many factors for example the amount of food intake by the flies, genetic background or inserted transgenes. The n-number is quite high across our survivals; so that we are convinced, the seen effects are valid. This reflects also the power of using Drosophila melanogaster as a model organism for such survivals. The high n-number in our data falls into a normal Gauss distribution with a distinct mean susceptibility between the genotypes analyzed.

      1. I like the conclusion at the end of the results: line 413: "We show that this oxidative stressmediated immune activation seems to be controlled by non-canonical DNA damage signaling resulting in JNK activation and subsequent upd3 expression, which can render the adult fly more susceptible to oxidative stress when it is over-activated." This is actually a more appropriate conclusion, but in the summary, introduction and discussion along with the overall schematic illustration, this is not actually stated as such, but rather as Upd3 released from cluster 6 causes the pathology. For example: line 435 "Hence, we postulate that hemocyte-derived upd3, most likely released by the activated plasmatocyte cluster C6 during oxidative stress in vivo and subsequently controlling energy mobilization and subsequent tissue wasting upon oxidative stress."

      We thank the referee for this suggestion and edited our manuscript and conclusions accordingly.

      Reviewer #3 (Recommendations For The Authors):

      1. In Figure 2, the authors claim showed that PQ treatment changes the hemocyte clusters in a way that suppresses the conventional Hml+ or Pxn+ hemocytes (cluster1) while expanding hemocyte clusters enriched with metabolic genes such as Lpin, bmm etc. It is not clear whether these cells are comparable to the fat body and if these clusters express any of previously known hemocyte marker genes to claim that these are bona fide hemocytes.

      We now included a new analysis of our snRNA-seq data in Figure S4, where we clearly show that all identified hemocyte clusters do not have a fat body signature and are hemocytes, which seem to undergo metabolic adaptations (Figure S4A). Furthermore, we show that the identified fat body cells have a clear fat body signature (Figure S4B) and do not express specific hemocyte markers (Figure S4C).

      1. In Figure 4C, the authors showed that comet assays of isolated hemocytes result in a statistically significant increase in DNA damage in DDR-deficient flies before and after PQ treatment. However, the authors conclude that, in lines 324-328, the higher susceptibility of DDR-deficient flies is not due to an increase in DNA damage. To explicitly conclude that "non-canonical" DNA damage response, without any DNA damage, is specifically upregulated during PQ treatment, the authors require further support to exclude the potential activation of canonical DDR.

      The referee is correct that we do not provide direct evidence for non-canonical DNA damage signaling. Therefore, we also decided to tune down our statement here a bit and removed that claim from the title. Increase in DNA damage can of course also increase the non-canonical DNA damage signaling pathway, loss of DNA damage signaling genes such as tefu and mei-41 seem to only have minor impacts on the overall amount of DNA damage acquired in hemocytes by oxidative stress. We therefore concluded that the induction in immune activation is most unlikely only caused by increased DNA damage but might be connected to dysregulation in non-canonical DNA damage signaling. Canonical DNA damage signaling leads essentially to DDR, which could be slow in adult hemocytes because they post-mitotic, or to apoptosis, which we could not observe in the analyzed time window in our experiments. Hemocyte number remained stable over the 24h PQ treatment without reduction in cell number (Figure 1H).

      1. From Figure 4D-F, the authors showed that loss of DDR in hemocytes induces the expression of unpaired 2 and 3, Socs36E, which represent the JAK/STAT pathway, and thor, InR, Pepck in the InR pathway, and a JNK readout, puc. These results indicate that the DDR pathway normally inhibits the upd-mediated JAK/STAT activation upon PQ treatment, compared to wild-type animals during PQ treatment in Figure 1B-C, which in turn protects the animal during oxidative stress responses. However, the authors claim that "enhanced DNA damage boosts immune activation and therefore susceptibility to oxidative stress (lines 365-366); we show that this oxidative stress-mediated immune activation seems to be controlled by non-canonical DNA damage signaling resulting in JNK activation and subsequent upd3 expression (line 413-416)". These conclusions are not compatible with the authors' data and may require additional data to support or can be modified.

      In the revised manuscript, we carefully revised now the text and our statements that it seems that DNA damage signaling in hemocytes has regulatory or modulatory effect on the immune response during oxidative stress. Accordingly, we also adjusted our graphical summary. We agree with the referee and used the term “non-canonical” DNA damage signaling more carefully throughout the manuscript. The slight increase in DNA damage seen after PQ treatment can contribute to immune activation but seems to be not correlative to the induced cytokine levels or the susceptibility of the flies to oxidative stress.

      1. In Fig 1I, the authors showed that genetic ablation of hemocytes using UAS-repear induces susceptibility to PQ treatment. It is possible that inducing cell death in hemocytes itself causes the expression of cytokine upd3 or activates the JNK pathway to enhance the basal level of upd3/JNK even without PQ treatment. If this phenotype is solely mediated by the loss of hemocytes, the results should be repeated by reducing the number of hemocytes with alternative genetic backgrounds.

      In the different genotypes analyzed across our manuscript we did not detect cell death of hemocytes or a dramatic reduction in hemocytes number (see Figure 1H, Figure 5B, Figure 6C). The higher susceptibility if hemocyte-deficient flies during oxidative stress is most likely caused by the loss of their regulatory role during energy mobilization. We tested triglyceride levels in hemocyte-deficient flies and found a decreased triglyceride consumption (lipolysis), with reduced levels of circulating glucose levels. This findings support our hypothesis that hemocytes are needed to balance the response to oxidative stress. In contrast, the flies with DDR-deficient hemocytes show higher systemic cytokine levels, which most likely enhance energy mobilization from the fat body and therefore result in a higher susceptibility of the fly to oxidative stress. Hence, we claim that hemocytes and their regulation of systemic cytokine levels are important to balance the response to oxidative stress and guarantee the survival of the organism.

      1. Lethality of control animals in PQ treatment is variable and it is hard to estimate the effect of animal susceptibility during 15mM PQ feeding. For example, Fig1A shows that control animals exhibit ~10% death during 15mM PQ which is further enhanced by crq-Gal80>reaper expression to 40% (Fig 1I). However, in Fig 5D-E, the basal lethality of wild-type controls already reaches 40~50%, which makes them hard to compare with other genetic manipulations. Related to this, the authors demonstrated that the expression of upd3 in hemocytes is sufficient to aggravate animal survival upon PQ treatment; however, upd3 null mutants do not rescue the lethality, which indicates that upd3 is not required for hampering animal mortality. These data need to be revisited and analyzed.

      As outlined above, we find the variability of susceptibility to oxidative stress across all of our experiments. This could be due to different effects such as food intake but also transgene insertion and genetic background. Crq-gal80ts>reaper flies are healthy, but show a shortened life span on normal food (Kierdorf et al., 2020) due to enhanced loss of proteostasis in muscles. We show in the revised manuscript that these flies have a higher susceptibility to oxidative stress and that this effect could be mediated by defects in energy mobilization and redistribution as shown by less triglyceride lysis from the fat body and decreasing levels in free glucose. This would explain the high mortality rate of these flies at 7 days after eclosion. Paraquat treatment (15mM) is a severe inducer of oxidative stress, which results in death of most flies when they are maintained for longer time windows on PQ food. Hence, it is a model, which is not suitable to examine and monitor recovery from this detrimental insult. upd3null mutants were extensively reexamined in this manuscript, and even though we could not see a full protection of these flies from oxidative stress induced death, we found a reduced susceptibility compared to control flies (Figure 6F). Furthermore, when we combined upd3null mutants with flies deficient for tefu and mei-41 in hemocytes, the increased susceptibility to oxidative stress was rescued.

    1. Author Response

      The following is the authors’ response to the original reviews.

      Reviewer #1

      1) IR reduced mature spines (mushroom) but not immature spines (filopodia) in vitro at 14 days post-2 Gy IR. Please check previous reports by C. Limoli and J. Fike groups (in vivo dendritic spine characterization following proton or photon irradiation).

      We appreciate the reviewer's comments. Although IR did not reduce filopodia in the previous study, there are no prior studies using the same time points as ours, 4 days post-2 Gy IR. Additionally, according to other previous studies, PAK3 inhibition led to an increase in filopodia (J Neurosci. 2004 Dec 1;24(48):10816-25), and IR increased thin-type spines and decreased mushroom-type spines at the 7 days after 2 Gy IR (PLoS One. 2012;7(7):e40844). Considering these findings, we believe that the increase in filopodia observed in our study is due to the short-term effects of IR and the consequent PAK3 downregulation. We added the description regarding time point in “Materials and Methods”.

      Page 20, line 439-440; "In the analysis of molecular alterations, cultured neurons were sampled 4 days after irradiation."

      2) Does IR (2 Gy or 5 x 2 Gy) affect the viability in vitro? This could be linked with reduced dendritic structure and F/G-actin ratios.

      As the reviewer mentioned, we evaluated neuronal viability following 2 Gy IR exposure. Consequently, approximately 80% of the cells survived after the IR exposure (Fig. 4A). Although we agree that cognitive abilities may decrease due to the neuron death after IR, we identified that PAK3 overexpression restores the F/G-actin ratio in surviving neurons after IR, suggesting the IR-induced alterations at least in neuronal plasticity are mainly regulated by PAK3 rather than IR itself. Additionally, neurons that survive after IR maintain similar levels of NeuN, a mature neuron marker (Fig. S5A). We added the description regarding additional experiments in “Results”.

      Page 10, line 206-209; "IR decreased neuronal viability in human differentiated neurons, with approximately 80% survival (Fig 4A). However, IR did not alter the mature neuronal marker, NeuN (Fig S5A). These results indicate that IR-induced disruption of PAK3 signaling occurs in surviving neurons following irradiation. Consistent with previous murine neuron data, IR reduced the F/G-actin ratio (Fig. 4B)."

      3) The authors state, "Overall, these results indicated that IR could induce cognitive impairment by disrupting dendritic spine maturation." Dendritic spine damage may not be the only factor contributing to cognitive dysfunction (neural circuit function, neuroinflammation, astrogliosis, etc., needs to be discussed).

      We agree with the reviewer's comment that dendritic spine damage may not be the only factor contributing to cognitive impairment. Since our study has only confirmed the effects on dendritic spines as part of the complex impact of radiation, we added the description of the necessity for further research on various factors related to IR-induced cognitive dysfunction in “Discussion”.

      Page 15, line 317-324; >The dendritic spine is one of the major factors influencing cognitive function. In our study, we observed changes in dendritic spines due to radiation exposure, followed by subsequent cognitive impairment. Additionally, we established that regulating PAK3, which affects dendritic spine maturation, can modulate radiation-induced cognitive dysfunction. However, considering that radiation can impact the entire nervous system and that neural circuit function, neuroinflammation, and astrogliosis can also influence cognitive function (Makale et al., 2017), future studies is needed to investigate the mechanisms of factors beyond dendritic spine changes caused by radiation.>

      4) Fig 2 and Suppl Fig S2. The in vivo results should be placed in the manuscript Fig 2 as this would provide relevant physiological information on PAK3 downregulation and reduced dendritic spines and cognition.

      We appreciated the reviewer's comment. As the reviewer mentioned, we rearranged Fig S2C to Fig 2H.

      Page 33, line 825-827; "(H) Left: the protein levels of phosphorylated LIMK1, LIMK1, phosphorylated cofilin, and cofilin after IR in frontal cortex and hippocampus. Right: each western blot bands are quantified by ImageJ."

      5) miR-206-3p expression was found to be elevated post-IR in the human and mouse neurons in vitro. This was correlated with IR-induced downregulation of PAK3 using an antagonist miR experiment, wherein PAK3, LIMK1, and downstream makers were restored in the irradiated neurons. MiR-206-3p upregulation data should also be confirmed in vivo using an irradiated mouse brain to correlate the cognitive dysfunction timepoint.

      We observed IR-induced miR-206-3p upregulation (Fig 6D) and consequent PAK3 downregulation (Fig 6G) in vivo at 4 days after IR. Considering that the antagomiR significantly restores cognitive dysfunction (Fig 6E) at 1-3 days after IR, we suppose the expression of miR-206-3p would be consistently increased by IR, suppressing the PAK3 signaling pathway and leading to cognitive dysfunction.

      Page 33, line 825-827; "(H) Left: the protein levels of phosphorylated LIMK1, LIMK1, phosphorylated cofilin, and cofilin after IR in frontal cortex and hippocampus. Right: each western blot bands are quantified by ImageJ."

      6) Fig 5 shows that in vivo administration of antago-miR-206 reversed IR-induced upregulation of miR-206, reductions in PAK3 and downstream markers, and, importantly, reversed cognitive deficits induced by IR. This data should be supported by in vivo staining for important dendritic markers, including cofillin/p-cofilin, PSD-95, F- and G-actin within the hippocampal and PFC regions.

      We appreciated the reviewer's comment. Based on previous studies on intranasal administration, the substance is delivered to the PFC and hippocampus through the olfactory pathway in both humans and mice (Exp Neurobiol. 2020 Dec 31;29(6):453-469, Stem Cells. 2021 Dec;39(12):1589-1600). Even though we did not show direct evidence that antagomiR-206 is delivered to both regions, we confirmed its actual delivery to the brain using Cy5 fluorescence and examined PAK3 signaling (Fig. 6G) and the F/G-actin ratio (Fig. 6H) in both regions. To show the reliability of the tissue separation, we added a detailed description of the tissue separation method in “Materials and Methods”.

      Page 19, line 410-423; "Dissection of prefrontal cortex and hippocampus. The dissection of mouse brain regions was performed following a previous study (Spijker, 2011). First, to obtain the hippocampal region, we gently held the brain and opened the forceps, slowly separating the cortical halves. Once an opening had been created along the midline for approximately 60%, we directed the forceps (in the closed position) counterclockwise by 30–40° to expose the left cortex from the hippocampus, repeatedly opening the forceps as necessary. We then repeated the same procedure for the right cortex by pointing the forceps in a 30–40° clockwise direction until the upper part of the hippocampus became visible. At the most caudal part of the hippocampus/cortex boundary, we moved the small forceps through the cortex and used them to separate the hippocampus from the fornix. After removing the hippocampus, we used the large forceps to fold the cortex back into its original position. Subsequently, we placed the brain with the dorsal side and cut coronal sections to reveal the prefrontal cortex and striatum at different levels. Using a sharp razor blade, we made the first cut to remove the olfactory bulb and cut the section containing the prefrontal cortex."

      7) Does this change in the F/G actin ratios, Cofillin, and/or p-Cofillin impact any particular neuronal subtypes, including excitatory, inhibitory or any particular layers of major neurons? This point can't be appreciated from the WB data.

      The excitatory and inhibitory neurons do play crucial roles in cognitive function. In terms of response to radiation, excitatory neurons are more likely to be responsive. A previous study showed that spike firing and excitatory synaptic input were reduced by cranial irradiation, while inhibitory input was increased (Neural Regen Res. 2022 Oct;17(10):2253-2259). Additionally, PSD-95 is localized to dense specialized regions within the dendritic spines of excitatory synapses and is associated with synaptic plasticity (Neuron. 2001 Aug 2;31(2):289-303). Indeed, IR decreases the mRNA level of PSD-95 in differentiated human neurons (Fig S5A). Considering the previous research and our data, IR-induced PAK3 downregulation may occur primarily in excitatory neurons.

      8) Discussion: "In this study, we investigated the effect of cranial irradiation on cognitive function and the underlying mechanisms in a mouse model." Please change this statement to "....underlying neuronal mechanisms using in vivo and in vitro models."

      We appreciate the reviewer’s comment. We replaced ‘mechanisms in a mouse model’ with ‘neuronal mechanisms using in vivo and in vitro models.’ in the manuscript.

      Page 14, line 283; "In this study, we investigated the effect of cranial irradiation on cognitive function and the underlying neuronal mechanisms using in vivo and in vitro models."

      9) Discussion: "Furthermore, our study identifies a potential mechanism underlying the cognitive impairment associated with cranial irradiation, which downregulates PAK3 expression." This statement should be supported by the in vivo immunofluorescence data for the synaptic markers, including cofilin, p-cofillin, PSD-95, and F/G-actin staining.

      Even though we did not show the in vivo immunofluorescence data for the synaptic markers, we examined PAK3 signaling (Fig. 6G) and the F/G-actin ratio (Fig. 6H) in the hippocampal and PFC regions. Additionally, according to The Allen Mouse Brain Atlas, PAK3 is mainly expressed in the PFC and hippocampus regions (Fig S2A), suggesting that IR-induced PAK3 downregulation in both regions may have a significant impact on the cognitive impairment. Considering these data, we strongly believe that cranial irradiation downregulates PAK3 levels in the PFC and hippocampus, thus inducing cognitive impairment.

      10) miR modulate function by affecting multiple targets. The other potential neuronal and non-neuronal targets for miR-206-3p were not discussed. This possibility should be confirmed using relevant markers.

      According to the reviewer’s comment, we performed real-time PCR to examine whether miR-206-3p affects the expressions of neuronal and non-neuronal markers (Fig S5A and S5B). As a result, the post-synaptic marker, PSD-95, was reduced by miR-206-3p treatment. However, a mature neuronal marker (NeuN) and non-neuronal markers (GFAP and IBA-1) did not change upon miR-206-3p treatment. We added the related description in “Results”.

      Page 12, line 240-243; "Additionally, the post-synaptic marker, PSD-95, was decreased by miR-206-3p treatment. However, a mature neuronal marker (NeuN) and non-neuronal markers (GFAP and IBA-1) were not alterd upon miR-206-3p treatment (Fig. S5A and S5B)."

      11) Irradiation procedure: Please confirm that sham (0 Gy)-irradiated mice were also anesthetized for a similar procedure carried out for the 2 Gy or fractionated irradiation.

      According to the reviewer's comment, we added a description of sham (0 Gy)-irradiated mice in “Materials and Methods”.

      Page 17, line 359-360; "All mice, including those in the sham (0 Gy) group, were anesthetized with an intraperitoneal (i.p.) injection of zoletil (5 mg/10 g) daily for five days."

      12) 24 mL volume (antagomir treatment) via intra-nasal delivery is a rather unusually high volume. Please clarify if such a procedure was approved by the regulatory committee and if 24 mL volume led to any hemodilution.

      We appreciate the reviewer's comment. We referred to the protocol of intranasal administration from a previous study (Mol Ther. 2021 Dec 1;29(12):3465-3483), and made an error in specifying the miRNA unit. We corrected it from mL to μL.

      Page 19, line 399-402; "According to the manufacturer’s instructions and previous study (Zhou et al., 2021), 40 nmol of antagomiR-206-3p (sequence: 5’-CCACACACUUCCUUACAUUCCA -3’) or antagomiR-NC (the antagomiR negative control, its antisense chain sequence: 5’-UCUACUCUUUCUAGGAGGUUGUGA-3’) was dissolved in 1 mL of RNase-free water."

      Page 19, line 402-403; "A total of 24 μL of the solution (1 nmol per one mouse) was instilled with a pipette, alternately into the left and right nostrils (1 μL/time), with an interval of 3–5 min."

      Reviewer #2

      1) To show the relevance of PAK3 in Radiation-induced neurocognitive decrements, I suggest using 10 Gy WBI, group of 15-16 animals and long-term follow up >2 months post-RT.

      We appreciate the reviewer's comment. Biologically Effective Dose (BED) represents the most accurate quantitative prediction of biological effects of radiation. However, our study aimed to analyze the mechanisms underlying cognitive dysfunction induced not by a total dose of 10 Gy but rather by repeating 2 Gy fractions, which is used in clinical practice such as prophylactic cranial irradiation. In this regard, the administration of 2 Gy fractions holds significant relevance in our research.

      In statistical analysis, a larger sample size tends to be more accurate. However, we determined the sample size based on ethical considerations in animal research, taking into account the parameter (Effect size: 1.2 / alpha value: 0.05 / Group: 3 groups), resulting in a total sample size of 15, five mice per group (G Power 3.1 software). Despite the relatively small sample size, radiation exposure significantly reduced PAK3 expression with marginal variance, thereby inducing cognitive impairment.

      As the reviewer mentioned, the long-term effect (>2 months) of WBI may show more severe cognitive impairment, considering results from the previous studies. Nevertheless, previous research has revealed a correlation between mouse age and human age, suggesting that 2 months in mice is roughly equivalent to 5 years in humans (Life Sci. 2020 Feb 1;242:117242). Due to the substantial difference in biological time between humans and mice, 2 months in mice might be an excessive long-term period. Additionally, our study aims to investigate short-term changes rather than long-term effects. It is clear that IR-induced PAK3 downregulation induces cognitive impairment at least in the short-term period, and we believe that our findings may contribute to preventing serious neuronal dysfunction as the long-term side effects of PCI.

    1. Author Response

      The following is the authors’ response to the original reviews.

      Public Reviews:

      Reviewer #1 (Public Review):

      “Peng et al develop a computational method to predict/rank transcription factors (TFs) according to their likelihood of being pioneer transcription factors--factors that are capable of binding nucleosomes--using ChIP-seq for 225 human transcription factors, MNase-seq and DNase-seq data from five cell lines. The authors developed relatively straightforward, easy to interpret computational methods that leverage the potential for MNase-seq to enable relatively precise identification of the nucleosome dyad. Using an established smoothing approach and local peak identification methods to estimate positions together with identification of ChIP-seq peaks and motifs within those peaks which they referred to as "ChIP-seq motifs", they were able to quantify "motif profiles" and their density in nucleosome regions (NRs) and nucleosome free regions (NFRs) relative to their estimated nucleosome dyad positions. Using these profiles, they arrived at an odd-ratio based motif enrichment score along with a Fisher's exact test to assess the odds and significance that a given transcription factor's ChIP-seq motifs are enriched in NRs compared to NFRs, hence, its potential to be a pioneer transcription factor. They showed that known pioneer transcription factors had among the highest enrichment scores, and they could identify 32 relatively novel pioneer TFs with high enrichment scores and relatively high expression in their corresponding cell line. They used multiple validation approaches including (1) calculating the ROC-AUC associated with their enrichment score based on 16 known pioneer TFs among their 225 TFs which they used as positives and the remaining TFs (among the 225) as negatives; (2) use of the literature to note that known pioneer TFs that acted as key regulators of embryonic stem cell differentiation had a highest enrichment scores; (3) comparison of their enrichments scores to three classes of TFs defined by protein microarray and electromobility shift assays (1. strong binder to free and nucleosomal DNA, 2. weak binder to free and nucleosomal DNA, 3. strong binding to free but not nucleosomal DNA); and (4) correlation between their calculated TF motif nucleosome end/dyad binding ratio and relevant data from an NCAP-SELEX experiment. They also characterize the spatial distribution of TF motif binding relative to the dyad by (1) correlating TF motif density and nucleosome occupancy and (2) clustering TF motif binding profiles relative to their distance from the dyad and identifying 6 clusters.

      The strengths of this paper are the use of MNase-seq data to define relatively precise dyad positions and ChIP-seq data together with motif analysis to arrive at relatively accurate TF binding profiles relative to dyad positions in NRs as well as in NFRs. This allowed them to use a relatively simple odds ratio based enrichment score which performs well in identifying known pioneer TFs. Moreover, their validation approaches either produced highly significant or reasonable, trending results.

      The weaknesses of the paper are relatively minor. The most significant one is that they used ROC-AUC to assess the prediction accuracy of their enrichment score on a highly imbalanced dataset with 16 positives and 209 negatives. ROC-AUC is known to be a misleading prediction measure on highly imbalanced data. This is mitigated by the fact that they find an AUC = 0.94 for their best case. Thus, they're likely to find good results using a more appropriate performance measure for imbalanced data. Another minor point is that they did not associate their enrichment score (focus of Figure 2) with their correlation coefficients of TF motif density and nucleosome occupancy (focus of Figure 3). Finally, while the manuscript was clearly written, some parts of the Methods section could have been made more clear so that their approaches could be reproduced. The description of the NCAP-SELEX method could have also been more clear for a reader not familiar with this approach.”

      Reviewer #2 (Public Review):

      “In this study, the authors utilize a compendium of public genomic data to identify transcription factors (TF) that can identify their DNA binding motifs in the presence of nuclosome-wrapped chromatin and convert the chromatin to open chromatin. This class of TFs are termed Pioneer TFs (PTFs). A major strength of the study is the concept, whose premise is that motifs bound by PTFs (assessed by ChIP-seq for the respective TFs) should be present in both "closed" nucleosome wrapped DNA regions (measured by MNase-seq) as well as open regions (measured by DNAseI-seq) because the PTFs are able to open the chromatin. Use of multiple ENCODE cell lines, including the H1 stem cell line, enabled the authors to assess if binding at motifs changes from closed to open. Typical, non-PTF TFs are expected to only bind motifs in open chromatin regions (measured by DNaseI-seq) and not in regions closed in any cell type. This study contributes to the field a validation of PTFs that are already known to have pioneering activity and presents an interesting approach to quantify PTF activity.

      For this reviewer, there were a few notable limitations. One was the uncertainty regarding whether expression of the respective TFs across cell types was taken into account. This would help inform if a TF would be able to open chromatin. Another limitation was the cell types used. While understandable that these cell types were used, because of their deep epigenetic phenotyping and public availability, they are mostly transformed and do not bear close similarity to lineages in a healthy organism. Next, the methods used to identify PTFs were not made available in an easy-to-use tool for other researchers who may seek to identify PTFs in their cell type(s) of interest. Lastly, some terms used were not defined explicitly (e.g., meaning of dyads) and the language in the manuscript was often difficult to follow and contained improper English grammar.”

      Reviewer #3 (Public Review):

      Peng et al. designed a computational framework for identifying pioneer factors using epigenomic data from five cell types. The identification of pioneer factors is important for our understanding of the epigenetic and transcriptional regulation of cells. A computational approach toward this goal can significantly reduce the burden of labor-intensive experimental validation. Nevertheless, there are several caveats in the current analysis which may require some modification of the computational methods and additional analysis to maximize the confidence of the pioneer factor prediction results.

      A key consideration that arises during this review is that the current analysis anchors on H1 ESC and therefore may have biased the results toward the identification of pioneer factors that are relevant to the four other differentiated cell types. The low ranking of Yamanaka factors and known pioneer factors of NFYs and ESRRB may be due to the setup of the computational framework. Analysis should be repeated by using each of every cell type as an anchor for validating the reproducibility of the pioneer factors found so far and also to investigate whether TFs related to ESC identity (e.g. Yamanaka factors, NFYs and ESRRB) would show significant changes in their ranking. Given the potential cell type specificity of the pioneer factors, the extension to more cell types appears to be important for further demonstrating the utility of the computational framework.

      Author Response: We thank all reviewers for their thoughtful and constructive comments and suggestions, which helped us to strengthen our paper. Following the suggestions, we have performed additional analysis to address the reviewer’s comments and the detailed responses are itemized below.

      Reviewer #1 (Recommendations For The Authors):

      1. The authors should generate precision-recall curves in addition to (or replacing) the ROC-AUC curves shown Figure 2c. They should also calculate the precision-recall AUC and use that as their measure of enrichment score predication accuracy. Precision-recall curves and AUC are more appropriate for imbalanced positive-negative data as is the case in this study.

      Response: Following the reviewer’s suggestion, we have performed precision-recall analysis and calculated Matthews correlation coefficients (MCC) (Figure 2). We have further expanded our validation set to 32 known pioneer transcription factors (Supplementary Table 5) and compared the performance of enrichment score using different test sets (Supplementary Table 10). We have attained the highest ROC = 0.71, pr-ROC-AUC = 0.37 and MCC = 0.31 for Test set1 and ROC = 0.92, pr-ROC-AUC = 0.45 and MCC=0.49 for Test set2 (Supplementary Table 11).

      1. The authors should generate scatter plots of their TF enrichment scores (focus of Figure 2) and motif-density nucleosome occupancy Pearson correlation coefficients (focus of Figure 3) and calculate the corresponding correlation coefficient and p-value.

      Response: We observed a weak but statistically significant correlation between the enrichment scores and the correlation coefficient values (R=0.32 and p-value=1e-9)).

      1. The authors should write their computational methods in the Methods section in such a way that a skilled bioinformatician could reproduce their results. This does not require a major rewrite. They are very close. One example of this is that a minimum distance between neighboring local maxima of the smoothed dyad counts was set to 150 bps. How was this algorithmically done? Suppress/ignore weaker local maxima that are within 150bp of other stronger local maxima?

      Response: We have revised the Methods section to make it easier to follow and to reproduce the results. For identifying the local maxima, we have used the bwtool with the parameters ‘‘find local-extrema -maxima -min-sep=150’’ so that local maxima located within 150 bp of another neighboring maxima was ignored to avoid local clusters of extrema.

      1. Describe the NCAP-SELEX method more clearly so that a reader not familiar with this approach doesn't have to look it up. This can be brief.

      Response: Following the reviewer’s suggestion, we have added a detailed description of the NCAP-SELEX method.

      Reviewer #2 (Recommendations For The Authors):

      To improve the manuscript:

      1. The grammar in the manuscript should be read for accuracy to improve readability and clarify the exact meaning.

      Response: We have improved the grammar and have clarified the meaning of terms.

      1. The exact meaning of dyads needs to be defined up front. In some places seems to mean pairs of reads and others seems to refer to nucleosome positioning.

      Response: The meaning of “dyads” has been clarified. The dyad positions were determined by the midpoints of the mapped reads in MNase-seq data and refer to the center of the nucleosomal DNA.

      1. Meaning of NCAP-SELEX needs to be defined before use of acronym.

      Response: We have defined it in the manuscript.

      Reviewer #3 (Recommendations For The Authors):

      1. The authors found that Yamanaka factors and several other known pioneer factors (e.g. NFY-A, NFY-B, and ESRRB) are lowly ranked in their pioneer factor analysis. Since the analysis was performed by anchoring on H1 ESCs and comparing them to the other four cell lines, the results may only be relevant to differentiated cell types. It is therefore not unexpected that the Yamanaka factors which are important for iPSC reprogramming and the NFYs which have been experimentally shown to replace nucleosomes for maintaining ESC identity from differentiation (PMID: 25132174; PMID: 31296853) would not be enriched in the analysis. I suggest the authors repeat their analysis by anchoring on differentiated cell types and validate the reproducibility of the pioneer factors found so far and also investigate whether TFs related to ESC identity (e.g. Yamanaka factors, NFYs, and ESRRB) would show significant changes in their ranking as pioneer factors.

      Response: Following reviewer’s suggestions, we have repeated the enrichment analysis by redefining differentially open regions as those closed in differentiated cell lines (HepG2, HeLa-S3, MCF-7 and K562) and open in H1 embryonic cell line (Supplementary Figure 6). The results indicate that most known PTFs still showed significantly higher enrichment scores compared with other TFs especially for FOXA, GATA and CEBPB families. Interestingly, ESSRB and Yamanaka pioneer factor POU5F1 (OCT4) have also shown significantly high enrichment scores in this analysis (Supplementary Figure 6). This could be explained by the roles of Yamanaka factors in cellular reprogramming – they reprogram somatic differentiated cells into induced pluripotent stem cells.

      1. The authors mentioned the cell-type-specificity of TFs been pioneer factors and the example of CTCF was given. This point relates closely to above point 1 and, in particular, the correlation analysis of Yamanaka factors and NFYs supports their binding to nucleosomes. Together, these results highlight potential caveats of the current analysis in that the analysis is likely to be limited to the available cell types and may be affected by which cell type was used as the anchor cell type.

      Response: Differentiated and embryonic cell lines were used to ask specific question about the functional roles of PTFs for cell differentiation and stem cell reprogramming. In the revised manuscript, we have clarified this point and separated our data set into three different sets of PTFs with different functions (Supplementary table 10). We agree with the reviewer, it would be nice to have more data from other cell lines but unfortunately the matching between different Chip-seq, DNAase-seq and Mnase-seq data sets imposes strict limitations.

      1. The differential and conserved open chromatin regions are defined based on overlaps found between five cell types using their DNase-seq mapping profiles. The limitation of this definition is its lack of quantitativeness. For example, a chromatin region can have more than 80% overlaps between H1 and another cell type but the level of accessibility (e.g. number of reads mapped to this region) can be quite different between cell types. In such a case, I think it is still more appropriate to define such a region as a differential open chromatin region. The author should explore whether using a more quantitative definition would improve the identification and categorization of differential and conserved open chromatin regions.

      Response: we thank the reviewer for these suggestions. In the revised version, we have clarified the definition and further explored different thresholds in defining the differentially and conserved open chromatin regions in enrichment analysis (Supplementary Figure 8). Our results were not significantly affected when different thresholds are applied.

      1. While it is mentioned that H3K27ac and H3K4me1 ChIP-seq data from the five human cell lines were used in the study, the information on how enhancers are mapped/defined in these cell types is lacking.

      Response: We have clarified the definition in the text. The enhancer regions were identified as the open chromatin regions overlapped with both H3K27ac and H3K4me1 ChIP-seq narrow peaks. We have elucidated the how enhancers are defined in the methods sections. In addition, we have performed additional enrichment analysis using NRs located on differentially active enhancer regions and NDRs located on conserved active enhancer regions (Supplementary Figure 7) between H1 embryonic cell line and any other differentiated cell lines and the performance of enrichment scores in PTF classification was slightly worse compared with those calculated from differentially and conserved open chromatin regions

      1. The description of "genome-wide mapping of transcription factor binding sites" is unclear. For example, what does it mean by "In total, ChIP-seq data for 225 transcription factors could be matched with MNase-seq data" and why is this step needed? I would assume that a typical approach for mapping TF binding sites in the five cell types is to obtain the ChIP-seq data for each TF in each cell type and perform sequence alignment to the reference genome. The procedure described by the authors needs a clearer motivation and justification.

      Responses: This sentence refers to matching between the ChIP-seq and MNase-seq data from the same cell type. We explain in detail how ChIP-seq data is processed. We have clarified this in the paper.

      1. I also suggest the authors clearly justify the use of ROC analyses given that only a ground truth of positive (e.g. 16 known pioneer factors) is available and the "other transcription factors" considered as negative in the analysis in fact are expected to contain unknown pioneer factors and their identification should not be minimized (which lead to the maximization of ROC) by the analysis procedure.

      Responses: (This is also pointed by review 1). The fact that unknown transcription factors are treated as negatives actually leads to the lower reported ROC scores (more hits considered to be false positives), not to their maximization. That is the reason we mentioned in the paper that the obtained ROC scores can be considered as lower bound estimates. In addition, we have expanded our validation sets to 32 known pioneer factors and compiled three sets of PTFs for validations. Following the reviewers’ suggestions, we have further performed precision-recall (PR) analysis and calculated the Matthews correlation coefficient (MCC) using three sets of PTFs for validation (Supplementary Table 11 and Supplementary Figure 2).

      1. The analysis of pioneer transcription factor binding sites lacks insight. What can we learn these this analysis other than TFs from the same families are likely to be clustered in the same group?

      Responses: We thank the review for pointing out it and have added a more detailed discussion of these results in the revised manuscript. Very few PTF-nucleosome structural complexes have currently been solved so far and the binding modes of majority of PTFs with nucleosomes still remain unknow. Our analysis has identified six distinctive clusters of TF binding profiles with nucleosomal DNA, which could provide insight into the binding modes of PTFs with nucleosome. These clusters point to the diversity of binding motifs where transcription factors belonging to the same cluster may also exhibit potential competitive binding.

    1. Author Response

      The following is the authors’ response to the original reviews.

      The co-authors and I would like to thank you for overseeing the review, and to thank you and the reviewers for your constructive feedback about the manuscript. Below, we have summarized each suggestion for improving the manuscript and provided our response. In addition, the abstract was revised to include findings from physiological studies of mice with a single Numb cKO and to provide a more concise and conservative concluding statement.

      Reviewer #1 (Recommendations for The Authors):

      1. While the specificity of the observed muscle phenotypes seems clear, the subsequent molecular analysis of Numb protein interactors does not seem to consider the potential involvement of Numb-like. The authors should demonstrate the relative expression levels of Numb and Numb-like in the models used, and establish the specificity of the antibodies used in IP, western and staining experiments.

      Response: Perhaps the most convincing evidence that the anti-Numb antibody did not pull down Numb-like is that this protein was not detected among immunoprecipitated protein complexes pulled down by the anti-Numb antibody used. The antibody used in the immunoprecipitation was validated by the supplier and was previously reported to immunoprecipitate Numb [1, 2]. We previously demonstrated that a morpholino against Numb mRNA almost completely eliminated the band detected by this antibody and that this band was at the expected molecular weight [ref]. In our hands, mRNA levels for Numb-like in skeletal muscle are 5-10-fold lower than those for Numb [3]. We have been unable to detect Numb-like protein in healthy adult skeletal muscle by immunoblotting or immunofluorescence staining. Taking all of these findings together, it seems unlikely that the antibodies used for immunoprecipitating Numb-protein complexes pulls down Numb-like.

      1. The authors use PCR to investigate Numb isoform expression and conclude that p65 is likely the dominant protein isoform expressed. While this agrees with the single band observed in Supp Figure 4A, a positive control for exon 9 excluded and included isoforms in the PCR reactions would strengthen this conclusion.

      Response: The amplicons shown in Supplemental 4 were sequenced. The clones corresponded to the isoforms with the exon 3 present or removed. No amplicons containing exon 9 were detected. The following sentence was added to the Analysis of Splice Variants section of Methods to address this point: “PCR products were cloned using the TOPO TA cloning system (ThermoFisher) and multiple resulting clones were sequenced to confirm that the expected products were generated.”

      1. PCR analysis of total Numb and Numb-like expression levels are not shown. This is important given the specificity of the Numb antibodies used for AP-MS experiments are not described and some Numb antibodies are well known to also recognize Numb-like. Two different Numb antibodies were used for Western and immunoprecipitation but the specificity for Numb and Numb-like is not described. In particular, does the antibody used in the AP-MS experiment recognize both Numb and Numb-like? Supplementary Table 1 does not list Numb or Numb-like, but presumably peptides were identified?

      Response: As noted above, the specificity of anti-Numb antibodies was confirmed in previous studies [3]. Importantly, Numb-like mRNA levels are 5-10-fold lower than Numb mRNA, and NumbL protein is undetectable in healthy adult skeletal muscle by Western. The physiology data reported in this manuscript supports the conclusion that a single KO of Numb is sufficient to recapitulate the physiological phenotype of Numb/Numb-like KO . We therefore reason that the majority, if not all, of the physiological contribution of these proteins to muscle contractility due to Numb (Fig. 1).

      1. The validation experiment used the same Numb antibody for immunoprecipitation, immunoblotted with Septin 7. A reciprocal IP of Septin 7 and blotted with Numb should be performed. In addition, a Numb-like IP or immunoblot would also be useful to demonstrate the specificity of the interaction. Efforts to map the interaction between Numb and Septin 7 would be useful to demonstrate specificity of the interaction and strategies to establish the biological relevance of the interaction.

      Response: We agree with the reviewer and attempted several IPs with anti-Septin7 antibodies. These were unsuccessful. In a new collaboration, Dr. Italo Cavini (University of Sao Paulo) has used machine-learning-based approaches to model binding between Numb and several septins, including Septin 7. The analysis suggests that binding of Numb with septins involves a domain of Numb that has not yet been ascribed a function in protein-protein interactions. These computational predictions require experimental validation but provide rational starting point for experiments to define the domains responsible for these interactions. Such experiments were included in our recent NIH R01 renewal application. We hope to be able to report on results of confirmatory experiments of these computational models in the future.

      1. Other septins were identified in the AP-MS experiment and might have been anticipated to also be disrupted by Numb/Numb-like deletion. Are these septins known to interact in a complex?

      Response: This is an excellent question. Septins have conserved motifs providing a clear reason to imagine that many different mammalian septins could directly interact with Numb. Septins form heterooligomers consisting of complexes formed by 3, 6 or 8 septins [4]. It is likely that when Numb binds to one septin, antibodies against Numb pull down other septins present in the septin oligomer to which Numb is bound. The following paragraph was added to the discussion: “Our findings suggest that Numb may also interact with other septins such as septins 2, 9 and 10, which were also identified with a high level of confidence as Numb interacting proteins by our LC/MS/MS analysis. Our data to not allow us to determine if Numb binds directly to these septins. Septins contain highly conserved regions, and, consequently, if one such region of septin 7 interacts with Numb, then many septins would be expected to directly bind Numb through the same domain. However, because septins self-oligomerize, is possible that when Numb binds to one septin, antibodies against Numb could also pull down other septins present in the septin oligomer to which Numb is bound regardless of whether or not they are also bound by Numb. “

      1. The text for Figure 5 describes analysis of Septin localization in inducible Numb/Numb-like cKO muscle, but the figure indicates only Numb is knocked out. Please clarify.

      Response: We apologize for this oversight on our part. The Legend to Figure 5 has been corrected.

      1. Supplementary Figure 2 seems to show that TAM treatment increases Numb expression. Please clarify. Also, please correct reference 9.

      Response: The figure was incorrectly labeled. We apologize for this oversight and have corrected the figure in the revised manuscript.

      Reviewer #2 (Recommendations for The Authors):

      Overall, the manuscript is well written. I do have a few minor issues/concerns, which are detailed below.

      Abstract: Please be a little more specific regarding which where the tissue came from (i.e. humans, mice, cell) when referring to your previous studies.

      Response: The abstract has been revised as requested.

      Introduction: Please be more specific regarding the technique used for detecting ultrastructural changes. I assume it was done with TEM, but the reference is listed as an "invalid citation" in your reference list.

      Response: The introduction was revised as requested and the citation was updated to reference a valid citation.

      Methods / Numb Co-Immunoprecipitation: Please indicated the level of confluency of the C2C12 cells as this will alter gene expression.

      Response: As indicated in the updated Methods section, confluent C2C12 cells were switched to differentiation media (low serum) for seven days. When harvested, the cells had differentiated and fused into myotubes.

      Methods / Immunohistochemical Staining: The first sentence needs to be edited regarding plurality and grammar.

      Response: Thank you for this comment. The text was revised accordingly.

      Results / GWAS and WGS Identify...: Please spell out phosphodiesterase (I assume) for PDE4D

      Response: This change was incorporated in the text.

      References cited:

      1. Wu, M., et al., Epicardial spindle orientation controls cell entry into the myocardium. Dev Cell, 2010. 19(1): p. 114-25.

      2. Garcia-Heredia, J.M. and A. Carnero, The cargo protein MAP17 (PDZK1IP1) regulates the immune microenvironment. Oncotarget, 2017. 8(58): p. 98580-98597.

      3. De Gasperi, R., et al., Numb is required for optimal contraction of skeletal muscle. J Cachexia Sarcopenia Muscle, 2022.

      4. Neubauer, K. and B. Zieger, The Mammalian Septin Interactome. Front Cell Dev Biol, 2017. 5: p. 3.

    1. Author Response

      The following is the authors’ response to the previous reviews

      Reviewer #1 (Public Review):

      In countries endemic for P vivax the need to administer a primaquine (PQ) course adequate to prevent relapse in G6PD deficient persons poses a real dilemma. On one hand PQ will cause haemolysis; on the other hand, without PQ the chance of relapse is very high. As a result, out of fear of severe haemolysis, PQ has been under-used.

      In view of the above, the Authors have investigated in well-informed volunteers, who were kept under close medical supervision in hospital throughout the study, two different schedules of PQ administration: (1) escalating doses (to a total of 5-7 mg/kg); (2) single 45 mg dose (0.75 mg/kg).

      It is shown convincingly that regimen (1) can be used successfully to deliver within 3 weeks, under hospital conditions, the dose of PQ required to prevent P vivax relapse.

      As expected, with both regimens acute haemolytic anaemia (AHA) developed in all cases. With regimen (2), not surprisingly, the fall in Hb was less, although it was abrupt. With regimen (1) the average fall in Hb was about 4 G. Only in one subject the fall in Hb mandated termination of the study.

      Since the data from the Chicago group some sixty years ago, there has been no paper reporting a systematic daily analysis of AHA in so many closely monitored subjects with G6PD deficiency. The individual patient data in the Supplementary material are most informative and more than precious.

      Having said this, I do have some general comments.

      1. Through their remarkable Part 1 study, the Authors clearly wish to set the stage for a revision of the currently recommended PQ regimen for G6PD deficient patients. They have shown that 5-7 mg/kg can be administered within 3 weeks, whereas the currently recommended regimen provides 6 mg/kg over no less than 8 weeks.

      We state in the abstract: “The aim was to explore shorter and safer primaquine radical cure regimens compared to the currently recommended 8-weekly regimen (0.75 mg/kg once weekly), potentially obviating the need for G6PD testing”. This is the primary goal of the study.

      1. Part 2 aims to show that, as was known already, even a single PQ dose of 0.75 mg/kg causes a significant degree of haemolysis: G6PD deficiency-related haemolysis is characteristically markedly dose-dependent. Although they do not state it explicitly in these words (I think they should), the Authors want to make it clear that the currently recommended regimen does cause AHA.

      We also wanted to compare the extent of haemolysis following single dose with the extent of haemolysis following the ascending dose regimens, in the same patients.

      1. Regulatory agencies like to classify a drug regimen as either SAFE or NOT-SAFE; they also like to decide who is 'at risk' and who is 'not at risk'. A wealth of data, including those in this manuscript, show that it is not correct to say that a G6PD deficient person when taking PQ is at risk of haemolysis: he or she will definitely have haemolysis. As for SAFETY, it will depend on the clinical situation when PQ is started and on the severity of the AHA that will develop.

      We agree completely. Haemolysis following primaquine is inevitable. What matters is the rate and extent of haemolysis, and the compensatory response. Importantly the extent of the haemolysis, even within a specific genotype and for a given drug dose, appears to be highly variable.

      The above three issues are all present in the discussion, but I think they ought to be stated more clearly.

      We have tried to clarify these points in a revised discussion.

      Finally, by the Authors' own statement on page 15, the main limitation is the complexity of this approach. The authors suggest that blister packed PQ may help; but to me the real complexity is managing patients in the field versus the painstaking hospital care in the hands of experts, of which volunteers in this study have had the benefit. It is not surprising that a fall in Hb of 4 g/dl is well tolerated by most non-anaemic men; but patients with P vivax in the field may often have mild to moderate to severe anaemia; and certainly they will not have their Hb, retics and bilirubin checked every day. In crude approximation, we are talking of a fall in Hb of 4 G with regimen (1), as against a fall in Hb of 2 G with regimen (2), that is part of the currently recommended regimen: it stands to reason that, in terms of safety, the latter is generally preferable (even though some degree of fall in Hb will recur with each weekly dose). In my view, these difficult points should be discussed deliberately.

      As above we have tried to clarify these important points in a revised discussion

      Reviewer #1 (Recommendations For The Authors):

      Page 2 para 3. The decreased haemolysis upon continued PQ administration (that originally was named the 'resistance phase' is explained by two additive factors. First, the reticulocytosis (cells with higher G6PD activity pour into circulation from the bone marrow); second, the early doses of PQ has caused selective haemolysis of the oldest red cells, that had the lowest G6PD activity. This dual phenomenon is hinted at, but I think it should be stated clearly.

      Thank you. We have added to the Introduction (fourth paragraph in revised version):

      “Continued primaquine administration to G6PD deficient subjects resulted in "resistance" to the haemolytic effect. The selective haemolysis of the older red cells resulted in a compensatory increase in the number of reticulocytes. Thus, the red cell population became progressively younger and increasing resistant to oxidant stress, so overall haemolysis decreased and a steady state was reached.”

      Page 4 and elsewhere. In the 'Hillmen scale' for haemoglobinuria a value >6 was named a 'paroxysm'; but any value of 2 and above is already frank haemoglobinuria. Incidentally, the chart was published not in ref 17, but in NEJM 350:552, 2004.

      We have changed the reference (now ref 19) to the 2004 paper by Hillmen. We used the value of 6 as clinical criterion for stopping primaquine. While >2 is detectable in dilute urine, >6 refers to clearly red/black urine.

      In Table 1 and throughout the paper I am surprised that retics are given as %: absolute retic counts are more informative.

      We showed these as % counts as the majority of measurements were taken from blood slide readings where it is not possible to get an absolute count.

      Page 10, Attenuated hemolysis with continued or recurrent doses of PQ was shown convincingly for G6PD A-. There is also one report in which the time course of AHA was extensively investigated upon deliberate administration of PQ to a subject with G6PD Mediterranean (Blood 25: 92, 1965): there was little or no evidence for a 'resistance phase'.

      We agree that this suggests it might not be possible to attenuate haemolysis with the Mediterranean variant (or variants of similar severity) as even the youngest circulating red cells may be susceptible to haemolysis. More evidence is needed.

      S6, S7. Reticulocytes remain high until PQ is stopped; they return to normal some 17 days after stopping PQ. This should be stated in the main text.

      This has been added to the main text (section “Haemolysis and reticulocyte response”):

      “It took around 2 weeks for the reticulocyte counts to re-normalise.”

      In subject 11 haemoglobinuria was slight on day 12; what was it before?

      We have changed the caption of this Figure (Appendix 5) to:

      “Day 10 urine sample from subject 11 showing slight haemoglobinuria (Hillmen score of 4). The subject had a maximum Hillmen score varying between 2 and 3 on days 4 to 9.”

      I found individual patient data in S5 and S6 most interesting, especially since the G6PD variant was identified in each case. It would be helpful if in each case the total PQ dose were also shown, and in the interest of visual comparability the abscissa scale ought to be the same for all cases.

      We have amended Figures S5 and S6 to make them consistent with each other (now Appendix 5). We also amended the figures showing the individual subject data for consistency.

    1. Author Response

      Reviewer #1 (Public Review):

      In this manuscript, the authors identified compound heterozygous mutations in CFAP52 recessively cosegregating with male infertility status in a non-consanguineous family. The Cfap52-mutant patient exhibits a mixed acephalic spermatozoa syndrome (ASS) and multiple morphological abnormalities of the sperm flagella (MMAF) phenotype. The influence of mutations on CFAP52 protein function is well validated by in vitro cell experiments and immunofluorescence staining. Cfap52-KO mice are further constructed and perfectly resemble the Cfap52-mutant patient's infertile phenotype, also showing a mixed ASS and MMAF phenotype. The phenotype and underlying mechanisms of the disruption of sperm head-tail connection and flagella development are carefully analyzed by TEM, Western blotting, and immunofluorescence staining. The data presented revealed a prominent role for CFAP52 in sperm development, suggesting that CFAP52 is a novel diagnostic target for male infertility with defects of sperm head-tail connection and flagella development.

      Thank you for your positive comments.

      Reviewer #2 (Public Review):

      Summary:

      The authors tried to identify the genetic factors for asthenoteratozoospermia. Using whole-exome sequencing, they analyzed a family with an infertile male and identified CFAP52 variants. They further knockout mouse Cfap52 gene and the homozygous mice phenocopied the patient. CFAP52 interacts with several other sperm proteins to maintain normal sperm morphology. Finally, CFAP52-associated male infertility in humans and mice could be overcome by using intracytoplasmic sperm injections (ICSI).

      Strengths:

      The major strength of this study is to identify genetic factors contributing to asthenoteratozoospermia, and to generate a mouse knockout model to validate the factor.

      Thank you for your positive comments.

      Weaknesses:

      The authors did not use the OMICS to dissect the potential mechanisms. Instead, they took the advantage of direct co-IP experiment to fish the binding partners. They also did not discuss in detail why other motile cilia have different behavior.

      Dear reviewer, thank you for your comments and we tried to answer your two questions as follows.

      In this study, we did not choose omics technologies to explore the binding partners for CFAP52 (e.g., IP-MS) and differentially expressed proteins after the loss of CFAP52 (e.g., proteomics). For IP-MS, we feel sorry that all available antibodies of CFAP52 could not be used to perform protein immunoprecipitation experiments. Another reason is that there are only dozens of proteins that have been reported to regulate the head-tail coupling apparatus (HTCA) of sperm. Accordingly, we used Western blotting to examine the expression of ten acephalic sperm syndrome (ASS)-associated proteins and found that only SPATA6 expression was significantly reduced in the testis protein lysates of Cfap52-KO mice (Fig. 6A). We further carefully examined the regulation of the stability of SPATA6 by its binding partner CFAP52 (Fig. 6 and Figure 6—figure supplement 2).

      In addition to male infertility, Cfap52-KO mice suffered from hydrocephalus; the ependymal cilia was sparse under SEM observation and disrupted axonemal structures were identified by TEM analysis (Figure 4—figure supplement 2). However, no obvious abnormalities of tracheal cilia were identified by SEM and TEM analyses (Figure 4—figure supplement 2). Although flagella and motile cilia exhibit quite similar “9+2” axoneme structure, they have some their unique proteins and the requirement of some axonemal proteins may be different. For example, IQUB expression is detected in tissues other than the testis, such as the lung and brain; however, IQUB deletion only affects beating of sperm flagella but not respiratory cilia (Cell Rep, 2022). Cfap43-KO mice exhibited both sperm flagella disordor and early-onset hydrocephalus (Dev Biol, 2020), and CFAP206 is required for sperm motility, mucociliary clearance of the airways and brain development (Development, 2020).

      Reviewer #3 (Public Review):

      Summary:

      In this study, Jin et al. report the first evidence of CFAP52 mutations in human male infertility by identifying deleterious compound heterozygous mutations of CFAP52 in infertile human patients with acephalic and multiple morphological abnormalities in flagella (MMAF) phenotypes but without other abnormalities in motile cilia. They validated the pathogenicity of the mutations by an in vitro minigene assay and the absence of proteins in the patient's spermatozoa. Using a Cfap52 knockout mouse model they generated, the authors showed that the animals are hydrocephalic and the sperm have coupling defects, head decapitation, and axonemal structure disruption, supporting what was observed in human patients.

      Strengths:

      The major strengths of the study are the rigorous phenotypic and molecular analysis of normal and patient spermatozoa and the demonstration of infertility treatment by ICSI. The authors demonstrated the interaction between CFAP52 and SPATA6, a head-tail coupling regulator and structural protein, and showed that CFAP52 can interact with components of the microtubule inner protein (MIP), radial spoke, and outer dynein arm proteins.

      Thank you for your positive comments.

      Weaknesses:

      The weakness of the study is some inconsistency in the localization of the CFAP52 protein in human spermatozoa in the figures and the lack of such localization information completely missing in mouse spermatozoa. Putting their findings in the context of the newly available structural information from the recent series of unambiguous and unequivocal identification of CFAP52 as an MIP in the B tubule will not only greatly benefit the interpretation of the study, but also resolve the inconsistent sperm phenotypes reported by an independent study. Since the mouse model is not designed to exactly recapitulate the human mutations but a complete knockout and the knockout mice show hydrocephaly phenotype as well, some of the claims of causality and ICSI as a treatment need to be tempered. Discussing the frequency of acephaly and MMAF in primary male infertility will be beneficial to justify CFAP52 as a practical diagnostic tool.

      Dear reviewer, thank you for your comments and we tried to answer your questions as follows.

      By immunofluorescence staining, we showed that CFAP52 was localized at both HTCA and full-length flagella from the normal control; in contrast, CFAP52 signals were barely detected in the patient’s spermatozoa (Figure 3F). Given that CFAP52 staining did not occur in other figures, no inconsistency exists in the localization of the CFAP52 protein in human spermatozoa in the figures. We did not perform the CFAP52 staining in mouse spermatozoa; however, we have shown that CFAP52 protein was completely absent in the Cfap52-KO testes compared with the WT testes (Figure 4C).

      We appreciate the reviewer’s suggestion to put our findings of CFAP52 in the context of the newly available axoneme architecture. Given that these cryo-EM studies focus on doublet microtubules (DMTs), a broader expression pattern of CFAP52 in cilia/flagella could not be excluded. In mammals, CFAP52 seems to interact with a broad range of axonemal proteins, including MIP (CFAP45), ODAs (DNAI1 and DNAH11), and DRC (DRC10) (Dougherty et al., 2020). We have mentioned that ‘a lack of FAP52 in Chlamydomonas causes an instability of microtubules and detachment of the B-tubule from the A-tubule and shortened flagella are observed in Chlamydomonas when both FAP52 and FAP20 are absent (Owa et al., 2019). Unlike a specific regulation of the stability of B-tubules by FAP52 in Chlamydomonas (Owa et al., 2019), Cfap52-KO mice and CFAP52-mutant patient showed a serious disorder of the axoneme and its accessory structures.’

      Before our study, Cfap52-KO mice have not yet been generated. To explore the physiological roles of CFAP52, we decided to construct Cfap52-KO mice. During our manuscript is under preparation, an independent group also generated the Cfap52-KO mice and explored their phenotype (Wu et al., 2023). We quite agree with this reviewer that Cfap52-mutant mice will be exact models to recapitulate the human variants. Cfap52-mutant mice were not included in our current manuscript due to i) the two identified variants were ‘nonsense’ variant and ‘frameshift’ variants, respectively, which are expected to damage the CFAP52 expression and function; ii) the influence of two variants on CFAP52 protein function has been well validated by in vitro cell experiments and iii) research funding is limited for us. The assisted reproductive technology (ART) outcomes were also reported for the CFAP52-mutant patient and Cfap52-KO mice, which will be potential useful for further clinical studies. However, it is not suggested to be over-interpreted because it is only a case study.

      Quantitative analyses showed that the decapitated spermatozoa, abnormal head-tail connecting spermatozoa, and spermatozoa with deformed flagella accounted for approximately 40%, 25%, and 30% of the total spermatozoa in Cfap52-KO mice, respectively (Figure 4I). Regarding the CFAP52-mutant patient, the frequency of acephaly and MMAF were not counted and now we feel sorry that we don’t have enough samples (repeats) to perform quantitative analyses.

    1. Author Response

      The following is the authors’ response to the original reviews.

      Reviewer #1 (Recommendations For The Authors):

      Major concerns:

      1. In lines 41-43, there seems to be some confusion about the terminology regarding "sporadic ALS". ALS is subdivided into familial and sporadic forms. Familial ALS simply indicates that the patient has a family history of ALS and presumably has a genetic predisposition for developing this disease. In many families, the identity of the mutation remains unknown. Sporadic ALS patients do not have a family history of this disease. However, this does not imply that they lack mutations that caused disease. In fact, 5-10% of these patients have the hexanucleotide repeat expansion in C9orf72. This mutation is also found in about 40% of familial ALS cases.

      We have now amended the manuscript to be more accurate in our description of underlying genetics of ALS. This changes to this section are as follows:

      Lines 39-47:

      "...The median survival time in ALS, from initial onset of symptoms to death, typically as a result of respiratory complications, is only 20-48 months Chiò et al. (2009) and ALS has an estimated global mortality of 30,000 patients per year Mathis et al. (2019).

      ALS is typically classified into either familial (fALS) or sporadic (sALS) forms of the disease, based on whether or not patients have an identified family history of the disease; between 5-10% of total ALS cases fall into the former category, fALS, with the remaining 90-95% consisting of sALS cases Mathis et al. (2019). To date, over 20 monogenic mutations that cause ALS have been identified, however these still only account for 45% of fALS cases and only 7% of sALS cases Mejzini et al. (2019)..."

      1. In Fig. 4-supplement 1, 7DD and 5DD are not defined. I assume one is the fast-firing and one is the slow-firing motor neurons. I am also a bit confused as to why the 5DD neurons produce greater muscle force than the 7DD neurons when electrically stimulated. It seems to suggest that there is some difference between the two types of neurons or the groups of mice used to test them.

      We have now defined these terms and the amended figure legend now reads as follows:

      "(A) Fast-firing motor neurons (produced using a 7-day differentiation protocol thus labelled as “7DD”) or slow-firing ChR2+ motor neurons (produced using a 5-day differentiation protocol thus labelled as “5DD”) were engrafted in age matched SOD1G93A mice… Our expectation was that fast-firing motor neurons, which normally innervate larger numbers (>100) of stronger fast-twitch muscle fibres per motor unit would elicit significantly greater contractile force when optically stimulated, compared to slow-firing motor neurons that innervate small numbers (<10) of weaker, slow-twitch muscle fibres per motor unit. Surprisingly, our data did not show any difference when using grafts consisting of fast-firing motor neurons, versus slow-firing motor neurons, at least in response to optical stimulation. The factors underlying this surprising result, and the apparent discrepancy between electrically-evoked muscle contractions in nerves that had bene engrafted with either fast or slow firing motor neurons, are likely to be highly complex; we hope to further explore this as part of a separate follow up study."

      1. Along those lines, do these two subpopulations of motor neurons innervate the same set of muscle fibers? More generally, are certain types of muscle fibers preferentially innervated by this approach? Answering these questions could point to additional ways to enhance the effectiveness of this treatment approach. This should be discussed.

      This point is partially addressed in our response to Point 2 above, but to further extrapolate: certainly, the phenotype of individual muscle fibres is largely dictated by the firing properties of the motor neuron that innervates it. Slow-twitch muscle fibres tend to produce less contractile force but are more fatigue resistant, whereas fast-twitch muscle fibres produce more force but fatigue rapidly. There is evidence that expression of the chemorepellent molecule ephrin-A3 prevents the inappropriate innervation of slow-twitch muscle fibres by fast-firing motor neurons, which express the cognate receptor EphA8 [PMID: 26644518]. Importantly, fast-firing motor neurons are preferentially susceptible to disease mechanisms in ALS and the fast-twitch muscle fibres that they innervate are therefore more likely to undergo denervation and atrophy. Surprisingly, in this study we clearly show that grafts consisting of slow-firing motor neurons are able to innervate all regions of the triceps surae muscle group, including the normally exclusively fast-twitch superficial regions of the gastrocnemius and the exclusively slow-twitch soleus muscle. This finding strongly suggests that the normal developmental pairing of motor neuron and muscle fibre properties is not essential in this therapeutic context. Indeed, the use of more disease-resistant slow-firing motor neurons may provide some advantages. Again, we hope to be able to further explore this relationship in forthcoming follow-up studies.

      1. The authors state that exercise programs are likely to accelerate disease progression. This is not supported by the current body of clinical data. In fact, current guidelines are for moderate (not strenuous) exercise, and mouse studies have demonstrated a protective effect of moderate exercise on disease progression.

      We apologise for the lack of clarity on this point, as it was not our intention to imply that voluntary exercise accelerates disease progression. We have now amended the manuscript to specify “ENS-based exercise programs” to avoid any confusion.

      1. It is unclear what the experimental endpoint is. Page 25 defines it as 135 days of age, but ranges are given the figure legends, suggesting that some other criteria were used. It also seems unclear at what determined the age at which each animal was treated since they were also not treated at the same age.

      We hope that our response in the Public Reviews section above has fully addressed this point.

      1. I am a little confused by Figure 5 - figure supplement 5, panel D. Why do the authors give specific p-values here but not in the other panels? The sample sizes in D are very low, in some cases with only 1 animal in a group, and performing statistical tests under these conditions seems futile. The statistical power is nearly zero.

      For the purposes of consistency, we have now replaced the specific p-values in panel D with “ns”. The low n-values for the MUNE analysis data is due to the extremely difficult nature of identifying the contribution of individual motor units to the total muscle contractile response, when the maximal muscle force is extremely weak. In the absence of optical stimulation training, the extremely weak force elicited by acute optical stimulation precluded our ability to separate out the contribution of individual motor units and, often, in animals where this was not possible, we did not always perform electrically-evoked MUNE analysis. Unfortunately, we are not currently in a position to increase the n-values for this component of the study. Our ongoing research to enhance the amplitude of the muscle response to optical stimulation will hopefully help to more clearly address this in the future.

      1. One concern about this approach is that the procedure could accelerate the denervation of the target muscle. Figure 5 - figure supplement 6, panel B, indicates a significant reduction in force on the ipsilateral side relative to the contralateral side, at least under electrical stimulation of the nerve. This would be consistent with the hypothesis that the procedure does enhance disease progression in the treated limb. Is there a reduction in voluntary motor activity in these animals, such as in grip strength or the position of the foot while walking?

      We hope that this important point has been satisfactorily addressed in the Public Reviews section. Unfortunately, we did not undertake any behavioural analysis relating to voluntary motor function of the engrafted (or contralateral) hindlimbs, which may have provided useful data to address this point. As described above, the most likely explanation for this finding is due to physical nerve damage caused by the intraneural injection procedure; in our efforts to refine our strategy and move it towards clinical translation, we will take this into consideration in our future research.

      1. Based on Fig. 6D, it seems that the vast majority of innervated NMJs at endpoint are innervated by cells from the graft. And yet, electrical stimulation evokes substantially greater muscle force. This may suggest that optical control of engrafted motor neurons will not yield enough force for routine tasks or that the few remaining endogenous motor neurons are much more effective at generating force. These potential limitations and ways to overcome them should be discussed.

      There appears to be a slight misunderstanding, since our aim here was to sample a sufficiently powered number of motor end-plates innervated by YFP+ for statistical analysis. To do this we specifically chose regions of interest containing at least 1 YFP+ NMJ and the adjacent muscle fibres were included at random, whatever their innervation status. Had we sampled regions of interest at random, we would have been likely to capture only a very few YFP+ terminal as they occupy a very small volume of the total muscle section and the maximum scanning area for each high-resolution z-confocal stack is relatively small, so we feel that this selection was warranted.

      Minor comments:

      1. The donor mouse strain should be described as 129S1/SvImJ.

      We have now corrected this.

      1. The first time the supplementary figures show up in the manuscript, they seem to have two titles each, such as "Figure 1-figure supplement 1. (Figure 4 - figure supplement 1)". The second seems to be the correct one.

      This was caused by an issue with the Latex template, which has now been resolved.

      1. PCB is not defined the first time it is used (page 8, line 332).

      We have now defined this term on first use: printed circuit board (PCB)

      1. CNI is not defined in the text (page 12, line 432).

      We have now defined this abbreviation at the first usage on Page 4, Line 158

      1. Some of the fonts on the graphs are very small, such as Fig. 5J.

      We have increased the font size as much as possible for Fig. 5.

      1. Figure 6 - figure supplement 1 does not include a key to indicate which antigens are stains and which color refers to which antigen. This is also needed for the videos.

      We have now included a key on this figure supplement to indicate the relevant antigens and stain and we have also done the same for the videos.

      1. Video 5 seems to indicate that there is a dead zone in the back of the chamber. Does this raise any concerns about the consistency of training from animal to animal?

      This is an extremely astute observation. However, the intermittent activation of the implantable LED devices is not due to a dead zone; rather, it is due to the orientation of the power receiving coil within the device and it’s alignment with the resonance frequency chamber that transmits the power to the device. As the animals move around, and particularly when they rear up, the power receiving coil occasionally becomes misaligned and fails to receive sufficient power to activate the LED. Since the pulses are delivered every 2 seconds, for 1 hour per day, we feel that the animals, on average, receive sufficient numbers of pulses to implement the training regimen. Indeed, we feel that the results speak for themselves.

    1. Author Response

      The following is the authors’ response to the original reviews.

      We appreciate the reviewers’ detailed corrections and insightful comments. We have revised our manuscript per reviewers’ recommendations by including new data and clarifications/expansion of the discussion on our findings. Please see below for details.

      Reviewer #1 (Recommendations For The Authors):

      1. The introduction notes that CD1d KO mice show reduced levels of Va3.2 T cells (Ruscher et al.), which is interesting because innate memory T cell development in the thymus often requires IL-4 production by NKT cells. Have the authors explored QFL T cells in CD1d KO and/or IL-4 KO mice? Since their QFL TCR Tg mice still develop QFL T cells (and these animals likely have very few thymic NKT cells), NKT cells may not be required for the intrathymic development of QFL T cells?

      Answer: We agree that investigation on the role of NKT cells or IL-4 in QFL T cell development will greatly further our understanding of these cells.

      We validated the finding that expression of the QFL TCR transgene largely repressed the expression of endogenous TCRα, as indicated by the low levels of endogenous Vα2 on mature CD8SP T cells in both thymus and spleen. However, the frequencies of Vα2 usage in CD4 SP thymocytes and splenocytes from QFL transgenic mice were similar to non-transgenic mice, confirming that they underwent positive selection using endogenous TCR rather than the QFL TCR. We thus do not exclude the possible presence of NKT cells in QFLTg mouse and their potential involvement in the QFL T cells development. Our manuscript here is mainly focused on investigating the peripheral phenotype of QFL T cells and their association with the gut microbiota environment. Investigations into the role of CD1d/IL-4 will be best addressed in our future studies.

      1. The finding that Qa-1 expression is not required for the development of QFL T cells raises questions about other MHC products that may be involved. In this context, it is interesting that TAP-deficient mice develop few QFL T cells, for reasons that are unclear, but the authors may speculate a bit. In this context, it may be helpful for the authors to note whether TAP is required for QFL presentation to QFL T cells. Since Qa-1 is not required, and CD1d is still expressed in TAP KO mice, what then could be responsible for their defect in QFL T cell development?

      Answer: This is a great point. Figure 2 (from (Valerio et al., 2023) on the development of QFL T cells) tested whether QFL TCR cross-react with other MHC I molecules.

      We assessed the activation of pre-selection QFLTg thymocytes in response to various MHC I deficient DC2.4 cell lines. While the QFL thymocytes showed partially reduced activation when stimulated with Qa-1b deficient APCs, triple knock-out (KO) of Qa-1b, Kb, and Db in DC2.4 cells reduced activation close to background levels. However, double knock-out of Qa-1b with either Kb, or Db led to stimulation that was intermediate between the triple KO and Qa-1b-KO cell lines. These data suggest that Kb and Db may contribute to the positive selection of QFL T cells in Qa-1b-KO mice.

      TAP is required for FL9 peptide presentation and is very likely needed for presentation of the yet unidentified MHC Ia presented peptide(s) that are essential to QFL T positive selection. While CD1d/NKT cells/IL-4 may be involved in supporting the maturation of QFL T cells, we think in the TAP-KO mice the absence of TAP led to deletion/altered selection of the QFL T population at early developmental stage. We have added clarification on this point in the revised manuscript (line 412~418).

      1. It may be worthwhile for the authors to note that Qa-1 was also dispensable for the intrathymic selection of another Qa-1-restricted TCR (Doorduijn et al. 2018. Frontiers Immunol.), although this is presumably not the case for others (Sullivan et al. 2002. Immunity 17, 95).

      Answer: We appreciate this recommendation. We have noted this point in the resubmitted manuscript (line 412~418).

      1. Lines 122-124: The sentence "Interesting ..." seemed confusing to me; are the numbers (60 and 30%) correct?

      Answer: The numbers 60% and 30% were referring to the largest number we have detected for percentages of Va3.2 QFL T cells and Va3.2 CD8 T cell respectively. Here in the revised version, we replaced these numbers with average percentages (20.1% and <10%) to avoid confusion (line 134).

      1. Qa-1/peptide complexes may also be recognized by CD94/NKG2 receptors, which may complicate the interpretation of the data (e.g., staining of the dextramers). From their previous work, it appears that Qa-1/QFL does not bind CD94/NKG2, which would be helpful to note in the text.

      Answer: We have noted this point in the revised manuscript (line 117~121).

      1. It would be helpful to add a few comments about the potential relevance to HLA-E.

      Answer: We have included discussion on this point (line 391~401).

      1. Figure legends: Most legends note the total number of replicates, which is usually quite high. It would also be helpful to indicate the total number of independent experiments performed and, when relevant, that the data are pooled from multiple independent experiments.

      Answer: Thank you for raising the concern. We have clarified the experimental repeats in figure legends.

      Reviewer #2 (Recommendations For The Authors):

      1. The work of Nilabh Shastri was the foundation of the present study. Unfortunately, he passed away in 2021. Since he can no longer assume the responsibilities of a senior author, I wonder if it would be more appropriate to dedicate this paper to him than to list him as a co-author.

      Answer: We have removed Dr. Shastri’s name as a co-senior author and have dedicated this work to his memory.

      1. The official symbol for ERAAP is Erap1.

      Answer: We have replaced ERAAP with ERAP1.

      1. Please refrain from editorializing. For example, "strikingly" appears eight times and "interestingly" 9 times in the manuscript. Most readers believe they do not need to be said when something is striking or interesting.

      Answer: We appreciate the Reviewer’s suggestion and have removed ‘strikingly’ and ‘interestingly’ from the manuscript.

      1. In WT mice, are there some cell types that express Qa-1b but not Erap1 and could therefore present the FL9 peptide?

      Answer: This is a great question. Using our highly sensitive QFL T cell hybridoma line BEko8Z (sensitivity shown in Fig. 6b), we have so far not been able to detect steady-state FL9 presentation by cells isolated from the spleen, lymph nodes, various gut associated lymphoid tissues or intestinal epithelial cells (Supplementary Fig. 8 a left panel). However, we do not exclude the possibility of FL9 peptide being transiently presented under certain conditions (i.e. ER stress/transformed cells) at particular locations or within certain time windows, which is of great importance for understanding the function of these cells but is beyond the scope of this study.

      1. Since you have not tested substitutions at other positions, could you explain your reasoning that P4 and P6 are the critical residues (lines 271-272)?

      Answer: Thank you for raising the concern. We have expanded on explanation of our strategy for determining peptide homology (line 272~313) in the revised manuscript. We have also included data on the structure the QFL TCR: FL9-Qa-1b complex predicted by Alphafold2, conformation alignment of FL9 and Qdm (Figure 6. a, b) and the NetMHCpan prediction of Qa1b binding of Qdm, FL9 and various FL9 mutant peptides (Supplementary Fig. 8 c) to help readers visualize the reasoning behind our strategy.

      1. Readers might appreciate having a Figure summarizing the differences between spleen and gut QFL T cells.

      Answer: This is a great suggestion. We have added a table summarizing the characteristic features of the splenic and IEL QFL T cells (Table 1).

      1. In the discussion, readers would like to know what plan you might have to elucidate the function of QFL T cells.

      Answer: We appreciate the recommendation. We have elaborated on our opinions and future directions in the resubmitted manuscript (line 393~401, 446~455).  

      Reviewer #3 (Public Review):

      1. For most of the report, the authors use a set of phenotypic traits to highlight the unique features of QFL-specific CD8+ T cells - specifically, CD44high, CD8aa+ve, CD8ab-ve. In Supp. Fig. 4, however, completely distinct phenotypic characteristics are presented, indicating that IEL QFL-specific T cells are CD5low, Thy-1low. No explanation is provided in the text about whether this is a previously reported phenotype, whether any elements of this phenotype are shared with splenic QFL T cells, what significance the authors ascribe to this phenotype (and to the fact that Qa1-deficiency leads to a more conventional Thy-1+ve, CD5+ve phenotype), and whether this altered phenotype is also seen in ERAAP-deficient mice. At least some explanation for this abrupt shift in focus and integration with prior published work is needed. On a related note, CD5 expression is measured in splenic QFL-specific CD8+ T cells from GF vs SPF mice (Supp. Fig. 9), to indicate that there is no phenotypic impact in the GF mice - but from Supp. Fig. 4, it would seem more appropriate to report CD5 expression in QFL-specific cells from the IEL, not the spleen.

      Answer: Expression of CD8αα and lack of CD4, CD8αβ, CD5 and CD90 expression was indeed reported as the characteristic phenotype of natIELs. We have clarified this point in the resubmitted manuscript (line 80). The CD8αα+ IEL QFL T cells have consistently showed CD5CD90- phenotype. While CD8αα expression was sufficient to describe their natIEL phenotype, we showed the CD5-CD90- data in Supplementary figures only to provide additional evidence.

      The CD5 molecule by itself reflects the TCR signaling strength and high CD5 level is associated with self-reactivity of T cells (Azzam et al., 2001; Fulton et al., 2015). The implication of CD5 expression on QFLTg cells is discussed in our other manuscript where we investigate the development of these cells (Valerio et al., 2023). In Supplementary Fig. 9, because the donor splenic QFLTg cell have consistently showed comparable CD5 level between the GF and SPF group, we reasoned that it would not interfere with our interpretation of the CD44 expression.

      1. The authors suggest the finding that QFL-specific cells from ERAAP-deficient mice have a more "conventional" phenotype indicates some form of negative selection of high-affinity clones (this result being somewhat unexpected since ERAAP loss was previously shown to increase the presentation of Qa-1b loaded with FL9, confirmed in this report). It is not clear how this argument aligns with the data presented, however, since the authors convincingly show no significant reduction in the number of QFL-specific cells in ERAAP-knockout mice (Fig. 3a), and their own data (e.g. Fig. 2a) do not suggest that CD44 expression correlates with QFL-multimer staining (as a surrogate for TCR affinity/avidity). Is there some experimental basis for suggesting that ERAAP-deficient lacks a subset of high affinity QFL-specific cells?

      Answer: We think the presence of QFL T cells in ERAAP-KO mice is a result of the unconventional developmental mechanism of these cells which is better addressed in our complementary manuscript on the development of QFL T cells(Valerio et al., 2023). Valerio et al. found that the most predominant QFL T clone which expresses Vα3.2Jα21, Vβ1Dβ1Jβ2-7 received relatively strong TCR signaling and underwent agonist selection during thymic development, indicating that the QFL ligand is involved in selection of the innate-like QFL T population.

      We agree that there is so far no direct evidence showing the QFL T cells that were absent in the ERAAP-KO mice were high-affinity clones. We have removed ‘high-affinity’ from the manuscript (line 180). While CD44 expression has been associated the antigen-experiences phenotype of T cells, it is yet unclear whether expression level of this molecule directly reflects TCR affinity/avidity. identification of clones of different affinities/avidities require high precision technologies that are not currently available to the research community. While we do have zMovi, a newly developed (developing) technology, in the lab claimed to measure relative avidity/affinity of different cell types for ligands, during the past two years working with this instrument has taught us that the technology is not yet advanced enough; it can only produce reliable data on extreme differences of single clones, i.e., high numbers of homogeneous cell types expressing very high affinity receptors.

      1. The rationale for designing FL9 mutants, and for using these data to screen the proteomes of various commensal bacteria needs further explanation. The authors propose P4 and P6 of FL9 are likely to be "critical" but do not explain whether they predict these to be TCR or Qa-1b contact sites. Published data (e.g., PMID: 10974028) suggest that multiple residues contribute to Qa-1b binding, so while the authors find that P4A completely lost the ability to stimulate a QFL-specific hybridoma, it is unclear whether this is due to the loss of a TCR- or a Qa-1-contact site (or, possibly, both). This could easily be tested - e.g., by determining whether P4A can act as a competitive inhibitor for FL9-induced stimulation of BEko8Z (and, ideally, other Qa-1b-restricted cells, specific for distinct peptides). Without such information, it is unclear exactly what is being selected in the authors' screening strategy of commensal bacterial proteomes. This, of course, does not lessen the importance of finding the peptide from P. pentosaceus that can (albeit weakly) stimulate QFL-specific cells, and the finding that association with this microbe can sustain IEL QFL cells.

      Answer: Thank you for raising the concern. We have expanded on explanation of our strategy for determining peptide homology (line 272~313) in the revised manuscript. We have also included data on the structure the QFL TCR: FL9-Qa-1b complex predicted by Alphafold2, conformation alignment of FL9 and Qdm (Figure 6. a, b) and the NetMHCpan prediction of Qa1b binding of Qdm, FL9 and various FL9 mutant peptides (Supplementary Fig. 8 c) to help readers visualize the reasoning behind our strategy.

      References

      Azzam, H.S., DeJarnette, J.B., Huang, K., Emmons, R., Park, C.S., Sommers, C.L., El-Khoury, D., Shores, E.W., and Love, P.E. (2001). Fine tuning of TCR signaling by CD5. J Immunol 166, 5464- 5472.10.4049/jimmunol.166.9.5464, PMID:11313384

      Fulton, R.B., Hamilton, S.E., Xing, Y., Best, J.A., Goldrath, A.W., Hogquist, K.A., and Jameson, S.C. (2015). The TCR's sensitivity to self peptide-MHC dictates the ability of naive CD8(+) T cells to respond to foreign antigens. Nat Immunol 16, 107-117.10.1038/ni.3043, PMID:25419629

      Valerio, M.M., Arana, K., Guan, J., Chan, S.W., Yang, X., Kurd, N., Lee, A., Shastri, N., Coscoy, L., and Robey, E.A. (2023). The promiscuous development of an unconventional Qa1b-restricted T cell population. bioRxiv, 2022.2009.2026.509583.10.1101/2022.09.26.509583,

    1. Author Response

      The following is the authors’ response to the original reviews.

      Reviewer 1

      Public Review

      R1.1) Randomized clinical trials use experimental blinding and compare active and placebo conditions in their analyses. In this study, Fassi and colleagues explore how individual differences in subjective treatment (i.e., did the participant think they received the active or placebo treatment) influence symptoms and how this is related to objective treatment. The authors address this highly relevant and interesting question using a powerful method by (re-)analyzing data from four published neurostimulation studies and including subjective treatment in statistical models explaining treatment response. The major strengths include the innovative and important research question, the inclusion of four different studies with different techniques and populations to address this question, sound statistical analyses, and findings that are of high interest and relevance to the field.

      We thank the reviewer for this summary and the overall appreciation for our work.

      R1.2) My main suggestion is that authors reconsider the description of the main conclusion to better integrate and balance all findings. Specifically, the authors conclude that (e.g., in the abstract) "individual differences in subjective treatment can explain variability in outcomes better than the actual treatment", which I believe is not a consistent conclusion across all four studies as it does not appropriately consider important interactions with objective treatment observed in study 2 and 3. In study 2, the greatest improvement was observed in the group that received TMS but believed they received sham. While subjective treatment was associated with improvement regardless of objective active or sham treatment, improvement in the objective active TMS group who believed they received sham suggests the importance of objective treatment regardless of subjective treatment. In Study 3, including objective treatment in the model predicted more treatment variance, further suggesting the predictive value of objective treatment.

      We thank the reviewer for this comment and agree that the interpretation of findings requires a more nuanced and balanced description. We, therefore, implemented changes in both the abstract and discussion of the manuscript, as reported below (additions are highlighted in grey and deletions are shown in strikethrough):

      Abstract

      “Our findings consistently show that the inclusion of subjective treatment can provide a better model fit when accounted for alone or in an interaction term with objective treatment (defined as the condition to which participants are assigned in the experiment). These results demonstrate the significant contribution of subjective experience in explaining the variability of clinical, cognitive and behavioural outcomes. Based on these findings, We advocate for existing and future studies in clinical and non-clinical research to start accounting for participants’ subjective beliefs and their interplay with objective treatment when assessing the efficacy of treatments. This approach will be crucial in providing a more accurate estimation of the treatment effect and its source, allowing the development of effective and reproducible interventions.” (p. 3)

      Discussion

      “We demonstrate that participants’ subjective beliefs about receiving the active vs control (sham) treatment are an important factor that can explain variability in the primary outcome and, in some cases, fits the observed data better than the actual treatment participants received during the experiment.” (p. 21)

      “We demonstrate that participants’ subjective beliefs about receiving the active vs control (sham) treatment are an important factor that can explain variability in the primary outcome and, in some cases, fits the observed data better than the actual treatment participants received during the experiment. Specifically, in Studies 1, 2 and 4, the fact that participants thought to be in the active or control condition explained variability in clinical and cognitive scores to a more considerable extent than the objective treatment alone. Notably, the same pattern of results emerged when we replaced subjective treatment with subjective dosage in the fourth experiment, showing that subjective beliefs about treatment intensity also explained variability in research results better than objective treatment. In contrast to Studies 1 and 4, Studies 2 and 3 showed a more complex pattern of results. Specifically, in Study 2 we observed an interaction effect, whereby the greatest improvement in depressive symptoms was observed in the group that received the active objective treatment but believed they received sham. Differently, in Study 3, the inclusion of both subjective and objective treatment as main effects explained variability in symptoms of inattention. Overall, these findings suggest the complex interplay of objective and subjective treatment. The variability in the observed results could be explained by factors such as participants’ personality, type and severity of the disorder, prior treatments, knowledge base, experimental procedures, and views of the research team, all of which could be interesting avenues for future studies to explore.” (p. 22)

      R1.3) In addition to updating the conclusions to better reflect this interaction, I suggest authors include the proportion of participants in each subjective treatment group that actually received active or sham treatment to better understand how much of the subjective treatment is explained by objective treatment. I think it is particularly important to better integrate and more precisely communicate this finding, because the conclusions may otherwise be erroneously interpreted as improvements after treatment only being an effect of subjective treatment or sham.

      We thank the reviewer for this comment. The information about how many participants are included in each group is provided in the every each codebooks under the section “Count of Participants by Treatment Condition and Their Subjective Guess” which is in the project’s OSF link (https://osf.io/rztxu/). Additionally, we added these tables to the supplementary material in tables S1, S8, S15, and S18, and we referred to these tables throughout the Methods section. Further, we added this information to the manuscript results, as follows:

      • “Further details on participant groupings based on objective treatment and their subjective treatment can be found in the codebook corresponding to each of the four studies as well as S1.” (p. 8).

      • “The breakdown of participants to objective treatment and subjective treatment in the sample can be found in S8.” (p. 13).

      • “The breakdown of participants to objective treatment and subjective treatment in the sample can be found in S15.” (p. 17).

      • “The breakdown of participants to objective treatment and subjective treatment in the sample can be found in S18.” (p. 19).

      R1.4) The paper will have significant impact on the field. It will promote further investigation of the effects of sham vs active treatment by the introduction of the terms subjective treatment vs objective treatment and subjective dosage that can be used consistently in the future. The suggestions to assess the expectation of sham vs active earlier on in clinical trials will advance the understanding of subjective treatment in future studies. Overall, I believe the data will substantially contribute to the design and interpretation of future clinical trials by underscoring the importance of subjective treatment.

      We thank the reviewer for this positive comment.

      Review for authors

      R1.4) Abstract

      "Here we show that individual differences in subjective treatment.. can explain variability in outcomes better than the actual treatment". "Our findings consistently show that the inclusion of subjective treatment provides a better model fit than objective treatment alone" - these two statements could be interpreted as two different conclusions, authors should be more consistent.

      We thank the reviewer for this comment and have now changed the abstract to be consistent, as also highlighted in R1.1:

      Abstract

      “Our findings consistently show that the inclusion of subjective treatment can provides a better model fit when accounted for alone or in an interaction term with objective treatment (defined as the condition to which participants are assigned in the experiment). These results demonstrate the significant contribution of subjective experience in explaining the variability of clinical, cognitive and behavioural outcomes. Based on these findings, We advocate for existing and future studies in clinical and non-clinical research to start accounting for participants’ subjective beliefs and their interplay with objective treatment when assessing the efficacy of treatments. This approach will be crucial in providing a more accurate estimation of the treatment effect and its source, allowing the development of effective and reproducible interventions.” (p. 3)

      R1.5) Introduction

      This is an odd sentence given it is 2023: "As a result, the global neuromodulation device industry is expected to grow to $13.3 billion in 2022 (Colangelo, 2020)."

      We have now removed this sentence as indeed not applicable and instead added a reference for the previous sentence:

      “In recent years, neuromodulation has been studied as one of the most promising treatment methods (De Ridder et al., 2021).”

      Reference

      De Ridder, D., Maciaczyk, J., & Vanneste, S. (2021). The future of neuromodulation: Smart neuromodulation. Expert Review of Medical Devices, 18(4), 307–317. https://doi.org/10.1080/17434440.2021.1909470

      R1.6) Figures

      • Lines of Figure 1 are vague.

      • Figure 5 color scheme is confusing. It would be better to use green/blue colors for one, (e.g.) sham in both subjective and objective treatment and orange/red colors for active treatment.

      • For Figure 6 it would be better to use the same color for sham as subjective dosage none.

      • Relatedly, it would be easier to keep color scheme consistent across the paper and for example use green/blue colors for sham throughout.

      We thank the reviewer for this comment. Following these comments, all the figures of the paper has remade for better clarity.

      • Figure 1, the individual lines are now shown stronger, there is also a connecting line between the averages.

      • Figure 5, sham is now on cold colours (blue and green), and active treatment on warm colours (red and orange)

      • Figure 6, the same colour for sham as subjective dosage none is now applied.

      Further, we also edited Figures 2 and 4 by removing the percentages between 0% and 100% on the y-axis. Given that the outcome variable was binary coded, we implemented this change to avoid confusion.

      Reviewer 2

      Public Review

      R2.1) This manuscript focuses on the clinical impact of subjective experience or treatment with transcranial magnetic stimulation and transcranial direct current stimulation studies with retrospective analyses of 4 datasets. Subjective experience or treatment refers to the patient level thought of receiving active or sham treatments. The analyses suggest that subjective treatment effects are an important and under appreciated factor in randomized controlled trials. The authors present compelling evidence that has significance in the context of other modalities of treatment, treatment for other diseases, and plans for future randomized controlled trials. Other strengths included a rigorous approach and analyses. Some aspects of the manuscript are underdeveloped and the findings are over interpreted. Thank you for your efforts and the opportunity to review your work.

      We thank the reviewer for their overall appreciation of this work. We address the comment on the overinterpretation of findings in response to reviewer 1 (see R1.2) above, and we expand on the underdeveloped explanation of sham procedures (see R2.2) below.

      Review for authors

      R2.2) One concern is that the findings are consistently over interpreted and presented with a polarizing framework. This is a complicated area of study with many variables that are not understood or captured. For example, subjective experience effects likely varies with personality dimensions, disease, prior treatments, knowledge base, view of the research team, and disease severity. Framing subjective experience with a more balanced tone, as an important consideration for future trial design and study execution would enhance the impact of the paper.

      We thank the reviewer for this comment. We reframed our interpretation of results in both the manuscript abstract and discussion, as highlighted in response to reviewer 1 (see R1.2) above.

      R2.3) The discussion of sham approaches for transcranial magnetic stimulation and transcranial direct current stimulation is underdeveloped. There are approaches that are not discussed. The tilt method is seldom used for modern studies for example.

      We thank the reviewer for this comment, and we now rewrote a paragraph elaborating more on different practices to apply sham procedures in the introduction section:

      “Participants that take part in TMS and tES studies consistently report various perceptual sensations, such as audible clicks, visual disturbances, and cutaneous sensations (Davis et al., 2013) Consequently, they can discern when they have received the active treatment, making subjective beliefs and demand characteristics potentially influencing performance (Polanía et al., 2018). To account for such non-specific effects, sham (placebo) protocols have been employed. For transcranial direct current stimulation (tDCS), the most common form of tES, various sham protocols exist. A review by Fonteneau et al., 2019 shows 84% of 173 studies used similar sham approaches to an early method by Gandiga et al., 2005. This initial protocol had a 10s ramp-up followed by 30s of active stimulation at 1mA before cessation, differently from active stimulation that typically lasts up to 20 minutes.. However, this has been adapted in terms of intensity and duration of current, ramp-in/out phases, and the number of ramps during stimulation. Similarly, in sham TMS, the TMS coil may be tilted or replaced with purpose-built sham coils equipped with magnetic shields, which produce auditory effects but ensure no brain stimulation (Duecker & Sack, 2015). By using surface electrodes, the somatosensory effects of actual TMS are also mimicked. Overall, these types of sham stimulation aim to mimic the perceptual sensations associated with active stimulation without substantially affecting cortical excitability (Fritsch et al., 2010; Nitsche & Paulus, 2000). As a result, sham treatments should allow controlling for participants’ specific beliefs about the type of stimulation received.” (p.6)

      References

      Fonteneau, C., Mondino, M., Arns, M., Baeken, C., Bikson, M., Brunoni, A. R., Burke, M. J., Neuvonen, T., Padberg, F., Pascual-Leone, A., Poulet, E., Ruffini, G., Santarnecchi, E., Sauvaget, A., Schellhorn, K., Suaud-Chagny, M.-F., Palm, U., & Brunelin, J. (2019). Sham tDCS: A hidden source of variability? Reflections for further blinded, controlled trials. Brain Stimulation, 12(3), 668–673. https://doi.org/10.1016/j.brs.2018.12.977

      Gandiga, P. C., Hummel, F. C., & Cohen, L. G. (2006). Transcranial DC stimulation (tDCS): A tool for double-blind sham-controlled clinical studies in brain stimulation. Clinical Neurophysiology, 117(4), 845–850. https://doi.org/10.1016/j.clinph.2005.12.003

    1. Author Response

      The following is the authors’ response to the original reviews.

      eLife assessment:

      This study reports a meta-analysis of published data to address an issue that is topical and potentially useful for understanding how the sites of initiation of DNA replication are specified in human chromosomes. The work focuses on the role of the Origin Recognition Complex (ORC) and the Mini-Chromosome Maintenance (MCM2-7) complex in localizing origins of DNA replication in human cells. While some aspects of the paper are of interest, the analysis of published data is in parts inadequate to allow for the broad conclusion that, in contrast to multiple observations with other species, sites in the human genome for binding sites for ORC and MCM2-7 do not have extensive overlap with the location of origins of DNA replication.

      Public Reviews:

      Reviewer #1 (Public Review):

      In the best genetically and biochemically understood model of eukaryotic DNA replication, the budding yeast, Saccharomyces cerevisiae, the genomic locations at which DNA replication initiates are determined by a specific sequence motif. These motifs, or ARS elements, are bound by the origin recognition complex (ORC). ORC is required for loading of the initially inactive MCM helicase during origin licensing in G1. In human cells, ORC does not have a specific sequence binding domain and origin specification is not specified by a defined motif. There have thus been great efforts over many years to try to understand the determinants of DNA replication initiation in human cells using a variety of approaches, which have gradually become more refined over time.

      In this manuscript Tian et al. combine data from multiple previous studies using a range of techniques for identifying sites of replication initiation to identify conserved features of replication origins and to examine the relationship between origins and sites of ORC binding in the human genome. The authors identify a) conserved features of replication origins e.g. association with GC-rich sequences, open chromatin, promoters and CTCF binding sites. These associations have already been described in multiple earlier studies. They also examine the relationship of their determined origins and ORC binding sites and conclude that there is no relationship between sites of ORC binding and DNA replication initiation. While the conclusions concerning genomic features of origins are not novel, if true, a clear lack of colocalization of ORC and origins would be a striking finding.

      Response: Thank you. That is where the novelty of the paper lies.

      However, the majority of the datasets used do not report replication origins, but rather broad zones in which replication origins fire. Rather than refining the localisation of origins, the approach of combining diverse methods that monitor different objects related to DNA replication leads to a base dataset that is highly flawed and cannot support the conclusions that are drawn, as explained in more detail below.

      Response: We are using the narrowly defined SNS-seq peaks as the gold standard origins and making sure to focus in on those that fall within the initiation zones defined by other methods. The objective is to make a list of the most reproducible origins. Unlike what the reviewer states, this actually refines the dataset to focus on the SNS origins that have also been reproduced by the other methods in multiple cell lines. We have changed the last box of Fig. 1A to make this clearer: Shared origins = reproducible SNS-seq origins that are contained in initiation zones defined by Repli-seq, OK-seq and Bubble-seq. This and the Fig. 2B (as it is) will make our strategy clearer.

      Methods to determine sites at which DNA replication is initiated can be divided into two groups based on the genomic resolution at which they operate. Techniques such as bubble-seq, ok-seq can localise zones of replication initiation in the range ~50kb. Such zones may contain many replication origins. Conversely, techniques such as SNS-seq and ini-seq can localise replication origins down to less than 1kb. Indeed, the application of these different approaches has led to a degree of controversy in the field about whether human replication does indeed initiate at discrete sites (origins), or whether it initiates randomly in large zones with no recurrent sites being used. However, more recent work has shown that elements of both models are correct i.e. there are recurrent and efficient sites of replication initiation in the human genome, but these tend to be clustered and correspond to the demonstrated initiation zones (Guilbaud et al., 2022).

      These different scales and methodologies are important when considering the approach of Tian et al. The premise that combining all available data from five techniques will increase accuracy and confidence in identifying the most important origins is flawed for two principal reasons. First, as noted above, of the different techniques combined in this manuscript, only SNS-seq can actually identify origins rather than initiation zones. It is the former that matters when comparing sites of ORC binding with replication origin sites if a conclusion is to be drawn that the two do not co-localise.

      Response: We agree. So the reviewer should agree that our method of finding SNS-seq peaks that fall within initiation zones actually refines the origins to find the most reproducible origins. We are not losing the spatial precision of the SNS-seq peaks.

      Second, the authors give equal weight to all datasets. Certainly, in the case of SNS-seq, this is not appropriate. The technique has evolved over the years and some earlier versions have significantly different technical designs that may impact the reliability and/or resolution of the results e.g. in Foulk et al. (Foulk et al., 2015), lambda exonuclease was added to single stranded DNA from a total genomic preparation rather than purified nascent strands), which may lead to significantly different digestion patterns (ie underdigestion). Curiously, the authors do not make the best use of the largest SNS-seq dataset (Akerman et al., 2020) by ignoring these authors separation of core and stochastic origins. By blending all data together any separation of signal and noise is lost. Further, I am surprised that the authors have chosen not to use data and analysis from a recent study that provides subsets of the most highly used and efficient origins in the human genome, at high resolution (Guilbaud et al., 2022).

      Response: 1) We are using the data from Akerman et al., 2020: Dataset GSE128477 in Supplemental Table 1. We have now separately examined the core origins defined by the authors to check its overlap with ORC binding (Supplementary Fig. S8b).

      2) To take into account the refinement of the SNS-seq methods through the years, we actually included in our study only those SNS-seq studies after 2018, well after the lambda exonuclease method was introduced. Indeed, all 66 of SNS-seq datasets we used were obtained after the lambda exonuclease digestion step. To reiterate, we recognize that there may be many false positives in the individual origin mapping datasets. Our focus is on the True positives, the SNS-seq peaks that have some support from multiple SNS-seq studies AND fall within the initiation zones defined by the independent means of origin mapping (described in Fig. 1A and 2B). These True positives are most likely to be real and reproducible origins and should be expected to be near ORC binding sites.

      We have changed the last box of Fig. 1A to make this clearer: Shared origins = reproducible SNS-seq origins that are contained in initiation zones defined by Repli-seq, OK-seq or Bubble-seq.

      Ini-seq by Torsten Krude and co-workers (Guillbaud, 2022) does NOT use Lambda exonuclease digestion. So using Ini-seq defined origins is at odds with the suggestion above that we focus only on SNS-seq datasets that use Lambda exonuclease. However, Ini-seq identifies a much smaller subset of SNS-seq origins, so, as requested, we have also done the analysis with just that smaller set of origins, and it does show a better proximity to ORC binding sites, though even then the ORC proximate origins account for only 30% of the Ini-seq2 origins (Supplementary Fig. S8d). Note Ini-seq2 identifies DNA replication initiation sites seen in vitro on isolated nuclei.

      References:

      Akerman I, Kasaai B, Bazarova A, Sang PB, Peiffer I, Artufel M, Derelle R, Smith G, Rodriguez-Martinez M, Romano M, Kinet S, Tino P, Theillet C, Taylor N, Ballester B, Méchali M (2020) A predictable conserved DNA base composition signature defines human core DNA replication origins. Nat Commun, 11: 4826

      Foulk MS, Urban JM, Casella C, Gerbi SA (2015) Characterizing and controlling intrinsic biases of lambda exonuclease in nascent strand sequencing reveals phasing between nucleosomes and G-quadruplex motifs around a subset of human replication origins. Genome Res, 25: 725-735

      Guilbaud G, Murat P, Wilkes HS, Lerner LK, Sale JE, Krude T (2022) Determination of human DNA replication origin position and efficiency reveals principles of initiation zone organisation. Nucleic Acids Res, 50: 7436-7450

      Reviewer #2 (Public Review):

      Tian et al. perform a meta-analysis of 113 genome-wide origin profile datasets in humans to assess the reproducibility of experimental techniques and shared genomics features of origins. Techniques to map DNA replication sites have quickly evolved over the last decade, yet little is known about how these methods fare against each other (pros and cons), nor how consistent their maps are. The authors show that high-confidence origins recapitulate several known features of origins (e.g., correspondence with open chromatin, overlap with transcriptional promoters, CTCF binding sites). However, surprisingly, they find little overlap between ORC/MCM binding sites and origin locations.

      Overall, this meta-analysis provides the field with a good assessment of the current state of experimental techniques and their reproducibility, but I am worried about: (a) whether we've learned any new biology from this analysis; (b) how binding sites and origin locations can be so mismatched, in light of numerous studies that suggest otherwise; and (c) some methodological details described below.

      Major comments:

      • Line 26: "0.27% were reproducibly detected by four techniques" -- what does this mean? Does the fragment need to be detected by ALL FOUR techniques to be deemed reproducible?

      Response: If the reproducible SNS-seq peaks are included in the reproducible initiation zones found by the other methods, then we consider it reproducible across datasets. The strategy is to focus our analysis on the most reproducible SNS-seq peaks that happen to be in reproducible initiation zones. It is the best way to confidently identify a very small set of true positive origins. We have re-stated this in the abstract: “only 0.27% were reproducibly obtained in at least 20 independent SNS-seq datasets and contained in initiation zones identified by each of three other techniques (20,250 shared origins),...”

      And what if the technique detected the fragment is only 1 of N experiments conducted; does that count as "detected"?

      Response: A reproducible SNS-seq origin has been reproduced above a statistical threshold of 20 reproductions of SNS-seq datasets. A threshold of reproduction in 20 datasets out of 66 SNS-seq datasets gives an FDR of <0.1. This is explained in Fig. 2a and Supplementary Fig. S2. For the initiation zones, we considered a Zone even if it appears in only 1 of N experiments, because N is usually small. This relaxed method for selecting the initiation zones gives the best chance of finding SNS-seq peaks that are reproduced by the other methods.

      Later in Methods, the authors (line 512) say, "shared origins ... occur in sufficient number of samples" but what does sufficient mean?

      Response: “Sufficient” means that SNS-seq origin was reproducibly detected in ≥ 20 datasets and was included in any initiation zone defined by three other techniques.

      Then on line 522, they use a threshold of "20" samples, which seems arbitrary to me. How are these parameters set, and how robust are the conclusions to these settings? An alternative to setting these (arbitrary) thresholds and discretizing the data is to analyze the data continuously; i.e., associate with each fragment a continuous confidence score.

      Response: We explained Fig. 2a and Supplementary Fig. S2 on line 192 as follows: The occupancy score of each origin defined by SNS-seq (Supplementary Fig. 2a) counts the frequency at which a given origin is detected in the datasets under consideration. For the random background, we assumed that the number of origins confirmed by increasing occupancy scores decreases exponentially (see Methods and Supplementary Table 2). Plotting the number of origins with various occupancy scores when all SNS-seq datasets published after 2018 are considered together (the union origins) shows that the experimental curve deviates from the random background at a given occupancy score (Fig. 2a). The threshold occupancy score of 20 is the point where the observed number of origins deviates from the expected background number (with an FDR < 0.1) (Fig. 2a).

      In the Methods: We have revised the section, “Identification of shared origins” to better describe our strategy. The number of observed origins with occupancy score greater than 20 (out of 66 measures) is 10 times more than expected from the background model. This approach is statistically sound and described by us in (Fang et al. 2020).

      • Line 20: "50,000 origins" vs "7.5M 300bp chromosomal fragments" -- how do these two numbers relate? How many 300bp fragments would be expected given that there are ~50,000 origins? (i.e., how many fragments are there per origin, on average)? This is an important number to report because it gives some sense of how many of these fragments are likely nonsense/noise. The authors might consider eliminating those fragments significantly above the expected number, since their inclusion may muddle biological interpretation.

      Response: We confused the reviewer by the way we wrote the abstract. The 50,000 origins that are mentioned in the abstract is the hypothetical expected number of origins that have to fire to replicate the whole 6x10^9 nt diploid genome based on the average inter-origin distance of 100 kb (as determined by molecular combing). The 7.5M 300 bp fragments are the genomic regions where the 7.5M union SNS-seq-defined origins are located. Clearly, that is a lot of noise, some because of technical noise and some due to the fact that origins fire stochastically. Which is why our paper focuses on a smaller number of reproducible origins, the 20,250 shared origins. Our analysis is on the 20,250 shared origins, and not on all 7.5M union origins. Thus, we are not including the excess of non-reproducible (stochastic?) origins in our analysis.

      The revised abstract in the revised paper will say: “Based on experimentally determined average inter-origin distances of ~100 kb, DNA replication initiates from ~50,000 origins on human chromosomes in each cell-cycle. The origins are believed to be specified by binding of factors like the Origin Recognition Complex (ORC) or CTCF or other features like G-quadruplexes. We have performed an integrative analysis of 113 genome-wide human origin profiles (from five different techniques) and 5 ORC-binding site datasets to critically evaluate whether the most reproducible origins are specified by these features. Out of ~7.5 million union origins identified by all the SNS-seq datasets, only 0.27% were reproducibly obtained in at least 20 independent SNS-seq datasets and contained in initiation zones identified by any of three other techniques (20,250 shared origins), suggesting extensive variability in origin usage and identification in different circumstances.”

      • Line 143: I'm not terribly convinced by the PCA clustering analysis, since the variance explained by the first 2 PCs is only ~25%. A more robust analysis of whether origins cluster by cell type, year etc is to simply compute the distribution of pairwise correlations of origin profiles within the same group (cell type, year) vs the correlation distribution between groups. Relatedly, the authors should explain what an "origin profile" is (line 141). Is the matrix (to which PCA is applied) of size 7.5M x 113, with a "1" in the (i,j) position if the ith fragment was detected in the jth dataset?

      Response: The reviewer is correct about how we did the PCA and have now included the description in the Methods. We have now done the pairwise correlations the way the reviewer suggests, and it is clear that each technique correlates best with itself (though there are some datasets that do not correlate as well as the others even with the same technique) (Supp. Fig. S3). We have also done the PCA by techniques (Fig. 1c), by cell types for all techniques (Supp. Fig. S1c), by cell-types for SNS-seq only (Supp. Fig. S1d), and by year of publication of SNS-seq data (Supp. Fig. S1e). Our conclusions remain the same: in general, origins defined from the same cell lineage are more similar to each other than across lineages, though this similarity within a lineage is more pronounced when we focus on SNS-seq alone. However, even when we look at SNS-seq alone, there is not a perfect overlap of origins determined by different studies on the same lineage. Finally, although we looked only at SNS-seq data after 2018, by which time lamda exonuclease had become the accepted way of defining SNS-seq, there is surprising clustering around each year.

      • It's not clear to me what new biology (genomic features) has been learned from this meta-analysis. All the major genomic features analyzed have already been found to be associated with origin sites. For example, the correspondence with TSS has been reported before:

      https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6320713/

      https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6547456/

      So what new biology has been discovered from this meta-analysis?

      Response: The new biology can be summarized as: (a) We can identify a set of reproducible (in multiple datasets and in multiple cell lines) SNS-seq origins that also fall within initiation zones identified by completely independent methods. These may be the best origins to study in the midst of the noise created by stochastic origin firing. (b) The overlap of these Shared origins (True Positive Origins) with known ORC binding sites is tenuous. So either all the origin mapping data, or all the ORC binding data has to be discarded, or this is the new biological reality in mammalian cancer cells: on a genome-wide scale the most reproduced origins are not in close proximity to ORC binding sites, in contrast to the situation in yeast. (c) Several of the features reported to define origins (CTCF binding sites, G quadruplexes etc.) could simply be from the fact that those features also define transcription start sites (TSS), and the origins may prefer to locate to these parts of the genome because of the favorable chromatin state, instead of the sequence or the structural features of CTCF binding sites or G quadruplexes specifically locating the origins.

      • Line 250: The most surprising finding is that there is little overlap between ORC/MCM binding sites and origin locations. The authors speculate that the overlap between ORC1 and ORC2 could be low because they come from different cell types. Equally concerning is the lack of overlap with MCM. If true, these are potentially major discoveries that butts heads with numerous other studies that have suggested otherwise. More needs to be done to convince the reader that such a mis-match is true. Some ideas are below:

      Idea 1) One explanation given is that the ORC1 and ORC2 data come from different cell types. But there must be a dataset where both are mapped in the same cell type. Can the authors check the overlap here? In Fig S4A, I would expect the circles to not only strongly overlap but to also be of roughly the same size, since both ORC's are required in the complex. So something seems off here.

      Response: We agree with the reviewer that there is something “off here”. Either the techniques that report these sites are all wrong, or the biology does not fit into the prevailing hypothesis. As shown in Supplementary Fig. S6C, we do not have ORC1 and ORC2 ChIP-seq data from the same cell-type. We have ORC1 ChIP-seq and SNS-seq data from HeLa cells and ORC2 ChIP seq and origins from K562 cells, and so have now done the overlap of the binding sites to the shared origins in the same cell-type in the new Figure S5e and S5f. Out of 9605 shared origins in K562 cells, 12.8% overlap with ORC2 and 5.4% overlap with MCM3-7 binding sites also defined in K562 cells. Out of 8305 shared origins in HeLa cells, 4.4% overlap with ORC1 binding sites defined in HeLa cells.

      There is nothing in the Literature that shows that various ORC subunits ChiP-seq to the same sites, and we have unpublished data that shows very poor overlap in the CHiP binding sites of different ORC subunits. The poor overlap between the binding sites of subunits of the same complex either suggests that the subunits do not always bind to the chromatin as a six-subunit complex or that all the ORC subunit ChIP-seq data in the Literature is suspect. We provide in the supplementary figure S6A examples of true positive complexes (SMARCA4/ARID1A, SMC1A/SMC3, EZH2/SUZ12), whose subunits ChIP-seq to a large fraction of common sites.

      Idea 2) Another explanation given is that origins fire stochastically. One way to quantify the role of stochasticity is to quantify the overlap of origin locations performed by the same lab, in the same year, in the same experiment, in the same cell type -- i.e., across replicates -- and then compute the overlap of mapped origins. This would quantify how much mis-match is truly due to stochasticity, and how much may be due to other factors.

      Response: A given lab may have superior reproducibility with its own results compared to the entire field, and the finding that origins published in the same year tend to be clustered together could be because a given lab publishes a number of origin sets in a single paper in a given year. But the notion of stochasticity is well accepted in the field because of this observation: the average inter-origin distance measured by single molecule techniques like molecular combing is ~100 kb, but the average inter-origin distance measure on a population of cells (same cell line) is ~30 kb. The only explanation is that in a population of cells many origins can fire, but in a given cell on a given allele, only one-third of those possible origins fire. This is why we did not worry about the lack of reproducibility between cell-lines, labs etc, but instead focused on those SNS-seq origins that are reproducible over multiple techniques and cell lines.

      Idea 3) A third explanation is that MCMs are loaded further from origin sites in human than in yeast. Is there any evidence of this? How far away does the evidence suggest, and what if this distance is used to define proximity?

      Response: MCMs, of course, have to be loaded at an origin at the time the origin fires because MCMs provide the core of the helicase that starts unwinding the DNA at the origin. Thus, the lack of proximity of MCM binding sites with origins can be because the most detected MCM sites (where MCM spends the most time in a cell-population) does not correspond to where it is first active to initiate origin firing. This has been discussed. MCMs may be loaded far from origin site, but because of their ability to move along the chromatin, they have to move to the origin-site at some point to fire the origin.

      Idea 4) How many individual datasets (i.e., those collected and published together) also demonstrate the feature that ORC/MCM binding locations do not correlate with origins? If there are few, then indeed, the integrative analysis performed here is consistent. But if there are many, then why would individual datasets reveal one thing, but integrative analysis reveal something else?

      Response: In the revised manuscript we have now discussed Dellino, 2013; Kirstein, 2021; Wang, 2017; Mas, 2023. None of them have addressed what we are addressing, which is whether the small subset of the most reproducible origins proximal to ORC or MCM binding sites, but the discussion is essential.

      Idea 5) What if you were much more restrictive when defining "high-confidence" origins / binding sites. Does the overlap between origins and binding sites go up with increasing restriction?

      Response: We have made SNS-seq origins more restrictive by selecting those reproduced by 30, 40, or 50 datasets, in addition to the FDR-determined cutoff of 20. The number of origins fall, but when we do not see any significant increase in the % of origins that overlap with or are proximal to with all ORC or MCM binding sites or Shared ORC or MCM binding sites. This analysis is now included in Supp. Fig. S9 and discussed.

      Overall, I have the sense that these experimental techniques may be producing a lot of junk. If true, this would be useful for the field to know! But if not, and there are indeed "unexplored mechanisms of origin specification" that would be exciting. But I'm not convinced yet.

      • It would be nice in the Discussion for the authors to comment about the trade-offs of different techniques; what are their pros and cons, which should be used when, which should be avoided altogether, and why? This would be a valuable prescription for the field.

      Response: Thanks for the suggestion. We have done what the reviewer suggested in the new Supp. Fig. S4.

      Among the 20,250 high-confidence shared origins, 9,901 (48.9%) overlapped with SNS-seq origins in K562; 3,872 (19.1%) overlapped with OK-seq IZs; 1,163 (5.7%) overlapped with Repli-seq IZs.

      In the reciprocal direction, we asked which method best picks out the highly reproducible shared origins. 2.7% of SNS-seq origins, 17.2% of OK-seq initiation zones and 7.7% of Repli-seq initiation zones overlapped with the 20,250 shared origins

      Thus SNS-seq identifies more of the reproducible origins, but it comes with a high false positive rate.

      ORC ChIP-seq and MCM ChIP-seq data do not define origins: they define the binding sites of these proteins. Thus we have discussed why the ChIP-seq sites of these protein complexes should not be used to define origins.

      Reviewer #3 (Public Review):

      Summary: The authors present a thought-provoking and comprehensive re-analysis of previously published human cell genomics data that seeks to understand the relationship between the sites where the Origin Recognition Complex (ORC) binds chromatin, where the replicative helicase (Mcm2-7) is situated on chromatin, and where DNA replication actually beings (origins). The view that these should coincide is influenced by studies in yeast where ORC binds site-specifically to dedicated nucleosome-free origins where Mcm2-7 can be loaded and remains stably positioned for subsequent replication initiation. However, this is most certainly not the case in metazoans where it has already been reported that chromatin bindings sites of ORC, Mcm2-7, and origins do not necessarily overlap, likely because ORC loads the helicase in transcriptionally active regions of the genome and, since Mcm2-7 retains linear mobility (i.e., it can slide), it is displaced from its original position by other chromatin-contextualized processes (for example, see Gros et al., 2015 Mol Cell, Powell et al., 2015 EMBO J, Miotto et al., 2016 PNAS, and Prioleau et al., 2016 G&D amongst others). This study reaches a very similar conclusion: in short, they find a high degree of discordance between ORC, Mcm2-7, and origin positions in human cells.

      Strengths: The strength of this work is its comprehensive and unbiased analysis of all relevant genomics datasets. To my knowledge, this is the first attempt to integrate these observations and the analyses employed were suited for the questions under consideration.

      Response: Thank you for recognizing the comprehensive and unbiased nature of our analysis. The fact that the major weakness is that the comprehensive view fails to move the field forward, is actually a strength. It should be viewed in the light that we cannot find evidence to support the primary hypothesis: that the most reproducible origins must be near ORC and MCM binding sites. This finding will prevent the unwise adoption of ORC or MCM binding sites as surrogate markers of origins and will stimulate the field to try and improve methods of identifying ORC or MCM binding until the binding sites are found to be proximal to the most reproducible origins. The last possibility is that there are ORC- or MCM-independent modes of defining origins, but we have no evidence of that.

      Weaknesses: The major weakness of this paper is that this comprehensive view failed to move the field forward from what was already known. Further, a substantial body of relevant prior genomics literature on the subject was neither cited nor discussed. This omission is important given that this group reaches very similar conclusions as studies published a number of years ago. Further, their study seems to present a unique opportunity to evaluate and shape our confidence in the different genomics techniques compared in this study. This, however, was also not discussed.

      Response: We have done what the reviewer suggested: use K562 cell type-specific data where origins have been defined by three methods and reporting the percent of shared origins identified by each method (Supp. Fig. S4). Thanks for the suggestion. We have discussed now that SNS-seq identifies more of the reproducible origins, but it comes with a high false positive rate. ORC ChIP-seq and MCM ChIP-seq data do not define origins: they define the binding sites of these proteins. Thus, we have discussed that the ChIP-seq sites of these protein complexes as we now have them should not be used to define origins.

      We do not cite the SNS-seq data before 2018 because of the concerns discussed above about the earlier techniques needing improvement. We have discussed other genomics data that we failed to discuss.

      We have cited the papers the reviewer names:

      Gros, Mol Cell 2015 and Powell, EMBO J. 2015 discuss the movement of MCM2-7 away from ORC in yeast and flies and will be cited. MCM2-7 binding to sites away from ORC and being loaded in vast excess of ORC was reported earlier on Xenopus chromatin in PMC193934, and will also be cited.

      Miotto, PNAS, 2016: publishes ORC2 ChIP-seq sites in HeLa (data we have used in our analysis), but do not measure ORC1 ChIP-seq sites. They say: “ORC1 and ORC2 recognize similar chromatin states and hence are likely to have similar binding profiles.” This is a conclusion based on the fact that the ChIP seq sites in the two studies are in areas with open chromatin, it is not a direct comparison of binding sites of the two proteins.

      Prioleau, G&D, 2016: This is a review that compared different techniques of origin identification but has no primary data to say that ORC and MCM binding sites overlap with the most reproducible origins. It has now been referenced in the context of epigenetic marks and origins.

      Reviewing Editor:

      While there is some disagreement between the reviewers about the analysis performed, there are relevant concerns about the data analyzed (reviewers 1 and 2) and the biological significance of the observation (all three reviewers). There is also concern raised about the ORC ChIP-Seq data and the lack of overlap between published data for ORC1 and ORC2, which, if they were in a complex, the overlap in binding sites should be much better that reported.

      Given the high overlap of ChIP-seq data for subunits of three other complexes shown in Supp. Fig. S6A, the most likely explanation is that ORC1 and ORC2 do not necessarily bind to DNA only as part of a complex. In other words, other protein complexes that contain one subunit or the other also bind DNA. This is not entirely unexpected. Biochemically the ORC2-3-4-5 complex is more stable and more abundant than the six subunit ORC.

      Reviewer #2 (Recommendations For The Authors):

      Minor comments:

      • Line 44, missing spaces near references: "origins(Hu". Repeated issue throughout the manuscript.

      • Line 82: "Notably any technical biases are uniquely associated with each assay" -- how do you know the biases are unique to each assay and orthogonal to each other?

      • Line 135: typo: "using pipeline"

      • Line 136: "All the 113 datasets" -> "Each of the 113 datasets"?

      • Line 156: "differences among different techniques" -> "different" can be removed.

      • Figure 4F: I don't see any difference in 4F amongst shared *. What is the y-axis anyways?

      We have addressed these issues in the revised manuscript.

      Reviewer #3 (Recommendations For The Authors):

      The most significant omission is a contextualization of the results in the discussion and an explanation of why these results matter for the biology of replication, disease, and/or our confidence in the genomic techniques reported on in this study. As written, the discussion simply restates the results without any interpretation towards novel insight. I suggest that the authors revise their discussion to fill this important gap.

      A second important, unresolved point is whether replication origins identified by the various methods differ due to technical reasons or because different cell types were analyzed. Given the correlation between TSS and origins (reported in this study but many others too), it is somewhat expected that origins will differ between cell types as each will have a distinct transcriptional program. This critique is partly addressed in Figure S1C. However, given the conclusion that the techniques are only rarely in agreement (only 0.27% origins reproducibly detected by the four techniques), a more in-depth analysis of cell type specific data is warranted. Specifically, I would suggest that cell type-specific data be reported wherever origins have been defined by at least two methods in the same cell type, specifically reporting the percent of shared origins amongst the datasets. This type of analysis may also inform on whether one or more techniques produces the highest (or lowest) quality list of true origins.

      We have done what has been suggested: used K562 cell type-specific data because here the origins have been defined by at least two methods in the same cell type, and reported the percent of shared origins amongst the datasets (Supp. Fig. S4).

      Other MINOR comments include:

      • Line 215: the authors show that shared origins overlap with TF binding hotspots more often than union origins, which they claim suggests "that they are more likely to interact with transcription factors." As written, it sounds like the authors are proposing that ORC may have some direct physical interaction with transcription factors. Is this intended? If so, what support is there for this claim?

      The reviewer is correct. We have rephrased because we have no experimental support for this claim.

      • In the text, Figure 3G is discussed before Figure 3F. I suggest switching the order of these panels in Figure 3.

      Done.

      • It's not clear what Figure 5H to Figure 6 accomplishes. What specifically is added to the story by including these data? Is there something unique about the high confidence origins? If there is nothing noteworthy, I would suggest removing these data.

      We want to keep them to highlight the small number of origins that meet the hypothesis that ORC and MCM must bind at or near reproducible origins. These would be the origins that the field can focus in on for testing the hypothesis rigorously. They also show the danger of evaluating proximity between ORC or MCM binding sites with origins based on a few browser shots. If we only showed this figure we could conclude that ORC and MCM binding sites are very close to reproducible origins.

      • Line 394: "Since ORC is an early factor for initiating DNA replication, we expected that shared human origins will be proximate to the reproducible ORC binding sites." This is only expected if one disbelieves the prior literature that shows that ORC and origins are not, in many cases, proximal. This statement should be revised, or the previous literature should be cited, and an explanation provided about why this prior work may have missed the mark.

      We do not know of any genome-wide study in mammalian cell lines where ORC binding sites and MCM binding have been compared to highly reproducible origins, or that show that these binding sites and highly reproducible origins are mostly not proximal to each other. Most studies cherry pick a few origins and show by ChIP-PCR that ORC and/or MCM bind near those sites. Alternatively, studies sometimes show a selected browser shot, without a quantitative measure of the overlap genome wide and without doing a permutation test to determine if the observed overlap or proximity is higher than what would be expected at random with similar numbers of sites of similar lengths. In the revised manuscript we have discussed Dellino, 2013; Kirstein, 2021; Wang, 2017; Mas, 2023. None of them have addressed what we are addressing, is the small subset of the most reproducible origins proximal to ORC or MCM binding sites?

      • Line 402-404: given the lack of agreement between ORC binding sites and origins the authors suggest as an explanation that "MCM2-7 loaded at the ORC binding sites move much further away to initiate origins far from the ORC binding sites, or that there are as yet unexplored mechanisms of origin specification in human cancer cells". The first part of this statement has been shown to be true (Mcm2-7 movement) and should be cited. But what do the authors mean by the second suggestion of "unexplored mechanisms"? Please expand.

      We have addressed this point in the revised manuscript.

      • The authors should better reference and discuss the previous literature that relates to their work, some of these include Gros et al., 2015 Mol Cell, Powell et al., 2015 EMBO J, Miotto et al., 2016 PNAS, but likely there are many others.

      We have addressed this point in the revised manuscript.

    1. Author Response

      The following is the authors’ response to the original reviews.

      We are very grateful for your time and efforts spent on our manuscript. Your feedback has been very valuable. Please see below a point-by-point response to each suggestion and actions taken to address each point in the manuscript.

      eLife assessment

      In this fundamental study, the authors propose analytical methods for inferring evolutionary parameters of interest from sequencing data in healthy tissue relevant to hematopoiesis. By combining analyses of single cell and bulk sequencing data, the authors can use a stochastic process to inform different aspects of genetic heterogeneity. The strength of evidence in support of the authors' claim is thus compelling. The work will be of broad interest to cell biologists and theoretical biologists.

      Public Reviews:

      Reviewer #1 (Public Review):

      Summary:

      Authors propose mathematical methods for inferring evolutionary parameters of interest from bulk/single cell sequencing data in healthy tissue and hematopoiesis. In general, the introduction is well-written and adequately references the relevant and important previous literature and findings in this field (e.g. the power laws for well-mixed exponentially growing populations). The authors consider 3 phases of human development: early development, growth and maintenance, and mature phase. In particular, time-dependent mutation rates in Figure 2d is an intriguing and strong result, and the process underlying Figures 3 and 4 are generally wellexplained and convincing.

      Thank you for your positive comments.

      Notes & suggestions:

      1. The explanation of Figure 2 in Lines 101 - 111 should be expanded for clarity. First, is Figure 2a derived from stochastic simulation (line 101 suggests) or some theoretical analysis? Second, the gradual transition from f-2 to f-1 is appreciated, but the shape of the intermediates is not addressed in detail. The power laws are straight lines, and the simulations provide curved lines -- please expand in what range (low or high frequency variants) the power law approximations apply.

      Figure 2a was obtained from a numerical solution of equation 1, which describes the time dynamics of the expected VAF distribution. This is indeed unclear from the text, and we thank the reviewer for pointing out this discrepancy.

      We thank the reviewer for this suggestion and have now adjusted this in the text (102-110):

      “Numerical solutions of Eq.(1) show that the expected VAF distribution exhibits a gradual transition from the f-2 (growing population) to the f-1 (constant population) power law (Fig.2). These transitional states themselves do not adhere to some intermediate power-law (e.g. f for 1<<2), but instead present a sigmoidal shape, with the low frequency portion following f-1 and the high frequencies f-2 . Over time the shape changes as a wavelike front traveling from low to high frequency, with the constant-size equilibrium establishing earliest at the lowest frequencies and moving to higher frequency over time. Interestingly, the convergence towards equilibrium slows down over time -- for evenly-spaced observation times the solutions lie increasingly closer together -- further decreasing the speed at which the high frequency portion of the spectrum approaches equilibrium.”

      We also changed the caption of Figure 2 to make this clearer as

      “(a) Expected VAF distributions from evolving Eq1 to different time points for a population with an initial exponential growth phase and subsequent constant population phase (mature size N=103). Once the population reaches the maximum carrying capacity, the distribution moves from a 1/f2 growing population shape (purple) to a 1/f constant population shape (green). Note that the shift slows considerably at older age.”

      In addition, we have also added annotations to Figure 2a and 2b to further clarify which line (green or purple) is f-1 and f-2.

      Additionally, I do not understand the claim in line 108, that the transition is fast for low frequency variants, as the low frequency (on the left of the graph) lines are all close together, whereas the high frequency lines are far apart.

      The lines are closer together in the low frequency portion (left of the plot) because they are already very close to the constant-size equilibrium (f-1/green line) and these frequencies approached equilibrium very fast. On the contrary, in the high frequency portion (right side of plot) they are still very far from equilibrium and approached equilibrium much slower.

      It would be helpful to reiterate in this paragraph that these power laws are derived based on exponentially growing populations and are expected to break down under homeostatic conditions.

      We have adjusted the relevant paragraph in the text to make the validity of the power laws clearer (90-94):

      “For a well-mixed exponentially growing population without cell death the VAF spectrum 𝑣(𝑓) is given by 2𝜇/(𝑓 + 𝑓2 )$ (a 𝑓−2 power law) and is independent of time. In contrast, for a population of constant size – i.e. where birth and death rates are equal – the spectrum obeys 𝑣(𝑓) ∝ 2𝜇/ 𝑓 (a 𝑓−1 power law; see also SI), though this solution is only valid at sufficiently long times.”

      1. The sample vs population (blue vs orange) in Figure 3 is under-explained. How is it that the mutational burden and inferred mutation rate in A and B roughly match, but the VAF distributions in C are so different? How was the sampled set chosen? Perhaps this is an unimportant distinction based on the particular sample set, but the divergence of the two in C may serve as a distraction, here.

      This is an important question, and the answer was perhaps underemphasized in the caption. The sampling was performed as a uniform random sampling with replacement, and the same sample set was used for both the mutational burden and the VAF distribution. The reason for this stark contrast is that while the expectation of the burden distribution is not affected by sampling (i.e. sampling only affects the resolution/amount of stochasticity), the expectation of the VAF distribution changes due to sampling. While this was discussed in the section "Sparse sampling, single cell derived VAF spectra and evolutionary inferences", we have added note of this (indeed surprising) effect in the caption as well:

      “(b) Distribution of estimated mutation rates from 10'000 individual simulations, obtained from burden distributions of the complete populations (blue) as well as sampled sets of cells (orange). Because the expected mutational burden distribution is unaltered by sampling, the expected estimate of the mutation rate from (5) remains unchanged: 𝐸(𝜇̃𝑝𝑜𝑝) = 𝐸(𝜇̃𝑠𝑎𝑚𝑝𝑙𝑒). However, sampling increases the noise on the observed burden distribution, which results in a higher errormargin of the estimate: 𝜎(𝜇̃𝑝𝑜𝑝) < 𝜎(𝜇̃𝑠𝑎𝑚𝑝𝑙𝑒).”

      “(c) VAF spectra measured in the complete population (blue) and a sampled set of cells (orange). In contrast with the mutational burden distribution, strong sampling changes the shape of the expected distribution. A single simulation result is shown (diamonds) alongside the theoretically predicted expected values for both the total and sampled populations (Eqs. (1) and (6))(dashed line) and the average across 100 simulations (solid line).”

      1. The comparison of results herein to claims by Mitchell (ref. 12) are quite important results within the paper. I appreciate the note in the final paragraph of the discussion, and I suggest adding a sentence referencing the result noted in line 248-249 to the abstract, as well.

      We agree with the reviewer. We have extended the abstract now to reference the result in more detail:

      “However, the single cell mutational burden distribution is over-dispersed compared to a model of Poisson distributed random mutations suggesting. A time-associated model of mutation accumulation with a constant rate alone cannot generate such a pattern. At least one additional source of stochasticity would be needed. Possible candidates for these processes may be occasional bursts of stem cell divisions, potentially in response to injury, or non-constant mutation rates either through environmental exposures or cell intrinsic variation.”

      Reviewer #2 (Public Review):

      Summary: The authors provide a nice summary on the possibility to study genetic heterogeneity and how to measure the dynamics of stem cells. By combining single cell and bulk sequencing analyses, they aim to use a stochastic process and inform on different aspects of genetic heterogeneity.

      Strengths: Well designed study and strong methods

      Thank you for your positive comments.

      Weaknesses: Minor

      Further clarification to Figure 3 legend would be good to explain the 'no association' of number of samples and mutational burden estimate as per line 180-182 p.8.

      We have added a note to the caption of Figure 3b to explain more clearly how sampling affects the burden distribution and the mutation rate inferred from it (see also previous response to Reviewer 1):

      “Because the expected mutational burden distribution is unaltered by sampling, the expected estimate of the mutation rate from (5) remains unchanged: 𝐸(𝜇̃𝑝𝑜𝑝) = 𝐸(𝜇̃𝑠𝑎𝑚𝑝𝑙𝑒). However, sampling increases the noise on the observed burden distribution, which results in a higher errormargin of the estimate: 𝜎(𝜇̃𝑝𝑜𝑝) < 𝜎(𝜇̃𝑠𝑎𝑚𝑝𝑙𝑒).”

      Reviewer #1 (Recommendations For The Authors):

      Minor/editorial suggestions:

      1. Equation 1, please define \partial_t and \partial_K, for clarity.

      These have now been defined in the text (between line 85-86): “where 𝜅 = 𝑓𝑁(𝑡) denotes the number of cells sharing a variant (the variant frequency f times the total population size N), 𝛿(x) is the Dirac impulse function, 𝜕𝑡 and 𝜕𝜅 are the partial derivatives with respect to time and variant size.”

      1. Figure 2: It would be helpful to label the green and purple lines with the corresponding 1/f and 1/f^2 rule, in addition to the growing/fixed label, for clarity.

      We agree and have now added the corresponding labels to each line.

      Reviewer #2 (Recommendations For The Authors):

      Minor suggestions are given below:

      It would be nice for the authors to comment on whether the results could be extended/modified to account for possible fitness advantage of mutations which would be clinically relevant, for instance in the case of CHIP mutations and difference in time to myeloid malignancies transformation between CHIP/No CHIP individuals.

      This is an important point. We agree with the reviewer that CHIP mutations play an important role in shaping mutational diversity especially in older individuals. Evidence is now emerging that CHIP mutations are almost universally present in individuals 60+. Interestingly, in individuals younger than 60, a neutral model (as presented here), does capture the observed effective dynamics well. For the purpose of the analysis underlying this manuscript, a neutral model seems reasonable.

      The techniques we use here can be adjusted to include selection. How the results extend or modify will critically depend on the actual model of selection (rare or frequent CHIP mutations, strong vs weak selection etc.) that is realized in human hematopoiesis. Here we would say, the underlying biology currently is mostly unknown and is subject to (by others and in part by us) ongoing investigations, which extend beyond the scope of this manuscript.

      We now make note of this point in the manuscript and added a small paragraph in page 11 to the discussion:

      “Another open question is the role of selection and how it shapes intra-tissue genetic heterogeneity. Evidence is emerging that positively selected variants in blood are almost universally present in individuals above 60, while the effective observable dynamics in younger individuals is well described by neutral dynamics. How results presented here generalize or modify will critically depend on the model of selection realized in human hematopoiesis, e.g. a models of rare or frequent driver events. Details of the underlying biology are currently unknown.”

      It would be nice to see if any significant differences in parameter estimates occur between loci with/without linkage disequilibrium, for instance HLA region. Could the number of single-cell samples be 'more' relevant when studying the VAF distribution in HLA region?

      This is a good suggestion. We might be wrong or missing an important point, but somatic evolution as we use it in our modeling here is solely driven by asexual reproduction of cells. As such the entire genome of the cell is in linkage disequilibrium, independent of the precise genomic region (somatic evolution is in first approximation blind to germline mutations, as they are present in every single cell of the organism and therefore do not carry any information on the somatic evolutionary dynamics).

      We thank all editors and reviewers again for your constructive comments.

    1. Author Response

      I would like to express my thorough gratitude to the editors and reviewers, for the helpful comments and valuable suggestions, which provided us an opportunity to further address our research. Prior to submitting our final revision, here we provide our preliminary responses for the comments. Please find our detailed responses to the reviewers’ recommendations below.

      Reviewer #1 (Public Review):

      Summary:

      The authors were trying to understand the relationship between the development of large trunks and longirrostrine mandibles in bunodont proboscideans of Miocene, and how it reflects the variation in diet patterns.

      Strengths:

      The study is very well supported, written, and illustrated, with plenty of supplementary material. The findings are highly significant for the understanding of the diversification of bunodont proboscideans in Asia during Miocene, as well as explaining the cranial/jaw disparity of fossil lineages. This work elucidates the diversification of paleobiological aspects of fossil proboscideans and their evolutionary response to open environments in the Neogene using several methods. The authors included all Asian bunodont proboscideans with long mandibles and I suggest that they should use the expression "bunodont proboscideans" instead of gomphotheres.

      Weaknesses:

      I believe that the only weakness is the lack of discussion comparing their results with the development of gigantism and long limbs in proboscideans from the same epoch.

      Response: Thank you for your comprehensive review and positive feedback on our study regarding the co-evolution of feeding organs in bunodont proboscideans during the Miocene. We appreciate your suggestion, and have decided to use the term "bunodont elephantiforms" (for more explicit clarification, we use elephantiforms to exclude some early proboscideans, like Moeritherium, ect.) instead of "gomphotheres," and we will make this change in our revised manuscript. We also appreciate the potential weakness you mentioned regarding the lack of discussion comparing our results with the development of gigantism and long limbs in proboscideans from the same epoch. We agree with the reviewer’s suggestion, and we are aware that gigantism and long limbs are potential factors for trunk development. Gigantism resulted in the loss of flexibility in elephantiforms, and long limbs made it more challenging for them to reach the ground. A long trunk serves as compensation for these limitations. limb bones were rare to find in our material, especially those preserved in association with the skull.

      Reviewer #2 (Public Review):

      This study focuses on the eco-morphology, the feeding behaviors, and the co-evolution of feeding organs of longirostrine gomphotheres (Amebelodontidae, Choerolophodontidae, and Gomphotheriidae) which are characterised by their distinctive mandible and mandible tusk morphologies. They also have different evolutionary stages of food acquisition organs which may have co-evolve with extremely elongated mandibular symphysis and tusks. Although these three longirostrine gomphothere families were widely distributed in Northern China in the Early-Middle Miocene, the relative abundances and the distribution of these groups were different through time as a result of the climatic changes and ecosysytems.

      These three groups have different feeding behaviors indicated by different mandibular symphysis and tusk morphologies. Additionally, they have different evolutionary stages of trunks which are reflected by the narial region morphology. To be able to construct the feeding behavior and the relation between the mandible and the trunk of early elephantiformes, the authors examined the crania and mandibles of these three groups from the Early and Middle Miocene of northern China from three different museums and also made different analyses.

      The analyses made in the study are:

      1. Finite Element (FE) analysis: They conducted two kinds of tests: the distal forces test, and the twig-cutting test. With the distal forces test, advantageous and disadvantageous mechanical performances under distal vertical and horizontal external forces of each group are established. With the twig-cutting test, a cylindrical twig model of orthotropic elastoplasity was posed in three directions to the distal end of the mandibular task to calculate the sum of the equivalent plastic strain (SEPS). It is indicated that all three groups have different mandible specializations for cutting plants.

      2. Phylogenetic reconstruction: These groups have different narial region morphology, and in connection with this, have different stages of trunk evolution. The phylogenetic tree shows the degree of specialization of the narial morphology. And narial region evolutionary level is correlated with that of character-combine in relation to horizontal cutting. In the trilophodont longirostrine gomphotheres, co-evolution between the narial region and horizontal cutting behaviour is strongly suggested.

      3. Enamel isotopes analysis: The results of stable isotope analysis indicate an open environment with a diverse range of habitats and that the niches of these groups overlapped without obvious differentiation.

      The analysis shows that different eco-adaptations have led to the diverse mandibular morphology and open-land grazing has driven the development of trunk-specific functions and loss of the long mandible. This conclusion has been achieved with evidence on palaecological reconstruction, the reconstruction of feeding behaviors, and the examination of mandibular and narial region morphology from the detailed analysis during the study.

      All of the analyses are explained in detail in the supplementary files. The 3D models and movies in the supplementary files are detailed and understandable and explain the conclusion. The conclusions of the study are well supported by data.

      Response: We appreciate your detailed and insightful review of our study. Your summary accurately captures the essence of our research, and we are pleased to note that multiple research methods were used to demonstrate our conclusions. Your recognition of the evidence-based conclusions from palaeoecological, feeding behavior reconstruction, and morphological analyses reinforces the validity of our findings. Once again, we appreciate your time and thoughtful reviews.

    1. Author Response

      Reviewer #1 (Public Review):

      Summary:

      This study presents careful biochemical experiments to understand the relationship between LRRK2 GTP hydrolysis parameters and LRRK2 kinase activity. The authors report that incubation of LRRK2 with ATP increases the KM for GTP and decreases the kcat. From this, they suppose an autophosphorylation process is responsible for enzyme inhibition. LRRK2 T1343A showed no change, consistent with it needing to be phosphorylated to explain the changes in G-domain properties. The authors propose that phosphorylation of T1343 inhibits kinase activity and influences monomer-dimer transitions.

      Strengths: The strengths of the work are the very careful biochemical analyses and the interesting result for wild-type LRRK2.

      Weaknesses:

      A major unexplained weakness is why the mutant T1343A starts out with so much lower activity--it should be the same as wild-type, non-phosphorylated protein. Also, if a monomer-dimer transition is involved, it should be either all or nothing. Other approaches would add confidence to the findings.

      We thank the reviewer for these suggestions. We are aware that the T1343A has generally a lower activity compared to the wild type. Therefore, we would like to emphasize that this mutant is the only one not showing an increase in Km values after ATP treatment. Other mutants, also having lower kcat values like T1503A, still show this characteristic change in Km. Our favored explanation for the lower kcat of T1343A is that this mutation lays within a critical region, the so-called ploop, of the Roc domain and is very likely structurally not neutral. Concerning the dimer-monomer transition, we are convinced that there is more than one factor involved in this equilibrium. Most likely, including, but not limited to other LRRK2 domains (e.g. the WD40 domain), binding of co-factors (e.g. Rab29/Rab32 or 14-3-3) and membrane binding. Consistently, also n with stapled peptides targeting the Roc or Cor domains we were not able to shift the equilibrium completely to the monomer (Helton et al., ACS Chem Biol. 2021, 16:2326-2338; Pathak et al. ACS Chem Neurosci. 2023, 14(11):1971-1980) We will address these points in a revised version of the manuscript.

      Reviewer #2 (Public Review):

      This study addresses the catalytic activity of a Ras-like ROC GTPase domain of LRRK2 kinase, a Ser/Thr kinase linked to Parkinson's disease (PD). The enzyme is associated with gain-of-function variants that hyper-phosphorylate substrate Rab GTPases. However, the link between the regulatory ROC domain and activation of the kinase domain is not well understood. It is within this context that the authors detail the kinetics of the ROC GTPase domain of pathogenic variants of LRRK2, in comparison to the WT enzyme. Their data suggest that LRRK2 kinase activity negatively regulates the ROC GTPase activity and that PD variants of LRRK2 have differential effects on the Km and catalytic efficiency of GTP hydrolysis. Based on mutagenesis, kinetics, and biophysical experiments, the authors suggest a model in which autophosphorylation shifts the equilibrium toward monomeric LRRK2 (locked GTP state of ROC). The authors further conclude that T1343 is a crucial regulatory site, located in the P-loop of the ROC domain, which is necessary for the negative feedback mechanism. Unfortunately, the data do not support this hypothesis, and further experiments are required to confirm this model for the regulation of LRRK2 activity.

      Specific comments are below:

      • Although a couple of papers are cited, the rationale for focusing on the T1343 site is not evident to readers. It should be clarified that this locus, and perhaps other similar loci in the wider ROCO family, are likely important for direct interactions with the GTP molecule.

      To clarify this point: We, have not only have focused on this specific locus, but instead systematically mutated all known auto-phosphorylation sites with the RocCOR domain (see. supplemental information). Furthermore, it has been shown that this site, at least in the RCKW (Roc to WD40) construct, is quantitatively phosphorylated (Deniston et al., Nature 2020, 588:344-349). We are aware that the T1343 residue is located within the p-loop and that this can impact nucleotide binding capacities (see response to reviewer 1). We will clarify and address these points in a revised version of the manuscript.

      • Similar to the above, readers are kept in the dark about auto-phosphorylation and its effects on the monomer/dimer equilibrium. This is a critical aspect of this manuscript and a major conceptual finding that the authors are making from their data. However, the idea that auto-phosphorylation is (likely) to shift the monomer/dimer equilibrium toward monomer, thereby inactivating the enzyme, is not presented until page 6, AFTER describing much of their kinetics data. This is very confusing to readers, as it is difficult to understand the meaning of the data without a conceptual framework. If the model for the LRRK2 function is that dimerization is necessary for the phosphorylation of substrates, then this idea should be presented early in the introduction, and perhaps also in the abstract. If there are caveats, then they should be discussed before data are presented. A clear literature trail and the current accepted (or consensus) mechanism for LRRK2 activity is necessary to better understand the context for these data.

      We agree on the reviewer’s opinion. We will address this point in a revised version of the manuscript.

      • Following on the above concepts, I find it interesting that the authors mention monomeric cytosolic states, and kinase-active oligomers (dimers??), with citations. Again here, it would be useful to be more precise. Are dimers (oligomers?) only formed at the membrane? That would suggest mechanisms involving lipid or membrane-attached protein interactions. Also, what do the authors mean by oligomers? Are there more than dimers found localized to the membrane?

      There are multiple studies that have shown that LRRK2 is mainly monomeric in the cytosol while it forms mainly dimeric or higher oligomeric states at membrane (James et al., Biophys. J. 2012, 102, L41–L43; Berger et al., Biochemistry, 2010, 49, 5511–5523). However, we agree with the reviewer that it remains to be determined if the dimeric form is the most active state at the membrane, or a higher oligomeric state. Especially since a recent study shows that LRRK2 can form active tetramers only when bound to Rab29 (Zhu et al., bioRxiv, 2022, DOI: 10.1101/2022.04.26.489605). We will clarify and address these points in the introduction of a revised version of the manuscript.

      • Fig 5 is a key part of their findings, regarding the auto-phosphorylation induced monomer formation of LRRK2. From these two bar graphs, the authors state unequivocally that the 'monomer/dimer equilibrium is abolished', and therefore, that the underlying mechanism might be increased monomerization (through maintenance of a GTP-locked state). My view is that the authors should temper these conclusions with caveats. One is that there are still plenty of dimers in the auto-phosphorylated WT, and also in the T1343A mutant. Why is that the case? Can the authors explain why only perhaps a 10% shift is sufficient? Secondly, the T1343A mutant appears to have fewer overall dimers to begin with, so it appears to readers that 'abolition' is mainly due to different levels prior to ATP treatment at 30 deg. I feel these various issues need to be clarified in a revised manuscript, with additional supporting data. Finally, on a minor note, I presume that there are no statistically significant differences between the two sets of bar graphs on the right panel. It would be wise to place 'n.s.' above the graphs for readers, and in the figure legend, so readers are not confused.

      Starting with the monomer-dimer equilibrium we are convinced that there is more than the phosphorylation of T1343 (see response to reviewer 1). Therefore a 10% shift in our assay most likely underestimate the effect seen in cells.

      Consistently, the T1343A mutants show a similar increase in Rab10 phosphorylation assay as the G2019S mutant. This thus shows that the identified feedback mechanism plays an important role in a cellular context. We will explain this in more detail in a revised version of the manuscript. Concerning the bar diagram, we will add the “n.s.” indication in a future version of the manuscript.

      • Figure 6B, Westerns of phosphorylation, the lanes are not identified and it is unclear what these data mean.

      We apologize for this mistake and will add the correct labeling in a revised version of the manuscript.

    1. Author Response:

      Reviewer #1 (Public Review):

      [...] Major concerns/weakness:

      1) All the results in Fig. 2 utilized two glioma lines SF188 and Res259. The authors should repeat all these experiments in a couple of H3.3K27M DMG lines by deleting the H3.3K27M mutation first.

      We thank the referee for his/her comments that will help us to strengthen our conclusions.

      The reviewer's proposal is interesting, but this approach to deletion of the K27M mutation rather answers the question of the role of the BMP pathway in maintaining the phenotype of DMG cells. Our aim in the first part of this article (with Res and SF188) is rather to study how the BMP pathway can participate in installing a particular cellular state at the time of expression of the K27M mutation. In other words, the underlying idea is to define the phenotypic changes specifically associated with activation of the BMP pathway when epigenetic modifications are induced by expression of the K27M mutation. We have chosen the SF188 and Res259 models to remain in a glial context, but it would indeed be interesting to test the effect of this synergy in other models, closer to the cells of origin of DMG. In any case, these models should make it possible to answer the question of the cellular state transition at the moment of K27M expression, even if the reciprocal question of the reversibility of this state proposed by the reviewer is also of interest for understanding the oncogenic synergy between BMP/K27M.

      2) Fig. 3. The experiments of BMP2 treatment should be repeated in other H3.3K27M DMG lines using H3.1K27M ACVR1 mutant tumor lines as controls.

      We will provide the results of these experiments in a revised version. The use of mutant ACVR1 lines is interesting, but their control status seems questionable, as the addition of BMPs could have a cumulative effect on the effect of the mutation, notably by activating other receptors in the pathway.

      Minor concerns:

      Fig.2A. BMP2 expression increased in H3.3K27M SF188 cells. Therefore, the statement "whereas BMP2 and BMP4 expressions are not significantly modified (Figure 2A and Figure 2-figure supplement A-B)" is not accurate.

      The referee is absolutely right and we will correct this statement in the revised version.

      Reviewer #2 (Public Review):

      [...] The paper is well-written and easy to follow with a robust experimental plan and datasets supporting the claims. While previous work (acknowledged by the authors) indicated activation of BMP in H3K27M tumors, wild type for the ACVR1 mutation this paper is a nice addition and provides further mechanistic cues as to the importance of the BMP pathway and specific members in these deadly brain cancers. The effect of these BMPs in quiescence and invasion is of particular interest.

      We thank the referee for his/her supportive comments.

      A few suggestions to clarify the message are provided below:

      1- In thalamic diffuse midline gliomas, the BMP pathway should not be activated as it is in the pons. The authors should identify thalamic tumors in the datasets they explored and patients-derived cell lines from thalamic tumors available to investigate whether this pathway is active across all H3.3K27M mutants in the brain midline or specifically in tumors from the pons.

      The referee's question is an interesting one, and we will try to see if we can determine tumor’s location from the public data we've used. We will nevertheless try to determine whether the inter-patient variability observed in the level of activation of the BMP pathway may be due, in particular, to different tumor locations.

      2 - There are ~20% H3.3K27M tumors that carry an ACVR1 mutation and similar numbers of H3.1K27M that are wild type for this gene. Can the authors identify these outliers in their datasets and assess the activation of BMP2 and 7 or other BMP pathway members in this context?

      Indeed, defining the level of activation of the pathway in this type of H3.3K27M ACVR1 mutant or H3.1K27M ACVR1 wt tumors would be extremely interesting, but no samples of this type are a priori included in the datasets analyzed. Instead, we will try to define the phenotype of cell lines of this type in response to BMP.

    1. Author Response

      The following is the authors’ response to the original reviews.

      Reviewer #1 (Public Review):

      1. The manuscript study would be improved by further discussion of the mechanistic relationship between this class of sex-biased DHS and the other 2/3 of liver DHS that also show male-biased accessibility but whose chromatin does not respond directly to GH-stimulated STAT5.

      Response: We added a new paragraph to the Discussion (lines 608-618) discussing our novel finding that sex-biased H3K36me3 marks uniquely distinguish Static sex-biased DHS from Dynamic sex-biased DHS (see Fig. 6C) in light of a recent study in a different biological system showing that H3K36me3 marks comprise an important mechanism for maintaining cell type-specific identity by inhibiting the spread of H3K27me3 repressive marks at cell type-specific enhancers [Nat Cell Biol, 25 (2023) 1121-1134]. Further, we now discuss the potential mechanistic significance of this mark in insuring the sex-biased chromatin accessibility at Static sex-biased DHS:

      “Finally, we discovered that sex-biased H3K36me3 marks are a unique distinguishing feature of static sex-biased DHS, with male-biased H3K36me3 marks being highly enriched at static male-biased DHS but not at dynamic male-biased DHS, and female-biased H3K36me3 marks highly enriched at static female-biased DHS (Fig. 6C). H3K36me3 marks are classically associated with the demarcation of actively transcribed genes [50] but are also used to maintain cell type identity by inhibiting the spread of H3K27me3 repressive marks at cell type-specific enhancers [35, 51]. The enrichment of H3K36me3 marks at static male-biased DHS described here could thus be an important mechanism to maintain sex-dependent hepatocyte identity by keeping static male-biased enhancers constitutively open and free of H3K27me3 repressive marks in male liver, and similarly for H3K36me3 marks enriched at static female-biased DHS in female liver. Further study is needed to elucidate the underlying mechanisms whereby these and the other sex-specific histone marks discussed above are deposited on chromatin in a sex-dependent and site-specific manner and the roles that GH plays in regulating these epigenetic events”.

      1. Previous studies, including those in the Waxman lab (PMIDs: 26959237, 18974276, 35396276) suggest castration of males or gonadectomy of both sexes eliminates most sex differences in mRNA expression in mouse liver, and/or that androgens such as DHT or testosterone administered in adulthood potentially reverses the effects of gonadectomy and/or masculinizes liver gene expression. It is not clear from the present discussion whether the GH/STAT5 cyclic effects to masculinize chromatin status require the presence of androgens in adulthood to masculinize pituitary GH secretion. Are there analyses of the present (or past) data that might provide evidence about a dual role for GH and androgen acting on the same genes? For example, are sex-biased DHS bound by androgen-dependent factors or show other signs of androgen sensitivity? Are histone marks associated with DHS regulated by androgens? Moreover, it would help if the authors indicate whether they believe that the "constitutive" static sex differences in the larger 2/3 set of male-biased DHS are the result of "constitutive" (but variable) action of testicular androgens in adulthood. Although the present study is nicely focused on the GH pulse-sensitive DHS, is there mechanistic overlap in sex-biasing mechanisms with the larger static class of sex-biased liver DHS?

      Response: The Reviewer poses an intriguing set of question regarding the potential role of androgens in directly regulating, perhaps by working together with GH or GH-activated STAT5 at the level of chromatin, to co-regulate the set of Static male-biased DHS. We have now addressed these questions in full in a new Discussion paragraph, entitled, “Pituitary GH secretory patterns vs. gonadal steroids as regulators of sex-biased liver chromatin accessibility and gene expression” (lines 640-661), as follows:

      “While testosterone has a well-established role in programming hypothalamic control of pituitary GH secretory patterns [9-11], it is also possible that androgens and estrogens could regulate sex differences in hepatocytes directly at the epigenetic or transcriptional level. However, our findings support the proposal that plasma GH patterns, and not gonadal steroids, dominate epigenetic control of liver sex differences. First, the ability of a single exogenous plasma GH pulse to rapidly reopen dynamic male-biased DHS closed by hypophysectomy – in the face of ongoing ablation of pituitary stimulated gonadal steroid production and secretion – implicates GH signaling per se in the direct regulation of chromatin accessibility for this class of male-biased DHS. Second, GH regulates the sex bias of static male-biased DHS as well, as evidenced by their widespread closure in male liver following continuous GH infusion (Table S2E). It is important to note, however, that hepatocyte-specific knockout of androgen receptor (AR) does, in fact, dysregulate ~15% of sex-biased genes, albeit with a much lower effect size than global AR knockout [52] due to the systemic disruption of the somatotropic axis and circulating GH secretory profiles [53, 54]. Conceivably, AR could regulate these genes by a direct binding mechanism, acting either alone or in concert with GH-activated STAT5 to keep chromatin open constitutively at a subset of static male-biased DHS, of which 32% undergo at least partial closure in male liver following hypophysectomy (Fig. 4C). Estrogen receptor (ERa) likely plays only a minor role in regulating sex-biased liver DHS enhancers, given the lack of effect of hepatocyte-specific ERa knockout on sex-biased liver gene expression [22] and our finding that only 12% of static female-biased DHS close in female liver following hypophysectomy, which decreases circulating estradiol levels [55].”.

      Reviewer #2 (Public Review):

      The Reviewer did not raise any points of criticism.

      Reviewer #2 Recommendations:

      Line 121. "highly enriched for genes of the corresponding sex bias" is unclear. Does this mean that the genes near the DHS have the same bias in level of transcription as the bias in open chromatin? Please clarify.

      Response: Text was changed to: “were highly enriched for mapping to genes showing the corresponding sex bias in the level transcription, but not for genes whose expression shows the opposite sex bias”.

      Line 161. "STAT5 activity-dependent patterns" seems not to be supported by the data. The patterns correlate with STAT5 activity, but the authors can't conclude that they depend on STAT5 activity based on these data alone.

      Response: Text was changed to: “patterns of DNase-released fragments that correlate with STAT5 activity”

      Line 171. "identify genomic regions where chromatin dynamically opens or closes in male mouse liver in response to GH pulse activation of STAT5" This statement assumes a causal relationship between STAT5 and the status of differential sites. The data do not support this assumption of causality, because the data correlate STAT5 with status of the differential sites.

      Response: Text was changed to: “identify genomic regions where chromatin dynamically opens or closes in male mouse liver in close association with GH pulse activation of STAT5”.

      Line 176. The "binary pattern" in figure 2D seems not to be as binary as the authors suggest. The blue and red samples overlap in their distribution, and the lower green samples are intermediate between most of the blue and red samples. The "arbitrary" dotted line suggests the binary status, but this line is less convincing because it is arbitrary and drawn by eye; some samples don't obey the binary dichotomy.

      Response: Text was changed to: “This pattern, where individual male mouse livers largely show either high or low DNase-seq read count distributions at the top differential genomic sites, was also seen…”.

      Line 224 "independent" also implies causality.

      Response: No changes were made.

      Line 284. The effects of hypophysectomy on liver chromatin accessibility is attributed here to the loss of GH secretions. Hypophysectomy will also reduce testicular androgen secretion. To what extent can the results of Hypox be attributed to STAT5-dependent mechanisms as opposed to the loss of androgens?

      Response: This question is now discussed in full in the new Discussion section, entitled, “Pituitary GH secretory patterns vs. gonadal steroids as regulators of sex-biased liver chromatin accessibility and gene expression” (lines 640-661), as noted above.

      Line 505. "euthanized between plasma GH pulses". The authors are making an inference here because I do not think they measured GH levels. It would be more accurate to say that the time of euthanasia is inferred to be between GH pulses based on the measurement of STAT5 which is GH-dependent.

      Response: Text was changed to: “a time inferred to be between plasma GH pulses”.

      Reviewer #3 Recommendations:

      In Figure 1A the differences between female-biased enhancers and sex-independent enhancers seem greater than those comparing female-biased insulators and sex-independent insulators, and yet only the latter are significant. Please could you clarify?

      Response: Figure legend was corrected to indicate that Enhancers + Weak Enhancers were analyzed as a single group. Furthermore, the location of the Enhancer asterisks above the bars on the figure was adjusted to reflect this.

      Line 257, I could not find Table S1B.

      Response: Text in Figure legend was corrected to specify Table S7A as the source of this data.

      Line 265 "BCL6 binding was also enriched at dynamic sex-independent DHS (Table S7B)." The p-value of this enrichment was particularly high. Could this have a biological correlation?

      Response: We cannot rule out that possibility.

      Line 277 "identified a Fox family factor as a close match for one of the top enriched motifs in the set of 278 static but not in the set of dynamic male-biased DHS", Maybe authors could add that this holds true for FOXI1 and not for FOXD1.

      Response: Text was changed to specify FOXI1 as the factor.

      Line 368, please clarify the affirmation because in Table 1A we do not see the data of dynamic and static male-biased DHS, but only male-biased, female-biased, and sex-independent DHS subsets.

      Response: Text was corrected to read: “Our initial analyses revealed no major differences between dynamic and static male-biased DHS regarding the distribution of enhancer vs insulator vs promoter classifications (Fig. S7A) or their overall chromatin state distributions (Fig. S7B)”.

      Figure 7A and 7B. It would visually help the reader if in E1, E2, etc. you could include the short definitions (as in Figure 1B: Inactive, Inactive, Low signal, etc.)

      Response: We thank the reviewer for this suggestion, and have now added the X-axis labels suggested by the Reviewer.

      Line 570 The sentence was difficult to read "similar to E6, but unlike E6," Maybe removing the comma after "unlike E6" would help.

      Response: Text has been edited to avoid this cumbersome construct. It now reads: “…characterized by a high frequency of same activating chromatin marks as chromatin state E6, i.e., H3K27ac and H3K4me1 (E9) or H3K27ac alone (E10), but unlike E6 they are both deficient in…”.

      Other changes include revisions to the Abstract to take into account the new discussion concerning the impact of sex-biased H3K36me3 marks along with related and other revisions to the Discussion, and a revision to the manuscript Title to better capture its main message.

    1. Author Response

      The following is the authors’ response to the original reviews.

      We thank the reviewers for their time and effort to review our manuscript. We have provided a response to their thoughtful questions below. In our revised manuscript, we have expanded the Discussion to comment on the significance of reversible modification of APC with polyubiquitin, and how the APC transport defect might be rescued (lines 335 to 346). A new Supplementary Figure 3 has been added to show a replicate DUB assay and the uncropped gel of Figure 1C in the main text.

      Reviewer #1 (Recommendations For The Authors):

      To address the weaknesses outlined below, I have the following comments and suggestions for experiments:

      1) Functional link between mouse phenotypes and proposed mechanism: could the authors rescue neuron/glia cell density or motor defects by restoring axonal trafficking of APC?

      We have shown that inhibition of glycogen synthase kinase 3 (GSK3) abolished APC ubiquitylation (PMID 22761442). Etienne-Manneville and Hall have reported that GSK3 inactivation promotes APC association with microtubule plus ends to drive polarised astrocyte migration (PMID 12610628). It is therefore conceivable that treating Trabid mutant neurons with a GSK3 inhibitor could suppress APC ubiquitylation, restore APC transport, and rescue the defective axon growth. GSK3 has multiple targets so there are caveats to using potent inhibitors of this kinase. But such an experiment is integral to a future study aimed at rescuing Trabid mutant mouse phenotypes by GSK3 inhibition.

      Does perturbation of APC trafficking phenocopy the defects of TRABID p.R438W and p.A451V knock in mice during neurodevelopment? I appreciate that these experiments might not be easily feasible.

      Presently we do not know how to directly perturb APC transport (besides generating a Trabid mutation). Speculatively, APC phosphosite mutants which mimic constitutive phosphorylation by GSK3 might accumulate polyubiquitin, aggregate, and exhibit disrupted axonal transport. We predict that such APC mutants will cause neurodevelopmental abnormalities in mouse models.

      Thus, alternatively, could the authors provide evidence from unbiased proteomic approaches that APC is a major substrate of TRABID- and STRIPAK-dependent deubiquitylation during neurodevelopment? E.g., what are the changes in the ubiquitylome of neural progenitor cells isolated from mouse embryos with TRABID mutant alleles and is APC amongst the top dysregulated hits? What are the changes in the interactome of TRABID p.A451V and is the STRIPAK complex a major interactor that is lost?

      We are generating antibodies capable of immunoprecipitating endogenous Trabid from mouse cells. This antibody tool will allow us to characterise the Trabid-STRIPAK complex using advanced ubiquitin proteomic approaches to determine interactors and changes to the ubiquitylome of Trabid mutant cells.

      2) Related to the point 1, given that TRABID has been reported to be a regulator of immune signaling pathways (PMID: 26808229, 37237031), can the authors exclude a contribution of this function to the observed phenotypes during neurodevelopment?

      We have not observed any cellular or tissue phenotypes in young or aged Trabid mutant mice indicative of immune system dysregulation. We and others have shown that Trabid deficiency has no impact on the transcription of interferon and NF-B-stimulated genes or cytokine production in mouse and human cells (PMID 18281465; 17991829; unpublished). Nevertheless, a formal investigation is required to determine any changes to immune signalling pathways in our Trabid mutant mice.

      3) Based on previously published interactions, the authors propose that TRABID uses the STRIPAK complex to recruit its substrate APC. Could the authors provide experimental evidence for this by using their cellular model in Figure 4? Would depleting components of the STRIPAK complex in HEK 293T cells stably transfected with DOX-inducible WT-TRABID stabilize APC ubiquitylation upon dox induction?

      We have demonstrated that RNAi-mediated depletion of all 3 striatin proteins in HEK293T cells increased the levels of ubiquitin-modified APC (PMID 23277359). Moreover, depleting Trabid and the 3 Striatins together strongly increased the ubiquitin-modified APC pool, consistent with our model that Trabid and STRIPAK function together to deubiquitylate APC. In our inducible system, we would likely need to eliminate the expression of the STRIPAK component that directly recruits Trabid to achieve a null effect of Trabid overexpression on APC deubiquitylation. Experiments are in progress to determine which STRIPAK component binds directly to Trabid.

      4) Related to point 3, given that A451, the residue that mediates STRIPAK binding is in close proximity to the catalytic cysteine residue, how do the authors envision STRIPAK binding and OTU-dependent cleavage activity to work together at a structural level?

      A451 resides at the back of the active site in a pocket hypothesised to accommodate a short peptide from an interacting protein. The A451V mutant AnkOTU domain purified from bacteria retained full DUB activity, suggesting that Trabid’s ability to cleave polyubiquitin is independent of its ability to bind STRIPAK. Striatin proteins contain WD40 repeats which is a protein fold that binds ubiquitin (PMID 21070969). While the DUB- and STRIPAK-binding activities of Trabid might not be coupled structurally, it is plausible that Striatin could modulate Trabid’s ubiquitin linkage specificity in cells through allosteric interactions with the ubiquitin chain on the substrate.

      5) Is it known why APC needs to be reversibly modified with ubiquitin to be transported in axons and how increased APC ubiquitylation leads to impaired transport or could the authors speculate on this?

      We have shown that APC ubiquitin modification correlated with its binding to Axin in the -catenin destruction complex (PMID 22761442). Conversely, non-ubiquitin-modified APC accumulates in membrane protrusions (PMID 23277359). From this we have proposed that ubiquitin regulates the distribution of APC between its two major functional pools in cells. Chronic APC ubiquitylation in Trabid deficient/mutant neurons might result in increased APC sequestration into Axin destruction complexes and/or promote spurious interactions with ubiquitin binding proteins that cause APC to aggregate, and therefore retard its transport in axons.

      Additional minor comments to consider:

      • Figure 1C: What are the protein smears in the in vitro assays of A541V 15min and CS 120min? I would assume that contaminants from the protein preparations should be the same across different conditions and in particular across different time points of the same Trabid mutant.

      In replicate DUB assays using the same AnkOTU protein preparations we did not detect any smears (Supplementary Figure 3A). It is unclear what caused the smears in Figure 1C, but it is plausible that contaminants in specific tubes/assays are contributing factors.

      • Figure 1D: why is the amount of AnkOTU protein reduced for WT, R438W, and A541 in a time-dependent manner?

      With increasing incubation time in DUB assays, adducts of various molecular weights may form between ubiquitin and the AnkOTU domain. It is plausible that some of these adducts are non-gel-resolved high molecular weight aggregates that sequester some of the AnkOTU proteins. These aggregates, which could have been retained in the loading wells, were presumably washed away during our silver staining procedure hence we do not see them in the full-length gel (Supplementary Figure 3B).

      Reviewer #2 (Recommendations For The Authors):

      • The partial penetrance of the mouse knockin phenotype is confusing, especially as this is evident on an apparently inbred background. Can authors explain the factors that contribute to these differences?

      Low mutant Trabid protein expression in distinct neural crest or progenitor populations could contribute to the reduced penetrance of the cell number phenotype. APC dysfunction in Trabid mutant cells might also impact its role as a negative regulator of the Wnt signalling pathway which regulates neuronal and glial cell fates in the developing brain (PMID 9845073). It is conceivable that in some Trabid mutant mice where APC dysfunction is mild (due to low levels of mutant Trabid protein expression), compensatory mechanisms overcome APC’s reduced function in Wnt signalling and cytoskeleton organization to permit normal brain development. A future study to investigate perturbations of Wnt signalling pathways in Trabid mutant mice is warranted.

      • The use of the term 'hemizygous' is confusing, as it typically refers to when one copy of a gene is present as in X-linked conditions. Might the authors mean 'heterozygous'?

      All instances of ‘hemizygous’ in the manuscript have been amended to ‘heterozygous’.

      • Fig. 3A y-axis units is confusing. Do the authors mean number of TH+ SNc neurons evident per section?

      We have amended the y-axis in Fig. 3A to indicate number of TH+ neurons evident per section.

      • Since the TH phenotype is one of the phenotypes that is partially penetrant, did authors include both penetrant and non-penetrant mice in Fig. 3 and other figures? Shouldn't there be error bars in Fig. 3A, since multiple mice were presumably used for analysis for each condition?

      Each data point in Fig. 3A represents one mouse in a set of littermate mice with the indicated age, sex, and genotype. Generating midbrain SNc sections at similar bregma positions across wild-type and mutant littermate brains for accurate IHC comparison proved challenging. Unanticipated technical issues limited the quantification of equivalent midbrain sections to 3 sets of littermate mice from each respective R438W or A451V mutant colony. The cell number reduction is more obvious in some mutants than others, but the effect is observed across all ages and gender, providing confidence that the phenotype is robust. In Fig. 2 we have included only mutant mice with clearly fewer brain cells than wild-type littermates. We have not performed comprehensive IHC analysis of brains from all the mice used for the rotarod assay in Fig. 3E, but predict that mutant mice have a spectrum of neural/glial cell deficits in one or more brain areas that adversely impacted the motor circuitry causing their impaired motor function.

    1. Author Response

      We thank the Editors and the Reviewers for their comments on the importance of our work “showing a new role of caveolin-1 as an individual protein instead of the main molecular component of caveolae” in building membrane rigidity and also for constructive and thoughtful remarks that shall allow to improve the manuscript.

      Indeed, we here establish the contributing role of caveolin-1 to membrane mechanics by a molecular mechanism that needs to be further addressed. To that respect, we thank the reviewers for suggesting avenues to improve the presentation and discussion of our hypotheses based on results of theoretical model and independent biophysical measurements in tube pulling from plasma membrane spheres, which concur to support the key role of caveolin-1 in building membrane rigidity.

      To fulfill the recommendations of the reviewers we will amend the manuscript as discussed below.

      Public Reviews:

      Reviewer #1 (Public Review):

      Summary:

      Because of the role of membrane tension in the process, and that caveloae regulate membrane tension, the authors looked at the formation of TEMs in cells depleted of Caveolin1 and Cavin1 (PTRF): They found a higher propensity to form TEMs, spontaneously (a rare event) and after toxin treatment, in both Caveolin 1 and Cavin 1. They show that in both siRNA-Caveolin1 and siRNA-Cavin1 cells, the cytoplasm is thinner. They show that in siCaveolin1 only, the dynamics of opening are different, with notably much larger TEMs. From the dynamic model of opening, they predict that this should be due to a lower bending rigidity of the membrane. They measure the bending rigidity from Cell-generated Giant liposomes and find that the bending rigidity is reduced by approx. 50%.

      Strengths:

      They also nicely show that caveolin1 KO mice are more susceptible to death from infections with pathogens that create TEMs.

      Overall, the paper is well-conducted and nicely written. There are however a few details that should be addressed.

      Reviewer #2 (Public Review):

      Summary:

      The manuscript by Morel et al. aims to identify some potential mechano-regulators of transendothelial cell macro-aperture (TEM). Guided by the recognized role of caveolar invaginations in buffering the membrane tension of cells, the authors focused on caveolin-1 and associated regulator PTRF. They report a comprehensive in vitro work based on siRNA knockdown and optical imaging approach complemented with an in vivo work on mice, a biophysical assay allowing measurement of the mechanical properties of membranes, and a theoretical analysis inspired by soft matter physics.

      Strengths:

      The authors should be complimented for this multi-faceted and rigorous work. The accumulation of pieces of evidence collected from each type of approach makes the conclusion drawn by the authors very convincing, regarding the new role of cavolin-1 as an individual protein instead of the main molecular component of caveolae. On a personal note, I was very impressed by the quality of STORM images (Fig. 2) which are very illuminating and useful, in particular for validating some hypotheses of the theoretical analysis.

      Weaknesses:

      While this work pins down the key role of caveolin-1, its mechanism remains to be further investigated. The hypotheses proposed by the authors in the discussions about the link between caveolin and lipids/cholesterol are very plausible though challenging. Even though we may feel slightly frustrated by the absence of data in this direction, the quality and merit of this paper remain.

      In the current study, we did not find the technical conditions allowing us to properly address the role of cholesterol in the dynamics of TEM due to adverse effects of cholesterol depletion with methyl-beta-cyclodextrin on the morphology of HUVEC. To answer the Reviewer remark, we will mention our attempts to address a role of cholesterol in the dynamics of TEM in the results section. Moreover, we will thoroughly discuss in the section related to data of tube pulling experiments from PMS that caveolin-1 by controlling membrane lipid composition, may indirectly affect membrane rigidity (see comments below about the presence or absence of caveolin-1 in the tubes pulled from PMS and our hypotheses about a direct or indirect role of caveolin-1 in the control of membrane rigidity).

      The analogy with dewetting processes drawn to derive the theoretical model is very attractive. However, although part of the model has already been published several times by the same group of authors, the definition of the effective membrane rigidity of a plasma membrane including the underlying actin cortex, was very vague and confusing.

      In the revised manuscript, we will clearly define the membrane bending rigidity parameter, which was missing in the current version. The membrane bending rigidity is defined as the energy required to locally bend the membrane surface. In a liposome, a rigorous derivation leads to a relationship between the membrane tension relation and the variation of the projected area, which are related by the bending rigidity: this relationship is known as the Helfrich law. This statistical physics approach is only rigorously valid for a liposome, whereas its application to a cell is questionable due to the presence of cytoskeletal forces acting on the membrane. Nevertheless, application of the Helfrich law to cell membranes may be granted on short time scales, before active cell tension regulation takes place (Sens P and Plastino J, 2015 J Phys Condens Matter), especially in cases where cytoskeletal forces play a modest role, such as red blood cells (Helfrich W 1973 Z Naturforsch C). The fact that the cytoskeletal structure and actomyosin contraction are significantly disrupted upon cell intoxication-driven inhibition of the small GTPase RhoA supports the applicability of Helfrich law to describe TEM opening. Because of the presence of proteins, carbohydrates, and the adhesion of the remaining actin meshwork after toxin treatment, we expect the Helfrich relationship to somewhat differ from the case of a pure lipidic membrane. We account for these effects via an “effective bending rigidity”, a term used in the detailed discussion of the model hypotheses, which corresponds to an effective value describing the relationship between membrane tension and projected area variation in our cells. These considerations will be included in the revised manuscript.

      Here, for the first time, thanks to the STORM analysis, the authors show that HUVECs intoxicated by ExoC3 exhibit a loose and defective cortex with a significantly increased mesh size. This argues in favor of the validity of Helfrich formalism in this context. Nonetheless, there remains a puzzle. Experimentally, several TEMs are visible within one cell. Theoretically, the authors consider a simultaneous opening of several pores and treat them in an additive manner. However, when one pore opens, the tension relaxes and should prevent the opening of subsequent pores. Yet, experimentally, as seen from the beautiful supplementary videos, several pores open one after the other. This would suggest that the tension is not homogeneous within an intoxicated cell or that equilibration times are long. One possibility is that some undegraded actin pieces of the actin cortex may form a barrier that somehow isolates one TEM from a neighboring one.

      As pointed by the Reviewer, we expect that membrane tension is neither a purely global nor a purely local parameter. Opening of a TEM will relax membrane tension over a certain distance, not over the whole cell. Moreover, once the TEM closes back, membrane tension will increase again. This spatial and temporal localization of membrane tension relaxation explains that the opening of a first TEM does not preclude the opening of a second one. On the other hand, membrane tension is not a purely local property. Indeed, we observe that when two TEMs enlarge next to each other, their shape becomes anisotropic, as their enlargement is mutually hampered in the region separating them. We account for this interaction by treating TEM membrane relaxation in an additive fashion. We emphasize that this simplified description is used to predict maximum TEM size, corresponding to the time at which TEM interaction is strongest. As the reviewer points out, it would be more questionable to use this additive treatment to predict the likelihood of nucleation of a new TEM, which is not done here.

      Could the authors look back at their STORM data and check whether intoxicated cells do not exhibit a bimodal population of mesh sizes and possibly provide a mapping of mesh size at the scale of a cell?

      To address the question raised by the Reviewer we decided to plot the whole distribution of mesh sizes in addition to the average value per cell. We did not observe a bimodal distribution but rather a very heterogeneous distribution of mesh size going up to a few microns square in all conditions of siRNA treatments. Moreover, we did not observe a specific pattern in the distribution of mesh size at the scale of the cell, with very large mesh sizes being surrounded by small ones. We also did not observe any specific pattern for the localization of TEM opening, as described in the paper, making the correlation between mesh size and TEM opening difficult.

      In particular, it is quite striking that while bending rigidity of the lipid membrane is expected to set the maximal size of the aperture, most TEMs are well delimited with actin rings before closing. Is it because the surrounding loose actin is pushed back by the rim of the aperture? Could the authors better explain why they do not consider actin as a player in TEM opening?

      Actin ring assembly and stiffening is indeed a player in TEM opening, and it is included in our differential equation describing TEM opening dynamics (second term on the left-hand side of Eq. 3). In some cases, actin ring assembly is the dominant player, such as in TEM opening after laser ablation (ex novo TEM opening), as we previously reported (Stefani et al. 2017 Nat comm). In contrast, here we investigate de novo TEM opening, for which we expect that bending rigidity can be estimated without accounting for actin assembly, as we previously reported (Gonzalez-Rodriguez et al. 2012 Phys Rev Lett). Such a bending rigidity estimate (Eq. 5) is obtained by considering two different time scales: the time scale of membrane tension relaxation, governed by bending rigidity, and the time scale of cable assembly, governed by actin dynamics. We expect the first-time scale to be shorter, and thus the maximum size of de novo TEMs to be mainly constrained by membrane tension relaxation. The discussion of these two different time scales will be added to the revised manuscript.

      Instead of delegating to the discussion the possible link between caveolin and lipids as a mechanism for the enhanced bending rigidity provided by caveolin-1, it could be of interest for the readership to insert the attempted (and failed) experiments in the result section. For instance, did the authors try treatment with methyl-beta-cyclodextrin that extracts cholesterol (and disrupts caveolar and clathrin pits) but supposedly keeps the majority of the pool of individual caveolins at the membrane?

      We will state in the results section that we could not find appropriate experimental conditions allowing us to deplete cholesterol with methyl-beta cyclodextrin without interfering with the shape of HUVECs, thereby preventing the proper analysis of TEM dynamics.

      Tether pulling experiments on Plasma membrane spheres (PMS) are real tours de force and the results are quite convincing: a clear difference in bending rigidity is observed in controlled and caveolin knock-out PMS. However, one recurrent concern in these tether-pulling experiments is to be sure that the membrane pulled in the tether has the same composition as the one in the PMS body. The presence of the highly curved neck may impede or slow down membrane proteins from reaching the tether by convective or diffusive motion. Could the authors propose an experiment to demonstrate that caveolin-1 proteins are not restricted to the body of the PMS and can access to the nanometric tether?

      As pointed out by the reviewer, a concern with tube pulling experiments is related to the dynamics of equilibration of membrane composition between the nanotube and the rest of the membrane. In our experiments, we have waited about 30 seconds after tube pulling and after changing membrane tension. We have checked that after this time, the force remained constant, implying that we have performed experiments of tube pulling from PMS in technical conditions of equilibrium that ensure that lipids and membrane proteins had enough time to reach the tether by convective or diffusive motion. We will add a representative example of force vs time plot in our revision. In principle, this could be further checked using cells expressing GFP-caveolin-1 to generate PMS as done in Sinha et al., 2011: a steady protein signal in the tube will further confirm the equilibration, provided that caveolin is recruited in the nanotube due to mechanical reasons. Indeed, since caveolin-1 is inserted in the cytosolic leaflet of the plasma membrane, when a nanotube is pulled towards the exterior of the cell as in our experiments, we can expect 2 situations depending on the ability of caveolin-1 to deform membranes, which is not clear, in particular after the paper of Porta et al, Sci. Adv., 2022. i) If caveolin-1 (Cav1) does not bend membranes, it could be recruited in the nanotubes, at a density similar to the PMS body. The tube force measurement in this case would reflect the bending rigidity of the PMS membrane. Then, Cav1 could stiffen membrane either as a stiff inclusion at high density or/and by affecting lipid composition, as suggested in our text. ii) If Cav1 bends the membrane (i.e. it has a non-zero spontaneous curvature), it should create a positive curvature considering the geometry of the caveolae, opposite to the curvature of the nanotubes that we pull, and thus be excluded of the nanotubes. In this case, the force would reflect the bending rigidity of the membrane depleted of Cav1 and should be the same in both types of experiments (WT and Cav1 depleted conditions) if the lipid composition remains unchanged upon Cav1 depletion. Our measurements suggest again that Cav1 depletion affects the plasma membrane composition, probably by reducing the quantity of sphingomyelin and cholesterol. Note that the presence of a very reduced concentration of Cav1 as compared to the plasma membrane has been reported in tunneling nanotubes (TNT) connecting two neighboring cells (A. Li et al., Front. Cell Dev. Biol., 2022). These TNTs have typical diameters of similar scale than diameters of tubes pulled from PMS. Some of us have addressed these specific questions related to Cav-1 spontaneous curvature and its effect on the lipid composition of the plasma membrane in two separate manuscripts (in preparation). They represent comprehensive studies by themselves that clarify these points. We propose to add this discussion in the manuscript, with perspectives on future studies, but stressing the point that the presence of Cav1 stiffens plasma membranes, and that the exact origin of this effect must be further investigated.

    1. Author Response

      Public Reviews:

      Reviewer #1 (Public Review):

      Summary:

      The authors characterize S. enterica WbaP biochemically and structurally. The enzyme catalyzes the initial step in O antigen biosynthesis by transferring a phospho-galactosyl unit from UDP-galactose to undecaprenyl-phosphate. This initial primer is then extended by other glycosyltransferases to form the O antigen repeat unit.

      To preserve the biologically functional unit of WbaP, the authors chose a 'detergent-free' purification method based on membrane extraction using SMALP polymers. The obtained material was characterized biochemically and by single-particle cryo-electron microscopy.

      Strengths:

      The authors were able to isolate WbaP in a catalytically active and oligomeric form and determined a low-resolution cryo-EM structure of the dimeric complex. Using a disulfide cross-linking approach and other biophysical methods, the authors validated an AlphaFold predicted WbaP model used to interpret the experimental cryo-EM map.

      Weaknesses:

      The rationale for using SMALP to extract WbaP from the membrane was to 'preserve' the native lipid bilayer surrounding the protein. However, the physical properties of the lipids co-purifying with the protein are unclear. The volume of the EM map assigned to the SMALP polymers suggests a more micellar character.

      Overall, the obtained cryo-EM map appears to be at fairly low resolution. Based on Figure 6, individual helices are not resolved, suggesting an overall resolution significantly below the stated 4.1 Å. Thus, the presented structure is the one of an AlphaFold WbaP model.

      I believe the UMP titration analysis could be improved. The authors assume that a 'domain of unknown function (DUF)' binds UMP and regulates the enzyme's activity. UMP, a reaction product of WbaP, may also inhibit the enzyme competitively. Therefore, deleting the DUF for the UMP inhibition studies could help with data interpretation.

      We appreciate the reviewer’s careful analysis of our manuscript, and their attention to detail regarding the structural data. In a revised version of this manuscript, we will modify the discussion section to include a brief section focused on the liponanoparticle itself, comparing to other experimental structures in SMALP. Investigating the lipid microenvironment in SMALPs around both Lg- and Sm-PGTs is of great interest to our group. We have published initial data related to PglC from Campylobacter, but a systematic analysis of co-purified lipids from the growing number of SMALP-solubilized PGTs is an exciting future direction for this project. Expression and analysis of truncated constructs containing the catalytic domain of Lg-PGTs (including WbaP) has been attempted in our laboratory, with no success. This limits our ability to decouple DUF-mediated modulation of activity from interactions in the catalytic domain. Efforts to address this challenge are underway but will be the focus of future publications. Regarding the overall resolution – for transparency - we will add a new figure that shows the local resolution throughout the experimental map.

      Reviewer #2 (Public Review):

      Summary:

      The authors focused on delivering a comprehensive structural characterization of WbaP, a membrane-bound phosphoglycosyl transferase from Salmonella that is instrumental in bacterial glycoconjugate synthesis. Notably, the authors employed SMALP-200, an amphipathic copolymer, to extract WbaP in the form of native lipid bilayer nanodiscs. They then determined its oligomerization state through cross-linking and procured higher-resolution structural data via cryo-electron microscopy (cryo-EM). While the authors successfully characterized WbaP in a native-like lipid bilayer setting, and their findings support this, the paper's claim of introducing a novel methodology is not robust. The real contribution of this work lies in the newfound insights about WbaP's structure.

      Strengths:

      The manuscript provides novel insights into WbaP's structure and oligomerization state, highlighting potentially significant interactions. The methodologies employed represent state-of-the-art practices in the field. Most of the drawn conclusions are well-supported by either experimental or computational data, with a few exceptions noted below.

      Weaknesses:

      • Organization: The manuscript's organization lacks clarity. The authors seem to describe their processes in the sequence they occurred rather than a logical flow, leading to potential confusion. For instance, the authors delve into a series of inconclusive experiments to determine the oligomerization state of WbaP, utilizing techniques like SEC, SEC-MALS, mass photometry, and mass spectrometry. They then transition to cryo-EM but subsequently return to address the oligomerization issue, which they conclusively resolve using cross-linking experiments. Following this, they shift their focus to interpreting and discussing the structural features obtained from the cryo-EM data.

      • Ambiguous and incorrect statements: There are instances of vague and at times inaccurate statements. Using more precise terminology like "native nanodiscs" or "lipid bilayer nanodiscs" would enhance clarity compared to the term "liponanoparticles." The claim on page 8 concerning the refractive index increment of SMA polymers needs rectification. The real reason why SEC-MALS cannot provide absolute particle masses in this case is that using two independent concentration detectors (typically, absorbance and refractive index), the decomposition of elution profiles is necessarily limited to two chemical species of a known molar or specific absorbance and refractive index. Thus, it is clear that nanodiscs containing a protein, a polymer, and a chemically undefined mixture of native lipids cannot be analyzed by this technique.

      • Overstating of technical aspects: The technical aspects seem overstated. While the extraction of membrane proteins into native lipid bilayer nanodiscs and their characterization by cross-linking and cryo-EM are standard (and were published before by the same authors in ref. 29), the authors appear to promote them as groundbreaking. The statement that this study presents a novel, universal strategy and toolkit for examining small membrane proteins within liponanoparticles seems overstated, especially given the previous existence of similar methods.

      We appreciate the reviewer’s careful consideration of the steps that were taken and how they were presented. However, we need to reinforce that although the initial biophysical experiments do not provide the exact oligomeric state of the WbaP, they provide important new data. Together these data support that the intact liponanoparticle is large enough to accommodate a higher order oligomerization state along with native lipids and stabilizing SMA polymer – this was not known at the outset and led to Fig 2D showing the first demonstration of dimer that was then validated via XLMS and disulfide crosslinking. The process was logical and essential to this work. We recognize the reviewer’s point on the SEC-MALs experiment and will adjust the text accordingly.

      We sought to distinguish the stabilization method used here from canonical MSP nanodiscs by using the term styrene maleic acid liponanoparticle (SMALP). The term SMALP is widely used in literature utilizing this technology, thus the use of other terms may lead to confusion.

      Our manuscript in PExpPur was focused on enabling expression of sufficient quality and quantity for sophisticated downstream biophysical applications – that MS was intended to be enabling to the greater membrane protein community and is highly recognized and appreciated in “its own right.” This work presents the first in class structure of the large monoPGTs. Further only a single structure of the PGT domain itself has been solved and appears as an experimental structure in the PDB (also from our group) addressing the enigmatic additional domains and potential physiological relevance. It is also noteworthy that the Lg-monoPGTs dominate the superfamily. This is also the first time that any protein in SMALP has been characterized using direct mass technology, which provided the most accurate mass determination of the intact liponanoparticle/protein complex.

    1. Author Response

      Reviewer #1 (Public Review):

      The authors present a detailed analysis of a set of molecular dynamics computer simulations of several variants of a T-cell receptor (TCR) in isolation and bound to a Major Histocompatibility Complex with peptide (pMHC), with the aim of improving our understanding of the mechanism T cell activation in immunity. By analyzing simulations of peptide mutants and partially truncated TCRs, the authors find that native peptide agonists lead to a so-called catch-bond response, whereby tensile force applied in the direction of separation between TCR/pMHC appears to strengthen the TCR/pMHC interface, whereas mutated peptides exhibit the more common slip-bond response, in which applied force destabilizes the binding interface. Using various computational metrics and simulation statistics, the authors propose a model in which tensile force preferentially suppresses thermal fluctuations in the variable α domain of the TCR (vs the β domain) in a peptide-dependent manner, which orders and strengthens the binding interface by bringing together the complementarity-determining regions (CDRs) in the TCR variable chains, but only if the peptide is correctly matched to the TCR.

      R1-0. The study is detailed and written clearly, and conclusions appear convincing and are supported by the simulation data. However, the actual motions at the molecular or amino-acid level of how the catch-bond vs slip bond response originates remain somewhat unclear, and will probably warrant further investigations. Specific hypotheses that could be testable in experiments, such as predictions of which peptide (or TCR) mutations or which peptides could generate a catch-vs-slip response or activation, would have especially strengthened this study.

      Catch bonds have been observed in different αβ TCRs that differ in sequence when paired with their matching pMHC. Thus, there should be a general principle that apply irrespective of particular TCR sequences, as summarized in Fig. 8. The predictive capacity of this model in terms of understanding experiments is explained in our reply R0-3. Here, we discuss about designing specific point mutations to TCR that have not been studied previously. In our simulations, we can identify high-occupancy contacts that are present mainly in the high-load case as target for altering the catch bond behavior. An example is V7-G100 between the peptide and Vβ (Fig. 2C, bottom panel). The V7R mutant peptide is a modified agonist that we have already studied, where R7 forms hydrogen bonds and nonpolar contacts with residues other than βG100, albeit with lower occupancy (page 11, lines 280–282 and page 32, Fig. 5–figure supplement 2B). Instead of the V7R mutation to the peptide, mutating βG100 to other residues may lead to different effects. For example, compared to G100A, mutation to a bulkier residue such as G100F may cause opposing effects: It may induce steric mismatch that destabilizes the interface. Conversely, a stronger hydrophobic effect might increase the baseline bond lifetime. Also, mutating G100 to a polar residue may have even greater effect, leading to a slip bond or absence of measurable binding.

      As the reviewer suggested in R1-5, it will also be interesting to crosslink Vα and Cα by a disulfide bond to suppress its motion. Again, there are different possible outcomes. The lack of Vα-Cα motion could stabilize the interface with pMHC, resulting in a longer bond lifetime. Conversely, if the disulfide bond alters the V-C angle, it would have an opposite effect of destabilizing the interface by tilting it relative to the loading direction, similar to the dFG mutant in Appendix 1 (page 24).

      To make better predictions, simulations of such mutants should to be performed under different conditions and analyzed, which would be beyond the scope of the present study.

      Change made:

      • Page 14, Concluding Discussion, lines 395–402: We added a discussion about using simulations for designing and testing point mutants.

      Reviewer #2 (Public Review):

      In this work, Chang-Gonzalez and co-workers investigate the role of force in peptide recognition by T-cells using a model T-cell/peptide recognition complex. By applying forces through a harmonic restraint on distances, the authors probe the role of mechanical pulling on peptide binding specificity. They point to a role for force in distinguishing the different roles played by agonist and antagonist peptides for which the bound configuration is not clearly distinguishable. Overall, I would consider this work to be extensive and carefully done, and noteworthy for the number of mutant peptides and conditions probed. From the text, I’m not sure how specific these conclusions are to this particular complex, but I do not think this diminishes the specific studies.

      I have a couple of specific comments on the methodology and analysis that the authors could consider:

      R2-1. 1) It is not explained what is the origin of force on the peptide-MHC complex. Although I do know a bit about this, it’s not clear to me how the force ends up applied across the complex (e.g. is it directional in any way, on what subdomains/residues do we expect it to be applied), and is it constant or stochastic. I think it would be important to add some discussion of this and how it translates into the way the force is applied here (on terminal residues of the complex).

      As explained in our reply R0-1, force on the TCRαβ-pMHC complex arises during immune surveillance where the T-cell moves over APC. Generated by the cellular machinery such as actin retrograde flow and actomyosin motility, the applied force fluctuates, which would be on top of spontaneous fluctuation in force by thermal motion. This has been directly measured for the T-cell using a pMHC-coated bead via optical tweezers (see Feng et al., 2017, Fig. 1) and by DNA tension sensors (Liu, et al., 2016, Fig. 4; already cited in the manuscript). The direction of force also fluctuates that is longitudinal on average (see R1-6). How force distributes across the molecule is a great question, for which we plan to develop a computational method to quantify.

      Changes made.

      • Pages 3–4, newly added Results section ‘Applying loads to TCRαβ-pMHC complexes:’ We included the origin of force and its fluctuating nature, and the question of how loads are distributed across the molecule.

      • The reference (Feng et al., 2017) has been added in the above section.

      R2-2. 2) In terms of application of the force, I find the use of a harmonic restraint and then determining a distance at which the force has a certain value to be indirect and a bit unphysical. As just mentioned, since the origin of the force is not a harmonic trap, it would be more straightforward to apply a pulling force which has the form -F*d, which would correspond to a constant force (see for example comment articles 10.1021/acs.jpcb.1c10715,10.1021/acs.jpcb.1c06330). While application of a constant force will result in a new average distance, for small forces it does so in a way that does not change the variance of the distance whereas a harmonic force pollutes the variance (see e.g. 10.1021/ct300112v in a different context). A constant force could also shift the system into a different state not commensurate with the original distance, so by applying a harmonic trap, one could be keeping ones’ self from exploring this, which could be important, as in the case of certain catch bond mechanisms. While I certainly wouldn’t expect the authors to redo these extensive simulations, I think they could at least acknowledge this caveat, and they may be interested in considering a comparison of the two ways of applying a force in the future.

      Thanks for the suggestions and references. The paper by Stirnemann (2022) is a review including different computational methods of applying forces, mainly constant force and constant pulling velocity (steered molecular dynamics; SMD). The second one by Gomez et al., (2021) is a rather broad review of mechanosensing where discussion about computer simulation was mainly on SMD. In the third one by Pitera and Chodera (2012), potential limitations of using harmonic potentials in sampling nonlinear potential of mean force (PMF) are discussed.

      In the above references, loads or restraints are used to study conformational transitions or to sample the PMF, which are different from the use of positional restraints in our work. As explained in R0-1, positional restraint better mimics reality where the terminal ends of TCR and pMHC are anchored on the membranes of respective cells. Also, the concern raised by the reviewer about ruling out different states would be applicable to the case when there are multiple conformational states with local free energy minima at different extensions. Here, we are probing changes in the conformational dynamics (deformation and conformational fluctuation), rather than transitions between well-defined states.

      In Pitera and Chodera (2012) and also in other approaches such as umbrella sampling, the spring constant of the harmonic potential should be chosen sufficiently soft so that sampling around the neighborhood of the center of the potential can be made. On the other hand, if the harmonic potential is much stiffer than the local curvature of the PMF, although sampling may suffer, local gradient of the PMF, i.e, the force about the center of the potential, can be made. This has been studied earlier by one of us in Hwang (2007), which forms the basis for using a stiff harmonic potential for measuring the load on the TCRαβ-pMHC complex. The 1-kcal/(mol·˚A2) spring constant used in our study (page 17, line 540) was selected such that the thermally driven positional fluctuation is on the order of 0.8 ˚A. Hence, it is sufficiently stiff considering the much larger size of the TCRαβ-pMHC complex and the flexible added strands.

      Changes made:

      • Page 4, lines 117–119, newly added Results section ‘Applying loads to TCRαβ-pMHC complexes:’ The above explanation about the use of stiff harmonic restraint for measuring forces is added.

      • The 4 references mentioned above have been added to the above section.

      R2-3. 3) For the PCA analysis, I believe the authors learn separate PC vectors from different simulations and then take the dot product of those two vectors. Although this might be justified based on the simplified coordinate upon which the PCA is applied, in general, I am not a big fan of running PCA on separate data sets and then comparing the outputs, as the meaning seems opaque to me. To compare the biggest differences between many simulations, it would make more sense to me to perform PCA on all of the data combined, and see if there are certain combinations of quantities that distinguish the different simulations. Alternatively and probably better, one could perform linear discriminant analysis, which is appropriate in this case because one already knows that different simulations are in different states, and hence the LDA will directly give the linear coordinate that best distinguishes classes.

      As explained in R0-2, triads and BOC models are assigned to the same TCR across different simulations in identical ways. For the purpose of examining the relative Vα-Vβ and V-C motions, we believe comparing them across different simulations is a valid approach. When the motions are very distinct, it would be possible to combine all data and perform PCA or LDA to classify them. However, when behaviors differ subtly, analysis on the combined data may not capture individual behaviors. By analogy, consider two sets of 2-dimensional data obtained for the same system under different conditions. If each set forms an elliptical shape with the major axis differing slightly in direction, performing PCA separately on the two sets and comparing the angle between the major axes informs the difference between the two sets. If PCA were performed on the combined data (superposition of two ellipses forming an angle), it will be difficult to find the difference. LDA would likewise be difficult to apply without a very clear separation of behaviors.

      As also explained in R0-2, PCA is just one of multiple analyses we carried out to establish a coherent picture. The main use of PCA to this end was to compare directions of motion and relative amplitude of the motion among the subdomains.

      Changes made:

      • Page 6, lines 171–175 and page 8, lines 226–227: The rationale for applying PCA on triads and BOC models in different simulations are explained.

    1. Author Response

      Reviewer #1 (Public Review):

      This work introduces a novel framework for evaluating the performance of statistical methods that identify replay events. This is challenging because hippocampal replay is a latent cognitive process, where the ground truth is inaccessible, so methods cannot be evaluated against a known answer. The framework consists of two elements:

      1) A replay sequence p-value, evaluated against shuffled permutations of the data, such as radon line fitting, rank-order correlation, or weighted correlation. This element determines how trajectory-like the spiking representation is. The p-value threshold for all accepted replay events is adjusted based on an empirical shuffled distribution to control for the false discovery rate.

      2) A trajectory discriminability score, also evaluated against shuffled permutations of the data. In this case, there are two different possible spatial environments that can be replayed, so the method compares the log odds of track 1 vs. track 2.

      The authors then use this framework (accepted number of replay events and trajectory discriminability) to study the performance of replay identification methods. They conclude that sharp wave ripple power is not a necessary criterion for identifying replay event candidates during awake run behavior if you have high multiunit activity, a higher number of permutations is better for identifying replay events, linear Bayesian decoding methods outperform rank-order correlation, and there is no evidence for pre-play.

      The authors tackle a difficult and important problem for those studying hippocampal replay (and indeed all latent cognitive processes in the brain) with spiking data: how do we understand how well our methods are doing when the ground truth is inaccessible? Additionally, systematically studying how the variety of methods for identifying replay perform, is important for understanding the sometimes contradictory conclusions from replay papers. It helps consolidate the field around particular methods, leading to better reproducibility in the future. The authors' framework is also simple to implement and understand and the code has been provided, making it accessible to other neuroscientists. Testing for track discriminability, as well as the sequentiality of the replay event, is a sensible additional data point to eliminate "spurious" replay events.

      However, there are some concerns with the framework as well. The novelty of the framework is questionable as it consists of a log odds measure previously used in two prior papers (Carey et al. 2019 and the authors' own Tirole & Huelin Gorriz, et al., 2022) and a multiple comparisons correction, albeit a unique empirical multiple comparisons correction based on shuffled data.

      With respect to the log odds measure itself, as presented, it is reliant on having only two options to test between, limiting its general applicability. Even in the data used for the paper, there are sometimes three tracks, which could influence the conclusions of the paper about the validity of replay methods. This also highlights a weakness of the method in that it assumes that the true model (spatial track environment) is present in the set of options being tested. Furthermore, the log odds measure itself is sensitive to the defined ripple or multiunit start and end times, because it marginalizes over both position and time, so any inclusion of place cells that fire for the animal's stationary position could influence the discriminability of the track. Multiple track representations during a candidate replay event would also limit track discriminability. Finally, the authors call this measure "trajectory discriminability", which seems a misnomer as the time and position information are integrated out, so there is no notion of trajectory.

      The authors also fail to make the connection with the control of the false discovery rate via false positives on empirical shuffles with existing multiple comparison corrections that control for false discovery rates (such as the Benjamini and Hochberg procedure or Storey's q-value). Additionally, the particular type of shuffle used will influence the empirically determined p-value, making the procedure dependent on the defined null distribution. Shuffling the data is also considerably more computationally intensive than the existing multiple comparison corrections.

      Overall, the authors make interesting conclusions with respect to hippocampal replay methods, but the utility of the method is limited in scope because of its reliance on having exactly two comparisons and having to specify the null distribution to control for the false discovery rate. This work will be of interest to electrophysiologists studying hippocampal replay in spiking data.

      We would like to thank the reviewer for the feedback.

      Firstly, we would like to clarify that it is not our intention to present this tool as a novel replay detection approach. It is indeed merely a novel tool for evaluating different replay detection methods. Also, while we previously used log odds metrics to quantify contextual discriminability within replay events (Tirole et al., 2021), this framework is novel in how it is used (to compare replay detection methods), and the use of empirically determined FPR-matched alpha levels. We have now modified the manuscript to make this point more explicit.

      Our use of the term trajectory-discriminability is now changed to track-discriminability in the revised manuscript, given we are summing over time and space, as correctly pointed out by the reviewer.

      While this approach requires two tracks in its current implementation, we have also been able to apply this approach to three tracks, with a minor variation in the method, however this is beyond the scope of our current manuscript. Prior experience on other tracks not analysed in the log odds calculation should not pose any issue, given that the animal likely replays many experiences of the day (e.g. the homecage). These “other” replay events likely contribute to candidate replay events that fail to have a statistically significant replay score on either track.

      With regard to using a cell-id randomized dataset to empirically estimate false-positive rates, we have provided a detailed explanation behind our choice of using an alpha level correction in our response to the essential revisions above. This approach is not used to examine the effect of multiple comparisons, but rather to measure the replay detection error due to non-independence and a non-uniform p value distribution. Therefore we do not believe that existing multiple comparison corrections such as Benjamini and Hochberg procedure are applicable here (Author response image 1-3). Given the potential issues raised with a session-based cell-id randomization, we demonstrate above that the null distribution is sufficiently independent from the four shuffle-types used for replay detection (the same was not true for a place field randomized dataset) (Author response image 4).

      Author response image 1.

      Distribution of Spearman’s rank order correlation score and p value for false events with random sequence where each neuron fires one (left), two (middle) or three (right) spikes.

      Author response image 2.

      Distribution of Spearman’s rank order correlation score and p value for mixture of 20% true events and 80% false events where each neuron fires one (left), two (middle) or three (right) spikes.

      Author response image 3.

      Number of true events (blue) and false events (yellow) detected based on alpha level 0.05 (upper left), empirical false positive rate 5% (upper right) and false discovery rate 5% (lower left, based on BH method)

      Author response image 4.

      Proportion of false events detected when using dataset with within and cross experiment cell-id randomization and place field randomization. The detection was based on single shuffle including time bin permutation shuffle, spike train circular shift shuffle, place field circular shift shuffle, and place bin circular shift shuffle.

      Reviewer #2 (Public Review):

      This study proposes to evaluate and compare different replay methods in the absence of "ground truth" using data from hippocampal recordings of rodents that were exposed to two different tracks on the same day. The study proposes to leverage the potential of Bayesian methods to decode replay and reactivation in the same events. They find that events that pass a higher threshold for replay typically yield a higher measure of reactivation. On the other hand, events from the shuffled data that pass thresholds for replay typically don't show any reactivation. While well-intentioned, I think the result is highly problematic and poorly conceived.

      The work presents a lot of confusion about the nature of null hypothesis testing and the meaning of p-values. The prescription arrived at, to correct p-values by putting animals on two separate tracks and calculating a "sequence-less" measure of reactivation are impractical from an experimental point of view, and unsupportable from a statistical point of view. Much of the observations are presented as solutions for the field, but are in fact highly dependent on distinct features of the dataset at hand. The most interesting observation is that despite the existence of apparent sequences in the PRE-RUN data, no reactivation is detectable in those events, suggesting that in fact they represent spurious events. I would recommend the authors focus on this important observation and abandon the rest of the work, as it has the potential to further befuddle and promote poor statistical practices in the field.

      The major issue is that the manuscript conveys much confusion about the nature of hypothesis testing and the meaning of p-values. It's worth stating here the definition of a p-value: the conditional probability of rejecting the null hypothesis given that the null hypothesis is true. Unfortunately, in places, this study appears to confound the meaning of the p-value with the probability of rejecting the null hypothesis given that the null hypothesis is NOT true-i.e. in their recordings from awake replay on different mazes. Most of their analysis is based on the observation that events that have higher reactivation scores, as reflected in the mean log odds differences, have lower p-values resulting from their replay analyses. Shuffled data, in contrast, does not show any reactivation but can still show spurious replays depending on the shuffle procedure used to create the surrogate dataset. The authors suggest using this to test different practices in replay detection. However, another important point that seems lost in this study is that the surrogate dataset that is contrasted with the actual data depends very specifically on the null hypothesis that is being tested. That is to say, each different shuffle procedure is in fact testing a different null hypothesis. Unfortunately, most studies, including this one, are not very explicit about which null hypothesis is being tested with a given resampling method, but the p-value obtained is only meaningful insofar as the null that is being tested and related assumptions are clearly understood. From a statistical point of view, it makes no sense to adjust the p-value obtained by one shuffle procedure according to the p-value obtained by a different shuffle procedure, which is what this study inappropriately proposes. Other prescriptions offered by the study are highly dataset and method dependent and discuss minutiae of event detection, such as whether or not to require power in the ripple frequency band.

      We would like to thank the reviewer for their feedback. The purpose of this paper is to present a novel tool for evaluating replay sequence detection using an independent measure that does not depend on the sequence score. As the reviewer stated, in this study, we are detecting replay events based on a set alpha threshold (0.05), based on the conditional probability of rejecting the null hypothesis given that the null hypothesis is true. For all replay events detected during PRE, RUN or POST, they are classified as track 1 or track 2 replay events by comparing each event’s sequence score relative to the shuffled distribution. Then, the log odds measure was only applied to track 1 and track 2 replay events selected using sequence-based detection. Its important to clarify that we never use log odds to select events to examine their sequenceness p value. Therefore, we disagree with the reviewer’s claim that for awake replay events detected on different tracks, we are quantifying the probability of rejecting the null hypothesis given that the null hypothesis is not true.

      However, we fully understand the reviewer’s concerns with a cell-id randomization, and the potential caveats associated with using this approach for quantifying the false positive rate. First of all, we would like to clarify that the purpose of alpha level adjustment was to facilitate comparison across methods by finding the alpha level with matching false-positive rates determined empirically. Without doing this, it is impossible to compare two methods that differ in strictness (e.g. is using two different shuffles needed compared to using a single shuffle procedure). This means we are interested in comparing the performance of different methods at the equivalent alpha level where each method detects 5% spurious events per track rather than an arbitrary alpha level of 0.05 (which is difficult to interpret if statistical tests are run on non-independent samples). Once the false positive rate is matched, it is possible to compare two methods to see which one yields more events and/or has better track discriminability.

      We agree with the reviewer that the choice of data randomization is crucial. When a null distribution of a randomized dataset is very similar to the null distribution used for detection, this should lead to a 5% false positive rate (as a consequence of circular reasoning). In our response to the essential revisions, we have discussed about the effect of data randomization on replay detection. We observed that while place field circularly shifted dataset and cell-id randomized dataset led to similar false-positive rates when shuffles that disrupt temporal information were used for detection, a place field circularly shifted dataset but not a cell-id randomized dataset was sensitive to shuffle methods that disrupted place information (Author response image 4). We would also like to highlight one of our findings from the manuscript that the discrepancy between different methods can be substantially reduced when alpha level was adjusted to match false-positive rates (Figure 6B). This result directly supports the utility of a cell-id randomized dataset in finding the alpha level with equivalent false positive rates across methods. Hence, while imperfect, we argue cell-id randomization remains an acceptable method as it is sufficiently different from the four shuffles we used for replay detection compared to place field randomized dataset (Author response image 4).

      While the use of two linear tracks was crucial for our current framework to calculate log odds for evaluating replay detection, we acknowledge that it limits the applicability of this framework. At the same time, the conclusions of the manuscript with regard to ripples, replay methods, and preplay should remain valid on a single track. A second track just provides a useful control for how place cells can realistically remap within another environment. However, with modification, it may be applied to a maze with different arms or subregions, although this is beyond the scope of our current study.

      Last of not least, we partly agree with the reviewer that the result can be dataset-specific such that the result may vary depending on animal’s behavioural state and experimental design. However, our results highlight the fact that there is a very wide distribution of both the track discriminability and the proportion of significant events detected across methods that are currently used in the field. And while we see several methods that appear comparable in their effectiveness in replay detection, there are also other methods that are deeply flawed (that have been previously been used in peer-reviewed publications) if the alpha level is not sufficiently strict. Regardless of the method used, most methods can be corrected with an appropriate alpha level (e.g. using all spikes for a rank order correlation). Therefore, while the exact result may be dataset-specific, we feel that this is most likely due to the number of cells and properties of the track more than the use of two tracks. Reporting of the empirically determined false-positive rate and use of alpha level with matching false-positive rate (such as 0.05) for detection does not require a second track, and the adoption of this approach by other labs would help to improve the interpretability and generalizability of their replay data.

      Reviewer #3 (Public Review):

      This study tackles a major problem with replay detection, which is that different methods can produce vastly different results. It provides compelling evidence that the source of this inconsistency is that biological data often violates assumptions of independent samples. This results in false positive rates that can vary greatly with the precise statistical assumptions of the chosen replay measure, the detection parameters, and the dataset itself. To address this issue, the authors propose to empirically estimate the false positive rate and control for it by adjusting the significance threshold. Remarkably, this reconciles the differences in replay detection methods, as the results of all the replay methods tested converge quite well (see Figure 6B). This suggests that by controlling for the false positive rate, one can get an accurate estimate of replay with any of the standard methods.

      When comparing different replay detection methods, the authors use a sequence-independent log-odds difference score as a validation tool and an indirect measure of replay quality. This takes advantage of the two-track design of the experimental data, and its use here relies on the assumption that a true replay event would be associated with good (discriminable) reactivation of the environment that is being replayed. The other way replay "quality" is estimated is by the number of replay events detected once the false positive rate is taken into account. In this scheme, "better" replay is in the top right corner of Figure 6B: many detected events associated with congruent reactivation.

      There are two possible ways the results from this study can be integrated into future replay research. The first, simpler, way is to take note of the empirically estimated false positive rates reported here and simply avoid the methods that result in high false positive rates (weighted correlation with a place bin shuffle or all-spike Spearman correlation with a spike-id shuffle). The second, perhaps more desirable, way is to integrate the practice of estimating the false positive rate when scoring replay and to take it into account. This is very powerful as it can be applied to any replay method with any choice of parameters and get an accurate estimate of replay.

      How does one estimate the false positive rate in their dataset? The authors propose to use a cell-ID shuffle, which preserves all the firing statistics of replay events (bursts of spikes by the same cell, multi-unit fluctuations, etc.) but randomly swaps the cells' place fields, and to repeat the replay detection on this surrogate randomized dataset. Of course, there is no perfect shuffle, and it is possible that a surrogate dataset based on this particular shuffle may result in one underestimating the true false positive rate if different cell types are present (e.g. place field statistics may differ between CA1 and CA3 cells, or deep vs. superficial CA1 cells, or place cells vs. non-place cells if inclusion criteria are not strict). Moreover, it is crucial that this validation shuffle be independent of any shuffling procedure used to determine replay itself (which may not always be the case, particularly for the pre-decoding place field circular shuffle used by some of the methods here) lest the true false-positive rate be underestimated. Once the false positive rate is estimated, there are different ways one may choose to control for it: adjusting the significance threshold as the current study proposes, or directly comparing the number of events detected in the original vs surrogate data. Either way, with these caveats in mind, controlling for the false positive rate to the best of our ability is a powerful approach that the field should integrate.

      Which replay detection method performed the best? If one does not control for varying false positive rates, there are two methods that resulted in strikingly high (>15%) false positive rates: these were weighted correlation with a place bin shuffle and Spearman correlation (using all spikes) with a spike-id shuffle. However, after controlling for the false positive rate (Figure 6B) all methods largely agree, including those with initially high false positive rates. There is no clear "winner" method, because there is a lot of overlap in the confidence intervals, and there also are some additional reasons for not overly interpreting small differences in the observed results between methods. The confidence intervals are likely to underestimate the true variance in the data because the resampling procedure does not involve hierarchical statistics and thus fails to account for statistical dependencies on the session and animal level. Moreover, it is possible that methods that involve shuffles similar to the cross-validation shuffle ("wcorr 2 shuffles", "wcorr 3 shuffles" both use a pre-decoding place field circular shuffle, which is very similar to the pre-decoding place field swap used in the cross-validation procedure to estimate the false positive rate) may underestimate the false positive rate and therefore inflate adjusted p-value and the proportion of significant events. We should therefore not interpret small differences in the measured values between methods, and the only clear winner and the best way to score replay is using any method after taking the empirically estimated false positive rate into account.

      The authors recommend excluding low-ripple power events in sleep, because no replay was observed in events with low (0-3 z-units) ripple power specifically in sleep, but that no ripple restriction is necessary for awake events. There are problems with this conclusion. First, ripple power is not the only way to detect sharp-wave ripples (the sharp wave is very informative in detecting awake events). Second, when talking about sequence quality in awake non-ripple data, it is imperative for one to exclude theta sequences. The authors' speed threshold of 5 cm/s is not sufficient to guarantee that no theta cycles contaminate the awake replay events. Third, a direct comparison of the results with and without exclusion is lacking (selecting for the lower ripple power events is not the same as not having a threshold), so it is unclear how crucial it is to exclude the minority of the sleep events outside of ripples. The decision of whether or not to select for ripples should depend on the particular study and experimental conditions that can affect this measure (electrode placement, brain state prevalence, noise levels, etc.).

      Finally, the authors address a controversial topic of de-novo preplay. With replay detection corrected for the false positive rate, none of the detection methods produce evidence of preplay sequences nor sequenceless reactivation in the tested dataset. This presents compelling evidence in favour of the view that the sequence of place fields formed on a novel track cannot be predicted by the sequential structure found in pre-task sleep.

      We would like to thank the reviewer for the positive and constructive feedback.

      We agree with the reviewer that the conclusion about the effect of ripple power is dataset-specific and is not intended to be a one-size-fit-all recommendation for wider application. But it does raise a concern that individual studies should address. The criteria used for selecting candidate events will impact the overall fraction of detected events, and makes the comparison between studies using different methods more difficult. We have updated the manuscript to emphasize this point.

      “These results emphasize that a ripple power threshold is not necessary for RUN replay events in our dataset but may still be beneficial, as long as it does not excessively eliminate too many good replay events with low ripple power. In other words, depending on the experimental design, it is possible that a stricter p-value with no ripple threshold can be used to detect more replay events than using a less strict p-value combined with a strict ripple power threshold. However, for POST replay events, a threshold at least in the range of a z-score of 3-5 is recommended based on our dataset, to reduce inclusion of false-positives within the pool of detected replay events.”

      “We make six key observations: 1) A ripple power threshold may be more important for replay events during POST compared to RUN. For our dataset, the POST replay events with ripple power below a z-score of 3-5 were indistinguishable from spurious events. While the exact ripple z-score threshold to implement may differ depending on the experimental condition (e.g. electrode placement, behavioural paradigm, noise level and etc) and experimental aim, our findings highlight the benefit of using ripple power threshold for detecting replay during POST. 2) ”

    1. Author Response

      Reviewer #1 (Public Review):

      In this exciting and well-written manuscript, Alvarez-Buylla and colleagues report a fascinating discovery of an alkaloid-binding protein in the plasma of poison frogs, which may help explain how these animals are able to sequester a diversity of alkaloids with different target sites. This work is a major advance in our knowledge of how poison frogs are able to sequester and even resist such a panoply of alkaloids. Their study also adds to our understanding of how toxic animals resist the effects of their own defenses. Although target site insensitivity and other mechanisms acting to prevent the binding of alkaloids to their targets (often ion channels) are well characterized now in poison frogs, less is known regarding how they regulate the movement of toxins throughout the animal and in blood in particular. In the fugu (pufferfish) a protein binds saxitoxin and tetrodotoxin and in some amphibians possibly the protein saxiphilin has been proposed to be a toxin sponge for saxitoxin. However, little is known about poison frogs in particular and if toxin-binding proteins are involved in their sequestration and auto-resistance mechanisms.

      The authors use a clever approach wherein a fluorescently labeled probe of a pumiliotoxin analog (an alkaloid toxin sequestered by some poison frogs) is able to be crosslinked to proteins to which it binds. The authors then use sophisticated mass spectroscopy to identify the proteins and find an outlier 'hit' that is a serpin protein. A competition assay, as well as mutagenesis studies, revealed that this ~50-60 kDa plasma protein is responsible for binding much of the pumiliotoxin and a few other alkaloids known to be sequestered in the in vivo assay, but not nicotine, an alkaloid not sequestered by these frogs.

      In general, their results are convincing, their methods and analyses robust and the writing excellent. Their findings represent a major breakthrough in the study of toxin sequestration in poison frogs. Below, a more detailed summary and both major and minor constructive comments are given on the nature of the discoveries and some ways that the manuscript could be improved.

      Many thanks for this positive summary of our work! We greatly appreciate your time and thoroughness in giving us feedback.

      Detailed Summary

      The authors functionally characterize a serine-protease inhibitor protein in Oophaga sylvatica frog plasma, which they name O. sylvatica alkaloid-binding globulin (OsABG), that can bind toxic alkaloids. They show that OsABG is the most highly expressed serpin in O. sylvatica liver and that its expression is higher than that of albumin, a major small molecule carrier in vertebrates. Using a toxin photoprobe combined with competitive protein binding assays, their data suggest that OsABG is able to bind specific poison frog toxins including the two most abundant alkaloids in O. sylvatica skin. Their in vitro isolation of toxin-bound OsABG shows that the protein binds most free pumiliotoxin in solution and suggests that OsABG may play an important role in its sequestration. The authors further show that mutations in the binding pocket of OsABG remove its ability to bind toxins and that the binding pocket is structurally similar to that of other vertebrate serpins.

      These results are an exciting advance in understanding how poison frogs, which make and use alkaloids as chemical defenses, prevent self-intoxication. The authors provide convincing evidence that OsABG can function as a toxin sponge in O. sylvatica which sets a compelling precedent for future work needed to test the role of OsABG in vivo.

      The study could be improved by shifting the focus to O. sylvatica specifically rather than the convergent evolution of sequestration among different dendrobatid species. The reason for this is that most of the results (aside from some of the photoprobe binding results presented in Fig. 1 and Fig. 4) and the proteomics identification of OsABG itself are based on O. sylvatica. It's unclear whether ABG proteins are major toxin sponges in D. tinctorius or E. tricolor since these frogs may contain different toxin cocktails. The competitive binding results suggest that putative ABG proteins in D. tinctorius and E. tricolor have reduced binding affinity at higher toxin concentrations than ABG proteins in O. sylvatica. Although molecular convergence in toxin sponges may be at play in the dendrobatid poison frogs, more work is needed in non-O. sylvatica species to determine the extent of convergence.

      We understand and appreciate you raising this concern. As is partially described in the “essential revisions” section above, we have been more cautious throughout the results and discussion to not describe the plasma binding in E. tricolor and D. tinctorius as definitively due to ABG proteins, and to shift the overall focus to O. sylvatica.

      Major constructive comments:

      Although the protein gels in Fig.1-2 show clearly the role of ABG, a ~50 kDa protein, it's unclear whether transferrin-like proteins, which are ~80 kDa, may also play a role because the gels show proteins between 39-64 kDa (Fig.1). The gel in Fig.2A is specific to one O. sylvatica and extends this range, but the gel does not appear to be labeled accordingly, making it unclear whether other larger proteins could have been detected in addition to ABG. Clarifying this issue would facilitate the interpretation of the results.

      Thank you for this suggestion, please see our response above in the “essential revisions” section.

      There is what seems to be a significant size difference between the O. sylvatica bands and bands from the other toxic frog species, namely D. tinctorius and E. tricolor. Could the photoprobe be binding to other non-ABG proteins of different sizes in different frog species? Given that O. sylvatica bands are bright and this species was the only one subject to proteomics quantification, a possible conclusion may be that the ABG toxin sponge is a lineage-specific adaptation of O. sylvatica rather than a common mechanism of toxin sequestration among multiple independent lineages of poison frogs. It would be helpful if the authors could address this observation of their binding data and the hypothesis flowing from that in the manuscript.

      Thank you for this suggestion, please see our response above in the “essential revisions” section.

      Figure 1B: The species names should be labeled alongside the images in the phylogeny. In addition, please include symbols indicating the number of times toxicity has evolved (for example, once in the ancestors of O. sylvatica and D. tinctorius frogs and once in the ancestors of E. tricolor frogs).

      These suggested changes have been added to Figure 1B. We were not able to fit the full species names into the figure, instead we added an abbreviated version that is spelled out completely in the figure caption.

      Figure 4B-C: Photoprobe binding results in the presence of epi and nicotine appear to be missing for D. tinctorius and those in the presence of PTX and nicotine are missing for D. tricolor. Adding these results would make for a more complete picture of alkaloid binding by ABG in non-O. sylvatica species.

      Thank you for this suggestion, please see our response above in the “essential revisions” section.

      Using recombinant proteins with mutations at residues forming the binding pocket of O. sylvatica ABG (as inferred from docking simulations), the authors found that all binding pocket mutations disrupted photoprobe binding completely in vitro (L221-222, Fig. 4E). However, there is no information presented on non-binding pocket mutations. Mutations outside of the binding pocket would presumably maintain photoprobe binding - barring any indirect structural changes that might disrupt binding pocket interactions with the photoprobe. This result is important for the conclusion that the binding pocket itself is the sole mediator of toxin interactions. The authors do show that one binding pocket mutation (D383A) results in some degree of photoprobe binding (Fig. 4E) but more detail on the mutations in the binding pocket per se being causal would be helpful.

      Thank you for this suggestion, please see our response above in the “essential revisions” section.

      Please include concentrations in the descriptions of gel lanes in the main figures. The relative concentrations of the photoprobe and other toxins (eg., PTX, DHQ, epi, and nic) are essential for interpreting the competitive binding images. For example, this was done in Fig. S1 (e.g., PB + 10x PTX).

      The photoprobe and competitor concentrations have been added beneath the gels in Figures 1, 4, and 6 as suggested. Additionally, in the crosslinking experiments involving purified protein the amount of protein per well has been added to the top of the TAMRA gel.

      For clarity, the section "OsABG sequesters free PTX in solution with high affinity" could be presented directly after the section titled "Proteomic analysis identifies an alkaloid-binding globulin". The former highlights in vitro experiments confirming the binding affinity of the ABG protein identified in the latter.

      While we see how this rearrangement might work, we think that the current order of figures creates a more compelling story and provides the evidence in a more intuitive manner. For instance, it is necessary to show that recombinant protein recapitulates the plasma photoprobe results and that binding pocket mutants disrupt photoprobe binding (Figure 4), prior to showing the direct binding assays with the recombinant wild type and mutant proteins. For this reason, we believe that this rearrangement might cause confusion, and are leaving it as is.

      Fig. 6E-F should be included as part of Fig. 1 or 2. Although complementary to the RNA sequencing data, these protein results are more closely related to the results in the first two figures which show the degree of competitive binding affinity of PB in the presence of different toxins. The expanded competitive binding results for total skin alkaloids and the two most abundant skin alkaloids from wild samples are most appropriate here.

      We understand the reasoning behind this, however we feel that including these results in Figure 6 is more appropriate and that moving it would disrupt the flow of the story. The identification of ABG and its binding activity happened before we fully understood the alkaloid profiles of wild-collected O. sylvatica, therefore we did not think to test additional alkaloids like histrionicotoxin and indolizidines till we saw that these were very abundant on the skin of field collected poison frogs. Furthermore, we would like to leave this section at the end because we feel it contributes important ecological relevance that we want to leave readers with.

    1. Author Response

      Reviewer #1 (Public Review):

      This work aims to evaluate the use of pressure insoles for measurements that are traditionally done using force platforms in the assessment of people with knee osteoarthritis and other arthropathies. This is vital for providing an affordable assessment that does not require a fully equipped gait lab as well as utilizing wearable technology for personalized healthcare.

      Towards these aims, the authors were able to demonstrate that individual subjects can be identified with high precision using raw sensor data from the insoles and a convolutional neural network model. The authors have done a great job creating the models and combining an already available public dataset of force platform signals and utilizing them for training models with transferable ability to be used with data from pressure insoles. However, there are a few concerns, regarding substantiating some of the goals that this manuscript is trying to achieve.

      In addressing these concerns, if the results are further corroborated using the suggestions provided to the authors, this provides an exciting tool for identifying an individual's gait patterns out of a cluster of data, which is extremely useful for providing identifiable labels for personalized healthcare using wearable technologies.

      Thank you for this enthusiasm for our work, and we hope that our responses are adequate to address what we can of these comments. Please note that we have made every effort to address comments that we can and appreciated the detailed feedback you provided.

      Reviewer #2 (Public Review):

      The authors aimed to investigate whether digital insoles are an appropriate alternative to laboratory assessment with force plates when attempting to identify the knee injury status. The methods are rigorous and appropriate in the context of this research area. The results are impressive, and the figures are exceptional. The findings of this study can have a great impact on the field, showing that digital insoles can be accurately used for clinical purposes. The authors successfully achieved their aims.

      We thank the reviewer for this enthusiasm and hope our edits adequately address the points the reviewer made to strengthen the manuscript.

      Reviewer #3 (Public Review):

      In this manuscript, the authors describe the development of a machine-learning model to be used for gait assessment using insole data. They first developed a machine learning model using an existing, large data set of ground reaction forces collected during walking with force plates in a lab, from healthy adults and a group of people with knee injuries. Subsequently, they tested this model on ground reaction forces derived from insoles worn by a group of 19 healthy adults and a group of n=44 people with knee osteoarthritis (OA). The model was able to accurately identify individuals belonging to the knee OA group or the healthy group using the ground reaction forces during walking. Note: I do not have expertise on machine learning and will therefore refrain from reviewing the ML methods that were applied in this paper.

      Strengths: The authors successfully externally validated the trained model for GRF on insole data. Insole data carries potentially rich information, including the path of the CoP during the stance phase. The additional value of insoles over force plates in itself is clear, as insoles can be used independently of laboratory facilities. Moreover, insoles provide information on the COP path, which can have added value over other mobile assessment methods such as inertial sensors.

      Limitations: The second ML model, using only insole data to identify knee arthropathy from healthy subjects, was trained on a small sample of subjects. Although I have no background in ML, I can imagine that external validation in an independent and larger sample is needed to support the current findings.

      Gait speed has a major influence on the majority of gait-related outcomes. Slow or more cautious gait, due to pain or other causes, is reflected in vertical GRF's with less pronounced peaks. A difference in gait speed between people with pain in their knee (due to injury) and healthy subjects can be expected. This raises the question of what the added value of a model to estimate vertical GRF is over a simpler output (e.g. gait speed itself). Moreover, the paper does not elucidate what the added value of machine learning is over a simpler statistical model.

      This is a good point, however, clinically we are interested in weight bearing and difference in pressure related metrics in this musculoskeletal group, which speed will simply not provide. So we are looking at additional metrics.

      There are numerous publications suggesting that non-speed related metrics are important to predict disease progression in a variety of conditions (e.g., D’Lima DD, Fregly BJ, Pail S, Steklov N, Colwell CW. Knee joint forces: prediction, measurement and significance. Proc Inst Mech Eng H. 2012:226:95–102. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3324308/). In OA, the vector on ground force in medial knee OA (not vertical) creates torque and that is correlated with disease progression. We have modified the text throughout to address these points.

      In line with this issue, the current analyses are not strongly convincing me that the model described resulted in an identification of knee arthropathy-specific signature. Only knee arthropathy vs healthy (relatively young) subjects was compared, and we cannot rule out that this group only reflects general cautious, slow, or antalgic gait. As such, the data does not provide any evidence that the tool might be valuable to identify people with more or less severity of symptoms, or that the tool can be used to discriminate knee osteoarthritis from hip, or ankle osteoarthritis, or even to discriminate between people with musculoskeletal diseases and people with neurological gait disorders. This substantially limits the relevance for clinical (research) practice. In short, the output of the model seems to be restricted to "something is going on here", without further specification. Further development towards more specific aims using the insole data may substantially amplify clinical relevance.

      While no dataset (or model) is perfect, we feel that this is the first time that this model has been developed and applied in this cohort/clinical context, and of course acknowledge that future work is needed to further validate and examine how clinically meaningful this model is.

      We have broken out and added to a Study limitations section within the manuscript to reflect these caveats more clearly.

    1. Author Response

      The following is the authors’ response to the original reviews.

      eLife assessment

      This important paper exploits new cryo-EM tomography tools to examine the state of chromatin in situ. The experimental work is meticulously performed and convincing, with a vast amount of data collected. The main findings are interpreted by the authors to suggest that the majority of yeast nucleosomes lack a stable octameric conformation. Despite the possibly controversial nature of this report, it is our hope that such work will spark thought-provoking debate, and further the development of exciting new tools that can interrogate native chromatin shape and associated function in vivo.

      We thank the Editors and Reviewers for their thoughtful and helpful comments. We also appreciate the extraordinary amount of effort needed to assess both the lengthy manuscript and the previous reviews. Below, we provide our point-by-point response in bold blue font. Nearly all comments have been addressed in the revised manuscript. For a subset of comments that would require us to speculate, we have taken a conservative approach because we either lack key information or technical expertise: Instead of adding the speculative replies to the main text, we think it is better to leave them in the rebuttal for posterity. Readers will thereby have access to our speculation and know that we did not feel confident enough to include these thoughts in the Version of Record.

      Reviewer #1 (Public Review):

      This manuscript by Tan et al is using cryo-electron tomography to investigate the structure of yeast nucleosomes both ex vivo (nuclear lysates) and in situ (lamellae and cryosections). The sheer number of experiments and results are astounding and comparable with an entire PhD thesis. However, as is always the case, it is hard to prove that something is not there. In this case, canonical nucleosomes. In their path to find the nucleosomes, the authors also stumble over new insights into nucleosome arrangement that indicates that the positions of the histones is more flexible than previously believed.

      Please note that canonical nucleosomes are there in wild-type cells in situ, albeit rarer than what’s expected based on our HeLa cell analysis and especially the total number of yeast nucleosomes (canonical plus non-canonical). The negative result (absence of any canonical nucleosome classes in situ) was found in the histone-GFP mutants.

      Major strengths and weaknesses:

      Personally, I am not ready to agree with their conclusion that heterogenous non-canonical nucleosomes predominate in yeast cells, but this reviewer is not an expert in the field of nucleosomes and can't judge how well these results fit into previous results in the field. As a technological expert though, I think the authors have done everything possible to test that hypothesis with today's available methods. One can debate whether it is necessary to have 35 supplementary figures, but after working through them all, I see that the nature of the argument needs all that support, precisely because it is so hard to show what is not there. The massive amount of work that has gone into this manuscript and the state-of-the art nature of the technology should be warmly commended. I also think the authors have done a really great job with including all their results to the benefit of the scientific community. Yet, I am left with some questions and comments:

      Could the nucleosomes change into other shapes that were predetermined in situ? Could the authors expand on if there was a structure or two that was more common than the others of the classes they found? Or would this not have been found because of the template matching and later reference particle used?

      Our best guess (speculation) is that one of the class averages that is smaller than the canonical nucleosome contains one or more non-canonical nucleosome classes. However, we do not feel confident enough to single out any of these classes precisely because we do not yet know if they arise from one non-canonical nucleosome structure or from multiple – and therefore mis-classified – non-canonical nucleosome structures (potentially with other non-nucleosome complexes mixed in). We feel it is better to leave this discussion out of the manuscript, or risk sending the community on wild goose chases.

      Our template-matching workflow uses a low-enough cross-correlation threshold that any nucleosome-sized particle (plus minus a few nanometers) would be picked, which is why the number of hits is so large. So unless the noncanonical nucleosomes quadrupled in size or lost most of their histones, they should be grouped with one or more of the other 99 class averages (WT cells) or any of the 100 class averages (cells with GFP-tagged histones). As to whether the later reference particle could have prevented us from detecting one of the non-canonical nucleosome structures, we are unable to tell because we’d really have to know what an in situ non-canonical nucleosome looks like first.

      Could it simply be that the yeast nucleoplasm is differently structured than that of HeLa cells and it was harder to find nucleosomes by template matching in these cells? The authors argue against crowding in the discussion, but maybe it is just a nucleoplasm texture that side-tracks the programs?

      Presumably, the nucleoplasmic “side-tracking” texture would come from some molecules in the yeast nucleus. These molecules would be too small to visualize as discrete particles in the tomographic slices, but they would contribute textures that can be “seen” by the programs – in particular RELION, which does the discrimination between structural states. We are not sure what types of density textures would side-track RELION’s classification routines.

      The title of the paper is not well reflected in the main figures. The title of Figure 2 says "Canonical nucleosomes are rare in wild-type cells", but that is not shown/quantified in that figure. Rare is comparison to what? I suggest adding a comparative view from the HeLa cells, like the text does in lines 195-199. A measure of nucleosomes detected per volume nucleoplasm would also facilitate a comparison.

      Figure 2’s title is indeed unclear and does not align with the paper’s title and key conclusion. The rarity here is relative to the expected number of nucleosomes (canonical plus non-canonical). We have changed the title to:

      “Canonical nucleosomes are a minority of the expected total in wild-type cells”.

      We would prefer to leave the reference to HeLa cells to the main text instead of as a figure panel because the comparison is not straightforward for a graphical presentation. Instead, we now report the total number of nucleosomes estimated for this particular yeast tomogram (~7,600) versus the number of canonical nucleosomes classified (297; 594 if we assume we missed half of them). This information is in the revised figure legend:

      “In this tomogram, we estimate there are ~7,600 nucleosomes (see Methods on how the calculation is done), of which 297 are canonical structures. Accounting for the missing disc views, we estimate there are ~594 canonical nucleosomes in this cryolamella (< 8% the expected number of nucleosomes).”

      If the cell contains mostly non-canonical nucleosomes, are they really non-canonical? Maybe a change of language is required once this is somewhat sure (say, after line 303).

      This is an interesting semantic and philosophical point. From the yeast cell’s “perspective”, the canonical nucleosome structure would be the form that is in the majority. That being said, we do not know if there is one structure that is the majority. From the chromatin field’s point of view, the canonical nucleosome is the form that is most commonly seen in all the historical – and most contemporary – literature, namely something that resembles the crystal structure of Luger et al, 1997. Given these two lines of thinking, we added the following clarification as lines 312 – 316:

      “At present, we do not know what the non-canonical nucleosome structures are, meaning that we cannot even determine if one non-canonical structure is the majority. Until we know the non-canonical nucleosomes’ structures, we will use the term non-canonical to describe all the nucleosomes that do not have the canonical (crystal) structure.”

      The authors could explain more why they sometimes use conventional the 2D followed by 3D classification approach and sometimes "direct 3-D classification". Why, for example, do they do 2D followed by 3D in Figure S5A? This Figure could be considered a regular figure since it shows the main message of the paper.

      Since the classification of subtomograms in situ is still a work in progress, we felt it would be better to show one instance of 2-D classification for lysates and one for lamellae. While it is true that we could have presented direct 3-D classification for the entire paper, we anticipate that readers will be interested to see what the in situ 2-D class averages look like.

      The main message is that there are canonical nucleosomes in situ (at least in wild-type cells), but they are a minority. Therefore, the conventional classification for Figure S5A should not be a main figure because it does not show any canonical nucleosome class averages in situ.

      Figure 1: Why is there a gap in the middle of the nucleosome in panel B? The authors write that this is a higher resolution structure (18Å), but in the even higher resolution crystallography structure (3Å resolution), there is no gap in the middle.

      There is a lower concentration of amino acids at the middle in the disc view; unfortunately, the space-filling model in Figure 1A hides this feature. The gap exists in experimental cryo-EM density maps. See Author response image 1 for an example (pubmed.ncbi.nlm.nih.gov/29626188). The size of the gap depends on the contour level and probably the contrast mechanism, as the gap is less visible in the VPP subtomogram averages. To clarify this confusing phenomenon, we added the following lines to the figure legend:

      “The gap in the disc view of the nuclear-lysate-based average is due to the lower concentration of amino acids there, which is not visible in panel A due to space-filling rendering. This gap’s visibility may also depend on the contrast mechanism because it is not visible in the VPP averages.”

      Author response image 1.

      Reviewer #2 (Public Review):

      Nucleosome structures inside cells remain unclear. Tan et al. tackled this problem using cryo-ET and 3-D classification analysis of yeast cells. The authors found that the fraction of canonical nucleosomes in the cell could be less than 10% of total nucleosomes. The finding is consistent with the unstable property of yeast nucleosomes and the high proportion of the actively transcribed yeast genome. The authors made an important point in understanding chromatin structure in situ. Overall, the paper is well-written and informative to the chromatin/chromosome field.

      We thank Reviewer 2 for their positive assessment.

      Reviewer #3 (Public Review):

      Several labs in the 1970s published fundamental work revealing that almost all eukaryotes organize their DNA into repeating units called nucleosomes, which form the chromatin fiber. Decades of elegant biochemical and structural work indicated a primarily octameric organization of the nucleosome with 2 copies of each histone H2A, H2B, H3 and H4, wrapping 147bp of DNA in a left handed toroid, to which linker histone would bind.

      This was true for most species studied (except, yeast lack linker histone) and was recapitulated in stunning detail by in vitro reconstitutions by salt dialysis or chaperone-mediated assembly of nucleosomes. Thus, these landmark studies set the stage for an exploding number of papers on the topic of chromatin in the past 45 years.

      An emerging counterpoint to the prevailing idea of static particles is that nucleosomes are much more dynamic and can undergo spontaneous transformation. Such dynamics could arise from intrinsic instability due to DNA structural deformation, specific histone variants or their mutations, post-translational histone modifications which weaken the main contacts, protein partners, and predominantly, from active processes like ATP-dependent chromatin remodeling, transcription, repair and replication.

      This paper is important because it tests this idea whole-scale, applying novel cryo-EM tomography tools to examine the state of chromatin in yeast lysates or cryo-sections. The experimental work is meticulously performed, with vast amount of data collected. The main findings are interpreted by the authors to suggest that majority of yeast nucleosomes lack a stable octameric conformation. The findings are not surprising in that alternative conformations of nucleosomes might exist in vivo, but rather in the sheer scale of such particles reported, relative to the traditional form expected from decades of biochemical, biophysical and structural data. Thus, it is likely that this work will be perceived as controversial. Nonetheless, we believe these kinds of tools represent an important advance for in situ analysis of chromatin. We also think the field should have the opportunity to carefully evaluate the data and assess whether the claims are supported, or consider what additional experiments could be done to further test the conceptual claims made. It is our hope that such work will spark thought-provoking debate in a collegial fashion, and lead to the development of exciting new tools which can interrogate native chromatin shape in vivo. Most importantly, it will be critical to assess biological implications associated with more dynamic - or static forms- of nucleosomes, the associated chromatin fiber, and its three-dimensional organization, for nuclear or mitotic function.

      Thank you for putting our work in the context of the field’s trajectory. We hope our EMPIAR entry, which includes all the raw data used in this paper, will be useful for the community. As more labs (hopefully) upload their raw data and as image-processing continues to advance, the field will be able to revisit the question of non-canonical nucleosomes in budding yeast and other organisms. 

      Reviewer #1 (Recommendations For The Authors):

      The manuscript sometimes reads like a part of a series rather than a stand-alone paper. Be sure to spell out what needs to be known from previous work to read this article. The introduction is very EM-technique focused but could do with more nucleosome information.

      We have added a new paragraph that discusses the sources of structural variability to better prepare readers, as lines 50 – 59:

      “In the context of chromatin, nucleosomes are not discrete particles because sequential nucleosomes are connected by short stretches of linker DNA. Variation in linker DNA structure is a source of chromatin conformational heterogeneity (Collepardo-Guevara and Schlick, 2014). Recent cryo-EM studies show that nucleosomes can deviate from the canonical form in vitro, primarily in the structure of DNA near the entry/exit site (Bilokapic et al., 2018; Fukushima et al., 2022; Sato et al., 2021; Zhou et al., 2021). In addition to DNA structural variability, nucleosomes in vitro have small changes in histone conformations (Bilokapic et al., 2018). Larger-scale variations of DNA and histone structure are not compatible with high-resolution analysis and may have been missed in single-particle cryo-EM studies.”

      Line 165-6 "did not reveal a nucleosome class average in..". Add "canonical", since it otherwise suggests there were no nucleosomes.

      Thank you for catching this error. Corrected.

      Lines 177-182: Why are the disc views missed by the classification analysis? They should be there in the sample, as you say.

      We suspect that RELION 3 is misclassifying the disc-view canonical nucleosomes into the other classes. The RELION developers suspect that view-dependent misclassification arises from RELION 3’s 3-D CTF model. RELION 4 is reported to be less biased by the particles’ views. We have started testing RELION 4 but do not have anything concrete to report yet.

      Line 222: a GFP tag.

      Fixed.

      Line 382: "Note that the percentage .." I can't follow this sentence. Why would you need to know how many chromosome's worth of nucleosomes you are looking at to say the percentage of non-canonical nucleosomes?

      Thank you for noticing this confusing wording. The sentence has been both simplified and clarified as follows in lines 396 – 398:

      “Note that the percentage of canonical nucleosomes in lysates cannot be accurately estimated because we cannot determine how many nucleosomes in total are in each field of view.”

      Line 397: "We're not implying that..." Please add a sentence clearly stating what you DO mean with mobility for H2A/H2B.

      We have added the following clarifying sentence in lines 412 – 413:

      “We mean that H2A-H2B is attached to the rest of the nucleosome and can have small differences in orientation.”

      Line 428: repeated message from line 424. "in this figure, the blurring implies.."

      Redundant phrase removed.

      Line 439: "on a HeLa cell" - a single cell in the whole study?

      Yes, that study was done on a single cell.

      A general comment is that the authors could help the reader more by developing the figures and making them more pedagogical, a list of suggestions can be found below.

      Thank you for the suggestions. We have applied all of them to the specific figure callouts and to the other figures that could use similar clarification.

      Figure 2: Help the reader by avoiding abbreviations in the figure legend. VPP tomographic slice - spell out "Volta Phase Plate". Same with the term "remapped" (panel B) what does that mean?

      We spelled out Volta phase plate in full and explained “remapped” the additional figure legend text:

      “the class averages were oriented and positioned in the locations of their contributing subtomograms”.

      Supplementary figures:

      Figure S3: It is unclear what you mean with "two types of BY4741 nucleosomes". You then say that the canonical nucleosomes are shaded blue. So what color is then the non-canonical? All the greys? Some of them look just like random stuff, not nucleosomes.

      “Two types” is a typo and has been removed and “nucleosomes” has been replaced with “candidate nucleosome template-matching hits” to accurately reflect the particles used in classification.

      Figure S6: Top left says "3 tomograms (defocus)". I wonder if you meant to add the defocus range here. I have understood it like this is the same data as shown in Figure S5, which makes me wonder if this top cartoon should not be on top of that figure too (or exclusively there).

      To make Figures S6 (and S5) clearer, we have copied the top cartoon from Figure S6 to S5.

      Note that we corrected a typo for these figures (and the Table S7): the number of template-matched candidate nucleosomes should be 93,204, not 62,428.

      The description in the parentheses (defocus) is shorthand for defocus phase contrast and was not intended to also display a defocus range. All of the revised figure legends now report the meaning of both this shorthand and of the Volta phase plate (VPP).

      To help readers see the relationship between these two figures, we added the following clarifying text to the Figure S5 and S6 legends, respectively:

      “This workflow uses the same template-matched candidate nucleosomes as in Figure S6; see below.”

      “This workflow uses the same template-matched candidate nucleosomes as in Figure S5.”

      Figure S7: In the first panel, it is unclear why the featureless cylinder is shown as it is not used as a reference here. Rather, it could be put throughout where it was used and then put the simulated EM-map alone here. If left in, it should be stated in the legend that it was not used here.

      It would indeed be much clearer to show the featureless cylinder in all the other figures and leave the simulated nucleosome in this control figure. All figures are now updated. The figure legend was also updated as follows:

      “(A) A simulated EM map from a crystal structure of the nucleosome was used as the template-matching and 3-D classification reference.”

      Figure S18: Why are there classes where the GFP density is missing? Mention something about this in the figure legend.

      We have appended the following speculations to explain the “missing” GFP densities:

      “Some of the class averages are “missing” one or both expected GFP densities. The possible explanations include mobility of a subpopulation of GFPs or H2A-GFPs, incorrectly folded GFPs, or substitution of H2A for the variant histone H2A.Z.”

      Reviewer #2 (Recommendations For The Authors):

      My specific (rather minor) comments are the following:

      1) Abstract:

      yeast -> budding yeast.

      All three instances in the abstract have been replaced with “budding yeast”.

      It would be better to clarify what ex vivo means here.

      We have appended “(in nuclear lysates)” to explain the meaning of ex vivo.

      2) Some subtitles are unclear.

      e.g., "in wild-type lysates" -> "wild-type yeast lysates"

      Thank you for this suggestion. All unclear instances of subtitles and sample descriptions throughout the text have been corrected.

      3) Page 6, Line 113. "...which detects more canonical nucleosomes." A similar thing was already mentioned in the same paragraph and seems redundant.

      Thank you for noticing this redundant statement, which is now deleted.

      4) Page 25, Line 525. "However, crowding is an unlikely explanation..." Please note that many macromolecules (proteins, RNAs, polysaccharides, etc.) were lost during the nuclei isolation process.

      This is a good point. We have rewritten this paragraph to separate the discussion on technical versus biological effects of crowding, in lines 538 – 546:

      “Another hypothesis for the low numbers of detected canonical nucleosomes is that the nucleoplasm is too crowded, making the image processing infeasible. However, crowding is an unlikely technical limitation because we were able to detect canonical nucleosome class averages in our most-crowded nuclear lysates, which are so crowded that most nucleosomes are butted against others (Figures S15 and S16). Crowding may instead have biological contributions to the different subtomogram-analysis outcomes in cell nuclei and nuclear lysates. For example, the crowding from other nuclear constituents (proteins, RNAs, polysaccharides, etc.) may contribute to in situ nucleosome structure, but is lost during nucleus isolation.”

      5) Page 7, Line 126. "The subtomogram average..." Is there any explanation for this?

      Presumably, the longer linker DNA length corresponds to the ordered portion of the ~22 bp linker between consecutive nucleosomes, given the ~168 bp nucleosome repeat length. We have appended the following explanation as the concluding sentence, lines 137 – 140:

      “Because the nucleosome-repeat length of budding yeast chromatin is ~168 bp (Brogaard et al., 2012), this extra length of DNA may come from an ordered portion of the ~22 bp linker between adjacent nucleosomes.”

      6) "Histone GFP-tagging strategy" subsection:

      Since this subsection is a bit off the mainstream of the paper, it can be shortened and merged into the next one.

      We have merged the “Histone GFP-tagging strategy” and “GFP is detectable on nucleosome subtomogram averages ex vivo” subsections and shortened the text as much as possible. The new subsection is entitled “Histone GFP-tagging and visualization ex vivo”

      7) Page 16, Line 329. "Because all attempts to make H3- or H4-GFP "sole source" strains failed..." Is there a possible explanation here? Cytotoxic effect because of steric hindrance of nucleosomes?

      Yes, it is possible that the GFP tag is interfering with the nucleosomes interactions with its numerous partners. It is also possible that the histone-GFP fusions do not import and/or assemble efficiently enough to support a bare-minimum number of functional nucleosomes. Given that the phenotypic consequences of fusion tags is an underexplored topic and that we don’t have any data on the (dead) transformants, we would prefer to leave out the speculation about the cause of death in the attempted creation of “sole source” strains.

    2. Author Response

      eLife assessment

      This important paper exploits new cryo-EM tomography tools to examine the state of chromatin in situ. The experimental work is meticulously performed and convincing, with a vast amount of data collected. The main findings are interpreted by the authors to suggest that the majority of yeast nucleosomes lack a stable octameric conformation. Despite the possibly controversial nature of this report, it is our hope that such work will spark thought-provoking debate, and further the development of exciting new tools that can interrogate native chromatin shape and associated function in vivo.

      We thank the Editors and Reviewers for their thoughtful and helpful comments. We also appreciate the extraordinary amount of effort needed to assess both the lengthy manuscript and the previous reviews. Below, we provide our provisional responses in bold blue font. The majority of the comments are straightforward to address. We have taken a more conservative approach with the subset of comments that would require us to speculate because we either lack key information or we lack technical expertise. Instead of adding the speculative replies to the main text, we think it will be better to leave them in the rebuttal for posterity. Readers will therefore have access to our speculation and know that we did not feel confident enough to include these thoughts in the Version of Record.

      Reviewer #1 (Public Review):

      This manuscript by Tan et al is using cryo-electron tomography to investigate the structure of yeast nucleosomes both ex vivo (nuclear lysates) and in situ (lamellae and cryosections). The sheer number of experiments and results are astounding and comparable with an entire PhD thesis. However, as is always the case, it is hard to prove that something is not there. In this case, canonical nucleosomes. In their path to find the nucleosomes, the authors also stumble over new insights into nucleosome arrangement that indicates that the positions of the histones is more flexible than previously believed.

      We want to point out that canonical nucleosomes are there in wild-type cells in situ, albeit rarer than what’s expected based on our HeLa cell analysis. The negative result (absence of any canonical nucleosome classes in situ) was found in the histone-GFP mutants.

      Major strengths and weaknesses:

      Personally, I am not ready to agree with their conclusion that heterogenous non-canonical nucleosomes predominate in yeast cells, but this reviewer is not an expert in the field of nucleosomes and can't judge how well these results fit into previous results in the field. As a technological expert though, I think the authors have done everything possible to test that hypothesis with today's available methods. One can debate whether it is necessary to have 35 supplementary figures, but after working through them all, I see that the nature of the argument needs all that support, precisely because it is so hard to show what is not there. The massive amount of work that has gone into this manuscript and the state-of-the art nature of the technology should be warmly commended. I also think the authors have done a really great job with including all their results to the benefit of the scientific community. Yet, I am left with some questions and comments:

      Could the nucleosomes change into other shapes that were predetermined in situ? Could the authors expand on if there was a structure or two that was more common than the others of the classes they found? Or would this not have been found because of the template matching and later reference particle used?

      Our best guess (speculation) is that one of the class averages that is smaller than the canonical nucleosome contains one or more non-canonical nucleosome classes. We do not feel confident enough to single out any of these classes precisely because we do not yet know if they arise from one non-canonical nucleosome structure or from multiple – and therefore mis-classified – non-canonical nucleosome structures (potentially with other non-nucleosome complexes mixed in). We feel it is better to leave this discussion out of the manuscript, or risk sending the community on wild goose chases.

      Our template-matching workflow uses a low-enough cross-correlation threshold that any nucleosome-sized particle (plus minus a few nanometers) would be picked, which is why the number of hits is so large. So unless the noncanonical nucleosomes quadrupled in size or lost most of their histones, they should be grouped with one or more of the other 99 class averages (WT cells) or any of the 100 class averages (cells with GFP-tagged histones). As to whether the later reference particle could have prevented us from detecting one of the non-canonical nucleosome structures, we are unable to tell because we’d really have to know what an in situ non-canonical nucleosome looks like first.

      Could it simply be that the yeast nucleoplasm is differently structured than that of HeLa cells and it was harder to find nucleosomes by template matching in these cells? The authors argue against crowding in the discussion, but maybe it is just a nucleoplasm texture that side-tracks the programs?

      Presumably, the nucleoplasmic “side-tracking” texture would come from some molecules in the yeast nucleus. These molecules would be too small to visualize as discrete particles in the tomographic slices, but they would contribute textures that can be “seen” by the programs – in particular RELION, which does the discrimination between structural states. We do not know the inner-workings of RELION well enough to say what kinds of density textures would side-track its classification routines.

      The title of the paper is not well reflected in the main figures. The title of Figure 2 says "Canonical nucleosomes are rare in wild-type cells", but that is not shown/quantified in that figure. Rare is comparison to what? I suggest adding a comparative view from the HeLa cells, like the text does in lines 195-199. A measure of nucleosomes detected per volume nucleoplasm would also facilitate a comparison.

      Figure 2’s title is indeed unclear and does not align with the paper’s title and key conclusion. The rarity here is relative to the expected number of nucleosomes (canonical plus non-canonical). We have changed the title to “Canonical nucleosomes are a minority of the expected total in wild-type cells”. We would prefer to leave the reference to HeLa cells to the main text instead of as a figure panel because the comparison is not straightforward for a graphical presentation. Instead, we will report the total number of nucleosomes estimated for this particular tomogram (~7,600) versus the number of canonical nucleosomes classified (297; 594 if we assume we missed half of them).

      If the cell contains mostly non-canonical nucleosomes, are they really non-canonical? Maybe a change of language is required once this is somewhat sure (say, after line 303).

      This is an interesting semantic and philosophical point. From the yeast cell’s “perspective”, the canonical nucleosome structure would be the form that is in the majority. That being said, we do not know if there is one structure that is the majority. From the chromatin field’s point of view, the canonical nucleosome is the form that is most commonly seen in all the historical – and most contemporary – literature, namely something that resembles the crystal structure of Luger et al, 1997. Given these two lines of thinking, we will add the following clarification after line 303:

      “At present, we do not know what the non-canonical nucleosome structures are, meaning that we cannot even determine if one non-canonical structure is the majority. Until we know what the family of non-canonical nucleosome structures are, we will use the term non-canonical to describe the nucleosomes that do not have the canonical (crystal) structure”.

      The authors could explain more why they sometimes use conventional the 2D followed by 3D classification approach and sometimes "direct 3-D classification". Why, for example, do they do 2D followed by 3D in Figure S5A? This Figure could be considered a regular figure since it shows the main message of the paper.

      Because the classification of subtomograms in situ is still a work in progress, we felt it would be better to show one instance of 2-D classification for lysates and one for lamellae. While it is true that we could have presented direct 3-D classification for the entire paper, we anticipate that readers will be interested to see what the in situ 2-D class averages look like.

      The main message is that there are canonical nucleosomes in situ (at least in wild-type cells), but they are a minority. Therefore, the conventional classification for Figure S5A should not be a main figure because it does not show any canonical nucleosome class averages in situ.

      Figure 1: Why is there a gap in the middle of the nucleosome in panel B? The authors write that this is a higher resolution structure (18Å), but in the even higher resolution crystallography structure (3Å resolution), there is no gap in the middle.

      There is a lower concentration of amino acids at the middle in the disc view; unfortunately, the space-filling model in Figure 1A hides this feature. The gap exists in experimental cryo-EM density maps. See below for an example. The size of the gap depends on the contour level and probably the contrast mechanism, as the gap is less visible in the VPP subtomogram averages. To clarify this confusing phenomenon, we will add the following lines to the figure legend:

      “The gap in the disc view of the nuclear-lysate-based average is due to the lower concentration of amino acids there, which is not visible in panel A due to space-filling rendering. This gap’s size may depend on the contrast mechanism because it is not visible in the VPP averages.”

      Reviewer #2 (Public Review):

      Nucleosome structures inside cells remain unclear. Tan et al. tackled this problem using cryo-ET and 3-D classification analysis of yeast cells. The authors found that the fraction of canonical nucleosomes in the cell could be less than 10% of total nucleosomes. The finding is consistent with the unstable property of yeast nucleosomes and the high proportion of the actively transcribed yeast genome. The authors made an important point in understanding chromatin structure in situ. Overall, the paper is well-written and informative to the chromatin/chromosome field.

      We thank Reviewer 2 for their positive assessment.

      Reviewer #3 (Public Review):

      Several labs in the 1970s published fundamental work revealing that almost all eukaryotes organize their DNA into repeating units called nucleosomes, which form the chromatin fiber. Decades of elegant biochemical and structural work indicated a primarily octameric organization of the nucleosome with 2 copies of each histone H2A, H2B, H3 and H4, wrapping 147bp of DNA in a left handed toroid, to which linker histone would bind.

      This was true for most species studied (except, yeast lack linker histone) and was recapitulated in stunning detail by in vitro reconstitutions by salt dialysis or chaperone-mediated assembly of nucleosomes. Thus, these landmark studies set the stage for an exploding number of papers on the topic of chromatin in the past 45 years.

      An emerging counterpoint to the prevailing idea of static particles is that nucleosomes are much more dynamic and can undergo spontaneous transformation. Such dynamics could arise from intrinsic instability due to DNA structural deformation, specific histone variants or their mutations, post-translational histone modifications which weaken the main contacts, protein partners, and predominantly, from active processes like ATP-dependent chromatin remodeling, transcription, repair and replication.

      This paper is important because it tests this idea whole-scale, applying novel cryo-EM tomography tools to examine the state of chromatin in yeast lysates or cryo-sections. The experimental work is meticulously performed, with vast amount of data collected. The main findings are interpreted by the authors to suggest that majority of yeast nucleosomes lack a stable octameric conformation. The findings are not surprising in that alternative conformations of nucleosomes might exist in vivo, but rather in the sheer scale of such particles reported, relative to the traditional form expected from decades of biochemical, biophysical and structural data. Thus, it is likely that this work will be perceived as controversial. Nonetheless, we believe these kinds of tools represent an important advance for in situ analysis of chromatin. We also think the field should have the opportunity to carefully evaluate the data and assess whether the claims are supported, or consider what additional experiments could be done to further test the conceptual claims made. It is our hope that such work will spark thought-provoking debate in a collegial fashion, and lead to the development of exciting new tools which can interrogate native chromatin shape in vivo. Most importantly, it will be critical to assess biological implications associated with more dynamic - or static forms- of nucleosomes, the associated chromatin fiber, and its three-dimensional organization, for nuclear or mitotic function.

      Thank you for putting our work in the context of the field’s trajectory. We hope our EMPIAR entry, which includes all the raw data used in this paper, will be useful for the community. As more labs (hopefully) upload their raw data and as image-processing continues to advance, the field will be able to revisit the question of non-canonical nucleosomes in budding yeast and other organisms.

    1. Author Response

      The following is the authors’ response to the original reviews.

      Public Reviews:

      Reviewer #1 (Public Review):

      Trebino et al. investigated the BRAF activation process by analysing the interactions of BRAF N-terminal regulatory regions (CRD, RBD, and BSR) with the C-terminal kinase domain and with the upstream regulators HRAS and KRAS. To this end, they generated four constructs comprising different combinations of N-terminal domains of BRAF and analysed their interaction with HRAS as well as conformational changes that occur. By HDX-MS they confirmed that the RBD is indeed the main mediator of interaction with HRAS. Moreover, they observed that HRAS binding leads to conformational changes exposing the BSR to the environment. Next, the authors used OpenSPR to determine the binding affinities of HRAS to the different BRAF constructs. While BSR+RBD, RBD+CRD, and RBD bound HRAS with nanomolar affinity, no binding was observed with the construct comprising all three domains. Based on these experiments, the authors concluded that BSR and CRD negatively regulate binding to HRAS and hypothesised that BSR may confer some RAS isoform specificity. They corroborated this notion by showing that KRAS bound to BRAF-NT1 (BSR+RBD+CRD) while HRAS did not. Next, the authors analysed the autoinhibitory interaction occurring between the N-terminal regions and the kinase domain. Through pulldown and OpenSPR experiments, they confirm that it is mainly the CRD that makes the necessary contacts with the kinase domain. In addition, they show that the BSR stabilizes these interactions and that the addition of HRAS abolishes them. Finally, the D594G mutation within the KD of BRAF is shown to destabilise these autoinhibitory interactions, which could explain its oncogenic potential.

      Overall, the in vitro study provides new insights into the regulation of BRAF and its interactions with HRAS and KRAS through a comprehensive in vitro analysis of the BRAF N-terminal region. Also, the authors report the first KD values for the N- and C-terminal interactions of BRAF and show that the BSR might provide isoform specificity towards KRAS. While these findings could be useful for the development of a new generation of inhibitors, the overall impact of the manuscript could probably be enhanced if the authors were to investigate in more detail how the BSR-mediated specificity of BRAF towards certain RAS isoforms is achieved. Moreover, though the very "clean" in vitro approach is appreciated, it also seems useful to examine whether the observed interactions and conformational changes occur in the full-length BRAF molecule and in more physiological contexts. Some of the results could be compared with studies including full-length constructs.

      Public Response: We would like to express our gratitude for your valuable feedback on our manuscript. Your insightful suggestions have significantly improved the quality and completeness of our research. In response to your comments, we have conducted additional experiments and incorporated new data into the revised manuscript.

      To gain a deeper understanding of how the BSR-mediated specificity of BRAF towards certain RAS isoforms is achieved, we performed HDX-MS to investigate the impact of KRAS interactions on the BSR. Our findings indicate that when KRAS is bound to BRAF NT2, there is no significant difference in hydrogen-deuterium exchange rates in the BSR compared to the apo-NT2 state (Figure 4). This observation contrasts with the effect of HRAS binding, where peptides from the BRAF-BSR exhibit an increased rate change, suggesting that HRAS induces a conformationally more dynamic state (Figure 2).

      Our results align with the conclusions of Terrell et al. in their 2019 publication, which propose that isoform preferences in the RAS-RAF interaction are driven by opposite charge attractions between BRAF-BSR and KRAS-HVR, promoting the interaction.1 Our data offers a potential mechanistic explanation, suggesting that HRAS disrupts the conformational stability of the BSR provided by the RBD, while KRAS-HVR restores stability and enhances interaction favorability. It is important to note that our results do not directly confirm a long-lasting interaction between the BRAF-BSR and KRAS-HVR, but they do not rule out the possibility of a transient, low-affinity interaction or close proximity between the two.

      Furthermore, our binding kinetics measurements conducted using OpenSPR support these findings. Particularly, in the case of NT1, when the CRD accompanies the BSR and RBD, no interactions with HRAS were observed. Additionally, we quantified the binding affinities between NT3:KRAS and NT4:KRAS, demonstrating that they are equally strong and that the presence of the BSR or CRD does not singularly affect the primary RBD interaction, consistent with HRAS. The BSR appears to exert an inhibitory effect on HRAS when the entire N-terminal region (BSR+RBD+CRD) is present. The BSR-mediated specificity is achieved through a coordinated interplay with the CRD.

      Moreover, we have addressed your concern regarding the physiological relevance of our conclusions. In response, we utilized active, full-length (FL) BRAF purified from HEK293F cells in OpenSPR experiments. Our findings indicate that FL-BRAF behaves similarly to BRAF-NT1, as it does not bind to HRAS but binds to KRAS with a deviation comparable to NT1. We have demonstrated that post-translational modifications or native intramolecular interactions do not alter our initial results. Several literature sources, employing cell systems or expressing proteins from insect or mammalian cells, further support the findings presented in our study.2–5

      Thank you once again for your constructive feedback, which has contributed significantly to the refinement of our work.

      For the author:

      Major points:

      1. Figure 1D: Negative control is missing.

      Response: We have incorporated the negative control into this figure as suggested.

      1. Figure 3F and G: negative controls (GST only) are missing.

      Response: We have incorporated the negative control into this figure as suggested.

      1. The authors demonstrate that BRAF NT1 (BSR+RBD+CRD) interacts with KRAS but not HRAS in SPR experiments (Figure 4). What about the conformational change that affects the positioning of BSR when NT2 (BSR+RBD) binds to HRAS (Figure 2)? Does it also occur with KRAS or not? When a rate change is observed between free protein and bound protein in HDX, particularly when this rate change results in a sigmoidal curve that closely parallels the reference curve, it signifies that all residues within the peptide share a uniform protection factor. This suggests that they collectively undergo conformational changes at the same rate, likely due to a concerted opening as a cohesive unit. In the context of our time plots, we observe this distinctive characteristic in the curves derived from the BSR peptides, indicating that HRAS binding perturbs this region, alters its flexibility, and induces a coordinated conformational shift. This compelling evidence strongly supports our assertion that HRAS instigates a reorientation of the BSR.

      Response: In response to the reviewer's comments, we conducted additional experiments to explore whether KRAS elicits any comparable alterations in the H-D exchange of the BSR within BRAF-NT2. Our findings indicate that KRAS does not induce a similar conformational change in the BSR. We have detailed these results in the Results section under the heading "BSR Differentiates the BRAF-KRAS Interaction from the BRAF-HRAS Interaction" and have included corresponding panels in Figure 4 to visually illustrate these observations.

      1. Related to point 3: The authors mention that the HVR domain is responsible for isoform-specific differences. Does the BSR interact with the HVR domain of KRAS (but not HRAS)?

      Response: It has been suggested by Terrell and colleagues1 that the BRAF-BSR and KRASHVR are directly responsible for the isoform specific interactions. We have no direct evidence confirming an interaction between the HVR and BSR. However, we deduce the possibility of such interaction based on previous research findings. Our HDX-MS experiments have demonstrated that the BRAF-BSR does not engage with HRAS. In our new HDX-MS experiments involving KRAS, we observed that the presence of KRAS does not lead to any discernible increase or decrease in the rate of deuterium exchange within the BRAF-BSR. It is important to emphasize that the absence of a rate change does not necessarily negate the occurrence of binding; rather, it might indicate a transient interaction with an affinity level below the detection threshold of HDX-MS.

      Given that the only major difference between H- and K-RAS isoforms is the HVR, we hypothesize that binding differences between BRAF and RAS isoforms can be attributed to the HVR. Notably, BRAF-NT3 resembles CRAF, which also behaves in line with the findings from Terrell et al. in which the BSR is not present to impact RAS-RAF association. We have updated some of the discussion section to include the new results and draw relevant conclusion.

      We mention in the text in the results section, “The HVR is an important region for regulating RAS isoform differences, like membrane anchoring, localization, RAS dimerization, and RAF interactions6… These results, combined with HDX-MS results, which showed that the BSR is exposed when bound to HRAS, suggest that the electrostatic forces surrounding the BSR promote BRAF autoinhibition and the specificity of RAF-RAS interactions.”

      We also write in the discussion, “However, BRET assays suggest that CRAF does not show preference for either H- or KRAS, while BRAF appears to prefer KRAS.1 This preference is suggested to result from the potential favorable interactions between the negatively charged BSR of BRAF and the positively charged, poly-lysine region of the HVR of KRAS1… Our binding data provide additional examples of isoform-specific activity. We speculate that diminished BRAF-NT1 binding to HRAS and increased BSR exposure upon HRAS binding may be due to electrostatic repulsion between HRAS and the BSR. Our full-length KRAS and its interaction with NT1 support the hypothesis that the BSR attenuates fast binding to HRAS but not to KRAS.”

      1. The authors might consider including NRAS in their study to give more weight to this interesting aspect.

      Response: While this suggestion is intriguing and could contribute to the expanding body of literature on RAS signaling, particularly in the context of NRAS-mutant tumors, we believe that delving into this topic would be beyond the scope of the present manuscript.

      1. Figure 6A: In this pulldown experiment the authors wish to demonstrate that binding of HRAS abolishes the autoinhibitory binding between NT1 and the kinase domain. However, the experimental design (i.e., pulldown of RAS) does not allow us to assess whether NT1 and KD are bound to each other in these conditions at all. The authors should rather pull down the KD and show that the interaction with NT1 is abolished when RAS is added.

      Response: We appreciate your suggestion. The experimental design for this study was intentionally structured to focus on the specific subset of NT1 that interacts with HRAS. The BRAF N-terminal region has the capacity to bind both HRAS and KD, resulting in two distinct populations within BRAF-NT1: NT1:KD and NT1:HRAS, although we believe the ratio between those two populations is not 1:1. If we were to design the experiment by isolating either the KD or NT1, it would lead to the observation of both populations simultaneously, making it challenging to distinguish between them. Our pulldown experiments are performed under the same conditions (i.e. all the proteins were maintained in a molar ratio of 1:1 and exposed to the same buffer components), and we rely on pulldown assays, such as those depicted in Figure 5, to clearly demonstrate the binding interactions between NT1 and KD.

      1. The authors have chosen a purely in vitro approach for their interaction studies, which initially makes sense for the addressed questions. However, since the BRAF constructs studied are only fragments and neither BRAF nor K/HRAS has any posttranslational modifications, the question arises to what extent the findings obtained hold up in vivo. Therefore, the manuscript would greatly benefit from monitoring the described interactions in full-length proteins and in cells or at least with proteins purified from cells.

      Response: Thank you for your valuable suggestion, which we take very seriously to enhance the quality of our manuscript. Upon carefully reviewing your comments, we conducted additional experiments involving full-length, wild-type BRAF (FL-BRAF) that was purified from mammalian cells, encompassing the post-translational modifications and scaffolding proteins such as 14-3-3 (Supplementary Fig 8A). We have incorporated the findings from these OpenSPR experiments into the revised manuscript within the Results Section titled "BSR Differentiates the BRAF-KRAS Interaction from the BRAFHRAS Interaction" and Figure 4. In summary, our results with FL-BRAF affirm the extension of our initial observations. Both NT1 and FL-BRAF interact with KRAS with comparable affinities, and neither NT1 nor FL-BRAF demonstrates an interaction with HRAS using OpenSPR. These results underscore that BRAF fragments accurately represent active, fully processed BRAF, lending support to our in vitro approach.

      Moreover, the conserved interactions we report in this manuscript are supported by literature. The interaction between RAF-RBD and RAS has been extensively documented, spanning investigations conducted in both insect and mammalian cell lines. For instance, Tran et al. (2021) utilized mammalian expression systems to explore the role of RBD in mediating BRAF activation through RAS interaction, identifying the same binding surfaces that we highlighted using HDX-MS.2 They quantified the KRAS-CRAF interaction yielding binding affinities in the low nanomolar range, similar to our findings for BRAF-NT:KRAS OpenSPR.2 In the manuscript text, we compared the binding affinity of BRAF residues 1245 purified from insect cells3 to our BRAF 1-227 (NT2 from E. coli), noting that the published value falls within the standard deviation of our experimental value. Additionally, our results align with the autoinhibited FL-BRAF:MEK:14-3-3 structure, which was expressed in Sf9 insect cells and reveals the central role of the CRD in maintaining autoinhibition through interactions with KD.4 In 2005, Tran and colleagues revealed specific domains within the BRAF N-terminal region are involved in binding to KD through Co-IP experiments conducted in mammalian cells.5

      While we are fully aware of the limitations of taking a purely in vitro approach to study the role of BRAF regulatory domains in RAS-RAF interactions and autoinhibition, as well as to quantify the affinity of these interactions, we emphasize that this approach enables us to dissect and examine the specific regions of RAF that are under investigation. As we write in the manuscript: “Our in vitro studies were conducted using proteins purified from E. coli, which lack the membrane, post-translational modifications, and regulatory, scaffolding, or chaperone proteins that are involved in BRAF regulation. Nonetheless, our study provides a direct characterization of the intra- and inter-molecular protein-protein interactions involved in BRAF regulation, without the complications that arise in cell-based assays.” We have added the following comment to clarify the advantages of our in vitro approach and the challenges associated with cell-based assays: “… without the complications and false-positives that can arise in cell-based assays, which often cannot distinguish between proximity and biochemical interactions.”

      Once again, we appreciate your insight feedback, which has contributed significantly to the improvement of our manuscript.

      Minor:

      1. Page 7, paragraph 2, line 6: It should probably read "BRAF autoinhibition" not "BRAF autoinhibitory".

      Response: Thank you for bringing this to our attention. We have fixed this typo.

      1. Figure 3G: In the first lane (time point 0 min) there is no input band for His/MBP-NT1. Probably a mistake when cropping the image from the original photo.

      Response: We sincerely appreciate your diligence in identifying cropping errors, and we have taken comprehensive measures to review the manuscript and correct any such errors. Regarding this specific figure, it is important to note that NT1 was not added at the "0" minute time point, which explains the absence of an input band at that stage. To avoid any confusion, we have revised the notation from "0" to "-" for clarity.

      Reviewer #2 (Public Review):

      In the manuscript entitled 'Unveiling the Domain-Specific and RAS Isoform-Specific Details of BRAF Regulation', the authors conduct a series of in vitro experiments using Nterminal and C-terminal BRAF fragments (SPR, HDX-MS, pull-down assays) to interrogate BRAF domain-specific autoinhibitory interactions and engagement by H- and KRAS GTPases. Of the three RAF isoforms, BRAF contains an extended N-terminal domain that has yet to be detected in X-ray and cryoEM reconstructions but has been proposed to interact with the KRAS hypervariable region. The investigators probe binding interactions between 4 N-terminal (NT) BRAF fragments (containing one more NT domain (BRS, RBD, and CRD)), with full-length bacterial expressed HRAS, KRAS as well as two BRAF C-terminal kinase fragments to tease out the underlying contribution of domainspecific binding events. They find, consistent with previous studies, that the BRAF BSR domain may negatively regulate RAS binding and propose that the presence of the BSR domain in BRAF provides an additional layer of autoinhibitory constraints that mediate BRAF activity in a RAS-isoform-specific manner. One of the fragments studied contains an oncogenic mutation in the kinase domain (BRAF-KDD594G). The investigators find that this mutant shows reduced interactions with an N-terminal regulatory fragment and postulate that this oncogenic BRAF mutant may promote BRAF activation by weakening autoinhibitory interactions between the N- and C-terminus.

      While this manuscript sheds light on B-RAF specific autoinhibitory interactions and the identification and partial characterization of an oncogenic kinase domain (KD) mutant, several concerns exist with the vitro binding studies as they are performed using taggedisolated bacterial expressed fragments, 'dimerized' RAS constructs, lack of relevant citations, controls, comparisons and data/error analysis. Detailed concerns are listed below.

      1. Bacterial-expressed truncated BRAF constructs are used to dissect the role of individual domains in BRAF autoinhibition. Concerns exist regarding the possibility that bacterial expression of isolated domains or regions of BRAF could miss important posttranslational modifications, intra-molecular interactions, or conformational changes that may occur in the context of the full-length protein in mammalian cells. This concern is not addressed in the manuscript.

      Response: Reviewer 1 raised a similar concern, and we have duplicated our response below for your reference:

      Thank you for your valuable suggestion, which we take very seriously to enhance the quality of our manuscript. Upon carefully reviewing your comments, we conducted additional experiments involving full-length, wild-type BRAF (FL-BRAF) that was purified from mammalian cells, encompassing the post-translational modifications and scaffolding proteins such as 14-3-3 (Supplementary Fig 8A). We have incorporated the findings from these OpenSPR experiments into the revised manuscript within the Results Section titled "BSR Differentiates the BRAF-KRAS Interaction from the BRAF-HRAS Interaction" and Figure 4. In summary, our results with FL-BRAF affirm the extension of our initial observations. Both NT1 and FL-BRAF interact with KRAS with comparable affinities, and neither NT1 nor FL-BRAF demonstrates an interaction with HRAS using OpenSPR. These results underscore that BRAF fragments accurately represent active, fully processed BRAF, lending support to our in vitro approach.

      Moreover, the conserved interactions we report in this manuscript are supported by literature. The interaction between RAF-RBD and RAS has been extensively documented, spanning investigations conducted in both insect and mammalian cell lines. For instance, Tran et al. (2021) utilized mammalian expression systems to explore the role of RBD in mediating BRAF activation through RAS interaction, identifying the same binding surfaces that we highlighted using HDX-MS.2 They quantified the KRAS-CRAF interaction yielding binding affinities in the low nanomolar range, similar to our findings for BRAF-NT:KRAS OpenSPR.2 In the manuscript text, we compared the binding affinity of BRAF residues 1245 purified from insect cells3 to our BRAF 1-227 (NT2 from E. coli), noting that the published value falls within the standard deviation of our experimental value. Additionally, our results align with the autoinhibited FL-BRAF:MEK:14-3-3 structure, which was expressed in Sf9 insect cells and reveals the central role of the CRD in maintaining autoinhibition through interactions with KD.4 In 2005, Tran and colleagues revealed specific domains within the BRAF N-terminal region are involved in binding to KD through Co-IP experiments conducted in mammalian cells.5

      While we are fully aware of the limitations of taking a purely in vitro approach to study the role of BRAF regulatory domains in RAS-RAF interactions and autoinhibition, as well as to quantify the affinity of these interactions, we emphasize that this approach enables us to dissect and examine the specific regions of RAF that are under investigation. As we write in the manuscript: “Our in vitro studies were conducted using proteins purified from E. coli, which lack the membrane, post-translational modifications, and regulatory, scaffolding, or chaperone proteins that are involved in BRAF regulation. Nonetheless, our study provides a direct characterization of the intra- and inter-molecular protein-protein interactions involved in BRAF regulation, without the complications that arise in cell-based assays.” We have added the following comment to clarify the advantages of our in vitro approach and the challenges associated with cell-based assays: “… without the complications and false-positives that can arise in cell-based assays, which often cannot distinguish between proximity and biochemical interactions.”

      Once again, we appreciate your insight feedback, which has contributed significantly to the improvement of our manuscript.

      1. The experiments employ BRAF NT constructs that retain an MBP tag and RAS proteins with a GST tag. Have the investigators conducted control experiments to verify that the tags do not induce or perturb native interactions?

      Response: Thank you for highlighting this important issue. We have conducted control experiments whenever feasible, particularly in cases where tags were not required for visualization, immobilization, or where cleave sites were present. We have subsequently included these control experiments in the supplementary figures and accompanying text within the manuscript.

      It is essential to note that many of the techniques employed in this manuscript rely on tags, such as immobilizing proteins onto NTA OpenSPR sensors and employing various resins/beads for pulldown assays. Utilizing tags for protein immobilization in OpenSPR applications offers distinct advantages, including homogeneous and site-specific immobilization of the protein, ensuring that binding sites remain accessible for the study of protein-protein interactions (PPIs) of interest. Furthermore, in all BRAF-RAS SPR experiments, the MBP protein serves as the reference channel "blocking" protein. This reference channel is instrumental in mitigating any potential false-positive signals resulting from binding interactions with the MBP protein. Any such signal is subsequently subtracted out during data analysis.

      To provide a comprehensive understanding of these aspects, we have incorporated these details into the manuscript text for clarity:

      “Maltose bind protein (MBP) is immobilized on the OpenSPR reference channel, which accounts for any non-specific binding or impacts to the native PPIs that may result from the presence of tags. Kinetic analysis is performed on the corrected binding curves, which subtracts any response in the reference channel.”

      We describe the control experiment to examine whether His/MBP-tag affects NT1 binding with BRAF-KD: “Similarly, we removed the His/MBP-tag from BRAF-NT1 through a TEV protease cleavage reaction and flowed over untagged NT1. Kinetic analysis confirmed that the interaction is preserved with the KD=13 nM (Supplemental Figure 6F).”

      We show that the GST-tag does not affect KRAS interactions with NTs in supplemental figure 6. We purified full-length, His/MBP-KRAS and subsequently removed the tag through TEV cleavage. BRAF-NT interactions are preserved with untagged KRAS. GST alone, also does not interact with BRAF-NTs. We updated the text in the results section “BSR differentiates the BRAF-KRAS interaction from the BRAF-HRAS interaction.”

      Additionally, Vojtek and colleagues used the same fusion-protein combinations (GSTRAS and MBP-RAF) in pulldown experiments and also found no perturbations from these tags.8

      1. The investigators state that the GST tag on the RAS constructs was used to promote RAS dimerization, as RAS dimerization is proposed to be key for RAF activation. However, recent findings argue against the role of RAS dimers in RAF dimerization and activation (Simanshu et al, Mol. Cell 2023). Moreover, while GST can dimerize, it is unclear whether this promotes RAS dimerization as suggested. In methods for the OpenSPR experiments probing NT BRAF:RAS interactions, it is stated that "monomeric KRAS was flowed...". This terminology is a bit confusing. How was the monomeric state of KRAS determined and what was the rationale behind the experiment? Is there a difference in binding interactions between "monomeric vs dimeric KRAS"?

      Response: Thank you for conducting such a comprehensive review of our manuscript and for identifying the mention of "monomeric KRAS" in the experimental section, which was inadvertently included and should not have been present. This terminology originally referred to a series of experiments involving "monomeric" KRAS that were initially considered for inclusion in the main body of the manuscript but were subsequently removed before submission. Furthermore, we adjusted the terminology to prevent any confusion or unwarranted implications.

      To clarify, this "monomeric" construct refers to the tagless, full-length KRAS variant that was confirmed to exist in a monomeric state through Size Exclusion Chromatography, eluting at a volume equivalent to 21 kDa. We have incorporated the findings from experiments involving this untagged KRAS variant into the supplementary figures to provide supporting evidence, particularly in response to comment #2, that the GST-tag does not interfere with native interactions. Supplementary Figure 1 illustrates that both GST-HRAS (45 kDa) and GST-KRAS (45 kDa) elute as dimers in solution, at approximately 90 kDa. It is important to note that the main text figures primarily feature the GST-tagged, "dimeric" RAS constructs. Our research results do not suggest any significant differences between "monomeric," untagged KRAS and "dimeric" GST-tagged KRAS, indicating that the binding kinetics between RAS and RAF are not influenced by oligomerization state (Supplementary Fig 6). To mitigate any potential confusion, we have made the necessary distinctions in the text and have revised the methods description to accurately reflect these aspects.

      While the recent findings summarized by Simanshu and colleagues were published concurrently with our manuscript submission, we would like to address this comment in the following manner. The authors assert that RAS does not engage in dimerization through the G domain, a hypothesis that contrasts with certain prior research findings. Instead, they propose that the plasma membrane plays a pivotal role in the clustering of RAS. Furthermore, the authors mention the involvement of RAS "dimerization" in RAF dimerization and activation in the subsequent statements:

      “Recruitment of two RAF proteins by RAS proteins in close proximity facilitate RAF activation but are not required for RAF dimerization.”

      “However, the PM recruitment of two RAF proteins by two non-dimerized but co- localized RAS proteins would serve equally well to promote RAF dimerization. Moreover, recent work on the activation cycle of RAF dimers (ref 20–23) argues strongly against a role for RAS dimers while revealing regulation by the 14-3-3 and SHOC2-MRAS- PP1C complexes. (Ref 24)”

      The primary focus of our study centers on elucidating the intricate details of the RAS-RAF interaction and the mechanisms underlying RAF autoinhibition, rather than emphasizing RAF dimerization as the sole pathway to RAF activation. It is important to recognize that RAF activation encompasses multiple steps, including RAS-mediated relief of RAF autoinhibition.

      To mimic physiological conditions as closely as possible, we employed a GST-tag on RAS in our experiments. It's worth noting that GST has a dimerization property,9 which brings RAS molecules into close proximity to one another, effectively emulating conditions akin to the plasma membrane. Our primary objective is not solely to facilitate interactions by bringing RAS into close proximity. Instead, our aim is to replicate cellular conditions to the greatest extent feasible, especially within the predominantly in vitro framework of our studies. Furthermore, we have revised the sentence pertaining to HRAS as follows: “As verified by size exclusion chromatography (Supplementary Fig 1A), the GST-tag dimerizes and forces HRAS into close proximity to recapitulate physiological conditions. (ref. 35)”

      1. The investigators determine binding affinities between GST-HRAS and NT BRAF domains (NT2 7.5 {plus minus} 3.5; NT3 22 {plus minus} 11 nM) by SPR, and propose that the BRS domain has an inhibitory role HRAS interactions with the RAF NT. However, it is unclear whether these differences are statistically meaningful given the error.

      Response: Thank you for bringing up this matter for further discussion. We are fully aware that these distinctions (NT2 and NT3), considering the overlapping error, lack statistical significance. Our conclusion points toward the most notable differences occurring when comparing NT1 to either NT2 or NT3, highlighting that the presence of the BSR has an inhibitory effect, particularly when the CRD is also present. It's important to note that we did not directly compare NT2 and NT3 to each other. Our comparison primarily elucidates that BSR without the CRD, and conversely, CRD without the BSR, do not exhibit the inhibitory effect. This collective evidence leads to the conclusion that all three domains collaboratively play a role in negatively regulating BRAF against HRAS.

      1. It is unclear why NT1 (BSR+RBD+CRD) was not included in the HDX experiments, which makes it challenging to directly compare and determine specific contributions of each domain in the presence of HRAS. Including NT1 in the experimental design could provide a more comprehensive understanding of the interplay between the domains and their respective roles in the HRAS-BRAF interaction. Further, excluding certain domains from the constructs, such as the BSR or CRD, may overlook potential domain-domain interactions and their influence on the conformational changes induced by HRAS binding.

      Response: We acknowledge that incorporating NT1 into the HDX experiments would have provided clearer insights into the specific contributions of each domain. Originally, it was our intention to include NT1 in these experiments. Unfortunately, we encountered challenges with the HDX experiments when it came to BRAF-NT1, as it yielded a significantly low sequence coverage after MS/MS analysis. We made multiple attempts to address this issue, which included additional protein purifications involving reducing agents, increasing the concentration of reaction buffer components, and extending the incubation time with reducing agents before injection. Despite these efforts, we were unable to obtain the desired sequence coverage for NT1. Consequently, we switched our approach to analyze NT2 and NT3 as the next best alternative.

      1. The authors perform pulldown experiments with BRAF constructs (NT1: BSR+RBD+CRD, NT2: BSR+RBD, NT3: RBD+CRD, NT4: RBD alone), in which biotinylated BRAF-KD was captured on streptavidin beads and probed for bound His/MBP-tagged BRAF NTs. Western blot results suggest that only NT1 and NT3 bind to the KD (Figure 5). However, performing a pulldown experiment with an additional construct, CRD alone, it would help to determine whether the CRD alone is sufficient for the interaction or if the presence of the RBD is required for higher affinity binding. This additional experiment would strengthen the authors' arguments and provide further insights into the mechanism of BRAF autoinhibition.

      Response: We are grateful for this valuable suggestion, and in response, we have taken the initiative to clone and purify a CRD-only construct (NT5) to strengthen our arguments. Subsequently, we conducted OpenSPR experiments to measure the binding affinity between NT5 and KD. Our findings clearly indicate that the CRD alone is not sufficient to mediate the autoinhibitory interactions and that the presence of the RBD is indeed necessary. These results have been incorporated into Figure 5 and are described within the Results Section for enhanced clarity and support.

      1. While the investigators state that their findings indicate that H- and KRAS differentially interact with BRAF, most of the experiments are focused on HRAS, with only a subset on KRAS. As SPR & pull-down experiments are only conducted on NT1 and NT2, evidence for RAS isoform-specific interactions is weak. It is unclear why parallel experiments were not conducted with KRAS using BRAF NT3 & NT4 constructs.

      Response: We sincerely appreciate your suggestion, which has contributed to enhancing the overall robustness of the evidence regarding isoform-specific differences between H- and K-RAS. In response, we performed additional experiments involving NT3 and NT4. The outcomes of these experiments have been integrated into Figure 4, and we have provided a comprehensive description of these results within the Results section “BSR differentiates the BRAF-KRAS interaction from the BRAF-HRAS interaction” of the manuscript.

      1. The investigators do not cite the AlphaFold prediction of full-length BRAF (AFP15056-F1) or the known X-ray structure of the BRAF BRS domain. Hence, it is unclear how Alpha-Fold is used to gain new structural information, and whether it was used to predict the structure of the N-terminal regulatory or the full-length protein.

      Response: We greatly appreciate the reviewer’s commitment to upholding good scientific practices and ensuring the inclusion of relevant citations in publications. In our original manuscript, we employed the UniProt ID P15056 to reference the specific AlphaFold structure used in our study. This was clarified as follows: "Since the full-length structure of BRAF is still unresolved, we applied the AlphaFold Protein Structure Database for a model of BRAF to display the conformation of the N-terminal domains and the HDX-MS results.40,41” Additionally, we referenced AlphaFold using the two citations recommended on their website (references 35 and 36 in the original manuscript). To prevent any potential confusion in the future, we have incorporated "AF-P15056-F1," as suggested.

      We are sorry for any misunderstanding that may have arisen regarding the use of AlphaFold for gaining new structural insights. Our sole intention was to utilize AlphaFold as a tool for modeling HDX, as a full-length structure of BRAF, encompassing the entire N-terminal domain, remains unavailable. We have taken steps to clarify our objectives in the manuscript to ensure the purpose of our AlphaFold utilization is unambiguous.

      Furthermore, we wish to emphasize that our utilization of AlphaFold was never intended to exclude the known X-ray structure of the BRAF-BSR domain. In our revised text, we have added clarity to our purposes and cited the Lavoie et al. Nature publication from 2018, which provides alignment between the X-ray structure and the AlphaFold model, thereby enhancing the confidence in the latter.

      1. In HDX-MS experiments, it is unclear how the authors determine whether small differences in deuterium uptake observed for some of the peptide fragments are statistically significant, and why for some of the labeling reaction times the investigators state " {plus minus} HRAS only" for only 3 time points?

      Response: First, in reference to the question about " ‘{plus minus} HRAS only’ for only 3 time points,” we write:

      “Both constructs were incubated with and without GMPPNP-HRAS in D2O buffer for set labeling reaction times (NT3: 2 sec [NT3 ± HRAS only], 6 sec [NT3 ± HRAS only], 20 sec, 30 sec [NT3 ± HRAS only], 60 sec, 5 min, 10 min, 30 min, 90 min, 4.5 h, 15 h, and 24 h)...”

      We realize how this can be confusing. To avoid such confusion, we fixed the text to read instead:<br /> “Both constructs were incubated with and without GMPPNP-HRAS in D2O buffer for set labeling reaction times (NT3: 2 sec, 6 sec, 20 sec, 30 sec, 60 sec, 5 min, 10 min, 30 min, 90 min, 4.5 h, 15 h, 45 h and 24 h at RT; NT2: 20 sec, 60 sec, 5 min, 10 min, 30 min, 90 min, 4.5 h, 15 h, and 24 h at RT)...”

      Next, with regard to assessing significance, we determine it by closely examining a consistent trend in smooth time course plots. To establish this trend, we rely on the presence of more than four overlapping peptides, each with multiple charge states, within a specific sequence range. When we observe multiple peptides showing even a small difference in rate exchange, we can confidently infer that structural changes have taken place. This confidence stems from the inherent reliability and redundancy in the data analysis approach we have employed.11,12 It is noteworthy that our focus is primarily on reporting the binding or no binding, rather than quantifying the magnitude of exchange. As such, conducting multiple replicates or statistical testing is not deemed necessary.13,14 This is true for multiple reasons:

      1) Instead of small deuterium changes (y-axis), we are focusing on the x-axis changes, which provides a slowing factor and how much that H-D exchange rate has changed.

      • In a publication investigating the ideal HDX-MS data set, the author explains, “with the availability of high resolution HDX-MS raw data, it may be the time to shift the data analysis paradigm from determination of centroid values and presentation of deuteration levels to deconvolution of isotope envelopes and presentation of exchange rates.” 15

      • Presentation of data through rate changes provides a physical chemistry measurement, as opposed to a relative measurement with percent deuteration. For example, slowing with a factor of 10 equates to the energy in 1 kCal. By quick visual estimation, we see a slowing factor of about 2 when RAS is bound to the BRAF-RBD.

      • We made some changes to the text to clear up any confusion about measuring D uptake vs rate.

      2) Looking at sigmoidal curves only—the “smooth time course” shows that the timedependent deuterium changes are not random, artifacts, or false positives/negatives. When parallel sigmoidal curves are present, any x-axis change is a measure of H-D exchange. Only plots with a smooth time course are used to make conclusions about BRAF’s conformational changes or binding interfaces.

      3) Wide time range- the extended time also confirms that any observed difference is reliable and accurate. This extended time frame provides coverage for deuteration levels from 0 to 100% for peptides. A smooth time course is present in complete coverage.

      • A narrow time window is a common flaw in HDX-MS studies14,15

      4) The rate change is observed at multiple time points (at least 4 for each peptide), which are all independent reactions, and show reproducibility of change

      5) Many overlapping peptides show the same pattern- the exchange rate difference is observed in at least 4 peptide time plots without contradictory evidence within the sequence range.

      • We included the complete set of peptide time plots in the supplemental materials.

      6) The many other peptide time plots that do not show any difference with and without RAS is a form of reproducibility, that no difference means no difference.

      1. The investigators find that KRAS binds NT1 in SPR experiments, whereas HRAS does not. However, the pull-down assays show NT1 binding to both KRAS and HRAS. SI Fig 5 attributes this to slow association, yet both SPR (on/off rates) and equilibrium binding measurements are conducted. This data should be able to 'tease' out differences in association.

      Response: Thank you for bringing up this important point. It's crucial to note that the experiments conducted at slow flow rates generated low responses, making it challenging to perform kinetic analyses effectively. Consequently, we are unable to provide accurate equilibrium binding measurements (on/off rates) for NT1 and HRAS. Regrettably, comparing the association rates between KRAS and HRAS is not feasible due to the differing flow rates employed. We have addressed this limitation in the manuscript as follows:

      “We therefore immobilized NT1 and flowed over HRAS at a much slower flow rate (5 µL/min), during which we saw minimal but consistent binding (Supplementary Fig 5A). The low response and long timeframe of each injection, however, makes the dissociation constant (KD) unmeasurable and incomparable to our other NT-HRAS OpenSPR results.”

      1. The model in Figure 7B highlights BSR interactions with KRAS, however, BSR interactions with the KRAS HVR (proximal to the membrane) are not shown, as supported by Terrell et al. (2019).

      Response: Thank you for the suggestion. We reoriented the BSR closer to HVR of KRAS rather than G-domain.

      1. The investigators state that 'These findings demonstrate that HRAS binding to BRAF directly relieves BRAF autoinhibition by disrupting the NT1-KD interaction, providing the first in vitro evidence of RAS-mediated relief of RAF autoinhibition, the central dogma of RAS-RAF regulation. However, in Tran et al (2005) JBC, they report pulldown experiments using N-and C-terminal fragments of BRAF and state that 'BRAF also contains an N-terminal autoinhibitory domain and that the interaction of this domain with the catalytic domain was inhibited by binding to active HRAS'. This reference is not cited.

      Response: We appreciate the concern raised regarding our statement. We want to clarify that it was never our intention to disregard this JBC publication, and we apologize for any misunderstanding caused by our phrasing. We recognize that our initial statement was contentious, and we have removed the word "first" from the phrase "first in vitro evidence." In the section of the discussion where we originally cited the Tran et al. (2005) publication, we have revised the language to eliminate "first" and have rephrased the sentence, as provided below:

      “Our in vitro binding studies align with previous implications that RAS relieves RAF autoinhibition shown through cell-based coIP’s.5”

      1. In Fig 2, panels A and C, it is unclear what the grey dotted line in is each plot.

      Response: Thank you for drawing our attention to the additional explanation needed here. The gray dotted lines represent the maximum deuterium exchange. We added the following description to the figure 2 legend:

      “Gray dotted lines represent the theoretical exchange behavior for specified peptide that is fully unstructured (top) or for specified peptide with a uniform protection factor (fraction of time the residue is involved in protecting the H-bond) of 100 (lower).”

      1. In Fig 3, error analysis is not provided for panel E.

      Response: We added the standard deviation values to this panel. We additionally added these for Fig 4C and Fig 5B.

      1. How was RAS GMPPNP loading verified?

      Response: Ras loading is a well-established protocol with a solid foundation in the literature.16– 21 We followed this accepted method for nucleotide exchange. Our controls, as evident in pulldown and OpenSPR experiments (fig 1C, 4E), unequivocally demonstrate that GMPPNPloaded RAS is active, while unloaded RAS is inactive, as evidenced by the absence of no binding. We also added supplemental figure 6E to show that inactive (unloaded) GST-KRAS does not bind to BRAF during OpenSPR analysis. To exemplify this, we included binding curves of 1 µM GST-KRAS- GMPPNP and -GDP flowed over NTA-immobilized BRAF-NT2 at a flow rate of 30 µl/min.

      References

      (1) Terrell, E. M.; Durrant, D. E.; Ritt, D. A.; Sealover, N. E.; Sheffels, E.; Spencer-Smith, R.; Esposito, D.; Zhou, Y.; Hancock, J. F.; Kortum, R. L.; Morrison, D. K. Distinct Binding Preferences between Ras and Raf Family Members and the Impact on Oncogenic Ras Signaling. Mol. Cell 2019, 76 (6), 872-884.e5. https://doi.org/10.1016/j.molcel.2019.09.004.

      (2) Tran, T. H.; Chan, A. H.; Young, L. C.; Bindu, L.; Neale, C.; Messing, S.; Dharmaiah, S.; Taylor, T.; Denson, J. P.; Esposito, D.; Nissley, D. V.; Stephen, A. G.; McCormick, F.; Simanshu, D. K. KRAS Interaction with RAF1 RAS-Binding Domain and Cysteine-Rich Domain Provides Insights into RAS-Mediated RAF Activation. Nat. Commun. 2021, 12 (1176), 1–16. https://doi.org/10.1038/s41467-021-21422-x.

      (3) Fischer, A.; Hekman, M.; Kuhlmann, J.; Rubio, I.; Wiese, S.; Rapp, U. R. B- and C-RAF Display Essential Differences in Their Binding to Ras: The Isotype-Specific N Terminus of B-RAF Facilitates Ras Binding. J. Biol. Chem. 2007, 282 (36), 26503–26516. https://doi.org/10.1074/jbc.M607458200.

      (4) Park, E.; Rawson, S.; Li, K.; Kim, B. W.; Ficarro, S. B.; Pino, G. G. Del; Sharif, H.; Marto, J. A.; Jeon, H.; Eck, M. J. Architecture of Autoinhibited and Active BRAF–MEK1–14-3-3 Complexes. Nature 2019, 575 (7783), 545–550. https://doi.org/10.1038/s41586-0191660-y.

      (5) Tran, N. H.; Wu, X.; Frost, J. A. B-Raf and Raf-1 Are Regulated by Distinct Autoregulatory Mechanisms. J. Biol. Chem. 2005, 280 (16), 16244–16253. https://doi.org/10.1074/jbc.M501185200.

      (6) Prior, I. A.; Hancock, J. F. Ras Trafficking, Localization and Compartmentalized Signalling. Semin. Cell Dev. Biol. 2012, 23 (2), 145–153.

      (7) Herrmann, C.; Martin, G. A.; Wittinghofer, A. Quantitative Analysis of the Complex between P21 and the Ras-Binding Domain of the Human Raf-1 Protein Kinase. J. Biol. Chem. 1995, 270 (7), 2901–2905. https://doi.org/10.1074/jbc.270.7.2901.

      (8) Vojtek, A. B.; Hollenberg, S. M.; Cooper, J. A. Mammalian Ras Interacts Directly with the Serine/Threonine Kinase Raf. Cell 1993, 74 (1), 205–214. https://doi.org/10.1016/00928674(93)90307-C.

      (9) Parker, M. W.; Bello, M. Lo; Federici, G. Crystallization of Glutathione S-Transferase from Human Placenta. J. Mol. Biol. 1990, 213 (2), 221–222. https://doi.org/10.1016/S00222836(05)80183-4.

      (10) Inouye, K.; Mizutani, S.; Koide, H.; Kaziro, Y. Formation of the Ras Dimer Is Essential for Raf-1 Activation. J. Biol. Chem. 2000, 275 (6), 3737–3740. https://doi.org/10.1074/JBC.275.6.3737.

      (11) Z. Y. Kan, X. Ye, J. J. Skinner, L. Mayne, S. W. E. ExMS2: An Integrated Solution for Hydrogen-Deuterium Exchange Mass Spectrometry Data Analysis. Anal Chem 2019, 91 (11), 7474–7481.

      (12) Mayne, L.; Kan, Z. Y.; Sevugan Chetty, P.; Ricciuti, A.; Walters, B. T.; Englander, S. W. Many Overlapping Peptides for Protein Hydrogen Exchange Experiments by the Fragment Separation-Mass Spectrometry Method. J. Am. Soc. Mass Spectrom. 2011, 22 (11), 1898–1905. https://doi.org/10.1007/S13361-011-0235-4.

      (13) Ye, X.; Lin, J.; Mayne, L.; Shorter, J.; Englander, S. W. Hydrogen Exchange Reveals Hsp104 Architecture, Structural Dynamics, and Energetics in Physiological Solution. Proc. Natl. Acad. Sci. 2019, 116 (15), 7333–7342. https://doi.org/10.1073/pnas.1816184116.

      (14) Ye, X.; Lin, J.; Mayne, L.; Shorter, J.; Englander, S. W. Structural and Kinetic Basis for the Regulation and Potentiation of Hsp104 Function. Proc. Natl. Acad. Sci. 2020, 117 (17), 9384–9392. https://doi.org/10.1073/pnas.1921968117.

      (15) Hamuro, Y. Determination of Equine Cytochrome c Backbone Amide Hydrogen/Deuterium Exchange Rates by Mass Spectrometry Using a Wider Time Window and Isotope Envelope. J. Am. Soc. Mass Spectrom. 2017, 28 (3), 486–497. https://doi.org/10.1007/s13361-016-1571-1.

      (16) Herrmann, C.; Horn, G.; Spaargaren, M.; Wittinghofer, A. Differential Interaction of the Ras Family GTP-Binding Proteins H-Ras, Rap1A, and R-Ras with the Putative Effector Molecules Raf Kinase and Ral-Guanine Nucleotide Exchange Factor. J. Biol. Chem. 1996, 271 (12), 6794–6800. https://doi.org/10.1074/jbc.271.12.6794.

      (17) Miller, A. F.; Halkides, C. J.; Redfield, A. G. An NMR Comparison of the Changes Produced by Different Guanosine 5’-Triphosphate Analogs in Wild-Type and Oncogenic Mutant P21ras. Biochemistry 1993, 32 (29), 7367–7376. https://doi.org/10.1021/bi00080a006.

      (18) Amendola, C. R.; Mahaffey, J. P.; Parker, S. J.; Ahearn, I. M.; Chen, W. C.; Zhou, M.; Court, H.; Shi, J.; Mendoza, S. L.; Morten, M. J.; Rothenberg, E.; Gottlieb, E.; Wadghiri, Y. Z.; Possemato, R.; Hubbard, S. R.; Balmain, A.; Kimmelman, A. C.; Philips, M. R. KRAS4A Directly Regulates Hexokinase 1. Nature 2019. https://doi.org/10.1038/s41586019-1832-9.

      (19) John, J.; Sohmen, R.; Feuerstein, J.; Linke, R.; Wittinghofer, A.; Goody, R. S. Kinetics of Interaction of Nucleotides with Nucleotide-Free H-Ras P21. Biochemistry 1990, 29 (25), 6058–6065. https://doi.org/10.1021/bi00477a025.

      (20) Dharmaiah, S.; Tran, T. H.; Messing, S.; Agamasu, C.; Gillette, W. K.; Yan, W.; Waybright, T.; Alexander, P.; Esposito, D.; Nissley, D. V.; McCormick, F.; Stephen, A. G.; Simanshu, D. K. Structures of N-Terminally Processed KRAS Provide Insight into the Role of N-Acetylation. Sci. Reports 2019 91 2019, 9 (1), 1–15. https://doi.org/10.1038/s41598-019-46846-w.

      (21) Rathinaswamy, M. K.; Gaieb, Z.; Fleming, K. D.; Borsari, C.; Harris, N. J.; Moeller, B. E.; Wymann, M. P.; Amaro, R. E.; Burke, J. E. Disease-Related Mutations in PI3Kγ Disrupt Regulatory C-Terminal Dynamics and Reveal a Path to Selective Inhibitors. Elife 2021, 10. https://doi.org/10.7554/eLife.64691.

    1. Author Response

      The following is the authors’ response to the original reviews.

      Thank you again to the reviewers and editors for all constructive feedback. We have made several edits to the manuscript and data to address concerns raised during the initial review and strengthen the completeness of this study. Please find below our response to each, with referee comments in black and our responses in blue.

      eLIFE Assessment:

      The authors report that Dbp5 functions in parallel with Los1 in tRNA export, in a manner dependent on Gle1 and requiring the ATPase cycle of Dbp5, but independent of Mex67, Dbp5's partner in mRNA export. The evidence for this conclusion is still incomplete, as is the biochemical evidence that Dbp5 interacts directly with tRNA in vitro with Gle1 and co-factor InsP6 triggering Dbp5 ATPase activity in the Dbp5-tRNA complex. The evidence that Dbp5 interacts with tRNA in cells independently of Los1, Msn5 and Mex67 is, however, solid.”

      Thank you for the constructive feedback and assessment of our article. We have made several improvements to the quality of data (Figure 1E, Figure 3C, Figure 4), added additional tRNA Northern Blot/FISH targets to further generalize observed phenotypes beyond pre-tRNAIleUAU (Supplement 1C/D/E/F), provided growth assays for los1Δ/msn5 Δ/dbp5R423A (Supplement 1B), add added data showing gle1-4/los1Δ double mutants phenocopy los1Δ/dbp5R423A to further support the involvement of Gle1 and the Dbp5 ATPase cycle in tRNA export (Figure 5D).

      Additionally, we added quantification to assess the extent of overexpression of Dbp5 mutants in Figure 3 and a discussion of how these mutants alter the localization of the protein to better assess how they may impact tRNA export (lines 211-226). Furthermore, several minor edits to the text/figures have been made to remove typos and improve readability (e.g., labels of FISH/Northern data in Figure 1). Additional edits include adjusting the text and the model presented in Figure 6 to improve conclusions drawn from our data. This includes lines 106-107 and lines 366-371 which clarifies that the Dbp5 mediated tRNA export pathway may not be entirely independent of Mex67.

      Reviewer #1 (Public Review):

      "At least one result suggests that the idea of these pathways in parallel may be too simplistic as deletion of the LOS1 gene, which is not essential decreases the interaction of tRNA export substrate with Dbp5 (Figure 2A). If the two pathways were working in parallel, one might have expected removing one pathway to lead to an increase in the use of the other pathway and hence the interaction with a receptor in that pathway…. The obvious missing experiment here with respect to genetics is the test of whether deletion of the MSN5 gene in the cells, which combines deletion of LOS1 and the dbp5_R423A allele, shown in Figure 1D would be lethal…. The authors provide evidence of a model where the helicase Dbp5 plays a role in tRNA export from the nucleus. Further evidence is required to determine whether Dbp5 could function in the same pathway as the previously defined tRNA export receptors, Los1 and Msn5. There are genetic tests that could be performed to explore this question. Some of the biochemistry presented would show when Los1 is absent that the interaction of Dbp5 with tRNA decreases, which could support a model where Dbp5 plays a role in coordination with Los1”

      Author Response: We thank the reviewers for this suggestion and consideration. We have added data showing growth phenotypes for the los1Δ/msn5Δ/dbp5R423A triple mutants. We discuss possible explanations and alternative hypothesis for why these triple mutants are viable and the observed reduction in Dbp5-pre-tRNA interaction in the context of los1Δ (lines 128131; lines 172-174).

      Reviewer #1 (Public Review):

      “While some of the binding assays show rather modest band shifts (Figure 4B for example), the data in Figure 4A showing that there is no binding detected unless a non-hydrolyzable ATP analogue is employed, argues for specificity in nucleic acid binding. The question that does arise is whether the binding is specific for tRNA.”

      Author Response: We have adjusted brightness/contrast of the EMSAs in Figure 4 to allow for better visualization of band shifts. Additionally, a discussion of the specificity of Dbp5-nucleic acid binding and the observed tRNA binding has been added (lines 313-322)

      Reviewer #1 (Public Review):

      “With the exception of the binding studies, which also employ a mixture of yeast tRNAs, this study relies primarily on a single tRNA species to come to the conclusions drawn. Many other studies have used multiple tRNAs to explore whether pathways characterized are generalizable to other tRNAs.“

      Author Response: We have added additional tRNA targets for FISH/Northerns in Supplement 1C/D/E/F)

      Reviewer #2 (Public Review):

      “There are some pieces of data that are misinterpreted. (Figure 1A and B look the same; in Fig 1E, the DAPI staining is abnormal; in Fig 4 the bands can't be seen.)”

      Author Response: Thank you for your constructive feedback. We have replaced FISH images to improve DAPI staining (Figure 1E), adjusted EMSAs to allow for better visualization of band shifts. (Figure 4), improved Northern Blots for quality (Figure 3C), and rearranged Figure 1A/B for readability. We maintain that the results from Figure 1A/B are not misinterpreted but agree that the readability of the figure was poor and have adjusted labels/formatting accordingly. The results of these experiments show that the deletion of Los1 does not alter Dbp5 localization and conversely loss of Dbp5 does not alter Los1 localization. As such the localization patterns under loss-of-function conditions look the same as wild-type for each protein respectively.

    1. Author Response

      The following is the authors’ response to the original reviews.

      We thank the reviewers for their service and are pleased to see that they were positive about the overall study. The reviewers provided several very good suggestions that we feel have improved the revised manuscript. In response to their suggestions, we have added four new figures of additional data (Figure 1, Supplement 2; Figure 2, Supplement 2; Figure 3, Supplements 1 and 2) in this revision. We have addressed the specific review comments/suggestions point-by-point below. Text changes in the manuscript are indicated in red with line numbers indicated.

      Public Reviews:

      Reviewer #1 (Public Review):

      This important study from Jahncke et al. demonstrates inhibitory synaptic defects and elevated seizure susceptibility in multiple models of dystroglycanopathy. A strength of the paper is the use of a wide range of genetic models to disrupt different aspects of dystroglycan protein or glycosylation in forebrain neurons. The authors use a combination of immunohistochemistry and electrophysiology to identify cellular migration, lamination, axonal targeting, synapse formation/function, and seizure phenotypes in forebrain neurons. This is an elegant study with extensive data supporting the conclusions. The role of dystroglycan and the dystrophin glycoprotein complex (DGC) in cellular migration and synapse formation are of broad interest.

      • A strength of this paper is the use of several transgenic mouse lines with mutations in genes involved in glycosylation of dystroglycan. Knockout of POMT2 abolishes the majority of dystroglycan glycosylation, while point mutations in B4GAT and FKRP presumably produce more minor changes in glycosylation. This is a powerful approach to inves5gate the role of glycosylation in dystroglycan function. However, the authors do not address how mutations in these genes may affect glycosylation or expression of proteins other than dystroglycan. It is possible, even likely, that some of the phenotypes observed are due to changing glycosylation in any number of other proteins. The paper would be strengthened by addressing this possibility more directly.

      We are glad to see that the reviewer appreciated the range of transgenic models used to define the role of Dag1 glycosylation. It is certainly possible that glycosylation of proteins other than Dag1 is affected by deletion of Pomt2, B4Gat1 and/or FKRP. Indeed, Cadherin and Plexin proteins undergo Omannosylation in the brain. However, recent work has shown that these proteins are not dependent on Pomt1/2 for their O-mannosylation, and use an alternative glycosylation pathway. Therefore, they unlikely to contribute to the phenotypes we observed in our Pomt2, B4Gat1 and/or FKRP mutants. Furthermore, we did not observe any phenotypes in these models that was not also observed in the Dag1 conditional knockouts. We have clarified this point in the results section (lines 117-121) with additional references, and added the caveat that Pomt2, B4gat1, and Fkrp could play a role in the glycosylation of proteins other than Dag1.

      • It would be helpful to have a more clear description of how dystroglycan glycosylation is altered in B4GAT1M155T or FKRPP448L mice. For example, Figure 1 makes it appear that the distal sugar moieties are missing, however, the IIH6 antibody, which binds to terminal matriglycan repeats on the glycan chain, recognizes dystroglycan in these mutants.

      We apologize for the confusion caused by our schematic in Figure 1. We have adjusted the opacity of the schematic in Figure 1A to better illustrate that the matriglycan chain is s5ll present, albeit at reduced levels, in the B4Gat1 and FKRP mutants. In addition, this is directly shown in the western blot in Figure 1B.

      • In Figure 1, the authors use the IIH6 antibody, which recognizes the terminal portion of the dystroglycan glycan chain, to label dystroglycan in the hippocampus. As expected, Emx1Cre,POMT2cKO mice, which lack glycosylation of dystroglycan, do not show any labelling. However, this experiment does not reveal anything about dystroglycan expression, only that the IIH6 antibody no longer recognizes dystroglycan. It would be very helpful in interpreting the later results to know whether the level and pattern of dystroglycan expression is normal or absent in the POMT2cKO mice, perhaps using another antibody that does not target the glycosylated region. For example, figure 3 shows reduced axon targeting to the cell body layer in POMT2cKO, however, it is unclear whether this is due to absence/mislocalization of dystroglycan at the cell surface, or if dystroglycan expression is normal, but glycosylation is directly required for axon targeting.

      Addressed in the “Recommendation for Authors” section below

      • In Figures 3 and 5, the authors use CB1R labelling to measure axon targeting and synapses formation. However, it is not clear how the authors measure axon targeting and synapses number separately using the same CB1R antibody. In addition, figure 3 shows reduced CB1R labelling in Dag1cyto pyramidal cell layer, but Figure 5 shows no change in CB1R labelling in the same mice. These results would appear to be contradictory.

      In Figure 3, the data reflects fluorescent intensity of CB1R+ axons measured across the en5re hippocampal depth. In contrast, the synapse number in Figure 5 is measured as VGat+ and CB1R+ puncta (axonal swellings) within the pyramidal cell layer (SP). The discrepancy between these measurements in the Dag1Cyto mutants likely reflects a change in the distribution of the synaptic contacts in SP (ie: increased contacts in the upper portion of the SP relative to the bottom). This is clarified in the text, lines 315-319.

      • The authors measure spontaneous IPSCs (sIPSC) in CA1 pyramidal neurons to measure inhibitory synaptic function. This measure assesses inhibitory synaptic input from all sources, but dystroglycan mutations primarily impairs synapses arising from CCK+/CB1R interneurons, leaving synapses arising from PV or other interneurons relatively unchanged. To assess changes in CCK+/CB1R interneurons the authors apply the cholinergic receptor agonist Carbachol (which selectively activates CCK+/CB1R interneurons) and measure the change in sIPSC amplitude and frequency. While this is an interesting and reasonable experiment, the observed effects could be due to altered carbachol sensitivity in the transgenic mice. Control experiments showing that the effect of Carbachol on excitability of CCK+/CB1R interneurons is similar across mouse lines is missing.

      The reviewer is correct that we did not show that CCK/CB1R+ interneurons have the same sensitivity to CCh in controls and the various mutants. Indeed, this is something we have struggled with over the course of the study, and is an inherent limitation of the current study. Unfortunately, these cells are relatively sparse in the CA1, and therefore patching onto presumptive CCK/CB1R+ INs at random to test this directly is not feasible. There are also no genetic or viral tools that we are aware of at this time to fluorescently label these cells for targeted recordings (this would need to be a Cre-independent transgenic mouse line since we are using Cre to delete Dag1 and Pomt2). We tried to assess this by measuring c-fos immunohistochemistry staining as a proxy for activity in response to CCh. Briefly, we incubated acute slices with NBQX, SR95531, and Kynurenic Acid to block synaptic activity, and added CCh in the bath for 30, 60, and 90 minutes to induce CCK/CB1R+ INs firing. Slices were then fixed and stained for c-fos and NECAB1 to identify the CCK/CB1R+ interneurons.

      Unfortunately, we had a very difficult time imaging these slices, and we were not confident in our ability to localize c-fos+/NECAB1+ cells. We have clarified that this is an inherent limitation to the study in the text, lines 394-396.

      • Earlier work has shown that selective deletion of dystroglycan from pyramidal neurons produces near complete loss of CCK+/CB1R interneurons and synapse formation, a more severe deficit than observed here using a more widespread Cre-driver. This finding is surprising, as generally more wide-spread gene deletion results in more severe, not less severe, phenotypes. The authors make the reasonable claim that more wide-spread gene deletion better mimics human pathologies. However, possible speculation on why this is the case for dystroglycan could provide insight into the nature of CNS deficits in different forms of dystroglycanopathies.

      The reviewer is correct that previous work from both our lab and others have shown that deletion of Dag1 from only pyramidal neurons with NEX-cre leads to a complete loss of CCK/CB1R+ INs, and is thus more severe than the phenotype seen with the broader deletion of Dag1 with Emx1-Cre. We were also surprised by this result, so we also generated Dag1;Nestin-Cre mice. These mice show an iden5cal phenotype as the Dag1;Emx1-Cre mutants (new data; Figure 3, Supplement 1; text lines 226-233). This makes us confident in the validity of the Dag1;Emx-Cre mutants with regards to modeling the human disease. We do not know why the NEX-Cre line shows a more severe phenotype; it is possible that this is due to an unknown epistatic interaction between Dag1 and NEX-Cre.

      Reviewer #2 (Public Review):

      The manuscript by Jahncke and colleagues is centered on the CCK+ synaptic defects that are a consequence of Dystroglycanopathy and/or impaired dystroglycan-related protein function. The authors use conditional mouse models for Dag1 and Pomt2 to ablate their function in mouse forebrain neurons and demonstrate significant impairment of CCK+/CB1R+ interneuron (IN) development in addition to being prone to seizures. Mice lacking the intracellular domain of Dystroglycan have milder defects, but impaired CCK+/CB1R+ IN axon targeting. The authors conclude that the milder dystroglycanopathy is due to the par5ally reduced glycosylation that occurs in the milder mouse models as opposed to the more severe Pomt2 models. Additionally, the authors postulate that inhibitory synaptic defects and elevated seizure susceptibility are hallmarks of severe dystroglycanopathy and are required for the organization of functional inhibitory synapse assembly.

      The manuscript is overall, fairly well-written and the description of the phenotypic impact of disruption of Dystroglycan forebrain neurons (and similar glycosyltransferase pathway proteins) demonstrate impairment in axon targeting and organization.

      There are some questions with regards to interpretation of some of the results from these conditional mouse models.

      • The study is mostly descriptive, and some validation of subunits of the dystroglycanglycoprotein complex and laminin interactions would go towards defining the impact of disruption of dystroglycan's function in the brain.

      Addressed in the “Recommendation for Authors” section below

      • The statistics and basic analysis of the manuscript appear to be appropriate and within parameters for a study of this nature.

      • Some clarification between the discrepancies between the Walker Warburg Syndrome (WWS) patient phenotypes and those observed in these conditional mouse models is warranted. This manuscript has the potential to be impactful in the Dystroglycanopathy and general neurobiology fields.

      Addressed in the “Recommendation for Authors” section below

      Reviewer #3 (Public Review):

      The study presents a systematic analysis of how a range of dystroglycan mutations alter CCK/CB1 axonal targeting and inhibition in hippocampal CA1 and impact seizure susceptibility. The study follows up on prior literature identifying a role for dystroglycan in CCK/CB1 synapse formation. The careful assay includes comparison of 5 distinct dystroglycan mutation types known to be associated with varying degrees of muscular dystrophy phenotypes: a forebrain specific Dag1 knockout in excitatory neurons at 10.5, a forebrain specific knockout of the glycosyltransferase enzyme in excitatory neurons, mice with deletion of the intracellular domain of beta-Dag1 and 2 lines with missense mutations with milder phenotypes. They show that forebrain glutamatergic deletion of Dag1 or glycosyltransferase alters cortical lamination while lamination is preserved in mice with deletion of the intracellular domain or missense mutation.

      The study extends prior works by identifying that forebrain deletion of Dag1 or glycosyltransferase in excitatory neurons impairs CCK/CB1 and not PV axonal targeting and CB1 basket formation around CA1 pyramidal cells. Mice with deletion of the intracellular domain or missense mutation show limited reductions in CCK/CB1 fibers in CA1. Carbachol enhancement of CA1 IPSCs was reduced both in forebrain knockouts. Interestingly, carbachol enhancement of CA1 IPSCs was reduced when the intracellular domain of beta-Dag1was deleted, but not I the missense mutations, suggesting a role of the intracellular domain in synapse maintenance. All lines except the missense mutations, showed increased susceptibility to chemically induced behavioral seizures. Together, the study, is carefully designed, well controlled and systematic. The results advance prior findings of the role for dystroglycans in CCK/CB1 innervations of PCs by demonstrating effects of more selective cellular deletions and site specific mutations in extracellular and intracellular domains. The interesting finding that deletion of intracellular domain reduces both CB1 terminals in CA1 and carbachol modulation of IPSCs warrants further analysis. Lack of EEG evaluation of seizure latency is a limitation.

      Specific comments

      • Whether CCK/CB1 cell numbers in the CA1 are differentially affected in the transgenic mice is not clarified.

      This is a good point; we have now addressed this in Figure 3, Supplement 2 (new data; text lines 234-245). In brief, using two different markers (NECAB1 and NECAB2), we see no change in the number of CCK+/CB1R+ INs in the mutant mice.

      • 2. Whether basal synaptic inhibition is altered by the changes in CCK innervation is not examined.

      We apologize for the confusion. This is addressed in the text, lines 371-375:

      “Notably, even baseline sIPSC frequency was reduced in Dag1cyto/- mutants (2.27±1.70 Hz) compared to WT controls (4.46±2.04 Hz, p = 0.002), whereas baseline sIPSC frequencies appeared normal in all other mutants when compared to their respective controls.”

      Reviewer #1 (Recommendations For The Authors):

      Line 321- CCH-mediated CHANGE in sIPSC amplitude...

      This has been corrected (now line 356)

      Reviewer #2 (Recommendations For The Authors):

      Major Comments:

      • Disruption of the dystroglycan (and subsequent glycosyltransferase proteins) in the brain would likely impact laminin localization and cytoskeletal stability of the dystroglycanprotein complex. The authors should assess (via immunolabeling) the disruption laminin using laminin IF in the various conditional mouse model forebrain sections.

      We have stained brains from Dag1, Pomt2, and Dag1cyto mutants with an antibody to Laminin (new data; Figure 2, Supplement 2; text lines 191-205). Briefly, the data clearly shows that laminin staining is abnormal on the pial surface and in the blood vessels of the Dag1;Emx1-cre mutants. This is less severe in the Pomt2;Emx1 mutants, and normal in the Dag1cyto mutants. We also examined higher magnification of laminin staining in hippocampal SP around the pyramidal cells. Laminin in the region was diffuse (not synaptically localized) and there was no difference between any of the mutants and their respective controls (data not shown).

      • 2. The biggest question(s) I have is if the synaptic defects that were measured (Fig 6) in the spontaneous inhibitory post-synaptic currents (sIPSCs) could be rescued as a function of the glycosylation of dystroglycan? While ribitol/CDP-ribose has been shown to enhance alpha-dystroglycan glycosylation and total glycosylation, it might be appropriate here. NADplus exogenous supplementation has been (Ortez-Cordero et al., eLife, 2021) has a faster acting effect on glycosylation of dystroglycan and may work in this context. Can the authors add NADplus prior to their CCK+/CB1R+ IN recordings and evaluate synaptic current effects to determine if glycosylation rescue can actually occur?

      We are very much interested in the potential to rescue synaptic defects in the various mutants, and this is an active area of study for us going forward. However, we do not think the suggested experiments involving ribitol/NADplus supplementation are likely to work in our specific experiments with these models. In Dag1;Emx1-Cre and Pomt2;Emx1-Cre mice, which show the most dramatic phenotype, there is no O-mannosyl chain ini5ated for ribitol to act upon. In the Dag1Cyto mice, matriglycan is normal and therefore ribitol supplementation is unlikely to have an effect. In B4Gat1 and FKRP mutants, while matriglycan is reduced, there is no significant functional synaptic defect observed. Therefore, even if ribitol was able to increase matriglycan in these two mutants, we would be unable to detect a functional difference. As a side note, while the NADplus supplementation is an interesting idea, the previous study cited did these experiments in vitro in cell lines, so it is not clear if this would have the same effect in vivo. In addition, the time frame that they analyzed was following 24-72 hours of supplementation in cultured cells, which led to ~10% increase in IIH6 at 24 hours. We are unable to incubate acute slices for that amount of time prior to our recordings.

      • 3. Minor point. Genetic abbreviation for POMT2 should be "Pomt2", unless some other justification is provided by the authors. I believe the other mutations introduced (e.g. FKRP P448L are humanized mutations).

      This has been corrected throughout

      • 4. While dystroglycan glycosylation using the IIHC6 antibody is important for proper localization, the core DAG-6F4 monocloncal antibody (DSHB Iowa Hybridoma Bank) would inform you if there is actual disruption in the amount of dystroglycan protein translation and/or production in the forebrain. Can the authors address this question on total dystroglycan production?

      This is a great suggestion. We obtained both the DAG-6F4 monoclonal antibody from DSHB and a monoclonal antibody to alpha-Dag1 from Abcam (45-3) and tried using them for immunostaining, but they did not work with brain tissue. However, we were able to use an antibody to beta-Dag1 (Leica, B-DG-CE) for immunostaining. This new data is included in Figure 1, Supplement 2 (text lines 134-140) and shows that as expected, beta-Dag1 is completely gone in Dag1;Emx1-Cre and Dag1Cyto mutants. In the Pomt2;Emx1-Cre mutants, betaDag1 is present but no longer has the punctate appearance consistent with synaptic localization. We have added a section in the discussion expanding on the interpretation of the data, lines 449-462.

      • 5. Please comment more on the structural changes in the forebrain and the presence or lack thereof cobblestone (e.g. lissencephaly) in the POMT2 mutant mice (and the other dystroglycanopathy models)? There appears to be some discordance with that and the human Walker Warburg Syndrome (WWS) patients.

      The Pomt2;Emx1-cre mutants show a cobblestone phenotype (identical to the Dag1;Emx1-Cre mutants), see Figure 2. This is consistent with these two models having a complete loss of Dag1 function, and therefore modeling the most severe forms of dystroglycanopathy (WWS, MEB). In contrast, the B4Gat1 and FKRP mutants show relatively normal cortical migration because these mutants are hypomorphic and therefore retain some degree of functional Dag1. These two mice model a milder form of dystroglycanopathy. We have clarified this on lines 188-190 and 573-578.

      • 6. Line 577. Minor typo, statement ended in a comma, versus a period.

      Done

      • 7. Methods. Please report on the sex of the mice used in the experiments.

      Mice of both sexes were used throughout the study. This has been clarified in the methods section, and we have added information regarding how many mice of each sex were used in each experiment in supplemental table 1

      Reviewer #3 (Recommendations For The Authors):

      Additional Specific Comments,

      • Although authors include n slice/animals and other details in the methodology, including data as % changes and n (slices/animals) in results will greatly improve the readability.

      We have clarified that only one cell per slice was used for physiological recordings (Figure 6) in the methods section, as CCh does not wash out.

      • 2. IPSCs are measured as inward currents in high chloride with AMPA blockers which is appropriate. However, Mg was appears to be low (1 mM) in cutting solution. Was this the case in the recording solution. If so, why were NMDA blockers not used.

      To clarify, 10mM Mg was included in the cutting solution, and 1mM Mg was included in the recording solution. When the cell is clamped at -70mV, 1mM Mg2+ is sufficient to block NMDA receptors: haps://www.nature.com/ar5cles/309261a0

    1. Author Response

      Reviewer 1:

      1. The missing mouse gender information will be incorporated into the revised manuscript. For flow cytometry, two male and two female mice of each genotype were used. For single cell RNA sequencing, two female and one male mouse of each genotype were used. For the bulk RNA sequencing four male cd47−/− mice and four male wildtype mice were used.

      2. The bulk RNA sequencing analysis identified elevated expression of erythropoietic genes in CD8+ spleen cells from cd47−/− versus wildtype mice that were obtained using magnetic bead depletion of all other lineages. Therefore, we used the same Miltenyi negative selection kit as the first step to prepare the cells for single cell RNA sequencing. These untouched cells were then depleted of most mature CD8 T cells using a Miltenyi CD8a(Ly2) antibody positive selection kit. An important consideration underlying this approach was recognizing that the commercial magnetic bead depletion kits used for preparing specific immune cell types are optimized to give relatively pure populations of the intended immune cells using wildtype mice. Our previous experience studying NK cell development in the cd47−/− mice taught us that NK precursors, which are rare in wildtype mouse spleens, accumulate in cd47−/− spleens and were not removed by the antibody cocktail optimized for wildtype spleen cells (Nath et al Front Immunol 2018). The present data indicate that erythroid precursors behave similarly.

      3. Anemia is a prevalent side effect of several CD47 therapeutic antibodies being developed for cancer therapy. Anemia would be expected to induce erythropoiesis in bone marrow and possibly at extramedullary sites. Human spleen cells are not accessible to directly evaluate extramedullary erythropoiesis in cancer patients, but analysis of circulating erythroid precursors or liquid biopsy methods could be useful to detect induction of extramedullary erythropoiesis by these therapeutics. We are currently investigating the ability of CD47 antibodies to directly induce erythropoiesis using a human in vitro model.

      Reviewer 2:

      1. The reviewer asked, “whether the increased splenic erythropoiesis is a direct consequence of CD47-KO or a response to the anemic stress in this mouse model.” Our data supports both a direct role for CD47 and an indirect role resulting from the response to anemic stress. We cited our previous publications describing increased Sox2+ stem cells in spleens of Cd47 and Thbs1 knockout mice, but we neglected to emphasize another study where we found that bone marrow from cd47−/− mice subjected to the stress of ionizing radiation exhibited more colony forming units for erythroid (CFU-E) and burst-forming unit-erythroid (BFU-E) progenitors compared to bone marrow from irradiated wildtype mice (Maxhimer Sci Transl Med 2009). Taken together, our published data demonstrates that loss of CD47 results in an intrinsic protection of hematopoietic stem cells from genotoxic stress. This function of CD47 is thrombospondin-1-dependent and is consistent with the up-regulation of early erythroid precursors in the spleens of both knockout mice but cannot explain why the Thbs1−/− mice have fewer committed erythroid precursors than wildtype. We cited studies that documented increased red cell turnover in cd47−/− mice but less red cell turnover in Thbs1−/− mice compared to wildtype mice. Increased red cell clearance in cd47−/− mice is mediated by loss of the “don’t eat me” function of CD47 on red cells. In wildtype mice, clearance is augmented by thrombospondin-1 binding to the clustered CD47 on aging red cells (Wang, Aging Cell 2020). Thus, anemic stress in the mouse strains studied here decreases in the order cd47−/− > WT > Thbs−/−. This is consistent with the increased committed erythroid progenitors reported here in cd47−/− spleens and decreased committed progenitors in the Thbs1−/− spleens.

      2. The cd47−/− mice used for the current study are the same strain as those reported by Lindberg et al in 1996, with additional backcrossing onto a C57BL/6 background.

    1. Author Response

      We are grateful to the editor and the reviewers for recognizing the importance of our theoretical study on the mechanisms of centrosome size control. We appreciate their thoughtful critiques and suggested improvements, all of which we intend to address in the revised manuscript as outlined below. We acknowledge that the experimental evidence supporting the proposed theory is currently incomplete. We anticipate that our study will serve as inspiration for future experiments aimed at testing the proposed theory.

      As noted by both reviewers, our model is built on the assumption that the diffusion of molecular components is much faster than any reactive time scales. To explore the impact of diffusion on centrosome size regulation, we are presently working on a spatial model of centrosome growth within a spatially extended system. Our objective is to analyze the influence of diffusion, and we plan to integrate these findings into the revised manuscript.

      To address the concerns raised by both the reviewers regarding the applicability of our model to various organisms, we plan to revise the manuscript to clearly delineate the parameter ranges within which our model could be relevant for different organisms such as C. elegans or Drosophila. While centrosomal components may vary among different organisms, the underlying pathways of interactions exhibit similarities. Leveraging the generality of our theory, it has the capability to capture diverse centrosomal growth behaviors contingent on the parameter choices. Our objective is to emphasize these distinctions, illustrating how the modulation of growth cooperativity and enzyme concentration can influence size regulation and size scaling behaviors. Given the limited availability of quantitative experimental data across diverse organisms, we recognize the challenge in directly comparing our theory with data. Nevertheless, we are committed to presenting a thorough motivation for such comparisons to prevent any confusion or readability issues.

      We acknowledge the reviewers' concerns regarding the limited details provided on the simulation methods and the rationale behind the choice of model parameters. To address this, we will provide detailed explanations on the stochastic simulations, how the model parameters were calibrated, accompanied by appropriate references for the selected parameter values. Additionally, we thank reviewer 1 for the excellent suggestion to incorporate a linear stability analysis of the ordinary differential equations underlying the model. This analysis will offer valuable insights into how the physical parameters of the model influence the tendency to produce equal-sized centrosomes, and we are committed to including this in the revised manuscript. Additionally, we thank reviewer 2 for proposing the use of Polo pulse dynamics to more precisely constrain the parameter regime for centrosome growth dynamics in Drosophila. We will strive to incorporate this into the revised manuscript, recognizing the challenge of quantitatively interpreting centrosome size or subunit concentration values from experimental data on fluorescence intensities. We also plan to discuss enzyme pulse dynamics in C. elegans in the revised manuscript, as it presents a valuable prediction from our model.

      We disagree with reviewer 1's assertion that Reference 8 (Zwicker et al., PNAS 2014) effectively addresses the robustness of centrosome size equality in the presence of positive feedback. The linear stability analysis presented in Figure 5 of Reference 8 demonstrates stability of centrosome size around the fixed point, leading to the inference that Ostwald ripening can be inhibited by the catalytic activity of the centriole. In our manuscript (see Supplementary Figure 3), we demonstrate that the existence of the stable fixed point does not necessarily give rise to equal-sized centrosomes due to the slow dynamics of the solution around the fixed point. With an appreciable amount of positive feedback in the growth dynamics, the solution moves very slowly around the fixed point (similar to a line attractor), and cannot reach the fixed point within a biologically relevant timescale leaving the centrosomes at unequal sizes. Therefore, we argue that the model in Reference 8 lacks a robust mechanism for size control in the presence of autocatalytic growth. Additionally, we wish to emphasize that the choice of initial size difference in our model does not qualitatively alter the results for robustness in centrosome size equality, as shown in Supplementary Figure 3. Nevertheless, we acknowledge the need for a quantitative analysis of the dependence of size regulation on the initial discrepancy in centrosome size. We will incorporate such an analysis into the revised manuscript to strengthen our conclusions. Reviewer 2 has questioned the dismissal of the non-cooperative growth model, suggesting that minor adjustments in that model, such as incorporating size-dependent addition or loss rates due to surface assembly/disassembly, could potentially maintain equally sized organelles with sigmoidal growth dynamics. However, this conclusion is inaccurate. Any auto-regulatory positive feedback would result in size inequality, unless the positive feedback is shared between the organelles. The introduction of size-dependent addition rates due to surface-mediated assembly, would result in auto-regulatory positive feedback, leading to unequal sizes. We have explored a similar scenario of growth dynamics involving assembly and disassembly throughout the pericentriolic material volume in Supplementary Section II, demonstrating significant size inequality in that model and a lack of robustness in size control. We will provide a detailed response to this point in our reply, along with an explicit examination of the surface assembly model.

      In addition to the aforementioned modifications, we will revise the section discussing the predictions of the proposed model in the revised manuscript to rectify any lack of clarity in testable model predictions. We aim to provide clearer demonstrations of how our model predictions differ from those of previous models.

    1. Author Response

      The following is the authors’ response to the original reviews.

      We are grateful to the 3 reviewers and the editorial team for agreeing that our work is rigorous and valuable for the fields of olfaction and developmental biology. We provide a revised version of the manuscript that addresses major concerns raised by the reviewers and adheres to their suggestions.

      Specifically:

      -We clarify what is novel in this work and we cover the appropriate literature.

      -We tone down the language and interpretation of our data

      -We clarify the categorization of zones and improve the readability to the best of our ability.

      We have also made every effort to address minor points raised by the 3 reviewers and made clarifications wherever requested.

    1. Author Response

      The following is the authors’ response to the original reviews.

      Public Reviews:

      Reviewer #1 (Public Review):

      In order to find small molecules capable of enhancing regenerative repair, this study employed a high throughput YAP-activity screen method to query the ReFRAME library, identifying CLK2 inhibitor as one of the hits. Further studies showed that CLK2 inhibition leads to AMOTL2 exon skipping, rendering it unable to suppress YAP.

      The novelty of the study is that it showed that inhibition of a kinase not previously associated with the HIPPO pathway can influence YAP activity through modification of mRNA splicing. The major arguments appear solid.

      We thank the Reviewer for their thoughtful assessment of this work. We have fully addressed each comment below in a point-by-point fashion.

      There are several noteworthy points when assessing the results. In Figure S1C, 100nM drug was toxic to cells at 72 hours and 1nM drug suppressed cell proliferation by 60%. Yet such concentrations were used in Figure 1B and C to argue CLK2 inhibition liberates YAP activity (which one would assume will increase cellular proliferation). In Figure 1C it appears that 1nM drug treatment led to some kind of cellular stress, as cells are visibly enlarged. In Figure 1D, 1nM drug, which would have suppressed cell growth by 60%, did not affect YAP phosphorylation. Taken together, it appears even though CLK2 inhibitor (at high concentrations) liberates YAP activity, its toxicity may override the potential use of this drug as a YAP-activator to salve tissue regenerative repair, which was one of the goals hinted in the background section.

      We do not claim that CLK2 inhibition is useful as a YAP activator, either as a precise pharmacological tool or as a therapeutic mechanism for inducing regenerative repair. Instead, the key finding of this work is to describe a novel, unanticipated cellular mechanism for activating YAP, one that should be considered when optimizing pharmacological candidates that modulate alternative splicing for diseases where potential proliferation is undesirable.

      However, to address this point, we have included additional experimentation. Specifically, we show that cytotoxicity with compound treatment at 24 hours, a timepoint at which we perform most evaluation of alternative splicing induced by compound, is considerably less than that observed at 72 hours. Now included as Figure S1C, this panel shows while the compound displays some cytotoxicity at ~1 nM at 72 hours, the half maximal inhibitory potency at 24 hours is ~300 nM. As such, we believe there is not incongruity between YAP activity, cellular proliferation, and SM04690-induced cytotoxicity. It is simply such that higher concentrations of compound, and thus increased engagement of CLK2 and other targets of the inhibitor, result in a cumulative cytotoxic effect over time.

      In Figure 2D, at 100nM concentration, the drug did not appear to affect AMOTL2 splicing. Even though at higher concentrations it did, this potentially put into question whether YAP activity liberated by this drug at 1nM (Fig 2A), 10-50nM (Fig 2C) concentrations is caused by altered AMOTL2 splicing. Discussions should be provided on the difference in drug concentrations in these experiments. Does the drug decay very fast, and is that why later studies required higher dose?

      We believe this comment is in reference to Fig. 3D, and we argue that, while faint, there is the presence of AMOTL2 splicing at 100 nM SM04690 treatment as seen by a faint lower molecular weight band. However, to further understand the extent to which AMOTL2 is alternatively spliced in response to compound treatment, we performed RT-qPCR analysis of AMOTL2 splicing with an expanded concentration response. These results indicate that high magnitude exon skipping of AMOTL2 occurs starting at 10 nM with 24-hour treatment of compound (now in the manuscript as Fig. S4A). This result matches with our data in Fig. 2C, wherein YAP phosphorylation begins decreasing at 10 nM SM04690 treatment.

      Likely impact of the work on the field: this study presented a high throughput screen method for YAP activators and showed that such an approach works. The hit compound found from ReFRAME library, a CLK2 inhibitor, may not be actually useful as a YAP activator, given its clear toxicity. Applying this screen method on other large compound libraries may help find a YAP activator that helps regenerative repair. The finding that CLK2 inhibition could alter AMOTL2 splicing to affect HIPPO pathway could bring a new angle to understanding the regulation of HIPPO pathway.

      Reviewer #2 (Public Review):

      In this manuscript, the authors have screened the ReFRAME library and identified candidate small molecules that can activate YAP. The found that SM04690, an inhibitor of the WNT signaling pathway, could efficiently activate YAP through CLK2 kinase which has been shown to phosphorylate SR proteins to alter gene alternative splicing. They further demonstrated that SM04690 mediated alternative splicing of AMOTL2 and rendered it unlocalized on the membrane. Alternatively spliced AMOTL2 prevented YAP from anchoring to the cell membrane which results in decreased YAP phosphorylation and activated YAP. Previous findings showed that WNT signaling more or less activates YAP. The authors revealed that an inhibitor of WNT signaling could activate YAP. Thus, these findings are potentially interesting and important. However, the present manuscript provided a lot of indirect data and lacked key experiments.

      We thank the Reviewer for their thorough review of this work. We have responded to each comment below.

      Major points:

      1. In Figure S3, since inhibition of CLK2 resulted in extensive changes in alternative splicing, why did the authors choose AMOTL2? How to exclude other factors such as EEF1A1 and HSPA5, do they affect YAP activation? Angiomotin-related AMOTL1 and AMOTL2 were identified as negative regulators of YAP and TAZ by preventing their nuclear translocation. It has been reported that high cell density promoted assembly of the Crumbs complex, which recruited AMOTL2 to tight junctions. Ubiquitination of AMOTL2 K347 and K408 served as a docking site for LATS2, which phosphorylated YAP to promote its cytoplasmic retention and degradation. How to determine that alternative splicing rather than ubiquitination of AMOTL2 affects YAP activity? Does AMOTL2 Δ5 affect the ubiquitination of AMOTL2? Does overexpression of AMOTL2 Δ5Δ9 cause YAP and puncta to co-localize?

      AMOTL2 is the relevant cellular target, because among the entire transcriptome it was the third most alternatively spliced in response to CLK2 inhibition (Fig. S3). No other targets relevant to the Hippo pathway were identified.

      We have shown that overexpression of exon skipped AMOTL2 (Fig. 3F) recapitulates the effect of compound, indicating that splicing per se is what drives the YAP activation phenotype. While AMOTL2 is ubiquitinated, these established sites of ubiquitination do not lie within exons 5 or 9. Thus, we anticipate that ubiquitination is less likely a driving factor in the observed phenotype. The manuscript is written as not to exclude this as a possibility, but it is downstream of what we describe, and we believe out of scope to explore this further in this preliminary report.

      1. The author proposed that AMOTL2 splicing isoform formed biomolecular condensates. However, there was no relevant experimental data to support this conclusion. AMOTL2 is located not only on the cell membrane but also on the circulating endosome of the cell, and the puncta formed after AMOTL2 dissociation from the membrane is likely to be the localization of the circulating endosome. The author should co-stain AMOTL2 with markers of circulating endosomes or conduct experiments to prove the liquidity of puncta to verify the phase separation of AMOTL2 splicing isoform.

      We do not claim AMOTL2 forms biomolecular condensates. Instead, we hypothesize in the Discussion section that AMOTL2 could possibly phase separate into biomolecular condensates based on its similarity to AMOT, which has been shown to phase separate and form cytoplasmic puncta (PMID: 36318920). AMOT has also been shown to colocalize with endosomes (PMID: 25995376), which also appear as puncta.

      1. The localization of YAP in cells is regulated by cell density, and YAP usually translocates to the nucleus at low cell density. In Figure 2E, the cell densities of DMSO and SM04690-treated groups are inconsistent. In Figure 4A, the magnification of t DMSO and SM04690-treated groups is inconsistent, and the SM04690treated group seems to have a higher magnification.

      In immunofluorescence experiments, cells were plated at the same density and grown for the same amount of time before treatment. Additionally, within an experiment, images were taken at the same magnification. Any apparent differences in cell density are due to effects of the compound.

      1. There have been many reports that the WNT signaling pathway and the Hippo signaling pathway can crosstalk with each other. The authors should exclude the influence of the WNT signaling pathway by using SM04690.

      While the WNT pathway has been shown to influence Hippo pathway activity, we have shown a direct effect of CLK2 inhibition by SM04690. Any WNT potential pathway effects are in addition to the splicing-based mechanism we described.

      Reviewer #3 (Public Review):

      This study on drug repurposing presents the identification of potent activators of the Hippo pathway. The authors successfully screen a drug library and identify two CLK kinase inhibitors as YAP activators, with SM04690 targeting specifically CLK2. They further investigate the molecular basis of SM04690-induced YAP activity and identify splicing events in AMOTL2 as strongly affected by CLK2 inhibition. Exon skipping within AMOTL2 decreases the interactions with membrane bound proteins and is sufficient to induce YAP target gene expression. Overall the study is well designed, the conclusions are supported by sufficient data and represent an exciting connection between alternative splicing and the HIPPO pathway. The specificity of the inhibitor towards CLK2 and the mode of action via AMOTL2 could be supported by further data:

      We thank the Reviewer for their close examination of our work. We respond below.

      1. The inconsistent inhibitor concentrations and varying results reported in the paper can be distracting. For instance, the response of endogenous targets to 100 nM concentration is described as a >5-fold increase in Figure 2B, whereas it is reported as a 1-1.5-fold response to 1000 nM in Figure 2D. This inconsistency should be addressed and clarified to provide a more accurate and reliable representation of the findings.

      In Figure 2D, we have transduced cells with lentivirus, which most likely suppresses their responsiveness to compound treatment. We have addressed the issue of varying inhibitor concentrations in response to Reviewer 1.

      1. In the absence of a strong inhibitor induced YAP target gene expression (Figure 2D), it is difficult to conclude the dependency on YAP expression, as investigated by siRNA mediated knockdown. In a similar experiment, the dependency of the inhibitor on CLK2 expression could be confirmed

      While the sample with Scramble virus does not respond to the same extent that WT HEK293A cells do (e.g., Fig. 2B), there is still responsiveness to compound. Likewise, YAP knockdown cells display statistically significant decreases in YAP-controlled transcripts. This decrease of transcript is therefore sufficient evidence that SM04690 requires YAP for its activity. We have shown that multiple CLK2 inhibitors recapitulate the effect of SM04690, abrogating the need to show dependency of CLK2.

      1. To further support the conclusion that CLK2 is the direct target of SM04690, it would be informative to investigate the effects of CLK1/4 inhibition on AMOTL2 exons (for example within RNA-seq data). If CLK1/4 inhibitors do not induce changes in AMOTL2 exons, it would strengthen the evidence for CLK2's role as the direct target. Including the results in the discussion would enhance the comprehensiveness of the study.

      We showed that CLK1/4 inhibition with small molecules ML167 and TG003 does not affect YAP activity in our luciferase reporter assay (Fig. S2D), which we believe is sufficient evidence that CLK1/4 is neither the direct target of SM04690 nor relevant to the splicing mechanism we describe.

      1. It would be important to determine the specific dose of SM04690 required to induce changes in AMOTL2 splicing. The authors observe that AMOTL2 protein levels appear unaffected at doses below 50 nM in Figure 3D, while YAP target genes are already affected at 20 nM in Figure 3G. Although Western blotting may not be the most sensitive method to detect minor changes in splicing, performing PCR experiments at lower doses could provide more insight into the splicing changes. Therefore, it is suggested that the authors include PCR experiments at lower doses to determine if changes in splicing are visible and to better establish the relationship between splicing and gene expression changes.

      We agree with the Reviewer that this experiment is essential to better understand splicing changes with SM04690 treatment. Accordingly, we have added RT-qPCR-based analysis of AMOTL2 exon inclusion at lower concentrations between 10 nM and 100 nM (Fig. S4A). We included a similar discussion in response to a point from Reviewer 1.

      Reviewer #1 (Recommendations For The Authors):

      As stated in the public review section, it will be helpful to discuss the differences in drug concentration. Although no one should require or expect a perfect drug dose match throughout any study, in this study the drug dose clearly demarcated when CLK2 inhibitor help/hurt proliferation, when CLK2 inhibitor was able to affect YAP phosphorylation, and when CLK2 inhibitor was able to affect AMOTL2 splicing. This is not to challenge the major conclusions of the paper, but it is hard to ignore if no discussion is provided.

      Several suggestions on data presentation:

      1. Scale bar information is missing in Fig. 2E, 4A and 4B.

      We have corrected this mistake in the revised manuscript.

      1. For Fig.3 D and 3E, it's better if kD information was labeled alongside the AMOTL2 Western blot.

      Thank you for the suggestion; we have added the appropriate labeling.

      1. It's better to label Figure2D as sh YAP-1, sh YAP-2; Figure 3A as sh CLK2-1, sh CLK2-2 etc. Currently they are all labeled shRNA-1, shRNA-2, which can be confusing.

      We have altered the labeling for clarity as requested.

      Reviewer #3 (Recommendations For The Authors):

      1. The use of asterisks in Figure 2D is unclear, especially their placement on the "Scramble" sample.

      We have amended the asterisks and have also added more detail to the figure legend.

      1. When designing primers for splicing-sensitive PCR, it is recommended that the skipping isoform is larger than 100 bp. This will help to avoid quantitative issues with ethidium bromide staining. In the results part, the text reads as if only the skipping isoform is present after SM04690 treatment.

      This experiment was performed to confirm the presence of exon skipping in the treated samples. Accordingly, we did not optimize the ethidium bromide staining of the lower bp bands. We will take the size of the isoform into consideration in any future experiments. We thank the reviewer for catching the textual error and have amended the text in the manuscript.

    1. Author Response

      The following is the authors’ response to the original reviews.

      Reviewer #1 (Recommendations For The Authors):

      My main request is to show the phylogeny in the main text, so the reader knows what nodes are being compared.

      Full phylogeny was added to the main text as Fig. 2. Additionally, phylogenetic tree in Newick format is presented as a Supplementary file 2.

      I also suggest the authors check their figure legends carefully. At least in figure one, I think there is some mix-up with the letter labelling of the panels.

      Our mistake. Figure legend was corrected. In this version of the manuscript Figure 1 was split into Fig. 1 and Fig. 3. Corrected version is presented in the legend to Fig. 3.

      And lastly, I urge the authors to deposit the tree, alignment, and reconstructed sequences in a public repository.

      Alignment in fasta format and phylogenetic tree in Newick format were added as supplementary files to the publication (supplementary file 1 and supplementary file 2, respectively). Reconstructed sequences (both Most likely and AltAll variants) were shown as a figure supplement (Figure 3 – figure supplement 2). Posterior probabilities for all positions of the reconstructed sequences were added as a supplementary file (supplementary file 3).

      Reviewer #2 (Recommendations For The Authors):

      -I find the term "secondarily single sHsp" to be a little confusing, especially because it is often used in relation to IbpA/B, but it is just IbpA in another species. I think it would be more clear for the reader to consistently refer to it as Erwiniaceae IbpA vs Escherichia IbpA, or something similar.

      In the introduction we clarified (page 4 lines 11-13) that the term “secondarily single” IbpA refers to IbpA that lacks partner protein as a result of ibpB gene loss. This is in opposition to “single-protein” IbpA from a clade in which gene duplication leading to creation of two – protein sHsp system did not occur (like Vibrionaceae or Aeromonadaceae) - see Obuchowski et al., 2019.

      -Figure 1B. The labels are not defined. What is L? A and B refer to IbpA and IbpB but this should be made more clear to the reader. Why is this panel only referred to in the Introduction and not the Results? Why is there a second panel for E.amy, rather than including it in the same panel, as for other experiments? What are the error bars? (That goes for every error bar in the paper, none are defined).

      Labels in Fig.1B were corrected; “L” was used in reference to “luciferase alone” and it has been corrected for consistency to “no sHsp”. The sHsps activity measurements (obtained in the same experiment) were split into two separate panels as a correspondence to the two branches of the simplified tree in Fig. 1. The figure was modified to make it clearer and avoid confusion. Definitions of error bars were added to this and other figures.

      -"AncA0 exhibited sequestrase activity on the level comparable to IbpA from Escherichia coli (IbpAE.coli). AncA1 was moderately efficient in this process and IbpA from Erwinia amylovora (IbpAE.amyl) was the least efficient sequestrase (Fig. 1D)." - First, this should be referring to Fig. 1C. Second, the text doesn't quite match the panel. A0 appears to have the strongest sequestrase activity over most concentrations. Can the authors comment on in what concentration range these differences are most meaningful?

      Figure legend was corrected. Descriptions of panels C and D were fixed. Now these data are presented in panels A and B of a new Fig. 3. In our opinion differences in sequestration are most meaningful at lower sHsp concentrations (in this case lower than 5 µM), as with high enough sHsp concentration even less effective sequestrases seem to be able to effectively sequester aggregated proteins. Comment about it was added to the main text (page 5, line 6)

      -"Ancestral proteins' interaction with the aggregated substrates was stronger than in the case of extant E. amylovora IbpA, but weaker than in the case of extant E. coli IbpA (Fig. 1C)." - Is this referring to Fig. 1C, or to the unlabelled panel on the bottom right panel of Fig 1 (that is not referred to in the legend)? Can the authors comment on why they think the 2 ancestral proteins are much more similar to each other than they are to either of the native IbpAs?

      Due to our mistake descriptions of panels C and D were switched.

      Figure 1 was rearranged and split into Figures 1 and 3. Former figure S1 (full phylogeny) was inserted into the main text, as Fig. 2, per request of reviewer #1. Former panel 1D (now 3B) was rearranged, as graph was not apparent to be a part of that panel and looked as if it was unlabeled.

      The fact that the two ancestral proteins are more similar to each other than to the extant E. coli and E. amylovora proteins in their interaction with model substrate might be caused by higher sequence identity between the two ancestral proteins than between ancestral and extant proteins (10 amino acid differences between AncA0 and AncA1 compared to 20 differences between AncA1 and IbpA from E. amylovora or 11 differences between AncA0 and IbpA from E. coli). One also has to remember that this property is only one aspect of sHsp activity – proteins AncA0 and AncA1 are much less similar to each other if other activities such as sequestrase activity are considered. Substrate affinity and sequestrase activity are connected to each other, but there isn’t a strict correlation, as can be seen in the case of free ACD domains, which strongly bind aggregated substrate while effectively lacking sequestrase activity (fig. 5 A, fig. 5 – figure supplement 4 A,B).

      -Figure 1E should have E. coli IbpA and IbpB, by themselves, included for comparison. Strangely, it seems, by comparison to Fig 1B, that the "inhibitory" activity of A0 is not present in the E. coli protein, and the authors should comment on this. Similarly, A1 disaggregation looks like it might not be significantly different than the E. coli protein. Can the authors comment on why disaggregation might be so low in A1 compared to E.amy?

      E. coli IbpA alone was added to Fig. 1E (Fig. 3C in the new version) as suggested.

      AncA1 indeed exhibits similar activity to extant IbpA from E. coli, which, at the conditions of the experiment, does not possess inhibitory effect observed for AncA0. This suggests that:

      -There was an additional increase in ability to stimulate luciferase disaggregation between AncA1 and extant IbpA from E. amylovora

      -There was also an increase of ability to stimulate luciferase refolding between AncA0 and extant E. coli IbpA, albeit to a significantly lesser degree than in the Erwiniaceae branch.

      It is quite likely that after separation of Erwiniaceae and Enterobacteriaceae sHsp systems, they underwent further optimization through evolution. This might have led to observed higher effectiveness of modern IbpAs from both clades in refolding stimulation in comparison to the reconstructed ancestral proteins.

      Despite the above, effects of substitutions on positions 66 and 109 on activities of the extant E. coli and E. amylovora proteins suggests that the two identified positions still play key role in differentiating extant IbpAs from Erwiniaceae and Enterobacteriaceae.

      Nevertheless, additional mutations that lead to increased ability to stimulate luciferase reactivation must have occurred in both Erwiniaceae and Enterobacteriaceae branches of the phylogeny during evolution. These substitutions would be a worthwhile subject of further study.

      -Fig 1D - lizate should be lysate.

      The typo was corrected.

      -What is the bottom right panel in Fig 1? It doesn't seem to be referred to in the legend.

      This panel was intendent to be the part of figure 1D, but it was not clearly visible. This figure was rearranged to make it clearer. Now these data are presented as Fig. 3B.

      -Sequences are provided for the ancestral proteins, but I don't see them anywhere for the alternative ancestral proteins. How similar are the Anc proteins to the AltAlls? If they are very similar, this may not tell us anything about "robustness".

      Sequences of alternative proteins are added as a figure supplement (Fig. 3 - figure supplement 2). Full sequences of ML and alternative ancestors with posterior probabilities for each reconstructed position are presented in supplementary file 3

      The testing of the robustness to statistical uncertainty was intended to test to what extent properties of reconstructed ancestral proteins could be influenced by uncertainty present in a given reconstruction due to probabilistic nature of the process. Relatively high similarity between ML and AltAll sequences would indicate low uncertainty of the reconstruction (most likely due to high conservation during evolution). In such a case similar properties of AltAll and ML proteins would simply indicate that they are robust to the level of uncertainty present in a given reconstruction (which may be low). It would not tell us much about “general” robustness to mutations, but it was not relevant to research questions considered.

      -If the functional gain by IbpA comes down to only two amino acid substitutions, I'm not convinced this would be meaningfully reflected in any tests of positive selection.

      After considering Reviewer #1’s comments about limitations of models used for selection analysis we added acknowledgment in the discussion (page 9, line 9 - 13) that results indicating positive selection in our dataset should not be considered conclusive (see answer to Reviewer #1’s public review below).

      -The full MSA should be provided as supplemental material.

      The full MSA in fasta format is presented in the supplementary file 1.

      -For the aggregate binding panels in Figs 3 and 4, it would be helpful to show the native and ancestral proteins for comparison. I know this is a bit redundant, as they're present in Fig 1, but I find it hard to judge the scale of change. This is especially important because A0 and A1 are very similar in Fig 1, so I want to see what kind of difference the 2 mutations make.

      Data presented in Fig. 3C (Fig. 5C in the new version) refer to the binding of α-crystallin domains (A0ACD and A0ACD Q66H G109D) and not full length sHsps to E. coli proteins aggregated on a BLI sensor. Our intention was to show the influence of the two crucial substitutions (Q66H G109D) on the properties of A0 ancestral α-crystallin domain.

      Figure 4 (Fig. 6 in the new version) represent the effects of the substitutions on the identified positions 66 and 109 on the properties of extant IbpA orthologs from E. coli and E. amylovora, showing that these two positions play a key role in differentiating properties of those extant proteins. Changes in binding to aggregated substrate caused by those substitutions, as shown in Figure 6 B,C (new version), are indeed larger than observed between AncA0 and AncA1, as shown in Fig. 3B (new version).

      One has to remember, however, that the experiment shown in Fig.3 (new version) shows the effects of all 10 amino acid changes between the nodes A0 and A1 and not only the two analyzed substitutions, as was the case in experiment shown in Fig. 6 B,C (new version). Moreover, due to relatively large number of differences between ancestral and extant sequences (11 differences between AncA0 and E. coli IbpA, 20 differences between AncA1 and E. amylovora IbpA), substitutions in the two experiments are introduced into different sequence context.

      Because of the above, we believe that direct comparison of the results obtained for ancestral proteins with the results obtained for substitutions introduced into extant proteins would not meaningfully contribute to answering the question of the role of analyzed substitution in the context of extant proteins, while decreasing clarity of presented information.

      -Some of the luciferase plots show a time course, but others just show a single %. What is the time point used for the single % plots?

      Information was added to appropriate figure legends that for experiments showing a single timepoint the luciferase activity was measured after 1h of refolding.

      Reviewer #3 (Recommendations For The Authors):

      1. In the Introduction, it would be beneficial to explore additional instances where this evolutionary simplification process has been observed in nature. Investigating the prevalence of this phenomenon and identifying other multi-protein systems that have undergone simplification could enhance the understanding of its significance and implications.

      The section of the introduction concerning gene loss and differential paralog retention was expanded with additional examples of gene loss that is considered adaptive (page 3 lines 1 - 12).

      1. I am intrigued by the reasons why certain organisms continue to maintain a two-protein system despite the viability of a single-protein system. This aspect is particularly relevant for bacteria, considering the fitness cost associated with maintaining extra gene copies. Do you have any hypotheses or theories that may shed light on this intriguing observation?

      Refolding of proteins from aggregates requires the functional cooperation of sHsps and chaperones from Hsp70 system and Hsp100 disaggregase. In two protein sHsps system one sHsp (IbpA) is specialized in substrate binding, while the second one (IbpB) possesses low substrate binding potential and enhances sHps dissociation from substrates (Obuchowski et al, 2019). Thus, the presence of IbpB reduces the amount of chaperones from Hsp70 system required to outcompete sHsps from aggregated substrates to initiate refolding process. The cost associated with maintaining extra sHsp gene copy (ibpB) in bacteria might be compensated by lower requirement for Hsp70 chaperones for efficient and fast protein refolding following stress conditions.

      In this study we have demonstrated how such a system could have been simplified to a single – protein system capable of efficient substrate sequestration as well as stimulation of reactivation. This indeed leads to the question why such single – protein system isn’t more prevalent in Enterobacterales.

      One possibility may be that there are very specific requirements for efficient reactivation by a single – protein sHsp system. We have shown that new, more efficient IbpA functionality observed in Erwiniaceae required at least two separate mutations. It is possible, that such combinations of two substitutions simply did not occur in Enterobacteriaceae clade, in which IbpA still required partner protein for efficient reactivation stimulation.

      One must also remember that experiments performed in this study were performed in vitro in a specific set of conditions, which most likely does not represent whole spectrum of challenges faced by different bacteria. It is possible that two – protein system has some other additional adaptive effects, counterbalancing the additional cost of gene maintenance. It was for example recently shown (Miwa & Taguchi, PNAS, 120 (32) e2304841120) that bacterial sHsps play an important role in regulation of stress response. Two – protein system could potentially allow for more complex regulation.

      1. Incorporating X-ray crystallization as an additional technique in the methodology would offer detailed molecular insights into the effects of Q66H and G109D substitutions on ACD-C-terminal peptide and ACD-substrate interactions. The inclusion of such data would further strengthen the results section and provide robust support for your findings. Since the x-ray data might be difficult to collect, the authors might think to get alphafold model or some rosetta score for the model to discuss the finding further.

      In response to reviewer comment we added the comparison of the structural models of AncA0 and AncA0 Q66H G109D ACD dimers complexed with the C-terminal peptides, representing middle structures of largest clusters obtained from equilibrium molecular dynamics simulation trajectories based on the AlphaFold2 prediction and in silico mutagenesis (Fig. 5 – figure supplement 2). Model comparison as well as C-terminal peptide – ACD contact analysis did not reveal any major changes in mode of peptide binding or α-crystallin domain conformation, although we do acknowledge that simulation timescale limits the conformational sampling.

      Reviewer #1 (Public Review):

      The work in this paper is in general done carefully. Reconstructions are done appropriately and the effects of statistical uncertainty are quantified properly. My only slight complaint is that I couldn't find statistics about posterior probabilities anywhere and that the sequences and trees do not seem to be deposited.

      Posterior probabilities for all positions of reconstructed proteins were added as a supplementary file 3. MSA of all sequences used for ancestral reconstruction as well as phylogenetic tree in Newick format were added as supplementary files 1 and 2, respectively.

      I would also have preferred to have the actual phylogeny in the main text. This is a crucial piece of data that the reader needs to see to understand what exactly is being reconstructed.

      Full phylogeny was added to the main text as Fig. 2.

      The paper identifies which mutations are crucial for the functional differences between the ancestors tested. This is done quite carefully - the authors even show that the same substitutions also work in extant proteins. My only slight concern was the authors' explanation of what these substitutions do. They show that these substitutions lower the affinity of the C-terminal peptide to the alpha-crystallin domain - a key oligomeric interaction. But the difference is very small - from 4.5 to 7 uM. That seems so small that I find it a bit implausible that this effect alone explains the differences in hydrodynamic radius shown in Figure S8. From my visual inspection, it seems that there is also a noticeable change in the cooperativity of the binding interaction. The binding model the authors use is a fairly simple logarithmic curve that doesn't appear to consider the number of binding sites or potential cooperativity. I think this would have been nice to see here.

      The binding model we used is equivalent to the Hill equation as it accounts for the variable slope of sigmoid function by inclusion of input scaling factor k, which is equivalent to the hill coefficient. Simple one site binding model and two site binding model were also considered but provided worse fits to the data than model including binding cooperativity. Not providing values of fitted parameter k was our mistake, and it was corrected (Fig. 5. with a legend). Additionally, output scaling parameter L is not necessary as fraction bound takes values from 0 to 1, therefore we have fitted the curves again without this parameter. The new values of fitted parameters are very similar to the previous ones. To make text more accessible to the reader, we have used a conventional form of Hill equation. Indeed, AncA0 Q66H G109D ACD displays higher binding cooperativity than more ancestral AncA0 ACD (hill coefficient 2.3 for AncA0 vs 3.7 for AncA0 Q66H G109D). Fitted values of Hill coefficients are higher than one can expect for 2-site ACD dimer, which is probably caused by an experimental setup of BLI, where C-terminal peptide is immobilized on the sensor and ACD is present in solution as bivalent analyte leading to emergence of avidity effects. Both cooperativity and avidity are reflected in the value of Hill coefficient, however as ligand density on the sensor is the same in all experiments only change in ACD binding cooperativity can account for observed difference in the value of Hill coefficients. Difference in the C-terminal peptide binding cooperativity may influence the process of sHsp oligomerization and assembly formation despite similar binding affinity, especially if avidity of multiple binding sites within oligomer is considered.

      In addition, we changed the legend to Figure S8 (now called Fig. 5 – figure supplement 4A ) to clarify the fact that the differences in average hydrodynamic radius are in fact ferly small. To highlight the observation that there are two populations of particles in AncA0 and AncA0 Q66H G109D measured at 25, 35 and 45 °C with different hydrodynamic diameters, we used % of intensity in DLS measurement. It allows us to show the change in the hydrodynamic diameter distribution that is relatively small. We recognize it was not properly explained in the article and added a clarification in figure description.

      Lastly, the authors use likelihood methods to test for signatures of selection. This reviewer is not a fan of these methods, as they are easily misled by common biological processes (see PMID 37395787 for a recent critique). Perhaps these pitfalls could simply be acknowledged, as I don't think the selection analysis is very important to the impact of the work.

      We thank the reviewer for pointing to the recent research about limitations of methods used in our work in selection analysis. As per recommendation we added acknowledgment of limitations of methods used to discussion (page 9, line 9 - 13), modifying wording of our conclusions to deemphasize significance of selection analysis results.

    1. Author Response:

      We thank the editors and reviewers for their time in reviewing our manuscript. We would like to post a brief response to the peer reviews at this stage, and we will revise the manuscript and re-post at a later time.

      The main concerns regarding our molecular dating approach consist of the limited number of marker genes used for phylogenetic reconstruction, the molecular clock model employed, and the calibrations used. Firstly, regarding the marker genes that we used in our phylogenetic reconstruction, we will point out that we have extensively benchmarked these methods in a previous study (Martinez-Gutierrez and Aylward, 2021). We initially planned on presenting all of these results together in the same manuscript, but we decided that benchmarking phylogenetic marker genes across all Bacteria and Archaea together with an extensive molecular dating analysis was too much for a single study, and we therefore divided the results into two papers. In short, we agree with R1 that the use of different marker genes will lead to marked differences in the posterior ages of our Bayesian molecular dating analysis; however, we demonstrated that several of the few marker genes shared between Bacteria and Archaea lack of a strong phylogenetic signal and therefore introduce topological biases in the final phylogeny (i.e., long branch attraction). Consequently, using poorly-performing marker genes for molecular dating does not add valuable information to the overall analysis.

      Secondly, regarding the autocorrelated Log-normal model used in our study (-ln on Phylobayes), we believe this is appropriate. Besides being biologically meaningful for our study, it represents a compromise between a relaxed model with rate variation across branches and the assumption of correlation between parent and descent branches (Thorne et al., 1998). In contrast, a fully uncorrelated model that assumes rate independence across branches would make our analysis extremely time-consuming and intractable given our study encompasses all of Bacteria and Archaea. Nonetheless we understand the concerns raised, and in a future manuscript we will include age estimates resulting from the CIR and UGAM models in order to explore the potential effect of model selection in posterior dates.

      Thirdly and lastly, we will point out that calibrations for molecular dating of Bacteria and Archaea are always highly controversial, and there are essentially no calibrations for the early evolution of life on Earth that would not be contested to some degree. Researchers are therefore left to use their best judgment and provide reasonable rationale, which we have done here. We understand that strong opinions abound in this area, and many researchers will disagree with our approach, but that alone does not invalidate our study. Moreover, the main novelty of our approach is the use of a large tree that combines Bacteria and Archaea; extensive benchmarking of different calibration points on such a large tree is not possible here as it may be on a smaller set. One of the main concerns is the use of the age estimate of the Great Oxidation Event (GOE, 2.4 Ga) as minimum and maximum constraints for oxygenic Cyanobacteria, and Ammonia Oxidizing Archaea and aerobic Marinimicrobia, respectively. We agree that oxygen may have existed before the GOE as proposed previously (e.g., Ostrander et al., 2021), however; the strongest geochemical evidence so far (Mass Independent Fractionation of Sulfur, MIFs, (Farquhar et al., 2000)) indicates a significant accumulation of oxygen around that time. We therefore feel that this is a reasonable calibration to use for microbial lineages that have a physiology that is tightly linked to the production or consumption of oxygen. Similar reasoning has been used in other molecular dating studies, so our logic is not out of step with much research in the field (Liao et al., 2022; Ren et al., 2019).

      Due to the limitations of molecular dating studies of microorganisms, we have been very careful to avoid strong conclusions based on the absolute dates we calculated, and the primary interest of readers will likely be the relative divergence times of the marine clades we study (i.e., the overall timeline of microbial diversification in the ocean). We will provide a more in-depth assessment of models and calibrations for Bacteria and Archaea in a future draft, but in the meantime we hope to convey that our study is not without merit despite the substantial challenges of research in this area.

      References:

      • Farquhar J, Bao H, Thiemens M. 2000. Atmospheric influence of Earth’s earliest sulfur cycle. Science 289:756–759.
      • Liao T, Wang S, Stüeken EE, Luo H. 2022. Phylogenomic Evidence for the Origin of Obligate Anaerobic Anammox Bacteria Around the Great Oxidation Event. Mol Biol Evol 39. doi:10.1093/molbev/msac170
      • Martinez-Gutierrez CA, Aylward FO. 2021. Phylogenetic Signal, Congruence, and Uncertainty across Bacteria and Archaea. Mol Biol Evol 38:5514–5527.
      • Ren M, Feng X, Huang Y, Wang H, Hu Z, Clingenpeel S, Swan BK, Fonseca MM, Posada D, Stepanauskas R, Hollibaugh JT, Foster PG, Woyke T, Luo H. 2019. Phylogenomics suggests oxygen availability as a driving force in Thaumarchaeota evolution. ISME J 13:2150–2161.
      • Ostrander CM, Johnson AC, Anbar AD. 2021. Earth's first redox revolution. Annu Rev Earth Planet Sci. 49, 337-366.
      • Thorne JL, Kishino H, Painter IS. 1998. Estimating the rate of evolution of the rate of molecular evolution. Mol Biol Evol 15:1647–1657.
    2. Author Response

      The following is the authors’ response to the original reviews.

      Thank you for your time and effort in handling and reviewing our manuscript. We have responded to all comments below.

      Reviewer #1 (Public Review):

      Martinez-Gutierrez and colleagues presented a timeline of important bacteria and archaea groups in the ocean and based on this they correlated the emergence of these microbes with GOE and NOE, the two most important geological events leading to the oxygen accumulation of the Earth. The whole study builds on molecular clock analysis, but unfortunately, the clock analysis contains important errors in the calibration information the study used, and is also oversimplified, leaving many alternative parameters that are known to affect the posterior age estimates untested. Therefore, the main conclusion that the oxygen availability and redox state of the ocean is the main driver of marine microbial diversification is not convincing.

      We do not conclude that “oxygen availability and redox state of the ocean is the main driver of marine microbial diversification”. Our conclusion is much more nuanced. We merely discuss our findings in light of the major oxygenation events and oxygen availability (among other things) given the important role this molecule has played in shaping the redox state of the ocean.

      Regarding the methodological concerns, to address them we have provided additional analyses to account for different clock models and calibration points.

      Basically, what the molecular clock does is to propagate the temporal information of the nodes with time calibrations to the remaining nodes of the phylogenetic tree. So, the first and the most important step is to set the time constraints appropriately. But four of the six calibrations used in this study are debatable and even wrong.

      (1) The record for biogenic methane at 3460 Ma is not reliable. The authors cited Ueno et al. 2006, but that study was based on carbon isotope, which is insufficient to demonstrate biogenicity, as mentioned by Alleon and Summons 2019.

      Thank you for pointing out the limitations of using the geochemical evidence of methane as calibrations. Indeed, several commentaries have suggested that the biotic and abiotic origin of the methane reported by Ueno et al. are equally plausible (Alleon and Summons, 2019; Lollar and McCollom, 2006), however; we used that calibration as a minimum for the presence of life on Earth, not methanogenesis. Despite the controversy regarding the origin of methane, there are other lines of evidence suggesting the presence of life around ~3.4 Ga. For example stromatolites from the Dresser Formation, Pilbara, Western Australia (Djokic et al., 2017; Walter et al., 1980; Buick and Dunlop, 1990), and more recently (Hickman-Lewis et al., 2022). To avoid confusion, we have added a more extended explanation for the use of that calibration and additional evidence of life around that time in Table 1 and lines 100-104.

      (2) Three calibrations at Aerobic Nitrososphaerales, Aerobic Marinimicrobia, and Nitrite oxidizing bacteria have the same problem - they are all assumed to have evolved after the GOE where the Earth started to accumulate oxygen in the atmosphere, so they were all capped at 2320 Ma. This is an important mistake and will significantly affect the age estimates because maximum constraint was used (maximum constraint has a much greater effect on age estimates and minimum constraint), and this was used in three nodes involving both Bacteria and Archaea. The main problem is that the authors ignored the numerous evidence showing that oxygen can be produced far before GOE by degradation of abiotically-produced abundant H2O2 by catalases equipped in many anaerobes, also produced by oxygenic cyanobacteria evolved at least 500 Ma earlier than the onset of GOE (2500 Ma), and even accumulated locally (oxygen oasis). It is well possible that aerobic microbes could have evolved in the Archaean.

      We appreciate the suggestion of assessing the validity of the calibrations used in our analyses. We initially evaluated the informative power of the priors used for the Bayesian molecular dating (Supplemental File 5), and found that the only calibration that lacked enough information for the purposes of our study was Ammonia Oxidizing Archaea (AOA). In contrast to previous evidence (Ren et al., 2019; Yang et al., 2021), we associate this finding to the potential earlier diversification of AOA. Due to the limitations of several of the calibrations used, we performed an additional molecular dating analysis on 1000 replicate trees using a Penalized Likelihood strategy. This analysis consisted in excluding the calibrations that assumed the presence of oxygen as a maximum constraint. Our analysis shows similar age estimates of the marine microbial clades regardless of the exclusion of these calibrations (Supplemental File 8; TreePL Priors set 2). Our findings thus suggest that the age estimates reported in our study are consistent regardless of whether or not the presence of oxygen is used to calibrate several nodes in the tree. We describe the results of this analysis in lines 490-499 and include estimates in Supplemental File 8. Our results are therefore robust regardless of the use of these somewhat controversial calibrations.

      Once the phylogenetic tree is appropriately calibrated with fossils and other time constraints, the next important step is to test different clock models and other factors that are known to significantly affect the posterior age estimates. For example, different genes vary in evolutionary history and evolutionary rate, which often give very different age estimates. So it is very important to demonstrate that these concerns are taken into account. These are done in many careful molecular dating studies but missing in this study.

      We agree that the selection of marker genes will have a profound impact on the final age estimates. First, it is important to understand that very few genes present in modern Bacteria and Archaea can be traced back to the Last Universal Common Ancestor, so there are very few genes to use for this purpose. Studies that focus on particular groups of Bacteria and Archaea may have larger selections of genes to choose from, but for our purposes there are only about ~40 different genes - mostly encoding for ribosomal proteins, RNA polymerase subunits, and tRNA synthetases - that can be use for this purpose (Creevey et al., 2011; Wu and Scott, 2012). In a previous study we have extensively benchmarked methods for the reconstruction of high-resolution phylogenetic trees of Bacteria and Archaea using these genes (Martinez-Gutierrez and Aylward, 2021). Our analyses demonstrated that some of these genes (mainly tRNA synthetases) have undergone ancient lateral gene transfer events and are not suitable for deep phylogenetics or molecular dating. In this previous study we also evaluated different sets of marker genes to examine which provide the most robust phylogenetic inference. We arrived at a set of ribosomal proteins and RNA polymerase subunits that performs best for phylogenetic reconstruction, and we have used that in the current study.

      Furthermore, we tested the role of molecular dating model selection on the final Bayesian estimates by running four independent chains under the models UGAM and CIR, respectively. Overall, the results did not vary substantially compared with the ages obtained using the log-normal model reported on our manuscript (Supplemental File 8). The additional results are described in lines 478-488 and shown in Supplemental File 8. The clades that showed more variation when using different Bayesian models were SAR86, SAR11, and Crown Cyanobacteria (Supplemental File 8). Despite observing some differences in the age estimates when using different molecular models, the conclusion that the different marine microbial clades presented in our study diversified during distinct periods of Earth’s history remains. Moreover, the main goal of our study is to provide a relative timeline of the diversification of abundant marine microbial clades without focusing on absolute dates.

      Reviewer #2 (Public Review):

      In this paper, Martinez-Gutierrez and colleagues present a dated, multidomain (= Archaea+Bacteria) phylogenetic tree, and use their analyses to directly compare the ages of various marine prokaryotic groups. They also perform ancestral gene content reconstruction using stochastic mapping to determine when particular types of genes evolved in marine groups.

      Overall, there are not very many papers that attempt to infer a dated tree of all prokaryotes, and this is a distinctive and up-to-date new contribution to that oeuvre. There are several particularly novel and interesting aspects - for example, using the GOE as a (soft) maximum age for certain groups of strictly aerobic Bacteria, and using gene content enrichment to try to understand why and how particular marine groups radiated.

      Thank you for your thorough evaluation and comments on our manuscript.

      Comments

      One overall feature of the results is that marine groups tend to be quite young, and there don't seem to be any modern marine groups that were in the ocean prior to the GOE. It might be interesting to study the evolution of the marine phenotype itself over time; presumably some of the earlier branches were marine? What was the criterion for picking out the major groups being discussed in the paper? My (limited) understanding is that the earliest prokaryotes, potentially including LUCA, LBCA and LACA, was likely marine, in the sense that there would not yet have been any land above sea level at such times. This might merit discussion in the paper. Might there have been earlier exclusively marine groups that went extinct at some point?

      Thank you for pointing this out - this is a very interesting idea.<br /> Firstly, the major marine lineages that we study here have largely already been defined in previous studies and are known to account for a large fraction of the total diversity and biomass of prokaryotes in the ocean. For example, Giovannoni and Stingl described most of these groups previously when discussing cosmopolitan and abundant marine lineages (Giovannoni and Stingl, 2005). The main criteria to select the marine clades studied here are 1) these groups have large impacts in the marine biogeochemical cycles and represent a large fraction of the microbial biomass in the open ocean, 2) they have an appropriate representation on genomic databases such that they can be confidently included in a phylogenetic tree, 3) the clades included can be confidently classified as being marine, in the sense that consequently the last common ancestor had a marine origin. This is explained in lines 83-86. We were primarily interested in lineages that encompassed a broad phylogenetic breadth, and we therefore did not include many groups that can be found in the ocean but are also readily isolated from a range of other environments (i.e., Pseudomonas spp., some Actinomycetes, etc.).

      We agree that some of the earlier microbial branches in the Tree of Life were likely marine. The study of the marine origin of LUCA, LBCA, LACA, although interesting, is out of the scope of our study, and our results cannot offer any direct evidence of their habitat. We have therefore sought to focus on the origins of extant marine lineages.

      What do the stochastic mapping analyses indicate about the respective ancestors of Gracilicutes and Terrabacteria? At least in the latter case, the original hypothesis for the group was that they possessed adaptations to life on land - which seems connected/relevant to the idea of radiating into the sea discussed here - so it might be interesting to discuss what your analyses say about that idea.

      Thank you for your recommendation to perform additional analysis regarding the characterization of the ancestor of the superphyla Gracilicutes and Terrabacteria. We agree that this analysis would be very interesting, but we wish to focus the manuscript primarily on the marine clades in question, and other supergroups are listed in Figure 2 mainly for context. However, we did check the results of the stochastic mapping analysis and we now report the list of genes predicted to be gained and lost at the ancestor of the Gracilicutes and Terrabacteria clades, however; it is out of the scope of this study.

      I very much appreciate that finding time calibrations for microbes is challenging, but I nonetheless have a couple of comments or concerns about the calibrations used here:

      The minimum age for LBCA and LACA (Nodes 1 and 2 in Fig. 1) was calibrated with the earliest evidence of biogenic methane ~3.4Ga. In the case of LACA, I suppose this reflects the view that LACA was a methanogen, which is certainly plausible although perhaps not established with certainty. However, I'm less clear about the logic of calibrating the minimum age of Bacteria using this evidence, as I am not aware that there is much evidence that LBCA was a methanogen. Perhaps the line of reasoning here could be stated more explicitly. An alternative, slightly younger minimum age for Bacteria could perhaps be obtained from isotope data ~3.2Ga consistent with Cyanobacteria (e.g., see https://pubmed.ncbi.nlm.nih.gov/30127539/).

      Thank you for pointing this out. We used the presence of methane as a minimum for life on Earth, not as a minimum for methanogenesis. Despite using this calibration as a minimum for the root of Bacteria and not having methanogenic representatives within this domain, there are independent lines of evidence that point to the presence of microbial life around the same time (~3.5 Ga, for example stromatolites from the Dresser Formation, Pilbara, Western Australia (~3.5 Ga) (Djokic et al., 2017; Walter et al., 1980; Buick and Dunlop, 1990), and more recently (Hickman-Lewis et al., 2022). We added a rationale for the use of the evidence of methane as a minimum age for life on Earth to the manuscript (Table 1 and 100104).

      I am also unclear about the rationale for setting the minimum age of the photosynthetic Cyanobacteria crown to the time of the GOE. Presumably, oxygen-generating photosynthesis evolved on the stem of (photosynthetic) Cyanobacteria, and it therefore seems possible that the GOE might have been initiated by these stem Cyanobacteria, with the crown radiating later? My confusion here might be a comprehension error on my part - it is possible that in fact one node "deeper" than the crown was being calibrated here, which was not entirely clear to me from Figure 1. Perhaps mapping the node numbers directly to the node, rather than a connected branch, would help? (I am assuming, based on nodes 1 and 2, that the labels are being placed on the branch directly antecedent to the node of interest)?

      Thank you so much for your suggestion. As pointed out, the calibrations used were applied at the crown node of existing Cyanobacterial clades, not at the stem of photosynthetic Cyanobacteria. We agree that photosynthesis and therefore the production of molecular oxygen may have been present in more ancient Cyanobacterial clades, however; these groups have not been discovered yet or went extinct. We have improved Fig. 1 to avoid confusion and now it is part of the updated version of our manuscript.

      Alleon J, Summons RE. 2019. Organic geochemical approaches to understanding early life. Free Radic Biol Med 140:103–112.

      Buick R, Dunlop JSR. 1990. Evaporitic sediments of Early Archaean age from the Warrawoona Group, North Pole, Western Australia. Sedimentology 37: 247-277.

      Creevey CJ, Doerks T, Fitzpatrick DA, Raes J, Bork P. 2011. Universally distributed single-copy genes indicate a constant rate of horizontal transfer. PLoS One 6:e22099.

      Djokic T, Van Kranendonk MJ, Campbell KA, Walter MR, Ward CR. 2017. Earliest signs of life on land preserved in ca. 3.5 Ga hot spring deposits. Nat Commun 8:15263.

      Giovannoni SJ, Stingl U. 2005. Molecular diversity and ecology of microbial plankton. Nature 437: 343-348. Hickman-Lewis K, Cavalazzi B, Giannoukos K, D'Amico L, Vrbaski S, Saccomano G, et al. 2023. Advanced two-and three-dimensional insights into Earth's oldest stromatolites (ca. 3.5 Ga): Prospects for the search for life on Mars. Geology 51: 33-38.

      Lollar BS, McCollom TM. 2006. Geochemistry: biosignatures and abiotic constraints on early life. Nature. Martinez-Gutierrez CA, Aylward FO. 2021. Phylogenetic Signal, Congruence, and Uncertainty across Bacteria and Archaea. Mol Biol Evol 38:5514–5527.

      Ren M, Feng X, Huang Y, Wang H, Hu Z, Clingenpeel S, Swan BK, Fonseca MM, Posada D, Stepanauskas R, Hollibaugh JT, Foster PG, Woyke T, Luo H. 2019. Phylogenomics suggests oxygen availability as a driving force in Thaumarchaeota evolution. ISME J 13:2150–2161.

      Walter M R, R Buick, JSR Dunlop. 1980. Stromatolites 3,400–3,500 Myr old from the North pole area, Western Australia. Nature 284: 443-445.

      Wu M, Scott AJ. 2012. Phylogenomic analysis of bacterial and archaeal sequences with AMPHORA2. Bioinformatics 28:1033–1034.

      Yang Y, Zhang C, Lenton TM, Yan X, Zhu M, Zhou M, Tao J, Phelps TJ, Cao Z. 2021. The Evolution Pathway of Ammonia-Oxidizing Archaea Shaped by Major Geological Events. Mol Biol Evol 38:3637–3648.

    1. Author Response

      Reviewer #1 (Public Review):

      Summary:

      This work successfully identified and validated TRLs in hepatic metastatic uveal melanoma, providing new horizons for enhanced immunotherapy. Uveal melanoma is a highly metastatic cancer that, unlike cutaneous melanoma, has a limited effect on immune checkpoint responses, and thus there is a lack of formal clinical treatment for metastatic UM. In this manuscript, the authors described the immune microenvironmental profile of hepatic metastatic uveal melanoma by sc-RNAseq, TCR-seq, and PDX models. Firstly, they identified and defined the phenotypes of tumor-reactive T lymphocytes (TRLs). Moreover, they validated the activity of TILs by in vivo PDX modeling as well as in vitro co-culture of 3D tumorsphere cultures and autologous TILs. Additionally, the authors found that TRLs are mainly derived from depleted and late-activated T cells, which recognize melanoma antigens and tumor-specific antigens. Most importantly, they identified TRLs-associated phenotypes, which provide new avenues for targeting expanded T cells to improve cellular and immune checkpoint immunotherapy.

      Strengths:

      Jonas A. Nilsson, et al. has been working on new therapies for melanoma. The team has also previously performed the most comprehensive genome-wide analysis of uveal melanoma available, presenting the latest insights into metastatic disease. In this work, the authors performed paired sc-RNAseq and TCR-seq on 14 patients with metastatic UM, which is the largest single-cell map of metastatic UM available. This provides huge data support for other studies of metastatic UM.

      We thank the reviewer for these kind words about our work.

      Weaknesses:

      Although the paper does have strengths in principle, the weaknesses of the paper are that these strengths are not directly demonstrated. That is, insufficient analyses are performed to fully support the key claims in the manuscript by the data presented. In particular:

      The author's description of the overall results of the article should be logical, not just a description of the observed phenomena. For example, the presentation related to the results of TRLs lacked logic. In addition, the title of the article emphasizes the three subtypes of hepatic metastatic UM TRLs, but these three subtypes are not specifically discussed in the results as well as the discussion section. The title of the article is not a very comprehensive generalization and should be carefully considered by the authors.

      We thank the reviewer for the critical reading of our work. We agree that there is need of more discussion and will do this in a revised version.

      The authors' claim that they are the first to use autologous TILs and sc-RNAseq to study immunotherapy needs to be supported by the corresponding literature to be more convincing. This can help the reader to understand the innovation and importance of the methodology.

      We will go through the manuscript and literature to see where there might be missing references.

      In addition, the authors argue that TILs from metastatic UM can kill tumor cells. This is the key and bridging point to the main conclusion of the article. Therefore, the credibility of this conclusion should be considered. Metastatic UM1 and UM9 remain responsive to autologous tumors under in vitro conditions with their autologous TILs.

      UM1 responds also in vivo in the subcutaneous model in the paper. We have also finished an experiment where we show that this model also responds in a liver metastasis model. These data will be added in next version of the paper.

      In contrast, UM22, also as a metastatic UM, did not respond to TIL treatment. In particular, the presence of MART1-responsive TILs. The reliability of the results obtained by the authors in the model of only one case of UM22 liver metastasis should be considered. The authors should likewise consider whether such a specific cellular taxon might also exist in other patients with metastatic UM, producing an immune response to tumor cells. The results would be more comprehensive if supported by relevant data.

      The reviewer has interpreted the results absolutely right, the allogenic and autologous MART1-specific TILs cells while reactive in vitro against UM22, cannot kill this tumor either in a subcutaneous or liver metastases model. We hypothesize this has to do with an immune exclusion phenotype and show weak immunohistochemistry that suggest this. We hope the addition of more UM1 data can be viewed as supportive of tumor-reactivity also in vivo.

      In addition, the authors in that study used previously frozen biopsy samples for TCR-seq, which may be associated with low-quality sequencing data, high risk of outcome indicators, and unfriendly access to immune cell information. The existence of these problems and the reliability of the results should be considered. If special processing of TCR-seq data from frozen samples was performed, this should also be accounted for.

      We agree with the reviewers and acknowledge we never anticipated the development of single-cell sequencing techniques when we started biobank 2013. We performed dead cell removal before the 10x Genomics experiment. We have also done extensive quality controls and believe that the data from the biopsies should be viewed as a whole and that quantitative intra-patient comparisons cannot be done.

      Reviewer #2 (Public Review):

      Summary:

      The study's goal is to characterize and validate tumor-reactive T cells in liver metastases of uveal melanoma (UM), which could contribute to enhancing immunotherapy for these patients. The authors used single-cell RNA and TCR sequencing to find potential tumor-reactive T cells and then used patient-derived xenograft (PDX) models and tumor sphere cultures for functional analysis. They discovered that tumor-reactive T cells exist in activated/exhausted T cell subsets and in cytotoxic effector cells. Functional experiments with isolated TILs show that they are capable of killing UM cells in vivo and ex vivo.

      Strengths:

      The study highlights the potential of using single-cell sequencing and functional analysis to identify T cells that can be useful for cell therapy and marker selection in UM treatment. This is important and novel as conventional immune checkpoint therapies are not highly effective in treating UM. Additionally, the study's strength lies in its validation of findings through functional assays, which underscores the clinical relevance of the research.

      We thank the reviewer for these kind words about our work.

      Weaknesses:

      The manuscript may pose challenges for individuals with limited knowledge of single-cell analysis and immunology markers, making it less accessible to a broader audience.

      The first draft of the manuscript (excluding methods) was written by a person (J.A.N) who is not a bioinformatician. It has been corrected to include the correct nomenclature where applicable but overall it is written with the aim to be understandable. We will make an additional effort for the next version.

    1. Author Response

      The following is the authors’ response to the previous reviews

      We would like to thank you again for your thorough review of the manuscript. We have taken all comments into account in the revised version of the manuscript. Please find below our detailed responses to your comments.

      Reviewing Editor

      The manuscript has been improved, but there are some remaining issues that need to be addressed, as outlined in the reviewers' comments. In particular, please pay attention to Figures 1A and 2A as they appear to be the same. Moreover, the original gel images for Western blots should be made available given the concerns raised by Reviewer #1.

      Thank you for your recommendations. We have carefully considered all comments and made the requested revisions to improve the manuscript.

      Reviewer #1 (Public Review):

      In this manuscript, the authors aimed to compare, from testis tissues at different ages from mice in vivo and after culture, multiple aspects of Leydig cells. These aspects included mRNA levels, proliferation, apoptosis, steroid levels, protein levels, etc. A lot of work was put into this manuscript in terms of experiments, systems, and approaches. The technical aspects of this work may be of interest to labs working on the specific topics of in vitro spermatogenesis for fertility preservation.

      Second review:

      The authors should be commended for substantial improvement in their manuscript for resubmission.

      Thank you very much for this second review and your help to improve this manuscript.

      Recommendations For The Authors:

      Going forward, the authors would be well-served to put a similar amount of effort on first drafts as well, which would both increase reviewer enthusiasm and reduce reviewer workload to document all the deficiencies! Abstract is much improved, and clearly articulates the point of the study.

      We are very grateful for all your constructive comments, which have greatly contributed to the improvement of our manuscript.

      1) 54 - replace "could be" with was

      “could be” was replaced by “was”

      2) 75 - delete "being"

      “being” was deleted.

      3) 103 - would say "indirectly promotes" since Rhox5 is a transcription factor that presumably activates genes in Sertoli cells whose products then affect neighboring germ cells, either by direct action or by influencing Sertoli cell behavior changes

      “indirectly” was added in the sentence.

      4) 139, 155, elsewhere - haven't seen dpp italicized before, certainly not the norm

      In dpp (days post-partum), “pp” is italicized as it is a Latin word.

      5) 265 - delete "found"

      “found” was deleted.

      6) 263-273 - Is the CYP19 protein referred to encoded by the Cyp19a1 gene (line 263)? Should standardize nomenclature...

      The CYP19 protein (aromatase) is indeed encoded by the Cyp19a1 gene. The nomenclature was standardized: “CYP19” was replaced by “CYP19A1” in the entire manuscript.

      7) 280 - "homolog" doesn't seem like the right word, as it has a very specific meaning with regards to the evolutionary genetic relatedness of genes. Maybe analog?

      “homolog” was replaced by “analog”.

      8) 306 - would reword to something like "proportions of seminiferous tubules containing round and elongating spermatids" - the because the tubules don't reach spermatid stages

      This sentence was reworded as suggested.

      9) 310 - delete "resulted in", unnecessary

      “resulted in” was deleted.

      10) Why are the images shown in Figures 1A and 2A the same? That seems odd - was that intentional? Curious overall why the data is presented in such a way that it's done twice...

      We mistakenly presented immunofluorescence images twice. Duplicate images have been removed. In the modified version of this manuscript, Figure 1A shows 3-HSD immunofluorescence staining in cultures of fresh testicular tissues and in their in vivo counterparts while Figure 1 – figure supplement 1A (not Figure 2A) shows 3-HSD immunofluorescence staining in cultures of frozen/thawed testicular tissues.

      11) In all the western blots, the cropping is done awfully close to the bands - why is this? Can full gels be shown in a Supplement? And especially in the westerns in Fig. 5C, esp for CYP17A1, the cropping is unacceptable. This reviewer is wondering whether this is an oversight, or whether there is another band below that one that is being masked? Again, should show whole blot for transparency and to ensure Rigor and Reproducibility.

      Full gels are shown in the Supplementary File 2. For CYP17A1, we have shown that only one band of the expected molecular weight is obtained with the antibody (Please see photo below). After this verification, the nitrocellulose membranes were cut at the 55 kDa molecular weight band in order to reveal CYP17A1 expression in the upper part of the membranes and the protein used for normalization in the lower part of the membranes.

      Author response image 1.

      12) For all figures, wondering why the font sizes are so disparate? This will need to be addressed before publication so it looks more professional.

      All figures have been reworked as requested.

      Reviewer #3 (Public Review):

      Moutard, Laura, et al. investigated the gene expression and functional aspects of Leydig cells in a cryopreservation/long-term culture system. The authors found that critical genetic markers for Leydig cells were diminished when compared to the in-vivo testis. The testis also showed less androgen production and androgen responsiveness. Although they did not produce normal testosterone concentrations in basal media conditions, the cultured testis still remained highly responsive to gonadotrophin exposure, exhibiting a large increase in androgen production. Even after the hCG-dependent increase in testosterone, genetic markers of Leydig cells remained low, which means there is still a missing factor in the culture media that facilitates proper Leydig cell differentiation. Optimizing this testis culture protocol to help maintain proper Leydig cell differentiation could be useful for future human testis biopsy cultures, which will help preserve fertility and child cancer patients.

      Overall, the authors addressed most comments and questions from the previous review. The additional data regarding the necrotic area is helpful for interpreting the quality of the cultures. The authors did not conduct a multiple comparison tests although there are multiple comparisons conducted on for a single dependent variable (Fig 2J, Fig 3F, among many others), however, the addition of this multiple comparison is unlikely to change the conclusions of the paper or the figure and, thus is a minor technical detail in this case.

      Thank you very much for this second review and your help to improve this manuscript.

    1. Author Response

      eLife assessment

      This work describes new validated conditional double KO (cDKO) mice for LRRK1 and LRRK2 that will be useful for the field, given that LRRK2 is widely expressed in the brain and periphery, and many divergent phenotypes have been attributed previously to LRRK2 expression. The manuscript presents solid data demonstrating that it is the loss of LRRK1 and LRRK2 expression within the SNpc DA cells that is not well tolerated, as it was previously unclear from past work whether neurodegeneration in the LRRK double Knock Out (DKO) was cell autonomous or the result of loss of LRRK1/LRRK2 expression in other types of cells. Future studies may pursue the biochemical mechanisms underlying the reason for the apoptotic cells noted in this study, as here, the LRRK1/LRRK2 KO mice did not replicate the dramatic increase in the number of autophagic vacuoles previously noted in germline global LRRK1/LRRK2 KO mice.

      We thank the editors for handling our manuscript and for the succinct summary that recognizes the significance of our findings and points out interesting directions for future studies. We also thank the reviewers for their helpful comments and positive evaluation of our work. Below, we have provided point-by-point responses to the reviewers’ comments.

      Reviewer #1 (Public Review):

      Summary:

      This is an important work showing that loss of LRRK function causes late-onset dopaminergic neurodegeneration in a cell-autonomous manner. One of the LRRK members, LRRK2, is of significant translational importance as mutations in LRRK2 cause late-onset autosomal dominant Parkinson's disease (PD). While many in the field assume that LRRK2 mutant causes PD via increased LRRK2 activity (i.e., kinase activity), it is not a settled issue as not all disease-causing mutant LRRK2 exhibit increased activity. Further, while LRRK2 inhibitors are under clinical trials for PD, the consequence of chronic, long-term LRRK2 inhibition is unknown. Thus, studies evaluating the long-term impact of LRRK deficit have important translational implications. Moreover, because LRRK proteins, particularly LRRK2, are known to modulate immune response and intracellular membrane trafficking, the study's results and the reagents will be valuable for others interested in LRRK function.

      Strengths:

      This report describes a mouse model where the LRRK1 and LRRK2 gene is conditionally deleted in dopaminergic neurons. Previously, this group showed that while loss of LRRK2 expression does not cause brain phenotype, loss of both LRRK1 and LRRK2 causes a later onset, progressive degeneration of catecholaminergic neurons and dopaminergic (DAergic) neurons in the substantia nigra (SN), and noradrenergic neurons in the locus coeruleus (LC). However, because LRRK genes are widely expressed with some peripheral phenotypes, it was unknown if the neurodegeneration in the LRRK double knockout (DKO) was cell autonomous. To rigorously test this question, the authors have generated a double conditional (cDKO) allele where both LRRK1 and LRRK2 genes were targeted to contain loxP sites. In my view, this was beyond what is usually required, as most investigators might might combine one KO allele with another floxed allele. The authors provide a rigorous validation showing that the Driver (DAT-Cre) is expressed in most DAergic neurons in the SN and that LRRK levers are decreased selectively in the ventral midbrain. Using these mice, the authors show that the number of DAergic neurons is normal at 15 but significantly decreased at 20 months of age. Moreover, the authors show that the number of apoptotic neurons is increased by ~2X in aged SN, demonstrating increased ongoing cell death, as well as an increase in activated microglia. The degeneration is limited to DAergic neurons as LC neurons are not lost as this population does not express DAT. Overall, the mouse genetics and experimental analysis were performed rigorously, and the results were statistically sound and compelling.

      Weaknesses:

      I only have a few minor comments. First is that in PD and other degenerative conditions, loss of axons and terminals occurs prior to cell bodies. It might be beneficial to show the status of DAergic markers in the striatum. Second, previous studies indicate that very little, if any, LRRK1 is expressed in SN DAergic neurons. This also the case with the Allen Brain Atlas profile. Thus, authors should discuss the discrepancy as authors seem to imply significant LRRK1 expression in DA neurons.

      We appreciate the reviewer’s recognition of the importance of the study as well as our rigorous experimental approaches and compelling results. Our responses to the reviewer's two minor comments are below.

      1) DAergic markers in the striatum:

      We performed TH immunostaining in the striatum and quantified TH+ DA terminals in the striatum of DA neuron-specific LRRK cDKO and littermate control mice at the ages of 15 and 24 months. We found similar levels of TH immunoreactivity in the striatum of LRRK cDKO and littermate control mice at the age of 15 months (p = 0.6565, unpaired Student’s t-test) and significantly reduced levels of TH immunoreactivity in the striatum of LRRK cDKO, compared to control mice at the age of 24 months (~19%, p = 0.0215), suggesting an age-dependent loss of dopaminergic terminals in the striatum of DA neuron-specific LRRK cDKO mice. These results are now included as Figure 5 of the revised manuscript.

      2) LRRK1 expression in the SNpc:

      It is shown in the Mouse brain RNA-seq dataset and the Allen Mouse brain ISH dataset (https://www.proteinatlas.org/ENSG00000154237-LRRK1/brain) that LRRK1 is broadly expressed in the mouse brain and is expressed at modest levels in the midbrain, comparable to the cerebral cortex. Indeed, our Western analysis also showed that levels of LRRK1 detected in the dissected ventral midbrain and the cerebral cortex of control mice are similar (40µg total protein loaded per lane; Figure 2E). Furthermore, we previously demonstrated that deletion of LRRK2 (or LRRK1) alone does not cause age-dependent loss of DA neurons in the SNpc, but deletions of both LRRK1 and LRRK2 result in age-dependent loss of DA neurons in LRRK DKO mice, indicating the functional importance of LRRK1 in the protection of DA neuron survival in the aging mouse brain (Tong et al., PNAS 2010, 107: 9879-9884, Giaime et al., Neuron 2017, 96: 796-807).

      Reviewer #2 (Public Review):

      Summary:

      In this manuscript, Shen and collaborators described the generation of cDKO mice lacking LRRK1 and LRRK2 selectively in DAT-positive DAergic neurons. The Authors asked whether selective deletion of both LRRK isoforms could lead to a Parkinsonian phenotype, as previously reported by the same group in germline double LRRK1 and LRRK2 knockout mice (PMID: 29056298). Indeed, cDKO mice developed a late reduction of TH+ neurons in SNpc that partially correlated with the reduction of NeuN+ cells. This was associated with increased apoptotic cell and microglial cell numbers in SNpc.

      Unlike the constitutive DKO mice described earlier, however, cDKO mice did not replicate the dramatic increase in the number of autophagic vacuoles. The study supports the authors' hypothesis that loss of function rather than gain of function of LRRK2 leads to PD.

      Strengths:

      The study described for the first time a model where both the PD-associated gene LRRK2 and its homolog LRRK1 are deleted selectively in DAergic neurons, offering a new tool to understand the physiopathological role of LRRK2 and the compensating role of LRRK1 in modulating DAergic cell function.

      Weaknesses:

      The model has no construct validity since loss of function mutations of LRRK2 are well-tolerated in humans and do not lead to PD. The evidence of a Parkinsonian phenotype in these cDKO mice is limited and should be considered preliminary.

      We thank the reviewer for commenting on the usefulness of this new PD mouse model.

      The reviewer did not include a reference citation for the statement "loss of function mutations of LRRK2 are well-tolerated in humans and do not lead to PD." It is possible that the reviewer was referring to a human population study (Whiffin et al., Nat Med 2020, 26: 869-877), entitled "The effect of LRRK2 lossof-function variants in humans." In this study, the authors analyzed 141,456 individuals sequenced in the Genome Aggregation Database, 49,960 exome-sequenced individuals from the UK Biobank, and more than 4 million participants in the 23andMe genotyped dataset, and they looked for human genetic variants predicted to cause loss-of-function of protein-coding genes (pLoF variants). The reported findings were interesting, and the authors were careful in stating their conclusions. However, this is not a linkage study of large pedigrees carrying a single, clear-cut loss-of-function mutation (e.g. large deletions of most exons and coding sequences). Therefore, the experimental evidence is not compelling enough to conclude whether loss-of-function mutations in LRRK2 cause PD or do not cause PD.

      The current report is an unbiased genetic study in an effort to reveal the normal physiological role of LRRK in dopaminergic neurons. It was not intended to produce Parkinsonian phenotypes in LRRK cDKO mice, which would be a biased effort. However, the unequivocal discovery of the cell intrinsic role of LRRK in the protection of DA neurons from age-dependent degeneration and apoptotic cell death should be considered seriously, while we contemplate the disease mechanism and how LRRK2 mutations may cause DA neuron loss and PD.

      Reviewer #3 (Public Review):

      Kang, Huang, and colleagues investigated the impact of LRRK1 and LRRK2 deletion, specifically in dopaminergic neurons, using a novel cDKO mouse model. They observed a significant reduction in DAergic neurons in the substantia nigra in their conditional LRRK1 and LRRK2 KO mice and a corresponding increase in markers of apoptosis and gliosis. This work set out to address a longstanding question within the field around the role and importance of LRRK1 and LRRK2 in DAergic neurons and suggests that the loss of both proteins triggers some neurodegeneration and glial activation.

      The studies included in this work are carefully performed and clearly communicated, but additional studies are needed to strengthen further the authors' claims around the consequences of LRRK2 deletion in DAergic neurons.

      1. In Figures 2E and F, the authors assess the protein levels of LRRK1 and LRRK2 in their cDKO mouse model to confirm the deletion of both proteins. They observe a mild loss of LRRK1 and LRRK2 signals in the ventral midbrain compared to wild-type animals. While this is not surprising given other cell types that still express LRRK1 and LRRK2 would be present in their dissected ventral midbrain samples, it does not sufficiently confirm that LRRK1 and LRRK2 are not expressed in DAergic neurons. Additional data is needed to more directly demonstrate that LRRK1 and LRRK2 protein levels are reduced in DAergic neurons, including analysis of LRRK1 and LRRK2 protein levels via immunohistochemistry or FACS-based analysis of TH+ neurons.

      We thank the reviewer for highlighting this incredibly important but often overlooked issue. We agree that the data in Figure 2E, F alone would be inadequate to validate DA neuron-specific LRRK cDKO mice.

      Cell type-specific conditional knockouts are a mosaic with KO cells mixed with other cell types expressing the gene normally. DA neuron-specific cDKO is particularly challenging, as DA neurons are a subset of cells embedded in the ventral midbrain. Rather than using immunostaining, which relies upon specific, good LRRK1 and LRRK2 antibodies for IHC, or FACS sorting of TH+ neurons followed by Western blotting (few cells, mixed cell populations, etc.), we chose a clean genetic approach by generating germline mutant mice carrying the deleted LRRK1 and LRRK2 alleles in all cells from the floxed LRRK1 and LRRK2 alleles. This approach permits characterization of these deletion mutations in germline mutant mice using molecular approaches that yield unambiguous results.

      We crossed CMV-Cre deleter mice with floxed LRRK1 and LRRK2 mice to generate respective germline LRRK1 KO and LRRK2 KO mice, in which all cells carry the LRRK1 or LRRK2 deleted alleles that are identical to those in DA neurons of cDKO mice. We then performed Northern, extensive RTPCR followed by sequencing, and Western analyses to show the absence of the full length LRRK1 and LRRK2 mRNA (Figure 1G, H, Figure 1-figure supplement 8 and 10), and the expected truncation of LRRK1 and LRRK2 mRNA (Figure 1-figure supplement 9 and 11), and the absence of LRRK1 and LRRK2 proteins (Figure 1I). These analyses together demonstrate that in the presence of Cre, either CMV-Cre expressed in all cells or DAT-Cre expressed selectively in DA neurons, the floxed LRRK1 and LRRK2 exons are deleted, resulting in null alleles. We further demonstrated the specificity of DAT-Cremediated recombination (deletion) by crossing DAT-Cre mice with a GFP reporter, showing that 99% TH+ DA neurons in the SNpc are also GFP+ (Figure 2A, B), indicating that DAT-Cre-mediated recombination of the floxed alleles occurs in essentially all TH+ DA neurons in the SNpc.

      1. The authors observed a significant but modest effect of LRRK1 and LRRK2 deletion on the number of TH+ neurons in the substantia nigra (12-15% loss at 20-24 months of age). It is unclear whether this extent of neuron loss is functionally relevant. To strengthen the impact of these data, additional studies are warranted to determine whether this translates into any PD-relevant deficits in the mice, including motor deficits or alterations in alpha-synuclein accumulation/aggregation.

      Yes, the reduction of DA neurons in the SNpc of cDKO mice at the age of 20-24 months is modest. At 15 months of age, the number of TH+ DA neurons in the SNpc is similar between LRRK cDKO mice (10,000 ± 141) and littermate controls (10,077 ± 310, p > 0.9999). At 20 months of age, the number of DA neurons in the SNpc of LRRK cDKO mice (8,948 ± 273) is significantly reduced (-12.7%), compared to control mice (10,244 ± 220, F1,46 = 16.59, p = 0.0002, two-way ANOVA with Bonferroni’s post hoc multiple comparisons, p = 0.0041). By 24 months of age, the number of DA neurons in the SNpc of LRRK cDKO mice (8,188 ± 452) relative to controls (9,675 ± 232, p = 0.0010) is further reduced (15.4%).

      Similar results were obtained by an independent quantification by another investigator, also conducted in a genotype blind manner, using the fractionator and optical dissector method, by which TH+ cells were quantified in 25% areas. These results are included as Figure 3-figure supplement 1 in the revised manuscript. Because of the more limited sampling, the quantification data are more variable, compared to quantification of TH+ cells in all areas of the SNpc, shown in Figure 3. With both methods, we quantified TH+ cells in every 10th sections encompassing the entire SNpc (3D structure), as sampling using every 5th or every 10th sections yielded similar results.

      We also performed behavioral analysis of LRRK cDKO mice and littermate controls at the ages of 10 and 25 months using the beam walk test (10 mm and 20 mm beam) and the pole test, which are sensitive to impairment of motor coordination. We found that LRRK cDKO mice at 10 months of age showed significantly more hindlimb errors (p = 0.0005, unpaired two-tailed Student’s t-test) and longer traversal time (p = 0.0075) in the 10mm beam walk test, compared to control mice, though their performance is similar in the 20 mm beam walk (hindlimb slips: p = 0.0733, traversal time: p = 0.9796) and in the pole test. At 22 months of age, the performance of LRRK cDKO mice and littermate controls is more variable and worse, compared to the younger mice, and is not significantly different between the genotypic groups. These results are now included as Figure 9 of the revised manuscript.

      1. The authors demonstrate that, unlike in the germline LRRK DKO mice, they do not observe any alterations in electron-dense vacuoles via EM. Given their data showing increased apoptosis and gliosis, it remains unclear how the loss of LRRK proteins leads to DAergic neuronal cell loss. Mechanistic studies would be insightful to understand better potential explanations for how the loss of LRRK1 and LRRK2 may impair cellular survival, and additional text should be added to the discussion to discuss potential hypotheses for how this might occur.

      We agree that this phenotypic difference between germline DKO and DA neuron-specific cDKO mice is intriguing, suggesting a non-cell autonomous contribution of LRRK in age-dependent accumulation of autophagic and lysosomal vacuoles in SNpc neurons of germline LRRK DKO mice. We will discuss the phenotypic difference further in the revised manuscript. We are generating microglial specific LRRK cDKO mice to investigate the role of LRRK in microglia and whether microglia contribute in a cell extrinsic manner to the regulation of the autophagy-lysosomal pathway in DA neurons.

      1. The authors discuss the potential implications of the neuronal cell loss observed in cDKO mice for LRRK1 and LRRK2 for therapeutic approaches targeting LRRK2 and suggest this argues that LRRK2 variants may exert their effects through a loss-of-protein function. However, all of the data generated in this work focus on a mouse in which both LRRK1 and LRRK2 have been deleted, and it is therefore difficult to make any definitive conclusions about the consequences of specifically targeting LRRK2. The authors note potential redundancy between the two LRRK proteins, and they should soften some of their conclusions in the discussion section around implications for the effects of LRRK2 variants. Human subjects that carry LRRK2 loss-of-function alleles do not have an increased risk for developing PD, which argues against the author's conclusions that LRRK2 variants associated with PD are loss-offunction. Additional text should be included in their discussion to better address these nuances and caution should be used in terms of extrapolating their data to effects observed with PD-linked variants in LRRK2.

      We will modify the discussion accordingly in the revised manuscript.

    1. Author Response

      Reviewer #1 (Public Review):

      Weaknesses: There appears to be a lack of basic knowledge of the process of spermatogenesis. For instance, the statement that "During the first week of postnatal life, a population of SCs continues to proliferate to give rise to undifferentiated Asingle (As), Apaired (Apr) and Aaligned (Aal) cells. The remaining SCs differentiate to form chains of daughter cells that become primary and secondary permatocytes around postnatal day (PND) 10 to 12." is inaccurate. The Aal cells are the spermatogonial chains, the two are not distinct from one another. In addition, the authors fail to mention spermatogonial stem cells which form the basis for steady-state spermatogenesis. The authors also do not acknowledge the well-known fact that, in the mouse, the first wave of spermatogenesis is distinct from subsequent waves. Finally, the authors do not mention the presence of both undifferentiated spermatogonia (aka - type A) and differentiating spermatogonia (aka - type B). The premise for the study they present appears to be the implication that little is known about the dynamics of chromatin during the development of spermatogonia. However, there are published studies on this topic that have already provided much of the information that is presented in the current manuscript.

      We acknowledge the reviewer’s criticism about the inaccuracy and incompleteness of some of the statements about spermatogonial cells and spermatogenesis. We will be improve the text accordingly in the reviewed manuscript. We will also clarify the premise of the study which was to complement existing datasets on spermatogonial cells by providing parallel transcriptomic and chromatin accessibility maps of high resolution from the same cell populations at early postnatal, late postnatal and adult stages collected from single individuals (for adults). These features make our datasets comprehensive and an important additional resource for people in the community. We will also revise the description of published studies to be more inclusive.

      It is not clear which spermatogonial subtype the authors intended to profile with their analyses. On the one hand, they used PLZF to FACS sort cells. This typically enriches for undifferentiated spermatogonia. On the other hand, they report detection in the sorted population of markers such as c-KIT which is a well-known marker of differentiating spermatogonia, and that is in the same population in which ID4, a well-known marker of spermatogonial stem cells, was detected. The authors cite multiple previously published studies of gene expression during spermatogenesis, including studies of gene expression in spermatogonia. It is not at all clear what the authors' data adds to the previously available data on this subject.

      The authors analyzed cells recovered at PND 8 and 15 and compared those to cells recovered from the adult testis. The PND 8 and 15 cells would be from the initial wave of spermatogenesis whereas those from the adult testis would represent steady-state spermatogenesis. However, as noted above, there appears to be a lack of awareness of the well-established differences between spermatogenesis occurring at each of these stages.

      The reviewer correctly points that our samples contain both undifferentiated spermatogonial stem cells and differentiated spermatogonia, which is expected from the chosen FACS strategy. We clearly mention the fact that our populations are mixed and that our samples are 85-95% PLZF+ enriched. We also acknowledge the possible presence of contaminating cells that may influence the results and data interpretation in the section “Limitations”. We believe that this does not diminish the value of the datasets. But to further increase their usefulness and improve their interpretation, we will conduct new analyses and apply computational methods to deconvolute our bulk RNA-seq datasets in silico (PMID: 37528411) using publicly available single-cell RNA-seq datasets. Such analyses shall correct for cell-type heterogeneity and provide information about the cellular composition of our cell preparations clarifying the representation of undifferentiated and differentiated spermatogonial cells and the possible presence of somatic cells.

      In general, the authors present observational data of the sort that is generated by RNA-seq and ATAC-seq analyses, and they speculate on the potential significance of several of these observations. However, they provide no definitive data to support any of their speculations. This further illustrates the fact that this study contributes little if any new information beyond that already available from the numerous previously published RNA-seq and ATAC-seq studies of spermatogenesis. In short, the study described in this manuscript does not advance the field.

      We acknowledge that RNA-seq and ATAC-seq datasets like ours are observational and that their interpretation can be speculative. Nevertheless, our datasets represent an additional useful resource for the community because they are comprehensive and high resolution, and can be exploited for instance, for studies in environmental epigenetics and epigenetic inheritance examining the immediate and long-term effects of postnatal exposure and their dynamics. The depth of our RNA sequencing allowed detect transcripts with a high dynamic range, which has been limited with classical RNA sequencing analyses of spermatogonial cells and with single-cell analyses (which have comparatively low coverage). Further, our experimental pipeline is affordable (more than single cell sequencing approaches) and in the case of adults, provides data per animal informing on the intrinsic variability in transcriptional and chromatin regulation across males. These points will be discussed in the revised manuscript.

      The phenomenon of epigenetic priming is discussed, but then it seems that there is some expression of surprise that the data demonstrate what this reviewer would argue are examples of that phenomenon. The authors discuss the "modest correspondence between transcription and chromatin accessibility in SCs." Chromatin accessibility is an example of an epigenetic parameter associated with the primed state. The primed state is not fully equivalent to the actively expressing state. It appears that certain histone modifications along with transcription factors are critical to the transition between the primed and actively expressing states (in either direction). The cell types that were investigated in this study are closely related spermatogenic, and predominantly spermatogonial cell types. It is very likely that the differentially expressed loci will be primed in both the early (PND 8 or 15) and adult stages, even though those genes are differentially expressed at those stages. Thus, it is not surprising that there is not a strict concordance between +/- chromatin accessibility and +/- active or elevated expression.

      The reviewer is right that a strict concordance between chromatin accessibility and transcription is not necessarily expected. The text of the revised manuscript will be modified accordingly. However, we would like to note that our data strengthen the observations made by others that in cells from the same lineage, the global landscape of chromatin accessibility is more stable than their transcriptional programs over developmental time.

      Reviewer #2 (Public Review):

      The objective of this study from Lazar-Contes et al. is to examine chromatin accessibility changes in "spermatogonial cells" (SCs) across testis development. Exactly what SCs are, however, remains a mystery. The authors mention in the abstract that SCs are undifferentiated male germ cells and have self-renewal and differentiation activity, which would be true for Spermatogonial STEM Cells (SSCs), a very small subset of total spermatogonia, but then the methods they use to retrieve such cells using antibodies that enrich for undifferentiated spermatogonia encompass both undifferentiated and differentiating spermatogonia. Data in Fig. 1B prove that most (85-95%) are PLZF+, but PLZF is known to be expressed both by undifferentiated and differentiating (KIT+) spermatogonia (Niedenberger et al., 2015; PMID: 25737569). Thus, the bulk RNA-seq and ATAC-seq data arising from these cells constitute the aggregate results comprising the phenotype of a highly heterogeneous mixture of spermatogonia (plus contaminating somatic cells), NOT SSCs. Indeed, Fig. 1C demonstrates this by showing the detection of Kit mRNA (a well-known marker of differentiating spermatogonia - which the authors claim on line 89 is a marker of SCs!), along with the detection of markers of various somatic cell populations (albeit at lower levels).

      The reviewer is correct that our spermatogonial cell populations are mixed and include undifferentiated and differentiated cells, hence the name of spermatogonia (SCs), and probably also contain some somatic cells. We acknowledge that this is a limitation of our isolation approach. To circumvent this limitation, we will conduct in silico deconvolution analysis using publicly available single cell RNA sequencing datasets to obtain information about markers corresponding to undifferentiated and differentiated spermatogonia cells, and somatic cells. These additional analyses will provide information about the cellular composition of the samples and clarify the representation of undifferentiated and differentiated spermatogonial cells and other cells.

      This admixture problem influences the results - the authors show ATAC-seq accessibility traces for several genes in Fig. 2E (exhibiting differences between P15 and Adult), including Ihh, which is not expressed by spermatogenic cells, and Col6a1, which is expressed by peritubular myoid cells. Thus, the methods in this paper are fundamentally flawed, which precludes drawing any firm conclusions from the data about changes in chromatin accessibility among spermatogonia (SCs?) across postnatal testis development.

      The reviewer raises concern about the lack of correspondence between chromatin accessibility and expression observed for some genes, arguing that this precludes drawing firm conclusions. However, a dissociation between chromatin accessibility and gene expression is normal and expected since chromatin accessibility is only a readout of protein deposition and occupancy e.g. by transcription factors, chromatin regulators, nucleosomes, at specific genomic loci that does not give functional information of whether there is ongoing transcriptional activity or not. A gene that is repressed or poised for expression can still show clear signal of chromatin accessibility at regulatory elements. The dissociation between chromatin accessibility and transcription has been reported in many different cells and conditions (PMID: 36069349, PMID: 33098772) including in spermatogonial cells (PMID: 28985528) and in gonads in different species (PMID: 36323261). Therefore, the dissociation between accessibility and transcription is not a reason to conclude that our data are flawed.

      In addition, there already are numerous scRNA-seq datasets from mouse spermatogenic cells at the same developmental stages in question.

      This is true but full transcriptomic profiling like ours on cell populations provides different transcriptional information that is deeper and more comprehensive. Our datasets identified >17,000 genes while scRNA-seq typically identifies a few thousands of genes. Our analyses also identified full length transcripts, variants, isoforms and low abundance transcripts. These datasets are therefore a valuable addition to existing scRNA-seq.

      Moreover, several groups have used bulk ATAC-seq to profile enriched populations of spermatogonia, including from synchronized spermatogenesis which reflects a high degree of purity (see Maezawa et al., 2018 PMID: 29126117 and Schlief et al., 2023 PMID: 36983846 and in cultured spermatogonia - Suen et al., 2022 PMID: 36509798) - so this topic has already begun to be examined. None of these papers was cited, so it appears the authors were unaware of this work.

      We apologize for not mentioning these studies in our manuscript, we will do so in the revised version.

      The authors' methodological choice is even more surprising given the wealth of single-cell evidence in the literature since 2018 demonstrating the exceptional heterogeneity among spermatogonia at these developmental stages (the authors DID cite some of these papers, so they are aware). Indeed, it is currently possible to perform concurrent scATAC-seq and scRNA-seq (10x Genomics Multiome), which would have made these data quite useful and robust. As it stands, given the lack of novelty and critical methodological flaws, readers should be cautioned that there is little new information to be learned about spermatogenesis from this study, and in fact, the data in Figures 2-5 may lead readers astray because they do not reflect the biology of any one type of male germ cell. Indeed, not only do these data not add to our understanding of spermatogonial development, but they are damaging to the field if their source and identity are properly understood. Here are some specific examples of the problems with these data:

      1. Fig. 2D - Gata4 and Lhcgr are not expressed by germ cells in the testis.

      2. Fig. 3A - WT1 is expressed by Sertoli cells, so the change in accessibility of regions containing a WT1 motif suggests differential contamination with Sertoli cells. Since Wt1 mRNA was differentially high in P15 (Fig. 3B) - this seems to be the most likely explanation for the results. How was this excluded?

      3. Fig. 3D - Since Dmrt1 is expressed by Sertoli cells, the "downregulation" likely represents a reduction in Sertoli cell contamination in the adult, like the point above. Did the authors consider this?

      We acknowledge that concurrent scATAC-seq and scRNA-seq analyses have been done by others but our datasets add to these analyses by providing concurrent chromatin and expression analyses at high resolution in spermatogonial populations at 2 postnatal stages and in adulthood and from individual males (for adult cells). This provides a set of information that adds to the current literature. Doing such analyses in single cells is not tractable financially so we offer an economical alternative that delivers high resolution datasets for these different time points. Our analyses were not meant to study spermatogenesis but to provide a thorough and comprehensive profiling of chromatin accessibility and transcription in postnatal and adult spermatogonial cells.

      Our data need careful interpretation to avoid any misleading conclusions. Fig. 2D does not show expression but accessibility which does not tell if a particular locus or gene is expressed or not. Thus, candidates like Gata4 and Lhcgr shown in Fig. 2D are simply associated with DARs but this does not mean that they are expressed. Likewise in Fig. 3A, motifs refer to decreased accessibility and not to expression. Fig. 1C indicates that PND15 cells have low to no expression of 3 Sertoli cells markers (Vim, Tspan17 and Rhox), suggesting little contamination by Sertoli cells. The presence of WT1 in PND15 cells will however be examined more carefully and re-analysed by in silico deconvolution methods using single cell datasets for the revised manuscript. In Fig. 3D, differential contamination by Sertoli cells is possible, this will also be examined by deconvolution methods.

      Reviewer #3 (Public Review):

      In this study, Lazar-Contes and colleagues aimed to determine whether chromatin accessibility changes in the spermatogonial population during different phases of postnatal mammalian testis development. Because actions of the spermatogonial population set the foundation for continual and robust spermatogenesis and the gene networks regulating their biology are undefined, the goal of the study has merit. To advance knowledge, the authors used mice as a model and isolated spermatogonia from three different postnatal developmental age points using a cell sorting methodology that was based on cell surface markers reported in previous studies and then performed bulk RNA-sequencing and ATAC-sequencing. Overall, the technical aspects of the sequencing analyses and computational/bioinformatics seem sound but there are several concerns with the cell population isolated from testes and lack of acknowledgment for previous studies that have also performed ATAC-sequencing on spermatogonia of mouse and human testes. The limitations, described below, call into question the validity of the interpretations and reduce the potential merit of the findings.

      I suggest changing the acronym for spermatogonial cells from SC to SPG for two reasons. First, SPG is the commonly used acronym in the field of mammalian spermatogenesis. Second, SC is commonly used for Sertoli Cells.

      We thank the reviewer for the suggestion and will rename SCs into SPGs in the revised manuscript.

      The authors should provide a rationale for why they used postnatal day 8 and 15 mice.

      We will provide a rationale for the use of postnatal 8 and 15 stages in the revised manuscript. Briefly, these stages are interesting to study because early to mid postnatal life is a critical window of development for germ cells during which environmental exposure can have strong and persistent effects. The possibility that changes in germ cells can happen during this period and persist until adulthood is an important area of research linked to disciplines like epigenetic toxicology and epigenetic inheritance.

      The FACS sorting approach used was based on cell surface proteins that are not germline-specific so there were undoubtedly somatic cells in the samples used for both RNA and ATAC sequencing. Thus, it is essential to demonstrate the level of both germ cell and undifferentiated spermatogonial enrichment in the isolated and profiled cell populations. To achieve this, the authors used PLZF as a biomarker of undifferentiated spermatogonia. Although PLZF is indeed expressed by undifferentiated spermatogonia, there have been several studies demonstrating that expression extends into differentiating spermatogonia. In addition, PLZF is not germ-cell specific and single-cell RNA-seq analyses of testicular tissue have revealed that there are somatic cell populations that express Plzf, at least at the mRNA level. For these reasons, I suggest that the authors assess the isolated cell populations using a germ-cell specific biomarker such as DDX4 in combination with PLZF to get a more accurate assessment of the undifferentiated spermatogonial composition. This assessment is essential for the interpretation of the RNA-seq and ATAC-seq data that was generated.

      The reviewer is right that our cell populations likely contain undifferentiated and differentiated spermatogonial cells and a small percentage of somatic cells including Sertoli cells. As suggested, we examined the expression of the germ-cell marker Ddx4 in our datasets and observed that Ddx4 is highly expressed. It is indeed more highly expressed than the SSC marker Id4 (average log2CPM of 5 vs 8, respectively). We will include this information in the revised manuscript. Further, the deconvolution analyses that will be conducted are expected to clarify the cellular composition of our cell populations.

      A previous study by the Namekawa lab (PMID: 29126117) performed ATAC-seq on a similar cell population (THY1+ FACS sorted) that was isolated from pre-pubertal mouse testes. It was surprising to not see this study referenced in the current manuscript. In addition, it seems prudent to cross-reference the two ATAC-seq datasets for commonalities and differences. In addition, there are several published studies on scATAC-seq of human spermatogonia that might be of interest to cross-reference with the ATAC-seq data presented in the current study to provide an understanding of translational merit for the findings.

      We thank the reviewer for pointing out this study as well as other studies in human spermatogonia. We will cross-reference all of them in the revised manuscript.

    1. Author Response

      The following is the authors’ response to the original reviews.

      Reviewer 1

      We thank the reviewer for their thoughtful comments. We have addressed them below, and we believe that have significantly strengthened the clarity of the manuscript.

      Main Comments:

      In Fig. 2C-D, I am not sure I understand why ≈ 100 mutations fix with β = 0. In the absence of epistasis, and since the coefficients hi are sampled from a symmetric distribution centered at zero, it is to be expected that roughly half of the mutations will have positive fitness effects and thus will eventually fix in the population. With L = 250, I would have expected to see the number of fixed mutations approach ≈ 125 for β = 0. Perhaps I am missing something?

      • In our simulations, we initialize all populations from a state where there are only 100 available beneficial mutations (i.e., the initial rank is always 100). Without epistasis, these initial beneficial mutations are the only beneficial mutations that will be present throughout the entire trajectory. Hence, for β = 0, only 100 beneficial mutations can fix. Previously, this information could be found in the “Materials and methods” section of the SI. To make this aspect of our simulation more clear in the revision, we have added a discussion of the initial rank to the “Landscape structure” subsection of the model definition section. In addition, we have merged “Materials and methods” with “Further simulation details” in the SI into one section, and have listed the values for the simulation parameters in the model definition section.

      Along these lines, the authors show that increasing β leads to a higher number of fixed mutations. I am not sure I understand their explanation for this. In line 209 they write that as β increases, “mutations are needed to cease adaptation”. The way I see it, in the absence of epistasis the fitness peak should correspond to a genotype with ≈ L/2 mutations (the genotype carrying all mutations with hi > 0). Increasing the magnitude of microscopic epistasis (i.e., increasing β ), and assuming that there is no bias towards positive epistasis (which there shouldn’t be based on the model formulation, i.e., section "Disorder statistics" on page 4), can change the “location” of the fitness peak, such that it now corresponds to a different genotype. Statistically speaking, however, there are more genotypes with L/2 mutations than with any other number of mutations, so I would have expected that, on average, the number of mutations fixed in the population would still have been ≈ L/2 (naturally with somewhat large variation across replicates, as seems to be the case).

      • With epistasis, the situation becomes more complex. The structure of our model imposes significant sign epistasis in general (i.e. mutations can be beneficial on one background genotype and deleterious on another). This means that in the presence of epistasis, more than 100 mutations can be required to reach a local optimum even when the initial rank was 100. Intuitively, this occurs because mutations that were deleterious on the ancestral background genotype can become beneficial on future genotypes. We find that this occurs consistently throughout adaptation, leading to the accumulation of more mutations with increasing epistasis.

      • Please note that we use the value L = 1000 in our simulations. We have also made the fact that we use L = 1000 more clear by moving the description of the simulation parameters to the main text.

      I do see how, in the clonal interference regime, there can be multiple genotypes in the population at a given time (each with a different mutational load), thus making the number of fixed mutations larger than L/2 when aggregating over all genotypes in the population. But this observation makes less intuitive sense to me in the SSWM regime. In lines 207-208, the authors state that “as beta increases, a greater number of new available beneficial mutations are generated per each typical fixation event”. While this is true, it is also the case that a greater number of mutations that would have been beneficial in the absence of epistasis are now deleterious due to negative epistasis (if I am understanding what the authors mean correctly).

      • The reviewer is correct to note that in the strong clonal interference regime, there will be more accumulated mutations across the entire population than in any single strain. However, we report the number mutations that have fixed, i.e., become present in the entire population.

      • We find that the typical decrease in rank (per fixation event) of the population decreases with increasing epistasis — i.e., the number of available beneficial mutations that are “consumed” when a mutation fixes is typically lower in systems with stronger epistasis.

      Similarly, I am not sure I understand how one goes from equation (6) to equation (7). In particular, it would seem to me that the term 4αiαj Ji j in equation (6) should be equally likely to be positive or negative (again assuming no bias towards positive Ji j). I thus do not see why ηi j in equation (7) is sampled from a normal distribution with mean µβ instead of just mean zero.

      • The reviewer is correct that, for a uniformly random initial state, αi , αj , and Ji j will be uncorrelated so that the distribution of 4αiαj Ji j can be computed exactly (and has mean zero). However, we initialize from a state with rank 100, so that we need to compute the distribution of the random variable E[αiαj Ji j|αiαj Ji j > 0, R = 100]. This is mathematically very challenging, because there are nontrivial correlations between spins even at initialization. For these reasons, we found the uniformly random approximation insufficient. This is described in the paragraph following Equation (7) in the resubmission.

      Minor Comments:

      The authors use a model including terms up to second-order epistasis. To be clear, I think this choice is entirely justified: as they mention in their manuscript, this structure allows to approximate any fitness model defined on a Boolean hypercube. As I understand it, the reason for not incorporating higher-order terms (as in e.g. Reddy and Desai, eLife 2021) has to do with computational efficiency, i.e., accommodating higher-order terms in equation (10) may lead to a substantial increase in computation time. Is this the case?

      • The author is correct that the incorporation of higher-order terms leads to significantly more expensive computation. It’s an interesting direction of future inquiry to see if our adaptive fast fitness computation method can be extended to higher-order interactions.

      Reviewer 2

      We would like to thank the reviewer for their careful reading and their useful comments connecting our work to spin glass physics. We believe the resulting additions to the paper have made our contributions stronger, and that they reveal some novel connections between the substitution trajectory and correlation functions in spin glasses. A summary of our investigation is provided below, and we have added two paragraphs to the discussion section under the heading “Connections to spin glass physics”.

      Main Comments:

      In spin glasses, slowdown of dynamics could have contributions from stretched exponential relaxation of spin correlations as well as aging, each of which are associated with their own exponents. In the present model, these processes could be quantified by computing two-point correlations associated with genomic overlap, as a function of lag time as well as waiting time (generation number). The population dynamics of competing strains makes the analysis more complicated. But it should be possible to define these correlations by separately averaging over lineages starting from a single parent genome, and over distinct parent genomes. It would be interesting to see how exponents associated with these correlations relate to the exponent c associated with asymptotic fitness growth.

      • To investigate this point, we first considered the two-point correlation function 〈αi (tw)αi (tw+ ∆t)〉 for waiting time tw and lag time ∆t. Because all spins are statistically identical, it is natural to average this over the spin index i, leading to the quantity

      Viewed as a function of ∆t for any fixed tw, it is clear that . If m mutations with respect to α(tw) have fixed at time tw + ∆t, a similar calculation shows that . Surprisingly, this simple derivation reveals that the two-spin correlation function commonly studied in spin glass physics is an affine transformation of the substitution trajectory commonly studied in population genetics. Moreover, it shows that the effect of tw is to change the definition of the ancestral strain, so that we may set tw = 0 without loss of generality and study the correlation function χ2(t) = 1 − 2m(t) where m(t) is the mean substitution trajectory of the population. Much of our analysis proceeds by analyzing the effect of epistasis on the accumulation of mutations. This relation provides a novel connection between this analysis and the analysis of correlation functions in the spin glass literature.

      • It is well known that in the SSWM limit without epistasis, the substitution trajectory follows a power law similar to the fitness trajectory with relaxation exponent 1.0 [1]. Informed by this identity, we performed simulations in the SSWM limit and fit power laws to the correlation function χ2 as a function of time. We have verified that χ2(t) obeys a power- law relaxation with exponent roughly 1.0 for β = 0; moreover, as anticipated by the reviewer, the corresponding exponent decreases with increasing β . Nevertheless, we find that these relaxation exponents are distinct from those found for the fitness trajectory, despite following the same qualitative trend. This point is particularly interesting, as it highlights that the dynamics of fixation induce a distinct functional form at the level of the correlation functions when compared to, for example, the Glauber dynamics in statistical physics.

      The strength of dynamic correlations in spin glasses can be characterized by the four-point susceptibility, which contains information about correlated spin flips. These correlations are maximized over characteristic timescales. In the context of evolution, such analysis may provide insights on the correlated accumulation of mutations on different sets of loci over different timescales. It would be interesting to see how these correlations change as a function of the mutation rate as well as the strength of epistasis.

      • To study this point, we considered the four-point correlation function

      Because spins are statistically identical, we found numerically that the genotype average is roughly equivalent to the angular average over trajectories. Inter-changing the order of the summation and the angular averaging, we then find that

      so that the information contained in the four-point correlation function is the same as the information contained in the two-point correlation function.

      Fig. 2E and Fig. 5 together suggests an intriguing possibility when interpreted in the spin glass context. It is clear that in the absence of epistasis, clonal interference accelerates fitness growth. Fig. 2E additionally suggests that this scenario will continue to hold even in the presence of weak, but finite epistasis, but disappears for sufficiently strong epistasis. I wonder if the two regimes are separated by a phase transition at some non-trivial strength of epistasis. Indeed, the qualitative behavior appears to change from that of a random field Ising spin glass for small β , to that of a zero field Sherrington-Kirkpatrick spin glass for sufficiently large β . While the foregoing comments are somewhat speculative, perhaps a discussion along these lines, and what it means in the context of evolution could be a useful addition to the discussion section of the paper.

      • We thank the reviewer for this interesting suggestion, and we have added a discussion of this point to the text in the future directions section, lines 483–489.

      Minor Comments:

      1. In the abstract (line 17-18), I recommend use of the phrase "a simulated evolving population" to avoid a possible misinterpretation of the work as experimental as opposed to numerical.

      • We have added the word “simulated”.

      1. In line 70, the word "the" before "statistical physics" is redundant.

      • We have removed “the”.

      1. To make the message in lines 294-295 visually clear, I recommend keeping the Y-axis scale bars constant across Fig. 4A and Fig. 4B.

      • We appreciate the suggestion. However, we found that when putting the two figures on the same scale, because the agreement is only qualitative and not quantitative (as emphasized in the text), it becomes difficult to view the trend in both systems. For this reason, we have chosen to keep the figure as-is.

      1. Fig. 6 caption states: "Without epistasis, the rank decreases with increasing µ". It should be "rank increases".

      • We have fixed this.

      1. In the last sentence in the caption to Fig. 8, the labels "(A, β =0)" and "(B, β =0.25)" need to be swapped.

      • We have fixed this.

      Editor Comments

      We thank the editor for pointing our attention towards these three interesting references, in particular the second, which appears most relevant to our work. We have added a discussion of reference 2 in the future directions section (lines 471–482), commenting on how to determine the contribution of within-path clonal interference to the fitness dynamics in our model. We have also added a reference to article 3 in the model description, commenting on the importance of sign epistasis and the prevalence of sign epistasis in our model with β > 0.

      References:

      1. Good BH, Desai MM. The impact of macroscopic epistasis on long-term evolutionary dynamics. Genetics. 2015.
    1. Author Response

      The following is the authors’ response to the original reviews.

      Public Reviews:

      Reviewer #1 (Public Review):

      Summary:

      This study aims to further resolve the history of speciation and introgression in Heliconius butterflies. The authors break the data into various partitions and test evolutionary hypotheses using the Bayesian software BPP, which is based on the multispecies coalescent model with introgression. By synthesizing these various analyses, the study pieces together an updated history of Heliconius, including a multitude of introgression events and the sharing of chromosomal inversions.

      Strengths:

      Full-likelihood methods for estimating introgression can be very computationally expensive, making them challenging to apply to datasets containing many species. This study provides a great example of how to apply these approaches by breaking the data down into a series of smaller inference problems and then piecing the results together. On the empirical side, it further resolves the history of a genus with a famously complex history of speciation and introgression, continuing its role as a great model system for studying the evolutionary consequences of introgression. This is highlighted by a nice Discussion section on the implications of the paper's findings for the evolution of pollen feeding.

      Weaknesses:

      The analyses in this study make use of a single method, BPP. The analyses are quite thorough so this is okay in my view from a methodological standpoint, but given this singularity, more attention should be paid to the weaknesses of this particular approach.

      In the Discussion, we have now added a discussion of the limitations of our approach in the section 'Approaches for estimating species phylogeny with introgression from whole-genome sequence data: advantages and limitations.'

      Additionally, little attention is paid to comparable methods such as PhyloNet and their strengths and weaknesses in the Introduction or Discussion.

      We have also mentioned other methods (PhyloNet and starBEAST) in our Discussion. Our attempts to obtain usable estimates from PhyloNet were unsuccessful. In another study, the full likelihood version of PhyloNet (comparable in intent to the BPP methodology used here) could run with only small datasets of ~100 loci; see Edelman et al. (2019).

      BPP reduces computational burden by fixing certain aspects of the parameter space, such as the species tree topology or set of proposed introgression events. While this approach is statistically powerful, it requires users to make informed choices about which models to test, and these choices can have downstream consequences for subsequent analyses. It also might not be as applicable to systems outside of Heliconius where less previous information is available about the history of speciation and introgression. In general, it is likely that most modelling decisions made in the study are justified, but more attention should be paid to how these decisions are made and what the consequences of them could be, including alternative models.

      We agree with the reviewer that inferring the species tree topology and placing introgression events on the species tree, although well justified here, may be challenging in many groups of organisms and may affect downstream analyses. We now discuss this as a limitation of our approach in the Discussion. In general, the initial MSC analysis without gene flow should provide information about possible species trees and introgression events. We can construct multiple introgression models and perform parameter estimation and model comparison to decide which best fits the data. This is summarized in the last paragraph of the section 'Approaches for estimating species phylogeny with introgression from whole-genome sequence data: advantages and limitations.' It would, of course, be nice to have a completely unsupervised method that could work with large phylogenies, but this is currently computationally impossible.

      • Co-estimating histories of speciation and introgression remains computationally challenging. To circumvent this in the study, the authors first estimate the history of speciation assuming no gene flow in BPP. While this approach should be robust to incomplete lineage sorting and gene tree estimation, it is still vulnerable to gene flow. This could result in a circular problem where gene flow causes the wrong species tree to be estimated, causing the true species tree to be estimated as a gene flow event.

      The goal of this initial analysis is to obtain a list of possible species trees with introgression events. We assume that gene flow results in a topology that is informative about the lineages involved. We also focus on common MAP trees with high posterior probabilities as less frequent trees or trees with low posterior probabilities reflect high uncertainty and are more likely to be erroneous. A difficulty is to decide which tree topology is most likely to be the true species tree. We summarize our approach in the Discussion.

      This is a flaw that this approach shares with summary-statistic approaches like the D-statistic, which also require an a-priori species tree.

      In a sense, this is true, but BPP is more flexible because it can be used to explore an arbitrary introgression model on any type of tree, while summary methods like D-statistic assume a specific species phylogeny with a particular introgression between nonsister lineages as well as fixed sampling configurations. Furthermore, as shown in the paper, we can compare different assumed trees, and test between them; we do this repeatedly in the paper for difficult branch placement issues. In contrast, summary methods such as the D-statistic works with species quartets only and do not work with either smaller or larger species trees.

      Enrichment of particular topologies on the Z chromosome helps resolve the true history in this particular case, but not all datasets will have sex chromosomes or chromosome-level assemblies to test against.

      Yes, we have the privilege of having chromosome-level assemblies available for Heliconius. In general, a spatial pattern of species tree estimates across genomic blocks can be informative about possible topologies that could represent the true species relationship. Then these candidate species trees can be tested by fitting different introgression models (as in Figure 1D,E) or by using the recombination rate argument (Figure 1F), which prefers trees common in low recombination rate regions of the genome, although this requires knowing a recombination rate map. In our case, we used a chromosome-level recombination rate per base pair, which is negatively correlated with the chromosome size. We have clarified this in the text. Ultimately, multiple lines of evidence should be examined before deciding on the most likely species tree. We now mention these potential difficulties with applying our methods to other datasets as limitations of our approach in the Discussion.

      • The a-priori specification of network models necessarily means that potentially better-fitting models to the data don't get explored. Models containing introgression events are proposed here based on parsimony to explain patterns in gene tree frequencies. This is a reasonable and common assumption, but parsimony is not always the best explanation for a dataset, as we often see with phylogenetic inference. In general, there are no rigorous approaches to estimating the best-fitting number of introgression events in a dataset.

      Joint inference of species topologies and possible introgression events remains computationally challenging. PhyloNet implements this joint inference but is limited to small datasets (<100 loci) and we found it to be unreliable.

      Likewise, the study estimates both pulse and continuous introgression models for certain partitions, though there is no rigorous way to assess which of these describes the data better.

      The Bayes factor can be used to compare different models fitted to the same data, for example, different MSC-I models with different introgression events, or MSC-I models with gene flow in pulses versus MSC-M models with continuous gene flow. We did not attempt this as it was clear to us that a better model would include both modes of gene flow, but such an option is not currently implemented in any software. Rather, we relied on our exploratory analysis (BPP MSC and 3s) and previous knowledge to inform a likely introgression model. In the case of groups that we fitted the MSC-M models, we chose to provide an intuitive justification as to why they might be more realistic than the MSC-I model without formally performing model selection.

      • Some aspects of the analyses involving inversions warrant additional consideration. Fewer loci were able to be identified in inverted regions, and such regions also often have reduced rates of recombination. I wonder if this might make inferences of the history of inverted regions vulnerable to the effects of incomplete lineage sorting, even when fitting the MSC model, due to a small # of truly genealogically independent loci.

      We agree with the reviewer that it is challenging to infer the history of a small region of the genome, such as the inversions studied here. Indeed, the presence of only a few loci in the 15b inversion means there is only limited information in the data for the species tree, as reflected in the low posterior probabilities for the MAP tree (Figure 3A). The effect of using tightly linked loci in the inversion should be increased uncertainty in the estimates, but not a systematic bias towards any particular species tree topology. Since major patterns of species relationships in each of the 15a, 15b and 15c regions are clear, we do not expect these effects to strongly influence our conclusions.

      Additionally, there are several models where introgression events are proposed to explain the loss of segregating inversions in certain species. It is not clear why these scenarios should be proposed over those in which the inversion is lost simply due to drift or selection.

      We know that the 15b inversion is absent in most species except for H. numata and H. pardalinus, at least, and that introgression of the inversion occurred between these two species, based on previous studies such as Jay et al (2018) and our own analysis. Polymorphism at this inversion forms a well-known “supergene” that affects mimicry, and is maintained by documented balancing selection in H. numata. Given this information, we propose a few possible scenarios of how the inversion might have originated, and when and where the introgression might have occurred, shown in Figure 3. In particular, the direction of introgression is something we test specifically. One way to test among these scenarios is to date the origin and introgression event of the inversion, but doing so properly is beyond the scope of this work. Nonetheless, we argue that it is at least likely that one difference between H. pardalinus and its sister species H. elevatus is the presence of the 15b inversion. Since other evidence shows that colour patterning loci in H. elevatus originated from an unrelated species, H. melpomene (i.e. the 15b and other non-inverted colour patterning loci), it is indeed likely that the inversion was “swapped out” by an uninverted sequence from H. melpomene during the formation of H. elevatus.

      We are aware that hypotheses such as these might appear highly elaborate and unparsimonious. But these are the conclusions where the data lead us. In the melpomene-silvanform clade, many speciation and introgression events occurred in short succession, and wild-caught hybrids prove that occasional hybridizations can occur across all 15 or so species in the group. We now detail how we have looked only for the major introgression patterns using a limited number of key speces. We leave fuller analyses for future work.

      In the main text, we have revised our discussion of the four proposed scenarios for 15b to improve clarity. We have also updated the introgression model from the melpomene-cydno clade to H. elevatus to be unidirectional based on the BPP results in Figure S18.

      Reviewer #2 (Public Review):

      Thawornwattana et al. reconstruct a species tree of the genus Heliconius using the full-likelihood multispecies coalescent, an exciting approach for genera with a history of extensive gene flow and introgression. With this, they obtain a species tree with H. aoede as the earliest diverging lineage, in sync with ecological and morphological characters. They also add resolution to the species relationships of the melpomene-silvaniform clade and quantify introgression events. Finally, they trace the origins of an inversion on chromosome 15 that exists as a polymorphism in H. numata, but is fixed in other species. Overall, obtaining better species tree resolutions and estimates of gene flow in groups with extensive histories of hybridization and introgression is an exciting avenue. Being able to control for ILS and get estimates between sister species are excellent perks. One overall quibble is that the paper seems to be best suited to a Heliconius audience, where past trees are easily recalled, or members of the different clades are well known.

      We thank the reviewer for the accurate summary and positive comments. Although our data and some of the discussion are specific to Heliconius, we believe our analysis framework will be useful to study species phylogeny and introgression in other taxa as well.

      Overall, applying approaches such as these to gain greater insight into species relationships with extensive gene flow could be of interest to many researchers. However, the conclusions could be strengthened with a bit more clarity on a few points.

      1) The biggest point of concern was the choice of species to use for each analysis. In particular the omission of H. ismenius in the resolution of the BNM clade species tree. The analysis of the chromosome 15 inversion seems to rely on the knowledge that H. ismenius is sister to H. numata, so without that demonstrated in the BNM section the resulting conclusions of the origin of that inversion are less interruptible.

      The choice of species to be included was mainly based on available high-quality genome resequence data from Edelman et al (2019), which were chosen to cover most of the major lineages within the genus. We agree that inclusion of H. ismenius would strengthen the analysis of the melpomene-silvaniform clade. In particular, it would be interesting to know which of only H. numata or H. numata+H. ismenius are responsible for the main source of genealogical variation across the genome in this group in Figure 2. The reviewer is correct in saying that we do assume that H. ismenius and H. numata are sister species. This relationship is supported by our analysis (Figure 3A) and previous analyses of genomic data, e.g. Zhang et al (2016), Cicconardi et al. (2023) and Rougemont et al. (2023). We made this clearer in the text:

      "Although this conclusion assumes that H. numata and H. ismenius are sister species while H. ismenius was not included in our species tree analysis of the melpomene-silvaniform clade (Figure 2), this sister relationship agrees with previous genomic studies of the autosomes and the sex chromosome (Zhang et al. 2016; Cicconardi et al. 2023; Rougemont et al. 2023)."

      2) An argument they make in support of the branching scenario where H. aoede is the earliest diverging branch is based on which chromosomes support that scenario and the key observation that less introgression is detected in regions of low recombination. Yet, they go no further to understand the relationship between recombination rate and species trees produced.

      We believe Figure 1F does examine this relationship, showing that trees under scenario 2 are more common in regions of the genome with lower recombination rates (i.e. in longer chromosomes). We added more clarification in the text where Figure 1F is mentioned. The relationship between recombination and introgression in Heliconius was earlier discovered and shown using windowed estimated gene trees in Martin et al. (2019) and in Edelman et al. (2019), so we did not re-test this here.

      3) How the loci were defined could use more clarity. From the methods, it seems like each loci could vary quite a bit in total bp length and number of informative sites. Understanding the data processing would make this paper a better resource for others looking to apply similar approaches.

      We added a new supplemental figure, Figure S20, to illustrate how coding and noncoding loci were extracted from the genome.

      Reviewer #3 (Public Review):

      The authors use a full-likelihood multispecies coalescent (MSC) approach to identify major introgression events throughout the radiation of Heliconius butterflies, thereby improving estimates of the phylogeny. First, the authors conclude that H. aoede is the likely outgroup relative to other Heliconius species; miocene introgression into the ancestor of H. aoede makes it appear to branch later. Topologies at most loci were not concordant with this scenario, though 'aoede-early' topologies were enriched in regions of the genome where interspecific introgression is expected to be reduced: the Z chromosome and larger autosomes. The revised phylogeny is interesting because it would mean that no extant Heliconius species has reverted to a non-pollen-feeding ancestral state. Second, the authors focus on a particularly challenging clade in which ancient and ongoing gene flow is extensive, concluding that silvaniform species are not monophyletic. Building on these results, a third set of analyses investigates the origin of the P1 inversion, which harbours multiple wing patterning loci, and which is maintained as a balanced polymorphism in H. numata. The authors present data supporting a new scenario in which P1 arises in H. numata or its ancestor and is introduced to the ancestor of H. pardilinus and H. elevatus - introgression in the opposite direction to what has previously been proposed using a smaller set of taxa and different methods.

      The analyses were extensive and methodologically sound. Care was taken to control for potential sources of error arising from incorrect genotype calls and the choice of a reference genome. The argument for H. aoede as the earliest-diverging Heliconius lineage was compelling, and analyses of the melpomene-silvaniform clade were thorough.

      The discussion is quite short in its current form. In my view, this is a missed opportunity to summarise the level of support and biological significance of key results. This applies to the revised Melpomenesilvaniform phylogeny and, in particular, the proposed H. numata origin of P1. It would be useful to have a brief overview of the relationships that remain unclear, and which data (if any) might improve estimates.

      We added a paragraph in the Discussion to summarize our key findings in 'An updated phylogeny of Heliconius', and discuss issues that remain uncertain.

      It was good to see the authors reflect on the utility of full-likelihood approaches more generally, though the discussion of their feasibility and superiority was at times somewhat overstated and reductive. Alternative MSC-based methods that use gene tree frequencies or coalescence times can be used to infer the direction and extent of introgression with accuracy that is satisfactory for a wide variety of research questions. In practice, a combination of both approaches has often been successful. Although full-likelihood approaches can certainly provide richer information if specific parameter estimates are of interest, they quickly become intractable in large species complexes where there is extensive gene flow or significant shifts in population size. In such cases, there may be hundreds of potentially important parameters to estimate, and alternate introgression scenarios may be impossible to disentangle. This is particularly challenging in systems, unlike Heliconius where there is little a priori knowledge of reproductive isolation, genome evolution, and the unique life history traits of each species. It would be useful for the authors to expand on their discussion of strategies that can simplify inference problems in such systems, acknowledging the difficulties therein.

      We agree that approximate methods based on summary statistics (e.g. gene tree topologies) are computationally much cheaper and are sometimes useful. We now discuss limitations of our approach regarding strategies for constructing possible introgression models, computational cost and analysis of large phylogenies, and modeling assumptions in the MSC framework in the first section of the Discussion.

      Reviewer #1 (Recommendations For The Authors):

      In addition to the comments raised in the public review, I have some minor suggestions:

      • In the Introduction, "Those methods have limited statistical power" implies summary-statistic methods have a high false negative rate for inferring the presence of introgression, which I don't think is true.

      We removed 'statistical' as we used the term power loosely to mean ability to estimate more parameters in the model by making a better use of information in the sequence data and not in the sense of a true positive rate.

      • When discussing full-likelihood approaches in a general sense, please cite additional methods than just BPP, such as PhyloNet.

      We added references for PhyloNet (Wen & Nakhleh, 2018) and starBEAST (Zhang et al., 2018) in the Introduction and Discussion.

      • Consider explicitly labelling chromosomal region 21 as the Z chromosome in relevant Figures, for ease of interpretation.

      In the main figures, we changed the chromosome label from 21 to Z.

      • From reading the main text it's not clear what a "3s analysis" is

      The 3s analysis estimates pairwise migration rates between two species by fitting an MSC-withmigration (MSC-M) model, also known as isolation-with-migration (IM), for three species, where gene flow is allowed between the two sister species while the outgroup is used to improve the power but does not involved in gene flow. We changed the text from

      "We use estimates of migration rates between each pair of species with a 3s analysis under the IM model of species triplets ..."

      to

      "We use estimates of migration rates between each pair of species under the the MSC-withmigration (MSC-M or IM) model of species triplets (3s analysis) ..."

      • "This agrees with the scenario in which H. elevatus is a result of hybrid speciation between H. pardalinus and the common ancestor of the cydno-melpomene clade [42, 43]." I don't think this model provides any support for hybrid speciation in particular, over a standard post-speciation introgression scenario.

      We took the finding that the introgression from the melpomene-cydno clade into H. elevatus occurs almost right after H. elevatus split off from H. pardalinus as evidence for hybrid speciation. We revised the text to make this clearer:

      "Our finding that divergence of H. elevatus and introgression from the cydno-melpomene clade occurred almost simultaneously provides evidence for a hybrid speciation origin of H. elevatus resulting from introgression between H. pardalinus and the common ancestor of the cydno-melpomene clade (Rosser et al. 2019; Rosser et al. 2023)."

      In particular, the Rosser et al. (2023) paper has now been submitted, and is the main paper to cite for the hybrid speciation hypothesis for H. elevatus.

      • "while clustering with H. elevatus would suggest the opposite direction of introgression" careful with terminology here; is this about direction (donor vs. recipient species) or taxa involved (which is not direction)?

      This is about the direction of introgression, not the taxa involved. We modified the text to make this clearer:

      "By including H. ismenius and H. elevatus, sister species of H. numata and H. pardalinus respectively, different directions of introgression should lead to different gene tree topologies. Clustering of (H. numata with the inversion, H. pardalinus) with H. numata without the inversion would suggest the introgression is H. numata → H. pardalinus while clustering of (H. numata with the inversion, H. pardalinus) with H. elevatus would suggest H. pardalinus → H. numata introgression."

      Reviewer #3 (Recommendations For The Authors):

      The work is methodologically sound and rigorous but could have been reported and discussed with greater clarity.

      It was difficult to assess the level of support for the proposed P1 introgression scenario without digging through the extensive supplementary materials. The discussion would ideally be used to clarify and summarise this.

      We have substantially revised the section on the P1 inversion. We also mention in the Results (in the final paragraph of the inversion section) and Discussion that our data provided robust evidence that the introgression of the inversion is from H. numata into H. pardalinus while its precise origin (in which lineage and when it originated) remains uncertain.

      The authors may also wish to compare their results to the recent work by Rougemont et al. on introgression between H. hecale and H. ismenius in the discussion.

      We now mention Rougemont et al. (2023) in the Discussion as an example of introgression of small regions of the genome involved in wing patterning. We also acknowledge that our updated phylogeny does not include this kind of local introgression.

      It was not initially obvious which number corresponded to the Z chromosome in any of the figures, even though this is critical to their interpretation.

      We changed the label for chromosome 21 to Z in the main figures.

      The supplementary tables should be described in more detail. For example, what is 'log_bf_check' and 'prefer_pred' in supplementary table S11?

      We added more details explaning necessary quantities in the table heading in both SI file and in the spreadsheet.

      Minor comments:

      First paragraph of 'Complex introgression in the 15b inversion region (P locus):' Rephrase "This suggests another introgression between the common...".

      We modified the text as follows:

      "Another feature of this 15b region is that among the species without the inversion, the cydnomelpomene clade clusters with H. elevatus and is nested within the pardalinus-hecale clade (without H. pardalinus). This is contrary to the expectation based on the topologies in the rest of the genome (Figure 2A, scenarios a–c) that the cydno-melpomene clade would be sister to the pardalinus-hecale clade (without H. pardalinus). One explanation for this pattern is that introgression occurred between the common ancestor of the cydno-melpomene clade and either H. elevatus or the common ancestor of H. elevatus and H. pardalinus together with a total replacement of the non-inverted 15b in H. pardalinus by the P1 inversion from H. numata (Jay et al. 2018). We confirm and quantify this introgression below."

      Second paragraph of 'Major Introgression Patterns in the melpomene-silvaniform clade:' "cconclusion" should be "conclusion."

      Corrected.

      Paragraph preceding discussion: sentences toward the end of the paragraph should be rephrased for clarity. E.g. "different tree topologies are expected under different direction of introgression."

      We revised this paragraph. The sentence now says:

      "By including H. ismenius and H. elevatus, sister species of H. numata and H. pardalinus respectively, different directions of introgression should lead to different gene tree topologies.<br /> Clustering of (H. numata with the inversion, H. pardalinus) with H. numata without the inversion would suggest the introgression is H. numata → H. pardalinus while clustering of (H. numata with the inversion, H. pardalinus) with H. elevatus would suggest H. pardalinus → H. numata introgression."

      I enjoyed reading this paper and I am certain it will generate discussion and future research.

    1. Author Response

      The following is the authors’ response to the original reviews.

      Reviewer #1 (Public Review):

      While the manuscript was reasonably clearly written and the methodology and results sound, it is not clear what the real contribution of the work is. The authors' findings - that ultrasonic stimulation is capable of altering intracellular Ca2+ to effect an increase in EV secretion from cells as long as the irradiation does not affect cell viability-is well established (see, for example, Ambattu et al., Commun Biol 3, 553, 2020; Deng et al., Theranostics, 11, 9 2021; Li et al., Cell Mol Biol Lett 28, 9, 2023). Moreover, the authors' own work (Maeshige et al., Ultrasonics 110, 106243, 2021) using the exact same stimulation (including the same parameters, i.e., intensity and frequency) and cells (C2C12 skeletal myotubes) reported this. Similarly, the authors themselves reported that EV secretion from C2C12 myotubes has the ability to regulate macrophage inflammatory response (Yamaguchi et al., Front Immunol 14, 1099799, 2023). It would then stand to reason that a reasonable and logical deduction from both studies is that the ultrasonic stimulation would lead to the same attenuation of inflammatory response in macrophages through enhanced secretion of EVs from the myotubes.

      We appreciate your comments and suggestions. Ambattu et al. in their report stated that the high frequency acoustic stimulation they used has a less effect on cell membranes than the 1 MHz ultrasound that we used in this study. Deng et al. and Li et al. applied low intensity pulsed ultrasound (LIPUS) (about 300 mW/cm2) in their studies. In this study, we assumed that ultrasound induced increase in EV secretion via increased Ca2+ influx into the cell by enhancing cell membrane permeability, and since it has been reported that the effect of ultrasound-induced enhancement in cell membrane permeability increases in an intensity-dependent manner (Zeghimi et al., 2015), we applied intensities of 1-3 W/cm2. While previous studies using LIPUS have used 15 minutes of irradiation, the high intensity employed in this study was capable to promote EV release after 5 minutes of stimulation. We have added the above explanation to the introduction in the revised version of the manuscript. Furthermore, while the previous studies used other types of cells, the main purpose of this study was to determine the optimal ultrasound intensity to promote EV release from skeletal muscle and to determine whether ultrasound-induced EVs are qualitatively altered compared to those released under normal conditions, thereby validating the anti-inflammatory effects of ultrasound-induced muscle EVs. Our previous study (Maeshige et al. 2021) used the same muscle cells but did not investigate an intensity dependence, so this is the first study to show that ultrasound irradiation promotes EV release in an intensity-dependent manner in muscle. In addition, we would like to emphasize that this study also goes beyond our previous study in the method of stimulation. Specifically, the present study a more efficient 5-minute irradiation protocol was used, whereas the previous study have adopted a 9-minute intervention.

      We understand that the results of this study are predictable from two of our previous studies, but since stimulus-induced EVs may be qualitatively different compared to EVs released under normal conditions (Kawanishi et al., 2023; Li et al., 2023), it is worthwhile to examine the effects of stimulus-induced EVs. This explanation has been added in the introduction of revised version of the manuscript.

      The authors' claim that 'the role of Ca2+ in ultrasound-induced EV release and its intensity-dependency are still unclear', and that the aim of the present work is to clarify the mechanism, is somewhat overstated. That ultrasonic stimulation alters intracellular Ca2+ to lead to EV release, therefore establishing their interdependency and hence demonstrating the mechanism by which EV secretion is enhanced by the ultrasonic stimulation, was detailed in Ambattu et al., Commun Biol 3, 553, 2020. While this was carried out at a slightly higher frequency (10 MHz) and slightly different form of ultrasonic stimulation, the same authors have appeared to since establish that a universal mechanism of transduction across an entire range of frequencies and stimuli (Ambattu, Biophysics Rev 4, 021301, 2023).

      In this study, we showed that Ca2+ is involved in ultrasound-induced EV release using Ca2+-depleted culture medium, but since we did not examine the mechanism in more detail than that, we modified the introduction to avoid overstating.

      Similarly, the anti-inflammatory effects of EVs on macrophages have also been extensively reported (Li et al., J Nanobiotechnol 20, 38, 2022; Lo Sicco et al., Stem Cells Transl Med 6, 3, 2017; Hu et al., Acta Pharma Sin B 11, 6, 2021), including that by the authors themselves in a recent study on the same C2C12 myotubes (Yamaguchi et al., Front Immunol 14, 1099799, 2023). Moreover, the authors' stated aim for the present work - clarifying the mechanism of the anti-inflammatory effects of ultrasound-induced skeletal muscle-derived EVs on macrophages - appears to be somewhat redundant given that they simply repeated the microRNA profiling study they carried out in Yamaguchi et al., Front Immunol 14, 1099799, 2023. The only difference was that a fraction of the EVs (from identical cells) that they tested were now a consequence of the ultrasound stimulation they imposed.

      That the authors have found that their specific type of ultrasonic stimulation maintains this EV content (i.e., microRNA profile) is novel, although this, in itself, appears to be of little consequence to the overall objective of the work which was to show the suppression of macrophage pro-inflammatory response due to enhanced EV secretion under the ultrasonic irradiation since it was the anti-inflammatory effects were attributed to the increase in EV concentration and not their content.

      In comparison with the current study, our previous study observed EVs secreted only from muscle in normal condition. However, the purpose of the current study is to answer the question whether ultrasound treatment could enhance the effect of EVs and change the encapsuled miRNAs. Although we identified several miRNAs which are specifically induced by ultrasound, further studies are needed to demonstrate the effect of those miRNAs derived from ultrasound-treated muscles on macrophages. We have mentioned this limitation in the discussion of the revised manuscript.  

      Reviewer #1 (Recommendations For The Authors):

      This reviewer felt that there was a lack of novelty in the manuscript and that the results of the work confirm conclusions that could have been logically deduced from a combination of the authors' preceding work (Maeshige et al., Ultrasonics 110, 106243, 2021 and Yamaguchi et al., Front Immunol 14, 1099799, 2023). The contribution of the work could perhaps be elevated if the authors were to focus more on whether the 0.01% of altered miRNA has any impact on cellular activity.

      As mentioned above, the present study is novel compared to our previous studies for examining the effects of ultrasound-induced EVs. In addition, the fact that EV content is maintained after ultrasound stimulation rather indicates that ultrasound can be used as a highly stable and effective method of promoting EV release.

      A further, albeit more minor, recommendation is to omit lines 73-80 in the manuscript. The discussion on physical exercise for promoting EV secretion together with the non-invasive nature of ultrasound therapy is very misleading as it creates the impression that the authors' work can be applied as a direct intervention on a patient. This was not shown in the work, which was limited to irradiating cells ex vivo.

      We agree and have edited the introduction.

      Reviewer #2 (Public Review):

      1. The exploration of output parameters for US induction appears limited, with only three different output powers (intensities) tested, thus narrowing the scope of their findings.

      We appreciate your comments and suggestions. The intensity of LIPUS is basically in the ~0.3 W/cm2 range, and in clinical practice, ~2.5 W/cm2 is considered to be a safe intensity to irradiate the human body (Draper, 2014). Therefore, 3.0 W/cm2 is also a fairly high intensity for the human body, so 3.0 W/cm2 was set as the maximum intensity in this study.

      1. Their claim of elucidating mechanisms seems to be only partially met, with a predominant focus on the correlation between calcium responses and EV release.

      The focus of this study was to examine the effects of ultrasound-induced EVs on the inflammatory responses of macrophages and not on the detailed mechanism of calcium involvement. We revised the introduction to make the purpose of this study clearer.

      1. While the intracellular calcium response is a dynamic activity, the method used to measure it could risk a loss of kinetic information.

      Although we did not examine the kinetic action of calcium, we believe that Ca2+ is at least proven to be involved to the EV-promoting effect of ultrasound on muscle, since the enhancement of EV release by ultrasound was canceled by elimination of calcium from the culture medium. Furthermore, real-time measurement of Ca2+ after ultrasound irradiation has shown that ultrasound irradiation promotes Ca2+ influx into cells immediately after the irradiation. (Fan et al., 2010).  

      1. The inclusion of miRNA sequencing is commendable; however, the interpretation of this data fails to draw clear conclusions, diminishing the impact of this segment.

      Although we identified several miRNAs which are specifically induced by ultrasound, further studies are needed to demonstrate the effect of those miRNAs derived from US-treated muscles on macrophages. We have mentioned this limitation in the discussion of the revised version of manuscript.

      While the authors have shown the anti-inflammatory effects of US-induced EVs on macrophages, there are gaps in the comprehensive understanding of the mechanisms underlying US-induced EV release. Certain aspects, like the calcium response and the utility of miRNA sequencing, were not fully explored to their potential. Therefore, while the study establishes some findings, it leaves other aspects only partially substantiated.

      As stated above, the main purpose of this study was to examine the effects of ultrasound-induced EVs on the inflammatory responses of macrophages. We set detailed investigation on the mechanism of ultrasound-induced EV release as our next step and have revised the introduction and discussion of the revised manuscript to make the purpose and limitation of this study clearer.  

      Reviewer #2 (Recommendations For The Authors):

      The author's exploration into the role of Ca2+ in the context of US-induced EV release is a timely endeavor, especially given the growing interest in understanding the cellular dynamics associated with external stimulants like ultrasound. Nevertheless, the manuscript does not unambiguously define the mechanism of action and its broader implications.

      Ca2+ has long been established as a versatile intracellular messenger, governing a myriad of cellular processes. There is a wealth of methodologies, from specific inhibitors to specialized assays, tailored to dissect the role of Ca2+ in diverse contexts. In the specific case of US-induced Ca2+ activity, the expectation would be for a clear, mechanistic delineation of how this ionic surge drives EV release. Yet, this study stops short of providing those details. It is imperative for the authors to dig deeper, employing a diverse set of tools at their disposal, to fill this knowledge gap.

      Recently, it was reported that increased Ca2+ influx causes an increase in EV secretion via the plasma membrane repair protein annexin A6 (Williams et al. 2023). However, the full mechanism of how an increase in intracellular Ca2+, let alone ultrasound-induced Ca2+, promotes EV release has not yet been understood yet, and it is beyond the scope of this study to elucidate this part of the mechanism.

      Furthermore, the paper raises another important question: Which specific proteins are pivotal in orchestrating the US-induced Ca2+ entry in myotubes? Addressing this would not only enhance the manuscript's novelty but would also contribute a vital piece to the puzzle of understanding US-cellular interactions.

      Ultrasound increases Ca2+ uptake by increasing cell membrane permeability by sonoporation, rather than via protein reactions (Fan et al., 2010). We added this explanation to the introduction in the revised version of manuscript.  

      Lastly, while the report touches upon the influence of varying US output power on EV concentrations, it piques curiosity about potential effects beyond the 3W/cm2 threshold. It's observed that cell viability isn't compromised at this intensity, suggesting room for further exploration. Would a higher intensity yield a proportionally increased EV release, or is there a saturation point? Conversely, could intensities beyond 3W/cm2 begin to have deleterious effects on the cells? These are crucial considerations that merit investigation to realize the full potential of US as a modulatory tool, both for research and therapeutic applications.

      As mentioned above, 3.0 W/cm2 was adopted as the maximum intensity in this study with reference to the intensity used in clinical practice. In addition, since the cytotoxicity and therapeutic effects of ultrasound depend not only on intensity but also on other parameters such as duty cycle, acoustic frequency, pulse repetition frequency and duration, so a comprehensive analysis of the effects of ultrasound on cells at various parameter settings would be valuable as an independent study.

    1. Author Response

      The following is the authors’ response to the original reviews.

      We greatly appreciate your positive assessment and the comments by the two reviewers on the previous version of our manuscript, all of which are very helpful and greatly improved our manuscript. We have incorporated all changes and corrections requested by these reviewers and we believe their suggestions have enhanced the overall quality of our manuscript.

      As for Reviewer #1.

      We thank Reviewer 1 very much for her/his very positive and detailed remarks, all of which have been introduced into the revised version of our manuscript.

      We have added the information about the biological control on the development of phosphatic-shelled brachiopod columns in the introduction, so that our late narrative can be more understandable. The Cambrian Explosion is the innovation of metazoan body plans and radiation of animals during a relatively short geological time. The expansion of new body plans in different groups of brachiopods in the early Cambrian was likely driven by the Cambrian Explosion. The columnar architectures are not developed in living lingulate brachiopods, and thus it is important to get a better understanding of this extinct shell architecture from the fossil records on a global scale in order to study the evolutionary trend of shell architectures and compositions in brachiopods. We hope the current comparison study of columnar shell architectures from some of the oldest known brachiopods will help to pursue this goal. Furthermore, the adaptive innovation of biomineralized columnar architecture in early brachiopods is discussed in the revised manuscript.

      As for Reviewer #2.

      We thank Reviewer 2 very much for her/his very constructive and detailed remarks. All the comments have been thoroughly considered, and introduced into the revised version of the manuscript.

      The current information on the shell structures of early linguliform brachiopods is unclear, which has been introduced in the revised manuscript and the supplementary Appendix 1. We also state that more detailed studies of the complexity and diversity of linguliform brachiopod architectures (especially their early fossil representatives) require further investigations. As the shell structure and biomineralization process are crucial to unravel the poorly resolved phylogeny and early evolution of Brachiopoda, in this paper, we undertake a primary study of exquisitely well-preserved brachiopods from the Cambrian Series 2. The shapes and sizes of microscopic cylindrical columns are described in detail in this research, and this work will be useful for further comparative studies on brachiopod shell architecture. The important reference paper on brachiopod shells by Butler et al. (2015) has been added to the revised manuscript. The structure and language of the manuscript are revised based on the very helpful suggestions.

      Concerning the families Eoobolidae and Lingulellotretidae, we are aware of the current problematic situation of these families, and we have added more discussion about the detailed characters of Eoobolidae in the Systematic Palaeontology part of the manuscript. However, the revision of the families Eoobolidae and Lingulellotretidae falls outside the scope of this paper. We prefer to leave it now as it will be part of an upcoming publication based on more global materials from China, Australia, Sweden and Estonia that we are currently working on.

      On behalf of my co-authors, I thank you for taking the time to consider our manuscript for publication in eLife and I hope that with the changes we have made to our paper, it is now suitable for publication. If you have any further questions about our revised manuscript, please do not hesitate to get in contact. Thank you very much for your time and consideration.

    1. Author Response

      The following is the authors’ response to the original reviews.

      The authors deeply appreciate the reviewer’s constructive criticism.

      Answers to the public review from Reviewer 1

      1. The pathogenesis of truncating LRRC23 in asthenozoospermia needs to be further considered. The molecular mechanism of LRRC23 demonstrated in mice should be tested in patients with the LRRC23 variant. As it may be difficult to determine the structures of RS3 in the infertile male sperm, the LRRC23 localization should be observed in the sperm from patients with the LRRC23 variant.

      We understand the reviewer’s point. Unfortunately, the patients declined to continue in the project after the initial clinical evaluation and blood draw, so we were unable to follow up.

      1. The absence of the RS3 head in LRRC23Δ/Δ mouse sperm is not sufficient to support the specific localization of LRRC23 in RS3 head. Although LRRC23 might bind to RS head protein RSPH9, the authors state that "RSPH9 is a head component of RS1 and RS2 like in C. reinhardtii (Gui et al, 2021), but not of RS3" as the protein level and the localization of RSPH9 is not altered in LRRC23Δ/Δ sperm. Thus, the specific localization of LRRC23 in RS3 head should be further confirmed.

      Thank you for your comment. We agree with the reviewer that the specific localization of LRRC23 within the RS3 head needs to be further confirmed, but this requires an atomic resolution structure of the RS3 head, which is beyond the scope of the current study. We will pursue this direction in our future study.

      3) The interaction between LRRC23 and RSPH9 needs to be defined. AlphaFold models could help determine the likelihood of a direct interaction. In addition, the structure of the 96-nm modular repeats of axonemes from the flagella of human respiratory cilia has been determined (PMID: 37258679), and the localization of LRRC23 in RS could be further predicted.

      We appreciate the comment. We are pursuing an atomic resolution structure of the RS3 head, and thus leave the prediction and detailed localization to future studies.

      4) The ortholog of the RSP15 may also be predicted or confirmed by using the reported structure in human respiratory cilia (PMID: 37258679). Whether the LRCC34 in RS2 is LRRC34?

      Based on the amino acid sequence and AlphaFold predicted structure comparison, we proposed LRRC34 as the RSP15 orthologue. We agree that further clarification of whether the reported RSP15 structure in human respiratory cilia is LRRC34 is valuable, but we would like to focus the current study on re-annotating LRRC23 function to RS3 and male infertility.

      Answers to the public review from Reviewer 2

      1. While the author generated mutant mice expressing truncated LRRC23 proteins, the expression of these truncated proteins was not detected in sperm. This implies that, in terms of sperm structure, the mutant LRRC23 protein behaves similarly to the complete knockout of the LRRC23 protein, which has been previously reported and characterized (Zhang et al., 2021).

      We partially agree with the reviewer’s comments. Indeed, the spermatozoa from truncated mutant LRRC23 mice may be similar to those from the complete knockout. However, the truncated LRRC23 in the testis could in part contribute to the assembly and structural organization of the RS3 head and/or bridge during spermatogenesis, and thus it is possible that complete absence of the LRRC23 could result in more severe structural defects in the RS3 and bridge structure. Therefore, to simply infer the same defects requires a direct comparison.

      1. This reviewer questions the proposal that LRRC23 is an integral component of RS3, as the results indicate not only the loss of the RS3 head structure but also an incomplete RS2-RS3 junction structure. In addition, the interaction of LRRC23 with RSPH9 alone does not fully explain its involvement solely in RS3 assembly. Additional evidence is required to examine the influence of LRRC23 on the RS2-RS3 junction.

      Thank you for the reviewer’s point. In a previous study, LRRC23 was detected in tracheal cilia that lack the bridge structure. Thus, we concluded that LRRC23 is a component in the RS3 head, but not necessarily in the RS2-RS3 bridge structure, although the bridge structure is also affected. Broad structural defects due to single protein loss of function are often observed in sperm flagella. For example, deficiency of RSPH6A, an RS head component, affects not only the RS structure but the entire flagellar structure in a non-uniform manner, resulting in multiple morphological flagellar abnormalities. We anticipate that our future study to determine the molecular architecture in the RS3 head and bridge structure will provide further insights into this question.

      1. The article does not explore how these mutations affect the flagella structure in human sperm, which needs further study. Expanding the study to include human sperm structure would undoubtedly enhance the quality of the article.

      We agree with the importance of further pursuing the effect of these mutations in human samples, but faced practical difficulties. As responded to reviewer 1, the patients not only dropped out of the project, but also are distantly located in remote region of Pakistan, making the application of cryo-ET not feasible.

      Answers to the recommendations of Reviewer 1

      1. The statistics analysis should be performed in Figures 2E and 2F.

      We appreciate the reviewer’s recommendation. For 2E, since the standard deviations for two groups are equal to 0, it is not possible to perform appropriate statical analyses. For 2F, since the knockout males do not sire, it is not possible to know the number of litters in this case. Therefore, litter size information is not available for knockout males, and statistical analyses are not applicable.

      1. In Figure 3A, the human sperm RS structures (PMID: 36593309) should be provided.

      Thanks for the suggestion. We have included human sperm RS structures as suggested.

      1. The molecular weight markers should also be added in Figure 3F (left), EV4B, and EV5B (AKAP3, RSPH9, AcTub).

      In the original Figure 3F, the markers were shown as the white lines in the blot images due to the space limitations. Since the previous markers are not clearly visible, we have changed the color to yellow. The marker information in EV4B and 5B has also been updated.

      Answers to the recommendations of Reviewer 2

      1. Line 119, Table S1 is incorrectly shown.

      We have corrected the Table nomenclature to Table EV1.

      1. Line 132, the author suggests that LRRC23 mutations do not affect female reproduction based on the fertility of the mother. However, this conclusion may lack rigor since it overlooks the sterility of IV-4. To address this, the author needs to examine the fertility of female mice more comprehensively. Additionally, considering the higher expression level of LRRC23 in the oviduct, the author should investigate any potential changes in the oviduct cilia.

      Thank you for the reviewer’s comment. As described in line 134, the mother of IV-4, who also carries the homozygous mutant allele like IV-4, was fertile. In addition, Lrrc23Δ/Δ female mice are fertile (now added in lines 173-174). In fact, we maintain the mouse line by crossing Lrrc23Δ/Δ females with heterozygous males. Thus, our initial conclusion that the LRRC23 mutation does not cause female fertility is still valid. However, LRRC23 has a function in the regulation of oviductal cilia requires further study, so we have softened down the corresponding sentence.

      1. In the article, the author mentions that there are some morphological differences observed in the sperm, which are not clearly depicted in Fig.1B. It is essential to specify the specific changes in sperm morphology that the author identified.

      Thank you for your comment. The morphological variations (e.g., the sperm in the lower left corner of Fig.1B has more a rounded sperm head) meant overall normal morphology with the normal range of occurrence in abnormal sperm morphology in normal fertile men, not necessarily caused by the LRRC23 mutation. To avoid confusion, we have rephrased the sentence (see lines 122-124).

      1. In Fig.3F, the previous study confirmed an interaction between LRRC23 and RSPH3 (Zhang et al., 2021), but the current manuscript does not demonstrate such an interaction; the author should explain the text.

      We appreciate your point. This could be due to the different interaction condition in vitro, and we described the possibility in main text (See Lines 200-201).

      1. In the case of the interaction between LRRC23 and RSPH9, the author utilizes human protein to detect but conducts phenotype verification in mice. Thus, discussing the relevance and potential limitations of extrapolating these findings from human protein interactions to the phenotypic effects

      Thank you for the reviewer’s suggestion. We added discussion for that part (lines 336-341).

      1. The authors needed to detect changes in LRRC23 protein and mRNA levels at different stages of spermatogenesis.

      We agree that expression profiling of LRRC23 protein levels in developing male germ cells will be helpful to further understand LRRC23 function in spermatogenesis, but we do not perceive that it is not critical in this study as LRRC23 mRNA expression profiling from scRNA database (Fig. EV4) hints at the protein profiles.

      1. In Figure 4C of the article, the author should provide a clear and detailed explanation in the text of how they distinguish RS1, RS2, and RS3.

      We added the information in figure legends (lines 1034-1037).

      1. Zoom in on the RS structure in Fig.EV5D for precise observation.

      In TEM images with limited resolution, we could not tell which RS (RS1, 2, or 3) we have in the cross-section, and simple zoom-in does not provide a better and/or more accurate observation (the main reason, we moved forward with cryo-ET).

      1. By utilizing computational modeling and bioinformatics tools, the authors gain insights into the potential interactions, binding sites, and structural features of LRRC23 within the RS3 complex. This approach provides a deeper understanding of LRRC23's function and role in the assembly and stability of the RS3 complex. To enhance the clarity and visualization of the findings, the authors should generate a schematic diagram that illustrates the proposed interactions and structural organization of LRRC23 within the RS3 complex.

      We appreciate the reviewer’s suggestion to speculate the molecular position and interaction of LRRC23 within the RS3 complex. For the level of computational modeling and bioinformatics, we believe that purification of RS3 complex and LRRC23 interactome study is required, which is one of our future directions. Given the limitation of our current data, we choose to stay conservative and not to suggest detailed structural information of LRRC23 in RS3 complex.

    1. Author Response

      The following is the authors’ response to the original reviews.

      Re: Revised author response for eLife-RP-RA-2023-90135 (“The white-footed deermouse, an infection-tolerant reservoir for several zoonotic agents, tempers interferon responses to endotoxin in comparison to the mouse and rat” by Milovic, Duong, and Barbour”)

      The revised manuscript has taken into account all the comments and questions of the two reviewers. Our responses to each of the comments are detailed below. In brief, the modifications or additional materials for the revision each specifically address a reviewer comment. These modifcations or materials include the following….

      • a more in-depth consideration of sample sizes

      • a better explanation of what p values signify for a GO term analysis

      • a more detailed account of the selection of the normalization procedure for cross-species targeted RNA-seq (including a new supplemental figure)

      • several more box plots in supplementary materials to complement the scatterplots and linear regressions of the figures of the primary text

      • provision in a public access repository of the complete data for the RNA-seq analyses as well as primary data for figures and tables as new supplementary tables

      • the expansion of description of the analysis done for the revision of Borrelia hermsii infection of P. leucopus. This included a new table (Table 10 of the revision) • development of the possible relevance of finding for longevity studies by citing similarities of the findings in P. leucopus with those in the naked mole-rat

      • what we think is a better assessment of differences between female and male P. leucopus for this particular study, while still keeping focus on DEGs in common for females and males. This included a new figure (Figure 4 of the revision).

      • removal of reference to a “inverse” relationship between Nos2 and Arg1 while still retaining ratios of informative value

      We note that in the interval between uploading the original bioRxiv preprint and now we learned of the paper of Gozashti, Feschotte, and Hoekstra (reference 32), which supports our conception of the important place of endogenous retroviruses in the biology and ecology of deermice. This is the only addition or modification that was not a direct response to a reviewer comment or question, but it was germane to one of Reviewer #1’s comments (“Regarding..”).

      Reviewer #1:

      Supplemental Table 1 only lists genes that passed the authors statistical thresholds. The full list of genes detected in their analysis should be included with read counts, statistics, etc. as supplemental information.

      We agree that provision of the entire lists of reference transcripts and the RNA-seq results for each of the 40 animals is merited. These datasets are too large for what the journal’s supplementary materials resource was intended for, so we have deposited them at the Dryad public access repository.

      While P. leucopus is a critical reservoir for B. burgdorferi, caution should be taken in directly connecting the data presented here and the Lyme disease spirochete. While it's possible that P. leucopus have a universal mechanism for limiting inflammation in response to PAMPs, B. burgdorferi lack LPS and so it is also possible the mechanisms that enable LPS tolerance and B. burgdorferi tolerance may be highly divergent.

      The impetus for the study was the phenomenon of tolerance of infection of P. leucopus by a number of different kinds of pathogens, not just B. burgdorferi. We take the reviewer’s point, though. Certainly, the white-footed deermouse is probably most notable at-large for its role as a reservoir for the Lyme disease agent. We doubt that the species responses to LPS and to the principal agonists of B. burgdorferi are “highly divergent”, though. Other than the TLR itself-TLR4 for LPS vs the heterodimer TLR2/TLR1 for the lipoproteins of these spirochetes--the downstream signaling is generally similar for amounts comparable in their agonist potency.

      We had thought that we had addressed this distinction for B. burgdorferi and other Borreliaceae members by referring to the earlier study. But we agree with the reviewer that what was provided on this point was insufficient in the context of the present work. Accordingly, for the revision we have added a new analysis of the data on experimental infection of P. leucopus with Borrelia hermsii, which lacks LPS and for which the TLR agonists eliciting inflammation are lipoproteins. We do this in a format (new Table 6) that aids comparison with the LPS experimental data elsewhere in the article. As the manuscript references, B. burgdorferi infection of P. leucopus elicits comparatively little inflammation in blood even at the height of infection. While this phenomenon with the Lyme disease agent was part of the rationale driving these studies, the better comparison with LPS was 5 days into B. hermsii infection when the animals are spirochetemic.

      Statistical significance is binary and p-values should not be used as the primary comparator of groups (e.g. once a p-value crosses the deigned threshold for significance, the magnitude of that p-value no longer provides biological information). For instance, in comparing GO-terms, the reason for using of high p-value cutoffs ("None of these were up-regulated gene GO terms with p values < 1011 for M. musculus.") to compare species is unclear. If the authors wish to compare effect sizes, comparing enrichment between terms that pass a cutoff would likely be the better choice. Similarly, comparing DEG expression by p-value cutoff and effect size is more meaningful than analyses based on exclusively on p-value: "Of the top 100 DEGs for each species by ascending FDR p value." Description in later figures (e.g. Figure 4) is favored.

      Effect sizes--in this case, fold-changes--were taken into account for GO term analysis and were specified in the settings that are described. So, any gene that was “counted” for consideration for a particular GO term would have passed that threshold and with a falsediscovery corrected p value of a specified minimum. There is no further scoring of the “hit” based upon the magnitude of the p value beyond that point. It is, as the reviewer writes, binary at that point. We are in agreement on those principles.

      As we understand the comment above, though, the p-values referred to are in regard to the GO term analysis itself. The objective was discovery followed by inference. The situation was more like a genome-wide association study (GWAS) study. This is not strictly speaking a hypothesis test, because there was no stated hypothesis ahead of time or one driving the design. The “p value” for something like GO term analysis or GWAS provides an estimate of the strength of the association. It is not binary in that sense. The lower the p value, the greater confidence about the association. In a GWAS of a human population an association of a trait with a particular SNP or indel is usually not taken seriously unless the p value is less than 10^-7 or 10^-8. In the case of GO terms, the p value approximates (but is not equivalent to) the number of genes that are differentially expressed that belong to a GO cluster out of the total number of genes that define that cluster. The higher the proportion of the genes in the cluster that are associated with a treatment (LPS vs. saline), the lower the p value. Thus, it provides information beyond the point at which it would be rightly deemed of little additional value in many hypothesis testing circumstances.

      That said, we agree that the original manuscript could have been clearer on this point and have for the revision expanded the description of the GO term analysis in the Methods, including some explanation for a reader on what the p value signifies here. We also refrain from specifying a certain p value for special attention and merely list 20 by ascending p value.

      The ability to use of CD45 to normalize data is unclear. Authors should elaborate both on the use of the method and provide some data how the data change when they are normalized. For instance, do correlations between untreated Mus and Peromyscus gene expression improve? The authors seem to imply this should be a standard for interspecies comparison and so it would be helpful to either provide data to support that or, if applicable, use of the technique in literature should be referenced.

      The reviewer brings up an important point that we considered addressing in more depth for the original manuscript but in the end deferred to considerations about length and left it out.

      But we are glad to address this here, as well as in the revised manuscript.

      We did not intend to imply either that this particular normalization approach had been done before by others or that it “should” be a standard. We are not aware of another report on this, and it would be up to others whether it would be useful or not for them. We made no claim about its utility in another model or circumstance. The challenge before us was to do a comparative analysis of transcription in the blood not just for animals of one species under different conditions but animals of two different genera under different conditions. A notable difference between the animals was in their white blood cell counts, as this study documents. White cells would be the source of a majority of transcripts of potential relevance here, but there would also be mRNA for globins, from reticulocytes, from megakaryocytes, and likely cell-free RNA with origins in various tissues. If the white cell numbers differed, but the non-white cell sources of RNA did not, then there could be unacknowledged biases.

      It would be like comparing two different kinds of tissues and assuming them to be the same in the types and numbers of cells they contained. Four hours after a dose of LPS the liver cells (or brain cells) would differ in their transcriptional profiles from untreated the livers (or brains) of untreated animals for sure, but there would not be much if any change in the numbers of different kinds of cells in the liver (or brain) within 4 hours. The blood can change a lot in composition within that time frame under these same conditions. Some sort of accounting for differing white cell numbers in the blood in different outbred animals of two species seemed to be called for.

      The normalization that was done for the genome-wide analysis was not based on a particular transcript, but instead was based on the total number of reads, the lengths of the reference transcripts, and the distributions of reads matching to the tens of thousands of references for each sample. This was done according to what are standard procedures by now for bulk RNAseq analyses. Because the reference transcript sets for P. leucopus and M. musculus differed in their numbers and completeness of annotation, we did not attempt any cross-species comparison for the same set of genes at that point. That would not be possible because they were not entirely commensurate.

      The GO term analysis of those results provided the leads for the more targeted approach, which was roughly analogous to RT-qPCR. For a targeted assay of this sort, it is common to have a “housekeeping gene” or some other presumably stably transcribed gene for normalization. A commonly used one is Gapdh, but we had previously found that Gapdh was a DEG itself in the blood in P. leucopus and M. musculus at the four hour mark after LPS. The aim was to provide for some adjustment so datasets for blood samples differing in white blood cell counts could be compared. Two options were the 12S ribosomal RNA of the mitochondria, which would be in white cells but not mature erythrocytes, and CD45, which has served an approximately similar function for flow cytometry of the blood. As described in what has been added for the revision and the supplementary materials, we compared these different approaches to normalization. Ptprc and 12S rRNA were effectively interchangeable as the denominator with identifying DEGs of P. leucopus and M. musculus and cross-species comparisons.

      Regarding the ISG data-is a possible conclusion not that Peromyscus don't upregulate the antiviral response because it's already so high in untreated rodents? It seems untreated Peromyscus have ISG expression roughly equivalent to the LPS mice for some of the genes. This could be compared more clearly if genes were displayed as bar plots/box and whisker plots rather than in scatter plots. It is unclear why the linear regression is the key point here rather than normalized differences in expression.

      In answer to the question: yes, that is possible. In the interval between uploading of the manuscript and this revision, we became aware of a study by Gozashti and Hoekstra published this year in Molecular Biology and Evolution (reference 32) and reporting on the “massive invasion” of endogenous retroviruses in P. maniculatus and the defenses deployed in response to achieve silencing. We cite this work and discuss it, including related findings for P. leucopus, in the revision.

      We had originally intended to include box plots as well as scatterplots with regressions for the data, but thought it would be too much and possibly considered redundant. But with this encouragement from the reviewer we provide additional box plots in supplementary materials for the revision.

      Some sections of the discussion are under supported:

      The claim that low inflammation contributes to increased lifespan is stated both in the introduction and discussion. Is there justification to support this? Do aged pathogen-free mice show more inflammation than aged Peromyscus?

      We respectively point out that there was not a claim of this sort. We stated a fact about P. leucopus’ longevity. We made no statement connecting longevity and inflammation beyond the suggestion in the introduction that the explanation(s) for infection tolerance might have some bearing for studies on determinants of life span.

      But the reviewer’s comment prompted further consideration of this aspect of Peromyscus biology. This led eventually to the literature on the naked mole-rat, which seems to be the rodent with the longest known life span and the subject of considerable study. The discussion section of the revision has an added paragraph on some of the similarities of P. leucopus and the naked mole-rat in terms of neutrophils, expression of nitric oxide synthase 2 in response to LPS, and type 1 interferon responses. While this is far from decisive, it does serve to connect some of the dots and, hopefully, is considered at least partially responsive to the reviewer’s question.

      The claim that reduced Peromyscus responsiveness could lead to increased susceptibility to infection is prominently proposed but not supported by any of the literature cited.

      There was not this claim. In fact, it was framed as a question, not a statement. Nevertheless, we think we understand what the comment is getting at and acknowledge in the revision that there may be unexamined circumstances in which P. leucopus may be more vulnerable.

      References to B. burgdorferi, which do not have LPS, in the discussion need to ensure that the reader understands this and the potential that responses could be very different.

      We think we addressed this comment in a response above.

      Reviewer #2:

      1. How were the number of animals for each experiment selected? Was a power analysis conducted?

      A power analysis of any meaning for bulk RNA-seq with tens of thousands of reference transcripts, each with their own variance, and a comparison of animals of two different genera is not straight forward. Furthermore, a specific hypothesis was not being tested. This was a broad, forward screen. But the question about sample sizes is one that deserves more attention than the original manuscript provided. This now provided in added text in two places in Methods ( “RNA-seq” and “Genome-wide different gene expression”) in the revision.

      1. The authors conducted a cursory evaluation of sex differences of P. leucopus and reported no difference in response except for Il6 and Il10 expression being higher in the males than the females in the exposed group. The data was not presented in the manuscript. Nor was sex considered for the other two species. A further discussion of the role that sex could play and future studies would be appreciated.

      We agree that the limited analysis of sex differences and the undocumented remark about Il6 and Il10 expression in females and males warranted correction. For the revision we removed that analysis of targeted RNA-seq of P. leucopus from the two different studies. For this study we were looking for differences that applied to both species. This was the reason that there were equal numbers of females and males in the samples. We agree that further investigation of differences between sexes in their responses is of interest but is probably best left for “future studies”.

      But in revision we do not entirely ignore the question of sex of the animal and provide an additional analysis of the bulk RNA-seq for P. leucopus with regard to differences between females and males. This basically demonstarted an overall commensurability between sexes, at least for the purposes of the GO term analysis and subsequent targeted RNA-seq, but did reveal some exceptions that are candidate genes for those future studies.

      In the revision, we also add for the discussion and its “study limitations” section a disclaimer about possibly missing sex associated differences because the groups were mixed sexes.

      1. The ratio of Nos2 and Arg1 copies for LPS treated and control P. leucopus and M.musculus in Table 3 show that in P. leucopus there is not a significant difference but in M.musculus there is an increase in Nos2 copies with LPS treatment. The authors then used a targeted RNA-seq analysis to show that in P. leucopus the number of Arg1 reads after LPS treatment is significantly higher than the controls. These results are over oversimplified in the text as an inverse relationship for Nos2/Arg1 in the two species.

      We agree. In addition to providing box plots for Arg1 and Nos2, as suggested by Reviewer #1, we also replaced “ratio” in commenting on Arg1 and Nos2, with “differences in Nos2 and Arg1 expresssion” replacing “ratio of Nos2 to Arg1 expression” at one place. At another place we have removed “inverse” with regard to Nos2 and Arg1. But we respectfully decline to remove Nos2/Arg1 from Figure 5 (now Figure 6) or inclusion of Nos2/Arg1 ratios elsewhere. According to our understanding there need not be an inverse relationship for a ratio to have informative value.

      Recommendations For the Authors

      We thank the two reviewers for their constructive recommendations and suggestions, in some case pointing out errors we totally missed. For the great majority, the recommendations were followed. Where we decline or disagree we explain this in the response.

      Reviewer #1 (Recommendations For The Authors):

      • How was the FDR < 0.003 cutoff chosen for DEG? All cutoffs are arbitrary but there should be some justification.

      We agree and have provided the rationale at that point in the paper (before Figure 3) in R2: "For GO term analysis the absolute fold-change criterion was ≥ 2. Because of the ~3-fold greater number of transcripts for the M. musculus reference set than the P. leucopus reference set, application of the same false-discovery rate (FDR) threshold for both datasets would favor the labeling of transcripts as DEGs in P. leucopus. Accordingly, the FDR p values were arbitrarily set at <5 x 10-5 for P. leucopus and <3 x 10-3 for M. musculus to provide approximately the same number of DEGs for P. leucopus (1154 DEGs) and M. musculus (1266 DEGs) for the GO term comparison."

      • It would be helpful to include a figure demonstrating the correlation between CD45 and WBC ("Pearson's continuous and Spearman's ranked correlations between log-transformed total white blood cell counts and normalized reads for Ptprc across 40 animals representing both species, sexes, and treatments were 0.40 (p = 0.01) and 0.34 (p = 0.03), respectively.")

      In both the first version of the revision (R1) and in R2 we provide a fuller explanation of the choice of CD45 (Ptprc) for normalization as detailed in the response to Reviewer #1's public comment. In the revision only Pearson's correlation and p value is given. We did not think another figure was justified after there was additional space devoted to this in both R1 and R2.

      • Unclear what the following paragraph is referring to-is this from the previous paper? Was this experiment introduced somewhere? "Low transcription of Nos2 and high transcription of Arg1 both in controls and LPS-treated P. leucopus was also observed in the experiment where the dose of LPS was 1 µg/g body mass instead of 10 µg/g and the interval between injection and assessment was 12 h instead of 4 h (Table 4)."

      This experiment is described in the Methods in the original and subsequent versions, but we agree that it is not clear whether it was from present study or previous one. Here is the revised text for R2: "Low transcription of Nos2 in both in controls and LPS-treated P. leucopus and an increase in Arg1 with LPS was also observed in another experiment for the present study where the dose of LPS was 1 µg/g body mass instead of 10 µg/g and the interval between injection and assessment was 12 h instead of 4 h (Table 4)."

      • Regarding the differences in IFNy between outbred and BALB/c mice-are there any other RNA-seq datasets you can mine where other inbred mice (B/6, C3H, etc) have been injected with LPS and probed roughly the same amount of time later? Do they look like BALB/c or the outbreds?

      In both the original and R1 and R2 we cite two papers on the difference of BALB/c mice. While this is of interest for follow-up in the future, we did not think additional content on a subject that mainly pertains to M. musculus was warranted here, where the main focus is Peromyscus.

      • Figure 8 and its legend are difficult to follow. The top half of the figure is not well explained and it's unclear what species this is. Decreased use of abbreviations would help. Consider marking each R2 value as Mus or Peromyscus (As done in Fig 9). There are some typographical errors in the legend ("gree," incomplete sentence missing the words LPS or treatment AND Mus: "Co-variation between transcripts for selected PRRs (yellow) and ISGs (gree) in the blood of P. leucopus (P) or (M) with (L") or without (C)."

      This is now Figure 9 in both R1 and R2. We revised it for R1 to include references to the box plots in supplementary materials, but agree with Reviewer #1's recommendation to correct the typos and make the legend less confusing. We did not think that further labeling of the R2 values in the scatterplots with the species names was necessary. The data points are not just colors but also different symbols, so it should be fairly easy for readers to distinguish the regression lines by species. For R2 this is the revised legend with additions in response to the recommendation underlined:

      "Figure 9. Co-variation between transcripts for selected PRRs and ISGs in the blood of P. leucopus (P) or M. musculus (M) with (L) or without (C) LPS treatment. Top panel: matrix of coefficients of determination (R2) for combined P. leucopus and M. musculus data. PRRs are indicated by yellow fill and ISGs by blue fill on horizontal and vertical axes. Shades of green of the matrix cells correspond to R2 values, where cells with values less than 0.30 have white fill and those of 0.90-1.00 have deepest green fill. Bottom panels: scatter plots of log-transformed normalized Mx2 transcripts on Rigi (left), Ifih1 (center), and Gbp4 (right). The linear regression curves are for each species. For the right-lower graph the result from the General Linear Model (GLM) estimate is also given. Values for analysis are in Table S4; box plots for Gbp4, Irf7, Isg15, Mx2, and Oas1 are provided in Figure S6."

      • Discussion section could benefit from editing for clarity. Examples listed: o Unclear what effect is described here "The bacterial infection experiment indicated that the observed effect in P. leucopus was not limited to a TLR4 agonist; the lipoproteins of B. hermsii are agonists for TLR2 (Salazar et al. 2009)."

      Both R1 and R2 include the new section on the B. hermsii infection model. This was added in response to Reviewer #1 public comment. So the expanded consideration of this aspect should address the reviewer's recommendation for more clarity and context here. For R2 we modified the text in the discussion of R1:

      "The analysis here of the B. hermsii infection experiment also indicated that the phenomenon observed in P. leucopus was not limited to a TLR4 agonist."

      o Unclear what the takeaway from this paragraph is: "Reducing the differences between P. leucopus and the murids M. musculus and R. norvegicus to a single all-embracing attribute may be fruitless. But from a perspective that also takes in the 2-3x longer life span of the whitefooted deer mouse compared to the house mouse and the capacity of P. leucopus to serve as disease agent reservoir while maintaining if not increasing its distribution (Moscarella et al. 2019), the feature that seems to best distinguish the deer mouse from either the mouse or rat is its predominantly anti-inflammatory quality. The presentation of this trait likely has a complex, polygenic basis, with environmental (including microbiota) and epigenetic influences. An individual's placement is on a spectrum or, more likely, a landscape rather than in one or another binary or Mendelian category."

      We agree that modification, simplication, and clarification was called for. In response to a public comment of Reviewer #1 we had changed that section, leaving out reference to longevity here. Here is the revised text in both R1 and R2:

      "Reducing differences between P. leucopus and murids M. musculus and R. norvegicus to a single attribute, such as the documented inactivation of the Fcgr1 gene in P. leucopus (7), may be fruitless. But the feature that may best distinguish the deermouse from the mouse and rat is its predominantly anti-inflammatory quality. This characteristic likely has a complex, polygenic basis, with environmental (including microbiota) and epigenetic influences. An individual’s placement is on a spectrum or, more likely, a landscape rather than in one or another binary or Mendelian category."

      Minor comments:

      • Use of blue and red in figures as the -only- way to easily distinguish between groups is a poor choice-both in terms of how inclusivity of color-blind researchers and enabling grayscale printing. Most detrimental in Figure 2, but also slightly problematic in Figure 1. Use of color and shape (as done in other figures) is a much better alternative.

      We agree. Both figures have been modified to include an additional characteristic for denoting the data point. For Figure 1 it is a black filling, and for Figure 2 it is the size of symbol in additon to the color. This should enable accurate visualization by color blind individuals and printing in gray scale. We have added definitions for the symbols within the graph itself, so there is no need to refer to the legend to interpret what they mean.

      • Note the typo where it should read P leucopus: "The differences between P. musculus and M. musculus in the ratios of Nos2/Arg1 and IL12/IL10 were reported before (BalderramaGutierrez et al. 2021),"

      We thank the reviewer for pointing this typo out, which also carried over to R1. It has been corrected for R2.

      • Optional: Can the relationship between the ratios in figure 5 and macrophage "types" be displayed graphically alongside the graphs? It's a little challenging to go back and forth between the text and the figure to try to understand the biological implication.

      We considered something like this but in the end decided that we were not yet comfortable assigning “types” in this fashion for Peromyscus.

      Reviewer #2 (Recommendations For The Authors):

      • Be consistent with nomenclature for your species/treatment groups in the text, figures, and tables. For example, you go back and forth between "P. leucopus" and "deermouse" in the text. And in figures you use "P," "Peromyscus", or "Pero".

      In the Methods section of the original and revisions R1 and R2 we indicate that "deermouse" is synonymous with "Peromyscus leucopus" and "mouse" is synonymous with "Mus musculus" in the context of this paper. We think that some alternation in the terms relieves the text of some of its repetitiveness and that readers should not have a problem with equating one with the other. The use of "deermouse" also reinforces for readers that Peromyscus is not a mouse. With regard to the abbreviations for P. leucopus, those were used to accommodate design and space issues of the figures or tables. In all cases, the abbreviations referred to are defined in the legends of the figures. So, we respectfully decline to follow this recommendation.

      • Often the sentence structure and/or word choice is irregular and makes quick/easy comprehension difficult. Several examples are:

      o The third paragraph of the introduction

      We agree that the first and second sentences are unclear. Here is the revision for R2:

      “As a species native to North America, P. leucopus is an advantageous alternative to the Eurasian-origin house mouse for study of natural variation in populations that are readily accessible (9, 53). A disadvantage for the study of any Peromyscus species is the limited reagents and genetic tools of the sorts that are applied for mouse studies.”

      o The first line after Figure 5 on page 9.

      We agree. The long sentence which we think the reviewer is referring to has been in split into two sentences for R2.

      “An ortholog of Ly6C (13), a protein used for typing mouse monocytes and other white cells, has not been identified in Peromyscus or other Cricetidae family members. Therefore, for this study the comparison with Cd14 is with Cd16 or Fcgr3, which deermice and other cricetines do have.”

      o The sentence that starts "Our attention was drawn to..." on page 14.

      We agree that the sentence was awkward and split into two sentences.

      “Our attention was drawn to ERVs by finding in the genome-wide RNA-seq of LPS-treated and control rats. Two of the three highest scoring DEGs by FDR p value and fold-change were a gagpol polyprotein of a leukemia virus with 131x fold-change from controls and a mouse leukmia virus (MLV) envelope (Env) protein with 62x fold-change (Dryad Table D5).”

      • For figures with multiple panels, use A), B) etc then indicate which panel you are discussing in your text. This is a very data heavy study and your readers can easily get lost.

      We agree and have added pointers in the text to the panels we are referring to. But we prefer to use easily understood descriptors like “left” and “upper” over assigned letters.

      • For all the figures, where are the stats from the t-tests? Why didn't you do a two-way ANOVA? Instead of multiple t-tests?

      Where we are not hypothesis testing and we are able to show all the data points in box-whisker plots with distributions fully revealed, our default position is not to apply significance tests in a post hoc fashion. If a reader or other investigator wants to do this for other purposes, e.g. a meta-analysis, the data is provided in public repository for them to do this. We are not sure what the reviewer means by "multiple t-tests" for "all figures". Where we do 2-tailed t-tests for presentation of data for many genes in a table for the targeted RNA (where individual values cannot shown in the table), there is always correction for multiple testing, as indicated in Methods. The p values shown as "FDR" are after correction.

      • Results paragraph "LPS experiment and hematology studies"

      o List the two species for the first description to orient the reader since you eventually include rat data.

      We agree that this is warranted and followed this recommendation for R2.

      o Not all the mice experienced tachypnea, but the text makes it seem like 100% did.

      We are not sure what the reviewer is referring to here. This is what is in the text on tachypnea: "By the experiment’s termination at 4 h, 8 of 10 M. musculus treated with LPS had tachypnea, while only one of ten LPS-treated P. leucopus displayed this sign of the sepsis state (p = 0.005)." The only other mention of "tachypnea" was in Methods.

      • Figure 1: Why was the M. musculus outlier excluded? Where any other outliers excluded?

      That data point for the mouse was not "excluded" from the graph. It is identified (MM17) for reference with Table 1, and there is the graph for all to see where it is. It was only excluded from the regression curve for control mice. There was no significance testing. There were no other outliers excluded.

      • Figure 3: explain the colors and make the scales the same for all the panels or at least for the upregulated DEGs and the downregulated DEGs.

      We have modified the legend for Figure 3 to include fuller definitions of the x-axes and a description of the color spectrum. We decline to make the x-axis scale the same for all the panels because the horizontal bars in “transcription down” panels would take up only a small fraction of the space. The x-axes are clearly defined and the colors of the bars also indicate the differences in p-values. We doubt that readers will be misled. Here is the revised legend: “Figure 3. Gene Ontology (GO) term clusters associated with up-regulated genes (upper panels) and down-regulated genes (lower panels) of P. leucopus (left panels) and M. musculus (right panels) treated with LPS in comparison with untreated controls of each species. The scale for the x-axes for the panels was determined by the highest -log10 p values in each of the 4 sets. The horizontal bar color, which ranges from white to dark brown through shades of yellow through orange in between, is a schematic representation of the -log10 p values.”

      • Results paragraph "Targeted RNA seq analysis"

      o In the third paragraph, an R2 of 0.75 is not close enough to 1 to call it "~1"

      What the reviewer is referring to is no longer in either R1 and R2, as detailed in the authors' response to public comments.

      o In the 4th paragraph, where are your stats?

      We have replaced terms like "substantially" and "marginally" with simple descriptions of relationships in the graphs.

      "For the LPS-treated animals there was, as expected for this selected set, higher expression of the majority genes and greater heterogeneity among P. leucopus and M. musculus animals in their responses for represented genes. In contrast to the findings with controls, Ifng and Nos2 had higher transcription in treated mice. In deermice the magnitude of difference in the transcription between controls and LPS-treated was less."

      • Figure 4: The colors are hard to see, I suggest making all the up regulated reads one color, the down regulated reads a different color, and the reads that aren't different black or gray.

      This is now Figure 5 in R1 and R2. The selected genes that are highlighted in the panels are denoted not only by color but also by type of symbol. We do not think that readers will have a problem telling one from another even if color blind. The purpose of this figure was to provide an overview and a visual representation with calling out of selected genes, some of which will be evaluated in more detail later. We thought that this was necessary before diving deeper into the data of Table 2. We do not think further discriminating between transcripts in the categorical way that the reviewer suggests is warranted at this point. So, we respectfully decline to follow this suggestion.

      • Results paragraph " Alternatively- activated macrophages...."

      o Include a brief description of Nos2 and Arg1

      We have defined what enzymes these are genes for in R2.

      o How do you explain the lack of a difference in P. leucopus Arg1? Your text says the RT-qPCR confirms the RNA-seq findings.

      There was a difference in P. leucopus Arg1 by RT-qPCR between control and LPS treated by about 3-fold. By both RNA-seq and RT-qPCR Arg1 transcription is higher in P. leucopus than in M. musculus under both conditions. But we have modified the sentence so that does not imply more than what the data and analysis of the table reveal.

      "While we could not type single cells using protein markers, we could assess relative transcription of established indicators of different white cell subpopulations in whole blood. The present study, which incorporated outbred M. musculus instead of an inbred strain, confirmed the previous finding of differences in Nos2 and Arg1 expression between M. musculus and P. leucopus (Figure 5; Table 2). Results similar to the RNA-seq findings were obtained with specific RT-qPCR assays for Nos2 and Arg1 transcripts for P. musculus and M. musculus (Table 3)."

      • Figure 5: reorganize the panels to make the text description and label with letters, where are the stats?

      We thought the figure (now Figure 6) was self-explanatory, but agree that further explanation in the legend was indicated. We prefer to use descriptions of locations (“upper left”) over labels, like “panel C”, which do not obviously indicate the location of the panel. Of course, if the journal’s style mandates the other format we will do so. Our response about “stats” for boxplot figures is the same as what we provided above.

      • Results paragraph "Interferon-gamma and interleukin-1 beta..."

      o Either add the numbers or direct the viewer to where Ifng is in Table 2. The table is very big and Ifng is all the way at the bottom!

      We agree that this table is large, but we thought it better to err on the side of inclusiveness by having a single table, rather than have some genes in the main article and other results in a supplementary table. We thought that it would make it easier for reviewers and readers to find a gene of interest, but we also acknowledge the challenge to locate the genes we highlight. We follow for R2 that reviewer's recommendation to provide some guidance for readers trying to locate a featured gene by pointing relative locations. While adding a column of numbers to already complex table seems more than what is called for, we are depositing an Excel spreadsheet of the table at the Dryad repository to facilitate searching by an interested reader for a particular gene.

      • Figure 6: stats? The pink and red are hard to easily distinguish from each other. I also suggest not using red and green together for color blind readers.

      With regard to the box-plots and significance testing, please see response above to an earlier recommendation. We have removed an interpretative adjective (i.e. "marked") from the description of the graph. Different symbols as well as colors are used, so we do not think that this will pose a problem for readers, even those with complete red-green color blindness. For what it’s worth, with regard to the "red" and "pink" issue, according to the figure on our displays the colors of the two symbols appear to be red and purple. They are also applied to different species and different conditions for those species.

      • Figure 8: In the legend it says "... PRRs (yellow) and ISGs (gree)" which is a typo, but don't you mean blue not green anyways?

      See response above to Reviewer #1's recommendation. This has been corrected.

    1. Author Response

      Reviewer #1 (Public Review):

      Summary: The authors investigated the function of Microrchidia (MORC) proteins in the human malaria parasite Plasmodium falciparum. Recognizing MORC's implication in DNA compaction and gene silencing across diverse species, the study aimed to explore the influence of PfMORC on transcriptional regulation, life cycle progression and survival of the malaria parasite. Depletion of PfMORC leads to the collapse of heterochromatin and thus to the killing of the parasite. The potential regulatory role of PfMORC in the survival of the parasite suggests that it may be central to the development of new antimalarial strategies.

      Strengths: The application of the cutting-edge CRISPR/Cas9 genome editing tool, combined with other molecular and genomic approaches, provides a robust methodology. Comprehensive ChIP-seq experiments indicate PfMORC's interaction with sub-telomeric areas and genes tied to antigenic variation, suggesting its pivotal role in stage transition. The incorporation of Hi-C studies is noteworthy, enabling the visualization of changes in chromatin conformation in response to PfMORC knockdown.

      We greatly appreciate the overall positive feedback . Our application of CRISPR/Cas9 genome editing tools coupled with complementary cellular and functional approaches shed light on the importance ofPfMORC in maintaining chromatin structural integrity in the parasite and highlight this protein as a promising target for novel therapeutic intervention.

      Weaknesses: Although disruption of PfMORC affects chromatin architecture and stage-specific gene expression, determining a direct cause-effect relationship requires further investigation.

      Our conclusions were made on the basis of multiple, unbiased molecular and functional assays that point to the relevance of the PfMORC protein in maintaining the parasite’s chromatin landscape. Although we do not claim to have precise evidence on the step-by-step pathway to which PfMORC is involved, we bring forth first-hand evidence of its overall function in heterochromatin binding and gene-regulation, its association with major TF regulatory players, and essentiality for parasite survival. We however agree with the comment regarding the lack of direct effects of PfMORC KD and will provide additional evidence by performing ChIP-seq experiments against additional histone marks in WT and PfMORC KD lines.

      Furthermore, while numerous interacting partners have been identified, their validation is critical and understanding their role in directing MORC to its targets or in influencing the chromatin compaction activities of MORC is essential for further clarification. In addition, the authors should adjust their conclusions in the manuscript to more accurately represent the multifaceted functions of MORC in the parasite.

      We do agree with the reviewer's comment. Validation of the identified interacting partners is critical and most likely essential to understanding their role in directing MORC to its targets. However, our protein pull down experiments have been done using biological replicates. Several of the interacting partners have also been identified and published by other labs. A direct comparison of our work together with previous published work will be incorporated in a revised version of the manuscript to further validate the identified interacting partners and the accuracy of the data we obtained in this manuscript. Molecular validation of all proteins identified in our protein may take a few more years and will be submitted for publication in futur manuscripts.

      Reviewer #2 (Public Review):

      Summary: This paper, titled "Regulation of Chromatin Accessibility and Transcriptional Repression by PfMORC Protein in Plasmodium falciparum," delves into the PfMORC protein's role during the intra-erythrocytic cycle of the malaria parasite, P. falciparum. Le Roch et al. examined PfMORC's interactions with proteins, its genomic distribution in different parasite life stages (rings, trophozoites, schizonts), and the transcriptome's response to PfMORC depletion. They conducted a chromatin conformation capture on PfMORC-depleted parasites and observed significant alterations. Furthermore, they demonstrated that PfMORC depletion is lethal to the parasite.

      Strengths: This study significantly advances our understanding of PfMORC's role in establishing heterochromatin. The direct consequences of the PfMORC depletion are addressed using chromatin conformation capture.

      We appreciate the Reviewer’s comments and reflection on the importance of our work.

      Weaknesses: The study only partially addressed the direct effects of PfMORC depletion on other heterochromatin markers.

      Here again, we agree with the reviewer’s comment and intend to perform additional experiments to delve deeper into the multifaceted roles of PfMORC. We have begun to explore the effects of PfMORC depletion on heterochromatin marks using ChIP-seq experiments at distinct stages of parasite development. We hope our new results will shed light on the direct implications of PfMORC in heterochromatin regulation.

    1. Author Response:

      We would like to thank you very much for handling and reviewing our manuscript so carefully and to be so positive about our work. We are indeed grateful about these very concise and constructive reviews as well as about the Editorial Assessment. We basically agree with all reviewers' comments. Besides addressing all formal suggestions, we also decided to do some more experiments.

      The main concern, the role of the transcription factor NF-YA1 during rhizobial infections, is indeed an absolut valid one. While the CDEL system has its beauties it certainly has its limitations as well. Thus, we will try to assess the role of NF-YA1 during symbiotic infections in Medicago more specifically. We will place NF-YA1 expression under the control of infection-specific promoters to limit pleiotropic effects of ectopic over-expression and assess rhizobial infections as well as cell cycle patterns in tranformed hairy roots producing the H3.1/H3.3 marker. Infection-inducible promoters will also be used to drive the ectopic expression of CYCD3;1 on the cortical infection thread trajectory to locally increase mitotic cycles, in order to test the functional importance of cell cycle exit on cortical infections.

      We hope that we will be able to conclude more firmly on NF-YA1 function prior to locking the version of record and to deliver these experiments in a time frame of about 4-6 months, which is the minimum time we need for cloning the respective constructs, doing all hairy root transformations in sufficient numbers and quantitative microscopy.

    1. Author Response:

      Reviewer #1 (Public Review):

      [...] Overall the manuscript is well written, and the successful generation of the new endogenous Cac tags (Td-Tomato, Halo) and CaBeta, stj, and stolid genes with V5 tags will be powerful reagents for the field to enable new studies on calcium channels in synaptic structure, function, and plasticity. There are also some interesting, though not entirely unexpected, findings regarding how Brp and homeostatic plasticity modulate calcium channel abundance. However, a major concern is that the conclusions about how "molecular and organization diversity generate functional synaptic heterogeneity" are not really supported by the data presented in this study. In particular, the key fact that frames this study is that Cac levels are similar at Ib and Is active zones, but that Pr is higher at Is over Ib (which was previously known). While Pr can be influenced by myriad processes, the authors should have first assessed presynaptic calcium influx - if they had, they would have better framed the key questions in this study. As the authors reference from previous studies, calcium influx is at least two-fold higher per active zone at Is over Ib, and the authors likely know that this difference is more than sufficient to explain the difference in Pr at Is over Ib. Hence, there is no reason to invoke differences in "molecular and organization diversity" to explain the difference in Pr, and the authors offer no data to support that the differences in active zone structure at Is vs Ib are necessary for the differences in Pr. Indeed, the real question the authors should have investigated is why there are such differences in presynaptic calcium influx at Is over Ib despite having similar levels/abundance of Cac. This seems the real question, and is all that is needed to explain the Pr differences shown in Fig. 1. The other changes in active zone structure and organization at Is vs Ib may very well contribute to additional differences in Pr, but the authors have not shown this in the present study, and rely on other studies (such as calcium-SV coupling at Is vs Ib) to support an argument that is not necessitated by their data. At the end of this manuscript, the authors have found an interesting possibility that Stj levels are reduced at Is vs Ib, that might perhaps contribute to the difference in calcium influx. However, at present this remains speculative.

      Overall, the authors have generated powerful reagents for the field to study calcium channels and how they are regulated, but draw conclusions about active zone structure and organization contributing to functional heterogeneity that are not strongly supported by the data presented.

      Reviewer 1 raises an interesting question that we agree will form the basis of important studies. Here, we set out to address a different question, which we will work to better frame. While we and others had previously found a strong correlation between calcium channel abundance and synaptic release probability (Pr (Akbergenova et al., 2018; Gratz et al., 2019; Holderith et al., 2012; Nakamura et al., 2015; Sheng et al., 2012)), more recent studies found that calcium channel abundance does not necessarily predict synaptic strength (Aldahabi et al., 2022; Rebola et al., 2019). Our study explores this paradox and presents findings that provide an explanation: calcium channel abundance predicts Pr among individual synapses of either low-Pr type-Ib or high-Pr type-Is inputs where modulating channel number tunes synaptic strength, but does not predict Pr between the two inputs, indicating an inputspecific role for calcium channel abundance in promoting synaptic strength. Thus, we propose that calcium channel abundance predictably modulates synaptic strength among individual synapses of a single input or synapse subtype, which share similar molecular and spatial organization, but not between distinct inputs where the underlying organization of active zones differs. Consistently, in the mouse, calcium channel abundance correlates strongly with release probability specifically when assessed among homogeneous populations of connections (Aldahabi et al., 2022; Holderith et al., 2012; Nakamura et al., 2015; Rebola et al., 2019; Sheng et al., 2012).

      As Reviewer 1 notes, the two-fold difference in calcium influx at type-Is synapses is certainly an important difference underlying three-fold higher Pr. However, growing evidence indicates that calcium influx alone, like calcium channel abundance, does not reliably predict synaptic strength between inputs. For example, Rebola et al. (2019) compared cerebellar synapses formed by granule and stellate cells and found that lower Pr granule synapses exhibit both higher calcium channel abundance and calcium influx. In another example, Aldahabi et al. (2023) demonstrate that even when calcium influx is greater at high-Pr synapses, it does not necessarily explain differences in synaptic strength between inputs. Studying excitatory hippocampal CA1 synapses onto distinct interneuronal targets, they found that raising calcium entry at low-Pr inputs to high-Pr synapse levels is not sufficient to increase synaptic strength to high-Pr synapse levels. Similarly, at the Drosophila NMJ, the finding that type-Ib synapses exhibit loose calcium channel-synaptic vesicle coupling whereas type-Is synapses exhibit tight coupling suggests factors beyond calcium influx also contribute to differences in Pr between the two inputs (He et al., 2023). Consistently, a two-fold increase in external calcium does not induce a three-fold increase in release at low-Pr type-Ib synapses (He et al., 2023). Thus, upon finding that calcium channel abundance is similar at type-Ib and -Is synapses, we focused on identifying differences beyond calcium channel abundance and calcium influx that might contribute their distinct synaptic strengths. We agree that these studies, ours included, cannot definitively determine the contribution of identified organizational differences to distinct release probabilities because it is not currently possible to specifically alter subsynaptic organization, and will ensure that our language is tempered accordingly. However, in addition to the studies cited above and our findings, recent work demonstrating that homeostatic potentiation of neurotransmitter release is accompanied by greater spatial compaction of multiple active zone proteins (Dannhauser et al., 2022; Mrestani et al., 2021) and decreased calcium channel mobility (Ghelani et al., 2023) provide support for the interpretation that subsynaptic organization is a key parameter for modulating Pr.

      Reviewer #2 (Public Review):

      The authors aim to investigate how voltage-gated calcium channel number, organization, and subunit composition lead to changes in synaptic activity at tonic and phasic motor neuron terminals, or type Is and Ib motor neurons in Drosophila. These neuron subtypes generate widely different physiological outputs, and many investigations have sought to understand the molecular underpinnings responsible for these differences. Additionally, these authors explore not only static differences that exist during the third-instar larval stage of development but also use a pharmacological approach to induce homeostatic plasticity to explore how these neuronal subtypes dynamically change the structural composition and organization of key synaptic proteins contributing to physiological plasticity. The Drosophila neuromuscular junction (NMJ) is glutamatergic, the main excitatory neurotransmitter in the human brain, so these findings not only expand our understanding of the molecular and physiological mechanisms responsible for differences in motor neuron subtype activity but also contribute to our understanding of how the human brain and nervous system functions.

      The authors employ state-of-the-art tools and techniques such as single-molecule localization microscopy 3D STORM and create several novel transgenic animals using CRISPR to expand the molecular tools available for exploration of synaptic biology that will be of wide interest to the field. Additionally, the authors use a robust set of experimental approaches from active zone level resolution functional imaging from live preparations to electrophysiology and immunohistochemical analyses to explore and test their hypotheses. All data appear to be robustly acquired and analyzed using appropriate methodology. The authors make important advancements to our understanding of how the different motor neuron subtypes, phasic and tonic-like, exhibit widely varying electrical output despite the neuromuscular junctions having similar ultrastructural composition in the proteins of interest, voltage gated calcium channel cacophony (cac) and the scaffold protein Bruchpilot (brp). The authors reveal the ratio of brp:cac appears to be a critical determinant of release probability (Pr), and in particular, the packing density of VGCCs and availability of brp. Importantly, the authors demonstrate a brp-dependent increase in VGCC density following acute philanthotoxin perfusion (glutamate receptor inhibitor). This VGCC increase appears to be largely responsible for the presynaptic homeostatic plasticity (PHP) observable at the Drosophila NMJ. Lastly, the authors created several novel CRISPRtagged transgenic lines to visualize the spatial localization of VGCC subunits in Drosophila. Two of these lines, CaBV5-C and stjV5-N, express in motor neurons and in the nervous system, localize at the NMJ, and most strikingly, strongly correlate with Pr at tonic and phasic-like terminals.

      1) The few limitations in this study could be addressed with some commentary, a few minor follow-up analyses, or experiments. The authors use a postsynaptically expressed calcium indicator (mhcGal4>UAS -GCaMP) to calculate Pr, yet do not explore the contribution that glutamate receptors, or other postsynaptic contributors (e.g. components of the postsynaptic density, PSD) may contribute. A previous publication exploring tonic vs phasic-like activity at the drosophila NMJ revealed a dynamic role for GluRII (Aponte-Santiago et al, 2020). Could the speed of GluR accumulation account for differences between neuron subtypes?

      We did observe that GCaMP signals are higher at type Is synapses, where synapses tend to form later but GluRs accumulate more rapidly upon innervation (Aponte-Santiago et al., 2020). However, because we are using our GCaMP indicator as a plus/minus readout of synaptic vesicle release at mature synapses, we do not expect differences in GluR accumulation to have a significant effect on our measures. Consistently, the difference in Pr we observe between type-Ib and -Is inputs (Fig. 1C) is similar to that previously reported (He et al., 2023; Lu et al., 2016; Newman et al., 2022).

      2) The observation that calcium channel density and brp:cac ratio as a critical determinant of Pr is an important one. However, it is surprising that this was not observed in previous investigations of cac intensity (of which there are many). Is this purely a technical limitation of other investigations, or are other possibilities feasible? Additionally, regarding VGCC-SV coupling, the authors conclude that this packing density increases their proximity to SVs and contributes to the steeper relationship between VGCCs and Pr at phasic type Is. Is it possible that brp or other AZ components could account for these differences. The authors possess the tools to address this directly by labeling vesicles with JanellaFluor646; a stronger signal should be present at Is boutons. Additionally, many different studies have used transmission electron microscopy to explore SVs location to AZs (t-bars) at the Drosophila NMJ.

      To date, the molecular underpinnings of heterogeneity in synaptic strength have primarily been investigated among individual type-Ib synapses. However, a recent study investigating differences between type-Ib and -Is synapses also found that the Cac:Brp ratio is higher at type-Is synapses (He et al., 2023).

      At this point, we do not know which active zone components are responsible for the organizational (Figs. 1, 2) and coupling (now demonstrated by He et al., 2023) differences between type-Ib and -Is synapses or what establishes the differences in active zone protein levels we observe (Figs. 3,6), although Brp likely plays a local role. We find that Brp is required for dynamically regulating calcium channel levels during homeostatic plasticity and plays distinct roles at type-Ib and -Is synapses (Figs. 3, 4). Brp regulates a number of proteins critical for the distribution of docked synaptic vesicles near T bars of type Ib active zones, including Unc13 (Bohme et al., 2016). Extending these studies to type-Is synapses will be of great interest.

      3) In reference to the contradictory observations that VGCC intensity does not always correlate with, or determine Pr. Previous investigations have also observed other AZ proteins or interactors (e.g. synaptotagmin mutants) critically control release, even when the correlation between cac and release remains constant while Pr dramatically precipitates.

      This is an important point as a number of molecular and organizational differences between high- and low-Pr synapses certainly contribute to baseline functional differences. The other proteins we (Figs. 3,6) and others (Dannhauser et al., 2022; Ehmann et al., 2014; He et al., 2023; Jetti et al., 2023; Mrestani et al., 2021; Newman et al., 2022) have investigated are less abundant and/or more densely organized at type-Is synapses. Investigating additional active zone proteins, including synaptic proteins, and determining how these factors combine to yield increased synaptic strength are important next steps.

      4) To confirm the observations that lower brp levels results in a significantly higher cac:brp ratio at phasic-like synapses by organizing VGCCs; this argument could be made stronger by analyzing their existing data. By selecting a population of AZs in Ib boutons that endogenously express normal cac and lower brp levels, the Pr from these should be higher than those from within that population, but comparable to Is Pr. I believe the authors should also be able to correlate the cac:brp ratio with Pr from their data set generally; to determine if a strong correlation exists beyond their observation for cac correlation.

      We do not have simultaneous measures of Pr and Cac and Brp abundance. However, our findings suggest that distinct Cac:Brp ratios at type Ib and Is inputs reflect underlying organizational differences that contribute to distinct release probabilities between the two synaptic subtypes. In contrast, within either synaptic subtype, release probability is positively correlated with both Cac and Brp levels. Thus, the mechanisms driving functional differences between synaptic subtypes are distinct from those driving functional heterogeneity within a subtype, so we do not expect Cac:Brp ratio to correlate with Pr among individual type-Ib synapses. We will work to clarify this point in the revised text.

      5) For the philanthotoxin induced changes in cac and brp localization underlying PHP, why do the authors not show cac accumulation after PhTx on live dissected preparations (i.e. in real time)? This also be an excellent opportunity to validate their brp:cac theory. Do the authors observe a dynamic change in brp:cac after 1, or 5 minutes; do Is boutons potentiate stronger due to proportional increases in cac and brp? Also regarding PhTx-induced PHP, their observations that stj and α2δ-3 are more abundant at Is synapses, suggests that they may also play a role in PhTx induced changes in cac. If either/both are overexpressed during PhTx, brp should increase while cac remains constant. These accessory proteins may determine cac incorporation at AZs.

      As we have previously followed Cac accumulation in live dissected preparations and found that levels increase proportionally across individual synapses (Gratz et al., 2019), we did not attempt to repeat these challenging experiments at smaller type-Is synapses. We will reanalyze our data to investigate Cac:Brp ratio at individual active zones post PhTx. However, as noted above, we do not expect changes in the Cac:Brp ratio to correlate with Pr among individual synapses of single inputs as this measure reflects organization differences between inputs and PhTx induces an increase in the abundance of both proteins at both inputs.

      Determining the effect of PhTx on Stj levels at type-Ib and -Is active zones is an excellent idea and might provide insight into how lower Stj levels correlate with higher Pr at type-Is synapses. While prior studies have demonstrated critical roles for Stj in regulating Cac accumulation during development and in promoting presynaptic homeostatic potentiation (Cunningham et al., 2022; Dickman et al., 2008; Kurshan et al., 2009; Ly et al., 2008; Wang et al., 2016), its regulation during PHP has not been investigated.

      Taken together this study generates important data-driven, conceptional, and theoretical advancements in our understanding of the molecular underpinnings of different motor neurons, and our understanding of synaptic biology generally. The data are robust, thoroughly analyzed, appropriately depicted. This study not only generates novel findings but also generated novel molecular tools which will aid future investigations and investigators progress in this field.

      References

      Akbergenova, Y., K.L. Cunningham, Y.V. Zhang, S. Weiss, and J.T. Littleton. 2018. Characterization of developmental and molecular factors underlying release heterogeneity at Drosophila synapses. eLife. 7.

      Aldahabi, M., F. Balint, N. Holderith, A. Lorincz, M. Reva, and Z. Nusser. 2022. Different priming states of synaptic vesicles underlie distinct release probabilities at hippocampal excitatory synapses. Neuron. 110:4144-4161 e4147.

      Aponte-Santiago, N.A., K.G. Ormerod, Y. Akbergenova, and J.T. Littleton. 2020. Synaptic Plasticity Induced by Differential Manipulation of Tonic and Phasic Motoneurons in Drosophila. The Journal of neuroscience : the official journal of the Society for Neuroscience. 40:6270-6288.

      Bohme, M.A., C. Beis, S. Reddy-Alla, E. Reynolds, M.M. Mampell, A.T. Grasskamp, J. Lutzkendorf, D.D. Bergeron, J.H. Driller, H. Babikir, F. Gottfert, I.M. Robinson, C.J. O'Kane, S.W. Hell, M.C. Wahl, U. Stelzl, B. Loll, A.M. Walter, and S.J. Sigrist. 2016. Active zone scaffolds differentially accumulate Unc13 isoforms to tune Ca(2+) channel-vesicle coupling. Nature neuroscience. 19:1311-1320.

      Cunningham, K.L., C.W. Sauvola, S. Tavana, and J.T. Littleton. 2022. Regulation of presynaptic Ca(2+) channel abundance at active zones through a balance of delivery and turnover. Elife. 11.

      Dannhauser, S., A. Mrestani, F. Gundelach, M. Pauli, F. Komma, P. Kollmannsberger, M. Sauer, M. Heckmann, and M.M. Paul. 2022. Endogenous tagging of Unc-13 reveals nanoscale reorganization at active zones during presynaptic homeostatic potentiation. Front Cell Neurosci. 16:1074304.

      Dickman, D.K., P.T. Kurshan, and T.L. Schwarz. 2008. Mutations in a Drosophila alpha2delta voltagegated calcium channel subunit reveal a crucial synaptic function. The Journal of neuroscience : the official journal of the Society for Neuroscience. 28:31-38.

      Ehmann, N., S. Van De Linde, A. Alon, D. Ljaschenko, X.Z. Keung, T. Holm, A. Rings, A. Diantonio, S. Hallermann, U. Ashery, M. Heckmann, M. Sauer, and R.J. Kittel. 2014. Quantitative super-resolution imaging of Bruchpilot distinguishes active zone states. Nature Communications. 5.

      Ghelani, T., M. Escher, U. Thomas, K. Esch, J. Lützkendorf, H. Depner, M. Maglione, P. Parutto, S. Gratz, T. Matkovic-Rachid, S. Ryglewski, A.M. Walter, D. Holcman, K. O‘Connor Giles, M. Heine, and S.J. Sigrist. 2023. Interactive nanocluster compaction of the ELKS scaffold and Cacophony Ca<sup>2+</sup> channels drives sustained active zone potentiation. Science Advances. 9:eade7804.

      Gratz, S.J., P. Goel, J.J. Bruckner, R.X. Hernandez, K. Khateeb, G.T. Macleod, D. Dickman, and K.M. O'Connor-Giles. 2019. Endogenous tagging reveals differential regulation of Ca<sup>2+</sup> channels at single AZs during presynaptic homeostatic potentiation and depression. The Journal of Neuroscience:3068-3018.

      He, K., Y. Han, X. Li, R.X. Hernandez, D.V. Riboul, T. Feghhi, K.A. Justs, O. Mahneva, S. Perry, G.T. Macleod, and D. Dickman. 2023. Physiologic and Nanoscale Distinctions Define Glutamatergic Synapses in Tonic vs Phasic Neurons. The Journal of neuroscience : the official journal of the Society for Neuroscience. 43:4598-4611.

      Holderith, N., A. Lorincz, G. Katona, B. Rózsa, A. Kulik, M. Watanabe, and Z. Nusser. 2012. Release probability of hippocampal glutamatergic terminals scales with the size of the active zone. Nature neuroscience. 15:988-997.

      Jetti, S.K., A.B. Crane, Y. Akbergenova, N.A. Aponte-Santiago, K.L. Cunningham, C.A. Whittaker, and J.T. Littleton. 2023. Molecular Logic of Synaptic Diversity Between Drosophila Tonic and Phasic Motoneurons. bioRxiv:2023.2001.2017.524447.

      Kurshan, P.T., A. Oztan, and T.L. Schwarz. 2009. Presynaptic alpha2delta-3 is required for synaptic morphogenesis independent of its Ca2+-channel functions. Nature neuroscience. 12:1415-1423.

      Lu, Z., A.K. Chouhan, J.A. Borycz, Z. Lu, A.J. Rossano, K.L. Brain, Y. Zhou, I.A. Meinertzhagen, and G.T. Macleod. 2016. High-Probability Neurotransmitter Release Sites Represent an Energy-Efficient Design. Current biology : CB. 26:2562-2571.

      Ly , C.V., C.-K. Yao , P. Verstreken , T. Ohyama , and H.J. Bellen 2008. straightjacket is required for the synaptic stabilization of cacophony, a voltage-gated calcium channel α1 subunit. Journal of Cell Biology. 181:157-170.

      Mrestani, A., M. Pauli, P. Kollmannsberger, F. Repp, R.J. Kittel, J. Eilers, S. Doose, M. Sauer, A.-L. Sirén, M. Heckmann, and M.M. Paul. 2021. Active zone compaction correlates with presynaptic homeostatic potentiation. Cell Reports. 37:109770.

      Nakamura, Y., H. Harada, N. Kamasawa, K. Matsui, Jason S. Rothman, R. Shigemoto, R.A. Silver, David A. DiGregorio, and T. Takahashi. 2015. Nanoscale Distribution of Presynaptic Ca2+ Channels and Its Impact on Vesicular Release during Development. Neuron. 85:145-158.

      Newman, Z.L., D. Bakshinskaya, R. Schultz, S.J. Kenny, S. Moon, K. Aghi, C. Stanley, N. Marnani, R. Li, J. Bleier, K. Xu, and E.Y. Isacoff. 2022. Determinants of synapse diversity revealed by superresolution quantal transmission and active zone imaging. Nature Communications. 13:229.

      Rebola, N., M. Reva, T. Kirizs, M. Szoboszlay, A. Lőrincz, G. Moneron, Z. Nusser, and D.A. Digregorio. 2019. Distinct Nanoscale Calcium Channel and Synaptic Vesicle Topographies Contribute to the Diversity of Synaptic Function. Neuron. 104:693-710.e699.

      Sheng, J., L. He, H. Zheng, L. Xue, F. Luo, W. Shin, T. Sun, T. Kuner, D.T. Yue, and L.-G. Wu. 2012. Calcium-channel number critically influences synaptic strength and plasticity at the active zone. Nature neuroscience. 15:998-1006.

      Wang, T., R.T. Jones, J.M. Whippen, and G.W. Davis. 2016. alpha2delta-3 Is Required for Rapid Transsynaptic Homeostatic Signaling. Cell Rep. 16:2875-2888.

    1. Author Response:

      We sincerely appreciate the recognition from both reviewers regarding the innovative gradual activity-blocking design employing NBQX, as well as the robustness of our approach that integrates experimental and computational approaches to investigate the interplay between homeostatic functional and structural plasticity in response to activity deprivation.

      Acknowledging the raised concerns and insightful advice shared by the reviewers, we provide the the following provisional response:

      Why did we focus on activity silencing? Our decision to focus on chronic activity deprivation stems from a robust body of evidence—summarised in the recent review by Moulin and colleagues (2022)—that highlights the consistent occurrence of homeostatic spine loss alongside synaptic downscaling in response to prolonged excitation. In contrast, chronic silencing studies, as outlined in the same review, exhibit inconsistencies and contradictions, with spine loss often manifesting as non-homeostatic. After carefully reviewing the available data, we formulated two hypotheses to account for this heterogeneity: (i) the non-linear nature of activity-dependent structural plasticity, and (ii) the intricate interplay between homeostatic synaptic scaling and structural plasticity influenced by factors such as the extend of activity deprivation, specific dendritic segments, cell phenotypes, brain regions, and even across species. The intricate exploration of these hypotheses necessitated a systematic approach through computational simulations (and suitable experiments). The present manuscript intentionally confines the discussion of heightened activity to a proof-of-concept computer simulation, underscoring our deliberate emphasis on the central theme of activity silencing. Nevertheless, we do concur with the reviewers that an intriguing avenue for future exploration lies in extending the model to encompass homeostatic synaptic downscaling triggered by augmented activity.

      Why did we choose NBQX and why didn't we extensively characterise it? We utilised NBQX, a competitive antagonist targeting AMPA receptors, enabling us to finely modulate network activity via dosages (as elucidated by Wrathall et al., 2007), surpassing the control attainable with TTX. Despite its atypical role in studying homeostatic synaptic plasticity, NBQX boasts commendable efficacy in regulating network activity, substantiated by our electrophysiological recordings as well as in vivo and in vitro studies (Follett et al., 2000; Wrathall et al., 2007). However, it's worth noting that NBQX selectively binds to GluA2-containing AMPA receptors, pivotal for TTX-triggered synaptic scaling (Gainey et al., 2009) and glutamate-induced spine protrusion in the presence of TTX (Richards et al., 2005). Importantly, there's no conclusive evidence suggesting that NBQX, when applied in isolation (without TTX), hinders the synthesis or insertion of AMPA receptors. While we acknowledge the interest and value in characterising NBQX separately, such an endeavour extends beyond the immediate scope of our current study.

      It's pertinent to also note that the models we employed—activity (calcium) dependent homeostatic synaptic scaling and structural plasticity—are inherently phenomenological in nature. In essence, these models refrain from delving into intricate molecular mechanisms beyond the regulation of calcium concentration by firing rates. Given the highly phenomenological nature of our models, introducing a detailed molecular characterization of NBQX, or expanding into a chronic increase in network activity scenarios targeting different molecular pathways, could potentially create misleading expectations among our readers, implying a level of molecular pathway implementation that is not our immediate focus.

      Did the model successfully replicate the experimental findings? Achieving a strong agreement between computer simulations and empirical data is often a sought-after outcome, particularly when both aspects are integrated within a single study. However, this congruence is not always the primary intent. In our present investigation, we introduced three distinct ways in which experimental data merged with computational studies: to provide informative input, to validate hypotheses, and to stimulate novel ideas.

      Our experiments primarily aimed to inform the computational model through an analysis of spine density. The computational framework was envisioned to yield insights that could be broadly applicable, extending beyond the mere replication of conducted experiments. In this context, our modelling outcomes effectively mirrored the heterogeneous alterations in synapse numbers observed in various in vivo and in vitro studies following activity deprivation—ranging from homeostatic increases to non-homeostatic synapse loss.

      Our model also proposed a plausible mechanism illustrating how synaptic scaling might propel the transition from non-homeostatic synapse loss to the restoration of synapse levels, achieved by maximising inputs from active spines. This supposition found partial confirmation when considering both our experimentally obtained spine sizes and those detailed in the existing literature—pointing to a reduction in spine numbers but a conservation of larger spine sizes during complete activity blockade.

      Moreover, our experimental observations unveiled certain aspects that, while not entirely encompassed by our model, have the potential to inspire future modelling studies. For instance, we observed size-dependent changes in spine sizes under complete activity blockade; we also observed inconsistent combinations of spine density and size changes across dendritic segments upon activity deprivation. The prospect of reconfiguring the interplay between structural plasticity and synaptic scaling rules to elucidate the observed heterogeneity in outcomes stands as an intriguing avenue worth revisiting, particularly as the modelling of structural plasticity within a network of intricately detailed neurons becomes feasible.

      In summary, while the aspiration to faithfully replicate experimental outcomes exists, achieving an exact correspondence between a purposefully simplified system, like the point neural network we employed in our study, and real-world data should be approached with caution. Striving for such a match carries the risk of overfitting and prematurely advancing conclusions that might not stand the test of broader applications.

      Why did we establish strict definitions for functional and structural plasticity? The rationale behind this strategic decision lies in the historical breadth of the term "structural plasticity," encompassing a wide array of high-dimensional alterations in neural morphology throughout development and adulthood. This expansive interpretation contributed to the delayed development of computational models specifically targeting structural plasticity. Moreover, certain elements, like spine sizes, blur the boundaries with the functional facet of synapses as also mentioned by the reviewers. We hope the reviewers and readers concur with our perspective that implementing structural plasticity through the manipulation of synapse numbers—effectively enabling dynamic (re)wiring—provides a high degree of freedom and robustness. Synaptic size seamlessly translates into synaptic weights within the modelling framework. While the distinction between synaptic weight and synapse number may seem stringent, it meticulously prepares the groundwork for addressing a fundamental question: How does the gradual modification of synapse numbers, juxtaposed with the swift modulation of synaptic weights, interact within a perpetually evolving dynamic system? In this respect our study serves as a panoramic vista, unveiling possibilities wherein distinct combinations of these two governing principles can engender divergent outcomes. This contribution not only stands as a benchmark but also extends a welcoming embrace to forthcoming structural plasticity models that embrace the concept of continuous size and number alterations.

    1. Author Response

      The following is the authors’ response to the original reviews.

      Reviewer #1 (Public Review):

      The manuscript describes an interesting experiment in which an animal had to judge a duration of an interval and press one of two levers depending on the duration. The Authors recorded activity of neurons in key areas of the basal ganglia (SNr and striatum), and noticed that they can be divided into 4 types.

      The data presented in the manuscript is very rich and interesting, however, I am not convinced by the interpretation of these data proposed in the paper. The Authors focus on neurons of types 1 & 2 and propose that their difference encodes the choice the animal makes. However, I would like to offer an alternative interpretation of the data. Looking at the description of task and animal movements seen in Figure 1, it seems to me that there are 4 main "actions" the animals may do in the task: press right lever, press left lever, move left, and move right. It seems to me that the 4 neurons authors observed may correspond to these actions, i.e. Figure 1 shows that Type 1 neurons decrease when right level becomes more likely to be correct, so their decrease may correspond to preparation of pressing right lever - they may be releasing this action from inhibition (analogously Type 2 neurons may be related to pressing left lever). Furthermore, comparing animal movements and timing of activity of neurons of type 3 and 4, it seems to me that type 3 neurons decrease when the animal moves left, while type 4 when the animal moves right.

      I suggest Authors analyse if this interpretation is valid, and if so, revise the interpretation in the paper and the model accordingly.

      We thank the reviewer for the general appreciation of the study. Regarding to the interpretation of each SNr subtypes, we have compared firing activities of the same SNr neurons in both standard 2-8 s task and reversed 2-8 s task (Figure 2G-R, Figure S4). Type 1 and Type 2 neurons are related to right and left choices respectively in the standard task (Figure 2G, M, N), and this is even more evident in the reversed 2-8 s task (Figure 2J), because when the movement trajectories of the same mice in 8-s trials were reversed from left-then-right in the control task (Figure 2I) to right-then-left in the reversed task (Figure 2L), the Type 1 SNr neurons which showed monotonic decreasing dynamics in the control 2-8 s task (Figure 2M) reversed their neuronal dynamics to a monotonic increase in the reversed 2-8 s task (Figure 2P). The same reversal of neuronal dynamics was also observed in Type 2 SNr neurons in the reversed version of standard task (Figure 2N vs Figure 2Q). Therefore, Type 1 and Type 2 neurons are related to the action selection. Furthermore, Type 3 and Type 4 SNr neurons exhibiting transient change when mice switching either from left to right, or from left to right maintained the same neuronal dynamics in both standard 2-8 s task and reversed 2-8 s task (Figure S4C-F), indicating that Type 3 and Type 4 neurons are related to the switch between choices but not the specific upcoming choice to be made.

      Reviewer #1 (Recommendations For The Authors):

      Suggest to clarify if SNr neurons recorded just from a single hemisphere or bilaterally.

      We have described the recording hemisphere in our Methods (page 46, lines 974-976) as follows “For striatum recording, we implanted 11 mice in the left hemisphere and 8 mice in the right hemisphere. For the SNr recording, we implanted 5 mice in the left hemisphere and 4 mice in the right hemisphere.”

      Suggest to analyse if type 1/2/3/4 neurons are preferrably located in hemispheres contra/ipsi lateral to a particular lever or movement.

      We have addressed this issue in Figure S3 and Figure S6. In fact, we have implanted electrodes in both left and right hemispheres with mirror M-L coordinates. For striatum recording, we implanted 11 mice in the left hemisphere and 8 mice in the right hemisphere. For the SNr recording, we implanted 5 mice in the left hemisphere and 4 mice in the right hemisphere. We have analyzed the striatal and SNr neuronal activity in left vs. right hemisphere respectively, in relation to action selection. We found that SNr neurons recorded in either left or right hemisphere exhibited the same four types of neural dynamics with similar proportions (Fig. S3). Specially, the Type 1 neurons are dominant in both hemispheres. Similar in striatum, SPNs from left and right hemispheres showed the same four types of neural dynamics with similar proportions (Fig. S6). Therefore, there is no significant difference between hemispheres regarding to the proportion of neuron subtypes.

      Suggest to investigate if type 1/2 neurons are involved in preparation for lever press, please investigate if these neurons are also changing their activity during the lever press.

      In Figure S1L, we have showed the neuronal activities of example Type 1 and Type 2 SNr neurons to rewarded and non-rewarded lever presses. Type 1 SNr neuron shows higher firing activities when pressing the left lever than pressing the right lever, whereas Type 2 SNr neuron shows higher firing activities when pressing the right lever than pressing the left lever, indicating that Type 1 and Type 2 neurons firing activities are action choice dependent.

      Suggest investigating if Type 3/4 neurons are controlling movement from one location to another, please analyse if their activity is correlated with the movement on trial by trial bases.

      In Figure S2C-D, we showed firing activities of example Type 3 and Type 4 neurons on trial-by-trial bases. Type 3 neuron showed increased firing activities between 3-4 s during the 8s lever retraction period when the animal switched from left side to right side, whereas Type 4 neuron showed decreased firing activities between 3-4 s during as the animal switching from left to right. We further showed in Figure S4C-F, Type 3 and Type 4 neurons Type 3 and Type 4 neurons are related to the switch between choices but not the specific upcoming choice to be made.

      Suggest also performing analogous analyses for striatal neurons.

      We showed 4 types of SPNs on the on trial-by-trial bases as follows. Due to the limitation of the number of figures, these data were not included in the manuscript. We have now included these results in Fig. S2(E-H).

      Typo: l. 68: "can bidirectionally regulates" -> "can bidirectionally regulate"

      Thanks, we have now corrected the typos.

      Reviewer #2 (Public Review):

      In this valuable manuscript Li & Jin record from the substantial nigra and dorsal striatum to identify subpopulations of neurons with activity that reflects different dynamics during action selection, and then use optogenetics in transgenic mice to selectively inhibit or excite D1- and D2- expressing spiny projection neurons in the striatum, demonstrating a causal role for each in action selection in an opposing manner. They argue that their findings cannot be explained by current models and propose a new 'triple control' model instead, with one direct and two indirect pathways. These findings will be of broad interest to neuroscientists, but lacks some direct evidence for the proposal of the new model.

      Overall there are many strengths to this manuscript including the fact that the empirical data in this manuscript is thorough and the experiments are well-designed. The model is well thought through, but I do have some remaining questions and issues with it.

      Weaknesses:

      1) The nature of 'action selection' as described in this manuscript is a bit ambiguous and implies a level of cognition or choice which I'm not sure is there. It's not integral to the understanding of the paper really, but I would have liked to know whether the actions are under goal-directed/habitual or even Pavlovian control. This is not really possible to differentiate with this task as there are a number of Pavlovian cues (e.g. lever retraction interval, house light offset) that could be used to guide behavior.

      Sorry for the confusion of task description in the manuscript. We appreciate reviewer’s deep understanding about the complexity of the 2-8 s task we designed. Indeed, the 2-8 s task can’t be simply categorized as goal-directed/habitual or Pavlovian task. There are several behavioral aspects in this task. Lever retraction is served as a Pavlovian cue for mice to start performing the left-then-right sequential movement, but once levers are retracted, there is no cue available to mice during the lever retraction period, and mice have to make a decision to switch choice solely based on its internal estimation of the passage of time, which is considered as a cognitive process. The house light stays on for the entire training session (2 – 3 hours), and will be turned off when the task is done, so house light will not be used as a guidance for choice behavior. The behavior and neural activities during the lever retraction period is our main focus in this manuscript. The main advantage of such task design is that the animal is engaged in a self-determined, dynamic switch of action selection process, which offers a unique opportunity for investigating the role of various neuronal populations in the basal ganglia pathways during action selection.

      2) In a similar manner, the part of the striatum that is being targeted (e.g. Figures 4E,I, and N) is dorsal, but is central with regards to the mediolateral extent. We know that the function of different striatal compartments is highly heterogeneous with regards to action selection (e.g. PMID: 16045504, 16153716, 11312310) so it would have been nice to have some data showing how specific these findings are to this particular part of dorsal striatum.

      We thank the reviewer for bringing up this point. We are targeting dorsal-central part of striatum. In Figure S5G-L, we showed the specific location we targeted in striatum. Also as specified in Methods (lines 965-970), the craniotomies for electrode implantation were made at the following coordinates: 0.5 mm rostral to bregma and 1.5 mm laterally, and ~ 2.2 mm from the surface of the brain for dorsal striatum. For the virus injection and optic fiber implantation (lines 997-998), the craniotomies was made bilaterally at 0.5 mm rostral to bregma, 2 mm laterally and ~ 2.2 mm from the surface of the brain.

      3) I'm not sure how I feel about the diagrams in Figure 4S. In particular, the co-activation model is shown with D2-SPNs represented as a + sign (which is described as "having a facilitatory effect to selection" in the caption), but the co-activation model still suggests that D2-SPNs are largely inhibitory - just of competing actions rather than directly inhibiting actions. Moreover, I am not sure about these diagrams because they appear to show that D2-SPNs far outnumbers D1-SPNs and we know that this isn't the case. I realize the diagrams are not proportionate, but it still looks a bit misrepresented to me.

      We appreciate the reviewer’s comments about the diagram. We borrowed and extended the “center-surround” layout from the receptive field of neurons in the early visual system, as an intuitive analogy in describing the functional interaction among striatal pathways (also see Mink 2003 Archives of Neurology). In the co-activation model, if D2-SPNs inhibit the competing action, then the target action will be more likely to be selected due to the reduced competition, which means D2-SPNs actually facilitate the target action in an indirect way. And this is why we define the effect of D2-SPNs in the co-activation model as facilitatory. The area of each region does not represent the amount of cells but mainly qualitative functional role. To make it clearer, we have now added more explanation in the manuscript (page 17, lines 338-341).

      4). There are a number of grammatical and syntax errors that made the manuscript difficult to understand in places.

      We have now gone through the text carefully and corrected the typos.

      5) I wondered if the authors had read PMID: 32001651 and 33215609 which propose a quite different interpretation of direct/indirect pathway neurons in striatum in action selection. I wonder if the authors considered how their findings might fit within this framework.

      We appreciate the reviewer’s comments and suggestion. Miriam Matamales et al. (2020, PMID: 32001651) found that dynamic D2- to D1-SPNs transmodulation across the striatum that is necessary for updating previously learned behavior, which highlights the importance of collateral modulations between D1- and D2-SPNs as an additional layer of behavior control besides the classic direct and indirect pathways. This finding is compatible with our “Triple control” model emphasizing the influence of collateral modulations within striatum on behavior choice. James Peak et al. (2020, PMID: 33215609) demonstrated that D2-SPNs are critical to maintain the flexibility of behavior, which is reflected in our “Triple-control” model that activation of D2-SPNs could trigger the behavioral switch from the current action to another action. Although the two studies mentioned above mainly investigate the roles of striatal D1- and D2-SPNs in action learning and behavioral strategies, their functions in general fit within our new ‘Triple-control’ model of basal ganglia pathways for action selection.

      6) There is no direct evidence of two indirect pathways, although perhaps this is beyond the scope of the current manuscript and is a prediction for future studies to test.

      As accumulating RNA-seq and physiological data implying the heterogeneity of D2-SPNs, the further investigation of the subtypes of D1- and D2-SPNs and their functionality are likely a direction the field will continue to explore. On the other hand, we have discussed other possible anatomical circuits within basal ganglia circuitry that could fulfill the functional role of a third pathway in our new ‘Triple-control’ model, together with or independent of the second indirect pathway (page 32-33, lines 689-700). We certainly hope that our new model will inspire future work to identify and dissect the additional functional pathways in the basal ganglia circuits for action control.

      Reviewer #2 (Recommendations For The Authors):

      Suggestions for authors:

      1) Consider how specific to the dorso-central striatum these findings are, possibly in the discussion.

      We have specified in the Discussion that the study is targeting dorsal-central part of striatum (page 29, lines 609-612).

      2) Modify the diagrams in 4S to make them more representative of the model's features.

      We have responded this comment above.

      3) Consider whether the findings here might fit within the role for direct pathway in excitatory action-outcome learning and the indirect pathway in response flexibility more generally.

      The current study is mainly focus on selection and execution of actions. It will definitely be important to continue exploring the functionality of direct vs. indirect pathways in the action learning process.

      4) Correct typos and grammatical errors including (but not limited to):

      a) Line 62-64 - explain why this is controversial? Is it because we don't know which one applies?

      In the “Go/No-go” model, indirect pathway inhibits the desired action and function as gain modulation, while in the “Co-activation” model, indirect pathway inhibits the competing action and in turn facilitates the desired action in an indirect manner, therefore these two existing models disagree with each other on the explanation the function of indirect pathway in its targeting action and the net outcome of behavior.

      b) Line 68 - Regulates should be regulate.

      This has been corrected in the revised manuscript.

      c) Line 86 - should read "there are neuronal populations in either the direct or indirect pathway that are activated..."

      This has been corrected in the revised manuscript.

      d) Line 146-147 - "these types of neuronal dynamics in Snr only appeared in the correct but not incorrect trials" - It seems the authors are suggesting this only for Types 1 and 2 neurons, but this confused me the first time I read it and I suggest it is made clearer.

      Line 146-147 now reads “These four types of neuronal dynamics in SNr only appeared…”

      e) Line 346 - significant should be significantly.

      This has been corrected in the revised manuscript.

      f) Line 360 "contrast" should be "contrasting".

      This has been corrected in the revised manuscript.

    1. Author Response

      The following is the authors’ response to the original reviews.

      We thank the reviewers for their positive remarks. We have addressed the reviewers’ recommendations in the point-by-point response below to improve our revised manuscript.

      Reviewer #1 (Recommendations For The Authors):

      1. The authors carry out their HDX-MS work on Prestin (and SLC26A9) solubilized in glycol-diosgenin. The authors should carefully rationalize their choice of detergent and discuss how their key findings are also pertinent to the native state of Prestin when residing in an actual phospholipid bilayer. More native membrane mimetic models are available, for instance, nano-discs etc. While I am not insisting that the authors have to repeat their measurements in a more native membrane system, it would be a very nice control experiment, and in any case, a detailed discussion of the limitations of the approach taken and possible caveats should be included - possibly with additional references to other studies.

      Response: We have added a paragraph rationalizing the choice of detergent in lines 174-176. We have also added requested HDX data comparing prestin reconstituted in nanodisc to prestin solubilized in micelle (Fig 5). The HDX for prestin under these two membrane mimetics were indistinguishable, including the anion-binding site, suggesting that our major findings are likely pertinent to prestin residing in a lipid bilayer. The only major HDX difference we observed was that a lipid-facing helix TM6 is more dynamic for prestin in nanodisc compared to in micelles. In our previous structural studies, we identified TM6 as the “eletromotile elbow” that is important for prestin’s mechanical expansion (Bavi et al., Nature, 2021). We are currently conducting a more thorough investigation to understand the role of TM6 in prestin’s electromotility.

      1. As far as I understand, the HEPES state represents the apo-state and thus assumes that HEPES does not bind to Prestin - the authors should support this assumption or include a discussion of the possible effect of HEPES on Prestin. Also, the HEPES state has fewer time-points - this should also be discussed.

      Response: We have included a discussion of the possible effects of HEPES in lines 331-345. In fact, in an attempt to support our assumption that HEPES does not bind to prestin, we set out to determine the structure of prestin in the HEPES-based buffer using single particle cryo-EM. However, we did not find evidence that HEPES binds to prestin. Details are discussed in lines 331-345 and Supporting Information Text 3.

      We employed a denser sampling of HDX labeling times for prestin in Cl- because it is critical for fitting and ∆G calculation. The earlier time points are used mainly to evaluate the dynamics of the less stable cytosolic domain. Since the cytosolic domain does not directly participate in prestin’s voltage-sensing mechanism and electromotility, we only measured the HEPES states with longer time points which mainly probe the dynamics of the transmembrane domain.

      1. Overall, the HDX-MS data provided and the statistical analysis done is in my view sufficiently detailed and well done - the authors are advised to make reference to and include a HDX Summary table and HDX Data Table according to the HDX-MS community-guidelines (Masson et al. Nature Methods 2019).

      Response: An HDX summary table was provided in Table S1 and referred in lines 81 and 388. We have included a reference to Masson et al., Nature Methods, 2019, in line 389.

      1. Figure 5 - I like the detailed analysis of the helix folding - but in my experience, one can provide a great fit of many HDX curves to a 4 -term exponential function - I think the authors would need more time-points to provide a more convincing case. But it does provide a compelling theory - even if the data strictly does not prove it. The authors should discuss this in more detail - including limitations etc.

      Response: We presented a statistical analysis describing the accuracy of the fitting in Fig 6A. We acknowledge that the values of the exponentials may not be precisely determined, but the fundamental result is robust – TM3 exchanges through fraying from the N-terminal end of the helix while TM6 exchanges much more cooperatively. Collecting additional time points may reduce the error on the rates but would not contribute to additional mechanistic insights.

      Reviewer #2 (Recommendations For The Authors):

      1. I suggest toning down more speculative/ hypothetical aspects. Specifically, I believe that the following sentence should not be in the abstract in its present form: "This event shortens the TM3-TM10 electrostatic gap, thereby connecting the two helices such that TM3-anion-TM10 is pushed upwards by forces from the electric field, resulting in reduced cross-sectional area."

      Response: The sentence has been rephrased.

      1. The "nuance" between helix fraying and helix unfolding is an important aspect of the author's hypothesis but this should be explained better. In that regard, have the authors performed HDX-MS analysis of the mutant P136T? That would nicely support their claim regarding the importance of helix fraying as being foundational to allow electromotility.

      Response: More explanation for helix fraying and unfolding has been provided in the main text. We have not performed HDX-MS analysis of the mutant P136T. However, we performed molecular dynamics simulations using Upside, and consistently, showed that a P136T mutation in prestin results in a highly stabilized TM3 (Fig. S4B).

      1. Why do measurements at two pDs? Did the authors observe any differences?

      Response: The purpose of two pDs is to increase the effective dynamic range of the HDX measurement by two orders of magnitude because the intrinsic exchange rate scales with pD & Temp. This allows us to determine the stability of both the highly and minimally stable regions within the protein. We have rephrased lines 83-87 to better rationalize this choice of pDs. With the time points performed in this study, we did not observe noticeable differences for HDX performed under the two pDs when corrected for the changes in the intrinsic rates (Fig. S7A).

      1. I can't help but wonder what is the interest in doing HDX-MS measurements after 27h of incubation. Membrane proteins are known for their instability once purified and a few odd HDX profiles at that specific timepoint (especially in the 80-100 residues area) make one question whether local unfolding preceding aggregation could happen. This actually weakens the author's claims about cooperative unfolding and localized and directional helix fraying. Could they provide some evidence (CD, thermostability measurements such as trp fluorescence quenching, or SEC analysis) that the prestin is still folded after 27h in GDN.

      Response: We appreciate reviewer’s comments on membrane proteins can be unstable once purified. In our system, we did not observe evidence of unfolding or aggregation caused by long-term incubation after purification. This is mostly supported by the fact that our HDX reactions were initiated and injected to MS in random order, yet are still highly reproducible among biological and technical replicates. A specific example included HDX on freshly purified SLC26A9 gave the same deuteration levels as SLC26A9 purified in GDN after 4 days. For prestin, although we don’t have direct comparison between fresh samples and old samples (24-27h post-purification) due to the lack of samples, 30s HDX in SO42- performed 24h post-purification gave a %D that fell between 10s and 90s of labeling done on fresh sample. Additionally, HDX on prestin in Cl- performed on freshly purified sample gave the sample %D as prestin in the presence of 1M urea labeled after 24~48h of purification, suggesting that prestin is relatively resistant to aggregation at least within 48h after purification even in the presence of 1 M urea (data not shown).

      Furthermore, the HDX for prestin in nanodisc are essentially identical to prestin in micelles except for a functionally important helix (TM6), suggesting minimal aggregation or misfolding.

      We think the “a few odd HDX profiles” at 27h time points for residues 80-100 are caused by two reasons. Firstly, TM1 unfolds cooperatively and its stability in HEPES falls within the detection range when long labeling time points were employed (within one log unit of 27h). Secondly, we observed two non-interconverting and structurally distinct populations for TM1 (Supporting Information Text 1 & Fig. S8), and in long labeling times, the two isotope distributions merge and sometimes can skew the %D calculations. Nevertheless, the HDX differences we observed comparing across conditions are clear and such %D calculation skewing, if present, should be minimal and does not change our main conclusions.

    1. Author Response

      Reviewer #1 (Public Review):

      Summary:

      This work describes the mechanism of protein disaggregation by the ClpL AAA+ protein of Listeria monocytogenes. Using several model substrate proteins the authors first show that ClpL possesses a robust disaggregase activity that does not further require the endogenous DnaK chaperone in vitro. In addition, they found that ClpL is more thermostable than the endogenous L. monocytogenes DnaK and has the capacity to unfold tightly folded protein domains. The mechanistic basis for the robust disaggregase activity of ClpL was also dissected in vitro and in some cases, supported by in vivo data performed in chaperone-deficient E. coli strains. The data presented show that the two AAA domains, the pore-2 site and the N-terminal domain (NTD) of ClpL are critical for its disaggregase activity. Remarkably, grafting the NTD of ClpL to ClpB converted ClpB into an autonomous disaggregase, highlighting the importance of such a domain in the DnaK-independent disaggregation of proteins. The role of the ClpL NTD domain was further dissected, identifying key residues and positions necessary for aggregate recognition and disaggregation. Finally, using sets of SEC and negative staining EM experiments combined with conditional covalent linkages and disaggregation assays the authors found that ClpL shows significant structural plasticity, forming dynamic hexameric and heptameric active single rings that can further form higher assembly states via their middle domains.

      Strengths:

      The manuscript is well-written and the experimental work is well executed. It contains a robust and complete set of in vitro data that push further our knowledge of such important disaggregases. It shows the importance of the atypical ClpL N-terminal domain in the disaggregation process as well as the structural malleability of such AAA+ proteins. More generally, this work expands our knowledge of heat resistance in bacterial pathogens.

      Weaknesses:

      There is no specific weakness in this work, although it would have helped to have a drawing model showing how ClpL performs protein disaggregation based on their new findings. The function of the higher assembly states of ClpL remains unresolved and will need further extensive research. Similarly, it will be interesting in the future to see whether the sole function of the plasmid-encoded ClpL is to cope with general protein aggregates under heat stress.

      We thank the reviewer for the positive evaluation. We agree with the reviewer that it will be important to test whether ClpL can bind to and process non-aggregated protein substrates. Our preliminary analysis suggests that the disaggregation activity of ClpL is most relevant in vivo, pointing to protein aggregates as main target.

      We also agree that the role of dimers or tetramers of ClpL rings needs to be further explored. Our initial analysis suggests a function of ring dimers as a resting state. It will now be important to study the dynamics of ClpL assembly formation and test whether substrate presence shifts ClpL assemblies towards an active, single ring state.

      Reviewer #2 (Public Review):

      The manuscript by Bohl et al. is an interesting and carefully done study on the biochemical properties and mode of action of potent autonomous AAA+ disaggregase ClpL from Listeria monocytogenes. ClpL is encoded on plasmids. It shows high thermal stability and provides Listeria monocytogenes food-pathogen substantial increase in resistance to heat. The authors show that ClpL interacts with aggregated proteins through the aromatic residues present in its N-terminal domain and subsequently unfolds proteins from aggregates translocating polypeptide chains through the central pore in its oligomeric ring structure. The structure of ClpL oligomers was also investigated in the manuscript. The results suggest that mono-ring structure and not dimer or trimer of rings, observed in addition to mono-ring structures under EM, is an active species of disaggregase.

      Presented experiments are conclusive and well-controlled. Several mutants were created to analyze the importance of a particular ClpL domain.

      The study's strength lies in the direct comparison of ClpL biochemical properties with autonomous ClpG disaggregase present in selected Gram-negative bacteria and well-studied E. coli system consisting of ClpB disaggregase and DnaK and its cochaperones. This puts the obtained results in a broader context.

      We thank the reviewer for the detailed comments. There are no specific weaknesses indicated in the public review.

      Reviewer #3 (Public Review):

      Summary:

      This manuscript details the characterization of ClpL from L. monocytogenes as a potent and autonomous AAA+ disaggregase. The authors demonstrate that ClpL has potent and DnaK-independent disaggregase activity towards a variety of aggregated model substrates and that this disaggregase activity appears to be greater than that observed with the canonical DnaK/ClpB co-chaperone. Furthermore, Lm ClpL appears to have greater thermostability as compared to Lm DnaK, suggesting that ClpL-expressing cells may be able to withstand more severe heat stress conditions. Interestingly, Lm ClpP can provide thermotolerance to E. coli that have been genetically depleted of either ClpB or in cells expressing a mutant DnaK103. The authors further characterized the mechanisms by which ClpL interacts with protein aggregates, identifying that the N-terminal domain of ClpL is essential for disaggregase function. Lastly, by EM and mutagenesis analysis, the authors report that ClpL can exist in a variety of larger macromolecular complexes, including dimer or trimers of hexamers/heptamers, and they provide evidence that the N-terminal domains of ClpL prevent dimer ring formation, thus promoting an active and substrate-binding ClpL complex. Throughout this manuscript the authors compare Lm ClpL to ClpG, another potent and autonomous disaggregase found in gram-negative bacteria that have been reported on previously, demonstrating that these two enzymes share homologous activity and qualities. Taken together this report clearly establishes ClpL as a novel and autonomous disaggregase.

      Strengths:

      The work presented in this report amounts to a significant body of novel and significant work that will be of interest to the protein chaperone community. Furthermore, by providing examples of how ClpL can provide in vivo thermotolerance to both E. coli and L. gasseri the authors have expanded the significance of this work and provided novel insight into potential mechanisms responsible for thermotolerance in food-borne pathogens.

      Weaknesses:

      The figures are clearly depicted and easy to understand, though some of the axis labeling is a bit misleading or confusing and may warrant revision. While I do feel that the results and discussion as presented support the authors' hypothesis and overall goal of demonstrating ClpL as a novel disaggregase, interpretation of the data is hindered as no statistical tests are provided throughout the manuscript. Because of this only qualitative analysis can be made, and as such many of the concluding statements involving pairwise comparisons need to be revisited or quantitative data with stats needs to be provided. The addition of statistical analysis is critical and should not be difficult, nor do I anticipate that it will change the conclusions of this report.

      We thank the reviewer for the valid criticism. We addressed the major concern of the reviewer and added the requested statistical analysis to all relevant figures. The analysis confirms our conclusions. We also followed the advice of the reviewer and revised axis labeling to increase clarity.

    1. Author Response

      The following is the authors’ response to the original reviews.

      Public Reviews:

      Reviewer #1 (Public Review):

      Anderson, Henikoff, Ahmad et al. performed a series of genomics assays to study Drosophila spermatogenesis. Their main approaches include (1) Using two different genetic mutants that arrest male germ cell differentiation at distinct stages, bam and aly mutant, they performed CUT&TAG using H3K4me2, a histone modification for active promoters and enhancers; (2) Using FACS sorted pure spermatocytes, they performed CUT&TAG using antibodies against RNA PolII phosphorylated Ser 2, H4K16ac, H3K9me2, H3K27me3, and ubH2AK118. They also compare these chromatin profiling results with the published single-cell and single-nucleus RNA-seq data. Their analyses are across the genome but the major conclusions are about the chromatin features of the sex chromosomes. For example, the X chromosome is lack of dosage compensation as well as inactivation in spermatocytes, while Y chromosome is activated but enriched with ubH2A in spermatocytes. Overall, this work provides high-quality epigenome data in testes and in purified germ cells. The analyses are very informative to understand and appreciate the dramatic chromatin structure change during spermatogenesis in Drosophila. Some new analyses and a few new experiments are suggested here, which hopefully further take advantage of these data sets and make some results more conclusive.

      Major comments: 1. The step-wise accumulation of H3K4me2 in bam, aly and wt testes are interesting. Is it possible to analyse the cis-acting sequences of different groups of genes with distinct H3K4me2 features, in order to examine whether there is any shared motif(s), suggesting common trans-factors that potentially set up the chromatin state for activating gene expression in a sequential manner?

      While the histone H3K4me2 mark is low and more widespread at genes active in late spermatocytes and in spermatids (shown in Figure 2C and some examples in Figure 1C-D), we suggest that this may be due to a general decrease in the importance of this modification in late spermatogenesis rather than a specific feature of those genes. We point this out in lines 146-152. This idea is supported by the widespread change in RNAPII distribution in all genes in the germline, shown in Figure 3F and supplementary Figure 2.

      1. Pg. 4, line 141-142: "we cannot measure H3K4me2 modification at the bam promoter in bam mutant testes or at the aly promoter in aly mutant testes", what are the allelic features of the bam mutant and aly mutant? Are the molecular features of these mutations preventing the detection of H3K4me2 at the endogenous genes' promoters? Also, the references cited (Chen et al., 2011) and (Laktionov et al., 2018) are not the original research papers where these two mutants were characterized.

      We have corrected these citations to the original papers. We clarified in the text that the bamΔ86 allele is a deletion of almost all of the coding sequence (reported in Bopp, D., Horabin, J.I., Lersch, R.A., Cline, T.W., Schedl, P. (1993). Expression of the Sex-lethal gene is controlled at multiple levels during Drosophila oogenesis. Development 118(3): 797--812.). The aly1 allele is also a P element-induced mutation; it is not molecularly characterized (it was first described here: Lin, T.Y., Viswanathan, S., Wood, C., Wilson, P.G., Wolf, N., Fuller, M.T. (1996). Coordinate developmental control of the meiotic cell cycle and spermatid differentiation in Drosophila males. Development 122(4): 1331--1341.) We noticed a lack of reads for various histone modifications in aly mutants in part of the gene, suggesting that the deletion is limited to the promoter and the first exon. Signal for the H3K4me2 modification is at background levels for the distal portion of aly, suggesting that the deletion inactivates the gene.

      1. The original paper that reported the Pc-GFP line and its localization is: Chromosoma 108, 83 (1999).

      We are citing the first published description of this marker in the male germline (lines 291-293).

      The Pc-GFP is ubiquitously expressed and almost present in all cell types. In Figure 6B, there is no Pc-GFP signals in bam and aly mutant cells.

      We apologize, our labeling of the figure was easily overlooked - the bam and aly genotypes do not carry the PcGFP marker, since we didn’t need it for staging the germline nuclei. We have clarified this in the figure.

      According to the Method "one testis was dissected", does it mean that only one testis was prepared for immunostaining and imaging? If so, definitely more samples should be used for a more confident conclusion.

      We corrected the text to make it clear that all cytological examinations were repeated at least times (lines 438-439).

      Also, why use 3rd instar larval testes instead of adult testes?

      Generally, we find that immunostaining of the larval testes is cleaner, and we now mention this in the Methods (lines 439-440). We have immunostained both larval and adult testes for these markers with consistent results.

      Finally, it is better to compare fixed tissue and live tissue, as the Pc-GFP signal could be lost during fixation and washing steps. Please refer to the above paper [Chromosoma 108, 83 (1999)] for Pc-GFP in spermatogonial cells and Development 138, 2441-2450 (2011) for Pc-GFP localization in aly mutant.

      We are using PcGFP staining for staging with antibody detection of other chromatin features, which requires fixed material, although we have compared PcGFP signal in both live and fixed tissue. We have added the 1999 reference for nuclear staging in the male germline.

      1. Ubiquitinylation of histone H2A is typically associated with gene silencing, here it has been hypothesized that ubH2A contributes to the activation of Y chromosome. This conclusion is strenuous, as it entirely depends on correlative results.

      We agree that this is a correlation. We cite in the text examples where uH2A is associated with gene activation. We have added a comment to clarify that this is a correlation (lines 318-320), and now present an alternative that uH2A on the Y chromosome may be moderating expression from these highly active genes (lines 405-407).

      For example, the lack of co-localization of ubH2A immunostaining and Pc-GFP are not convincing evidence that ubH2A is not resulting from PRC1 dRing activity. It would be a lot stronger conclusion by using genetic tools to show this. For example, if dRing is knocked down (using RNAi driven by a late-stage germline driver such as bam-Gal4) or mutated in spermatocytes (using mitotic clonal analysis), would they detect changes of ubH2A levels?

      We have tested multiple constructs to knockdown dRING using the bam-GAL4 driver although we have not reported it in the manuscript. These knockdowns have no effect on uH2A staining in the testis, on motile sperm production, or on male fertility, although these RNAi constructs do produce Polycomb phenotypes when expressed in somatic cells from an en-GAL4 driver. This is the reason why we point out in the text that there are multiple alternative candidates for an H2A ubiquitin ligase in the Drosophila genome and that in other species RING1 is not responsible for sex body uH2A in the male germline (lines 394-396).

      1. Regarding "X chromosome of males is thought to be upregulated in early germline cells", it has been shown that male-biased genes are deprived on the X chromosome [Science 299:697-700 (2003); Genome Biol 5:R40 (2004); Nature 450:238-241 (2007)], so are the differentiation genes of spermatogenesis [Cell Research 20:763-783 (2010)]. It would be informative to discuss the X chromatin features identified in this work with these previous findings.

      We now mention that the Drosophila X chromosome is moderately depleted of male germline-expressed genes (lines 362-363).

      For example, the lack of RNAPII on X chromosome in spermatocytes could be due to a few differentiation genes expressed in spermatocytes located on the X chromosome.

      We show in Figure 3B that there is a minor non-significant reduction in RNAPII on the X chromosome in spermatocytes. This small reduction might be due to the moderate paucity of male germline-expressed genes on this chromosome, but since it is non-significant we have not discussed it.

      Reviewer #2 (Public Review):

      Anderson et al profiled chromatin features, including active chromatin marks, RNA polymerase II distribution, and histone modifications in the sex chromosomes of spermatogenic cells in Drosophila. The results are new and the experiments and analyses look well done, including with appropriate numbers of replicates. Results were parsed by comparing them among two arrest mutants and wildtype, as well as in FACS-sorted spermatocytes. The authors also profiled larval wing discs to serve as reference-somatic cells, which allowed them to focus only on features in their testis data that were associated with germ cells. Their results were further refined by categorizing the genes of interest based on available single nucleus RNA seq expression profiles. The authors document interesting phenomena, such as differences in the distribution of RNAPIIS2p on some genes in germ cells vs somatic cells, the presence of a uH2A body beginning in early spermatocytes, and high levels of uH2A on the Y chromosome and little or none on the X. The former is intriguing because this modification is usually associated with silencing, yet the Y chromosome is active in spermatogenic cells. The authors interpret some of their data as implying a lack of dosage compensation of the X chromosome in spermatocytes.

      The data are believable and new, but it is not fully clear how to interpret them. The paper's interpretations rely on subtractive logic to parse results from mixtures of cells down to cell type, extracting spermatogonia, spermatocyte, etc. features by comparing bam mutants (only spermatogonia) to aly mutants (spermatogonia and early spermatocytes but no later stages) to wildtype (all spermatogenic stages), and extracting testis germline data by comparison to wing disc soma; their FACS sorted spermatocytes also have heterogeneity. I recognize that the present paper was a lot of work and am not suggesting that the authors redo their study using methods that give more purity and precision of stage (https://doi.org/10.1126/science.aal3096, https://doi.org/10.1101/gad.335331.119), but they should be aware of them and of their results.

      The pulse-release system that the reviewer points to is an interesting system, but more limited in material and in useable markers than the systems we used here. We have added to our discussion of the the limitations of subtractive comparisons between arrest genotypes, both in regards to using mutants that may alter gene expression programs, and to how subtractive comparisons may limit our detection of differences between cell types (lines 143-147).

      The conclusions about dosage compensation are indirect, but are consistent with the current model documented in the studies cited by the authors, as well as earlier studies (doi: 10.1186/jbiol30).

      We disagree; our data directly speaks to the molecular mechanisms at play. Our profiling of the H4K16acetylation mark and RNAPII in isolated spermatocytes (Figure 4) demonstrates that current models are correct, and so are useful for settling this point in the literature.

      Reviewer #1 (Recommendations For The Authors):

      Throughout the manuscript, it is better to cite the original research papers.

      We have added citations for the original characterizations of bam and aly alleles used, for the descriptions of PCGFP in spermatocytes, and for issues raised by reviewer comments.

      Minor comments:

      Pg.2, line 70-71: "Germline stem cells at the apical tip of the testis asymmetrically divide to birth spermatogonia", should be gonialblast.

      Fixed (line 71).

      Pg.2, line 71: "four rapid mitotic divisions", the spermatogonial cell cycle lasts several hours-- "rapid" is subjective and relative, better to leave this word out.

      Fixed (line 71).

      Reviewer #2 (Recommendations For The Authors):

      Other than the major issue raised in the public review this paper only needs a few minor modifications, listed by line number below. The first one would be considered essential by this reviewer.

      27: In the sentence that ends on this line, please add the word testis after Drosophila.

      Fixed (line 27).

      119: It must be known from the Fly Cell Atlas data whether these genes do begin to express in spermatogonia.

      Collated expression values from the FCA are provided in Supplementary Table 2. In many cases there is detectable expression of these genes in spermatogonia, although transcript abundance peaks in early spermatocytes.

      198: remove "distribution of".

      Fixed (line 200).

      311: enrichment relative to what?

      Fixed (line 313). It is relative to signal in wing discs.

      344: other aspects could be regulated such as elongation, termination.

      We have added caveats to our speculations in this sentence (lines 340-356). The increased signal we see in gene bodies could be due to slower RNAPII elongation, but we don’t see a way that changes in termination would produce this pattern.

      369: This part of the paper seems overly speculative, given the many molecular differences between dosage compensation mechanisms of Drosophila vs mammals, and studies that indicate that MSCI does occur in Drosophila (DOI: 10.3390/genes12111796).

      We disagree, and this is a central point in our manuscript. The paper referred to here does not directly assess MSCI in Drosophila, instead they argue that MSCI could be the force driving the evolutionary depletion of male-germline-expressed genes they describe. These and many studies in the literature have conflated the effects of a lack of X dosage compensation and of MSCI in the male germline. Our direct measurements of RNAPII in spermatocytes demonstrates that there is no dosage compensation nor is there MSCI. Further, profiling of histone modifications associated with Drosophila somatic dosage compensation (H4K16ac) or with mammalian MSCI (uH2A, H3K9me2) show that the molecular mechanisms found in these other settings are not in play in the Drosophila male germline. As we have established these biological differences between mammals and Drosophila, it is appropriate to now speculate on why these differences may be, which we do on lines 374-384.

      (several lines): Can the authors justify their assumption that chromatin features of larval wing disc cells will match those of somatic cells of adult testes?

      We don’t only compare germline features to somatic cells of the wing disc, but also to genes with somatic expression in the testes annotated by FCA expression data (H3K4me2 in Figure 2C, RNAPII in Figure 3F). Note in Supplementary Figure 2 the distribution of RNAPII in whole testes (which includes somatic cells) is similar to that of larval wing discs, confirming that the differences we describe are specific to germline cells.

    1. Author Response

      The following is the authors’ response to the previous reviews

      Point-to-Point Responses to Reviewers’ Comments

      We are a bit surprised by the comments of Reviewer 1, but that our further responses can help communications with Reviewer 1. We have also responded to comments of Reviewers 2 and 3.

      Public Reviews:

      *Reviewer #1 (Public Review):

      The overall tone of the rebuttal and lack of responses on several questions was surprising. Clearly, the authors took umbrage at the phrase 'no smoking gun' and provided a lengthy repetition of the fair argument about 'ticking boxes' on the classic list of criteria. They also make repeated historical references that descriptions of neurotransmitters include many papers, typically over decades, e.g. in the case of ACh and its discovery by Sir Henry Dale. While I empathize with the authors' apparent frustration (I quote: '...accept the reality that Rome was not built in a single day and that no transmitter was proven by a one single paper') I am a bit surprised at the complete brushing away of the argument, and in fact the discussion. In the original paper, the notion of a receptor was mentioned only in a single sentence and all three reviewers brought up this rather obvious question. The historical comparisons are difficult: Of course many papers contribute to the identification of a neurotransmitter, but there is a much higher burden of proof in 2023 compared to the work by Otto Loewi and Sir Henry Dale: most, if not all, currently accepted neurotransmitter have a clear biological function at the level of the brain and animal behavior or function - and were in fact first proposed to exist based on a functional biological experiment (e.g. Loewi's heart rate change). This, and the isolation of the chemical that does the job, were clear, unquestionable 'smoking guns' a hundred years ago. Fast forward 2023: Creatine has been carefully studied by the authors to tick many of the boxes for neurotransmitters, but there is no clear role for its function in an animal. The authors show convincing effects upon K+ stimulation and electrophysiological recordings that show altered neuronal activity using the slc6a8 and agat mutants as well as Cr application - but, as has been pointed out by other reviewers, these effects are not a clear-cut demonstration of a chemical transmitter function, however many boxes are ticked. The identification of a role of a neurotransmitter for brain function and animal behavior has reasonably more advanced possibilities in 2023 than a hundred years ago - and e.g. a discussion of approaches for possible receptor candidates should be possible.

      Again, I reviewed this positively and agree that a lot of cumulative data are great to be put out there and allow the discovery to be more broadly discussed and tested. But I have to note, that the authors simply respond with the 'Rome was not built in a single day' statement to my suggestions on at least 'have some lead' how to approach the question of a receptor e.g. through agonists or antagonists (while clearly stating 'I do not think the publication of this manuscript should not be made dependent' on this). Similarly, in response to reviewer 2's concerns about a missing receptor, the authors' only (may I say snarky) response is ' We have deleted this sentence, though what could mediate postsynaptic responses other than receptors?' The bullet point by reviewer 3 ' • No candidate receptor for creatine has been identified postsynaptically.' is the one point by that reviewer that is simply ignored by the authors completely. Finally, I note that my reivew question on the K stimulation issues (e.g. 35 neurons that simply did not respond at all) was: ' Response: To avoid the disadvantage of K stimulation, we also performed optogenetic experiments recently and obtained encouraging preliminary results.' No details, not data - no response really.

      In sum, I find this all a bit strange and the rebuttal surprising - all three reviewers were supportive and have carefully listed points of discussion that I found all valid and thoughtful. In response, the authors selectively responded scientifically to some experimental questions, but otherwise simply rather non-scientifically dismissed questions with 'Rome was not built in a day'-type answers, or less. I my view, the authors have disregarded the review process and the effort of three supportive reviewers, which should be part of the permanent record of this paper.

      Response:

      We were very surprised by the tone of Reviewer 1 in the second round of reviewing. The corresponding author has spent some time including a long holiday to cool down and re-read our earlier responses. The following is entirely by the correspond author.

      I have finally checked the term “smoking gun”, and found out that I interpreted it wrongly while I had thought that Reviewer 1 was wrong. This came from a long story in that I was lectured by a native speaker for my English when submitting the first paper from my own paper. In that case, the Reviewer was wrong (in arguing that only adjectives but not nouns can be used to define nouns), I was quite offended and remembered it vividly. In the case of “smoking gun”, I wrongly believed that it meant a hint (while the definite evidence would be “the final nail in the coffin”). By interpreting is as a hint, I was then rebutting Reviewer 1 for negating all our experimental results as “not a single piece of suggestive evidence”.

      For the above, I apologize.

      I have another disagreement about “smoking gun”. For a transmitter, multiple criteria have to be met. For example, finding a receptor for a small molecule would not be definitive for a transmitter because if it is not present in the SVs, it is unlikely to be a typical transmitter. If a molecule has a receptor but they are not even in the nervous system, it is definitely no a transmitter.

      The title of our paper is “Evidence suggesting creatine as a new central neurotransmitter”, not “Evidence proving creatine as a new central neurotransmitter”. In the Abstract, after “Our biochemical, chemical, genetic and electrophysiological results are consistent with the possibility of Cr as a neurotransmitter”, we are adding “though not yet reaching the level of proof for the now classic transmitters”. In the last sentence of the introduction, we have now added “though the discovery of a receptor for Cr would prove it”.

      I do, however, believe that, however strong the wordings are, criticisms and rebuttals in science are normal and should be conducted even when emotions are involved.

      One of my major point of differences with at least two of the reviewers is that the criteria for neurotransmitters should be those listed in major textbooks. While everyone can have one’s own opinions, the textbooks, especially those accepted by readers of the field for more than 40 years, should be the standards. Kandel has listed the 4 criteria not only 40 years ago but also just 2 years ago in their latest 6th edition. The reviewers have asked for more, while discounting Kandel et al. (2021). So, in essence, the Reviewer is not shy in scientific criticisms when stating “The identification of a role of a neurotransmitter for brain function and animal behavior has reasonably more advanced possibilities in 2023 than a hundred years ago”.

      Reviewer 1 raised another new criterion: brain function and behavior, while this is not in any textbook lists. However, lack of Cr caused behavioral problems, as cited by us in the introduction: both humans and mice were defective in brain function with loss of function mutations in the gene for the specific Cr transporter SLC6A8. If the reviewer meant behavioral abnormalities caused by Cr injection, that was unclear. But that criterion may not be met by other transmitters which is the likely reason that it was not a criterion in any textbook.

      Reviewer #2 (Public Review):

      Summary:

      Bian et al studied creatine (Cr) in the context of central nervous system (CNS) function. They detected Cr in synaptic vesicles purified from mouse brains with anti-Synaptophysin using capillary electrophoresis-mass spectrometry. Cr levels in the synaptic vesicle fraction was reduced in mice lacking the Cr synthetase AGAT, or the Cr transporter SLC6A8. They provide evidence for Cr release within several minutes after treating brain slices with KCl. This KCl-induced Cr release was partially calcium dependent and was attenuated in slices obtained from AGAT and SLC6A8 mutant mice. Cr application also decreased the excitability of cortical pyramidal cells in one third of the cells tested. Finally, they provide evidence for SLC6A8-dependent Cr uptake into synaptosomes, and ATP-dependent Cr loading into synaptic vesicles. Based on these data, the authors propose that Cr may act as neurotransmitter in the CNS.

      Strengths: 1. A major strength of the paper is the broad spectrum of tools used to investigate Cr. 2. The study provides evidence that Cr is present in/loaded into synaptic vesicles.

      Weaknesses: 1. There is no significant decrease in Cr content pulled down by anti-Syp in AGAT-/- mice when normalized to IgG controls. Hence, blocking AGAT activity/Cr synthesis does not affect Cr levels in the synaptic vesicle fraction, arguing against a Cr enrichment.

      Response: Evidence for Cr enrichment in the SVS was obtained robustly with wild type mice. When brain Cr is very low in AGAT-/- mutant mice, because there is little Cr, there is also little Cr in the SVs. One does not require that as a criterion: it does not argue against the normal levels of Cr could be transported into the SVs even if when the much reduced levels of AGAT-/- Cr in mutant mice could be enriched in SVs.

      1. There is no difference in KCl-induced Cr release between SLC6A8-/Y and SLC6A8+/Y when normalizing the data to the respective controls. Thus, the data are not consistent with the idea that depolarization-induced Cr release requires SLC6A8.

      Response: This comment of Reviewer 2 was based on Figure 5D. But if one carefully examines Figure 5G, it was clear that the Ca++ dependent component of KCl -induced Cr release was lower in SLC6A8-/Y than that in SLC6A8+/Y.

      1. The rationale of grouping the excitability data into responders and non-responders is not convincing because the threshold of 10% decrease in AP rate is arbitrary. The data do therefore not support the conclusion that Cr reduces neuronal excitability.

      Response: Comparison of the same neuron, before and after Cr did show effects on neuronal excitability though that would have no statistics if one does not group multiple cells into the same categories.

      Reviewer #3 (Public Review):

      SUMMARY:

      The manuscript by Bian et al. promotes the idea that creatine is a new neurotransmitter. The authors conduct an impressive combination of mass spectrometry (Fig. 1), genetics (Figs. 2, 3, 6), biochemistry (Figs. 2, 3, 8), immunostaining (Fig. 4), electrophysiology (Figs. 5, 6, 7), and EM (Fig. 8) in order to offer support for the hypothesis that creatine is a CNS neurotransmitter.

      STRENGTHS:

      There are many strengths to this study. • The combinatorial approach is a strength. There is no shortage of data in this study. • The careful consideration of specific criteria that creatine would need to meet in order to be considered a neurotransmitter is a strength. • The comparison studies that the authors have done in parallel with classical neurotransmitters is helpful. • Demonstration that creatine has inhibitory effects is another strength. • The new genetic mutations for Slc6a8 and AGAT are strengths and potentially incredibly helpful for downstream work.

      WEAKNESSES: • Some data are indirect. Even though Slc6a8 and AGAT are helpful sentinels for the presence of creatine, they are not creatine themselves. Of note, these molecules themselves are not essential for making the case that creatine is a neurotransmitter.

      Response: We agree, but those data are not inconsistent with the possibility.

      • Regarding Slc6a8, it seems to work only as a reuptake transporter - not as a transporter into SVs. Therefore, we do not know what the transporter into the TVs is.

      Response: SLC6A8 is not the transporter on the SVs, but is an excellent candidate for the transporter on the presynaptic cytoplasmic membrane for uptake of Cr into the presynaptic structure.

      • Puzzlingly, Slc6a8 and AGAT are in different cells, setting up the complicated model that creatine is created in one cell type and then processed as a neurotransmitter in another. This matter will likely need to be resolved in future studies.

      Response: We agree.

      • No candidate receptor for creatine has been identified postsynaptically. This will likely need to be resolved in future studies.

      Response: We agree.

      • Because no candidate receptor has been identified, it is important to fully consider other possibilities for roles of creatine that would explain these observations other than it being a neurotransmitter? There is some attention to this in the Discussion.

      Response: We agree.

      There are several criteria that define a neurotransmitter. The authors nicely delineated many criteria in their discussion, but it is worth it for readers to do the same with their own understanding of the data.

      By this reviewer's understanding (and combining some textbook definitions together) a neurotransmitter: 1) must be present within the presynaptic neuron and stored in vesicles; 2) must be released by depolarization of the presynaptic terminal; 3) must require Ca2+ influx upon depolarization prior to release; 4) must bind specific receptors present on the postsynaptic cell; 5) exogenous transmitter can mimic presynaptic release; 6) there exists a mechanism of removal of the neurotransmitter from the synaptic cleft.

      Response: While any of us can come up with a list according to our own understanding, the paper copies lists from textbooks, especially from Kandel et al. (2021), which lists the same 4 criteria as Kandel et al. (1983), providing consistency and consensus.

      For a paper to claim that the published work has identified a new neurotransmitter, several of these criteria would be met - and the paper would acknowledge in the discussion which ones have not been met. For this particular paper, this reviewer finds that condition 1 is clearly met.

      Conditions 2 and 3 seem to be met by electrophysiology, but there are caveats here. High KCl stimulation is a blunt instrument that will depolarize absolutely everything in the prep all at once and could result in any number of non-specific biological reactions as a result of K+ rushing into all neurons in the prep. Moreover, the results in 0 Ca2+ are puzzling. For creatine (and for the other neurotransmitters), why is there such a massive uptick in release, even when the extracellular saline is devoid of calcium?

      Response: Classic transmitters are released in a Ca++ dependent manner when stimulated by KCl, though they also had a Ca++ independent component as also shown in our Figure 5 E and F.

      Condition 4 is not discussed in detail at all. In the discussion, the authors elide the criterion of receptors specified by Purves by inferring that the existence of postsynaptic responses implies the existence of receptors. True, but does it specifically imply the existence of creatinergic receptors? This reviewer does not think that is necessarily the case. The authors should be appropriately circumspect and consider other modes of inhibition that are induced by activation or potentiation of other receptors (e.g., GABAergic or glycinergic).

      Response: Kandel et al. did not list this.

      Condition 5 may be met, because authors applied exogenous creatine and observed inhibition. However, this is tough to know without understanding the effects of endogenous release of creatine. if they were to test if the absence of creatine caused excess excitation (at putative creatinergic synapses), then that would be supportive of the same. Nicely, Ghirardini et al., 2023 study cited by the reviewers does provide support for this exact notion in pyramidal neurons.

      Response: For most commonly accepted transmitters, this criterion has never been met. For example, the simplest case would be ACh at the neuromuscular junction. Howver, we have now found that choline is clearly present in SVs. So, how does anyone be sure that only ACh is released only, or how does anyone rule out effects of choline on postsynaptic cells when cholinergic neurons are stimulated?

      Many synapses are now known to release more than one transmitter, making it difficult to define the effect of one transmitter released endogenously.

      These are perhaps reasons why some textbooks do not emphasize similarities of endogenously released vs exogenously applied molecules.

      For condition 6, the authors made a great effort with Slc6a8. This is a very tough criterion to understand or prove for many synapses and neurotransmitters.

      Response: SLC6A8 is a transporter on the cytoplasmic membrane, thus a good candidate for removal of Cr from the synaptic cleft.

      In terms of fundamental neuroscience, the story should be impactful. There are certainly more neurotransmitters out there than currently identified and by textbook criteria, creatine seems to be one of them taking all of the data in this study and others into account.

      Response: We hope that more will join our lonely efforts in trying to discover more transmitters.

      Recommendations for the authors:

      Reviewer #1 (Recommendations For The Authors):

      Since the authors largely disregarded questions in the review process, I do not see a point in listing recommendation for the authors again.

      Reviewer #2 (Recommendations For The Authors):

      1. The different sections of the manuscript are not separated by headers.

      Response: We do have separate subheadings.

      1. The beginning of the results section either does not reference the underlying literature or refers to unpublished data.

      Response: We have a very long introduction which was criticized for being too long and with too much historical citations. We therefore refrained from citation again in the beginning part of the Results section.

      1. The text contains many opinions and historical information that are not required (e.g., "It has never been easy to discover a new neurotransmitter, especially one in the central nervous system (CNS). We have been searching for new neurotransmitters for 12 years."; l. 17).

      Response: We would like to keep these because most readers are young and do not know the history and difficulties of discovering transmitters.

      1. Almeida et al. (2008; doi: 10.1002/syn.20280) provided evidence for electrical activity-, and Ca2+-dependent Cr release from rat brain slices. This paper should be introduced in the introduction.

      Response: Done.

      1. Fig. 7: A Y-scale for the stimulation protocol is missing.

      Response: Done.

      Reviewer #3 (Recommendations For The Authors):

      The main suggestion by this reviewer (beyond the details in the public review) was to consider the full spectrum of biology that is consistent with these results. By my reading, creatine could be a neurotransmitter, but other possibilities also exist. The authors have highlighted some of those for their Discussion.

    1. Author Response

      The following is the authors’ response to the previous reviews

      eLife assessment

      The manuscript offers important findings on the potential influence of maternally derived extracellular vesicles on embryo metabolism. However, while the content is convincing, the title appears to overstate the study's conclusions due to its speculative nature on the DNA transmission and embryo bioenergetics connection. A more measured title would better represent the evidence presented.

      We want to extend our heartfelt appreciation to the editors and reviewers for their invaluable comments on our research. Their feedback has played a crucial role in improving the quality of our manuscript.

      We acknowledge the concern regarding the manuscript's title and are fully open to making modifications. Following the recommendation of Reviewer 2, the proposed new title of the manuscript will be “Vertical transmission of maternal DNA through extracellular vesicles associates with altered embryo bioenergetics during the periconception period.”

      Reviewer #1 (Public Review):

      Q1. Bolumar et al. isolated and characterized EV subpopulations, apoptotic bodies (AB), Microvesicles (MV), and Exosomes (EXO), from endometrial fluid through the female menstrual cycle. By performing DNA sequencing, they found the MVs contain more specific DNA sequences than other EVs, and specifically, more mtDNA were encapsulated in MVs. They also found a reduction of mtDNA content in the human endometrium at the receptive and post-receptive period that is associated with an increase in mitophagy activity in the cells, and a higher mtDNA content in the secreted MVs was found at the same time. Last, they demonstrated that the endometrial Ishikawa cell-derived EVs could be taken by the mouse embryos and resulted in altered embryo metabolism.

      This is a very interesting study and is the first one demonstrating the direct transmission of maternal mtDNA to embryos through EVs.

      A1. Thank you for your kind comments.

      Reviewer #2 (Public Review):

      Q2. In Bolumar, Moncayo-Arlandi et al. the authors explore whether endometrium-derived extracellular vesicles contribute DNA to embryos and therefore influence embryo metabolism and respiration. The manuscript combines techniques for isolating different populations of extracellular vesicles, DNA sequencing, embryo culture, and respiration assays performed on human endometrial samples and mouse embryos.

      Vesicle isolation is technically difficult and therefore collection from human samples is commendable. Also, the influence of maternally derived DNA on the bioenergetics of embryos is unknown and therefore novel. However, several experiments presented in the manuscript fail to reach statistical significance, likely due to the small sample sizes. This manuscript is a good but incomplete start as to the potential function of maternal DNA transfer via vesicles.

      In my opinion the manuscript supports the following of the authors' claims:

      1. Different amounts of nDNA and mtDNA are shed in human endometrial extracellular vesicles during different phases of the menstrual cycle.
      2. Endometrial microvesicles are more enriched for mitochondrial DNA sequences compared to other types of vesicles present in the human samples.
      3. Fluorescently labelled DNA from extracellular vesicles derived from an endometrial adenocarcinoma cell line can be incorporated into hatched mouse embryos.
      4. Culture of mouse embryos with endometrial extracellular vesicles can influence embryo respiration and the effect is greater when cultured with isolated exosomes compared to other isolated microvesicles.

      My main concerns with the manuscript:

      1. Several experiments presented fail to reach statistical significance or are qualitative.
      2. The definitive experiments presented in the manuscript are limited to the transfer of DNA in general not mtDNA. Therefore a strong connection with metabolism is missing, diminishing the significance of the findings.

      A2. We thank you for your detailed feedback. While we acknowledge the reviewer's concerns regarding sample sizes, we emphasize that this study was intentionally designed as a pilot study and was approved by the IRB with a specific sample size to serve as proof of concept. We fully agree that further research is essential for a more comprehensive understanding of the novel biological process described in this manuscript. When this manuscript is finally accepted, we can submit a new IRB application to obtain a larger sample size, allowing us to delve deeper into demonstrating the connection with metabolism

      Recommendations for the authors:

      Reviewer #1 (Recommendations For The Authors):

      Q3. The authors have made significant improvements, and the manuscript now is appropriate for eLife.

      A3. Thank you for your consideration.

      Reviewer #2 (Recommendations For The Authors):

      The authors have made several changes that have improved the manuscript. However, I still have some concerns.

      Q4. The title is still too definitive. Something like "Vertical transmission of maternal DNA through extracellular vesicles is associated with changes in embryo bioenergetics during the periconception period" would be more appropriate.

      A4. As mentioned earlier in the response to the editors, we acknowledge the concerns regarding the manuscript's title.

      Following your recommendation, the proposed new title of the manuscript is “Vertical transmission of maternal DNA through extracellular vesicles associates with altered embryo bioenergetics during the periconception period.”

      Q5. I am confused by the incorporation of the new experiment (supplementary figure 7) where embryos are cultured in free-floating synthesized mtDNA. If these sequences were not encapsulated in vesicles I don't think the experiment is relevant. If they were similarly prepared as in the section "Tagged-DNA production and EV internalization by murine embryos" I stand corrected but please clarify or omit. Otherwise, the new data/figure in response to Q11 showing co-localization of mitochondria and EdU-tagged DNA from MVs from Ishikawa cells is more compelling. However, this doesn't separate the uptake of mtDNA alone from the potential uptake of mitochondria, which this manuscript is not focused on.

      A5. We apologize for any confusion that may have arisen for the reviewer. We conducted this experiment in response to question Q4 posed by the same reviewer, which specifically inquired about the detection of internalized mtDNA by the embryos.

      As previously stated in the revised manuscript, the EdU system does not selectively label mtDNA; instead, it labels any newly synthesized DNA, both nuclear and mitochondrial. We have not found a system that specifically labels mtDNA for subsequent tracing inside EVs or for encapsulation within artificial EVs (which falls outside our expertise). Therefore, we employed labeled mtDNA that we could trace after the embryos' internalization.

      While we acknowledge that this approach is not perfect, it does demonstrate the internalization of mtDNA sequences within the embryo. We have revised the manuscript to eliminate any potential sources of confusion. If the reviewer or editors still have concerns about the experiment's suitability, we are open to removing it from the final version of the manuscript. Please refer to page 9 and lines 234-238 for more details."

    1. Author Response

      The following is the authors’ response to the original reviews.

      General comments:

      To reviewer 1 and 3: The following sentences below were added at the beginning of the result section to clarify that the Gr gene expression analysis was performed using bimodal expression systems and to provide a reference that these expression profiles can generally be expected to represent endogenous Gr expression.

      "Note that this and all previous Gr expression studies were performed using bimodal expression systems, mostly GAL4/UAS, whereby Gr promotors driving GAL4 are assumed to faithfully reproduce expression of the respective Gr genes. Importantly, we analyzed two or more Gr28-GAL4 insertion lines for each transgene, and at least two generated the same expression profiles (Mishra et al., 2018; Thorne and Amrein, 2008) providing evidence that the drivers reflect a fairly accurate expression profile of respective endogenous genes."

      Specific comments:

      Reviewer #1 (Recommendations For The Authors):

      The important chemogenetic behavioral data would benefit from a clearer presentation including a cartoon to explain what the behavior is and how it is scored. Figure 2 is the key figure in this paper and it would be helpful if the figure were reorganized to guide the non-expert reader to the key result. I recommend labeling the positive controls Gr43a as "sweet" and Gr66a as "bitter" and perhaps organize the presentation to have the negative control at the left, then Gr28ba that had no effect, then group Gr28a with Gr43a for positive valence and Gr28bc with Gr66a for negative valence. I'm not sure what the value is of showing both 0.1 mM and 0.5 mM capsaicin, the text does not explain. The experiment in Figure 2B is important but non-experts will not understand what is being done here - can the authors please provide a cartoon like those in Figure 1 showing what cells are being subjected to chemogenetics and how this differs from Figure 2A?

      The reviewer is correct that much can be improved, which we hope to have accomplished with the modifications in Figure 2. We re-organized it to deliver the key result to non-expert readers in an easy way. We added cartoons both explaining how the two-choice preference assays were conducted and indicating which cells express UAS-VR1. The cartoon in Figure 1E and Figure 2A are now directly relatable and should clarify what cells express VR1 (in Figure 2). Positive and negative control experiments using Gr43aGAL4 (a GAL4 knock-in; Miyamoto et al., 2013) and Gr66a-GAL4 are highlighted in the Figure and mentioned upfront in the text to make clear to what the experimental larvae can be compared. We also excluded larvae responses to 0.5 mM capsaicin.

      1. The AlphaFold ligand docking in Figure 8 is conducted with Gr28bc monomers, which are unlikely to be the in vivo relevant structure, given that the related OR/ORCO ancestor structures are tetramers. I recommend that this component of the paper either be removed entirely or that the authors redo the in silico work using the AlphaFold-Multimer package reported by Hassabis and Jumper in 2022 https://www.biorxiv.org/content/10.1101/2021.10.04.463034v2. It will be interesting to see what a tetramer structure looks like with the ligand.

      We tried but were able to use the recommended package. Even if it were, the problem is that we do not know the partner of Gr28b.c. And while it is not clear whether and how extensive changes in the ligand binding pockets occur when using the monomer prediciton vs a multimer package, we followed the reviewer’s suggestion and removed the modeling from the manuscript.

      Minor points:

      1. Line 80: I do not think it is biophysically or biochemically plausible that GRs and IRs would assemble into functional heteromeric channels and suggest that the authors either explain how that would work or remove this speculative comment.

      We have removed this sentence.

      1. Line 246-248: I would tone down the speculation about GR subunit composition - it's still too early days to understand the stoichiometry or the extent that any of the broadly expressed GRs is a co-receptor.

      We did not indulge in the possible stoichiometry of Gr complexes, but merely mention that they are composed in general of two or more Gr subunits, for which clear genetic evidence exists: Up to three different putative bitter Gr genes are necessary to elicit responses to bitter compounds, and at least two putative sugar Gr genes are necessary to restore behavioral responses to any sweet tasting chemicals (sugars). Regardless, we have toned down the language, stating now:

      “Given the multimeric nature of bitter taste receptors (Sung et al., 2017), one possibility is that the absence of a Gr subunit not required for the detection of denatonium (Gr66a) could favor formation of multimeric complexes containing Gr subunits that recognize this compound (Gr28b.a and/or Gr28b.c).”

      1. Line 284: I don't think that co-expression necessarily means that GRs form heteromultimeric channels. It's equally possible that the cell controls subunit assembly to avoid mixing and matching ligand-selective subunits at will. I would tone this down - it's still speculative at this stage. We don't even know yet how this works for OR-Orco, where we do have structures. There is not yet an OR-Orco Cryo-EM structure, so we do not know what the subunit stoichiometry is.

      We are not sure what the reviewer’s concern is. While direct biochemical or biophysical evidence is currently lacking, there is strong genetic evidence for heteromeric composition of Gr complexes, both from studies of bitter and sweet receptors/neurons (see response above). It is likely that intrinsic properties facilitate assembly of certain Grs within a taste receptor complex. We have refrained from any speculation about stoichiometry, though given the relatedness of Grs and Ors, it would not be far-fetched to propose that taste receptor complexes are also tetrameric in nature, which was recently proposed for a homomeric channel of the bombyx mori homolog of Gr43a, BmGr9 (Morinaga et al., 2022).

      1. Line 305: the work of Emily Troemel and Cori Bargmann PMID: 9346234 should be cited in the Discussion. Theirs was the first experiment to show that valence was a feature of the neuron and not the receptor(s) it expresses.

      We have now cited this work in the discussion to acknowledge this important discovery.

      1. Figure 1 - the clarity of the organization of the figure could be improved for non-experts. For instance, can the key for the abbreviations be written out at the right of Figure 1A? Second, it is confusing to talk about DOG/TOG neurons "projecting" to the DO/TO - I think the authors mean dendritic innervation, not axons projecting. Maybe having a diagram that cartoons a closeup of the DOG/TOG neurons and how they innervate the cuticular structures would make this clearer. I struggled to go from the pretty staining at the left of B and C to the schematics at the right that colored in which neurons express which receptors.

      We appreciate these comments regarding clarity and have amended Figure 1 and made necessary changes in the text and the Figure legend.

      1. Figure 3 would benefit from a summary cartoon relating back to the cartoons in Figure 1 to summarize what neurons the authors think are necessary for bitter avoidance.

      We very much appreciate this suggestion and have increased clarity by referring to the carton in Figures 1 and 2.

      1. Figure 4B - the lowercase letters indicating Gr28 subunits that are being expressed under UAS control (bottom row of table "UAS-Gr28") are easily confused for the lowercase letters a, b used throughout to signify significant differences. I recommend that the authors write out the gene names in this figure to clarify the genes in the rescue experiment.

      We changed the text in the Figure accordingly.

      1. For non-experts it would be helpful to have a map of the Gr28 gene locus so that people understand the arrangement of the genes and how the Gal4 driver lines map onto the locus.

      We have now included such a map in Figure 1B.

      Reviewer #2 (Recommendations For The Authors):

      1. In the title and multiple times in the text (e.g. lines 121-122), the authors make the claim that different Gr28 genes mediate opposing behaviors. At first, I was not convinced of this claim, but I now believe it may be warranted if integrating the present results with results from Mishra et al., 2018. In the present study, the authors show that different neurons drive opposing behaviors, but they did not show that the genes themselves mediate opposing behaviors. They show evidence for the role of Gr28bc and Gr28ba in aversion, but not the role of Gr28a in attraction. I was thinking that there could be other receptors in Gr28a-expressing neurons that mediate attraction. However, Mishra et al. showed that mutation of all Gr28 genes abolishes preference for RNA/ribose as well as detection of these compounds by Gr28a+ neurons of the terminal organ, an impairment that could be rescued by expressing Gr28a (although Gr28b genes seem to have similar functions), and the present study shows that the other Gr28 genes are not co-expressed with Gr28a in the terminal organ. Is this the line of reasoning that we must take to come to the conclusion in the title? If so, I don't believe it comes through clearly in the paper.

      We appreciate this observation. We have modified language in the abstract and the introduction to reflect previous reports of Gr28a as an RNA/ribose receptor (Mishra et al., 2018) and its conversation across dipteran insects (Fujii et al., 2023) where we showed that appetitive behavior for RNA can be mediated via the mosquito homologs in transgenic Drosophila larvae. The reviewer is correct in that there are other appetitive neurons, namely those expressing Gr43a, which defines a set distinct from and non-overlapping with Gr28a neurons (Mishra 2018). This additional information is included in the Figure 1, summarizing expression of the Gr28 genes, Gr66a and Gr43a.

      1. The Figure 6 schematic does not show Gr66a+ Gr28- cells as being connected to avoidance behavior. This seems misleading because it seems likely that these cells do promote avoidance (based on known functions of other Gr66a cells). Also, it is not clear what the red dashed line represents.

      The Gr66a neurons are indeed also avoidance mediating, but it is not clear which subgroup of these neurons is necessary. Our analysis in Figure 2 using Gr28b.c driving Kir2.1 suggests that a small subset of Gr66a neurons is sufficient to mediate avoidance. It is, however, possible that other subsets not including Gr28b.c can also mediate avoidance. The figure has been modified accordingly, as has the model in Figure 7.

      1. I would suggest including the description of Figures 7-8 in the Results instead of the Discussion. In Figure 8, it would be helpful to superimpose labels for the transmembrane domains and extracellular/intracellular sides to better interpret the models.

      The modeling was removed from the manuscript (see response above to reviewer 1).

      1. The finding that Gr66a mutants show increased denatonium and quinine avoidance (Figure 4 - figure supplement 1) seems like a non sequitur, as it does not relate to the analysis of Gr28 genes. I support the inclusion of these interesting results, but perhaps it could be stated why this experiment was conducted (e.g. as a positive control).

      We have reworded this section to make clear why Gr66a mutants were tested (possibly being part of a denatonium receptor complex).

      1. An introduction to the nomenclature and gene structure for the Gr28 genes would be helpful. It's not clear how they're all related, e.g. that the Gr28b genes share some exons whereas Gr28a is separate. The Results section alludes to "the high level of similarity between these receptors", and some sort of reference or quantification for this statement would be useful. I also think naming the Gr28b genes with a period (e.g. "Gr28b.c") may be more consistent with the literature.

      We have added the structure of the Gr28 genes in the Figure 1B, which was also a suggestion by reviewer 1, and we have amended the naming of the genes.

      1. Lines 79-80 state "some GRNs express members of both families", but no citation is provided.

      As this sentence was deleted, based on a comment by reviewer 1, this point becomes mute.

      1. There are several typos or grammatical mistakes that the authors may wish to correct (e.g. lines 73, 75, 91, 232, 334, 780, 788).

      We appreciate the reviewer pointing these errors out to us. The mistakes were corrected.

      Reviewer #3 (Recommendations For The Authors):

      • Silencing experiments suggest a role for Gr28bc in the avoidance of quinine (Figure 3), while imaging experiments do not support this role (Figure 5G). An explanation is needed to reconcile these findings.

      The imaging experiments do support a role for Gr28b proteins in quinine detection in the specific TOG GRN used for all live imaging (Figure 5). This GRN in DGr28 larvae has a significantly lower Ca2+ responses to quinine compared to controls. However, the Ca2+ response could not be rescued to wild type levels by supplementing single Gr28b subunits, suggesting multiple Gr28b proteins are present in a quinine specific receptor complex in this GRN. Also note that Ca2+ responses of DGr28 larvae to quinine is not completely abolished, suggesting some redundancy, possible via Gr33a (Apostolopoulou et al., 2014), also supported by DGr28 larvae, which have still a robust avoidance to quinine. We are confident we have been clearer in arguing this point, both the result and especially the discussion section.

      • Silencing experiments specifically targeted neurons expressing Gr28bc and Gr28be (Figure 3). It is important to note why other neurons expressing different members of the Gr28 family were not included in this analysis.

      • Inconsistency is observed in the use of different reagents across the experiments. Specifically, all six Gal4 lines were utilized in the Chemical Activation experiments, while only two lines were employed in the silencing experiments.

      The silencing experiments asked the specific questions as to what neurons are necessary for avoidance of bitter chemicals. Gr28a-GAL4 and Gr28b.a-GAL4 neurons were omitted because the former mediate feeding preference and not avoidance, and the latter is expressed in the same neurons as Gr28b.e (Figure 1). The remaining two Gr28b genes, Gr28b.b-GAL4 and Gr28b.d-GAL4 are not expressed in the larval taste system (Mishra et al., 2018) as we stated in the introduction/result section, and they were therefore not included in the chemogenetic or Kir2.1 inactivation experiments. We included these genes in rescue experiments, simply to test whether or not they can restore function for sensing denatonium.

      As for the chemogenetic activation experiments: two of the GAL4 lines are controls (Gr66a-GAL4 and Gr43GAL4), that were needed to show what can be expected from these experiments.

      • The authors did not acknowledge that neurons expressing members of the GR28 family also express other Gr family members, which could potentially contribute to the detection and behavioral responses to the tested bitter compounds.

      We believe we did, but we have made that much more explicit in the revised manuscript.

      • Gal4 lines from various studies exhibit varying expression patterns, highlighting the necessity for improved reagents. These findings also suggest the importance of employing different Gal4 lines for each receptor to validate the results of the current study.

      See response at the beginning of our rebuttal.

      • Activating or silencing neurons pertains to the function of the neurons rather than the receptors.

      We agree and nothing in the manuscript states otherwise.

    1. Author Response

      The following is the authors’ response to the original reviews.

      REPLIES TO REVIEWERS

      For instance, The DynaMut2 and thermal shift assays point towards less stable variants than wild type, with Tm values slightly lower. On the other hand, the Kd value of variants reported stronger binding of NSP10 with NSP16. How do authors explain this, as the change due to point mutation may not fall within error range?

      Concerning the lower Tm values for the mutants compared to wild type NSP10, the errors of the measurements conducted in triplicate are very low (0.1 degrees) indicating that they do not fall into the error range, in particular as the changes in Tm are significant with changes of up to 4 degrees. This is consistent with the DynaMut23 calculations. Furthermore, the differences in Kd values between wild type and mutants are partially significant. Whereas one of the mutants did not display any changes in Kd value. Compared to wild-type NSP10 for both NSP14 and NSP16, the other show a 2 to 3 fold better Kd, with reasonable errors and we consider those as small but significant, and not within error range.

      For instance, the conformational ensemble could be utilized for docking with NSP16 and NSP14. There could be a potential alternative pathway for explaining the above changes in Kd. This should be attempted for understanding the role in its functional activity.

      We agree with the reviewer. We are working on a follow up manuscript exclusively looking into the NSP10-NSP14/16 interfacial interactions. Our preliminary results from biophysical and biochemical analysis suggests a range of Kd values observed between the mutants and the NSP14/NSP16. We are also investigating changes in the interfacial interactions via crystallography.

      Therefore, more quantitative analysis is required to explain structural changes. The free energy landscape reported in the paper may not capture rare transition events or slight rearrangements in side chain dynamics, both these could offer better understanding of mutations.

      We agree with the point raised by the reviewer. As mentioned above, we are exclusively looking into these interfacial interactions and binding between different partners, which will be reported in a follow up manuscript.

      Recommendations for the authors: please note that you control which, if any, revisions, to undertake

      1. Line 206, V104 need to be corrected to A104.

      done

      1. Line333, does it mean the Kd value of NSP10 binding to NSP16 similar to the Kd value of binding to NSP14?

      Yes. Overall, they are in about the same range with a Kd value of around 1 µM for the NSP10-NSP16 complex and 4 µM for the NSP10-NSP14 complex.

      1. Figure 3, the colors corresponding to different variants or native NSP10 could be consistent for easier reading and understanding.

      The colors have been edited.

      1. The data presented in Figure 3d are not clear enough to draw conclusions about the Kd Value in the main text.(Values of variants are smaller than that of wild-type NSP10, indicating a slightly stronger binding to NSP16)

      The measured differences are small with 2 to 3 fold differences, but significant and are not within the error range as can be derived from the data and calculated Kd values and their errors.

      1. Are there other mutations in the sequence with the top 3 mutations? If yes, is it possible to do the same experiments with that protein? Why not choose the NSP10 of the popular strain for the determination of the binding ability to NSP14 and NSP16.

      No, the top three were single point mutations.

      1. Enzyme activity assays like ExoN activity detection of NSP14 and vitro activity detection of NSP16 2′-O-MTase could be performed to characterize the effect of these three mutations on biological function.

      Yes, it would be good to consider these. We are considering these assays in the follow up manuscript as mentioned above.

      1. More details on image acquisition and writing errors need to be clarified and corrected.

      Done.

      1. Typo in Results section T12, T102, V104 should be A104

      Done.

      1. DynaMut analysis is extrapolated to explain that "Mutation to a hydrophobic side chain such as Ile, results in a loss of this interaction." There is no data to support this as complexes have not been studied. Perhaps this is speculative at best.

      We have changed this sentence to “Mutation to a hydrophobic side chain such as Ile, is predicted to result in the loss of this interaction”, since this was a prediction

    1. Author Response

      The following is the authors’ response to the original reviews.

      Public Reviews:

      Reviewer #1 (Public Review):

      Summary: Hansen et al. dissect the molecular mechanisms of bacterial ice nucleating proteins mutating the protein systematically. They assay the ice nucleating ability for variants changing the R-coils as well as the coil capping motifs. The ice nucleation mechanism depends on the integrity of the R-coils, without which the multimerization and formation of fibrils are disrupted.

      Strengths: The effects of mutations are really dramatic, so there is no doubt about the effect. The variants tested are logical and progressively advance the story. The authors identify an underlying mechanism involving multimerization, which is plausible and compatible with EM data. The model is further shown to work in cells by tomography.

      Weaknesses: The theoretical model presented for how the proteins assemble into fibrils is simple, but not supported by much data.

      Agreed. This theoretical INP multimer model was introduced to promote discussion and elicit ideas on how to prove or disprove it. The length and width of the fibres are defined by cryo-ET results, in which the narrow width is just sufficient to accommodate a dimer of the INPs, and the long length requires that several INPs are joined end to end. Their antiparallel arrangement produces identical ends to the dimer and avoids steric clash of the C-terminal cap structures as well as the C-terminal GFP tag. This model can accommodate the wide range of INPs lengths seen in nature (due to different numbers of water-organizing coils) and introduced in mutagenesis experiments (Forbes et al. 2022). It defines a critical role for the R-coil subdomain in joining the dimers together and explains why this region cannot be shortened by more than a few coils either in nature or by experimentation.

      In response to specific criticisms of the model (Fig. 9), we have redesigned this to be less schematic and to incorporate several copies of the AlphaFold-predicted structure.

      Reviewer #2 (Public Review):

      Summary:

      This paper further investigates the role of self-assembly of ice-binding bacterial proteins in promoting ice-nucleation. For the P. borealis Ice Nucleating Protein (PbINP) studied here, earlier work had already determined clearly distinct roles for different subdomains of the protein in determining activity. Key players are the water-organizing loops (WO-loops) of the central beta-solenoid structure and a set of non-water-organizing C-terminal loops, called the R-loops in view of characteristically located arginines. Previous mutation studies (using nucleation activity as a read-out) had already suggested the R-loops interact with the WO loops, to cause self-assembly of PbINP, which in turn was thought to lead to enhanced ice-nucleating activity. In this paper, the activities of additional mutants are studied, and a bioinformatics analysis on the statistics of the number of WO- and R-loops is presented for a wide range of bacterial ice-nucleating proteins, and additional electron-microscopy results are presented on fibrils formed by the non-mutated PbINP in E coli lysates.

      Strengths:

      -A very complete set of additional mutants is investigated to further strengthen the earlier hypothesis.

      -A nice bioinformatics analysis that underscores that the hypothesis should apply not only to PbINP but to a wide range of (related) bacterial ice-nucleating proteins.

      -Convincing data that PbINP overexpressed in E coli forms fibrils (electron microscopy on E coli lysates).

      Weaknesses:

      -The new data is interesting and further strengthens the hypotheses put forward in the earlier work. However, just as in the earlier work, the proof for the link between self-assembly and ice-nucleation remains indirect. Assembly into fibrils is shown for E coli lysates expressing non-mutated pbINP, hence it is indeed clear that pbINP self-associates. It is not shown however that the mutations that lead to loss of ice-nucleating activity also lead to loss of self-assembly. A more quantitative or additional self-assembly assay could shine light on this, either in the present or in future studies.

      The control cryo-ET experiment where the R-coils were deleted and INP fibres were not seen is consistent with a link between the loss of ice-nucleating activity and the loss of self-assembly. However, we agree that a more direct measurement of the physical state of INP molecules is needed to prove the link.

      -Also the "working model" for the self-assembly of the fibers remains not more than that, just as in the earlier papers, since the mutation-activity relationship does not contain enough information to build a good structural model. Again, a better model would require different kinds of experiments, that yield more detailed structural data on the fibrils.

      Reviewer #1 also raised these criticisms of the model, which we have responded to (above). Testing the model is a focus of our continuing experiments on INPs.

      Reviewer #3 (Public Review):

      Summary: in this manuscript, Hansen and co-authors investigated the role of R-coils in the multimerization and ice nucleation activity of PbINP, an ice nucleation protein identified in Pseudomonas borealis. The results of this work suggest that the length, localization, and amino acid composition of R-coils are crucial for the formation of PbINP multimers.

      Strengths: The authors use a rational mutagenesis approach to identify the role of the length, localisation, and amino acid composition of R-coils in ice nucleation activity. Based on these results, the authors hypothesize a multimerization model. Overall, this is a multidisciplinary work that provides new insights into the molecular mechanisms underlying ice nucleation activity.

      Weaknesses: Several parts of the work appear cryptic and unsuitable for non-expert readers. The results of this work should be better described and presented.

      In revising the manuscript for reposting we have rewritten sections to make it more accessible to the non-expert. Incorporating the detailed recommendations of the reviewers has been helpful in this effort.

      Recommendations for the authors: please note that you control which revisions to undertake from the public reviews and recommendations for the authors

      Reviewer #1 (Recommendations For The Authors):

      Introduction: Curiously, there is no mention at all in the introduction of what the biological function of these ice-nucleating proteins is.

      We added the following text to the first paragraph of the Introduction: ”INP-producing bacteria are widespread in the environment where they are responsible for initiating frost (4) and atmospheric precipitation (5). As such, these bacteria play a significant role in the Earth’s hydrological cycle and in agricultural productivity.”

      Line 70: TXT, SLT, and Y motifs are mentioned, but only the first is described. Also, TXT name alternates between TXT and TxT in the manuscript. (I think the latter is more correct).

      These putative water-organizing motifs are introduced in the preceding paper (new ref 8). We now use TxT consistently throughout the manuscript and have converted SLT to SxT because L is an inward-pointing residue that is not directly involved in water organization.

      Line 236: A construct with repeats deleted is tested for thermostability, but it is not really explained what hypothesis this experiment is supposed to test.

      This is an observation that adds information about the stability of the INP multimers and will need to be explained by the structure.

      Line 267: The authors test a mutant where the N-terminal coil is disrupted and find a big effect. Nevertheless, no conclusion is drawn. What does this result mean?

      On the contrary, INP activity is not appreciably affected by N-terminal deletion.

      Line 269: The CryoEM begins rather abruptly with technical details. Consider introducing the paragraph with a brief statement about what you want to investigate. Also, the analysis seems a little half-hearted.

      Given that the authors describe other EM studies of fibrils of the same protein it would be nice with a clear statement about what is new in their study and how it compares to previous studies.

      We have added this statement about why we used Cryo-EM: “The idea that INPs must assemble into larger structures to be effective at ice nucleation has persisted since their discovery (6). In the interim the resolving power of cryo-EM has immensely improved. Here we elected to use cryo-electron tomography to view the INP multimers in situ and avoid any perturbation of their superstructure during isolation.”

      Fig. 7B: Single-letter amino acid codes are always capitalized.

      We have revised this figure to use capital letters for the amino acids.

      Fig. 9: This figure is really hard to read even though it is very simplistic. I would consider making a figure with several copies of the AlphaFold model instead. Especially panel D, I do not know what is supposed to show.

      We have followed this advice and have completely revised the figure using copies of the AlphaFold model. Panel D (now C) shows two cross-sections through the AlphaFold model.

      Line 355 onwards: The model of the INP is the weakest part of the manuscript. This reviewer considers that the model is crude and it is unclear what information the model is supported by. The authors might want to consider running an AlphaFold multimer to get a better model of at least the dimer.

      Our objective now is to validate or disprove the model by experimentation using protein-protein cross-linking in conjunction with mass spectrometry, and higher resolution cryo-EM methods.

      Reviewer #2 (Recommendations For The Authors):

      I would suggest more frankly discussing the weaknesses mentioned in my public review, as well as approaches that could be used in the future to address these.

      In the cryo-ET analysis, INP mutations of the R-coils that lead to loss of ice-nucleating activity fail to show fibres in the bacteria (Fig. S4), which is consistent with the loss of self-assembly. We are working on physical methods that can assess the degree of assembly of the different INP constructs and mutations. We are working to validate and improve the working model of INP multimers.

      Reviewer #3 (Recommendations For The Authors):

      Abstract

      Line 18. Below 0 Celsius should be < 0 {degree sign}C.

      Done

      Line 25. E. coli should be Escherichia coli

      Done

      Line 29. E. coli should be in italics.

      Done

      Introduction

      The introduction is weak and not suitable for non-expert readers. Moreover, in some parts it is cryptic and it is not clear whether the authors are describing INP in general or PbINP. The introduction should be reorganized to highlight the novelty of this paper compared to Forbes et al. 2022.

      The changes we have made to the Introduction can be seen in the ‘documents compared’ version where the changes are tracked.

      Line 45. It is unclear whether this paragraph is a result reported in the literature or the result of this work. Please clarify.

      These are results reported in the literature as indicated by the references cited in the paragraph.

      Line 54. It is not clear whether this paragraph describes PbINP or INP in general.

      This paragraph begins with INPs in general and then focuses on PbINP.

      Results

      Line 109. This section would benefit from a paragraph in which the authors describe the rationale for this bioinformatic analysis.

      We added the following Statement: “A bioinformatic analysis of bacterial INPs was undertaken to identify their variations in size and sequence to understand what is common to all that could guide experiments to probe higher order structure and help develop a collective model of the INP multimer.”

      Some information is needed on the selected sequences such as sequence identity, what do the authors mean by nr database?

      The abbreviation nr has been replaced by ‘non-redundant’. As explained in that same paragraph the sequences selected were those from long-read sequences that could be relied on to accurately count the number of solenoid coils.

      Line 144. The standard deviation is necessary to understand whether these differences are statistically significant.

      These have been added as p values.

      Figure 2. I noticed that the authors used GFP-tagged PbINP. Why? In addition, panel C is never mentioned in the manuscript.

      The GFP tag was used to confirm expression of the PbINP in E. coli. We have added this sentence: “As previously described these constructs were tagged with GFP as an internal control for INP production, and its addition had no measured effect on ice nucleation activity (8).”The GFP tag was also useful as in internal control for the heat denaturation experiments featured in Fig. 6, where it lost its fluorescence between 65 and 75 °C.

      Fig. 2C is now cited alongside Fig. 2B.

      Figure 3. In my opinion, the results of the R-coil deletion should also be shown in Figure 2. Line 171. This section is cryptic. A logo sequence or an alignment of WO-coils and R-coils of PbINP could be helpful for the reader. Instead of the architecture of the whole protein, it would be useful to have the sequence of the R-coils with the residues that the authors mutagenised.

      The logo sequences are available in Fig. 1.

      Line 202. Here, the authors describe a new experimental setup. As the Materials and Methods section follows the Discussion, the authors should state in the first paragraph of the Results section that IN activity was measured on whole cells.

      We have now modified the introductory sentence to read: “Ice nucleation assays were performed on intact E. coli expressing PbINP to assess the activity of the incremental replacement mutants.”

      Line 202. The authors investigated the effects of pH and temperature (Line 223) on the IN activity. The authors should better introduce the rationale for these experiments and how they fit within the work.

      We have now modified the following sentence to provide the rationale: “To see how important electrostatic interactions were in the multimerization of PbINP as reflected by its ice nucleation activity, it was necessary to lyse the E. coli to change the pH surrounding the INP multimers.”

      Line 245. This work is supported by a model provided by Alphafold. I wonder how reliable this model is; the authors should indicate the quality of the model and provide the accuracy values of the residuals.

      This information is now provided in Figure S1.

      Line 259. Typically in mutagenesis studies, a key residue is substituted with alanine to create a loss of function variant. In this case, the authors have made the following substitutions F1204D, D1208L, and Y1230D, it is not clear to me why the authors have replaced an aromatic residue with one of aspartic acid that is negatively charged.

      We have justified these more extreme changes as follows: “For an enhanced effect of the mutations hydrophobic residues were replaced with charged ones and vice versa.”

      Line 269. This paragraph seems completely unrelated to the section entitled: The β-solenoid of INPs is stabilized by a capping structure at the C terminus, but not at the N terminus.

      We had omitted the sub-heading “Cryo-electron tomography reveals INPs multimers form bundled fibres in recombinant cells”, which is now in place.

      Discussion

      Overall, the discussion is too long and some parts appear cryptic, this section should be reorganized.

      The changes we have made to the Discussion can be seen in the ‘documents compared’ version where the changes are tracked.

      Line 354. It is not clear what experimental evidence supports this model. In the results, this model is never mentioned and it is not clear whether it was obtained by computational analysis or not.

      The model is presented in the Discussion because it was not arrived at by experimentation but is an attempt to integrate the observations made in the Results section. The experimental evidence that supports this model is reviewed in the Discussion section: “Working model of the INP multimer is consistent with the properties of INPs and their multimers.”

      Line 354. The authors used GFP-tagged PbINP. The Authors should discuss the role of GFP in this model and IN activity. A measurement of IN activity on PbINP without GFP would be useful.

      We have previously shown in Ref 8 that the GFP tag has no detrimental effect on ice nucleation activity. Our model for the INP multimer can accommodate this C-terminal tag without any steric hindrance.

      Line 364. The Authors hypothesize that electrostatic interactions stabilize end-to-end dimer associations. To test this hypothesis, the authors should measure the activity of IN at increasing concentrations of NaCl. It is known that high salt concentrations shield charges by preventing the formation of electrostatic intermolecular interactions.

      We have added this sentence to the Discussion: “Another useful test of the electrostatic component to the multimer model would be to study the effects of increasing salt concentration on ice nucleation activity of the E. coli extracts.”

      Line 439. Conclusions should be useful for the reader.

      Material and Methods

      In several sections, the authors refer to what has already been published in Forbes et al. However, the minimum information should also be described in this work. In addition, the Authors should indicate the number of replicates.

      The ice nucleation assays on whole cells were done on the WISDOM apparatus, which integrates 100’s of individual measurements to obtain a T50 value. These T50 values were confirmed by assays on the nanoliter osmometer apparatus. The numbers of replicates used on the nanoliter osmometer apparatus are indicated by box and whisker plots in Figs. 5 & 6 with boxes and bars showing quartiles, with medians indicated by a centre line.

      Line 500. This paragraph should be removed as the results are not described in the manuscript.

      This is a Methods section that describes how that INPs were expression in E. coli. It has details that are important for researchers who want to repeat our findings, such as the use of the Arctic Express strain for producing INP.

    1. Author Response

      The following is the authors’ response to the original reviews.

      Thank you for the e-mail of 27th September that includes the eLife assessment and reviewers comments on manuscript eLife-RP-RA-2023-91861. We have considered these, added additional data and made various changes to the text as detailed below. We now submit a modified version that we would be happy to view as the ‘Version of Record’.

      We are very pleased to note the highly positive reports from the reviewers. The major change we have made is to alter the Introduction to include further consideration of the development of the ‘bar-code’ hypothesis. As highlighted by reviewer 2 the Lefkowitz/Duke University Group have been major proponents of this concept. However, as with many topics their views did not emerge in isolation. Indeed we (specifically Tobin) were developing similar ideas in the same period (see Tobin et al., (2008) Trends Pharmacol Sci 29, 413-420). Moreover, other groups, particularly that of Clark and collaborators at University of Texas, were developing similar ideas using the beta2-adrenoceptor as a model at least as early as this (e.g. Tran et al., (2004) Mol Pharmacol 65, 196-206). As such we have re-written parts of the Introduction to reflect these early studies whilst retaining information on more recent studies that have greatly expanded such early work. This has resulted in the addition of extra references and re-numbering of the Reference section. We have also provided statistical analysis of agonist-induced arrestin interactions with the receptor as requested by a reviewer and performed additional studies to assess the effect of the GRK2/3 inhibitor in agonist-regulation of phosphorylation of the hFFA2-DREADD receptor. This has led to an additional author (Aisha M. Abdelmalik) being added to the paper.

      To address first the ‘public reviews’

      Reviewer 1

      1. We agree that we do not at this point explore the implications of the tissue specific barcoding we observe and report. However, as noted by the reviewer these will be studies for the future.

      2. The question of why these are only 2 widely expressed arrestins and very many GPCRs is not one we attempt to address here and groups using various arrestin ‘conformation’ sensors are probably much better placed to do so than we are.

      Reviewer 2

      1. It is difficult to address the potential low level of ‘background’ staining in some of the immunocytochemical images versus the ‘cleaner’ background in some of the immunoblotting images. The methods and techniques used are very distinct. However, it should be apparent that the immunoblotting studies are performed (both using cell lines and tissues) post-immunoprecipitation and this is likely to reduce such background to a minimum. This is obviously not the case in the immunocytochemical studies. It is also likely, even though the antisera are immune-selected against the peptide target, there may be some level of immune-recognition this is not limited to the phosphorylated residues.

      2. Whilst this reviewer has commented in detail in the ‘recommendations’ section on the use of English, the other reviewers have not, and we do not find the manuscript challenging to follow or read.

      Reviewer 3

      1. We agree that the mass-spectrometry presented is not quantitative. The intention was for the mass spec to be a guide for the development of the antisera used in the study. We have re-written the initial part of the Results section (page 7) to state that phosphorylation of Ser297 was evident in the basal and agonist-stimulated receptor whilst phosphorylation of Ser296 was only evident following agonist addition.

      2. Immunoblotting is intrinsically variable as parameters of antiserum titre in re-used samples is not assessed and although we are aware that FFA2 displays a degree of constitutive activity (see for example Hudson et al., (2012) J Biol Chem. 287(49):41195-209) we did not make any specific effort to supress this by, for example, including an inverse agonist ligand. Agonist-regulation of phosphorylation of the receptor, as detected in cell lines by the anti- pThr306/pThr310antiserum, is exceptionally clear cut in all the images displayed, and as we note for the pSer296/pSer297 antiserum this was always, in part, agonist-independent.

      The point about compound 101 not being tested directly in the immunoblotting studies performed on the cell line-expressed receptor is a good one. We have now performed such studies which are shown as Figure 2E. These illustrate that the GRK2/3 inhibitor compound 101 does not reduce substantially agonist-induced phosphorylation of the receptor at least as detected by the pThr306/pThr310antiserum or by the pSer296/pSer297 antiserum. Equally this compound had little effect on recognition of the receptor. As the PD2 mutations which correspond to the targets for the pThr306/pThr310antiserum have no significant effect on recruitment of arrestin 3 in response to MOMBA (please see additional statistical analysis in modified Figure 2C) this is perhaps not surprising. Moreover, the PD1 mutations that correspond to the pSer296/pSer297antiserum also, in isolation, only have a partial effect of MOMBA-induced interactions with arrestin 3.

      1. The use of phosphatase inhibitors is an integral part of these studies. As noted in Materials we used PhosSTOP (Roche, 4906837001). However, we failed to make it sufficiently clear that this reagent was present throughput sample preparation for both cell lines and tissue studies. This had been specified previously by two of us (SS, FN, see Fritzwanker S, Nagel F, Kliewer A, Stammer V, Schulz S. In situ visualization of opioid and cannabinoid drug effects using phosphosite-specific GPCR antibodies. Commun Biol. 6, 419 (2023)) but we agree this was insufficient and we now correct this oversight by making this explicit in Results.

      Recommendations

      Reviewer 1

      Competing interest: We apologise for this typographic error. It is now corrected.

      Figures: We have upgraded the figure images to 300dpi and this markedly improves readability

      Reviewer 2

      Revisiting writing: We thank the reviewer for their assessment of the text. However, we do not feel that ‘every sentence in the entire manuscript could be clarified’ is a reasonable statement. Neither of the other reviewers commented on this. Each of the authors read and approved the manuscript.

      Figures: see response to Reviewer 1. We have greatly enhanced image quality at this part of the process.

      Statistics on Figure 2: We apologise for this oversight. Although there were no significant differences in potency for MOMBA to promote interactions with arrestin-3 to each of the PD mutants versus wild type receptor, there were in terms of maximal effect. Statistical analysis was performed via one-way ANOVA followed by Dunnett’s multiple comparisons test. This is now detailed directly in Figure 2C and its associated legend. As noted by the reviewer there was indeed a highly significant effect of the GRK2/3 inhibitor compound 101 and this is now also noted in Figure 2D and its associated legend.

      Units on page 9: pEC50 is considered as Molar by default but we have now specified this. PD1-4: It would be cumbersome to write out (and to read) 8 mutations that make up PD1-4 and hence we think this is specified appropriately in the Figure.

      Reviewer 3

      1. Mass spec: Please see comment point 1 to reviewer 3.

      2. Immunoblotting and compound 101: We have done so.

      3. Phosphatase inhibition: see public comments, reviewer 3.

    1. Author Response

      The following is the authors’ response to the original reviews.

      We are grateful to all the reviewers for their thoughtful comments and the efforts they put into reviewing our manuscript. These are highly positive and constructive reviews. Thank you! We have updated our manuscript to include further discussion of several important points (as suggested by reviewers) and addressed reviewer suggestions individually below.

      Reviewer #1 (Public Review):

      This remarkable and creative study from the Asbury lab examines the extent to which mechanical coupling can coordinate the growth of two microtubules attached to isolated kinetochores. The concept of mechanical coupling in kinetochores was proposed in the mid-1990s and makes sense intuitively (as shown in Fig. 1B). But intuitive concepts still need experimental validation, which this study at long last provides. The experiments described in this paper will serve as a foundation for the transition of an intuitive concept into a robust, quantitative, and validated model.

      The introduction cites at least 5 papers that proposed mechanical coupling in kinetochores, as well as 5 theoretical studies on mechanical coupling within microtubule bundles, so it's clear that this manuscript will be of considerable interest to the field. The intro is very well written (as is the manuscript in general), but I recommend that the authors include a brief review of the variable size of k-fibers across species, to help the reader contextualize the problem.

      We agree with the reviewer’s suggestion and have added a brief review of variable k-fiber sizes to the Introduction section (lines 30-35).

      For example, budding yeast kinetochores are built around a single microtubule (Winey 1995), so mechanical coupling is not relevant for this species.

      Indeed, the use of yeast kinetochores to study mechanical coupling is an odd fit, because these structures did not evolve to support such coupling. There is no doubt that yeast kinetochores are useful for demonstrating mechanical coupling and for measuring the stiffnesses necessary to achieve coupling, but I recommend that the authors include a caveat somewhere in the manuscript, perhaps in the place where they discuss their use of simple elastic coupling as compared to viscoelastic coupling or strain-stiffening. It's easy to imagine that kinetochores with large k-fibers might require complex coupling mechanisms, for example.

      Even though yeast kinetochores are built around single microtubules, mechanical coupling has still been proposed to help coordinate the dynamics of sister kinetochores in yeast (Gardner et al. 2005, see main text for full reference). We have added this important point to the Introduction section of the manuscript (lines 33-35). The microtubules attached to sister kinetochores are oriented oppositely to one another, in an anti-parallel arrangement that differs from the parallel arrangement we studied here. Nevertheless, it seems likely to us that coordination of anti-parallel microtubule growth between the single microtubules attached to sister kinetochores in yeast relies at least partly on mechanical coupling. One of the many ways we foresee our dual-trap assay being useful in the future is to test how anti-parallel microtubule growth and shortening can be coordinated via mechanical coupling. Of course, since kinetochores can change the dynamics of their attached microtubules (Umbreit et al., 2012, “The Ndc80 kinetochore complex directly modulates microtubule dynamics”), the kinetochores from different species may have also evolved unique mechanisms of modifying microtubule tension-dependent dynamics to achieve coordination of their attached microtubules. Thus far, in vitro reconstitutions using kinetochore assemblies from metazoans have not yet achieved the coupling stability that we routinely achieve with isolated yeast kinetochores. As reconstitutions with kinetochores from other species improve, it will be very interesting to test for species-specific differences in how the kinetochores influence microtubule dynamics and in how effectively they can coordinate microtubules via mechanical coupling.

      We note that the (visco)elastic properties of yeast kinetochores, and their relative simplicity compared to other kinetochores, shouldn’t significantly affect our primary experimental results. Yeast kinetochores are relatively small and the force on each bead changes very slowly in our experiments (see Figure S3-1 for examples), so the kinetochore’s change in length over time is very slow and very small. We have added this point to the Methods section of the manuscript (lines 479-484). We agree that mechanical coupling in species with large k-fibers might rely on more complex material properties, such as viscoelasticity or strain-stiffening. In principle, that type of complexity could be incorporated into our dual-trap experiments by altering the simulated linker. We view this as an interesting area for future study.

      And is mechanical coupling relevant for holocentric kinetochores like those found in C. elegans?

      This is a very interesting question. While holocentric kinetochores do not form k-fiber bundles (O’Toole et al., 2003, “Morphologically distinct microtubule ends in the mitotic centrosome of Caenorhabditis elegans” and Redemann et al., 2017, C. elegans chromosomes connect to centrosomes by anchoring into the spindle network), mechanical coupling could be even more important for them compared to monocentric kinetochores because tip-attached microtubules both near each other AND at opposite ends of the same chromosome must grow at similar enough rates to stay attached to the same chromosome. In C. elegans prometaphase, opposite chromosome ends move towards the same pole as the chromosome itself oscillates, suggesting that microtubule plus ends attached to the same chromosome are growing in the same direction at the same time (Maddox et al., 2004, ““Holo”er than thou: Chromosome segregation and kinetochore function in C. elegans”). Microtubules appear to stop growing or shortening after chromosome alignment is complete (Redemann et al., 2017), at which time the plus ends of kinetochore microtubules are in close proximity to the chromosome surface (O’Toole et al., 2003, Redemann et al., 2017). The tight clustering of kinetochore microtubule tips near the chromosome at metaphase, as well as the coordinated movement of chromosome arms preceding metaphase, suggests a high level of inter-microtubule coordination in the congression leading up to metaphase. We propose this coordination could be achieved by mechanical coupling through the kinetochore proteins on the surface of holocentric chromosomes and through the underlying chromosome itself.

      The paper shows considerable rigour in terms of experimental design, statistical analysis, and presentation of results. My only comment on this topic relates to the bandwidth of the dual-trap assay, which I recommend describing in the main text in addition to the methods. For example, the authors note that the stage position is updated at 50 Hz. The authors should clearly explain that this bandwidth is sufficiently fast relative to microtubule growth speeds.

      Thank you for this suggestion. We have added to the Results section (lines 131-133) that updating the stage position at 50 Hz is sufficient to maintain the desired force. We also modified the Methods section (lines 488-491) to clarify that the stage position is sampled at 200 Hz, which is more than sufficient to accurately show the growth variability present in dual-trap experiments.

      After describing their measurements, the authors use Monte Carlo simulations to show that pauses are essential to a quantitative explanation of their coupling data. Apparently, there is a history of theoretical approaches to coupling, as the introduction cites 5 theoretical studies. I would have appreciated it if the authors had engaged with this literature in the Results section, e.g. by describing which previous study most closely resembles their own and/or comparing and contrasting their approach with the previous work.

      Thank you for this excellent suggestion. We have added a brief comparison of our work to previous theoretical studies examining the role of mechanical coupling in k-fiber coordination to the Results section (lines 179-185).

      Overall, this paper is rigorous, creative, and thought-provoking. The unique experimental approach developed by the Asbury lab shows great promise, and I very much look forward to future iterations.

      Reviewer #2 (Public Review):

      Leeds et al. investigated the role of mechanical coupling in coordinating the growth kinetics of microtubules in kinetochore-fibers (k-fibers). The authors developed a dual optical-trap system to explore how constant load redistributed between a pair of microtubules depending on their growth state coordinates their growth.

      The main finding of the paper is that the duration and frequency of pausing events during individual microtubule growth are decreased when tension is applied at their tips via kinetochore particles coupled to optically trapped beads. However, the study does not offer any insight into the possible mechanism behind this dependency. For example, it is not clear whether this is a specific property of the kinetochore particles that were used in this experiment, whether it could be attributed to specific proteins in these particles, or if this could potentially be an inherent property of the microtubules themselves.

      We agree that the experiments described in our work do not distinguish between tension-dependence inherent to the microtubule itself and tension-dependence conferred by the kinetochore. We speculate about reasons why tension might disfavor pausing in paragraph 5 of the discussion (lines 356-366). Given that microtubule growth is suppressed by compression without the presence of kinetochores or other microtubule-associated proteins (Dogterom & Yurke, 1997, Janson et al., 2003, see main text for full reference), it seems plausible to us that tension-dependent dynamics, including pausing behaviors, might be inherent to microtubules. However, experiments with different tension-bearing plus-end couplers will be required to test this idea rigorously. We view this as an interesting area for future study.

      The authors simulate the coordination between two microtubules and show that by using the parameters of pausing and variability in growth rates both measured experimentally they can explain coordination between two microtubules measured in their experiments. This is a convincing result, but k-fibers typically have many more microtubules, and it seems important to understand how the ability to coordinate growth by this mechanism scales with the number of microtubules. It is not obvious whether this mechanism could explain the coordination of more than two microtubules.

      We wholeheartedly agree, it is of vital importance to understand how the coordination of growth via mechanical coupling scales with the number of microtubules. Indeed, we have already begun studying simulations of bundles of ten to twenty microtubules based on the pausing model developed in this paper. Simulated microtubule tips appear significantly limited when linked by mechanical couplers of similar stiffnesses to those used in the dual-trap assay, supporting the idea that mechanical coupling may be able to explain much of the coordination between microtubules in growing k-fiber bundles. We hope to use these simulations to continue exploring the degree to which mechanical coupling can coordinate k-fiber microtubules in future publications.

      The range of stiffnesses chosen to simulate the microtubule coupling allows linkers to stretch hundreds of nanometers linearly. However, most proteins including those at kinetochore must have finite size and therefore should behave more like worm-like chains rather than linear springs. This means they may appear soft for small elongations, but the force would increase rapidly once the length gets close to the contour length. How this more realistic description of mechanics might affect the conclusions of the work is not clear.

      While the worm-like chain is likely a better model for individual linker molecules, deformation of the underlying centromeric chromatin is also likely to be important, with viscoelastic properties that are still poorly understood. Rather than using a complicated (viscoelastic or worm-like-chain-based) model with many unconstrained parameters, we felt a simple model with a single stiffness parameter to characterize the coupling material was a better starting point, allowing a straightforward comparison between stiffer and softer coupling. In future work, simulations could be used to study the effects of strain-stiffening and viscoelasticity and ask if these effects might further improve (or degrade) the efficacy of mechanical coupling for coordinating kinetochore microtubules.

      The novel dual-bead assay is interesting. However, it only provides virtual coupling between two otherwise independently growing microtubules. Since the growth of one affects the growth of the other only via software, it is unclear whether the same insight can be gained from the single-bead setup, for example, by moving the bead at a constant speed and monitoring how microtubule growth adjusts to the fixed speed. The advantages of the double-bead setup could have been demonstrated better.

      Thank you for your suggestion to clarify the advantages of our dual-trap approach compared to single-trap experiments. We have added a paragraph to the Discussion section (lines 315-327) to explain the following points: In a real k-fiber bundle, each microtubule can dynamically adjust its growth speed to the current force being applied. In the same way, the dual-trap assay allows us to examine how both leading and lagging tips dynamically adjust to the other’s growth speed simultaneously. In addition, in our dual-trap assay each microtubule in the pair is grown at the same time relative to preparing the slide and comes from an identical batch of kinetochore-bead and tubulin-containing growth buffer. Any differences in growth speeds between paired microtubules can be attributed to intrinsic microtubule variability, rather than prep-to-prep or sample-to-sample differences in microtubule dynamics.

      Reviewer #3 (Public Review):

      Leeds et al. employ elegant in vitro experiments and sophisticated numerical modeling to investigate the ability of mechanical coupling to coordinate the growth of individual microtubules within microtubule bundles, specifically k-fibers. While individual microtubules naturally polymerize at varying rates, their growth must be tightly regulated to function as a cohesive unit during chromosome segregation. Although this coordination could potentially be achieved biochemically through selective binding of polymerases and depolymerases, the authors demonstrate, using a novel dual laser trap assay, that mechanical coupling alone can also coordinate the growth of in vitro microtubule pairs.

      By reanalyzing recordings of single microtubules growing under constant force (data from their own previous work), the authors investigate the stochastic kinetics of pausing and show that pausing is suppressed by tension. Using a constant shared load, the authors then show that filament growth is tightly coordinated when pairs of microtubules are mechanically coupled by a material with sufficient stiffness. In addition, the authors develop a theoretical model to describe both the natural variability and force dependence of growth, using no freely adjustable parameters. Simulations based on this model, which accounts for stochastic force-dependent pausing and intrinsic variability in microtubule growth rate, fit the dual-trap data well.

      Overall, this study illuminates the potential of mechanical coupling in coordinating microtubule growth and offers a framework for modeling k-fibers under shared loads. The research exhibits meticulous technical rigor and is presented with exceptional clarity. It provides compelling evidence that a minimal, reconstituted biological system can exhibit complex behavior. As it currently stands, the paper is highly informative and valuable to the field.

      To provide further clarity regarding the implications of their study, the authors may wish to address the following points in more detail:

      • Considering the authors' understanding of the quantitative relationship between forces, microtubule growth, and coordination, is the dual trap assay necessary to demonstrate this coordination? What advantages does the (semi)experimental system offer compared to a purely in silico treatment?

      Thank you for your suggestion to explain the advantages of our dual-trap approach compared to simulations based on previous recordings of individual microtubules growing under tension. We have added a paragraph about this to the Discussion section (lines 315-327). Previously we knew that a shared load should theoretically tend to coordinate a growing microtubule pair, but we did not know how well, nor did we know the degree of variability that would need to be overcome to achieve coordination. Moreover, there are myriad ways one could model the variability and force dependence in microtubule growth, but not all of them can successfully explain the tip separations we now measure between real microtubule pairs. For instance, our non-pausing model, although entirely derived from force-clamp data, had too much variability and too little coordination between microtubule pairs when we compared simulation results to our dual-trap measurements. Thus, the dual-trap assay allows us to test our assumptions about how variability in microtubule growth arises and how mechanical coupling affects it using real microtubules. Reviewer 2 likewise asked about the advantages of the dual-trap approach relative to single-trap experiments, and we suggest also examining our response to their comment above.

      • What are the limitations of studying a system comprising only two individual microtubules? How might the presence of crosslinkers, which are typically present in vivo between microtubules, influence their behavior in this context?

      This is a very interesting question. K-fiber microtubules in many organisms are subject to forces along their lattices from crosslinkers that attach them to each other and to other microtubules outside the k-fiber. Bridging fibers, for example, are pushed apart at the spindle equator by kinesin motors like Eg5, and are thought to maintain tension on k-fiber microtubule tips by sliding them towards the pole (Vukusic et al., 2017, “Microtubule Sliding within the Bridging Fiber Pushes Kinetochore Fibers Apart to Segregate Chromosomes"). Passive crosslinkers can also produce diffusion-like forces that drive microtubules to move relative to one another (although to our knowledge this has only been demonstrated with antiparallel microtubules—see Braun et al., 2017, “Changes in microtubule overlap length regulate kinesin-14-driven microtubule sliding”). Testing how these various lattice-based forces might affect k-fiber coordination is of great interest to us, but it is not easy to envision how it could be done in our dual-trap setup, where the two coupled microtubules only interact through mechanical forces and are biochemically isolated from one another (in separate assay chambers). Perhaps a clever new assay could be devised in the future to study the role of crosslinkers in combination with mechanical coupling on the coordination of growing microtubules in parallel.

      • How dependent are the results on the chosen segmentation algorithm? Can the distributions of pause and run durations truly be fitted by "simple" Gaussians, as indicated in Figure S5-2? Given the inherent limitations in accurately measuring short durations and the application of threshold durations, it is likely that the first bins in the histograms underestimate events. Cumulative plots could potentially address this issue.

      The qualitative trends of tension suppressing pause entrance and promoting pause exit seemed to be insensitive to the choices we made in our segmentation algorithm. We have added a paragraph to the Methods section (lines 558-569) to explain how other choices we tried (a smoothing window of 5 s compared to 2 s and a minimum event duration of 0.01 s compared to 1 s) had only mild effects on the measured force sensitivities but did not affect their signs. This suggests that while imposing a threshold duration almost certainly underestimates the number of shorter events, it does not substantially affect our overall conclusion that tension reduces the rate of pause entry, accelerates pause exit, and speeds assembly during the ‘runs’ between pauses.

      For segmenting each position-vs-time record into pause and run intervals, we fit the velocity distribution for each individual recording with a mixture of Gaussians. The distributions from some recordings fit quite well to a sum of Gaussians, while others did not fit as well. However, we found that the exact threshold used to separate runs from pauses (typically between 2 and 4 nm/s) had a surprisingly small effect on what the algorithm differentiated as a pause or a run. The segmentation algorithm and its performance on every record we analyzed can be directly viewed by downloading and running our force-clamp viewer, publicly available at https://doi.org/10.5061/dryad.6djh9w16v.

      Reviewer #2 (Recommendations For The Authors):

      In Figure 3a it would be helpful to see the traces of forces applied to individual microtubules. This would help to understand both, how the force is distributed between individual microtubules depending on their dynamic state and also to see the fluctuations of individual forces.

      We completely agree that understanding how force is distributed between microtubules in our dual-trap assay is both interesting and of great value. Although we decided not to include force vs time traces in the main figures, please refer to Figure S3-1, which shows the force-vs-time curves corresponding to the example position-vs-time traces displayed in Figure 3a, plus examples from two additional microtubule pairs.

    1. Author Response

      The following is the authors’ response to the original reviews.

      Reviewer #1 (Public Review):

      The paper offers some potentially interesting insight into the allosteric communication pathways of the CTFR protein. A mutation to this protein can cause cystic fibrosis and both synthetic and endogenous ligands exert allosteric control of the function of this pivotal enzyme. The current study utilizes Gaussian Network Models (GNMs) of various substrate and mutational states of CFTR to quantify and characterize the role of individual residues in contributing to two main quantities that the authors deem important for allostery: transfer entropy (TE) and cross correlation. I found the TE of the Apo system and the corresponding statistical analysis particularly compelling. I found it difficult, however, to assess the limitations of the chosen model (GNM) and thus the degree of confidence I should have in the results. This mainly stems from a lack of a proposed mechanism by which allostery is achieved in the protein. Proposing a mechanism and presenting logical alternatives in the introduction would greatly benefit this manuscript. It would also allow the authors to place the allosteric mechanism of this protein in the broader context of protein allostery.

      As detailed below, we went to great lengths to address these concerns, with an emphasis on the limitations of the model and a proposed mechanism. These revisions should hopefully warrant a re-evaluation of our manuscript.

      Reviewer #1 (Recommendations For The Authors):

      1. It would greatly benefit the paper to state a proposed mechanism by which allostery is achieved in this protein. Is this through ensemble selection, ensemble induction, or a purely dynamic mechanism? What is the rationale for choosing the proposed mechanism and what are reasonable alternative mechanisms? How does this mechanism fit in the broader context of protein allostery?

      Following this comment, we added a VERY extensive description of the proposed mechanism by which allostery is achieved in CFTR and present the rationale for choosing this mechanism (lines 445-97 and Figure 7). Briefly, based on previous experimental results and our results we propose that no single model can explain allostery in CFTR, and that its allosteric mechanism is a combination of induced fit, ensemble selection, and a dynamic mechanism.

      1. With a proposed mechanism in place, the choice of a GNM to investigate the mechanism and eliminate alternative mechanisms should be rationalized.

      The rational for choosing GNM (and ANM-LD) to study the proposed mechanism is now given in lines 498-510. Please note however, that as mentioned in the response to point 1 (and detailed in lines 445-97), the choice of allosteric mechanism, and ruling out other alternatives was not based solely on GNM and ANM-LD, but also on previous experimental results.

      1. A discussion of the strengths and limitations of the GNM are pivotal to understanding the limitations of the results shown. How sensitive are the results to specific details of the model(s)?

      a. A discussion of the strengths and limitations of the GNM have been added to the introduction. Please see lines 107-122.

      b. Sensitivity of the results to the specific details of GNM:

      GNM uses two parameters: the force constant of harmonic interactions and the cutoff distance within which the existence of the interactions is considered. The force constant is uniform for all interactions and is taken as unity. Its value affects only the absolute values of the fluctuations (i.e., their scale) but not their distribution. As we are only looking at fluctuations in relative terms our results are insensitive to its value. GNM uses a cutoff distance of 7-10 Å in which interactions are considered (10 Å used in this study). To test the sensitivity of the results to the cutoff distance we repeated the calculations using 7 Å. As now discussed in lines 170-73 and shown in Figure S2 the results remained largely unchanged.

      c. Sensitivity of the results to the specific details of TE: To identify cause-and-effect relations TE introduces a time delay (τ) between the movement of residues. The choice of τ is important: when τ is too small, only local cause-and-effect relations (between adjacent amino acids) will be revealed. if τ is too big, few (if any) cause-and-effect relations will manifest. This is analogous to the effects of a stone throne into a lake: look too soon, before the stone hits the water, and you’ll see no ripples. Look too late, the ripples will have already subsided. In a previous work (PMID 32320672), we studied in detail the effects of choosing different τ values and found that an optimal value of τ which maximizes the degree of collectivities of net TE values is in most cases 3× τopt (τopt is the time window in which the total TE of residues is maximized). Details of how τ was chosen were added to the methods section.

      In general, the limitations of the chosen model(s) is difficult to determine from the current manuscript because it is devoid of details of the model. While I understand that GNMs have been widely used to study protein systems, the specifics of the model are central to the current work and thus should be provided somewhere in the manuscript.

      a. As mentioned in our response above, the limitations of GNM are now presented (lines 107-122).

      b. The specifics of the model are now given in more detail in the methods section.

      c. In addition, as mentioned above, the results are largely independent of the values of the model’s parameters.

      b. Would changing the force constants to a more anisotropic model qualitatively change the results?

      a. GNM assumes isotropic fluctuations, and the calculations are based on this assumption. Therefore, GNM is inherently an isotropic model.

      b. Importantly, we complement the GNM-TE calculations with ANM-LD simulations, which predict the normal modes in 3D using an anisotropic network model.

      1. How repeatable is the difference between no ATP bound and ATP bound CFTR? I worry that the differences in TE in Figures 1 and 3A are mainly due to two different crystallization conditions. Is there evidence that two different structures of the same protein in the same ligand state lead to small changes in TE?

      To address this concern, we repeated the calculations using the structures of the ATP-free and bound forms of zebrafish CFTR. As now explained in text (lines 298-303) and shown in Figure S8 the effects of ATP are highly repeatable.

      1. Collective modes - why should we expect allostery to be in the most collective modes? Let alone the 10 most? Why not do a mode by mode analysis? Why, for example, were two modes removed page 9 first full paragraph?

      a. Collective modes: We have erroneously referred to the slow modes as collective modes. This has now been corrected throughout the manuscript.

      b. Let alone the 10 most?

      c. why should we expect allostery to be in the most collective modes? Residues that are allosterically coupled are expected to display correlated motions. The slow modes (formerly referred to as “collective modes”) are generally the most collective ones, i.e., display the greatest degree of concerted motions. We therefore expect these modes to contain the allosteric information.

      d. Furthermore, as now explained in the text (lines 163-69) and in Figure S1 the Eigenvalue decays of ATP-free and -bound CFTR demonstrate that the 10 slowest GNM modes sufficiently represent the entire dynamic spectrum (the distribution converges after the 10th slow mode).

      e. Why not do a mode by mode analysis? It is entirely possible to do a mode-by-mode analysis. However, our view is that the allosteric dynamics of a protein is best represented by an ensemble of modes, rather than by individual ones. We found (as detailed here PMID 32320672) that it is more informative to first use the complete set of modes that encompasses the dynamics (the 10 slowest modes in our case) and then gradually remove the dominant modes.

      f. As explained in text (lines 254-7) and more elaborately in our previous work (PMID 35644497), the large amplitude of the slowest modes may hide the presence of “faster” modes that may nevertheless be of functional importance. Removal of the 1-2 slowest modes often helps reveal such modes.

      g. Why, for example, were two modes removed page 9 first full paragraph? As explained for the ATP-free form (lines 257-60), removal of these two slowest modes allowed the “surfacing” of dynamic features which were hidden before. We propose that these dynamic features are functionally relevant (see lines 304-19). Removal of other modes did not provide additional insight.

      Minor issues:<br /> 1. Statements like "see shortly below" should be made more specific (or removed completely).

      Corrected as suggested

      1. "interfered" should be "inferred" page 10 middle of the first full paragraph

      Corrected as suggested

      1. End parenthesis after "(for an excellent explanation about the correlation between TE and allostery see (41)." Page 4 middle of first full paragraph

      Corrected as suggested

      Reviewer #2 (Public Review):

      In this study, the authors used ANM-LD and GNM-based Transfer Entropy to investigate the allosteric communications network of CFTR. The modeling results are validated with experimental observations. Key residues were identified as pivotal allosteric sources and transducers and may account for disease mutations.

      The paper is well written and the results are significant for understanding CFTR biology.

      Reviewer #2 (Recommendations For The Authors):

      Technical comments:

      p4 Please explain how is the time delay parameter tau chosen (ie. three times the optimum tau value...)? It seems this unknown time should depend on the separation between i and j. Is the TE result sensitive to the choice of tau? How does the choice of cutoff distance of GNM affect the TE result?

      a. The choice of τ is important: when τ is too small, only local cause-and-effect relations (between adjacent amino acids) will be revealed. if τ is too big, few (if any) cause-and-effect relations will manifest. This is analogous to the effects of a stone throne into a lake: look too soon, before the stone hits the water, and you’ll see no ripples. Look too late, the ripples will have already subsided. In a previous work (PMID 32320672), we studied in detail the effects of choosing different τ values and found that an optimal value of τ which maximizes the degree of collectivities of net TE values is in most cases 3× τopt (τopt is the time window in which the total TE of residues is maximized). Details of how τ was chosen were added to the methods section.

      b. To test the sensitivity of the results to the cutoff distance we repeated the calculations using 7 Å. As now discussed in lines 170-173 and shown in Figure S2 the results remained largely unchanged.

      It would be nice to directly validate the causal prediction by GNM-based TE. For example, is it in agreement with direct causal observation of MD simulation? If the dimer is too big for MD, perhaps MD is more feasible for the monomer (NBD1+TMD1).

      a. The causality we determined using GNM-based TE is in good agreement with conclusions drawn from single channel electrophysiological recordings and rate-equilibrium free-energy relationship analysis (Sorum et al; Cell 2015, and see lines 8691, and 364-70).

      b. To the best of our knowledge, causality relations in CFTR are yet to be determined by MD simulations (This is likely because the protein is too big and the conformational changes are very slow). We cannot therefore compare the causality.

      c. Conducting MD simulations on half of CFTR (NBD1+TMD1) is not likely to be very informative: the ATP binding sites are formed at the interface of NBD1 and NBD2, and the ion translocation pathway at the interface of the TMDs.

      p5 How are the TE peak positions different from other key positions as predicted by GNM, such as the hinge positions with minimal mobility of the dominant GNM modes?

      Following this comment, we compared the positions of the GNM-TE peaks and the hinge positions as determined by GNM. As now discussed in lines 173-178 and shown in Figure S3 we observed partial overlap which was nevertheless statistically significant (Figure S3).

      p7 How to select the 10 most collective GNM modes? Why not use the 10 slowest GNM modes?

      We have actually used the 10 slowest GNM modes, but in an attempt to cater for the non-specialist reader, we referred to them as the most collective ones. This has now been corrected throughout the manuscript and the terminology that is now used is “10 slowest modes”

      p9 There exist other ANM-based methods for conformational transition modeling. So it would be nice to discuss their similarity and differences from ANM-LD, and compare their predictions.

      Alternative ANM (and other elastic network models) -based methods are now mentioned and referenced in lines 144-50. These methods are different from ANM-LD in the details of the all atom simulations and in their integration with the elastic network model. It is not trivial to reanalyze CFTR’s allostery using these methods and is beyond the scope of this work.

      Regarding the prediction of order of residue motions, can one directly observe such order by superimposing some intermediate conformation of ANM-LD with the initial and end structure?

      This would indeed be very attractive approach to visualize the order of events and following this comment we have tried to do just so. Unfortunately, we failed: Superimposing pairs of frames provided little insight, and we therefore compiled a video comprising all frames, or videos based on averages of several time delayed frames. We found that it is next to impossible to discern (using the naked eye) the directionality of the fluctuations and follow the order of conformational changes. Therefore, at this point, we have abandoned this endeavor.

      Reviewer #3 (Public Review):

      This study of CFTR, its mutants, dynamics, and effects of ATP binding, and drug binding is well written and highly informative. They have employed coarse-grained dynamics that help to interpret the dynamics in useful and highly informative ways. Overall the paper is highly informative and a pleasure to read.

      The investigation of the effects of drugs is particularly interesting, but perhaps not fully formed.

      This is a remarkably thorough computational investigation of the mechanics of CFTR, its mutants, and ATP binding and drug binding. It applies some novel appropriate methods to learn much about structure's allostery and the effects of drug bindings. It is, overall, an interesting and well written paper.

      There are only two main questions I would like to ask about this quite thorough study.

      Reviewer #3 (Recommendations For The Authors):

      1. Is it possible that the relatively large exothermic ATP hydrolysis itself exerts a force that causes the observed transitions? Jernigan and others have explored this effect for GroEL and some other structures. The effects of ATP binding and hydrolysis are likely often confused, and both are likely to be important.

      It is well established by many studies that ATP hydrolysis is not required to drive the conformational changes or to open the channel, and that ATP binding per-se is sufficient (e.g., We have clarified this point in lines 521-30.

      1. For the case of ivacaftor, would a comparison of the motion's directions show that ivacaftor might be compensating simply by its mass being located in a site to compensate for the mass changes from the mutations (ENMs with masses needed to address this). We have observed such cases on opposite sides of a hinge.

      We do not think that this is the case, from the following reasons:

      a. Ivacaftor corrects many gating mutations (e.g., G551D, G178R, S549N, S549R, G551S, G970R, G1244E, S1251N, S1255P, G1349D) which are spread all over the protein. Ivacaftor binds to a single site in CFTR, and it is therefore unlikely that its mass contribution corrects all these diverse mass changes.

      b. The residues that comprise the Ivacaftor binding were identified as allosteric “hotspots” in both the ATP-free and -bound forms (Figures 2B, 3B, and 6A), also in the absence of the drug. This indicates that the dynamic traits of this site is intrinsic to it, and that once bound, the drug acts by modulating these dynamics

      The Abstract does not repeat some of the more interesting points made in the paper and would benefit from a substantial revision.

      Corrected as suggested

      There are just a few minor points (just words):

      P 3 line 2 of first full ¶: "effects" should be "affects"

      Corrected as suggested

      P 6 first lilne "per-se" should be "per se"

      Corrected as suggested

      Further down that page "two set" should be "two sets"

      Corrected as suggested

      Even further down that same page "testimony" should be "support"

      Corrected as suggested

      P 10, 5 lines from the bottom "impose that" is awkward

      Changed to “define”

    1. Author Response

      The following is the authors’ response to the original reviews.

      Public Reviews:

      Reviewer #1 (Public Review):

      The authors have previously employed micrococcal nuclease tethered to various Mcm subunits to the cut DNA to which the Mcm2-7 double hexamers (DH) bind. Using this assay, they found that Mcm2-7 DH are located on many more sites in the S. cerevisiae genome than previously shown. They then demonstrated that these sites have characteristics consistent with origins of DNA replication, including the presence of ARS consensus sequences, location of very inefficient sites of initiation of DNA replication in vivo, are free of nucleosomes, they contain a G-C skew and they locate to intergenic regions of the genome. The authors suggest, consistent with published single molecule results, that there are many more potential origins in the S. cerevisiae genome than previously annotated.

      The results are convincing and are consistent with prior observations. The analysis of the origin associated features is informative.

      Reviewer #2 (Public Review):

      By mapping the sites of the Mcm2-7 replicative helicase loading across the budding yeast genome using high-resolution chromatin endogenous cleavage or ChEC, Bedalov and colleagues find that these markers for origins of DNA replication are much more broadly distributed than previously appreciated. Interestingly, this is consistent with early reconstituted biochemical studies that showed that the ACS was not essential for helicase loading in vitro (e.g. Remus et al., 2009, PMID: 19896182). To accomplish this, they combined the results of 12 independent assays to gain exceptionally deep coverage of Mcm2-7 binding sites. By comparing these sites to previous studies mapping ssDNA generated during replication initiation, they provide evidence that at least a fraction of the 1600 most robustly Mcm2-7-bound sequences act as origins. A weakness of the paper is that the group-based (as opposed to analyzing individual Mcm2-7 binding sites) nature of the analysis prevents the authors from concluding that all of the 1,600 sites mentioned in the title act as origins. The authors also show that the location of Mcm2-7 location after loading are highly similar in the top 500 binding sites, although the mobile nature of loaded Mcm2-7 double hexamers prevents any conclusions about the location of initial loading. Interestingly, by comparing subsets of the Mcm2-7 binding sites, they find that there is a propensity of at least a subset of these sites to be nucleosome depleted, to overlap with at least a partial match to the ACS sequence (found at all of the most well-characterized budding yeast origins), and a GC-skew. Each of which is a characteristic of previously characterized origins of replication.

      Overall, this manuscript greatly broadens the number of sites that are capable of loading Mcm2-7 in budding yeast cells and shows that a subset of these additional sites act as replication origins. Although these sites do have a propensity to include a match to the ACS, these studies suggest that the mechanism of helicase loading in yeast and multicellular organisms is more similar than previously thought.

      Reviewer #1 (Recommendations For The Authors):

      Specific Comments:

      1. The proposal, based on this study, that replication in S. cerevisiae is similar to that in Human cells (mentioned in the abstract, introduction and end of discussion) is not supported by the evidence, either in this paper or elsewhere. The authors suggest that even these inefficient origins are directed by specific sequences that load Mcm2-7 DH, but there is no evidence that this occurs outside a limited clade of budding yeasts and certainly no in human cells. Furthermore, the distribution and efficiency of origins of replication Human cells has not been shown to parallel the findings in this paper. Thus, the conclusion should be removed since it makes a statement that S. cerevisiae and Human cells have similar mechanisms for origin location. This might confuse non-specialists who do not appreciate the subtleties.

      The reviewer's concern that we could confuse non-specialists is well-founded. We have made the following changes to emphasize the point that, while a wider distribution of origins makes S phase in yeast more like that in humans, the genome replication programs in the two organisms remain distinctly different:

      1) The last sentence of the abstract was changed as follows:

      a. These results shed light on recent reports that as many as 15% of replication events initiate outside of known origins, and they reveal S phase in yeast to be surprisingly similar to that in humans.

      b. These results shed light on recent reports that as many as 15% of replication events initiate outside of known origins, and this broader distribu5on of replica5on origins suggest that S phase in yeast may be less dis5nct from that in humans than is widely assumed.

      1. A sentence in the results was changed as follows:

      a. Another characteris5c of known origins that we could use as a criterion to assess the nature of Mcm binding sites is the presence of an ACS.

      b. Another characteris5c of known origins in S. cerevisiae (although not in most other organisms) that we could use as a criterion to assess the nature of Mcm binding sites is the presence of an ACS.

      1. We changed the last sentence of the Discussion as follows:

      a. On the other hand, the sharply focused nature of its replication origins made S phase in yeast appear distinct from that in other organisms. Our discovery that sites of replica5on ini5a5on in yeast are much more widely dispersed than previously believed, with at least 1600 and possibly as many as 5500 origins, emphasizes its continued relevance to understanding genome duplication in humans.

      b. On the other hand, the sharply focused nature of its replication origins made S phase in yeast appear dis?nct from that in other organisms. Although by no means elimina5ng this dis5nc5on, our discovery that sites of replication ini5a5on in yeast are much more widely dispersed than previously believed, with at least 1600 and possibly as many as 5500 origins, emphasizes yeast's continued relevance to understanding S phase in humans.

      1. The authors discuss in the introduction that origins in S. cerevisiae are equivalent to ARS sequences. Why didn't they ask if the inefficient origins also confer ARS activity? This would be a valuable addition and a very simple experiment.

      The inefficient origins are not expected to confer ARS activity, because origins that are not licensed in essentially every G1 will be diluted out by cell division. We confirmed the absence of our inefficiently licensed origins in a data set generated by high throughput sequencing of a genomic library that was selected for origin activity (PMID: 23241746), but we did not note the results of this analysis in our manuscript, because the low complexity of the library used made this negative result uninformative. To clarify this point, we added the bolded clauses to the following sentences in the Introduction and Discussion:

      1. Origins vary widely in their efficiency, with some being used in almost every cell cycle while others may be used in only one in one thousand S phases (Boos and Ferreira, 2019), with only the former being capable of supporting plasmid replication in the traditional ARS assay.
      2. "Thus, we can detect Mcm complexes that are loaded in as few as 1 in 500 cells (Foss et al., 2021), even though such low affinity Mcm binding sites are not expected to be capable of supporting autonomous replication of a plasmid."
      1. While the authors have shown that Mcm2-7 is loaded adjacent to the principal ARS consensus sequence, consistent with biochemical studies on pre-RC assembly, two reports have shown that the Mcm2-7 ChIP is dependent on the B2 element of ARS1, but the ORC ChIP is not, suggesting that Mcm2-7 is loaded there (See Lipford and Bell, Mol. Cell 2007 and Zou and Stillman, Mol. Cell. Biol. 2000).

      We have added the following two sentences in the Results section to note these reports:

      "Furthermore, in the case of ARS1, two reports have demonstrated a requirement for the B2 element for Mcm loading, though not for Orc binding, suggesting that Orc may bind to the ACS but then load Mcm at the B2 element (Zou and Stillman 2000; Lipford and Bell 2001). This would still leave Mcm loaded downstream of the ACS, but we note this result to emphasize that not all details of Mcm loading in vitro have been definitively established."

      **Reviewer #2 (Recommendations For The Authors):>>

      Specific points:

      1. The authors state "It is notable that the Mcm-ChEC panel of Figure 3A shows no obvious change in Mcm stoichiometry across the entire range, from low abundance, at the bottom, to high abundance, at the top." The ChEC method does not intrinsically measure stoichiometry so this conclusion needs more explanation. The authors appear to be referring to the distribution of Mcm2-7 reads being similar across all origins, but this does not measure how many double hexamers are present at an origin. If the stoichiometry argument is based on a finding that each origin has only a single 60 bp region that is protected by Mcm2-7 (rather than a distribution of 60 bp regions spread across the origin), then the authors should provide more compelling evidence than what is shown in Fig. 3A.

      We agree with the reviewer that our conclusion needs more explanation, and we have therefore made the following change, which we believe clarifies the point that we were trying to convey:

      We agree with the reviewer that our conclusion needs more explanation, and we have therefore made the following change, which we believe clarifies the point that we were trying to convey:

      1. Original version: It is notable that the Mcm-ChEC panel of Figure 3A shows no obvious change in Mcm stoichiometry across the entire range, from low abundance, at the bottom, to high abundance, at the top. This argues against models in which higher replication activity at more active origins reflect the loading of more Mcm double-hexamers at those origins within a single cell.

      2. Updated version: It is notable that, when Mcm is present, it is present predominantly as a single double-hexamer (right panel of Figure 3A), and that this remains true across the entire range of abundance shown in Figure 3A. This argues against models in which higher replication activity at more active origins is caused by the loading of more Mcm double-hexamers at those origins within a single cell, since such models predict that multiple Mcm footprints should be more prevalent at the top (high abundance) of the Mcm-ChEC heat map in Figure 3A than at the bottom.

      1. The authors state "we estimate that ~1-2 % cells have an Mcm complex loaded at the Mcm binding sites in the eighth cohort (ranks 1401-1600)" but it is not clear how this estimate is calculated. An explanation would help the reader to understand this statement.

      We have expanded on our earlier statement to clarify how we arrived at the estimate:

      1. Original version: Based on our previous analysis of MCM occupancy (Foss et al., 2021), which showed that approximately 90% cells have an MCM complex loaded at one of the most active known replication origins, we estimate that ~1-2 % cells have an Mcm complex loaded at the Mcm binding sites in the eighth cohort (ranks 1401-1600).

      2. Updated version: We have previously used Southern blodng to demonstrate that approximately 90% of the DNA at one of the most active known origins (ARS1103) is cut by Mcm-MNase (Foss et al., 2021), and to thereby infer that 90% of cells have a doublehelicase loaded at this origin. Using this as a benchmark, we estimate that ~1-2 % cells have an Mcm complex loaded at the Mcm binding sites in the eighth cohort (ranks 14011600).

      1. Although there is evidence that some subset of the CMBS sites exhibit nucleosome depletion, an ACS, and a GCskew, the authors should do a better job of making the reader aware that it is likely that a decreasing percentage of the individual origins in a group include these characteristic and that this is a likely factor explaining the increasingly rare use of these sites as Mcm2-7 loading sites and origins of replication.

      We have added the following text to the Discussion to draw the reader's attention to this possibility, while also noting that we do not believe it to be a major factor in the increasingly rare use of sites within the first 5,500 CMBSs as replication origins:

      Furthermore, it is possible that, as one moves to lower abundance groups of CMBSs within the most abundant 5500 sites, a smaller fraction of sites within those groups have any origin function at all. If one takes this model to the extreme, it would suggest that the continuous decline in replication activity seen in Figure 2B between the group comprised of ranks 1-200 and that comprised of ranks 1401-1600 reflects an ever increasing fraction of CMBSs with zero origin activity. At the other extreme, the decline in replication activity could be interpreted within a framework in which 100% of CMBSs in each group function as replication origins, but that their replication activity declines with rank, perhaps because continuously decreasing fractions of cells in the population contain a single double-hexamer. While the truth presumably lies between these two extremes, we favor a model that tilts toward the latter view, because of the abruptness of the transition that appears around rank 5,000 in (1) nucleosomal architecture (Figures 3A, 3B and S3); (2) intergenic versus genic localization and transcription levels (Figure 4A); (3) EACS position weight matrix scores (Figure 5B); and (4) GC skew (Figure 6B). By these criteria, the CMBSs below rank 5000 appear relatively homogeneous, while still showing a gradual decline in replication activity with MCM abundance within the range of detection (11600). Our assumption is that the qualitative homogeneity is more consistent with a quantitative, but not qualitative, change in CMBSs with declining MCM abundance among the top 5000 CMBSs.

      1. The argument that there are as many as 5,500 origins is not well justified. Similarly, the evidence that there are even 1,600 origins is not compelling. As the authors state, to see the peaks observed in the various analyses (ssDNA association, nucleosome depletion, etc.) of the increasingly less populated CMBSs (e.g. those with fewer ChEC reads), only a small subset of the CMBS are likely to have a given characteristic. Given that the loading of a Mcm2-7 double hexamer makes any site a potential origin, it would be more appropriate to say that there could be as many as 5,500 potential origins but many if not most are unlikely to ever direct initiation.

      The reviewer is correct that, because many of our analyses rely on group averages rather than individual measurements, we are oien unable to make statements that can be applied to every member of a group. We had tried to emphasize this point in our original manuscript with the following two sentences (in bold), which were in the Results and Discussion, respectively:

      1. First, clear peaks of ssDNA signal extend down to the eighth cohort (brown line), which corresponds to CMBSs ranked 1401-1600. Of course, this does not imply that all of these sites function as replication origins, and nor does it imply that no sites below that rank do so, since we have reached the limits of detection of this ssDNA-based assay. Nonetheless, it suggests that replication activity is common among sites extending at least down to rank 1600.

      2. Of course, we do not conclude that all CMBSs with ranks lower than 5500 function as replication origins, nor that none with ranks above 5500 do so, but only that the number of replication origins is likely to be approximately an order of magnitude higher than widely believed.

      We have now added a third sentence to further underline this point (in bold):

      Second, by averaging signals of replication from multiple Mcm binding sites, we were able to extract weak signals of replication. This is due to the fact that noise, which is randomly distributed, will tend to cancel itself out, while signals of replication will consistently augment the signal at the midpoint of the origin (Figure 2). An inevitable shortcoming to this approach is that it precludes analysis of specific sites; in other words, not every member of the group will share the average characteristic of that group.

      A separate issue that this touches on is the distinction between a replication origin and a site at which Mcm2-7 has been loaded. While it strikes us as unlikely that a loaded Mcm complex would be completely incalcitrant to activation, it is a formal possibility. To alert the reader to this issue, we have added the following clause, in bold, to the Abstract, and we have also added the sentence below that to the Discussion:

      We conclude that, if sites at which Mcm double-hexamers are loaded can function as replication origins, then DNA replication origins are at least 3-fold more abundant than previously assumed, and we suggest that replication may occasionally initiate in essentially every intergenic region.

      Finally, it is important to note that, in equating Mcm binding sites with potential replication origins, we are assuming that if an Mcm double-hexamer is loaded onto the DNA, then it is conceivable that that complex can be activated.

      1. The author's discussion of the relationship between Mcm2-7 location relative to the ACS and the mechanism of of Mcm2-7 loading does not consider that Mcm2-7 double hexamers can slide on DNA after loading (for example, Remus et al., 2009 PMID: 19896182). Thus, the authors are not looking at sites of loading only the distribution of Mcm2-7 molecules after loading. In addition, biochemical experiments do not predict a particular Mcm2-7 position relative to the ACS. Indeed, at ARS1, one would predict that the close proximity of the second weak match to the ACS (the B2 element) to the primary ACS would lead the Mcm2-7 double hexamer being initially formed at a site overlapping the ARS1 ACS. It is much more likely that the explanation for the distribution of Mcm2-7 locations relative to the ACS is that the ORC-bound ACS and the nucleosomes immediately flanking the origin prevents Mcm2-7 from occupying the right-side of the origin as illustrated in Fig. 5D.

      We have tried to emphasize this point more clearly. In our original manuscript, we had brought up the possibility of Mcms sliding after being loaded in the following context (see bolded clause):

      Specifically, in 112 out of 146 instances in which a peak of Mcm signal was within 100 base pairs of a known ACS, that peak was downstream of the ACS. The 34 exceptions may reflect (1) incorrect identification of the ACS; (2) incorrect inference of the directionality of the site; or (3) sliding of the Mcm complex after it has been loaded.

      We have now added the following to further emphasize the point:

      In interpreting the results above, it is important to remember that the locations at which we are detecting Mcm complexes by ChEC do not necessarily reflect the locations at which those complexes were loaded, since Mcm double-hexamers can slide along the DNA after loading (Remus et al. 2009; Gros et al. 2015; Foss et al. 2019).

      We have also softened the following conclusion by changing "confirmation of" to "support for":

      "...our results...provide in vivo support for in vitro predictions of the directionality of Mcm loading by Orc..."

      There are missing references in several places:

      1. "For example, 15 of the 56 genes that contained a high abundance site have been implicated in meiosis and sporulation and are not expressed during vegetative growth (~5 out of 56 expected from random sampling), consistent with previous observations (Mori and Shirahige, 2007)." Should include Blitzblau et al., 2012 (PMC3355065) which showed that Mcm2-7 loading was impacted by differences in meiotic and mitotic transcription.

      2. "In contrast to the low abundance sites, the most abundant 500 sites showed a preference for convergent over divergent transcription (left of vertical dotted line in Figure 4B), in agreement with a previous report (Li et al., 2014)." This preference was first pointed out in MacAlpine and Bell, 2005 (PMID: 15868424).

      3. "This sequence is recognized by the Origin Recognition Complex (Orc), a 6-protein complex that loads MCM (Broach et al., 1983; Deshpande and Newlon, 1992; Eaton et al., 2010; Kearsey, 1984; Newlon and Theis, 1993; Singh and Krishnamachari, 2016; Srienc et al., 1985)." This list should include a reference to Bell and Stillman, 1992 (PMID: 1579162), which first described ORC and showed that it recognized the ACS. It would also be more helpful to the reviewer to distinguish the references that identified that ACS from those concerning ORC binding to it.

      We thank the reviewer for pointing out these missing references, and we have added them. We have also separated the references that note the identification of the ACS sequence from those that demonstrate Orc binding to that sequence.

    1. Author Response

      The following is the authors’ response to the original reviews.

      Reviewer #1 (Public Review):

      "MAGIC" was introduced by the Rong Li lab in a Nature letters article in 2017. This manuscript is an extension of this original work and uses a genome wide screen the Baker's yeast to decipher which cellular pathways influence MAGIC. Overall, this manuscript is a logical extension of the 2017 study, however the manuscript is challenging to follow, complicated by the data often being discussed out of sequence. Although the manuscripts make claims of a mechanism being pinpointed, there are many gaps and the true mechanisms of how the factors identified in the screen influence MAGIC is not clear. A key issue is that there are many assumptions drawn on previous literature, but central aspects of the mechanisms being proposed are not adequately shown.

      Key comments:

      1. Reasoning and pipelines presented in the first two sections of the results are disordered and do not follow figure order. In some instances, the background to experimental analyses such as detailing the generation of spGFP constructs in the YKO mutant library, or validation of Snf1 activation are mentioned after respective results are discussed. This needs to be fixed.

      We thank the reviewer for pointing out potential confusion to readers. We have revised the first two sections according to reviewer’s suggestion. (Page 4-6)

      1. In general there is a lack of data to support microscopy data and supporting quantification analysis. The validity of this data could be significantly strengthened with accompanying western blots showing accumulation of a given constructs in mitochondrial sub compartments (as was the case in the lab’s original paper in 2017).

      We appreciate the reviewer’s suggestion on biochemical validations. However, the validity of this imaging-based assay for detecting import of cytosolic misfolded proteins into mitochondria, including the use of FlucSM as a model misfolding-prone protein, was carefully established in our previous study by using appropriate controls, super resolution imaging, APEX-based proximity labeling, and classical biochemical fractionation and protease protection assay (Ruan et al., 2017 Nature, ref. 10). We have reminded readers of these validation experiments in the previous study on Page 4, line 14-17.

      In recent years, advancements in imaging-based tools have allowed many protein interactions and dynamic processes, which were previously examined by using biochemical assays in lysates of populations of cells, to be observed with various level of quantitation in live cells with intact cellular compartments. Many of these assays, e.g., the RUSH assay for ER to Golgi transport, FRAP-based analysis for nuclear/cytoplasmic shuttling of proteins, or FRET-based assays for protein-protein interactions, have been well accepted and even embraced by the respective fields of study once validated with genetic and biochemical approaches. The advantages for live-cell imaging-based assays are often their unique ability to report dynamic processes or unstable molecular species with spatiotemporal sensitivity. Respectfully, it is our view, based on our own experience, that the traditional protease protection assay is not adequate or sufficiently quantitative for examining the presence of unstable misfolded proteins in mitochondrial sub-compartments, given the obligatorily lengthy in vitro cell lysis and mitochondrial isolation process, during which the unstable proteins are continuously being degraded. This likely explains our previous biochemical fractionation result that only weak protein signals were detected in the matrix fraction (Ruan et al., 2017 Nature, ref. 10). In addition, unlike stably folded, native mitochondrial matrix proteins, misfolded/unfolded proteins such as Lsg1 or FlucSM are highly susceptible to protease treatment. This sensitivity makes the assay unreliable for detecting such proteins if trace amount of the protease penetrates mitochondrial membranes during cell lysis even without detergent treatment.

      While we agree that protease protection assay is highly valuable for qualitative detection of the presence of a protein in certain mitochondrial compartments or determining its topology on membranes, this assay (regrettably in our hands) does not allow quantitative comparisons that were necessary for this study, because of inherent sample to sample variation, yet the laborious and low throughput nature of this assay makes it difficult for adequate statistical analysis. Furthermore, the level of protein detection in various fractions is highly sensitive to how the sample is treated with protease and detergent. Our imaging-based quantification, on the other hand, allows us to compare increased or decreased presence of GFP11-tagged proteins in mitochondria under different metabolic conditions or in different mutant or wild-type strains. Data from hundreds of cells and at least three independent biological replicates allowed us to apply adequate statistical analysis to aid our conclusion.

      1. Much of the mechanisms proposed relies on the Snf1 activation. This is however not shown but assumed to be taking place. Given that this activation is central to the mechanism proposed, this should be explicitly shown here - for example survey the phosphorylation status of the protein.

      Both REG1 deletion and low glucose conditions have been demonstrated extensively for Snf1 phosphorylation and activation in yeast (e.g., many seminal papers from Marian Carlson’s and other lab, such as ref. 24-28). In our study, we have indeed corroborated this by showing that Mig1 was exported from the nucleus in Δreg1 mutant and in low glucose conditions (Figure 1—figure supplement 2H and I. The mechanism of Snf1-mediated nuclear export of Mig1 has been characterized in detail as well (e.g., ref. 29-31).

      Recommendations for the authors: please note that you control which, if any, revisions, to undertake

      Reviewer #1 (Recommendations For The Authors):

      SPECIFIC COMMENTS

      Genetic Screen o Line 20 - the narrative moves to SNF1, but the reasoning for the selection of this Class I substrate is not defined. What was the basis for this selection - what happened to the other Class I substrates. It is stated in the text that the other Class I proteins show the same increase in spGFP signal. The data showing this should be included in the Supp Figure 1 for transparency.

      We have moved the narratives of Snf1 function to the second section and clarified that we were interested in this gene due to its central role in metabolism and mitochondrial functions that may influence MAGIC (Page 5: line 16-20). Other genes in class 1 were shown in Table S1. Detailed discussion of other genes in this category is beyond the scope of this study.

      Snf1/AMPK prevents MP accumulation in mitochondria:

      The FlucDM data in human RPE-1 mitochondria seems to be added to only increase the significance of the work. The mechanisms suggested here with Hap4 would not be possible in human cells as there is no homologue of this protein in human cells. Making generalisations that these pathways are conserved based on this one experiment is not appropriate.

      We appreciate this feedback. Although the focus of this study is the regulation of MAGIC by the yeast AMPK Snf1, we would like to share our initial observation that suggests a similar role of AMPK in human RPE-1 cells. We acknowledge that the underlying mechanisms regarding the downstream transcription factors and pathway for misfolded protein import could be different in mammalian cells, but the overall effect of AMPK in mitochondrial biogenesis is well known to resemble that of Snf1. To avoid making over-generalization, we changed our statement of conclusion to: ‘These results suggest that AMPK in human cells regulates MP accumulation in mitochondria following a similar trend as in yeast, although the underlying mechanisms might differ between these organisms.’ (Page 7: line 2-4)

      Mechanisms of MAGIC regulation by Snf1:

      While the lysosome is ruled out here the authors have not considered the proteasomes. Is there a reason for this? Given accumulation of aggregates outside of mitochondria, and previous connections of the proteasome to mitochondrial quality control this would be an obvious thing to check. We examined the role of lysosomal degradation here because it is known to be activated under Snf1active condition (ref. 37). We appreciate this feedback and have included a new analysis on MG132treated FlucSM spGFP strains in which PDR5 gene was deleted to avoid drug efflux.

      This result suggests that the proteosome inhibitor did not ablate the difference in FlucSM accumulation between these conditions. That MG132 promoted mitochondrial accumulation of FlucSM in both high glucose and low glucose conditions was not surprising, as FlucSM is also degraded by proteasome in the cytosol (Ruan et al., 2017 Nature, ref. 10), and preventing this pathway could divert more of such protein molecules toward MAGIC. (Page 7: line 26-29).

      Line 13 "we hypothesized that elevated expression of mitochondrial preproteins induced by the activation of Snf1-Hap4 axis (REF) may outcompete MPs for import channels". This statement has some assumptions. The authors have not shown that Snf1 is activated in thier models and more importantly that they have an accumulation of mitochondrial preproteins. The data that follows using the cytosolic domains of the receptors is hard to rationalise without seeing evidence that there is in fact pre-protein accumulation or impacts on the mitochondrial proteome in this system.

      As stated in our response to main point [3], Snf1 activation in reg1 mutant or in low glucose is evidenced by our data showing Mig1 export from nucleus to cytoplasm and had also been shown in many previous publications. A recent study (Tsuboi et al., 2020 eLife) also showed a dramatic increase in mitochondrial volume fraction in Δreg1 cells and wild-type cells in respiratory conditions, further supporting the role of Snf1 in mitochondrial biogenesis. We have provided relevant references in the manuscript (ref. 24-28).

      The ability of Tom70 cytosolic domain (Tom70cd), which can bind mitochondrial preproteins but not localize to mitochondria due to lack of N-terminal targeting sequence, to compete with endogenous Tom70 for mitochondrial preproteins has been well documented (ref. 47-49). However, we agree with the reviewer that a future quantitative proteomics study to measure changes in mitochondrial proteome under Tom70cd over-expression could allow more accurate interpretation of our experimental result.

      AMPK protects cellular fitness during proteotoxic stress:

      The inhibition of preprotein import by overexpressing the cytosolic domains of receptors is not supported with some proof of principle data. If this was working as the authors assume, it is not clear why only an effect with Tom70 is observed. The majority of the mitochondrial proteome is imported via Tom20/Tom22 so this does not align with what the authors are suggesting. Is the Tom70CD and any associated Hsp proteins facilitating the observed changes to the MPs?

      We thank the reviewer for raising this point. We expressed different TOM receptor cytosolic domains but found that Tom70cd had the strongest rescue on MAGIC under AMPK activation conditions. It is possible that certain Tom70 substrates or Tom70-assoicated heat shock proteins inhibit the import of MAGIC substrates. We admit that a clear explanation of this unexpected observation necessitates a better understanding of how native and MAGIC substrates are selected and imported by the outer-membrane channel. We can only offer our best interpretation based on the current state of the understanding, and we feel that we have been careful to acknowledge such in the manuscript.

      While the effect of AMPK inactivation reducing FUS accumulation was striking, this was all in the context of overexpression and may not be physiologically relevant - or may occur very transiently under basal conditions. Is GST an appropriate control here, why not use WT FUS? Likewise, one representative image is shown in Figure 5 - can the authors show western blotting that mitochondrial accumulation of FUS can be reduced with AMPK activation?

      We thank the reviewer for this suggestion, however, overexpressed FUS WT is also aggregation prone (Zhihui Sun et al., 2011, PloS Biology; Shulin Ju, 2011, PloS Biology; Jacqueline C. Mitchell et., 2013, Acta Neuro). We believe that GST, as a well-folded protein, is an appropriate control (Ruan et al., 2017 Nature, ref. 10). As we discussed in response to main point [1], the in vitro assay involving protease protection and western blots do not allow reliable quantitative comparison in our hands.

      In text changes.

      The analysis pipeline of the YKO mutant library should be introduced at the very start of the first paragraph, not the end.

      Addressed on Page 4, second paragraph

      "Fluc" should be introduced as "Firefly luciferase" within the first paragraph of the first section, also need to define SM and DM in FlucSM/FlucDM - these appear to be missing.

      Addressed in both Introduction (Page 2: line 29; Page 3: line 8-9) and re-clarified in Result (Page 5: line 27-29)

      The role of Reg1 should be explicitly stated in the text, not just in the figure.

      Addressed on Page 6: line 3-6

      Figure 1H legend states Reg1 (WT) is Snf1-inactive and Reg1 KO is Snf1-active. This wording is confusing and is not supported by data, but by assumption. If the authors want to use this wording then evidence needs to be provided - as suggested above.

      We have changed this and other legends to only show genotypes and medium conditions.

      "Tom70cd overexpression also exacerbated growth rate reduction due to FlucSM expression in HG medium (Figure 4A; Figure 4 - figure supplement 1A)" should be figure supplement 1B.

      Fixed on Page 10: line 10

      "These results suggest that glucose limitation protects mitochondria and cellular fitness during FlucSM induced proteotoxic stress through Snf1-dependent inhibition of MP import into mitochondria". The phrase "Snf1-dependent inhibition of MP import into mitochondria" may be misleading, as Snf1 isn't modulating import directly but is acting on transcriptional regulators to modulate mitochondrial import under stress.

      We restated the conclusion as follows: ‘These results suggest that Snf1 activation under glucose limitation protects mitochondrial and cellular fitness under FlucSM-associated proteotoxic stress.’ (Page 10: line 20- 21)

      "... Significantly increased the fraction of spGFP-positive and MMP-low cells in both HG and LG medium (Figure 4G-K)" should be (Figure 4J-K).

      Fixed on Page 11: line 3

      Reviewer #2 (Public Review):

      Work of Rong Li´s lab, published in Nature 2017 (Ruan et al, 2017), led the authors to suggest that the mitochondrial protein import machinery removes misfolded/aggregated proteins from the cytosol and transports them to the mitochondrial matrix, where they are degraded by Pim1, the yeast Lon protease. The process was named mitochondria as guardian in cytosol (MAGIC).

      The mechanism by which MAGIC selects proteins lacking mitochondrial targeting information, and the mechanism which allows misfolded proteins to cross the mitochondrial membranes remained, however, enigmatic. Up to my knowledge, additional support of MAGIC has not been published. Due to that, MAGIC is briefly mentioned in relevant reviews (it is a very interesting possibility!), however, the process is mentioned as a "proposal" (Andreasson et al, 2019) or is referred to require "further investigation to define its relevance for cellular protein homeostasis (proteostasis)" (Pfanner et al, 2019).

      Rong Li´s lab now presents a follow-up story. As in the original Nature paper, the major findings are based on in vivo localization studies in yeast. The authors employ an aggregation prone, artificial luciferase construct (FlucSM), in a classical split-GFP assay: GFP1-10 is targeted to the matrix of mitochondria by fusion with the mitochondrial protein Grx5, while GFP11 is fused to FlucSM, lacking mitochondrial targeting information. In addition the authors perform a genetic screen, based on a similar assay, however, using the cytosolic misfolding-prone protein Lsg1 as a read-out.

      My major concern about the manuscript is that it does not provide additional information which helps to understand how specifically aggregated cytosolic proteins, lacking a mitochondrial targeting signal could be imported into mitochondria. As it stands, I am not convinced that the observed FlucSM-/Lsg1-GFP signals presented in this study originate from FlucSM-/Lsg1-GFP localized inside of the mitochondrial matrix. The conclusions drawn by the authors in the current manuscript, however, rely on this single approach.

      In the 2017 paper the authors state: "... we speculate that protein aggregates engaged with mitochondria via interaction with import receptors such as Tom70, leading to import of aggregate proteins followed by degradation by mitochondrial proteases such as Pim1." Based on the new data shown in this manuscript the authors now conclude "that MP (misfolded protein) import does not use Tom70/Tom71 as obligatory receptors." The new data presented do not provide a conclusive alternative. More experiments are required to draw a conclusion.

      In my view: to confirm that MAGIC does indeed result in import of aggregated cytosolic proteins into the mitochondrial matrix, a second, independent approach is needed. My suggestion is to isolate mitochondria from a strain expressing FlucSM-GFP and perform protease protection assays, which are well established to demonstrate matrix localization of mitochondrial proteins. In case the authors are not equipped to do these experiments I feel that a collaboration with one of the excellent mitochondrial labs in the US might help the MAGIC pathway to become established.

      We thank Reviewer 2 for these suggestions, but we would like to respectfully offer our difference in opinion:

      a. Regarding the suggestion “to isolate mitochondria from a strain expressing FlucSM-GFP and perform protease protection assays”, in our previous study (Ruan et al., 2017 Nature, ref. 10), we have indeed applied two independent biochemical approaches: APEX-mitochondrial matrix proximity labeling and classic protease protection assay using non-spGFP strains, both consistently confirmed the entry of misfolded proteins into mitochondria under proteotoxic stress. Our super-resolution imaging further confirmed the import of the split GFP-labeled proteins to be inside mitochondria. Moreover, as we discussed in response to Reviewer 1’s main point [2], while the suggested biochemical assay is useful for validating topology within mitochondria, it is not quantitative and may not reliably report the in vivo accumulation of misfolded proteins in mitochondria due to the isolation process that takes hours, during which the unstable proteins could be continuously degraded within mitochondria.

      While we agree with the reviewer that we do not yet understand how misfolded proteins are imported into mitochondria, it would be unfair to state “as it stands, I am not convinced..” simply because the underlying mechanism remains to be elucidated. We would like to point out that targeting sequences for many well-established mitochondrial proteins are still not well defined. It is well known that mitochondrial targeting sequences are not as uniformly predictable as, for example, nuclear targeting sequences. Our finding that deletion of TOM6 enhances the import of misfolded proteins suggest that their import may involve the TOM channel in a more promiscuous conformation, which may reduce the requirement for a specific sequence-based targeting signal associated with the substrate.

      b. Regarding the role of Tom70, in our 2017 study, using proteomics and subsequently immunoprecipitation we validated the binding, albeit not necessarily direct, between misfolded protein FlucSM and Tom70. Therefore, “we speculate that protein aggregates engaged with mitochondria via interaction with import receptors such as Tom70”. Recent studies from different labs confirmed the interactions between Tom70 and aggregation prone proteins (Backes et al., 2021, Cell Reports; Liu et al., 2023, PNAS). In the current study, surprisingly, knockout of TOM70 did not block MAGIC, suggesting redundant components of mitochondria import system may facilitate the recruitment of misfolded proteins in the absence of Tom70, and this does not contradict the notion that Tom70 helps tether protein aggregates to mitochondria.

      c. Regarding other studies also showing the import of misfolding or aggregation-prone cytosolic proteins into mitochondria, there have been at least several recent studies in the literature for mammalian cells involving either model substrates or disease proteins (e.g., ref. 12-15; 56-58; Vicario, M. et al. 2019 Cell Death Dis.). The studies are briefly mentioned in Introduction (Page 3, paragraph 2). The present manuscript documents a major effort from our group using whole genome screen in yeast to understand the mechanism and regulation of MAGIC. Many of the screen hits have yet to be studied in detail. We full agree that much remains to be understood about whether and how this pathway affects proteostasis and what might be the evolutionary origin for such a mechanism.

      Additional comments:

      The genetic screen:

      The genetic screen identified five class 1 deletion strains, which lead to enhanced accumulation of Lsg1GFP and a larger set of class 2 mutants, which lead to reduced accumulation. Please note, in my opinion it is not clear that accumulation of the reporters occurs inside the mitochondria. In any case, the authors selected one single protein for further analysis: Snf1, the catalytic subunit of the yeast SNF complex, which is required for respiratory growth of yeast.

      The results of the screen are not discussed in any detail. The authors mention that ribosome biogenesis factors are abundant among class 2 mutants. Noteworthy, Lsg1 is involved in 60S ribosomal subunit biogenesis. As Lsg1-GFP11 is overexpressed in the screen this should be discussed. Class 2 mutants also .include several 40S ribosomal subunit proteins (only one of the 60S subunit). What does this imply for the MAGIC model? Also, it should be discussed that the screen did not identify reg1 and hap4, which I had expected as hits based on the data shown in later parts of the manuscript.

      We apologize for the confusion, but the GFP11 tag was in fact knocked into the C-terminus of Lsg1 in the endogenous LSG1 locus, and so Lsg1 was not overexpressed in the screen. We have made sure that this information is clearly conveyed in the revised manuscript (Page 4: line 20-22). How the ribosome small subunit affects MAGIC is beyond the focus of the current study and will be pursued in the future.

      Regarding why certain mutants did not come out of our initial screen, this is not unexpected as the YKO collection, although extremely valuable to the community, is known to be potentially affected by false knockouts, suppressor accumulation and cross contamination (for references, e.g., Puddu et al., 2019 Nature). Additionally, high-through screens can also miss real hits. In our experience using this collection in several studies, we often found additional hits from analysis of genes implicated by known genetic or biochemical interactions.

      Mutant yeast strains and growth assays:

      The Δreg1 strain grows poorly in all growth conditions and frequently accumulates extragenic suppressor mutations (Barrett et al, 2012). It would be good to make sure that this is not the case in the strains employed in this study. My suggestion is to do (and show) standard yeast plating assays with the relevant mutant strains including Δreg1, snf1, hap4, Δreg1Δhap4 without the split GFP constructs and also with them (i.e. the strains that were used in the assays).

      We thank the reviewer for the suggestion. We were indeed aware of potential accumulation of suppressor mutations from the YKO library. Therefore, deletion mutants like Δreg1 and loss of TFs downstream of Snf1 that we used in the study after the initial screen were all freshly made and validated. At least 3 independent colonies were analyzed for each mutant (mentioned in Methods & Materials; Page 33, line 57). Moreover, the plating assay suggested here may not reveal additional information other than growth, which was taken into consideration during our experiments.

      Activation of Snf1 in the relevant strains should be tested with the commercially available antibody recognizing active Snf1, which is phosphorylated at Snf1-T210.

      Snf1 activation was validated by the Mig1 exporting from the nucleus. We also noted above that many studies have clearly demonstrated Snf1 activation in reg1 mutant and under low glucose growth (e.g., ref. 24-28).

      Effects of Snf1, Reg1, Hap4 and respiratory growth conditions:

      The authors show that split GFP reporters show enhanced accumulation during fermentative growth, in Δsnf1, and Δreg1Δhap4 and fail to accumulate during respiratory growth, in Δreg1 and upon overexpression of HAP4. Analysis of Δhap4 should be included in Fig. 2. The suggestion that upon activation of Snf1 enhanced Hap4-dependent expression "outcompetes" misfolded protein import seems unlikely as only a fraction of mitochondrial genes is under control of Hap4. Without further experimental evidence I do not find that a valid assumption. More likely, the membrane potential plays a role: it is low during fermentative growth, in Δsnf1 and Δreg1Δhap4, and high during respiratory growth and in Δreg1 (Hübscher et al, 2016). Such an effect of the membrane potential seems to contradict the findings in the 2017 paper and the issue should be clarified and discussed. In any case, these data do not reveal that GFP reporters accumulate inside of the mitochondria. Based on the currently available evidence they may accumulate in close proximity/attached to the mitochondria. This has to be tested directly (see above).

      We have included our analysis of Δhap4 in Page 8: line 14-15 and Figure 2—figure supplement 1H. Consistent with our result for Δreg1Δhap4 in glucose-rich medium, HAP4 deletion also resulted in a significant increase in mitochondrial accumulation of FlucSM in low glucose medium compared to WT. It did not have effect in high glucose condition in which Snf1 is largely inactive.

      It is our view that the importance of Hap4 should not be judged by the number of nuclear encoded mitochondrial proteins they regulate. Still, this sub-group comprises a considerable number of proteins (at least 55 genes upregulated by Hap4 overexpression, ref. 43), and certain substrates may be more competitive with misfolded cytosolic proteins for import. Our genetic data strongly suggest that the inhibitory effect of active Snf1 on MAGIC is through Hap4, although we agree with the reviewer that detailed mechanism on how Hap4 substrates may compete with misfolded proteins need to be addressed in future studies.

      Membrane potential is important for mitochondrial import. During respiratory growth and in Δreg1, membrane potential is well known to be elevated comparing to fermentative condition (e.g., Figure 4C). Our observation that the import of misfolded proteins into mitochondria is reduced under these conditions simply suggests that this reduction is not due to a lack of membrane potential. This is not in any way contradictory to our 2017 finding that misfolded protein import requires membrane potential (ref. 10).

      Again, the accumulation of misfolded proteins in mitochondria, especially the model protein FlucSM, has been validated by using super resolution imaging (Figure 1—figure supplement 1A) in addition to the protease protection assay in our 2017 study.

      Introduction and Discussion:

      Both are really short, too short in my view. Please provide some background of the general principals of mitochondrial protein import and information of how exactly translocation of cytosolic, aggregated proteins (lacking targeting information) is supposed to work. I do not understand exactly how the authors actually envisage the process.

      We thank the reviewer for the suggestion. In the revised manuscript, we have extended both Introduction (Page 2-3) and Discussion section (Page 11-13)

      The results from the 2022 eLife paper (Liu et al, 2022), which suggests that Tom70 may "regulate both the transcription/biogenesis and import of mitochondrial proteins so the nascent mitochondrial proteins do not compromise cytosolic proteostasis or cause cytosolic protein aggregation" should be discussed with regard to the data obtained with overexpression of the Tom70 soluble domain.

      We thank the reviewer for pointing out that study and we have included a brief comment in Discussion section (Page 12: line 13-16). As the function of Tom70 appears to be complex, we cannot exclude the possibility that overexpression of the cytosolic domain has additional or indirect effects in addition to that due to preprotein binding.

      Andreasson, C., Ott, M., and Buttner, S. (2019). Mitochondria orchestrate proteostatic and metabolic stress responses. EMBO Rep 20, e47865.

      Barrett, L., Orlova, M., Maziarz, M., and Kuchin, S. (2012). Protein kinase A contributes to the negative control of Snf1 protein kinase in Saccharomyces cerevisiae. Eukaryot Cell 11, 119-128.

      Hubscher, V., Mudholkar, K., Chiabudini, M., Fitzke, E., Wolfle, T., Pfeifer, D., Drepper, F., Warscheid, B., and Rospert, S. (2016). The Hsp70 homolog Ssb and the 14-3-3 protein Bmh1 jointly regulate transcription of glucose repressed genes in Saccharomyces cerevisiae. Nucleic Acids Res. 44, 5629-5645.

      Liu, Q., Chang, C.E., Wooldredge, A.C., Fong, B., Kennedy, B.K., and Zhou, C. (2022). Tom70-based transcriptional regulation of mitochondrial biogenesis and aging. Elife 11

      Pfanner, N., Warscheid, B., and Wiedemann, N. (2019). Mitochondrial proteins: from biogenesis to functional networks. Nat Rev Mol Cell Biol 20, 267-284.

      Ruan, L., Zhou, C., Jin, E., Kucharavy, A., Zhang, Y., Wen, Z., Florens, L., and Li, R. (2017). Cytosolic proteostasis through importing of misfolded proteins into mitochondria. Nature 543, 443-446.

      I prefer to have "all in one", also due to time limitation.

      It would be great to be able to upload the review file as otherwise formatting and symbols get lost.

      Reviewer #3 (Public Review):

      In this study, Wang et al extend on their previous finding of a novel quality control pathway, the MAGIC pathway. This pathway allows misfolded cytosolic proteins to become imported into mitochondria and there they are degraded by the LON protease. Using a screen, they identify Snf1 as a player that regulates MAGIC. Snf1 inhibits mitochondrial protein import via the transcription factor Hap4 via an unknown pathway. This allows cells to adapt to metabolic changes, upon high glucose levels, misfolded proteins an become imported and degraded, while during low glucose growth conditions, import of these proteins is prevented, and instead import of mitochondrial proteins is preferred.

      This is a nice and well-structured manuscript reporting on important findings about a regulatory mechanism of a quality control pathway. The findings are obtained by a combination of mostly fluorescent protein-based assays. Findings from these assays support the claims well.

      While this study convincingly describes the mechanisms of a mitochondria-associated import pathway using mainly model substrates, my major concern is that the physiological relevance of this pathway remains unclear: what are endogenous substrates of the pathway, to which extend are they imported and degraded, i.e. how much does MAGIC contribute to overall misfolded protein removal (none of the experiments reports quantitative "flux" information). Lastly, it remains unclear by which mechanism Snf1 impacts on MAGIC or whether it is "only" about being outcompeted by mitochondrial precursors.

      We thank Reviewer 3 for the positive and encouraging comments on our manuscript. We agree with the reviewer that identifying MAGIC endogenous substrates and understanding what percentage of them are degraded in mitochondria are very important issues to be addressed. We are indeed carrying out projects to address these questions. We also agree with Reviewer 3 that the effect of Snf1 on MAGIC may have additional mechanisms in addition to precursors competition, such as Tom6 mediated conformational changes of TOM pores. In the revised manuscript, we had added a discussion to address these comments (Page 12: line 21-28).

      Reviewer #3 (Recommendations For The Authors):

      1. In their screen, the authors utilize differences in GFP intensity as a measure for import efficiency. However, reconstitution of the GFP from GFP1-10 and GFP11 in the matrix might also be affected (folding factors, differential degradation).

      Upon Snf1 activation, the protein abundance of mitochondrial chaperones such as Hsp10, Hsp60, and Mdj1, and mitochondrial proteases such as Pim1 are not significantly changed (ref. 35). Therefore, it is unlikely that the folding and degradation capacity of mitochondrial matrix is drastically affected by Snf1 activation.

      To examine the effect of Snf1 activation on spGFP reconstitution, Grx5 spGFP strain was constructed in which the endogenous mitochondrial matrix protein Grx5 was C-terminally tagged with GFP11 at its genomic locus, and GFP1-10 was targeted to mitochondria through cleavable Su9 MTS (MTS-mCherryGFP1-10) (ref. 10). Only modest reduction in Grx5 spGFP intensity was observed in LG compared to HG, and no significant difference after adjusting the GFP1-10 abundance (spGFP/mCherry ratio) (Figure 1— figure supplement 3A-D). These data suggest that any effect on spGFP reconstitution is insufficient to explain the drastic reduction of MP accumulation in mitochondria under Snf1 activation. Overall, our results demonstrate that Snf1 activation primarily prevents mitochondrial accumulation of MPs, but not that of normal mitochondrial proteins. (Page 6: line 17-25).

      We admit, however, that to fully rule out these factors, specific intra-mitochondrial folding or degradation reporter assays would be needed.

      1. Scoring of protein import always takes place using fluorescence-based assays. These always require folding of the "sensors" in the matrix. An additional convincing approach that would not rely on matrix folding could be pulse chase approaches coupled to fractionation assays and immunoprecipitation.

      We thank reviewer 3 for this suggestion. In our previous study, we applied two different biochemical assays: APEX proximity labeling, and mitochondrial fractionation followed by protease protection. Both confirmed the entry of misfolded proteins into mitochondria as observed by using split GFP. As we discussed in response to Reviewer 1’s main point [3], the fractionation assays are not quantitative enough for the comparisons made in our study. In particular, during the over 2-hour assay, misfolded proteins continue to be degraded within mitochondria. By using proper controls, our spGFP system provides quantitative comparisons for mitochondrial accumulation of misfolded proteins in non-disturbed physiological conditions.

      1. Could the pathway be reconstituted in vitro with isolated mitochondria to test for the "competition hypothesis"

      This is an excellent suggestion, but setting up such a reconstituted system is a project on its own. The study documented in this manuscript already encompasses a large amount of work that we feel should be published timely.

      1. Fluorescence figures are not colour blind friendly (red-green). This should be improved by changing the color scheme.

      We thank reviewer 3 for pointing this out and sincerely apologize for any inconvenience. However, we are unfortunately unable to change all images within a limited time. We will adopt another color scheme in future work.

      1. spGFP in human cells appears to form "spot-like" structures. What are these granules?

      We indeed observed granule-like structures by spGFP labeled FUS in mitochondria, which is interesting, but we did not investigate this further because it is a not a focus of this study.

    1. Author Response

      The following is the authors’ response to the original reviews.

      Response to Reviewers

      To whom it may concern, Thank you for your constructive feedback on our manuscript. I appreciate the time and effort that you and the reviewers have dedicated to providing your valuable feedback. We are grateful to the reviewers for their insightful comments and suggestions for our paper. I have been able to incorporate changes to reflect the majority of these suggestions provided. I have updated the analysis scripts (at https://github.com/neurogenomics/reanalysis_Mathys_2019) and have listed these changes in blue below:

      eLife assessment:

      This work is useful as it highlights the importance of data analysis strategies in influencing outcomes during differential gene expression testing. While the manuscript has the potential to enhance awareness regarding data analysis choices in the community, its value could be further enhanced by providing a more comprehensive comparison of alternative methods and discussing the potential differences in preprocessing, such as scFLOW. The current analysis, although insightful, appears incomplete in addressing these aspects.

      We thank the reviewing editors for this note. We agree that the differences in preprocessing will affect the results and conceal which step in our reanalysis resulted in the discrepancies we noted. To address this, we have split out our reanalysis into two separate parts - In the main body of the text we discuss the differences resulting from just changing the differential expression approach where we use the same processed data as the authors to enable a fair comparison. Secondly, we still provide the reprocessed data and perform differential expression analysis on it and discuss the cause and impact the differences in the processing steps made to the results.

      Reviewer 1:

      I think readers would be interested to learn more about the genes that were found "significant" by the original paper but sorted out by the authors. Did they just fall short of the cutoffs? If so, how many more samples would have been required to ascertain significance? This would yield a recommendation for future studies and an overall more positive/productive spirit to the manuscript. On the other hand, I suspect a fraction of DEGs were false positives due to differences in the proportions of cells from different individuals compared to the original analysis. Which percentage of DEGs does this apply to? Again, this would raise awareness of the issue and support the use of pseudobulk approaches.

      To investigate the relationship between the genes and how they differ across our analysis we have added a correlation analysis between our different DE approaches (using the same processed data), see paragraph 5 in the manuscript and supplementary table 3. In short, we find that there is a high correlation in the genes’ fold change values across our pseudobulk analysis and the author’s pseudoreplication analysis on the same dataset (pearson R of 0.87 for an adjusted p-value of 0.05) which is somewhat expected given the DE approaches are applied to the same dataset. However, the p-values, which pertain to the likelihood that a gene’s expressional changes is related to the case/control differences in AD, and resulting DEGs vary considerably due to the artificially inflated confidence of the author’s approach (Fig. 1c-e). Despite there being a correlation between the pseudoreplciation and pseudobulk approaches here, we do not think it makes sense to consider how many more samples would have been required to ascertain significance. The differences in results between the two approaches is not negatable with sample size as many DEGs identified by pseudoreplication will be false positives as highlighted in previous work1,2,3,4. However, perhaps we are misinterpreting the reviewer, who may have meant a power analysis which we have not conducted. Such an undertaking would require analysing a multitude of snRNA-Seq of large sample sizes to garner a confident estimate for power calculations based on pseudobulk approaches. Although we agree with the reviewer that this would be beneficial to the field, we do not believe it is in scope for this work. On the reviewer’s note regarding a fraction of DEGs being false positives due to differences in the proportions of cells from different individuals compared to the original analysis - We have analysed the same processed data the authors used to negate the differences caused by the differing processing steps. We thank the reviewer for this suggestion. We also give more insight into the cause of these differences, namely on filtering our nuclei with large proportions of mitochondrial reads and discuss their effect in paragraph 3 (also see Supplementary Figure 2).

      Given there are only a few DEGs, it would be good to show more data about these genes to allow better assessment of the robustness of the results, i.e., boxplots of the pseudobulk counts in the compared groups and perhaps heatmaps of the raw counts prior to aggregation. This could rule out concerns about outliers affecting the results.

      In Supplementary Figure 3, we have added boxplots of the sum pseudobulked, trimmed mean of M-values (TMM) normalised counts for three of our identified DEGs (b) and three of the authors’ DEGs which they discuss in their manuscript (a) to show the differences in counts across AD pathology and controls for these genes. We hope this gives some insight into the transcriptional changes highlighted by the differing approaches. In our opinion, there is a clear difference in the transcriptional signal in the genes identified from pseudobulk which is not present for the genes identified from the authors approach.

      Overall, I believe the paper would deliver a clearer message by mainlining the QC from the original study and only changing the DE analysis. However, if keeping the part about QC/batch correction:

      • Assess to which degree changes in cell type proportion are indeed due to batch correction (as suggested in the text) and not filtering by looking at the annotated cell types in the original publication and those in your analysis.

      • Also perform the analysis without changing QC and state the # of DEGs in both cases, to at least allow some disentanglement of the effect of different steps of the analysis.

      • Please state the number of cells removed by each QC step in the supplementary note.

      We thank the reviewer for this suggestion. We agree with performing the DE analysis on the same processed data as the original authors and have split out our reanalysis into two separate parts, primarily focussing on the discrepancies caused by the choice of differential expression (DE) approach. By splitting our analysis in this manner, we can identify the substantial differences in results caused by differing the DE approach in the study. Secondly, we can see how differences in preprocessing affects the DE results in isolation too – see paragraph 8 but in short, the fold change correlation between pseudobulk DE analyses on the reprocessed data vs authors processed data only had a moderate correlation (Pearson R of 0.57).

      In regards to the number of cells removed by each QC step, we have added an aggregated view for all samples in supplementary table 3 and also give the full statistics per sample in our Github repository: https://github.com/neurogenomics/reanalysis_Mathys_2019. Moreover, we investigated the root cause in the differences in nuclei numbers, uncovering filtering down to mitochondrial read proportions as the main culprit (Supplementary Figure 2).

      I recommend the authors read the following papers, assess whether their methodology agrees with them, and add citations as appropriate to support statements made in the manuscript.

      We thank the reviewer for this comprehensive list. We have updated our manuscript and supplementary file and main text throughout to cite many of these where appropriate. We believe this helps add context to our decisions for the differing tools and approaches used as part of the processing pipeline with scFlow and the differential expression approach.

      I believe the authors' intention was to show the results of their reanalysis not as a criticism of the original paper (which can hardly be faulted for their strategy which was state-of-the-art at the time and indeed they took extra measures attempting to ensure the reliability of their results), but primarily to raise awareness and provide recommendations for rigorous analysis of sc/snRNA-seq data for future studies.

      We thank the reviewer for this note, this was exactly our intent. Furthermore, we are based in a dementia research institute and our aim is to ensure that ensure that the Alzheimer’s disease research field does not focus on spuriously identified genes.We have updated the text of the manuscript (start paragraph 2) to explicitly state this so our message is not misconstrued.

      In my opinion, the purpose of the paper might be better served by focusing on the DE strategy without changing QC and instead detailing where/how DEGs were gained/lost and supporting whether these were false positives.

      We agree that the differences in preprocessing will affect the results and conceal which step in our reanalysis resulted in the discrepancies we noted. To address this, we have split out our reanalysis into two separate parts - In the main body of the text we discuss the differences resulting from just changing the differential expression approach where we use the same processed data as the authors to enable a fair comparison. Secondly, we still provide the reprocessed data and perform differential expression analysis on it and discuss the impact the differences in the processing steps made to the results. As previously mentioned, we have also added further investigation into the DEGs identified, looking at the correlation across the differing approaches and plotting the counts for selected genes.

      For instance, removal with a mitochondrial count of <5% seems harsh and might account for a large proportion of additional cells filtered out in comparison to the original analysis. There is no blanket "correct cutoff" for this percentage. For instance, the "classic" Seurat tutorial https://satijalab.org/seurat/articles/pbmc3k_tutorial.html uses the 5% threshold chosen by the authors, an MAD-based selection of cutoff arrived at 8% here https://www.sc-best-practices.org/preprocessing_visualization/quality_control.html, another "best practices" guide choses by default 10% https://bioconductor.org/books/3.17/OSCA.basic/quality-control.html#quality-control-discarded, etc. Generally, the % of mitochondrial reads varies a lot between datasets.

      Apologies, the 5% cut-off was a misprint – the actual cut-off used was 10% which, as the reviewer notes, is on the higher side of what is recommended. We have updated our manuscript to rectify this mistake and discuss the differences in the number of cells caused by the two approaches to mitochondrial filtering in the manuscript (paragraph 3). We found that over 16,000 nuclei that were removed in our QC pipeline were kept by the author’s (Supplementary Fig. 2), explaining the discrepancy in the number of nuclei after QC. Based on Supplementary Fig. 2, it is clear the author’s approach was ineffective at removing nuclei with high proportions of mitochondrial reads which is indicative of cell death5,6. We hope this alleviates the reviewer’s concerns around our alternative processing approach. Moreover, as mentioned, we swapped to compare the differences by DE approaches on the same data to avoid any effect by this.

      Reviewer 2:

      The paper would be better if the authors merged this work with the scFLOW paper so that they can justify their analysis pipeline and show it in an influential dataset.

      We thank the reviewer for this note. We would like to clarify that the purpose of our work was not to show the scFlow analysis pipeline on an influential dataset but rather to raise awareness and provide recommendations for rigorous analysis of single-cell and single-nucleus RNA-Seq data (sc/snRNA-Seq) for future studies and to help redirect the focus of the Alzheimer’s disease research field away from possible spuriously identified genes. We have updated our manuscript text to highlight this (see start paragraph 2). Furthermore, we are aware our original approach reprocessing the data with scFlow will affect the results and conceal which step in our reanalysis resulted in the discrepancies we noted. Thus, we have split out our reanalysis into two separate parts - In the main body of the text we discuss the differences resulting from just changing the differential expression approach where we use the same processed data as the authors to enable a fair comparison. Secondly, we still provide the reprocessed data so that the community can benefit from it and perform differential expression analysis on it and discuss the impact the differences in the processing steps made to the results. We have also added further references supporting the choice of steps and tools used in scFlow in the supplementary text which should address the reviewer’s concerns about justifying the analysis pipeline. Moreover, we identified the cause of the nuclei count differences caused by the two processing approaches, namely on filtering our nuclei with large proportions of mitochondrial reads and discuss their effect in paragraph 3 (also see Supplementary Figure 2).

      A major contribution is the use of the authors' own inhouse pipeline for data preparation (scFLOW), but this software is unpublished since 2021 and consequently not yet refereed. It isn't reasonable to take this pipeline as being validated in the field.

      We believe our answer to the previous point addresses these concerns - We have added references supporting the choice of steps and tools used in scFlow in the supplementary text which should address the reviewer’s concerns about justifying the analysis pipeline. Moreover, as a result of the pipeline we identified that 16,000 of the nuclei kept by the authors are likely of low quality and indicative of cell death with high mitochondrial read proportions5,6.

      They also worry that the significant findings in Mathys' paper are influenced by the number of cells of each type. I'm sure it is since power is a function of sample size, but is this a bad thing? It seems odd that their approach is not influenced by sample size.

      We thank the reviewer for highlighting this point. As they noted, we conclude that the original authors number of DEGs is just a product of the number of cells. However, the reviewer states that ‘It seems odd that their approach is not influenced by sample size’. An increase in the number of cells is not an increase in sample size since these cells are not independent from one another - they come from the same sample. Therefore, an increase in the number of cells should not result in an increase in the number of DEGs whereas an increase in the number of samples would. This point is the major issue with pseudoreplication approaches which over-estimate the confidence when performing differential expression due to the statistical dependence between cells from the same patient not being considered. See these references for more information on this point1,2,7,8. We have added a discussion of this point to our manuscript in paragraph 6.

      Moreover, recent work has established that the genetic risk for Alzheimer’s disease acts primarily via microglia9,10. Thus, it would be reasonable to expect that the majority of large effect size DEGs identified would be found in this cell type. This is what we found with our pseudobulk differential expression approach – 96% of all DEGs were in microglia. We have updated the text of our manuscript (paragraph 5) to highlight this last point.

      References 1. Murphy, A. E. & Skene, N. G. A balanced measure shows superior performance of pseudobulk methods in single-cell RNA-sequencing analysis. Nat. Commun. 13, 7851 (2022).

      1. Squair, J. W. et al. Confronting false discoveries in single-cell differential expression. Nat. Commun. 12, 5692 (2021).

      2. Crowell, H. L. et al. muscat detects subpopulation-specific state transitions from multi-sample multi-condition single-cell transcriptomics data. Nat. Commun. 11, 6077 (2020).

      3. Soneson, C. & Robinson, M. D. Bias, robustness and scalability in single-cell differential expression analysis. Nat. Methods 15, 255–261 (2018).

      4. Ilicic, T. et al. Classification of low quality cells from single-cell RNA-seq data. Genome Biol. 17, 29 (2016).

      5. Heumos, L. et al. Best practices for single-cell analysis across modalities. Nat. Rev. Genet. 24, 550–572 (2023).

      6. Zimmerman, K. D., Espeland, M. A. & Langefeld, C. D. A practical solution to pseudoreplication bias in single-cell studies. Nat. Commun. 12, 738 (2021).

      7. Lazic, S. E. The problem of pseudoreplication in neuroscientific studies: is it affecting your analysis? BMC Neurosci. 11, 5 (2010).

      8. Skene, N. G. & Grant, S. G. N. Identification of Vulnerable Cell Types in Major Brain Disorders Using Single Cell Transcriptomes and Expression Weighted Cell Type Enrichment. Front. Neurosci. 0, (2016).

      9. McQuade, A. & Blurton-Jones, M. Microglia in Alzheimer’s disease: Exploring how genetics and phenotype influence risk. J. Mol. Biol. 431, 1805–1817 (2019).

    1. Author Response

      The following is the authors’ response to the current reviews.

      eLife assessment

      The findings of this article provide valuable information on the changes of cell clusters induced by chronic periodontitis. The observation of a new fibroblast subpopulation, named AG fibroblasts, is interesting, and the strength of evidence presented is solid.

      We thank the Reviewing Editor and the Senior Editor for the positive assessment and strong support for our study.

      Public Reviews:

      Reviewer #1 (Public Review):

      In this article, the authors found a distinct fibroblast subpopulation named AG fibroblasts, which are capable of regulating myeloid cells, T cells and ILCs, and proposed that AG fibroblasts function as a previously unrecognized surveillant to orchestrate chronic gingival inflammation in periodontitis. Generally speaking, this article is innovative and interesting.

      We truly appreciate this public review.

      Reviewer #2 (Public Review):

      This study proposed the AG fibroblast-neutrophil-ILC3 axis as a mechanism contributing to pathological inflammation in periodontitis. In this study single-cell transcriptomic analysis was performed. But the signal mechanism behind them was not evaluated.

      The authors achieved their aims, and the results partially support their conclusions.

      We agree that we must conduct future studies to evaluate our hypothesis.

      The mouse ligatured periodontitis models differ from clinical periodontitis in human, this study supplies the basis for future research in human.

      This is an important subject. We have previously expressed a concern on the mouse ligature model that the microbial composition of the mouse ligature did not mirror the human oral microbial composition. Therefore, we developed the maxillary topical application (MTA) model, in which human oral biofilm was directly applied to the maxillary gingiva. In this study, the newly developed MTA model was further dissected by single cell RNA seq, which revealed that the extracellular substances of human oral biofilm might be an important trigger of gingival inflammation. RESULT has been revised.

      Recommendations for the authors:

      Reviewer #1 (Recommendations For The Authors):

      I appreciate the authors' efforts. I think it would be much better to simplify INTRODUCTION.

      INTRODUCTION has been simplified as suggested.

      Reviewer #2 (Recommendations For The Authors):

      1. Many host cells participate in immune responses, such as gingival epithelial cells. AG fibroblast is not the only cell involved in the immune response, and the weight of its role needs to be clarified. So the expression in the conclusion should be appropriate.

      RESPONSE: We agree with this comment. Our study identified the AG fibroblast–neutrophil–ILC3 axis as a previously unrecognized mechanism which could play an additional role in the complex interplay between oral barrier immune cells.

      1. The main results should be included in the Abstract.

      Abstract has been revised.


      The following is the authors’ response to the original reviews.

      We thank all reviewers for constructive critiques. We plan to perform new experiments and revise our manuscript accordingly. The text and Figures are currently undergoing the revision process. Below highlights our revision plan.

      eLife assessment

      The findings of this article provide valuable information on the changes of cell clusters induced by chronic periodontitis. The observation of a new fibroblast subpopulation, which was named as AG fibroblasts, was quite interesting, but needs further evidence. The strength of evidence presented is incomplete.

      We discovered a new subpopulation of gingival fibroblasts, named AG fibroblasts, using non-biased single cell RNA sequencing (scRNA-seq) of mouse gingival samples undergoing the development of ligature-induced periodontitis. AG fibroblasts exhibited a unique gene expression profile: [1] constitutive expression of type XIV collagen; and [2] ligatureinduced upregulation of Toll-Like Receptors and their downstream signals as well as chemokines such as CXCL12. Thus, we have hypothesized that AG fibroblasts initially sense the pathological stress including oral microbial stimuli and secrete inflammatory signals through chemokine expression.

      The current manuscript examined the relationship between AG fibroblasts and oral barrier immune cells focusing on the chemokines and other ligands derived from AG fibroblasts and their putative receptors in those immune cells. Using scRNA-seq data mining programs, our data demonstrated the compelling evidence that AG fibroblasts should play a critical role in orchestrating the oral barrier immunity, at least at the early stages of periodontal inflammation.

      We agree that it is important to explore the functional/pathological role of AG fibroblasts. In this revision, we further investigated the role of TLRs in the pathogen sensing mechanism of AG fibroblasts. To accomplish this goal, we applied a newly developed mouse model in which mice were exposed to the maxillary topical application (MTA) of oral microbial pathogens without the ligature placement. With 1 hr exposure with human oral biofilm, not with planktonic microbiota, the mice maxillary tissue exhibited measurable degradation as evidenced by the activation of cathepsin K. To dissect the role of TLRs, we applied the putative stimulants of TLR9 and TLR2/4 using the discrete MTA model. The scRNA-seq from the MTA model revealed that the application of unmethylated CpG oligonucleotide and P. gingivalis lipopolysaccharide (LPS), respectively, induced the activation of chemokines by AG fibroblast.

      The revised manuscript reported this critical data with the detailed information. As such the additional figures and corresponding results, discussion and materials & methods were included.

      Public Reviews:

      Reviewer #1 (Public Review):

      In this article, the authors found a distinct fibroblast subpopulation named AG fibroblasts, which are capable of regulating myeloid cells, T cells and ILCs, and proposed that AG fibroblasts function as a previously unrecognized surveillant to orchestrate chronic gingival inflammation in periodontitis. Generally speaking, this article is innovative and interesting, however, there are some problems that need to be addressed to improve the quality of the manuscript.

      We appreciate this comment. As suggested, we further investigated the surveillant function of AG fibroblasts by reanalyzing the scRNA-seq data for stress sensing receptors such as Toll-Like Receptors (TLR). In the revision, we addressed the role of TLR in the activation of AG fibroblasts using a newly developed mouse model employing the maxillary topical application (MTA) of putative TLR stimulants. The new information clearly demonstrated that AG fibroblasts play a pivotal role as the surveillant and translating the pathogenic stimulants to oral barrier inflammation through chemokine expression.

      Reviewer #2 (Public Review):

      This study proposed the AG fibroblast-neutrophil-ILC3 axis as a mechanism contributing to pathological inflammation in periodontitis. However, the immune response in the vivo is very complex. It is difficult to determine which is the cause and which is the result. This study explores the relevant issue from one dimension, which is of great significance for a deeper understanding of the pathogenesis of periodontitis. It should be fully discussed.

      We appreciate this comment. We expanded the current understanding of oral immune signal communication in Discussion and highlight how AG fibroblast may fit to it. To address this question, we expanded our investigation in the pathological signal detection by AG fibroblasts by employing the newly developed maxillary topical application (MTA) model. The revised manuscript contains the new information and expanded the discussion in the context of complex immune response.

      Reviewer #1 (Recommendations For The Authors):

      Detailed comments are listed below:

      Abstract:<br /> I am confused about the expression of "human periodontitis-like phenotype". How does the authors define this concept? Periodontitis is a complex disease, despite that alveolar bone resorption is a typical manifestation of periodontitis, its characteristics remain to be further studied. I hope the authors can provide some detailed information about this concept or describe it in another way.

      This is an important comment. Radiographically, human periodontitis is diagnosed by alveolar bone resorption from the cervical region, not from root apex. To highlight this, we present dental radiographs of human periodontitis as supplementary information. However, we agree with this comment, our statement should be limited to alveolar bone resorption pattern in Rag2KO and Rag2gcKO mice. Abstract be revised accordingly.

      Introduction:<br /> It is recommended to simplify the first to third paragraphs, and briefly explain the functions of various types of cells in different stages of periodontitis, as well as the role of different cluster markers play across the time course of periodontal inflammation development.

      Following this recommendation, INTRODUCTION has been simplified.

      Results:<br /> 1. It is recommended to add HE staining and immunohistochemistry staining to observe the inflammation, tissue damage, and repair status from 0 to 7 days, so that readers can understand cell phenotype changes corresponding to the periodontitis stage. The observation index can include inflammation and vascular related indicators.

      As recommended, representative histological figures were included. We further performed new immunohistochemistry experiment of mouse gingival tissue (D0, D1, D3, D7) highlighting the infiltration of CD45+ immune cells. We found that inflammatory vascular formation in the H&E histology, which was highlighted. To characterize the tissue damage, the histological sections were stained by picrosirius red to highlight the change in collagen connective tissue of PDL and gingiva.

      1. Figure 1A-1D can be placed in the supplementary figure.

      Combining the new data above, Figure 1 was revised as suggested.

      1. I suggest the authors to put the detection of the existence of AG fibroblasts before exploring its relationship with other types of cells.

      2. The layout of the picture should be closely related to the topic of the article. It is recommended to readjust the layout of the picture. Figure 1 should be the detection of AG cells and their proportion changes from 0 to 7 days. In other figures, the authors can separately describe the proportion changes of myeloid cells, T cells and ILCs, and explored the association between AG fibroblasts and these cell types.

      As suggested, the presentation order of Figures and text was revised to bring the information about AG fibroblasts first. The chemokine-receptor analysis was moved below.

      1. Please provide the complete form of "KT" in Line 162.

      KT fibroblasts (fibroblasts keeping typical phenotype) was described in the text.

      Methods:<br /> It is recommended to separately list the statistical methods section. The statistical method used in the article should be one-way ANOVA.

      A separate statistical method section is created. As pointed out, we used one-way ANOVA with post-hoc Tukey test (when multiple groups were compared).

      Discussion:<br /> I suggest the authors remove Figures 3-6 from the discussion section. For example, in Line 283, "(Figure 3 and 4)" should be removed.

      Revised as suggested.

      Reference:<br /> Some information for the references is missing. For example, "Lin P, et al. Application of Ligature-Induced Periodontitis in Mice to Explore the Molecular Mechanism of Periodontal Disease. Int J Mol Sci 22, (2021)" should be "Lin P, et al. Application of Ligature-Induced Periodontitis in Mice to Explore the Molecular Mechanism of Periodontal Disease. Int J Mol Sci 22, 8900 (2021)". It is necessary to recheck all references.

      The reference has been checked for the accuracy and the omission pointed out was corrected. Although we used EndNote program, we found some more inaccuracy in the references that were manually corrected. We appreciate your suggestion.

      Reviewer #2 (Recommendations For The Authors):

      1. Many host cells participate in immune responses, such as gingival epithelial cells. AG fibroblast is not the only cell involved in the immune response, and the weight of its role needs to be clarified. So the expression in the conclusion should be appropriate.

      Following this critique, we revised INTRODUCTION, DISCUSSION and CONCLUSION, to highlight how AG fibroblasts function within a comprehensive immune response network.

      1. This study cannot directly answer the issue of the relationship between periodontitis and systemic diseases.

      We agree with this critique. We either deleted or de-emphasized the relationship between periodontitis and systemic diseases throughout the text.

    1. Author response

      The following is the authors’ response to the current reviews.

      We thank the editor for the eLife assessment and reviewers for their remaining comments. We will address them in this response.

      First, we thank eLife for the positive assessment. Regarding the point of visual acuity that is mentioned in this assessment, we understand that this comment is made. It is not an uncommon comment when rodent vision is discussed. However, we emphasize that we took the lower visual acuity of rats and the higher visual acuity of humans into account when designing the human study, by using a fast and eccentric stimulus presentation for humans. As a result, we do not expect a higher discriminability of stimuli in humans. We have described this in detail in our Methods section when describing the procedure in the human experiment:

      “We used this fast and eccentric stimulus presentation with a mask to resemble the stimulus perception more closely to that of rats. Vermaercke & Op de Beeck (2012) have found that human visual acuity in these fast and eccentric presentations is not significantly better than the reported visual acuity of rats. By using this approach we avoid that differences in strategies between humans and rats would be explained by such a difference in acuity”

      Second, regarding the remaining comment of Reviewer #2 about our use of AlexNet:

      While it is indeed relevant to further look into different computational architectures, we chose to not do this within the current study. First, it is a central characteristic of the study procedure that the computational approach and chosen network is chosen early on as it is used to generate the experimental design that animals are tested with. We cannot decide after data collection to use a different network to select the stimuli with which these data were collected. Second, as mentioned in our first response, using AlexNet is not a random choice. It has been used in many previously published vision studies that were relatively positive about the correspondence with biological vision (Cadieu et al., 2014; Groen et al., 2018; Kalfas et al., 2018; Nayebi et al., 2023; Zeman et al., 2020). Third, our aim was not to find a best DNN model for rat vision, but instead examining the visual features that play a role in our complex discrimination task with a model that was hopefully a good enough starting point. The fact that the designs based upon AlexNet resulted in differential and interpretable effects in rats as well as in humans suggests that this computational model was a good start. Comparing the outcomes of different networks would be an interesting next step, and we expect that our approach could work even better when using a network that is more specifically tailored to mimic rat visual processing.

      Finally, regarding the choice to specifically chose alignment and concavity as baseline properties, this choice is probably not crucial for the current study. We have no reason to expect rats to have an explicit notion about how a shape is built up in terms of a part-based structure, where alignment relates to the relative position of the parts and concavity is a property of the main base. For human vision it might be different, but we did not focus on such questions in this study.


      The following is the authors’ response to the original reviews.

      We would like to thank you for giving us the opportunity to submit a revised draft our manuscript. We appreciate the time and effort that you dedicated to providing insightful feedback on our manuscript and are grateful for the valuable comments and improvements on our paper. It helped us to improve our manuscript. We have carefully considered the comments and tried our best to address every one of them. We have added clarifications in the Discussion concerning the type of neural network that we used, about which visual features might play a role in our results as well as clarified the experimental setup and protocol in the Methods section as these two sections were lacking key information points.

      Below we provide a response to the public comments and concerns of the reviewers.

      Several key points were addressed by at least two reviewers, and we will respond to them first.

      A first point concerns the type of network we used. In our study, we used AlexNet to simulate the ventral visual stream and to further examine rat and human performance. While other, more complex neural networks might lead to other results, we chose to work with AlexNet because it has been used in many other vision studies that are published in high impact journals ((Cadieu et al., 2014; Groen et al., 2018; Kalfas et al., 2018; Nayebi et al., 2023; Zeman et al., 2020). We did not try to find a best DNN model for rat vision but instead, we were looking for an explanation of which visual features play a role in our complex discrimination task. We added a consideration to our Discussion addressing why we worked with AlexNet. Since our data will be published on OSF, we encourage to researchers to use our data with other, more complex neural networks and to further investigate this issue.

      A second point that was addressed by multiple reviewers concerns the visual acuity of the animals and its impact on their performance. The position of the rat was not monitored in the setup. In a previous study in our lab (Crijns & Op de Beeck, 2019), we investigated the visual acuity of rats in the touchscreen setups by presenting gratings with different cycles per screen to see how it affects their performance in orientation discrimination. With the results from this study and general knowledge about rat visual acuity, we derived that the decision distance of rats lies around 12.5cm from the screen. We have added this paragraph to the Discussion.

      A third key point that needs to be addressed as a general point involves which visual features could explain rat and human performance. We reported marked differences between rat and human data in how performance varied across image trials, and we concluded through our computationally informed tests and analyses that rat performance was explained better by lower levels of processing. Yet, we did not investigate which exact features might underlie rat performance. As a starter, we have focused on taking a closer look at pixel similarity and brightness and calculating the correlation between rat/human performance and these two visual features.

      We calculated the correlation between the rat performances and image brightness of the transformations. We did this by calculating the difference in brightness of the base pair (brightness base target – brightness base distractor), and subtracting the difference in brightness of every test target-distractor pair for each test protocol (brightness test target – brightness test distractor for each test pair). We then correlated these 287 brightness values (1 for each test image pair) with the average rat performance for each test image pair. This resulted in a correlation of 0.39, suggesting that there is an influence of brightness in the test protocols. If we perform the same correlation with the human performances, we get a correlation of -0.12, suggesting a negative influence of brightness in the human study.

      We calculated the correlation between pixel similarity of the test stimuli in relation to the base stimuli with the average performance of the animals on all nine test protocols. We did this by calculating the pixel similarity between the base target with every other testing distractor (A), the pixel similarity between the base target with every other testing target (B), the pixel similarity between the base distractor with every other testing distractor (C) and the pixel similarity between the base distractor with every other testing target (D). For each test image pair, we then calculated the average of (A) and (D), and subtracted the average of (C) and (B) from it. We correlated these 287 values (one for each image pair) with the average rat performance on all test image pairs, which resulted in a correlation of 0.34, suggesting an influence of pixel similarity in rat behaviour. Performing the same correlation analysis with the human performances results in a correlation of 0.12.

      We have also addressed this in the Discussion of the revised manuscript. Note that the reliability of the rat data was 0.58, clearly higher than the correlations with brightness and pixel similarity, thus these features capture only part of the strategies used by rats.

      We have also responded to all other insightful suggestions and comments of the reviewers, and a point-by-point response to the more major comments will follow now.  

      Reviewer #1, general comments:

      The authors should also discuss the potential reason for the human-rat differences too, and importantly discuss whether these differences are coming from the rather unusual approach of training used in rats (i.e. to identify one item among a single pair of images), or perhaps due to the visual differences in the stimuli used (what were the image sizes used in rats and humans?). Can they address whether rats trained on more generic visual tasks (e.g. same-different, or category matching tasks) would show similar performance as humans?

      The task that we used is typically referred to as a two-alternative forced choice (2AFC). This is a simple task to learn. A same-different task is cognitively much more demanding, also for artificial neural networks (see e.g. Puebla & Bowers, 2022, J. Vision). A one-stimulus choice task (probably what the reviewer refers to with category matching) is known to be more difficult compared to 2AFC, with a sensitivity that is predicted to be Sqrt(2) lower according to signal detection theory (MacMillan & Creelman, 1991). We confirmed this prediction empirically in our lab (unpublished observations). Thus, we predict that rats perform less good in the suggested alternatives, potentially even (in case of same-different) resulting in a wider performance gap with humans.

      I also found that a lot of essential information is not conveyed clearly in the manuscript. Perhaps it is there in earlier studies but it is very tedious for a reader to go back to some other studies to understand this one. For instance, the exact number of image pairs used for training and testing for rats and humans was either missing or hard to find out. The task used on rats was also extremely difficult to understand. An image of the experimental setup or a timeline graphic showing the entire trial with screenshots would have helped greatly.

      All the image pairs used for training and testing for rats and humans are depicted in Figure 1 (for rats) and Supplemental Figure 6 (for humans). For the first training protocol (Training), only one image pair was shown, with the target being the concave object with horizontal alignment of the spheres. For the second training protocol (Dimension learning), three image pairs were shown, consisting of the base pair, a pair which differs only in concavity, and a pair which differs only in alignment. For the third training protocol (Transformations) and all testing protocols, all combination of targets and distractors were presented. For example, in the Rotation X protocol, the stimuli consisted of 6 targets and 6 distractors, resulting in a total of 36 image pairs for this protocol. The task used on rats is exactly as shown in Figure 1. A trial started with two blank screens. Once the animal initiated a trial by sticking its head in the reward tray, one stimulus was presented on each screen. There was no time limit and so the stimuli remained on the screen until the animal made a decision. If the animal touched the target, it received a sugar pellet as reward and a ITI of 20s started. If the animal touched the distractor, it did not receive a sugar pellet and a time-out of 5s started in addition to the 20s ITI.

      We have clarified this in the manuscript.

      The authors state that the rats received random reward on 80% of the trials, but is that on 80% of the correctly responded trials or on 80% of trials regardless of the correctness of the response? If these are free choice experiments, then the task demands are quite different. This needs to be clarified. Similarly, the authors mention that 1/3 of the trials in a given test block contained the old base pair - are these included in the accuracy calculations?

      The animals receive random reward on 80% on all testing trials with new stimuli, regardless of the correctness of the response. This was done to ensure that we can measure true generalization based upon learning in the training phase, and that the animals do not learn/are not trained in these testing stimuli. For the trials with the old stimuli (base pair), the animals always received real reward (reward when correct; no reward in case of error).

      The 1/3rd trials with old stimuli are not included in the accuracy calculations but were used as a quality check/control to investigate which sessions have to be excluded and to assure that the rats were still doing the task properly. We have added this in the manuscript.

      The authors were injecting noise with stimuli to cDNN to match its accuracy to rat. However, that noise potentially can interacted with the signal in cDNN and further influence the results. That could generate hidden confound in the results. Can they acknowledge/discuss this possibility?

      Yes, adding noise can potentially interact with the signal and further influence the results. Without noise, the average training data of the network would lie around 100% which would be unrealistic, given the performances of the animals. To match the training performance of the neural networks with that of the rats, we added noise 100 times and averaged over these iterations (cfr. (Schnell et al., 2023; Vinken & Op de Beeck, 2021)).  

      Reviewer #2, weaknesses:

      1) There are a few inconsistencies in the number of subjects reported. Sometimes 45 humans are mentioned and sometimes 50. Probably they are just typos, but it's unclear.

      Thank you for your feedback. We have doublechecked this and changed the number of subjects where necessary. We collected data from 50 human participants, but had to exclude 5 of them due to low performance during the quality check (Dimension learning) protocols. Similarly, we collected data from 12 rats but had to exclude one animal because of health issues. All these data exclusion steps were mentioned in the Methods section of the original version of the manuscript, but the subject numbers were not always properly adjusted in the description in the Results section. This is now corrected.

      2) A few aspects mentioned in the introduction and results are only defined in the Methods thus making the manuscript a bit hard to follow (e.g. the alignment dimension), thus I had to jump often from the main text to the methods to get a sense of their meaning.

      Thank you for your feedback. We have clarified some aspects in the Introduction, such as the alignment dimension.

      4) Many important aspects of the task are not fully described in the Methods (e.g. size of the stimuli, reaction times and basic statistics on the responses).

      We have added the size of the stimuli to the Methods section and clarified that the stimuli remained on the screen until the animals made a choice. Reaction time in our task would not be interpretable given that stimuli come on the screen when the animal initiates a trial with its back to the screen. Therefore we do not have this kind of information.

      Reviewer #1

      • Can the authors show all the high vs zero and zero vs high stimulus pairs either in the main or supplementary figures? It would be instructive to know if some other simple property covaried between these two sets.

      In Figure 1, all images of all protocols are shown. For the High vs. Zero and Zero vs. High protocols, we used a deep neural network to select a total of 7 targets and 7 distractors. This results in 49 image pairs (every combination of target-distractor).

      • Are there individual differences across animals? It would be useful for the authors to show individual accuracy for each animal where possible.

      We now added individual rat data for all test protocols – 1 colour per rat, black circle = average. We have added this picture to the Supplementary material (Supplementary Figure 1).

      • Figure 1 - it was not truly clear to me how many image pairs were used in the actual experiment. Also, it was very confusing to me what was the target for the test trials. Additionally, authors reported their task as a categorisation task, but it is a discrimination task.

      Figure 1 shows all the images that were used in this study. Every combination of every target-distractor in each protocol (except for Dimension learning) was presented to the animals. For example in Rotation X, the test stimuli as shown in Fig. 1 consisted of 6 targets and 6 distractors, resulting in a total of 36 image pairs for this test protocol.

      In each test protocol, the target corresponded to the concave object with horizontally attached spheres, or the object from the pair that in the stimulus space was closed to this object. We have added this clarification in the Introduction: “We started by training the animals in a base stimulus pair, with the target being the concave object with horizontally aligned spheres. Once the animals were trained in this base stimulus pair, we used the identity-preserving transformations to test for generalization.” as well as in the caption of Figure 1. We have changed the term “categorisation task” to “discrimination task” throughout the manuscript.

      • Figure 2 - what are the red and black lines? How many new pairs are being tested here? Panel labels are missing (a/b/c etc)

      We have changed this figure by adding panel labels, and clarifying the missing information in the caption. All images that were shown to the animals are presented on this figure. For Dimension Learning, only three image pairs were shown (base pair, concavity pair, alignment pair) and for the Transformations protocol, every combination of every target and distractor were shown, i.e. 25 image pairs in total.

      • Figure 3 - last panel: the 1st and 2nd distractor look identical.

      We understand your concern as these two distractors indeed look quite similar. They are different however in terms of how they are rotated along the x, y and z axes (see Author response image 1 for a bigger image of these two distractors). The similarity is due to the existence of near-symmetry in the object shape which causes high self-similarity for some large rotations.

      Author response image 1.

      • Line 542 – authors say they have ‘concatenated’ the performance of the animals, but do they mean they are taking the average across animals?

      It is both. In this specific analysis we calculated the performance of the animals, which was indeed averaged across animals, per test protocol, per stimulus pair. This resulted in 9 arrays (one for each test protocol) of several performances (1 for each stimulus pair). These 9 arrays were concatenated by linking them together in one big array (i.e. placing them one after the other). We did the same concatenation with the distance to hyperplane of the network on all nine test protocols. These two concatenated arrays with 287 values each (one with the animal performance and one with the DNN performance) were correlated.

      • Line 164 - What are these 287 image pairs - this is not clear.

      The 287 image pairs correspond to all image pairs of all 9 test protocols: 36 (Rotation X) + 36 (Rotation Y) + 36 (Rotation Z) + 4 (Size) + 25 (Position) + 16 (Light location) + 36 (Combination Rotation) + 49 (Zero vs. high) + 49 (High vs. zero) = 287 image pairs in total. We have clarified this in the manuscript.

      • Line 215 - Human rat correlation (0.18) was comparable to the best cDNN layer correlation. What does this mean?

      The human rat correlation (0.18) was closest to the best cDNN layer - rat correlation (about 0.15). In the manuscript we emphasize that rat performance is not well captured by individual cDNN layers.  

      Reviewer #2

      Major comments

      • In l.23 (and in the methods) the authors mention 50 humans, but in l.87 they are 45. Also, both in l.95 and in the Methods the authors mention "twelve animals" but they wrote 11 elsewhere (e.g. abstract and first paragraph of the results).

      In our human study design, we introduced several Dimension learning protocols. These were later used as a quality check to indicate which participants were outliers, using outlier detection in R. This resulted in 5 outlying human participants, and thus we ended with a pool of 45 human participants that were included in the analyses. This information was given in the Methods section of the original manuscript, but we did not mention the correct numbers everywhere. We have corrected this in the manuscript. We also changed the number of participants (humans and rats) to the correct one throughout the entire manuscript.

      • At l.95 when I first met the "4x4 stimulus grid" I had to guess its meaning. It would be really useful to see the stimulus grid as a panel in Figure 1 (in general Figures S1 and S4 could be integrated as panels of Figure 1). Also, even if the description of the stimulus generation in the Methods is probably clear enough, the authors might want to consider adding a simple schematic in Figure 1 as well (e.g. show the base, either concave or convex, and then how the 3 spheres are added to control alignment).

      We have added the 4x4 stimulus grid in the main text.

      • There is also another important point related to the choice of the network. As I wrote, I find the overall approach very interesting and powerful, but I'm actually worried that AlexNet might not be a good choice. I have experience trying to model neuronal responses from IT in monkeys, and there even the higher layers of AlexNet aren't that helpful. I need to use much deeper networks (e.g. ResNet or GoogleNet) to get decent fits. So I'm afraid that what is deemed as "high" in AlexNet might not be as high as the authors think. It would be helpful, as a sanity check, to see if the authors get the same sort of stimulus categories when using a different, deeper network.

      We added a consideration to the manuscript about which network to use (see the Discussion): “We chose to work with Alexnet, as this is a network that has been used as a benchmark in many previous studies (e.g. (Cadieu et al., 2014; Groen et al., 2018; Kalfas et al., 2018; Nayebi et al., 2023; Zeman et al., 2020)), including studies that used more complex stimuli than the stimulus space in our current study. […] . It is in line with the literature that a typical deep neural network, AlexNet and also more complex ones, can explain human and animal behaviour to a certain extent but not fully. The explained variance might differ among DNNs, and there might be DNNs that can explain a higher proportion of rat or human behaviour. Most relevant for our current study is that DNNs tend to agree in terms of how representations change from lower to higher hierarchical layers, because this is the transformation that we have targeted in the Zero vs. high and High vs. zero testing protocols. (Pinto et al., 2008) already revealed that a simple V1-like model can sometimes result in surprisingly good object recognition performance. This aspect of our findings is also in line with the observation of Vinken & Op de Beeck (2021) that the performance of rats in many previous tasks might not be indicative of highly complex representations. Nevertheless, there is still a relative difference in complexity between lower and higher levels in the hierarchy. That is what we capitalize upon with the Zero vs. high and High vs. zero protocols. Thus, it might be more fruitful to explicitly contrast different levels of processing in a relative way rather than trying to pinpoint behaviour to specific levels of processing.”

      • The task description needs way more detail. For how long were the stimuli presented? What was their size? Were the positions of the stimuli randomized? Was it a reaction time task? Was the time-out used as a negative feedback? In case, when (e.g. mistakes or slow responses)? Also, it is important to report some statistics about the basic responses. What was the average response time, what was the performance of individual animals (over days)? Did they show any bias for a particular dimension (either the 2 baseline dimensions or the identity preserving ones) or side of response? Was there a correlation within animals between performance on the baseline task and performance on the more complex tasks?

      Thank you for your feedback. We have added more details to the task description in the manuscript.

      The stimuli were presented on the screens until the animals reacted to one of the two screens. The size of the stimuli was 100 x 100 pixel. The position of the stimuli was always centred/full screen on the touchscreens. It was not a reaction time task and we also did not measure reaction time.

      • Related to my previous comment, I wonder if the relative size/position of the stimulus with respect to the position of the animal in the setup might have had an impact on the performance, also given the impact of size shown in Figure 2. Was the position of the rat in the setup monitored (e.g. with DeepLabCut)? I guess that on average any effect of the animal position might be averaged away, but was this actually checked and/or controlled for?

      The position of the rat was not monitored in the setup. In a previous study from our lab (Crijns & Op de Beeck, 2019), we investigated the visual acuity of rats in the touchscreen setups by presenting gratings with different cycles per screen to see how it affects their performance in orientation discrimination. With the results from this study and general knowledge about rat visual acuity, we derived that the decision distance of rats lies around 12.5cm from the screen. We have added this to the discussion.

      Minor comments

      • l.33 The sentence mentions humans, but the references are about monkeys. I believe that this concept is universal enough not to require any citation to support it.

      Thank you for your feedback. We have removed the citations.

      • This is very minor and totally negligible. The acronymous cDNN is not that common for convents (and it's kind of similar to cuDNN), it might help clarity to stick to a more popular acronymous, e.g. CNN or ANN. Also, given that the "high" layers used for stimulus selection where not convolutional layers after all (if I'm not mistaken).

      Thank you for your feedback. We have changed the acronym to ‘CNN’ in the entire manuscript.

      • In l.107-109 the authors identified a few potential biases in their stimuli, and they claim these biases cannot explain the results. However, the explanation is given only in the next pages. It might help to mention that before or to move that paragraph later, as I was just wondering about it until I finally got to the part on the brightness bias.

      We expanded the analysis of these dimensions (e.g. brightness) throughout the manuscript.

      • It would help a lot the readability to put also a label close to each dimension in Figures 2 and 3. I had to go and look at Figure S4 to figure that out.

      Figures 2 and 3 have been updated, also including changes related to other comments.

      • In Figure 2A, please specify what the red dashed line means.

      We have edited the caption of Figure 2: “Figure 2 (a) Results of the Dimension learning training protocol. The black dashed horizontal line indicates chance level performance and the red dashed line represents the 80% performance threshold. The blue circles on top of each bar represent individual rat performances. The three bars represent the average performance of all animals on the old pair (Old), the pair that differs only in concavity (Conc) and on the pair that differs only in alignment (Align). (b) Results of the Transformations training protocol. Each cell of the matrix indicates the average performance per stimulus pair, pooled over all animals. The columns represent the distractors, whereas the rows separate the targets. The colour bar indicates the performance correct. ”

      • Related to that, why performing a binomial test on 80%? It sounds arbitrary.

      We performed the binomial test on 80% as 80% is our performance threshold for the animals

      • The way the cDNN methods are introduced makes it sound like the authors actually fine-tuned the weights of AlexNet, while (if I'm not mistaken), they trained a classifier on the activations of a pre-trained AlexNet with frozen weights. It might be a bit confusing to readers. The rest of the paragraph instead is very clear and easy to follow.

      We think the most confusing sentence was “ Figure 7 shows the performance of the network after training the network on our training stimuli for all test protocols. “ We changed this sentence to “ Figure 8 shows the performance of the network for each of the test protocols after training classifiers on the training stimuli using the different DNN layers.“

      Reviewer #3

      Main recommendations:

      Although it may not fully explain the entire pattern of visual behavior, it is important to discuss rat visual acuity and its impact on the perception of visual features in the stimulus set.

      We have added a paragraph to the Discussion that discusses the visual acuity of rats and its impact on perceiving the visual features of the stimuli.

      The authors observed a potential influence of image brightness on behavior during the dimension learning protocol. Was there a correlation between image brightness and the subsequent image transformations?

      We have added this to the Discussion: “To further investigate to which visual features the rat performance and human performance correlates best with, we calculated the correlation between rat performance and pixel similarity of the test image pairs, as well as the correlation between rat performance and brightness in the test image pairs. Here we found a correlation of 0.34 for pixel similarity and 0.39 for brightness, suggesting that these two visual features partly explain our results when compared to the full-set reliability of rat performance (0.58). If we perform the same correlation with the human performances, we get a correlation of 0.12 for pixel similarity and -0.12 for brightness. With the full-set reliability of 0.58 (rats) and 0.63 (humans) in mind, this suggests that even pixel similarity and brightness only partly explain the performances of rats and humans.”

      Did the rats rely on consistent visual features to perform the tasks? I assume the split-half analysis was on data pooled across rats. What was the average correlation between rats? Were rats more internally consistent (split-half within rat) than consistent with other rats?

      The split-half analysis was indeed performed on data pooled across rats. We checked whether rats are more internally consistent by comparing the split-half within correlations with the split-half between correlations. For the split-half within correlations, we split the data for each rat in two subsets and calculated the performance vectors (performance across all image pairs). We then calculated the correlation between these two vectors for each animal. To get the split-half between correlation, we calculated the correlation between the performance vector of every subset data of every rat with every other subset data from the other rats. Finally, we compared for each animal its split-half within correlation with the split-half between correlations involving that animal. The result of this paired t-test (p = 0.93, 95%CI [-0.09; 0.08]) suggests that rats were not internally more consistent.

      Discussion of the cDNN performance and its relation to rat behavior could be expanded and clarified in several ways:

      • The paper would benefit from further discussion regarding the low correlations between rat behavior and cDNN layers. Is the main message that cDNNs are not a suitable model for rat vision? Or can we conclude that the peak in mid layers indicates that rat behavior reflects mid-level visual processing? It would be valuable to explore what we currently know about the organization of the rat visual cortex and how applicable these models are to their visual system in terms of architecture and hierarchy.

      We added a consideration to the manuscript about which network to use (see Discussion).

      • The cDNN exhibited above chance performance in various early layers for several test protocols (e.g., rotations, light location, combination rotation). Does this limit the interpretation of the complexity of visual behavior required to perform these tasks?

      This is not uncommon to find. Pinto et al. (2008) already revealed that a simple V1-like model can sometimes result in surprisingly good object recognition performance. This aspect of our findings is also in line with the observation of Vinken & Op de Beeck (2021) that the performance of rats in many previous tasks might not be indicative of highly complex representations. Nevertheless, there is still a relative difference in complexity between lower and higher levels in the hierarchy. That is what we capitalize upon with the High vs zero and the Zero vs high protocols. Thus, it might be more fruitful to explicitly contrast different levels of processing in a relative way rather than trying to pinpoint behavior to specific levels of processing. This argumentation is added to the Discussion section.

      • How representative is the correlation profile between cDNN layers and behavior across protocols? Pooling stimuli across protocols may be necessary to obtain stable correlations due to relatively modest sample numbers. However, the authors could address how much each individual protocol influences the overall correlations in leave-one-out analyses. Are there protocols where rat behavior correlates more strongly with higher layers (e.g., when excluding zero vs. high)?

      We prefer to base our conclusions mostly on the pooled analyses rather than individual protocols. As the reviewer also mentions, we can expect that the pooled analyses will provide the most stable results. For information, we included leave-one-out analyses in the supplemental material. Excluding the Zero vs. High protocol did not result in a stronger correlation with the higher layers. It was rare to see correlations with higher layers, and in the one case that we did (when excluding High versus zero) the correlations were still higher in several mid-level layers.

      Author response image 2.

      • The authors hypothesize that the cDNN results indicate that rats rely on visual features such as contrast. Can this link be established more firmly? e.g., what are the receptive fields in the layers that correlate with rat behavior sensitive to?

      This hypothesis was made based on previous in-lab research ((Schnell et al., 2023) where we found rats indeed rely on contrast features. In this study, we performed a face categorization task, parameterized on contrast features, and we investigated to what extent rats use contrast features to perform in a face categorization task. Similarly as in the current study, we used a DNN that as trained and tested on the same stimuli as the animals to investigate the representations of the animals. There, we found that the animals use contrast features to some extent and that this correlated best with the lower layers of the network. Hence, we would say that the lower layers correlate best with rat behaviour that is sensitive to contrast. Earlier layers of the network include local filters that simulate V1-like receptive fields. Higher layers of the network, on the other hand, are used for object selectivity.

      • There seems to be a disconnect between rat behavior and the selection of stimuli for the high (zero) vs. zero (high) protocols. Specifically, rat behavior correlated best with mid layers, whereas the image selection process relied on earlier layers. What is the interpretation when rat behavior correlates with higher layers than those used to select the stimuli?

      We agree that it is difficult to pinpoint a particular level of processing, and it might be better to use relative terms: lower/higher than. This is addressed in the manuscript by the edit in response to three comments back.

      • To what extent can we attribute the performance below the ceiling for many protocols to sensory/perceptual limitations as opposed to other factors such as task structure, motivation, or distractibility?

      We agree that these factors play a role in the overall performance difference. In Figure 5, the most right bar shows the percentage of all animals (light blue) vs all humans (dark blue) on the old pair that was presented during the testing protocol. Even here, the performance of the animals was lower than humans, and this pattern extended to the testing protocols as well. This was most likely due to motivation and/or distractibility which we know can happen in both humans and rats but affects the rat results more with our methodology.

      Minor recommendations:

      • What was the trial-to-trial variability in the distance and position of the rat's head relative to the stimuli displayed on the screen? Can this variability be taken into account in the size and position protocols? How meaningful is the cDNN modelling of these protocols considering that the training and testing of the model does not incorporate this trial-to-trial variability?

      We have no information on this trial-to-trial variability. We have information though on what rats typically do overall from an earlier paper that was mentioned in response to an earlier comment (Crijns et al.).

      We have added a disclaimer in the Discussion on our lack of information on trial-to-trial variability.

      • Several of the protocols varied a visual feature dimension (e.g., concavity & alignment) relative to the base pair. Did rat performance correlate with these manipulations? How did rat behavior relate to pixel dissimilarity, either between target and distractor or in relation to the trained base pair?

      We have added this to the Discussion. See also our general comments in the Public responses.

      • What could be the underlying factor(s) contributing to the difference in accuracy between the "small transformations" depicted in Figure 2 and some of the transformations displayed in Figure 3? In particular, it seems that the variability of targets and distractors is greater for the "small transformations" in Figure 2 compared to the rotation along the y-axis shown in Figure 3.

      There are several differences between these protocols. Before considering the stimulus properties, we should take into account other factors. The Transformations protocol was a training protocol, meaning that the animals underwent several sessions in this protocol, always receiving real reward during the trials, and only stopping once a high enough performance was reached. For the protocols in Figure 3, the animals were also placed in these protocols for multiple sessions in order to obtain enough trials, however, the difference here is that they did not receive real reward and testing was also stopped if performance was still low.

      • In Figure 3, it is unclear which pairwise transformation accuracies were above chance. It would be helpful if the authors could indicate significant cells with an asterisk. The scale for percentage correct is cut off at 50%. Were there any instances where the behaviors were below 50%? Specifically, did the rats consistently choose the wrong option for any of the pairs? It would be helpful to add "old pair", "concavity" and "alignment" to x-axis labels in Fig 2A .

      We have added “old”, “conc” and “align” to the x-axis labels in Figure 2A.

      • Considering the overall performance across protocols, it seems overstated to claim that the rats were able to "master the task."

      When talking about “mastering the task”, we talk about the training protocols where we aimed that the animals would perform at 80% and not significantly less. We checked this throughout the testing protocols as well, where we also presented the old pair as quality control, and their performance was never significantly lower than our 80% performance threshold on this pair, suggesting that they mastered the task in which they were trained. To avoid discussion on semantics, we also rephrased “master the task” into “learn the task”.

      • What are the criteria for the claim that the "animal model of choice for vision studies has become the rodent model"? It is likely that researchers in primate vision may hold a different viewpoint, and data such as yearly total publication counts might not align with this claim.

      Primate vision is important for investigating complex visual aspects. With the advancements in experimental techniques for rodent vision, e.g. genetics and imaging techniques as well as behavioural tasks, the rodent model has become an important model as well. It is not necessarily an “either” or “or” question (primates or rodents), but more a complementary issue: using both primates and rodents to unravel the full picture of vision.

      We have changed this part in the introduction to “Lately, the rodent model has become an important model in vision studies, motivated by the applicability of molecular and genetic tools rather than by the visual capabilities of rodents”.

      • The correspondence between the list of layers in Supplementary Tables 8 and 9 and the layers shown in Figures 4 and 6 could be clarified.

      We have clarified this in the caption of Figure 7

      • The titles in Figures 4 and 6 could be updated from "DNN" to "cDNN" to ensure consistency with the rest of the manuscript.

      Thank you for your feedback. We have changed the titles in Figures 4 and 6 such that they are consistent with the rest of the manuscript.

    1. Author Response

      The following is the authors’ response to the original reviews.

      eLife assessment

      This valuable manuscript attempts to identify the brain regions and cell types involved in habituation to dark flash stimuli in larval zebrafish. Habituation being a form of learning widespread in the animal kingdom, the investigation of neural mechanisms underlying it is an important endeavor. The authors use a combination of behavioral analysis, neural activity imaging, and pharmacological manipulation to investigate brain-wide mechanisms of habituation. However, the data presented are incomplete and do not show a convincing causative link between pharmacological manipulations, neural activity patterns, and behavioral outcomes.

      We thank the reviewers and editors for their careful reading and reviews of our work. We are grateful that they appreciate the value in our experimental approach and results. We acknowledge what we interpret as the major criticism, that in our original manuscript we focused too heavily on the hypothesized role of GABAergic neurons in driving habituation. This hypothesis will remain only indirectly supported until we can identify a GABAergic population of neurons that drives habituation. Therefore, we have revised our manuscript, decreasing the focus on GABA, and rather emphasizing the following three points:

      1) By performing the first Ca2+ imaging experiments during dark flash habituation, we identify multiple distinct functional classes of neurons which have different adaptation profiles, including non-adapting and potentiating classes. These neurons are spread throughout the brain, indicating that habituation is a complex and distributed process.

      2) By performing a pharmacological screen for dark flash habituation modifiers, we confirm habituation behaviour manifests from multiple distinct molecular mechanisms that independently modulate different behavioural outputs. We also implicate multiple novel pathways in habituation plasticity, some of which we have validated through dose-response studies.

      3) By combining pharmacology and Ca2+ imaging, we did not observe a simple relationship between the behavioural effects of a drug treatment and functional alterations in neurons. This observation further supports our model that habituation is a multidimensional process, for which a simple circuit model will be insufficient.

      We would like to point out that, in our opinion, there appears to be a factual error in the final sentence of the eLife assessment:

      “However, the data presented are incomplete and do not show a convincing causative link between pharmacological manipulations, neural activity patterns, and behavioral outcomes”.

      We believe that a “convincing causative link” between pharmacological manipulations and behavioural outcomes has been clearly demonstrated for PTX, Melatonin, Estradiol and Hexestrol through our dose response experiments. Similarly a link between pharmacology and neural activity patterns has also been directly demonstrated. As mentioned in (3), we acknowledge that our data linking neural activity and behaviour is more tenuous, as will be more explicitly reflected in our revised manuscript.

      Nevertheless, we maintain that one of the primary strengths of our study is our attempt to integrate analyses that span the behavioural, pharmacological, and neural activity-levels.

      In our revised manuscript, we have substantially altered the Abstract and Discussion, removed the Model figure (previously Figure 8), and changed the title from :

      “Inhibition drives habituation of a larval zebrafish visual response”

      to:

      “Functional and pharmacological analyses of visual habituation learning in larval zebrafish”

      Text changes from the initial version are visible as track changes in the word document: “LamireEtAl_2022_eLifeRevisions.docx”

      Reviewer #1 (Public Review):

      This manuscript addresses the important and understudied issue of circuit-level mechanisms supporting habituation, particularly in pursuit of the possible role of increases in the activity of inhibitory neurons in suppressing behavioral output during long-term habituation. The authors make use of many of the striking advantages of the larval zebrafish to perform whole brain, single neuronal calcium imaging during repeated sensory exposure, and high throughput screening of pharmacological agents in freely moving, habituating larvae. Notably, several blockers/antagonists of GABAA(C) receptors completely suppress habituation of the O-bend escape response to dark flashes, suggesting a key role for GABAergic transmission in this form of habituation. Other substances are identified that strikingly enhance habituation, including melatonin, although here the suggested mechanistic insight is less specific. To add to these findings, a number of functional clusters of neurons are identified in the larval brain that has divergent activity through habituation, with many clusters exhibiting suppression of different degrees, in line with adaptive filtration during habituation, and a single cluster that potentiates during habituation. Further assessment reveals that all of these clusters include GABAergic inhibitory neurons and excitatory neurons, so we cannot take away the simple interpretation that the potentiating cluster of neurons is inhibitory and therefore exerts an influence on the other adapting (depressing) clusters to produce habituation. Rather, a variety of interpretations remain in play.

      Overall, there is great potential in the approach that has been used here to gain insight into circuit-level mechanisms of habituation. There are many experiments performed by the authors that cannot be achieved currently in other vertebrate systems, so the manuscript serves as a potential methodological platform that can be used to support a rich array of future work. While there are several key observations that one can take away from this manuscript, a clear interpretation of the role of GABAergic inhibitory neurons in habituation has not been established. This potential feature of habituation is emphasized throughout, particularly in the introduction and discussion sections, meaning that one is obliged as a reader to interrogate whether the results as they currently stand really do demonstrate a role for GABAergic inhibition in habituation. Currently, the key piece of evidence that may support this conclusion is that picrotoxin, which acts to block some classes of GABA receptors, prevents habituation. However, there are interpretations of this finding that do not specifically require a role for modified GABAergic inhibition. For instance, by lowering GABAergic inhibition, an overall increase in neural activity will occur within the brain, in this case below a level that could cause a seizure. That increase in activity may simply prevent learning by massively increasing neural noise and therefore either preventing synaptic plasticity or, more likely, causing indiscriminate synaptic strengthening and weakening that occludes information storage. Sensory processing itself could also be disrupted, for instance by altering the selectivity of receptive fields. Alternatively, it could be that the increase in neural activity produced by the blockade of inhibition simply drives more behavioral output, meaning that more excitatory synaptic adaptation is required to suppress that output. The authors propose two specific working models of the ways in which GABAergic inhibition could be implemented in habituation. An alternative model, in which GABAergic neurons are not themselves modified but act as a key intermediary between Hebbian assemblies of excitatory neurons that are modified to support memory and output neurons, is not explored. As yet, these or other models in which inhibition is not required for habituation, have not been fully tested.

      This manuscript describes a really substantial body of work that provides evidence of functional clusters of neurons with divergent responses to repeated sensory input and an array of pharmacological agents that can influence the rate of a fundamentally important form of learning.

      We thank the reviewer for their careful consideration of our work, and we agree that multiple models of how habituation occurs remain plausible. As discussed above and below in more detail, we have revised our manuscript to better reflect this. We hope the reviewer will agree that this has improved the manuscript.

      Reviewer #2 (Public Review):

      In this study, Lamire et al. use a calcium imaging approach, behavioural tests, and pharmacological manipulations to identify the molecular mechanisms behind visual habituation. Overall, the manuscript is well-written but difficult to follow at times. They show a valuable new drug screen paradigm to assess the impact of pharmacological compounds on the behaviour of larval zebrafish, the results are convincing, but the description of the work is sometimes confusing and lacking details.

      We thank the reviewer for identifying areas where our description lacked details. We apologize for these omissions and have attempted to add relevant details as described below. We note that all of the analysis code is available online, though we appreciate that navigating and extracting data from these files is not straightforward.

      The volumetric calcium imaging of habituation to dark flashes is valuable, but the mix of responses to visual cues that are not relevant to the dark flash escape, such as the slow increase back to baseline luminosity, lowers the clarity of the results. The link between the calcium imaging results and free-swimming behaviour is not especially convincing, however, that is a common issue of head-restrained imaging with larval zebrafish.

      We agree with the reviewer that the design of our stimulus, and specifically the slow increase back to baseline luminosity, is perhaps confusing for the interpretation of some of the response profiles of neurons. We originally chose this stimulus type (rather than a square wave of 1s of darkness, for example) in order to better highlight the responses of the larvae to the onset of darkness (rather than the response to abruptly returning to full brightness). We therefore believe that the slow return to baseline is an important feature of the stimulus,, which better separates activity related to the fast offset from activity related to light onset. And since all of the foundational behavioural data (Randlett et al., Current Biology 2019), and pharmacological data, used this stimulus type, we did not change it for the Ca2+ imaging experiments. Our use of relatively slow nuclear-targeted GCaMP indicators also means that the temporal resolution of our imaging experiments is relatively poor, and therefore we felt that using a stimulus that highlighted light offset might be best.

      We also fully acknowledge in the Results section that the behaviour of the head embedded fish is not the same as that of free-swimming fish, and that therefore establishing a direct link between these types of experiments is complicated. This is an unavoidable caveat in the head-embedded style experiments. To further emphasize this, we have also added a paragraph to the discussion where this is acknowledged explicitly.

      “We also found that the same pharmacological treatments that result in strong alterations to habituation behaviour in freely swimming larvae ([fig:5]), resulted in relatively subtle and complex functional alterations in the circuit ([fig:6]). Making direct comparisons between freely-swimming behaviour and head-fixed Ca2+ imaging is always challenging due to the differences in behaviour observed in the two contexts, and therefore our failure to identify a clear logic in these experiments may have technical explanations that will require approaches to measure neural activity from unrestrained and freely-behaving animals to resolve . Alternatively, these results are again consistent with the idea that habituation is a multidimensional and perhaps highly non-linear phenomenon in the circuit, which cannot be captured by a simple model.”

      The strong focus on GABA seems unwarranted based on the pharmacological results, as only Picrotoxinin gives clear results, but the other antagonists do not give a consistent results. On the other hand, the melatonin receptor agonists, and oestrogen receptor agonists give more consistent results, including more convincing dose effects.

      We agree that our manuscript focused too strongly on GABA and have toned this down. We are currently performing genetic experiments aimed at identifying the Melatonin, Estrogen and GABA receptors that function during habituation, which we think will be necessary to move beyond pharmacology and the necessary caveats that such experiments bring.

      The pharmacological manipulation of the habituation circuits mapped in the first part does not arrive at any satisfying conclusion, which is acknowledged by the authors. These results do reinforce the disconnect between the calcium imaging and the behavioural experiments and undercut somewhat the proposed circuit-level model.

      We agree with this criticism and have toned down the focus on GABA specifically in the circuit, and have removed the speculative model previously in Figure 8.

      Overall, the authors did identify interesting new molecular pathways that may be involved in habituation to dark flashes. Their screening approach, while not novel, will be a powerful way to interrogate other behavioural profiles. The authors identified circuit loci apparently involved in habituation to dark flashes, and the potentiation and no adaptation clusters have not been previously observed as far as I know.

      The data will be useful to guide follow-up experiments by the community on the new pathway candidates that this screen has uncovered, including behaviours beyond dark flash habituation.

      We again thank the reviewer for both their support of our approach, and in pointing out where our conclusions were not well supported by our data.

      Reviewer #3 (Public Review):

      To analyze the circuit mechanisms leading to the habituation of the O-bed responses upon repeated dark flashes (DFs), the authors performed 2-photon Ca2+ imaging in larvae expressing nuclear-targeted GCaMP7f pan-neuronally panning the majority of the midbrain, hindbrain, pretectum, and thalamus. They found that while the majority of neurons across the brain depress their responsiveness during habituation, a smaller population of neurons in the dorsal regions of the brain, including the torus longitudinalis, cerebellum, and dorsal hindbrain, showed the opposite pattern, suggesting that motor-related brain regions contain non-depressed signals, and therefore likely contribute to habituation plasticity.

      Further analysis using affinity propagation clustering identified 12 clusters that differed both in their adaptation to repeated DFs, as well as the shape of their response to the DF.

      Next by the pharmacological screening of 1953 small molecule compounds with known targets in conjunction with the high-throughput assay, they found that 176 compounds significantly altered some aspects of measured behavior. Among them, they sought to identify the compounds that 1) have minimal effects on the naive response to DFs, but strong effects during the training and/or memory retention periods, 2) have minimal effects on other aspects of behaviors, 3) show similar behavioral effects to other compounds tested in the same molecular pathway, and identified the GABAA/C Receptor antagonists Bicuculline, Amoxapine, and Picrotoxinin (PTX). As partial antagonism of GABAAR and/or GABACR is sufficient to strongly suppress habituation but not generalized behavioral excitability, they concluded that GABA plays a very prominent role in habituation. They also identified multiple agonists of both Melatonin and Estrogen receptors, indicating that hormonal signaling may also play a prominent role in habituation response.

      To integrate the results of the Ca2+ imaging experiments with the pharmacological screening results, the authors compared the Ca2+ activity patterns after treatment with vehicle, PTX, or Melatonin in the tethered larvae. The behavioral effects of PTX and Melatonin were much smaller compared with the very strong behavioral effects in freely-swimming animals, but the authors assumed that the difference was significant enough to continue further experiments. Based on the hypothesis that Melatonin and GABA cooperate during habituation, they expected PTX and Melatonin to have opposite effects. This was not the case in their results: for example, the size of the 12(Pot, M) neuron population was increased by both PTX and Melatonin, suggesting that pharmacological manipulations that affect habituation behavior manifest in complex functional alterations in the circuit, making capturing these effects by a simple difficult.

      Since the 12(𝑃𝑜𝑡, 𝑀) neurons potentiate their responses and thus could act to progressively depress the responses of other neuronal classes, they examined the identity of these neurons with GABA neurons. However, GABAergic neurons in the habituating circuit are not characterized by their Adaptation Profile, suggesting that global manipulations of GABAergic signaling through PTX have complex manifestations in the functional properties of neurons.

      Overall, the authors have performed an admirably large amount of work both in whole-brain neural activity imaging and pharmacological screening. However, they are not successful in integrating the results of both experiments into an acceptably consistent interpretation due to the incongruency of the results of different experiments. Although the authors present some models for interpretation, it is not easy for me to believe that this model would help the readers of this journal to deepen the understanding of the mechanisms for habituation in DF responses at the neural circuit level.

      This reviewer would rather recommend the authors divide this manuscript into two and publish two papers by adding some more strengthening data for each part such as cellular manipulations, e.g. ablation to prove the critical involvement of 12(Pot, M) neurons in habituation.

      We thank the reviewer for their careful consideration of our manuscript, and we agree that our emphasis on a particular model of DF habituation, namely the potentiation of GABAergic synapses, was overly speculative. We hope they will agree that our revised manuscript better reflect the results from our experiments, and we have tried to more specifically emphasize the incongruency in our behavioural and Ca2+ imaging data after pharmacological treatment, which we agree shows that a simple model is insufficient to capture both of these sets of observations.

      We have opted not to split the paper into two, since we feel that the collective message of this paper and approach combining molecular and functional analysis will be of interest. Moreover, we feel that the molecular and functional analyses feed off of each other and provide a level of complementarity that would be lost if the manuscript would be split, even if the message in this particular case is rather complex

      Reviewer #1 (Recommendations For The Authors):

      There is much to commend about this manuscript. The advantages of studying habituation in the zebrafish larva are very clearly demonstrated, including the wonderful calcium imaging across the brain and the relatively high throughput screening of large numbers of different pharmacological agents. The habituation to dark flashes in freely moving larvae is also striking and the very large effect size serves the screening beautifully. Thus, if we take the really substantial amount of work of a very high standard that has been done here, there is clearly potential for an important new contribution to the literature. However, as you will see from my public review, I am of the opinion that a specific role for the modification of GABAergic inhibitory systems has not yet been established through this work. While the potential role for GABAergic inhibitory neurons in habituation, either as the key modifiable element or as an intermediary between memory and motor output, is an attractive theory with many strengths, your study as it currently stands does not categorically demonstrate that one of those two options holds. For instance, the more traditional view, that adaptive filtration is mediated by weakened synaptic connectivity between excitatory sensory systems and excitatory motor output or reduced intrinsic excitability in those same neurons, could still be in operation here. By lowering GABAergic influence over post-synaptic targets with picrotoxin, it is possible that motor output remains highly active, and even lower activity or synaptic drive from those excitatory sensory systems that feed into the output may still reliably produce behavioral output. Alternatively, it could be the formation of a memory of the familiar stimulus is disrupted by reduced inhibition that alters sensory coding either by introducing noise or reducing the selectivity of receptive fields. I believe that there are several options to address these concerns:

      1) You could change the emphasis of the manuscript so that it is less focused on inhibition and instead emphasizes the categorization of clusters of neurons that have divergent responses during habituation, including either strong suppression to potentiation. To this, you add a high throughput screening system with a wide range of different agents being tested, several of which produce a significant effect on habituation in either direction. These observations in themselves provide powerful building blocks for future work.

      2) If GABAergic neurons play a key role in habituation in this paradigm, then picrotoxin is having its effect by blocking receptors on excitatory neurons. Thus, it seems that selectively imaging GABAergic neurons before and after the application of these drugs is not likely to reveal the contribution of GABAergic synaptic influence on excitatory targets. More important is to get a stronger sense of how the GABAergic neurons change their activity throughout habituation and then influence the downstream target neurons of those GABAergic neurons (some of which may themselves be inhibitory and participating in disinhibition). For instance, you could interrogate whether anti-correlations in activity levels exist between presynaptic inhibitory neurons and putative post-synaptic targets. This analysis could be further bolstered by removing that relationship in the presence of Picrotoxin, thereby demonstrating a direct influence of inhibition from a GABAergic presynaptic partner on a postsynaptic target. While this would constitute a lot more work, it is likely to yield greater insight into a specific role for GABAergic neurons in habituation, and I suspect much of that information is in the existing datasets.

      3) To really reveal causal roles for inhibition in this form of habituation, it seems to me that there needs to be some selective intervention in GABAergic neuronal activity, ideally bidirectionally, to transiently interrupt or enhance habituation. Optogenetic or chemogenetic stimulation/inactivation is one option in this regard, which I imagine would be challenging to implement and certainly involves a lot of further work, particularly if you are then going to target specific subpopulations of GABAergic neurons. I appreciate that this option seems way beyond the scope of a review process and would probably constitute a follow-up study.

      We agree with the reviewer that we have not “categorically demonstrated” that GABAergic inhibitory neurons drive habituation by increasing their influence on the circuit, and appreciate the suggestions for how to reformulate our manuscript to better reflect this. We have opted to follow suggestion (1), and have considerably changed the focus of the manuscript.

      The additional analysis suggested in (2) is very interesting, but since we can not identify which cells are inhibitory in our imaging experiments with picrotoxinin treatment, nor which are pre- or post-synaptic, we feel that this analysis will be very unconstrained. Also, if GABA is acting as an inhibitory neurotransmitter, it therefore is expected to act to drive anticorrelations among pre and postsynaptic neurons through inhibition. Therefore, blockage of GABA through PTX would be expected to result in increased correlations, regardless of our hypothesized role of neurons during habituation. Our current efforts are aimed at identifying critical neurons driving habituation plasticity, and we will perform such analysis once we have mechanisms for identifying these neurons.

      Finally, we agree that (3) is the obvious and only way to demonstrate causation here, and this is where we are working towards. However, since we currently have no means of genetically targeting these neurons, we are not able to perform these suggested experiments today.

      I have some additional concerns that I would really appreciate you addressing:

      1) The behavioral habituation is striking in the freely moving larvae, but very hard to monitor in the larvae that are immobilized for calcium imaging. Are there steps that could be taken in the long run to improve direct observation of the habituation effect in these semi-stationary fish? For instance, is it possible to observe eye movements or some more subtle behavioral readout than the O-bend reflex? I apologize if this is a naïve question, but I am not entirely familiar with this specific experimental paradigm.

      In the Dark Flash paradigm, we do not have readouts beyond the “O-bend” response itself, which is characterized by a large-angle bend of the tail and turning maneuver. We have not observed other, more subtle behavioural responses, such as eye or fin movements, for example. If we would be able to identify alternative behavioural outputs that were more robustly performed during head-embedded preparations, this would indeed be an advantage allowing us to more directly interpret the Ca2+ imaging results with respect to behaviour.

      2) The dark flash as a stimulus to which the larvae habituate is obviously used as a powerful and ethologically relevant stimulus. However, it does leave an element of traditional habituation paradigms out, which is a novel stimulus that can be used to immediately re-instate the habituated response (otherwise known as dishabituation). Is there a way that you can imagine implementing that with zebrafish larvae, for instance through systematically altering a visual feature, such as spatial frequency or orientation? This would be a powerful development in my view as it would not only allow you to rule out motor or sensory fatigue as an underlying cause of reduced behavior but also it would provide an extra feature that strengthens your assessment of neuronal response profiles in candidate populations of inhibitory and excitatory neurons.

      We agree that identifying a dishabituating stimulus would be very powerful for our experiments. For short-term habituation of the acoustic startle response, Wolman et al demonstrated that dishabituation occurs after a touch stimulus (Wolman et al., PNAS, 2011; https://doi.org/10.1073/pnas.1107156108). We attempted to dishabituate the O-Bend response with tap and touch stimuli, and this unfortunately did not occur. Our understanding of dishabituation is that this generally requires a second stimulus that elicits the same behaviour as the habituated stimulus (e.g. both acoustic and touch-stimuli elicit the Mauthner-dependent C-bend response). In zebrafish the only stimulus that has been identified that elicits the O-bend is a dark-flash. This lack of an appropriate alternative stimulus is perhaps why we have been unsuccessful in identifying a dishabituating stimulus.

      3) You have written about the concept of 'short' and 'long' response shapes when using calcium imaging as a proxy for neural activity, surmising that the short response shape may reflect transient bursting. Although calcium imaging obviously has many advantages, this feature reveals one notable limitation of calcium imaging in contrast to electrophysiology, in that the time course of the signal is considerably longer and does not allow you with confidence to fully detect the response profile of neurons. Is there some kind of further deconvolution process that you could implement to improve the fidelity of your calcium imaging to the occurrence of action potentials? The burstiness of neurons is obviously important as it can indicate a particular type of neuron (for instance fast-spiking inhibitory neurons) or it might reveal a changing influence on post-synaptic neurons. For instance, bursting can be a response to inhibition due to the triggering of T-type calcium channels in response to hyperpolarization.

      One of the major limitations to Ca2+ imaging is the lack of temporal resolution. In our particular approach, using nuclear-targeted H2B-GCaMP indicators, further reduces our temporal resolution. Deconvolution approaches can be used in some instances to approximate spike rate, since the rise-time of Ca2+ indicators can be relatively fast. However, in our imaging we chose to image larger volumes at the expense of scan rate, where our imaging is performed at only 2hz. Therefore, deconvolution and spike-rate estimation is not appropriate. Considering these limitations, we would argue that the fact that we can observe differences in kinetics of the 'short' and 'long' response shapes indicates that they likely show very different response kinetics, which we hope to confirm by electrophysiology once we have established ways of targeting these neurons for recordings.

      4) I note that among the many substances you screened with is MK801. An obvious candidate mechanism in habituation is the NMDA receptor, given the importance of this receptor for so many forms of learning and bidirectional synaptic plasticity. If I am to understand correctly, this NMDA receptor blocker actually enhances habituation in the zebrafish larvae, similar to melatonin. That is a very surprising observation, which is worth looking into further or at least discussed in the manuscript. The finding would, at least, be consistent with the idea that plasticity is not occurring at excitatory synapses and could potentially bolster the argument that plasticity of inhibitory synapses is at play in this particular form of habituation.

      This is a very important point. We were also particularly interested in MK801, which has been shown to inhibit other forms of habituation, like short-term acoustic habituation (Wolman et al., PNAS, 2011; https://doi.org/10.1073/pnas.1107156108). In our experiments we did see that fish become even less responsive to dark flashes when treated with MK-801 (SSMD fingerprint data: Prob-Train = -0.39, Prob-Test = -1.58) which would indicate that MK-801 promotes dark flash habituation, similar to Melatonin. However, we also observed that MK-801 caused a decrease in the performance in the other visual assay we tested: the optomotor response (OMR-Perf = -0.93), indicating that MK-801 causes a generalized decrease in visual responses, perhaps by acting on circuits within the retina. Therefore, based on these experiments with global drug applications, we cannot determine if MK-801 influences the plasticity process in dark-flash habituation, and this is why we did not pursue it further in this project.

      Anyway, I hope that you take these suggestions as constructive and, in the spirit that they are intended, as possible routes for improving an already very interesting manuscript.

      We are very grateful for your suggestions, which we feel has helped us to improve our manuscript substantially.

      Reviewer #2 (Recommendations For The Authors):

      Overall, the manuscript is well-written, but confusing at times. The results are not always presented in a consistent way, and I found myself having to dig in the raw data or code to find answers. There is a certain disconnect between the free-swimming results, and the calcium imaging, which is somewhat inevitable based on other published work. But I am unsure of what they each bring to the other, as the results from Fig.6 do not match at all the changes observed in the behavioural assays, it almost feels like two separate studies and the inconsistencies make the model appear unlikely.

      We agree that there is a disconnect at the behavioural level in our free-swimming and head-embedded imaging experiments. However, this does not necessarily mean that the activity we observe during the imaging experiments cannot be informative about processes that are also occurring in freely-swimming fish. For example, it is possible that the dark-flash circuit is responding and habitating similarly in the head-embedded and freely-swimming preparations, but that in the latter context there is an additional blockade on motor output that massively decreases the propensity of the fish to initiate any movements. In such a case, the “disconnect between the free-swimming results, and the calcium imaging” would indicate that the relationship between neural activity and habituation behaviour is rather complex.

      Without a method to record activity from freely swimming fish at our disposal, we can not determine this, one way or the other.

      We hope that we now acknowledge these concerns appropriately in the discussion:

      “We also found that the same pharmacological treatments that result in strong alterations to habituation behaviour in freely swimming larvae ([fig:5]), resulted in relatively subtle and complex functional alterations in the circuit ([fig:6]). Making direct comparisons between freely-swimming behaviour and head-fixed Ca2+ imaging is always challenging due to the differences in behaviour observed in the two contexts, and therefore our failure to identify a clear logic in these experiments may have technical explanations that will require approaches to measure neural activity from unrestrained and freely-behaving animals to resolve . Alternatively, these results are again consistent with the idea that habituation is a multidimensional and perhaps highly non-linear phenomenon in the circuit, which cannot be captured by a simple model. “

      I am not convinced by the results surrounding GABA, from the inconsistent GABA receptor antagonist profile to the post hoc identification of GABAergic neurons as it is currently done in the manuscript. I think that the current focus on GABA does a disservice to the manuscript. However, the novel findings surrounding the potential role of Melatonin, and Estrogen, in habituation are quite interesting.

      We agree that we focused too heavily on our hypothesized role for GABA in our original manuscript, and we hope that the reviewer agrees that our updated manuscript is an improvement. We also thank the reviewer for their interest in our Melatonin and Estrogen results, for which follow up studies are ongoing to characterize the effects of these hormones and their receptors on habituation.

      There is an assumption that all the adaptation profiles are related to the DF (although that is somewhat alleviated in the discussions of the ON responses) and not to the luminosity changes. But there is no easy way to deconvolve those two in the current experiments. I would like the timing of the fluorescence rise to be quantified compared to the dark flash stimulus onset, potentially spike inference methods could help with giving a better idea of the timing of those responses. Based on the behavioural responses that were <500ms in Randlet O et al, eLife, 2019; we would expect only the fastest DF responses to be linked to the behaviour.

      We agree that we are unable to disambiguate responses to the dark flash that initiate the O-bend response, and those that are related to only changes in luminosity. As discussed above, our Ca2+ imaging approach is severely limited in temporal resolution and therefore spike inference methods are not appropriate.

      Major comments

      Fig.1: There seems to be a very variable lag between the motor events and DF responses, furthermore, it does not seem that the motor responses follow a similar habituation rate as in 1Bi. Although this only shows the smoothed 'movement cluster' from the rastermap, it could hide individual variability. It would be important to know what the 'escape' rate was in the embedded experiment, as

      Fig.1 sup.1 seems to indicate there was little to no habituation. It would also be needed to know which motor events are considered linked to the DF stimulus, and how that was decided. Was there a movement intensity threshold and lag limit in the response?

      We interpret this concern as relating to the data presented in Figure 6A, where we quantify the habituation rate in the head-embedded experiments. As we have discussed, both above and in the manuscript, we saw very strongly muted responses to DFs in the head-embedded preparation, but we neglected to describe our method of quantifying the responses. We have added the following description to the methods:

      “To quantify responses to the dark flash stimuli we used motion artifacts in the imaging data to identify frames associated with movements ([fig:1]-[fig:S1]). Motion artifact was quantified using the “corrXY” parameter from suite2p, which reflects the peak of phase correlation comparing each acquired frame and reference image used for motion correction. The “motion power” was quantified as the standard deviation of a 3-frame rolling window, which was smoothed in time using a Savitzky-Golay filter (window length = 15 frames, polyorder = 2). A response to a dark flash was defined as a “motion power” signal greater than 3 (z-score) occurring within 10-seconds of the dark-flash onset, and was used to quantify habituation in the head-embedded preparation ([fig:6]A).“

      Line 94: This seems to be a strong claim based on the sparse presence of non-habituating, or potentiating, neurons in downstream regions. However, these neurons appear to be extremely rare, and as mentioned in my comment above, the behavioural habituation appears minimal. These neurons could encode the luminosity and be part of other responses, such as light-seeking in Karpenko S et al, eLife, 2020 or escape directionality in Heap et al, Neuron, 2018. Furthermore, dimming information has been shown to have parallel processing pathways in Robles E et al, JCN, 2020; so it would make sense that not all the observed responses in this manuscript would be involved in behavioural habituation to dark flashes.

      We agree that without functional interventions, we do not know which of the neurons we have categorized are specifically involved in the dark flash response habituation. It is possible that the non-adapting and potentiating neurons are involved in other behaviours. We have therefore removed this statement.

      Line 103: It appears that several of those responses are to the changes in luminosity and not the DF itself, especially the ON and sustained responses. Based on the previous DF habituation study from Randlet O et al, eLife, 2019; the latency of the response is below 0.5s. So the behaviour-relevant responses must only include the shortest latency one, as discussed above.

      We appreciate the point that the reviewer is making here, but we are less clear about what the difference between “changes in luminosity” and a “dark flash” response are, since a dark flash consists of a change in luminosity. We take it that the reviewer means the difference between a luminance stimulus that elicits an O-bend, from one that does not. In order to disambiguate the two, one would likely need to use stimuli where the luminosity changes, but do not elicit O-bends.

      Perhaps due to the limited temporal resolution of our Ca2+ imaging data, we do not see a clear difference in the onset of the stimulus response for any of the functional clusters that would help us to determine which neurons are more relevant to the acute DF response.

      Fig.2B. It is very difficult to make out the actual average z-scored fluorescence, a supplementary figure would help by making these bigger. A plot to quantify the maximum response would also be useful to judge how it changes between the first few and few last DF. Another plot to give the time between the onset of the responses and the onset of the DF stimulus is also needed to judge which cluster may be relevant to the DF escapes observed in the free-swimming experiments.

      We agree with the reviewer that interpreting these datasets are challenging. We did include the actual average z-scored fluorescence in Figure 6—figure supplement 1, panel D. This figure also includes a comparison between the predicted Ca2+ response to the dark flash (the stimulus convolved with the approximate GCaMP response kernel), which shows that all OFF-responding neuronal classes show very similar rise time response kinetics, and thus this analysis does not help to judge whether a cluster is more or less relevant to O-bend responses in the free-swimming experiments. We appreciate that there are differences in opinion about the best way to present the data, but we have opted to leave our original presentation.

      Line 130: Is a correlation below 0.1 meaningful or significant? It does not seem like this cluster would be a motor or decision cluster.

      Our goal with this correlational analysis to motor signals was to identify if certain clusters of DF responsive neurons were more associated with motor output, and therefore may be more downstream in the sensori-motor cascade. Cluster 4 showed the highest median correlation across the population of cells. Whether a median correlation of ~0.1 is “meaningful” is impossible for us to answer, but it is highly “significant” in the statistical sense, as is evident by the 99.99999% confidence intervals plotted. We note that these cells were not selected based on their correlation to the motor stimulus, but only to the dark flash stimulus. There are “motor” clusters that show much higher correlations to the motors signals, as is evident in Figure 1G.

      Line 165: Did the changes observed for Pimozide fall below the significance threshold, were lethal, or were the results not repeated? It does not appear in source data 2.

      Pimozide was lethal in our screen and therefore does not appear in the source data file. Indeed, in our previous experiments with Pimozide we had already established that a 10uM dose is lethal, and that the maximal effective dose we tried was 1uM as reported in (Randlett et al., Current Biology, 2019).

      We have clarified this in the text:

      “While the false negative rate is difficult to determine since so little is known about the pharmacology of the system, we note that of the three small molecules we previously established to alter dark flash habituation that were included in the screen, Clozapine, Haloperidol and Pimozide , the first two were identified among our hits while Pimozide was lethal at the 10\muM screening concentration.”

      Fig.1B and Fig.3B are the same data, which is awkward and should be explicitly stated. But the legends do not match in terms of the rest period. Which is correct? It is also important to note the other behavioural assays in the 'rest' period.

      We thank the reviewer for pointing out this discrepancy in the legend. We have corrected the typo in the figure legend of Figure 3B :

      “Habituation results in a progressive decrease in responsiveness to dark flashes repeated at 1-minute intervals, delivered in 4 training blocks of 60 stimuli, separated by 1hr of rest (from 0:00-7:00).”

      We have also added a statement that the data is the same as that in Figure 1B.

      Figure 3-4: SSMD fingerprint, there is no description of the different behavioural parameters. What they represent is left to the reader's inference. There is no mention of SpontDisp in the GitHub for example, so it is hard to know how these different parameters were measured. Even referring to the previous manuscript on habituation (Randlet O et al, eLife, 2019) does not shed light on most of them, for example, I suppose TwoMvmt represents the 'double responses' from the previous manuscript. Furthermore, there are inconsistencies between 3C and 4B, some minor (SpontDisp becomes SpntDisp), but Curve-Tap has disappeared for example, and I suspect became BendAmp-Tap. A more thorough description of these measures, and making the naming scheme consistent, are essential for readers to know what they are looking at.

      We again thank the reviewer for their careful assessment of our data, and we apologize for this sloppiness. We have gone through and made the naming of these parameters consistent in both figures, and have added another supplementary table that describes in more detail what each parameter is, and how it relates to the analysis code (Figure3_sourcedata3_SSMDFingerprintParameters.xls). This was an essential missing piece of information from our original manuscript.

      Line 206: While this prioritization makes sense, how was it implemented, how was the threshold decided and which were they? A table, or supplementary figure, would help to clarify the reason behind the choices. Fig.4C being cropped only around the response probability makes it impossible to judge if the criteria were respected, as the main heatmap is too small. For example, the choice of GABA receptor antagonists is somewhat puzzling, as besides PTX it does not seem that the other compounds had strong effects, with Amoxapine for example having seemingly as much effect on Naive and Train, with little in Test. And Bicuculline gave negative SSMD for prob in the three cases. The dose-response for PTX does lend credence to its effect, but I would have liked the other compounds, especially bicuculline. The melatonin results, for example, are much more convincing and interesting in our opinion.

      While in hindsight it may have been possible to do the hit prioritization in a systematic way using thresholding and ranking, we did this manually by inspecting the clustered fingerprints. We have clarified this in the text: “This manual prioritization led to the identification of the GABAA/C Receptor antagonists…”

      While we agree that it is not possible to judge how well we performed this prioritization based on the images presented, we note that we do provide the full fingerprint data in the supplementary data, for which the reader is welcome to draw their own conclusions.

      We have not performed further experiments with amoxapine, so we can not comment further on this. We did perform additional experiments with bicuculline, for which we did see effects similar to those of PTX, were habituation was inhibited. However, the effects are weaker and more variable than what we observe with PTX, and bicuculline also inhibits the initial responses of the larvae, causing their Naive response to be lower. Therefore we did not include it in our manuscript. We include these data here in Author response image 1 to reassure the Reviewer that picrotoxinin is not the only GABA Receptor antagonist for which we see inhibitory effects on habituation.

      Author response image 1.

      Fig.6: Why was the melatonin concentration used only 1um instead of 10um on the screen?

      Based on dose response experiments (Figure 5B, and others not shown), we found that the effect of Melatonin on habituation saturates at about 1uM, and therefore we used this dose.

      Line 277: As the correlation with motor output is marginal at best, and the authors recognize the lack of behaviour in tethered animals, I would be careful about such speculation. Especially since the other changes are complex and go in all directions.

      While we appreciate the reviewer's caution, we feel that our statement is appropriately hedged using “might be”. We have also removed the statement “and thus is most closely associated with behavioural initiation”.

      We now state:

      “However, opposite effects of PTX and Melatonin were observed for 4_L^{strgD} neurons ([fig:6]C), which we found to be most strongly correlated with motor output ([fig:2]F). Therefore, this class might be most critical for habituation of response Probability.”

      Fig.7: I am not sure how convincing these results are. 7F may have been more convincing, but to be thorough the authors would need to register the Gad1b identity to the calcium imaging and use their outline to extract the neuron's fluorescence. As it is, in the tectum, it is hard to be sure that all the identified neurons are indeed Gad1b positive, as that population is intermingled with other neuronal populations. The authors should consider the approach of Lovett-Barron M et al, Nat Neuro, 2020. Alternatively, the authors can tone down the language used in this section to match the confidence level of the association they propose.

      Figure 7A-E are what can be considered “virtual colocalization” analyses, where we are comparing the localization of data acquired in different experiments using image registration to common atlas coordinates. We agree that these results alone will never be very strong evidence for the identification of individual cells. The MultiMAP approach of Lovett-Barron is a powerful approach, though it makes the assumption that registration accuracy will be subcellular, which in practice may often not be the case. We believe that a better approach is to label the cells of interest during the Ca2+ imaging experiment itself, as we did 7F and G. The challenge in this experiment is binarizing the ROIs and thus deciding what is and is not a Gad1b-positive cell. In our opinion, the fact that these two independent experiments came to the same conclusion regarding Cluster 10 and 11 is good evidence that these cell types are likely predominantly GABAergic.

      As discussed above, we have re-written the manuscript to tone down our claims about the role of GABA and GABAergic neurons in habituation, which we hope the reviewer will agree better reflects the limitations of the data in Figure 6 and 7.

      Line 317: Based on the somewhat inconsistent results of the other GABA antagonists, I would be careful. Picrotoxin has been reported to antagonize other receptors besides GABA, see Das P et al, Neuropharma, 2003. So the results may be explained by a complex set of effects on multiple pathways with PTX.

      Off target effects are an important concern with any pharmacological experiment, and perhaps especially in zebrafish where receptors and targets can be quite divergent from those in mammals where most drug targets have been characterized. We have added this sentiment to the discussion:

      “We cannot rule out the possibility that off-targets of PTX, or subtle non-specific changes in excitatory/inhibitory balance alter habituation behaviour.”

      Line 400-403, 430: There are some conflicting statements regarding the potential role of clusters 1 and 2 in DF habituation. Do the authors think they play a role in the behaviour measured in this manuscript? Could they clarify what they mean?

      We see how our original statement in line 429 about the presence of cluster 1 and 2 neurons in the TL implied a role in dark flash habituation. This was not our intent, and we have removed “which also contains high concentrations of on-responding neurons”.

      Our thoughts on these neurons are now stated in the discussion as:

      “We also observed classes exhibiting an On-response profile ( and ). These neurons fire at the ramping increase in luminance after the DF, making it unlikely that they play a role in aspects of acute DF behaviour we measured here. These neurons exist in both non-adapting and depressing forms suggesting a yet unidentified role in behavioural adaptation to repeated DFs.“

      Minor comments

      Line 73 (and elsewhere): Why use adaptation instead of habituation (also in the adaptation profile)? Do you suspect your observations do not reflect habituation, but a sensory adaptation mechanism?

      We have used the convention that “habituation” refers to observations at the behavioural level, while “depression” and “potentiation” refer to observations at the neuronal level. We use the term “adaptation” to refer to neuronal adaptations of either sign (depression or potentiation), as in line 73.

      We believe that our observations reflect neuronal adaptations that underlie habituation behaviour.

      Line 71: It is debatable that the strongest learning happens in the first block, the difference between the first and last response seems to grow larger with each successive block. What do the authors mean by 'strongest'

      We agree that “strongest” was ambiguous. We have changed this to “initial”:

      “We focused on a single training block of 60 DFs to identify neuronal adaptations that occur during the initial phase of learning ”

      Fig.1F: there is no rastermap call in the GitHub repository, was the embedding done in the GUI? If so, it should also be shared for reproducibility's sake.

      Yes, Fig.1F was created using the suite2p GUI, as we have now clarified in the methods:

      “The clustered heatmap image of neural activity (([fig:3]F) was generated using the suite2p GUI using the “Visualize selected cells” function, and sorting the neurons using the rastermap algorithm ”

      The image is available in the “Figure1 - Ca2Imaging.svg” file available here: https://github.com/owenrandlett/lamire_2022/tree/main/LamireEtAl_2022

      Line 101: while true that AffinityPropagation does not require input on the number of clusters, preference can influence the number of clusters. It seems that at least two values were tested in the search for the clusters, can the authors comment on how many clusters the other preference value converged (or failed to converge) on?

      Indeed, as with any clustering approach, the resultant clusters are highly dependent on the input parameters, in this case the “preference”, as well as “damping” and the choice of affinity metric. By varying these parameters one can arrive at anywhere between 2 and hundreds of clusters.

      It is for this reason that we feel that the anatomical analyses of these clusters is very important, making the assumption that neurons of differing functional types will have different localizations in the brain, as we explained in the Results:

      “While these results indicate the presence of a dozen functionally distinct neuron types, such clustering analyses will force categories upon the data irrespective of if such categories actually exist. To determine if our cluster analyses identified genuine neuron types, we analyzed their anatomical localization ([fig:2]C-E). Since our clustering was based purely on functional responses, we reasoned that anatomical segregation of these clusters would be consistent with the presence of truly distinct types of neurons.”

      We also acknowledge in the Results that the clustering approach has limitations:

      “These results highlight a diversity of functional neuronal classes active during DF habituation. Whether there are indeed 12 classes of neurons, or if this is an over- or under-estimate, awaits a full molecular characterization. Independent of the precise number of neuronal classes, we proceed under the hypothesis that these clusters define neurons that play distinct roles in the DF response and/or its modulation during habituation learning“

      Fig.2. My understanding is that the cluster numbers are arbitrary unless there is a meaning to them, which then should be explained. I would recommend grouping the clusters per functional category as in Fig.6 to make it easier for the reader.

      Cluster number reflects the ordering in the hierarchical clustering tree shown in Figure 2B. We feel that this is the most logical representation of their functional similarity. We have clarified this in the Methods:

      “ We then used the Affinity Propagation clustering from scikit-learn , with “affinity” computed as the Pearson product-moment correlation coefficients (corrcoef in NumPy ), preference=-9, and damping=0.9, and clustered using Hierarchical clustering (cluster.hierarchy in SciPy ). Cluster number was assigned based on the ordering of the hierarchical clustering tree. ”

      Fig.3 SSMD fingerprint, it would be much easier for the readers if the list of parameters was clearer and rotated 90 degrees. Maybe in a supplementary figure to show what each represents.

      We agree that the SSMD fingerprint is very difficult to interpret. As discussed above, we have now included a supplementary table (Figure3_sourcedata2_SSMDFingerprintParameters.xlsx) where we have clarified what each parameter represents.

      Fig.4: The use of the same colours across the clustering methods is confusing, especially after the use of colours for the SSMD fingerprint in Fig.3. and at the bottom of 4A. Fig.4A for example could have been colour coded according to the most affected behaviour in the fingerprint at the bottom.

      Fig.4B the coloured text is difficult to read, especially for the lighter colours.

      We agree that our use of color is not perfect, but we have attempted to use them consistently: for example when referring to a functional cluster, or a drug manipulation. We don’t think that there is a sufficient number of distinguishable colors for us to never use the same color twice.

      Fig.4C if the goal is to show similarity, the relevant drugs could be placed adjacent to each other. One could also report the Euclidean distance, or compute how correlated the different fingerprints are within one pharmacological target space.

      The goal of Fig 4C is to highlight where Bicuculline, Amoxapine, Picrotoxinin, Melatonin, Ethinyl Estradiol and Hexestrol lie within the clustered heatmap of the behavioural fingerprints (Fig 4A), and<br /> demonstrate how the probability of response to dark flashes is modulated by these drugs. In our analyses, “similarity” is a function of the clustering distance.

      Fig.6D 'Same data as M, ...' I assume should be 'Same data as C,...'

      Indeed, thank you for pointing out this error that we have corrected.

      Fig. 7 How many GCaMP6s double transgenic larvae were imaged?

      6 fish were imaged, as is stated in the legend to Fig 7G

      Line 407: all is repeated.

      We apologize, but we do not see what is repeated at line 407. Can you please clarify?

      Line 481: Would testing spontaneous activity after training for 7h be unbiased, could there be fatigue effects?

      We tested for fatigue effects in our previous study, comparing larvae that received the training for 7hrs and those that did not, and we saw no deficits in spontaneous activity, tap response, or OMR performance (Figure S1, Randlett et al., Current Biology, 2019).

      Line 610: There are some inconsistencies between the authors' contributions in the manuscript and the one provided to eLife.

      Thank you, we will double check this in the resubmission forms. The authors' contributions in the manuscript are correct.

      Reviewer #3 (Recommendations For The Authors):

      I would rather recommend the authors divide this manuscript into two and publish two papers by adding some more strengthening data for each part such as cellular manipulations, e.g. ablation to prove the critical involvement of 12(Pot, M) neurons in habituation.

      We thank the reviewer for their suggestion, but have opted not to split the paper into two. We feel that the collective message of this paper and approach combining molecular and functional analysis will be of interest, and we believe the incongruencies in our results reflects the complexity inherent within the system.

    1. Author Response

      The following is the authors’ response to the original reviews.

      Thank you for the detailed and constructive reviews. We revised the paper accordingly, and a point-by-point reply appears below. The main changes are:

      • An extended discussion section that places our work in context with other related developments in theory and modeling.

      • A new results section that demonstrates a substantial improvement in performance from a non-linear activation function. This led to addition of a co-author.

      • The mathematical proof that the resolvent of the adjacency matrix leads to the shortest path distances has been moved to a separate article, available as a preprint and attached to this resubmission. This allows us to present that work in the context of graph theory, and focus the present paper on neural modeling.

      Reviewer #1 (Public Review):

      This paper presents a highly compelling and novel hypothesis for how the brain could generate signals to guide navigation towards remembered goals. Under this hypothesis, which the authors call "Endotaxis", the brain co-opts its ancient ability to navigate up odor gradients (chemotaxis) by generating a "virtual odor" that grows stronger the closer the animal is to a goal location. This idea is compelling from an evolutionary perspective and a mechanistic perspective. The paper is well-written and delightful to read.

      The authors develop a detailed model of how the brain may perform "Endotaxis", using a variety of interconnected cell types (point, map, and goal cells) to inform the chemotaxis system. They tested the ability of this model to navigate in several state spaces, representing both physical mazes and abstract cognitive tasks. The Endotaxis model performed reasonably well across different environments and different types of goals.

      The authors further tested the model using parameter sweeps and discovered a critical level of network gain, beyond which task performance drops. This critical level approximately matched analytical derivations.

      My main concern with this paper is that the analysis of the critical gain value (gamma_c) is incomplete, making the implications of these analyses unclear. There are several different reasonable ways in which the Endotaxis map cell representations might be normalized, which I suspect may lead to different results. Specifically, the recurrent connections between map cells may either be an adjacency matrix, or a normalized transition matrix. In the current submission, the recurrent connections are an unnormalized adjacency matrix. In a previous preprint version of the Endotaxis manuscript, the recurrent connections between the map cells were learned using Oja's rule, which results in a normalized state-transition matrix (see "Appendix 5: Endotaxis model and the successor representation" in "Neural learning rules for generating flexible predictions and computing the successor representation", your reference 17). The authors state "In summary, this sensitivity analysis shows that the optimal parameter set for endotaxis does depend on the environment". Is this statement, and the other conclusions of the sensitivity analysis, still true if the learned recurrent connections are a properly normalized state-transition matrix?

      Yes, this is an interesting topic. In v.1 of our bioRxiv preprint we used Oja’s rule for learning, which will converge on a map connectivity that reflects the transition probabilities. The matrix M becomes a left-normalized or right-normalized stochastic matrix, depending on whether one uses the pre-synaptic or the post-synaptic version of Oja’s rule. This is explained well in Appendix 5 of Fang 2023.

      In the present version of the model we use a rule that learns the adjacency matrix A, not the transition matrix T. The motivation is that we want to explain instances of oneshot learning, where an agent acquires a route after traversing it just once. For example, we had found experimentally that mice can execute a complex homing route on the first attempt.

      An agent can establish whether two nodes are connected (adjacency) the very first time it travels from one node to the other. Whereas it can evaluate the transition probability for that link only after trying this and all the other available links on multiple occasions. Hence the normalization terms in Oja’s rule, or in the rule used by Fang 2023, all involve some time-averaging over multiple visits to the same node. This implements a gradual learning process over many experiences, rather than a one-shot acquisition on the first experience.

      Still one may ask whether there are advantages to learning the transition matrix rather than the adjacency matrix. We looked into this with the following results:

      • The result that (1/γ − A)−1 is monotonically related to the graph distances D in the limit of small γ (a proof now moved to the Meister 2023 preprint) , holds also for the transition matrix T. The proof follows the same steps. So in the small gain limit, the navigation model would work with T as well.

      • If one uses the transition matrix to compute the network output (1/γ − T)-1 then the critical gain value is γc = 1. It is well known that the largest eigenvalue of any Markov transition matrix is 1, and the critical gain γc is the inverse of that. This result is independent of the graph. So this offers the promise that the network could use the same gain parameter γ regardless of the environment.

      • In practice, however, the goal signal turned out to be less robust when based on T than when based on A. We illustrate this with the attached Author response image 1. This replicates the analysis in Figure 3 of the manuscript, using the transition matrix instead of the adjacency matrix. Some observations:

      • Panel B: The goal signal follows an exponential dependence on graph distance much more robustly for the model with A than with T. This holds even for small gain values where the exponential decay is steep.

      • Panel C: As one raises the gain closer to the critical value, the goal signal based on T scatters much more than when based on A.

      • Panels D, E: Navigation based on A works better than based on T. For example, using the highest practical gain value, and a readout noise of ϵ = 0.01, navigation based on T has a range of only 8 steps on this graph, whereas navigation based on A ranges over 12 steps, the full size of this graph.

      We have added a section “Choice of learning rule” to explain this. The Author response image 1 is part of the code notebook on Github.

      Author response image 1.

      Overall, this paper provides a very compelling model for how neural circuits may have evolved the ability to navigate towards remembered goals, using ancient chemotaxis circuits.

      This framework will likely be very important for understanding how the hippocampus (and other memory/navigation-related circuits) interfaces with other processes in the brain, giving rise to memory-guided behavior.

      Reviewer #2 (Public Review):

      The manuscript presents a computational model of how an organism might learn a map of the structure of its environment and the location of valuable resources through synaptic plasticity, and how this map could subsequently be used for goal-directed navigation.

      The model is composed of 'map cells', which learn the structure of the environment in their recurrent connections, and 'goal-cell' which stores the location of valued resources with respect to the map cell population. Each map cell corresponds to a particular location in the environment due to receiving external excitatory input at this location. The synaptic plasticity rule between map cells potentiates synapses when activity above a specified threshold at the pre-synaptic neuron is followed by above-threshold activity at the post-synaptic neuron. The threshold is set such that map neurons are only driven above this plasticity threshold by the external excitatory input, causing synapses to only be potentiated between a pair of map neurons when the organism moves directly between the locations they represent. This causes the weight matrix between the map neurons to learn the adjacency for the graph of locations in the environment, i.e. after learning the synaptic weight matrix matches the environment's adjacency matrix. Recurrent activity in the map neuron population then causes a bump of activity centred on the current location, which drops off exponentially with the diffusion distance on the graph. Each goal cell receives input from the map cells, and also from a 'resource cell' whose activity indicates the presence or absence of a given values resource at the current location. Synaptic plasticity potentiates map-cell to goal-cell synapses in proportion to the activity of the map cells at time points when the resource cell is active. This causes goal cell activity to increase when the activity of the map cell population is similar to the activity where the resource was obtained. The upshot of all this is that after learning the activity of goal cells decreases exponentially with the diffusion distance from the corresponding goal location. The organism can therefore navigate to a given goal by doing gradient ascent on the activity of the corresponding goal cell. The process of evaluating these gradients and using them to select actions is not modelled explicitly, but the authors point to the similarity of this mechanism to chemotaxis (ascending a gradient of odour concentration to reach the odour source), and the widespread capacity for chemotaxis in the animal kingdom, to argue for its biological plausibility.

      The ideas are interesting and the presentation in the manuscript is generally clear. The two principle limitations of the manuscript are: i) Many of the ideas that the model implements have been explored in previous work. ii) The mapping of the circuit model onto real biological systems is pretty speculative, particularly with respect to the cerebellum.

      Regarding the novelty of the work, the idea of flexibly navigating to goals by descending distance gradients dates back to at least Kaelbling (Learning to achieve goals, IJCAI, 1993), and is closely related to both the successor representation (cited in manuscript) and Linear Markov Decision Processes (LMDPs) (Piray and Daw, 2021, https://doi.org/ 10.1038/s41467-021-25123-3, Todorov, 2009 https://doi.org/10.1073/pnas.0710743106). The specific proposal of navigating to goals by doing gradient descent on diffusion distances, computed as powers of the adjacency matrix, is explored in Baram et al. 2018 (https://doi.org/10.1101/421461), and the idea that recurrent neural networks whose weights are the adjacency matrix can compute diffusion distances are explored in Fang et al. 2022 (https://doi.org/10.1101/2022.05.18.492543). Similar ideas about route planning using the spread of recurrent activity are also explored in Corneil and Gerstner (2015, cited in manuscript). Further exploration of this space of ideas is no bad thing, but it is important to be clear where prior literature has proposed closely related ideas.

      We have added a discussion section on “Theories and models of spatial learning” with a survey of ideas in this domain and how they come together in the Endotaxis model.

      Regarding whether the proposed circuit model might plausibly map onto a real biological system, I will focus on the mammalian brain as I don't know the relevant insect literature. It was not completely clear to me how the authors think their model corresponds to mammalian brain circuits. When they initially discuss brain circuits they point to the cerebellum as a plausible candidate structure (lines 520-546). Though the correspondence between cerebellar and model cell types is not very clearly outlined, my understanding is they propose that cerebellar granule cells are the 'map-cells' and Purkinje cells are the 'goal-cells'. I'm no cerebellum expert, but my understanding is that the granule cells do not have recurrent excitatory connections needed by the map cells. I am also not aware of reports of place-field-like firing in these cell populations that would be predicted by this correspondence. If the authors think the cerebellum is the substrate for the proposed mechanism they should clearly outline the proposed correspondence between cerebellar and model cell types and support the argument with reference to the circuit architecture, firing properties, lesion studies, etc.

      On further thought we agree that the cerebellum-like circuits are not a plausible substrate for the endotaxis algorithm. The anatomy looks compelling, but plasticity at the synapse is anti-hebbian, and - as the reviewer points out - there is little evidence for recurrence among the inputs. We changed the discussion text accordingly.

      The authors also discuss the possibility that the hippocampal formation might implement the proposed model, though confusingly they state 'we do not presume that endotaxis is localized to that structure' (line 564).

      We have removed that confusing bit of text.

      A correspondence with the hippocampus appears more plausible than the cerebellum, given the spatial tuning properties of hippocampal cells, and the profound effect of lesions on navigation behaviours. When discussing the possible relationship of the model to hippocampal circuits it would be useful to address internally generated sequential activity in the hippocampus. During active navigation, and when animals exhibit vicarious trial and error at decision points, internally generated sequential activity of hippocampal place cells appears to explore different possible routes ahead of the animal (Kay et al. 2020, https://doi.org/10.1016/j.cell.2020.01.014, Reddish 2016, https:// doi.org/10.1038/nrn.2015.30). Given the emphasis the model places on sampling possible future locations to evaluate goal-distance gradients, this seems highly relevant.

      In our model, the possible future locations are sampled in real life, with the agent moving there or at least in that direction, e.g. via VTE movements. In this simple form the model has no provision for internal planning, and the animal never learns any specific route sequence. One can envision extending such a model with some form of sequence learning that would then support an internal planning mechanism. We mention this in the revised discussion section, along with citation of these relevant articles.

      Also, given the strong emphasis the authors place on the relationship of their model to chemotaxis/odour-guided navigation, it would be useful to discuss brain circuits involved in chemotaxis, and whether/how these circuits relate to those involved in goal-directed navigation, and the proposed model.

      The neural basis of goal-directed navigation is probably best understood in the insect brain. There the locomotor decisions seem to be initiated in the central complex, whose circuitry is getting revealed by the fly connectome projects. This area receives input from diverse sensory areas that deliver the signal on which the decisions are based. That includes the mushroom body, which we argue has the anatomical structure to implement the endotaxis algorithm. It remains a mystery how the insect chooses a particular goal for pursuit via its decisions. It could be revealing to force a change in goals (the mode switch in the endotaxis circuit) while recording from brain areas like the central complex. Our discussion now elaborates on this.

      Finally, it would be useful to clarify two aspects of the behaviour of the proposed algorithm:

      1) When discussing the relationship of the model to the successor representation (lines 620-627), the authors emphasise that learning in the model is independent of the policy followed by the agent during learning, while the successor representation is policy dependent. The policy independence of the model is achieved by making the synapses between map cells binary (0 or 1 weight) and setting them to 1 following a single transition between two locations. This makes the model unsuitable for learning the structure of graphs with probabilistic transitions, e.g. it would not behave adaptively in the widely used two-step task (Daw et al. 2011, https://doi.org/10.1016/ j.neuron.2011.02.027) as it would fail to differentiate between common and rare transitions. This limitation should be made clear and is particularly relevant to claims that the model can handle cognitive tasks in general. It is also worth noting that there are algorithms that are closely related to the successor representation, but which learn about the structure of the environment independent of the subjects policy, e.g. the work of Kaelbling which learns shortest path distances, and the default representation in the work of Piray and Daw (both referenced above). Both these approaches handle probabilistic transition structures.

      Yes. Our problem statement assumes that the environment is a graph with fixed edge weights. The revised text mentions this and other assumptions in a new section “Choice of learning rule”.

      2) As the model evaluates distances using powers of adjacency matrix, the resulting distances are diffusion distances not shortest path distances. Though diffusion and shortest path distances are usually closely correlated, they can differ systematically for some graphs (see Baram et al. ci:ted above).

      The recurrent network of map cells implements a specific function of the adjacency matrix, namely the resolvent (Eqn 7). We have a mathematical proof that this function delivers the shortest graph distances exactly, in the limit of small gain (γ in Eqn 7), and that this holds true for all graphs. For practical navigation in the presence of noise, one needs to raise the gain to something finite. Figure 3 analyzes how this affects deviations from the shortest graph distance, and how nonetheless the model still supports effective navigation over a surprising range. The mathematical details of the proof and further exploration of the resolvent distance at finite gain have been moved to a separate article, which is cited from here, and attached to the submission. The preprint by Baram et al. is cited in that article.

      Reviewer #3 (Public Review):

      This paper argues that it has developed an algorithm conceptually related to chemotaxis that provides a general mechanism for goal-directed behaviour in a biologically plausible neural form.

      The method depends on substantial simplifying assumptions. The simulated animal effectively moves through an environment consisting of discrete locations and can reliably detect when it is in each location. Whenever it moves from one location to an adjacent location, it perfectly learns the connectivity between these two locations (changes the value in an adjacency matrix to 1). This creates a graph of connections that reflects the explored environment. In this graph, the current location gets input activation and this spreads to all connected nodes multiplied by a constant decay (adjusted to the branching number of the graph) so that as the number of connection steps increases the activation decreases. Some locations will be marked as goals through experiencing a resource of a specific identity there, and subsequently will be activated by an amount proportional to their distance in the graph from the current location, i.e., their activation will increase if the agent moves a step closer and decrease if it moves a step further away. Hence by making such exploratory movements, the animal can decide which way to move to obtain a specified goal.

      I note here that it was not clear what purpose, other than increasing the effective range of activation, is served by having the goal input weights set based on the activation levels when the goal is obtained. As demonstrated in the homing behaviour, it is sufficient to just have a goal connected to a single location for the mechanism to work (i.e., the activation at that location increases if the animal takes a step closer to it); and as demonstrated by adding a new graph connection, goal activation is immediately altered in an appropriate way to exploit a new shortcut, without the goal weights corresponding to this graph change needing to be relearnt.

      As the reviewer states, allowing a graded strengthening of multiple synapses from the map cells increases the effective range of the goal signal. We have now confirmed this in simulations. For example, in the analysis of Fig 3E, a single goal synapse enables perfect navigation only over a range of 7 steps, whereas the distributed goal synapses allow perfect navigation over the full 12 steps. This analysis is included in the code notebook on Github.

      Given the abstractions introduced, it is clear that the biological task here has been reduced to the general problem of calculating the shortest path in a graph. That is, no real-world complications such as how to reliably recognise the same location when deciding that a new node should be introduced for a new location, or how to reliably execute movements between locations are addressed. Noise is only introduced as a 1% variability in the goal signal. It is therefore surprising that the main text provides almost no discussion of the conceptual relationship of this work to decades of previous work in calculating the shortest path in graphs, including a wide range of neural- and hardwarebased algorithms, many of which have been presented in the context of brain circuits.

      The connection to this work is briefly made in appendix A.1, where it is argued that the shortest path distance between two nodes in a directed graph can be calculated from equation 15, which depends only on the adjacency matrix and the decay parameter (provided the latter falls below a given value). It is not clear from the presentation whether this is a novel result. No direct reference is given for the derivation so I assume it is novel. But if this is a previously unknown solution to the general problem it deserves to be much more strongly featured and either way it needs to be appropriately set in the context of previous work.

      As far as we know this proposal for computing all-pairs-shortest-path is novel. We could not find it in textbooks or an extended literature search. We have discussed it with two graph theorist colleagues, who could not recall seeing it before, although the proof of the relationship is elementary. Inspired by the present reviewer comment, we chose to publish the result in a separate article that can focus on the mathematics and place it in the appropriate context of prior work in graph theory. For related work in the area of neural modeling please see our revised discussion section.

      Once this principle is grasped, the added value of the simulated results is somewhat limited. These show: 1) in practical terms, the spreading signal travels further for a smaller decay but becomes erratic as the decay parameter (map neuron gain) approaches its theoretical upper bound and decreases below noise levels beyond a certain distance. Both follow the theory. 2) that different graph structures can be acquired and used to approach goal locations (not surprising) .3) that simultaneous learning and exploitation of the graph only minimally affects the performance over starting with perfect knowledge of the graph. 4) that the parameters interact in expected ways. It might have been more impactful to explore whether the parameters could be dynamically tuned, based on the overall graph activity.

      This is a good summary of our simulation results, but we differ in the assessment of their value. In our experience, simulations can easily demolish an idea that seemed wonderful before exposure to numerical reality. For example, it is well known that one can build a neural integrator from a recurrent network that has feedback gain of exactly 1. In practical simulations, though, these networks tend to be fickle and unstable, and require unrealistically accurate tuning of the feedback gain. In our case, the theory predicts that there is a limited range of gains that should work, below the critical value, but large enough to avoid excessive decay of the signal. Simulation was needed to test what this practical range was, and we were pleasantly surprised that it is not ridiculously small, with robust navigation over a 10-20% range. Similarly, we did not predict that the same parameters would allow for effective acquisition of a new graph, learning of targets within the graph, and shortest-route navigation to those targets, without requiring any change in the operation of the network.

      Perhaps the most biologically interesting aspect of the work is to demonstrate the effectiveness, for flexible behaviour, of keeping separate the latent learning of environmental structure and the association of specific environmental states to goals or values. This contrasts (as the authors discuss) with the standard reinforcement learning approach, for example, that tries to learn the value of states that lead to reward. Examples of flexibility include the homing behaviour (a goal state is learned before any of the map is learned) and the patrolling behaviour (a goal cell that monitors all states for how recently they were visited). It is also interesting to link the mechanism of exploration of neighbouring states to observed scanning behaviours in navigating animals.

      The mapping to brain circuits is less convincing. Specifically, for the analogy to the mushroom body, it is not clear what connectivity (in the MB) is supposed to underlie the graph structure which is crucial to the whole concept. Is it assumed that Kenyon cell connections perform the activation spreading function and that these connections are sufficiently adaptable to rapidly learn the adjacency matrix? Is there any evidence for this?

      Yes, there is good evidence for recurrent synapses among Kenyon cells (map cells in the model), and for reward-gated synaptic plasticity at the synapses onto mushroom body output cells (goal cells in our model). We have expanded this material in the discussion section. Whether those functions are sufficient to learn the structure of a spatial environment has not been explored; we hope our paper might give an impetus, and are exploring behavioral experiments on flies with colleagues.

      As discussed above, the possibility that an algorithm like 'endotaxis' could explain how the rodent place cell system could support trajectory planning has already been explored in previous work so it is not clear what additional insight is gained from the current model.

      Please see our revised discussion section on “theories and models of spatial learning”. In short, some ingredients of the model have appeared in prior work, but we believe that the present formulation offers an unexpectedly simple end-to-end solution for all components of navigation: exploration, target learning, and goal seeking.

      Reviewer #1 (Recommendations For The Authors):

      Major concern:

      See the public review. How do the results change depending on whether the recurrent connections between map cells are an adjacency matrix vs. a properly normalized statetransition matrix? I'm especially asking about results related to critical gain (gamma_c), and the dependence of the optimal parameter values on the environment.

      Please see our response above including the attached reviewer figure.

      Minor concerns:

      It is not always clear when the learning rule is symmetric vs asymmetric (undirected vs directed graph), and it seems to switch back and forth. For example, line 127 refers to a directed graph; Fig 2B and the intro describe symmetric Hebbian learning. Most (all?) of the simulations use the symmetric rule. Please make sure it's clear.

      For simplicity we now use a symmetric rule throughout, as is appropriate for undirected graphs. We mention that a directed learning rule could be used to learn directed graphs. See the section on “choice of learning rule”. M_ij is not defined when it's first introduced (eq 4). Consider labeling the M's and the G's in Fig 2.

      Done.

      The network gain factor (gamma, eq 4) is distributed over both external and recurrent inputs (v = gamma(u + Mv)), instead of local to the recurrent weights like in the Successor Representation. This notational choice is obviously up to the authors. I raise slight concern for two reasons -- first, distributing gamma may affect some of the parameter sweep results (see major concern), and second, it may be confusing in light of how gamma is used in the SR literature (see reviewer's paper for the derivation of how SR is computed by an RNN with gain gamma).

      In our model, gamma represents the (linear) activation function of the map neuron, from synaptic input to firing output. Because the synaptic input comes from point cells and also from other map cells, the gain factor is applied to both. See for example the Dayan & Abbott book Eqn 7.11, which at steady state becomes our Eqn 4. In the formalism of Fang 2023 (Eqn 2), the factor γ is only applied to the recurrent synaptic input J ⋅ f, but somehow not to the place cell input ϕ. Biophysically, one could imagine applying the variable gain only to the recurrent synapses and not the feed-forward ones. Instead we prefer to think of it as modulating the gain of the neurons, rather than the synapses. The SR literature follows conventions from the early reinforcement learning papers, which were unconstrained by thinking about neurons and synapses. We have added a footnote pointing the reader to the uses of γ in different papers.

      In eq 13, and simulations, noise is added to the output only, not to the activity of recurrently connected neurons. It is possible this underestimates the impact of noise since the same magnitude of noise in the recurrent network (map cells) could have a compounded effect on the output.

      Certainly. The equivalent output noise represents the cumulative effect of noise everywhere in the network. We argue that a cumulative effect of 1% is reasonable given the overall ability of animals at stimulus discrimination, which is also limited by noise everywhere in the network. This has been clarified in the text.

      Fig 3 E, F, it looks like the navigated distance may be capped. I ask because the error bars for graph distance = 12 are so small/nonexistent. If it's capped, this should be in the legend.

      Correct. 12 is the largest distance on this graph. This has been added to the caption.

      Fig 3D legend, what does "navigation failed" mean? These results are not shown.

      On those occasions the agent gets trapped at a local maximum of the goal signal other than the intended goal. We have removed that line as it is not needed to interpret the data.

      Line 446, typo (Lateron).

      Fixed.

      Line 475, I'm a bit confused by the discussion of birds and bats. Bird behavior in the real world does involve discrete paths between points. Even if they theoretically could fly between any points, there are costs to doing so, and in practice, they often choose discrete favorite paths. It is definitely plausible that animals that can fly could also employ Endotaxis, so it is confusing to suggest they don't have the right behavior for Endotaxis, especially given the focus on fruit flies later in the discussion.

      Good points, we removed that remark. Regarding fruit flies, they handle much important business while walking, such as tracking a mate, fighting rivals over food, finding a good oviposition site.

      Section 9.3, I'm a bit confused by the discussion of cerebellum-like structures, because I don't think they have as dense recurrent connections as needed for the map cells in Endotaxis. Are you suggesting they are analogous to the output part of Endotaxis only, not the whole thing?

      Please see our reply in the public review. We have removed this discussion of cerebellar circuits.

      Line 541, "After sufficient exploration...", clarify that this is describing learning of just the output synapses, not the recurrent connections between map cells?

      We have revised this entire section on the arthropod mushroom body.

      In lines 551-556, the discussion is confusing and possibly not consistent with current literature. How can a simulation prove that synapses in the hippocampus are only strengthened among immediately adjacent place fields? I'd suggest either removing this discussion or adding further clarification. More broadly, the connection between Endotaxis and the hippocampus is very compelling. This might also be a good point to bring up BTSP (though you do already bring it up later).

      As suggested, we removed this section.

      Line 621 "The successor representation (at least as currently discussed) is designed to improve learning under a particular policy" That's not actually accurate. Ref 17 (reviewer's manuscript, cited here) is not policy-specific, and instead just learns the transition statistics experienced by the animal, using a biologically plausible learning rule that is very similar to the Endotaxis map cell learning rule (see our Appendix 5, comparing to Endotaxis, though that was referencing the previous version of the Endotaxis preprint where Oja's rule was used).

      We have edited this section in the discussion and removed the reference to policyspecific successor representations.

      Line 636 "Endotaxis is always on" ... this was not clear earlier in the paper (e.g. line 268, and the separation of different algorithms, and "while learning do" in Algorithm 2).

      The learning rules are suspended during some simulations so we can better measure the effects of different parts of endotaxis, in particular learning vs navigating. There is no interference between these two functions, and an agent benefits from having the learning rules on all the time. The text now clarifies this in the relevant sections.

      Section 9.6, I like the idea of tracing different connected functions. But when you say "that could lead to the mode switch"... I'm a bit confused about what is meant here. A mode switch doesn't need to happen in a different brain area/network, because winnertake-all could be implemented by mutual inhibition between the different goal units.

      This is an interesting suggestion for the high-level control algorithm. A Lorenzian view is that the animal’s choice of mode depends on internal states or drives, such as thirst vs hunger, that compete with each other. In that picture the goal cells represent options to be pursued, whereas the choice among the options occurs separately. But one could imagine that the arbitrage between drives happens through a competition at the level of goal cells: For example the consumption of water could lead to adaptation of the water cell, such that it loses out in the winner-take-all competition, the food cell takes over, and the mouse now navigates towards food. In this closed-loop picture, the animal doesn’t have to “know” what it wants at any given time, it just wants the right thing. This could eliminate the homunculus entirely! Of course this is all a bit speculative. We have edited the closing comments in a way that leaves open this possibility.

      Line 697-704, I need more step-by-step explanation/derivation.

      We now derive the properties of E step by step starting from Eqn (14). The proof that leads to Eqn 14 is now in a separate article (available as a preprint and attached to this submission).

      Reviewer #3 (Recommendations For The Authors):

      • Please include discussion and comparison to previous work of graph-based trajectory planning using spreading activation from the current node and/or the goal node. Here is a (far from comprehensive) list of papers that present similar algorithms:

      Glasius, R., Komoda, A., & Gielen, S. C. (1996). A biologically inspired neural net for trajectory formation and obstacle avoidance. Biological Cybernetics, 74(6), 511-520.

      Gaussier, P., Revel, A., Banquet, J. P., & Babeau, V. (2002). From view cells and place cells to cognitive map learning: processing stages of the hippocampal system. Biological cybernetics, 86(1), 15-28.

      Gorchetchnikov A, Hasselmo ME. A biophysical implementation of a bidirectional graph search algorithm to solve multiple goal navigation tasks. Connection Science. 2005;17(1-2):145-166

      Martinet, L. E., Sheynikhovich, D., Benchenane, K., & Arleo, A. (2011). Spatial learning and action planning in a prefrontal cortical network model. PLoS computational biology, 7(5), e1002045.

      Ponulak, F., & Hopfield, J. J. (2013). Rapid, parallel path planning by propagating wavefronts of spiking neural activity. Frontiers in computational neuroscience, 7, 98.

      Khajeh-Alijani, A., Urbanczik, R., & Senn, W. (2015). Scale-free navigational planning by neuronal traveling waves. PloS one, 10(7), e0127269.

      Adamatzky, A. (2017). Physical maze solvers. All twelve prototypes implement 1961 Lee algorithm. In Emergent computation (pp. 489-504). Springer, Cham.

      Please see our reply to the public review above, and the new discussion section on “Theories and models of spatial learning”, which cites most of these papers among others.

      • Please explain, if it is the case, why the goal cell learning (other than a direct link between the goal and the corresponding map location) and calculation of the overlapping 'goal signal' is necessary, or at least advantageous.

      Please see our reply in the public review above.

      • Map cells are initially introduced (line 84) as getting input from "only one or a few point cells". The rest of the paper seems to assume only one. Does it work when this is 'a few'? Does it matter that 'a few' is an option?

      We simplified the text here to “only one point cell”. A map cell with input from two distant locations creates problems. After learning the map synapses from adjacencies in the environment, the model now “believes” that those two locations are connected. This distorts the graph on which the graph distances are computed and introduces errors in the resulting goal signals. One can elaborate the present toy model with a much larger population of map cells that might convey more robustness, but that is beyond our current scope.

      • (line 539 on) Please explain what feature in the mushroom body (or other cerebellumlike) circuits is proposed to correspond to the learning of connections in the adjacency matrix in the model.

      Please see our response to this critique in the public review above. In the mushroom body, the Kenyon cells exhibit sparse responses and are recurrently connected. These would correspond to map cells in Endotaxis. For vertebrate cerebellum-like circuits, the correspondence is less compelling, and we have removed this topic from the discussion.

    1. Author Response

      The following is the authors’ response to the original reviews.

      Public Reviews:

      Reviewer #1 (Public Review):

      Cell death plays a critical role on regulating organogenesis. During tooth morphogenesis, apoptosis of embryonic dental tissue plays critical roles on regulating tooth germ development. The current study focused on ferroptosis, another way of cell death which has rarely been investigated in tooth development, and showed it may also play an important role on regulating the tooth dimension. The topic is novel and interesting, but the experimental design has many flaws which significantly compromised the study.

      1. The entire study was based on ex vivo tooth germ explant culture. Mandibular tooth germs of E15.5 (bell stage) were isolated for ex vivo culture. Most tooth germ explant culture experiments were actually using tooth germ of much earlier stages (E11.5-E13.5) for organ culture. After E16.5, both the large size and initially formed enamel/dentin could prevent nutrition from penetrating inside. Also, using tooth germ of earlier stage will help identify impact of ferroptosis upon early tooth development.

      2. Due to limited penetration, the ex vivo culture in the study lasted for no more than 5 days. I would recommend the authors to perform kidney capsule transplantation as an alternative approach, which can support tooth germ development much longer even into root formation.

      3. The major justification of using tooth germ ex vivo culture as the model in the study was to "conduct high-throughput analysis". However, the study could hardly be qualified as a high-throughput analysis. I would recommend the authors perform RNA sequencing for comparing tooth germs before/after erastin treatment. Such experiments won't take too much time or resource.

      We are grateful for the insightful feedback on our ex vivo tooth germ culture model. We initially chose the E15.5 tooth germ over earlier stages due to peak Gpx4 expression and iron accumulation during molar development, which occurs between E15.5 and E17.5 (Figure 1A & 1B). This period may be the most sensitive to ferroptotic stress during tooth development. Our experiments also demonstrated that the tooth germ displays robust growth after seven days of ex vivo cultivation (Figure supplement 1B).

      Kidney capsule transplantation is indeed an ideal method for ex vivo tooth germ culture. However, in our studies, we used erastin – a classic ferroptosis inducer – which exhibits instability in vivo, thereby constraining our investigation using kidney capsule transplantation.

      Our results about Gpx4 expression in the tooth germ during development (Figure 1A) showed a spatiotemporal pattern. This pattern suggests that bulk RNA sequencing of the tooth germ might not yield accurate revelations about changes in ferroptosis-related genes. We are presently using transgenic mice to further study the impact of excessive in vivo ferroptotic stress on tooth development. In these experiments, we intend to conduct single-cell RNA sequencing to explore detailed alterations in the tooth germ.

      1. Although the study mostly used molars as the model, the in vivo iron concentration was only demonstrated on incisors, but not molars (Figure 1).

      We have updated Figure 1B to include images of molars, which illustrate the accumulation of iron during molar development. The iron concentration peaks at E17.5, then decreases at PN0. Interestingly, unlike Gpx4 expression, iron accumulation rebounds at PN3. To gain a more accurate understanding, further in vivo studies utilizing transgenic mice are required.

      1. Phenotype analysis in Figure 2 is too superficial. Only dimensional information was provided. Cusps number, cusps distribution pattern and rooth/furcation formation were not evaluated. Differentiation of ameloblast/odontoblast was not evaluated. The proliferation rate in the dental epithelium/mesenchyme was not analyzed.

      The cusps number/distribution pattern are not influenced by erastin treatment in recent model (Figure 2A & 2C). Recent ex vivo culture model of tooth germ is unable to investigate the possible function of ferroptotic stress in rooth/furcation formation since it mainly initiates from PN4 to PN7. The proliferation and differentiation of dental epithelium/mesenchyme will be analyzed using transgenic mice in vivo.

      1. Low magnification images should be included in Figure 3 to display the entire tooth germs.

      The emission spectrum of recent utilized iron probe will extend due to increasing concentration of iron. This property makes the counter staining of tissue samples unavailable. The structure of the ex vivo cultured tooth germ could only be recognized in high magnification. The calculation could represent the entire alternation.

      1. In Figure 4, does ferroptotic inhibitor eliminate the iron accumulation in the tooth germ? How about the expression level of several target genes shown in Figure 3?

      In Fig 5, Fer-1 reduced the iron accumulation in tooth germ. Different inhibitors suppressed ferroptosis via different ways, Lip-1 mainly inhibits lipid peroxidation, DFO is an iron chelator which reduces the labile iron pool, Fer-1 is reported to both inhibit lipid peroxidation and reduce the labile iron pool, their functions to the accumulation of iron might be varied. The core risk factors of ferroptosis are lipid peroxidation and iron accumulation, thus in Fig 5, we analyzed the expression of 4HNE and the accumulation of iron to illustrated the suppression o ferroptosis instead of detecting several regulatory genes.

      1. The manuscript has many typos and grammar mistakes. All "submandibular" should be simply "mandibular". "eastin" should be "erastin" (line 92). "partly" should be "partially" (line 611).

      We addressed all the gramma and typo errors.

      Reviewer #2 (Recommendations for The Authors):

      This is a very well done study. However, writing is absolutely substandard. The authors should check and review extensively for improvements to the use of English. This is not just about language but also about style of the paper and presentation. As written, the abstract is not concise at all, and the overall logic of the study is not well presented. Currently, the abstract reads like another introduction.

      We improved our presentation.

      Reviewer #3 (Recommendations for The Authors):

      This is an interesting work reporting ferroptosis that is involved in the tooth morphogenesis. The authors showed that Gpx4, the core anti-lipid peroxidation enzyme in ferroptosis, is upregulated in tooth development using ex vivo culture system. They convincingly demonstrated that ferroptosis, but apoptosis, was present in tooth morphogenesis. The findings are interesting and novel. The work represents one of the earliest works studying Ferroptosis in tooth morphogenesis. There are several minor concerns.

      1) The abstract is too long and should be shortened.

      We modified the abstract to make it concise.

      2) Can the Gpx4 quantitatively be measured by qRT-PCR?

      3) How is Gpx4 regulated during development? If unknown, the authors should discuss it at least

      4) Are there any tooth developmental defects associated with ferroptosis? If there is one, the authors should discuss it.

      Our research on Gpx4 expression in the tooth germ during development (Figure 1A) highlights a specific spatiotemporal pattern. This pattern suggests that bulk RNA sequencing of the tooth germ may not provide accurate insight into changes in ferroptosis-related genes.

      The developmental role of Gpx4 had been studied even before the ferroptosis was formally described (before 2012). In situ hybridization indicated expression of Gpx4 in all developing germ layers during gastrulation and in the somite stage in the developing central nervous system and in the heart, which made Gpx4 (-/-) mice die embryonically in utero by midgestation (E7.5) and are associated with a lack of normal structural compartmentalization. Specific deletion of Gpx4 during developmental process were found to participate in the maturation and survival of cerebral and photoreceptor cell. Recent years, more ferroptosis related function of Gpx4 were discovered in neutrophil and chondrocyte of adult mice, in which specific deletion will lead to ferroptosis-induced organ dysregulation and degeneration.

      At present, no systematic study has been conducted on ferroptosis or ferroptotic stress in relation to tooth developmental defects. However, as early as the 1930s, pioneering dental biologists had already identified the presence of iron in the teeth of various animals. They also found that some enamel defects in mice were related to abnormal iron metabolism. Lipid metabolism and lipid peroxidation, which are other key risk factors of ferroptosis, were also described in the initial stages of dental biology research.

      We are currently generating transgenic mice with dental epithelium/mesenchymal specific deletions of Gpx4. This will allow us to further investigate the developmental defects related to ferroptosis and ferroptotic stress.

    1. Author Response

      Reviewer #1 (Public Review):

      The authors performed an RNAi screen to identify epigenetic regulators involved in oxygen-glucose deprivation (OGD)-induced neuronal injury using immortalized mouse hippocampal neuronal cell line HT-22. They identified PRMT5 as a novel negative regulator of neuronal cell survival after OGD. Both in vitro and in vivo experiments were then performed to evaluate the roles of PRMT5 in OGD and ischemic stroke-induced injury. The authors found that genetic and pharmacological inhibition of PRMT5 protected against neuronal cell death in both in vitro and in vivo models. Furthermore, they found that in response to OGD and ischemia, PRMT5 was translocated from the cytosol to the nucleus, where PRMT5 bound to the chromatin and promoter regions of targeted genes to repress the expression of downstream genes. Further, they showed that silencing PRMT5 significantly altered the OGD-induced changes for a large-scale of genes. In a mouse model of middle cerebral artery occlusion (MCAO), PRMT5 inhibitor EPZ015666 protected against neuronal death in vivo. This study reveals a potential therapeutic target for the treatment of ischemic stroke. Overall, the authors have done elegant work showing the role of PRMT5 in neuronal cell survival. However, the essential mechanisms underlying PRMT5 nuclear translocation have not been investigated, and the in vivo animal studies should be further strengthened.

      Thank you very much for your comments and suggestions. While stroke stands as the second leading cause of death globally, and the burden of post-onset disability is substantial, particularly surging at a faster rate in low- and middle-income countries compared to high-income countries. The exploration of new drugs for stroke treatment holds profound societal implications. The concept of neuroprotective drug development is not novel; over the past half-century, considerable research and resources have been invested in this field. Yet, progress appears to be notably limited, and interest is currently waning.

      Our research team is dedicated to devising rapid and cost-effective functional screening strategies grounded in the nervous system. Through this forward research approach, we aim to delve into potential neuroprotective targets across various neurological diseases. This endeavor not only bears significance for acute stroke but also holds potential application value for a spectrum of generalized nerve injuries.

      Building on your insights, our upcoming studies will involve in vivo animal experiments, integrating the PRMT5 nuclear translocation mechanism. We anticipate that our continued research will benefit from further professional insights and guidance from your expertise.

      Reviewer #2 (Public Review):

      Haoyang Wu et al. have shown that the symmetric arginine methyltransferase PRMT5 binds to the promoter region of several essential genes and represses their expression, leading to neuronal cell death. Knocking down PRMT5 in HT-22 cells by shRNA leads to pertinent improvement in cell survival after oxygen-glucose deprivation (OGD) conditions. In another set of experiments, inhibition of the catalytic activity of PRMT5 by a specific inhibitor, EPZ015666, in a middle cerebral artery occlusion (MCAO) mice model also showed protective effects against neuronal cell death. In this manuscript, the authors have established the negative role of PRMT5 in cerebral ischemia both in vitro and in vivo.

      However, my primary concern is the novelty of the manuscript. It has already been reported that inhibition of PRMT5 attenuates cerebral ischemia/reperfusion condition (Inhibition of PRMT5 attenuates cerebral ischemia/reperfusion-induced inflammation and pyroptosis through suppression of NF-κB/NLRP3 axis. Xiang Wu et al. Neuroscience Letters, Volume 776, 2022, 136576, ISSN 0304-3940, https://doi.org/10.1016/j.neulet.2022.136576.). Even these authors have also shown that treatment of PRMT5 specific catalytic inhibitor, LLY-283, could rescue ischemia-induced over-expression of inflammation-related factors.

      However, it would be better to verify the specificity of the inhibitor, EPZ015666, using other methyltransferases to be sure that the rescue is indeed mediated by PRMT5 catalytic inhibition.

      Thank you sincerely for dedicating time from your busy schedule to review our papers. Your comments and suggestions hold immense value for us, contributing significantly to the enhancement of our work. We acknowledge with honesty that this research journey has been a prolonged and challenging experience.

      The major functional study, as indicated by the CHIP-seq data record, was concluded between 2017 and 2019. Since then, our efforts and resources have been devoted to conducting in-depth mechanism and regulation research for PRMT5. Notably, PRMT5 is involved in 4-5 types of histone arginine methylation, and it plays a role in complex modification effects for proteins in the cytoplasm. Despite employing a variety of investigative methods, understanding and controlling these intricate mechanisms in experimental design have proven quite challenging. This not only places us at a disadvantage compared to some competitors but also hinders the creative potential of our lab team.

      We firmly believe that there is ample room for further research on the role of PRMT5 in the nervous system. We aspire to collaborate with other research teams to explore this area collectively.

    1. Author Response

      Reviewer #1 (Public Review):

      Summary:

      In this work, the authors use an OT setup to measure the DNA gripping and DNA slipping dynamics of phage lambda terminase motor interaction with DNA. They discover major differences in the dynamics of these two events, in comparison to the phage T4 motor, which they previously investigated. They attribute these differences to the presence of the TerS (small terminase) subunit of the motor complex of phage lambda in addition to the TerL (large terminase) subunit in phage, while in T4 only the TerL subunit is present. By exposing the stalled phage lambda procapsid-DNA complex (stalled with ATP-gammaS) to solutions containing 1) no nucleotide, 2) poorly hydrolyzed ATP, and 3) ADP, they found that the gripping persistence is strongest with ATP, weaker with ADP, and weakest with no nucleotide. This demonstrates nucleotide-dependent DNA gripping and friction of the motor. However, both persistence of gripping and friction are dramatically stronger than in the T4 TerL motor, due to the presence of the TerS subunit. While TerS was believed to be essential for the initiation of packaging in vivo, its role during DNA translocation was unclear. This study reveals the key role played by TerS in DNA gripping and DNA-motor friction, highlighting its role in DNA translocation where TerS acts as a "sliding clamp".

      The study also provides a method to investigate factors affecting the stability of the initiation complex in viral packaging motors.

      Strengths:

      The experiments are well carried out and the conclusions are justified. These findings are of great significance and advance our understanding of viral motor function in the DNA packaging process and packaging dynamics.

      Weaknesses:

      While the collected OT data is quantitative, therefore is no further quantitative analysis of the motor packaging dynamics with regard to different motor subunit functions and the presence of nucleotides.

      We thank the reviewer for the feedback and we will address the additional recommendations in a revised manuscript. Regarding the comment about quantitative analysis of the packaging dynamics, we emphasize that the present study focuses only on analysis of the grip/slip dynamics in the absence of ATP, since we have already studied the packaging dynamics (DNA translocation dynamics) with ATP in prior studies (refs 34, 35, 39-43). Note that in the present paper we do relate the present studies to these prior studies (such as on p. 7-8 regarding the mechanism of DNA gripping/release during translocation, on p. 8 regarding the finding that the T4 motor (without TerS) exhibits more frequent slipping during packaging, and on p. 8-9 regarding the cause of pauses during packaging).

      Reviewer #2 (Public Review):

      Summary:

      In their paper Rawson et al investigate the nanomechanical properties of the lambda bacteriophage packaging motor in terms of its ability to allow either the slippage of DNA out of the capsid or exerting a grip on the DNA, thereby preventing the slipping. They use a fascinatingly elegant single-molecule biophysics approach, in which gentle forces, generated and controlled by optical tweezers, are used to pull on the DNA molecule about to be packaged by the virus. A microfluidic device is then used to change the nucleotide environment of the reaction, so that the packaging motor can be investigated in its nucleotide-free (apo), ADP-, and non-hydrolyzable ATP-analog-bound states. The authors show that the apo state is dominated by DNA slippage which is impeded by friction. The slippage is stochastically halted by gripping stages. In ADP the DNA-gripped state becomes overwhelming, resulting in a much slowed DNA slippage. In non-hydrolyzable ATP analogs, the DNA slippage is essentially halted and the gripped state becomes exclusive. The authors also show that the slipping and gripping states are controlled not only by nucleotides but also by the force exerted on DNA. Altogether, DNA transport through/by the lambda-phage packaging motor is regulated by nucleotides and mechanical force. Furthermore, the authors document an intriguingly interesting DNA end-clamping mechanism that prevents the DNA from slipping entirely out of the capsid, which would make the packaging process inefficient even on the statistical level. The authors claim that their findings are likely related to the function of a small terminase subunit (TerS) in the lambda-phage motor, which may act as a sliding clamp.

      Strengths:

      Altogether this is a very elegantly executed, thought-provoking, and interesting work with numerous significant practical implications. The paper is well-written and nicely documented.

      Weaknesses:

      There are really no major weaknesses, apart from a few minor issues detailed below in my recommendations.

      We thank the reviewer for the feedback and we will address the minor issues in a revised manuscript.

    1. Author Response

      The following is the authors’ response to the original reviews.

      We have substantially revised our manuscript based on the extensive and highly constructive comments of the reviewers. We have included new data, refined existing data, and revised the text. To do this, some figures had to be split and several figures had to be renumbered. The additional experiments presented at the end of the Results also led us to expand our discussion of current limitations of our story.

      Recommendations for the authors

      Reviewer #1:

      To improve the manuscript, I have some recommendations for the authors.

      1) The cell size was quantified using flow cytometry (forward scatter). While this approach provides a convenient way to measure cell size, it is only a relative way to compare the cell size. A 10% increase in FSC value does not necessarily mean a 10% increase in diameter, this depends on the instrument. Consequently, the claims of density changes such as based on the panel 5B may be incorrect. It would be useful also to perform some experiments with Coulter Counter or imaging based quantification of cell size.

      We agree and this is precisely why we had also measured cell diameters by imaging (reported at the bottom of page 7 and figure supplement 1D in the initial version of the manuscript). In the revised manuscript, we have added a cautionary note in the same context. Regarding density changes, those measurements by FRAP are independent of assumptions about cell diameter. When cell density is down and cells are larger by whatever factor, one can safely conclude that total protein did not scale.

      2) When the Hsp90a/b KOs are introduced on page 9, it would be helpful to know at this stage whether the double KO cells are viable to understand why the individual KOs rather than double knockout cells were used.

      We have now added a statement to indicate that total Hsp90 KOs are not viable in eukaryotes.

      3) How the following can be reconciled with previous work is a bit unclear and needs some clarification: Neurohr et al 2019 identifies cytoplasmic dilution in larger cells, but in this manuscript WT cells maintain the same cytoplasmic density while becoming larger under chronic stress while the Hsp90 KO cells have reduced cytoplasmic density. Does this mean that the cytoplasmic dilution does not relate to cell size but is indirect and related to heat stress? Or is this related to uncoupling of cell size and density only in excessively large cells as for example HEK cells only increase their diameter by 30% based on the flow cytometry analysis?

      Yes, indeed, beyond a certain threshold, excessively enlarged cells cannot scale protein anymore. In the revised manuscript, we not only look at cells exposed to stress for much longer (up to one month) (see last paragraph of revised Results). These cells become even bigger, and in agreement with Neurohr and colleagues, we find that protein scaling breaks down.

      4) Related to the previous, the authors state that "Hsp90 levels rather than a specific isoform are critical for maintaining the cytoplasmic density", but there is no direct evidence connecting Hsp90 levels to cell size. Given the number of proteomics experiments done in this work, can a correlation between Hsp90 levels and cell size/cell density be identified? Or is this related to the way cell size is increased in chronic stress as later the authors say that with the CDK4/6 inhibitor Hsp90α/β KO cells can scale the total protein.

      We have previously determined total Hsp90 levels quantitatively by mass spec (Bhattacharya et al., 2022; see Figure S8 there) (now explicitly mentioned in the same context as our revision related to point #2, see above), and we have now also added the quantitation, including that of total Hsp90 levels, in what is now Figure 9.

      5) Page 17 states "Hsp90α/β KO cells increase cell size while translation is still reduced. Thus, cell size and translation must be coupled for adaptation to chronic stress." This feels like an important conclusion of the paper, yet the direct evidence is rather limited and the authors are clearly not sure how the Hsp90 KO cells increase their size without increasing the translational capacity. Yes, a potential explanation is provided immediately afterward as the authors show that Hsp90α/β KO cells subjected to chronic HS also have reduced proteasomal activity. Reducing protein degradation allows cells to gain more protein even if the synthesis rate does not increase (steady-state protein levels is a balance between synthesis and degradation). As stated by the authors in the discussion, the KO cells "fail to couple cell size increase to translation" simply because they can increase total protein, and cell size, by reducing protein degradation.

      Yes, reducing protein turnover might be a viable strategy, but here, reduced protein degradation in the Hsp90 KOs is clearly not enough since total protein levels cannot keep up with the cell size increase.

      6) What is unclear to me is to what extent these results (where chronic heat stress increases cell size and cells proliferate) relate to large senescent cells which are arrested. The discussion speculates that a failure to adapt to stress leads to aging, but direct evidence is lacking.

      Even though we feel quite strongly that (some) speculation should be allowed, we now provide more direct evidence for senescence (see Figure 10 of revised manuscript and corresponding text). Moreover, we had already demonstrated in Bhattacharya et al. 2022 that senescence is triggered by below-threshold levels of Hsp90 (i.e. cells express senescence markers). But note that senescence is only manifest upon prolonged exposure to chronic mild stress, and that our standard protocol for chronic mild stress was established in such a way as to avoid much of an effect on viability and proliferation (see Figure 1). So no, at least for wild-type cells, except for the experiments of Figure 10, what we studied are not large senescent and arrested cells.

      7) The clarity and content of the figures need some improvement. For example, in Fig 1, it is difficult to see the small symbols specifying the cell lines as the replicates are often overlapping. The font for p values is also too small. For Fig 2, legend says "the statistical significance between the groups was analyzed by two-tailed unpaired Student's t-tests." but there are no statistics shown. The use of statistical testing is also inconsistent across different figures and panels, for example Fig 3 A vs 3C and 5A vs 5H. In Fig 4. the legend talks about p-value, but y axis in panels is q value. The authors need to clarify this by mentioning that these are adjusted p values. Fig 7. should also explain "Rapa" in the legend or state "Rapamycin" in the figure.

      To avoid overloading figures further with enlarged text, we prefer not to increase the font size of the p-values, and for graphs where data points are too small or overlap, we remind the reviewer that all original data will be available with the paper (and linked to from each figure). For Figure 2, we removed the indicated orphaned statement. We've now added stats for Figure 3C, and double checked all others; note that in most cases where the differences are really obvious, we did not add p-values. Wherever there were q-values as Y axis, we have now also added the term "adjusted p-value" in the legend. As for "Rapa", it was and still is defined in the legend.

      8) The data in Fig 5A looks curious as the 39C response is bimodal suggesting that only some cells adapt to the heat stress or could this be a technical issue with the measurements?

      The reason for this is that the data points are from 2 independent experiments. This means that the measurements were done on different days with a microscope that had to be calibrated again and may have been in a slightly different mode. This is not uncommon with this type of data. As an example of that, please see Fig. 3C of Persson et al. Cell 183:1572-1585 (https://doi.org/10.1016/j.cell.2020.10.017).

      Reviewer #2:

      Specific comments for authors:

      Major comments:

      1. Fig. 1F: if cells are not split for 7 days than they start growing in multi-layers. The density within a plate affects their proliferation rate as well as their translation rate. Therefore, a proliferation curve (with counting) when cells are kept for the duration of the 7 day experiment at sub-confluent density (ideally <90%) would be much more informative in this case, and also help to understand the dynamics within the timecourse. For example, if initially there is cell cycle arrest (at day1, as shown in Fig. 1d), then proliferation rates should reflect that.

      See next point.

      1. On a more general note: What is the confluence of the 4-7day experiments? Initial density can change the cell's behavior not only for RPE cells (as shown in fig. 7e), but HEK cells are sensitive to that as well. It is critical that experiments for translation, protein content, cell size, etc. be done in sub-confluent conditions, as the over-confluency alone could be a confounder for cell size, translation rates, etc. If this is indeed the way it was done, this should be clarified. Otherwise, this is a critical confounder which should be eliminated.

      The risk of the confounding effects of overcrowding is indeed an important point, which we avoided, unfortunately without explicitly mentioning it in the manuscript (assuming that it went without saying). While we had already mentioned the seeding density and type of plate in Materials and Methods, we now address it explicitly both with additional data (new figure supplement 1B) and clarifying additions in the text. In our experience, the most common problem with confluent plates is not that cells grow on top of each other, but that they come off the plate and die. Regarding the cell cycle analysis of Fig. 1D and the proliferation assays of Fig. 1G, note that in the latter, we standardized cell numbers to those of day 1.

      1. The speculations about the link to aging and senescence are very interesting, however since these are only hypothesis at this stage, the current phrasing in the abstract is a bit misleading. In fact, I was expecting at least one experiment to deal with aging/senescence, primed by the abstract.

      You are perfectly correct. We have now added new experimental evidence that shows cells display activity of the senscence marker SA-βgal after prolonged chronic stress (Figure 10). Please see our response to point #6 of reviewer #1 for further comments.

      1. Fig. 2D - nuclei are also getting much larger - what is the contribution of the nuclear increase to the overall cell increase? Does it scale linearly? Or does it contribute more/less compared to the entire cell?

      Good point! We now include additional data on nuclear size in Figure 2E and figure supplement 2D, and corresponding additions in Results and Discussion. And as you correctly spotted, nuclei become bigger, too. The data suggest that the ratio of cytoplasm to nuclear size is more or less maintained. One can speculate that nuclei are larger because of partial "unfolding" (opening) of chromatin, which might very well be driven by the activation of Hsf1. But that's for future studies to figure out.

      1. Fig 3a-c: in fig. 2a it looks like the knockout of one isoform leads to a basal increase in the expression of the other. However, since different antibodies are used for alpha and beta, the question of whether this increase leads to complete compensation of the total levels of hsp90 cannot be answered. qPCR for common regions could help answer this question, and this could help explain the increased hsf1 activity in the knockouts.

      As pointed out in response to reviewer #1, point #4, we had previously determined total Hsp90 levels quantitatively by mass spec (Bhattacharya et al., 2022; see Figure S8 there), and we now mention that explicitly. Moreover, we have now added new data including the quantitation of total Hsp90 levels in Figure 9. RT-PCR might not be of much help considering that we had shown in Bhattacharya et al. 2022 that below-threshold Hsp90 levels (even less than what happens here) trigger translation through an IRES in the Hsp90β mRNA, whose levels don't change.

      1. What is the HSE-luc construct used for the hsf1 activity? Is that an artificial HSE? Or the Hspa7 promoter? It would be interesting to check the activity with respect to the hsp90 promoter using a similar assay, to understand whether cells compensation for overall reduction in hsp90 levels is the primary "goal" for hsf1 activation.

      The HSE-luc reporter is an artificial construct (we now clarify this in the Materials and Methods). Although Hsp90 is important, Hsf1's goal in life goes well beyond it. It notably also regulates lots of genes in the absence of stress, notably in cancer cells. Fig. 4B is an example of a blot that shows that chronic stress does not dramatically affect the levels of Hsp90α/β.

      1. The proteomics data are very interesting, however additional details are missing and it is hard to extract them from source data 1. Specifically - focusing on the 2 hsp90s, what do they look like? The compensation questions above could be answered using the proteomics data as well.

      As mentioned above in response to this reviewer's point #5 (and #4 of reviewer #1), we have previously addressed that in a paper that was focused on precisely this issue, and we have adapted the current manuscript accordingly.

      1. How many proteins go up/down in the proteomics data? How does this compare between WT and knockout cells? The authors should detail the specific differences, which pathways? Which proteins? otherwise the volcano plots alone, on their own, are really not informative.

      We have now added a GO analysis (Figure 5C), and heat maps for chaperones/co-chaperones and Hsp90 interactors (new figure supplements 4 and 5). We have still left some volcano plots because they are a good visualization of the overall changes. The text has been revised accordingly, notably also to clarify what we are trying to show with volcano plots (GO analysis and heat maps).

      1. Fig. 3f: cells with hsf1 knockdown even decreased in size after HS. Is this significant? Why could that be?

      The be honest, we do not know. A wild speculation would be that Hsf1 is not only required to drive the cell size increase, but that a certain minimal level of Hsf1 is required to maintain normal cell size (specifically in A549 cells?).

      1. The siHSF1 cells showing no change in cell size is central to the paper's claims. This should be done in HEK293 cells at least, for which much of the data in the paper is shown, preferably also in RPE1 cells.

      We have now added new data with the results obtained with HEK293T cells (Fig. 3F).

      1. Technical note: it is very strange that MAFs can be transfected for luciferase assay. Such primary cells, to my knowledge, are largely non-transfectable. How was transfection performed in these cells? The authors should show that these cells can be transfected using imaging, or give a reference.

      We did both. We gave references and the experimental details in Materials and Methods, but we now say it even more explicitly in there. Note that the transfection efficiency is not so critical in luciferase assays as one only reads out the activities of the transfected cell population.

      1. The claim that proteostasis remains intact and the complexity of the proteome is unchanged should be examined more quantitatively. Specifically, analysis directly comparing between WT and KO cells should be performed: are the induced and repressed proteins the same? Is there a correlation between the levels of significantly changed proteins between WT and KO cells? This analysis should be done for chaperones, hsp90 interactors, as well as for the total proteome. Additionally, proteins whose levels differ could suggest (additional) mechanisms underlying the effects.

      This comment also relates back to point #8. We hope that our newly added comment in the Results section associated with the new heat maps makes it clearer what purpose the proteomic data serve and that it is beyond the scope of this paper to quantitate differences further or to home in on this or that protein (with the exception of those proteins we have done immunoblots for). To go deeper into mechanisms is going to be a full project(s) in itself.

      1. "Surprisingly, we found that Hsp90α/β KO cells do even better than WT cells under basal conditions (37{degree sign} C) (Figure 4D)." This is not so surprising, in light of the fact that HSF1 activity in these cells is higher, thus their chaperoning capacity should be better (for example, more HSP70 present?), as the authors themselves point out later in the text.

      It is surprising considering that there is less of a major molecular chaperone. It's definitely not the first thing you suspect when you knock out Hsp90. But to avoid confusion, we have taken out "surprisingly" and reworded the statement.

      1. "Similarly, Hsp90α/β KO cells might do better than WT cells under chronic HS because of their ability to further increase the levels of other molecular chaperones, such as Hsp27, Hsp40, and Hsp70, during chronic HS." This relates to the point above - the authors can directly quantify the changes in the levels of all other chaperones, since they have the proteomics data, and substantiate these claims, which are now only suggestions.

      The subordinate clause ("... because...") is not a speculation, it is a statement based on the data (Fig. 4B and figure supplement 4A-B, and yes, of course, the proteomic data). However, that KOs indeed do better because of that remains to be proven (hence, the "might do better").

      1. In A549 cells, knockout of Hsp90 led to lower basal diffusion coefficient (proxy for cytosolic density) at normal temperatures. Then, at 40 degrees, it seems that the coefficient goes back to being more or less equal to that of WT cells (fig. S5D). How can the authors explain this?

      One cannot really compare them one on one. After all, the Hsp90 KOs are different cell lines, their EGFP expression levels may differ, and their heat sensitivity definitely differs. What can be compared is cells of a given cell line (i.e. WT or KO), transfected as a pool and then split to be cultured at different temperatures.

      1. P-eIF2alpha and other translation marker western blots should be repeated and quantified and in also performed in A549 KO cells. The latter is very important, as the changed in A549 WT cells during adaptation of all translation regulatory markers: p-eIF2alpha, p-mTOR, and most strikingly total mTOR, are sky-rocketing, while in HEK cells these remain constant. As mTOR is a well-known regulator of cell size, and a target of Hsp90, could it be the major mediator of this effect in A549 cells? And if so, what is the substitute in HEK cells?

      We now include bar graphs with quantitation of multiple experiments for both HEK and A549 cells, including for the KOs (Figure 6C-D - figure supplement 8). What they show is that p-mTOR levels increase during chronic stress. But since overall it also increases in Hsp90α/β KO cells, we had to conclude that this cannot explain the differences between cells of different genotypes. We have added a statement to that effect in the corresponding Results section.

      1. Figs. 5D (and S5F) are both for HEK cells, while Fig. 5H is for A549. The corresponding plots for both cell lines should be provided for clarity, as the magnitudes in 5D and S5F seem much larger in HEK cells than seen in 5H. If there are differences between the cell lines these should be pointed out, as currently, showing some figures for one and not the other is confusing.

      HEK and A549 cells in these experiments, which are different, serve different purposes. We now explicitly mention already in the text of the Results, which cell line is used. Hopefully that makes it less confusing.

      1. Fig. 6C lacks a pvalue.

      It's missing because it cannot be calculated. The graph shows the average of "only" 2 biologically independent samples (as stated in the legend).

      1. Fig. S6C - the legend doesn't match the figure. Additionally, #aggregates should be normalized to the respective #of cells in each micrograph, and p-values should be presented for those normalized values.

      For what is now figure supplement 9C, this has been fixed as suggested.

      1. Also, under non-HS conditions, Hsp90 knockout cells show less aggregates than the WT. Is this significant (numbers are small, so perhaps it isn't)? What does this mean for the basal proteostasis state of Hsp90 knockout cells? Is it perhaps better than that of the WT?

      The suggested way of quantitating the aggregates took care of that. There is no clear difference anymore between WT and KO, but clearly many more aggregates under chronic stress (figure supplement 9C).

      1. The data on the connection between size and survival under chronic stress is highly compelling, even though correlative. The authors speculate in the discussion about one possible explanation to the question of how the enlarged size protect from the chronic stress. In fact, their proteomics dataset has the potential to help address, at least in part, their hypothesis about thresholds of certain proteins, by saying which proteins cross the detectability threshold in the data, and which processes these relate to.

      What the proteomic data say is that most things don't change (standardized to total protein). While it is possible that a few proteins do change in interesting ways, characterizing those is beyond the scope of this study.

      1. Fig. 7G should have a respective quantification with a p-value.

      We have added additional data. What is now Fig. 9 shows the quantitation of multiple biological replicates (with p-values).

      Minor comments:

      1. "it is known that acute HS causes ribosomal dissociation from mRNA, which results in a translational pause (Shalgi et al., 2013)." - This paper showed that acute HS causes ribosomal pausing on mRNAs, not ribosomal dissociation.

      We corrected this.

      1. Fig. 7E - size bar is missing.

      It was actually there, but hard to see. We have improved that in what is now Fig. 8E (and it is now also mentioned in the legend).

      Reviewer #3:

      My main points are outlined in the Public Review. Only a few additional comments are included here:

      1. The manuscript is quite long and there are places where it could be shortened and tightened for clarity. I'd recommend going through carefully and trying to shorten to improve readability.

      We hope that our revisions to address all of the reviewers' comments (and to accommodate more data) make the text more readable. But to make it shorter would have come at the expense of clarity.

      1. It wasn't clear to me that the increased luciferase folding in HSP90 KO lines was surprising. It is demonstrated that knockdown of these isoforms can activate HSF1, which increases many chaperones known to promote luciferase refolding.

      We address this point in our response to point #13 of reviewer #2 (basically: we took out "surprisingly").

      1. Along the same lines. HSP90 knockdown activates HSF1, but doesn't induce basal cell size. However, exogenous overexpression of HSF1 or activation of HSF1 with capsaicin increase cell size. Why are similar things not observed for HSP90 knockdown? Is it the extent of HSF1 activation? This seems a bit unlikely because it looked like activation was similar in KO and capsaicin treated cells.

      This must be due to the specifics of these different assays. The levels of Hsf1 protein and activity, and the time course of Hsf1 activity may be different. Moreover, it is likely that the reporter gene readout does not accurately report on all Hsf1 activities at a genome-wide scale.

      1. As noted above, does HSP90 depletion impact ISR signaling induced by other types of stress (e.g., ER or mitochondrial stress). Specifically, do you see sustained translational attenuation (and eIF2a phosphorylation) when HSP90 is depleted under these conditions. In other words, does HSP90 have a specific role in globally resolving eIF2a phosphorylation as part of the ISR or is that specific to certain types of stress.

      Although we now include data to show that tunicamycin (and therefore presumably the UPR/ISR) also induces a cell size increase, comprehensively analyzing what we refer to as RSR across different types of stresses (including mitochondrial and ER stresses) in the background of different Hsp90 genotypes and cell lines goes well beyond the scope of the current study.

    1. Author Response

      Reviewer #3 (Public Review):

      The authors sought to directly compare the predictions of two models of somatosensory processing: The attenuation model, which states that the sensation of touch on one hand is reduced when it is the predictable result of an active movement by the other hand; and the enhancement model, which states that the sensation of touch is actually increased, as long as the active hand does not receive touch stimultaneously with the passive hand (no double stimulation). The authors achieved their aims, with results clearly demonstrating (1) attenuation in the case of self touch, (2) that previously-observed enhancement is a consequence of the comparison condition (false enhancement), and (3) that attenuation involves predictive mechanisms and does not result simply from double stimulation. These findings, and the methodology, should particularly impact future studies of perceptual attenuation, sensory prediction error, and motor control more generally. The opposite conclusions obtainable by selecting different comparison conditions is particularly striking.

      Experiment 1 affirms that a touch to the passive finger caused by the active finger tapping a force sensor is perceived as weaker (attenuated) compared to a baseline not involving the active finger, but that if double stimulation is prevented (active finger moves, but no contact), neither attenuation nor enhancement occurs. Experiment 2 includes the three original conditions, plus the no-go condition used as a comparison in these earlier studies. Results suggest that the comparisons used by previous studies would result in the false appearance of enhancement. Finally, Experiment 3 tests the hypothesis that the lack of attenuation in the no-contact condition is due to the absence of double stimulation rather than predictive mechanisms. When contact and no-contact trials were mixed in an 80:20 ratio, such that participants would form predictions about the consequence of their active finger movement even if some trials lacked contact. In this case, attenuation was observed for both contact and no-contact trials, supporting the idea that attenuation is related to predictive processes linked to moving the active finger, and is not a simple consequence of double stimulation.

      The methodology and analysis plans for all three experiments were pre-registered prior to data collection. We can therefore be very confident that the results were not influenced by hypotheses developed only after seeing the data. The three experiments were each performed in a new set of participants. Experiments 2 and 3 included conditions that replicated the Experiment 1 effects, allowing us to be very confident that the results are robust.

      While the study has significant strengths, some aspects of the interpretation need to be clarified. In particular, the authors' interpretation depends on the idea that attenuation is absent in the no-contact condition because this action-sensory consequence relationship is an "arbitrary mapping." It is not clear what makes it arbitrary. The self-touch contact condition could also be considered somewhat arbitrary and different from real self-touch; the 2N test force was triggered by the right finger tapping a force sensor. If participants' tapping forces were recorded, it would be useful to include this information, particularly about how variable participants' taps were. In other words, unlike real self-touch, in this paradigm the force of the active finger tap did not affect the force delivered to the passive finger.

      By ‘arbitrary’, we refer to nonecological mappings between a movement and a somatosensory stimulus. In other words, a mapping that does not resemble how one touches their body (natural self-touch). Examples of such arbitrary mappings are moving the right finger in the air and receiving simultaneous touch on the other hand, as in Thomas et al. (2022), or moving a joystick or potentiometer with one hand and receiving a touch on the other hand. These joystick or potentiometer conditions are typically used as a control condition when studying somatosensory attenuation because they include an arbitrary sensorimotor mapping (Shergill et al., 2005, 2003; Teufel et al., 2010; Wolpe et al., 2016).

      We understand the reviewer’s point about the relationship between the forces applied with the right hand and the forces received on the left hand. First, we would like to clarify that we recorded the forces that the participants applied to the sensor in every experiment. We have now added a figure (Figure 3 – figure supplement 3) showing the forces over time across all participants in every experiment, which is referred to in the Methods on Lines 727-730. As we wrote in the Methods (Lines 720-727), and in line with previous studies (Asimakidou et al., 2022; Kilteni et al., 2021; Kilteni and Ehrsson, 2022), we asked participants to tap, neither too weakly nor too strongly, with their right index finger, “as if tapping the screen of their smartphone”. We did so because participants do not have an intuitive sense of how strong a force of 2 N is, and this instruction allowed them to apply forces of similar magnitude from trial to trial while receiving the same touch on their left index finger. Indeed, as shown in Figure 3 – figure supplement 3 (D-F), participants showed low trial-to-trial variability in the applied forces, with an average variability (s.e.m.) of only ± 0.13 N in Experiment 1, ± 0.12 N in Experiment 2 and ± 0.11 N in Experiment 3. In other words, they generated similar forces with their right index finger across all trials while receiving the same force on their left index finger, establishing an approximately constant gain between movement and touch and a perceived causality between the two (Bays and Wolpert, 2008; Kilteni, 2023). Critically, Bays and Wolpert (Experiment 1 in that book chapter) previously showed that the magnitude of attenuation remains unaffected when halving or doubling the gain between the force applied by the active finger and the force delivered on the passive hand as long as the gain remains constant throughout the experiment (Bays and Wolpert, 2008). This should not be surprising given that when one finger transmits a force through an object to another finger, the resulting force also depends on the object's properties (e.g., shape, material and contact area) and the angle at which the finger contacts the object. This is outlined in Lines 733-736 of the manuscript.

      One additional potential weakness is that participants' vision was occluded in Experiment 3, but not in Experiments 1 and 2. The authors do not discuss whether this difference could confound any of the analyses that compare results across experiments.

      We thank the reviewer for the comment. We do not think that blindfolding is a weakness of our study, as we designed our experiment to take this factor into account. Specifically, we blindfolded participants to ensure that they would not know when the force sensor was retracted on (unexpected) no-contact trials. This was essential for establishing an expectation that they would contact the force sensor. Importantly, participants were blindfolded in all conditions of Experiment 3 (contact, no-contact and baseline), so any effect of blindfolding was present across all conditions of Experiment 3. Since in the analyses of Experiment 3 (Lines 342-354), we always compared between conditions, blindfolding per se could not explain any differences between conditions, as any putative effects of blindfolding are effectively removed when contrasting two conditions in which participants were blindfolded. Notably, this argument also applies to the comparisons that we made between Experiment 3 and Experiments 1 and 2, since all these analyses (Lines 362-376) compare the difference between contact and no-contact trials (e.g., PSE values) between the experiments. Once again, any putative effects from blindfolding were effectively removed. We should also emphasize that the participants’ left index finger as well as the motor that delivered the force to their left index finger were occluded from view in Experiments 1 and 2. This was done to prevent participants from using any visual cues to discriminate between the two forces. This is has been included in the Methods section (Lines 772-775).

      In conclusion, blindfolding cannot explain the results of Experiment 3, and it did not alter the interpretation of any of our results derived by comparing the experiments. We have clarified this point in the manuscript (Lines 823-827).

    1. Author Response

      Reviewer #1 (Public Review):

      In this manuscript the authors perform a detailed analysis of the impact of food type on reproduction in C. elegans. They find that, in comparison with the standard OP50 strain of E. coli that is ubiquitously used to maintain C. elegans in the laboratory setting, the CS180 strain results in a reduction in the number of progeny that may be a consequence of an early transition from spermatogenesis to oogenesis that reduces total sperm number. They also find that the rate of oocyte fertilization is increased in animals fed CS180 vs. OP50. Using mutants and laser ablations, the authors show that, whereas the insulin-like peptide INS-6 acts in the ASJ sensory neurons to mediate the food type effect on total progeny and early oogenesis, the increased fertilization rate phenotype does not require ASJ or insulin-like signaling and instead requires the AWA olfactory neurons.

      The major strengths of the manuscript are the establishment of INS-6 as a link between food type and reproduction and the detail and rigor with which the experiments were executed. The results presented generally support the authors' model. This role of insulin-like signaling in connecting food type and reproduction makes it a plausible target for evolutionary forces that may have shaped insulin-like signaling in invertebrates. As such, this work contributes broadly to our understanding of how insulin signaling may have evolved prior to the emergence of vertebrates.

      We thank the Reviewer for these nice comments.

      A weakness of the work is the epistasis analysis of insulin-like pathway components, which is incomplete and at times difficult to interpret.

      We conducted an epistasis analysis between ins-6 and daf-16 with regard to early oogenesis onset on the CS180 diet. Through recombination of lin-41::GFP with the daf-16 deletion mutation on chromosome I, we showed that daf-16 mutants exhibit early oogenesis at mid L4 on CS180 (Figure 5C and F), which is unlike the ins-6 deletion (null) mutants or the reduction-offunction mutations in daf-2. Both ins-6 and daf-2 mutants exhibit delayed oogenesis on CS180 (Figure 5B, D, and F). Interestingly, the delayed oogenesis phenotype of ins-6 null mutants was not rescued by loss of daf-16, suggesting that wild-type ins-6 promotes early oogenesis independent of daf-16 (Figure 5F). This is reminiscent of the Arur lab’s findings, where daf-2 promotes germline meiotic progression independent of daf-16 in response to food availability (Lopez et al., Dev Cell 2013, vol 27, pp 227-240).

      Reviewer #2 (Public Review):

      The manuscript by Mishra et al. examines the modulation of the nervous system by different bacterial food to influence reproductive phenotypes-specifically onset of oogenesis, fertilization rate, and progeny production. Defining how animal reproduction could be modulated by bacterial food cues through neuroendocrine signaling is a fascinating subject of study for which C. elegans is well-suited. However, the overall scope of the current study is limited, and some of the central data do not provide compelling evidence for the authors' underlying hypothesis and model.

      1) Two strains of E. coli are examined, the standard C. elegans bacterial food strain OP50 and an E. coli strain that Alcedo and colleagues have previously characterized to influence aging and longevity through nervous system modulation. While the authors determine that differences in LPS structure present between the strains does not account for the food-dependent effects, there is little further insight regarding the bacterial features that contribute to the observed differences in reproductive physiology. Moreover, at least two of the phenotypes examined-total progeny and fertilization rate-are known to be affected by bacterial food quality and may be affected by bacteria in many ways, so the description of these phenotypes is somewhat less compelling than the study of the onset of oogenesis.

      Our study focused on how specific sensory neurons mediate the effects of different bacterial diets on three different aspects of C. elegans reproductive physiology—total progeny, oogenesis onset and fertilization rates. We examined the effects of three different bacteria, E. coli OP50, CS180 and CS2429, on these three phenotypes and the effects of two Serratia marcescens strains, Db11 and Db1140, on oogenesis onset. Of these five bacteria, only CS180 and its derivative CS2429, promote early C. elegans oogenesis.

      In the revised manuscript, we included the effects of a fourth E. coli strain, the K-12 HT115 on total progeny (Figure 2—supplement 1), oogenesis onset (Figure 2E) and fertilization rates (Figure 2F). We found that HT115 does not elicit the same response as CS180 on oogenesis onset and fertilization rates. Thus, the oogenic-inducing and fertilization-enhancing cue(s) appear to be specific to CS180 and its derivative CS2429. We started characterizing the potential nature of these CS180-derived cue(s). So far, we found that these cues are unlikely to be free, small metabolites, since they were lost upon filtration of the CS180-conditioned LB media through a nylon membrane that has a pore size of 0.45 µm (Figure 2G and H). While we agree with the Reviewer that the identification of these cues are important, we believe that it is beyond the scope of this manuscript.

      More importantly, we showed that the sensory neuron ASJ does modulate the timing of oogenesis and that this involves the insulin-like peptide ins-6 (please see our responses to the Essential Revisions section and Figures 5 and 6). We also showed that ASJ (Figure 7G and K) or ins-6 (Figure 8D) does not affect the food type-dependent fertilization rates, which are modulated by a different sensory neuron, the olfactory neuron AWA (Figure 7J and K). AWA in turn has no effect on the timing of oogenesis (Figure 7L). Thus, this manuscript links specific sensory neurons and insulin-like peptides to distinct aspects of oocyte biology, which we believe is a significant advance in the field of reproductive biology.

      2) The onset of oogenesis phenotype, using the lin-41::GFP reporter, seems more specific and tractable, and the authors nicely decouple this phenotype from the total progeny and fertilization rate phenotypes through experiments that shift animals to different bacterial food at specific developmental stages.

      We thank the Reviewer for this comment.

      However, as it stands, the data regarding the role of ins-6 and ASJ in modulating this phenotype, and the model that exposure to CS180 bacterial food causes a change in the ASJ expression of ins-6, which is sufficient to promote the earlier onset of oogenesis at the mid-L4 stage, seems somewhat incomplete and have some inconsistencies to be addressed.

      a) The ins-6 mutant phenotype is rescued by genome ins-6 and partially rescued by ins-6 expressed under and ASJ-specific promoter. The lack of rescue from an ASI promoter is puzzling given the secreted nature of ins-6.

      We address this in Essential Revisions, point 3. Briefly, we disagree that this is puzzling, since several labs have already shown that there are functional differences between the INS-6 produced from ASI versus the INS-6 produced from ASJ, using different experimental approaches (Chen et al., 2013; Tang et al., 2023; and this work). Indeed, the cell-specific activities of a secreted signal is not limited to INS-6, but has also been described for other secreted peptides, such as INS-1 (Kodama et al., 2006; Tomioka et al., 2006; Takeishi et al., eLife 2020, vol 9, e61167. Thus, the interesting question is why functional differences exist between the INS-6 peptides from the two neurons. This is a fascinating question, but beyond the scope of this manuscript.

      b) The ins-6 mutant phenotype with regard to delaying the early expression of lin-41::GFP on CS180 appears weaker than the daf-2 mutant phenotype. This is difficult to reconcile with what is known about the relative strength of the daf-2 mutant alleles relative to ins-6 for a wide range of phenotypes.

      There are evidence in the literature that the ins-6 mutant phenotype will not look exactly like that of daf-2 (Chen et al., 2013; Cornils et al., Development 2011, vol 138, pp1183-93; Fernandes de Abreu et al., PLoS Genet 2014, vol 10, e1004225). The DAF-2 insulin-like receptor is predicted to bind multiple insulin-like peptides (Pierce et al., Genes Dev 2001, vol 15, pp 672-686), some of which can act antagonistic to DAF-2 function (Pierce et al., 2001; Cornils et al., 2011; Chen et al., 2013; Fernandes de Abreu et al., 2014). Thus, the oogenic effects of the reduction-offunction mutations in daf-2 are likely the sum of multiple insulin-like peptides, some of which might also delay oogenesis. This could explain why the manipulation of an individual insulin-like peptide, INS-6, which could bind DAF-2 to promote oogenesis, does not closely resemble the phenotype of daf-2 mutants.

      c) The daf-16 loss-of-function phenotype and suppression of daf-2 and ins-6 mutant phenotypes are not shown for the lin-41::GFP expression phenotype.

      We address this in the Public Review comments of Reviewer 1. Briefly, we focused on the epistasis analysis between ins-6 and daf-16 and showed that ins-6 promotes early oogenesis independent of daf-16.

      d) The modest difference in ins-6p::mCherry expression in the ASJ neurons (Figure 5D) make the idea that this difference causes onset of oogenesis somewhat implausible.

      We disagree that this change is modest and that the oogenic effect of such a change is implausible.

      First, the change in ins-6p::mCherry expression in ASJ on CS180 is comparable to other physiologically-important expression changes that have been reported for other genes (for example, Entchev et al., eLife 2015, vol 4, 4:e06259, for the tryptophan hydroxylase tph-1 and the TGF-β daf-7; and Tataridas-Pallas et al, PLoS Genet 2021, vol 17, e1009358, for the neuronally expressed NRF transcription factor skn-1b). Second, it is worth noting that we were using a single-copy reporter for ins-6 expression, where detected changes will be smaller but should be closer to physiological responses. It is possible that multiple-copy reporters will give larger changes, but that would be further from a physiological response. Third, the change in ins-6p::mCherry expression is comparable in scale to the ins-6 mutant phenotype. Our results showed that the 35% increase in ASJ expression of ins-6 is due to food type (Figure 6A; mean fluorescence on OP50 = 1526 + 94; mean fluorescence on CS180 = 2056 + 104). This change in magnitude is similar to the loss of lin-41::GFP expression in mid L4 of ins-6 mutants versus controls. About 30% to 43% of control worms express lin-41::GFP, whereas 0% of ins-6 mutants express the same reporter at mid L4 on CS180 (Figure 5 and its associated supplement).

      e) The strain carrying an genetic ablation of ASJ appears to have a markedly different baseline of kinetics of lin-41::GFP expression (even at lethargus, less than half of the animals appear to express lin-41::GFP). Given this phenotype, it seems difficult to draw conclusions about bacterial food-dependent effects on expression of lin-41::GFP. Additional characterization corroborating timing of oogenesis independent of the lin-41::GFP marker may be helpful, but something seems amiss.

      We address this in Essential Revisions, point 4. Briefly, we disagree that the kinetics of lin-41::GFP expression in ASJ-ablated animals is puzzling, compared to the kinetics observed in insulin signaling mutants. Besides ins-6, ASJ expresses multiple signals (Taylor et al., 2021), some of which might also regulate the multiple functions of oogenic lin-41::GFP. Thus, it should not be surprising that loss of ASJ will have a markedly different effect on oogenesis than the loss of ins-6.

      Reviewer #3 (Public Review):

      I very much enjoyed reading this paper by Shashwat Mishra and team from Joy Alcedo's and from Queelim Ch'ng's laboratories dissecting how sensory signals regulate reproduction in worms. The mechanisms by which sensory inputs affect the function of the germline, the balance between growth and differentiation within this tissue, are of broad interest not only to those interested in reproduction and differentiation, but also to those interested in the mechanisms of plasticity that enable organisms to adjust to changing environmental conditions. These mechanisms are only now beginning to be characterized. Here the focus is on the role of insulin signals expressed in sensory neurons. This work builds on previous findings by the Alcedo lab that sensory perception of bacterial-type dependent signals regulates C. elegans lifespan. Here their focus is on the effects on reproduction, and on the communication of that information by insulin-like signals.

      We thank the Reviewer for these nice comments.

      Worms have a huge family of 40 insulin-like genes, which the Alcedo and Ch'ng labs have been studying for many years. The paper starts with the interesting premise that the brood size of the worms is food type dependent. The authors show that this is due to effects on the timing of the onset of oogenesis during larval development (which constrains the size of the pool of sperm available for subsequent oocyte fertilization) as well as on effects on the rate of oocyte fertilization during adulthood. Using clever timing for food switching, they show that the effects on oogenesis onset and on fertilization rate are separable. In addition, these effects did not appear to be merely the outcome of indirect effects of food ingestion, but were, instead, at least in part, due to the perception of environmental information by specific sensory neurons. Using mutants affecting transduction of sensory information in specific neurons and genetic ablation of specific neurons, the authors show that the onset of oogenesis and the rate of reproduction were controlled by different sensory neurons, ASJ and AWA, respectively. One of these neurons, ASJ, transmitted environmental information via the ins-6 neuropeptide.

      Altogether, the paper advances our understanding of how environmental determinants influence reproduction.

      We thank the Reviewer for these nice comments.

    1. Author Response

      Reviewer #1 (Public Review):

      However, the authors are cautioned to tone down some of the sentences with the human diabetic samples as they rely heavily on extrapolation rather experimental tests.

      Thank you for this feedback. We have added an experimental test to support the CellChat results. We found that, in accordance with the CellChat analysis, more macrophage Gas6 expression is observed in diabetic wounds via IF. These data are now included in Figures 3C-D. We have additionally edited the text relating to Figure 3 to indicate that these results are not fully conclusive.

      For instance, the antibody inhibition of Axl had minimal effect on the clearance of apoptotic cells in the wound and this would be expected with the redundancy endowed by other TAM receptors.

      Thank you for this point. We have made a note of this in the text in lines 289-291.

      For instance, in Figure 6, the number of TUNEL+ cells seem to be higher in the IgG samples compared to the anti-Timd4 treatment, but this is not the case in the quantification

      Thank you for this comment. We have replaced these with more representative images, which appear in Figure 6A. We also repeated the staining with antibodies for cleaved caspase 3, which appear in Fig. 6 – Fig. supplement 1A, which showed similar results.

      Reviewer #2 (Public Review):

      I suggest to repeat the quantification of cells containing active caspase-3 with an anticleaved caspase-3 antibody. Here the authors use an antibody recognizing phospho S150 antibody, which is far from generally accepted to be a marker for active caspase-3. It would also be good to quantify the apoptotic cells observed in the sections (Fig 1 I and J) and compare to control treatment on sections. It is not clear from the data presented whether the number of apoptotic cells increases or not in the time frame analyzed since the controls are lacking.

      Thank you for this important suggestion. We have repeated the IF staining using an antibody for cleaved caspase 3 (Cell Signaling 9661S) and quantified the apoptotic cells present. We found that apoptotic cells were rare but present at both 24h and 48h after injury, and that significantly more cleaved caspase 3+ cells were present in 48h wounds than 24h wounds. These data are now included in Figure 1H-J and Fig. 1 – Fig. supplement 1F. We have also used this antibody in IF staining in Fig. 5 – Fig. supplement 1B and Fig. 6 – Fig. supplement 1A.

      In a FACS analysis (Fig S1 H), the authors show that there is no increase in dead cells in a time frame of 48 hrs. Could it be that the majority of the cells that may have died in vivo, were lost during the procedure of tissue digestions. Dead cells tend to aggregate.

      Based on these comments and the inconsistency in these data due to potential technical challenges, we have removed the FACS data quantifying Annexin V. We now include the quantification of cleaved caspase 3 and an efferocytosis assay to analyze the kinetics of efferocytosis.

      On line 104 the authors refer to the apoptosis-inducing activity of G0s2. Please, realize that there is little or no in vivo evidence for a role of G0s2 in apoptosis.

      Thank you for this helpful comment. We have removed this gene from our analysis and text.

      The authors state that Axl is uniquely expressed in DC and fibroblasts (Fig 2). Are the Axlcells positive in panel G (red, Fig 2) that do not stain for the Pdgfra marker (green) then all DCs? Please clarify or show with a triple staining that these cells are indeed DCs.

      Thank you for this comment. To clarify, our intention was to show that both DCs and fibroblasts express Axl, not to say conclusively that only DCs and fibroblasts express Axl. Indeed, in Figure 5, we show that a portion of macrophages also express Axl (at day 3), so some of the Axl+ cells in 2G may be macrophages rather than DCs. We have made this more clear in the text in lines 163-166.

      In addition, it is not clear to me to what reference level exactly the expression levels are compared in Fig 2A. Is this between the 24 and 48h time points after wounding (as mentioned in the legend)? If so, the analysis may indicate up or down regulation but not necessarily expression or no expression.

      Thank you for making this point. The heatmaps display scaled log-normalized mRNA counts for the entire dataset, not a comparison between the two timepoints. We have clarified this in the figure legends.

      2) Human diabetic wounds display increased and altered efferocytosis signaling via Axl. This conclusion is solely based on CellChat analysis and should be tuned down or validated.

      Thank you for this suggestion. We have experimentally validated this conclusion using IF staining for Gas6. We found that more Gas6 staining in CD68+ macrophages in diabetic foot ulcers when compared to nondiabetic foot wounds. These data are now included in Figure 3C-D.

      The authors conclude that anti-Axl treatment leads to healing defects based on lack of granulation tissue and larger scabs, a reduction of fibroblast repopulation and revascularization. The differences in the last two parameters mentioned above are obvious, however the other parameters, as granulation tissue and scabs are less clear to me. Is this quantified in any way? In Fig S4 D there is also a large scab visible in the control treatment image. Therefore, it would be good if these parameters could be better substantiated.

      Thank you for this comment. We have edited the text in lines 301-304 to de-emphasize these qualitative changes.

      In view of the lack of revascularization, are there differences in the mRNA expression levels of angiogenic factors such as VEGF and others at this time point? Does revascularization occur at later stages?.

      Thank you for this helpful suggestion. We have used qPCR to measure Vegfa mRNA expression, and these data are now included in Figure 5I. We found no significant difference in Vegfa expression 5 days after injury.

      Based on the FACS analysis the authors claim that there are no differences at the level of DCs. However, the plots shown in Fig 5C do not convincingly show the detection of DC (as boxed in the lower panel). Based on the density plots one would presume this is just the continuation of the CD11b+ population and not a separate CD11c+ population. To get a better view of that, it would be better to show dot plots instead of density plots.

      Thank you for this insightful comment. We have created new plots as suggested to demonstrate that this is not exactly the case. In the wound bed, contrary to what we see in blood isolates many times the full separation of populations is elusive and to ensure that we use single stain controls to set the gates. Nonetheless, we provide in Author response image 1 the same data as dot-plots as requested to show that that is not the case, alongside the single stain control to show that the gating strategy is adequate. We do understand and acknowledge that in dissociated tissues sometimes the outlines are not as perfect as what is obtained in immunological samples.

      Author response image 1.

      Finally, the authors state (line 265-266) that anti-Axl treatment leads to non-significantly increased expression of IL1alpha and IL6 after one day of injury (Fig S4C). If the difference between the control-treated and the anti-Axl-treated group is statistically not significant I would not conclude there is an increase. Please adapt phrasing or include more mice in the experiment (now only 4) to substantiate the observation and clarify whether it is increased or not.

      Thank you for this comment. We have altered the text in lines 286-289 to better reflect this.

      The authors conclude that overall healing was not affected but that the wound beds appeared more fragile. What is meant with 'appeared more fragile' is not clear. In addition, this seems to me a quite subjective interpretation. What are the objective parameters to come this conclusion?

      Thank you for this point. We have altered the text to remove this subjective language.

      Similar to inhibition of Axl, inhibition of Timd4 led to a defect in revascularization as witnessed by the absence of CD31 staining. Also in this experiment one can raise similar questions as in the anti-Axl experiment: 1) does revascularization occur at a later timepoint; 2) what about the expression of angiogenic factors?

      Thank you for this helpful suggestion. To further investigate the impact of Axl inhibition of angiogenesis, we have assayed for Vegfa by qPCR. We found no significant difference in Vegfa expression 5 days after injury. These data are now included in Figure 5I.

      In the anti-Timd4 treated wounds the authors observe more TUNEL-positive cells and conclude that this is due to a defect in efferocytosis. However, the formal experimental proof for this in the current model is lacking. How do the authors exclude the possibility that anti-Timd4 treatment attracts more infiltrating cells that then undergo treatment, or that the treatment with anti-Timd4 leads to more apoptosis of certain cells in the wound bed. What is the nature of these apoptotic cells (neutrophils, T cells, others)? It has been shown that Timd4 can have stimulatory effects on other cells, such as T cells. Could deprivation of Timd4 signaling in certain conditions lead to more dying cells in this model?

      Thank you for this insightful comment. To investigate this, we have repeated this experiment with IF staining for cleaved caspase 3 and found similar results, indicating the increase in apoptosis upon Timd4 inhibition (Fig. 6 – Fig. supplement 1A). We have also included text to acknowledge the possibility of an increase in apoptosis in lines 326-327.

      Reviewer #3 (public Review)):

      They never do show that there is an increase in apoptotic cells in the wounds, which then go down (which would be a sign that the cells are being cleared via efferocytosis. In addition, they are looking for apoptotic cells at very early time points (24-48 hours), times at which large numbers of apoptotic cells would not be expected. As an example, neutrophil infiltration peaks at 24-48 hours and efferocytosis of apoptotic neutrophils would be expected after that. Other types of apoptotic cells would likely be cleared even later. Finally, several of the panels showing apoptotic cells were done with a very small number of samples (1-3 per group) in some cases so it is unclear how rigorous the data are. I would recommend that the authors at the very least soften the wording related to these conclusions and discuss the limitations of their experimental design; ideally data from more samples would be included to provide clear support those statements.

      Thank you for raising this important point. In order to support these claims, we have undertaken two additional experiments. Firstly, we have repeated the immunofluorescence staining with a new antibody for activated caspase 3 and quantified the number of apoptotic cells present in 24h and 48h wound beds. We found that apoptotic cells significantly increased in 48h wound beds compared to 24h wounds (Figures 1H and Fig. 1 – Fig. supplement 1F).

      We have also undertaken a new experiment to show the temporal regulation of efferocytosis. We injected stained apoptotic neutrophils into 1D, 3D, and 5D wound beds and quantified the stained cells remaining after 1 hour in order to quantify the clearance of cells from the wound bed at different timepoints. We found that significantly more stained cells undergoing efferocytosis remained in 5D wounds, and that the rate of efferocytosis was approximately constant over this timeline. These data are now included in Figures 2H-M.

      While we would be interested to determine the identities of cells engaging in efferocytosis of the labeled apoptotic neutrophils, we found that co-staining for additional cell markers was impossible while maintaining the fluorescent labeling on the injected neutrophils.

      2) The human RNA-seq data is also quite limited, as non-diabetic wound tissue was all from one patient. Again, this limitation should be acknowledged.

      Thank you for this feedback. We have analyzed new data sets that include 5 individuals with diabetic foot ulcers and 4 individuals with non-diabetic wounds. These data are now included in Figure 3.

      Also, there are some important published papers by Sashwati Roy's group indicating that there are defects in efferocytosis in diabetic wounds, which may go against what the authors are showing here to some degree. Discussion of the authors' work in relation to these other studies should be discussed.

      Thank you for this suggestion. We have included discussion of this work to the text in lines 192193.

      3) For anti-Axl and anti-Timd4 experiments, the authors conclude that inhibition of Axl does not affect TUNEL+ cells and that Timd4 does not affect reepithelialization. However, in some cases the sample size was only 3 mice per group when measuring these parameters. That is a very small number of samples to draw conclusions about apoptotic cells or reepithelialization since these parameters are key for the overall conclusions of the experiments. Given that these are key data, it would be important to include more than n=3. Additionally, as stated above, a time point later than 24 h may be necessary to actually see changes in apoptotic cells.

      Thank you for this suggestion. We have repeated the staining for apoptotic cells using a new antibody for cleaved caspase 3 and stained wound beds from additional mice. In the anti-Axl experiments, we now show data for cleaved caspase 3 staining of 3- and 5-day wound beds with N=4 (Fig. 5 – Fig. supplement 1B). In the anti-Timd4 experiments, we now have N=6-11 for the TUNEL staining at 5 days after injection and injury (Figure 6B).

      4) In Fig 6, there look to be many more TUNEL+ cells in the wound bed of IgG control samples compared to anti-Timd4-treated samples, which contradicts the graph. Perhaps the authors could clarify where they were taking their measurements for panels with image analysis results.

      Thank you for this helpful point. We have updated this figure to be more representative of the quantification (Figure 6A-B), as well as repeated the staining with antibodies for cleaved caspase 3 (Fig. 6 – Fig. supplement 1A).

      Another question related to this experiment is how it is possible that efferocytosis is so drastically different yet there are no changes in wound healing (this is one reason why a larger sample size for reepithelialization may be critical) - this would seem to suggest that efferocytosis is not important in wound healing, which is confusing. Further discussion on this might be useful.

      Thank you for this point. Indeed, we see that there is a defect to revascularization when Timd4 is inhibited (Figure 6E-F), which indicates that efferocytosis is important to normal healing. This is discussed in lines 333-335.

    1. Author Response

      Reviewer #3 (Public Review):

      Comment 1: I'm having some difficulty understanding the logic of Figure 5 in determining cis processing. It is an inverse of figure 4, and in my view, provides further evidence of trans processing. A better experiment would be to use WT-citrine tagged protein with catalytic dead mcherry and image them together. This would show WT cis processing occurs faster than trans processing as citrine specks should appear earlier than the mCherry ones. Can also do colocalization and FRET-based assays with the pair.

      We thank the reviewer for pointing this out. While our data demonstrate that the same molecule must be catalytically active and competent for processing at the IDL (Figure 5), we agree that the data do not rule out trans-processing as a mechanism for speck formation. We have therefore modified the interpretation of these findings accordingly (pp. 7-8). We agree that some of the quantitative assays the reviewer has suggested would strengthen this logic, and we are making efforts to carry out a kinetic FRET-based assay for our upcoming biochemistry-focused manuscript to better characterize the enzymatic affinity of Casp11 for cis- vs. trans- based autoprocessing, and how either impacts Casp11 speck assembly.

      Comment 2: Do those casp11 specks still contain CARDs?- i.e. is the second cleavage necessary for speck formation? Is CARD necessary at all? Would adding the TEV site at CDL and b/w p20 and p10 rescue? i.e. trans-activate?

      We are grateful to the reviewer for these insightful questions, which we also had considered. We addressed this question in two ways – first by replacing the CARD with a DmrB dimerizable domain that undergoes inducible dimerization of Casp11 in the presence of the dimerizing drug AP20187. Critically, inducible dimerization of DmrB-ΔCARD-Casp11-mCherry significantly enhances Casp11-mCherry speck formation, and this speck formation requires catalytic activity, even in the presence of dimerizer (Figure 6A-C). Moreover, we generated CARD-less Casp11-mCherry constructs containing wild-type p20-p10 and catalytically inactive p20-p10. Intriguingly, the CARD was dispensable for spontaneous Casp11-mCherry speck formation, which again was dependent on catalytic activity (Figure 6-figure supplement 2A-B). While we do not currently have data with a TEV-cleavable CDL construct, our data here demonstrate that the CARD is dispensable for speck formation in an overexpression system, implying that the p20/p10 contains all the information that is necessary and sufficient to mediate spontaneous assembly of Casp11 specks in HEK293T cells. Nonetheless, as forced dimerization enhances speck formation (Figure, we hypothesize that CARD-LPS interactions act to facilitate catalytic activity and push cooperative assembly of the Casp11 speck.

      To address whether both the N-terminal CARD and C-terminal p10 domains are present in Casp11 specks, we performed a dual-fluorophore co-localization assay in which we transiently expressed C-terminal mCherry-tagged Casp11 constructs (Casp11-mCherry) in HEK293T cells that stably express N-terminal Flag-tagged Casp11 (2xFLAG-Casp11). As expected, Casp11-mCherry formed specks spontaneously in this setting (Figure 3-figure supplement 1). Critically, both the N-terminal FLAG and C-terminal mCherry were found together in these specks, indicating the presence of both Casp11 N- and C- termini within the specks. Moreover, the wild-type Casp11-mCherry also recruited catalytically inactive 2xFLAG-Casp11C254A, again supporting the finding that wild-type Casp11 can recruit a catalytic mutant to noncanonical inflammasome complexes.

      Comment 3: What are the equations that fit experimental data points and R2 for? E.g. Figure 1E. What are the parameters being fitted/compared and how are those interpreted? A table of fitted values and proper interpretation should be provided.

      We thank the reviewer for this request to clarify how the curves were fit to the experimental data points. We have modified our ‘Statistical Analysis’ section and all figure legends that contain dose-response curves to reflect the equations used to fit each curve. Additionally, please find a table of raw values in the corresponding source data provided for each dose-response curve (Figure 2 Source Data 5; Figure 4 Source Data 3, 6; Figure 5 Source Data 3, 4; Figure 7 Source Data 2; and Figure 4-figure supplement 1 Source Data 1).

    1. Author Response

      Reviewer #1 (Public Review):

      This paper examines different signaling networks and attempts to give general results for when the network will exhibit biphasic behavior, which is the situation when the output of the network is a non-monotonic function of its inputs. The strength of the paper is in the approach it takes. It starts with the simplest network motifs that produce biphasic behavior and then asks too what happens when these motifs are parts of larger networks. Their approach is in contrast to the usual way in which this question is tackled, which tends to be within the confines of a specific signaling network, where general results like the ones that the authors are after, might be hard to spot.

      We thank the reviewer for the careful reading of the manuscript and for the comments and appreciate the fact the reviewer regards the approach as the strength of the paper.

      The weakness of the paper, in my opinion, is the rather formal description of the results which I am afraid will be of rather limited utility to experimental groups seeking to make use of them. The paper attempts to provide general rules for when to expect biphasic behavior and it was hard to assess to what extent such rules exist as behaviors can change depending on the context of a larger network in which the smaller biphasic one is embedded. The other thing that made assessing the generality of the results difficult is that the input-output functions shown in all the figures are computed for a specific choice of parameters and I was left wondering how different choices of parameters might change the reported behaviors. The lack of specific proposals for how their results should guide future experiments on different signaling networks is another weakness.

      We address these points in a number of ways. Initially our presentation was intended to highlight unambiguously which systems (especially the substrate modification building blocks) were capable of biphasic response and which were not, and highlighting parameter dependence on intrinsic kinetic parameters. Based on both referee comments, we make a number of changes

      (a) We highlight the rationale for choosing the suite of biochemical substrate modification systems: enzyme/substrate sharing is a key driver for the origins of biphasic responses and the suite of systems we employ allows us to systematically explore this (see Response to Essential Revisions). These are building blocks of many pathways,

      (b) Biphasic responses emerge from a built in competing effect. In every instance of substrate modification systems, we now highlight the mechanistic underpinning which gives rise to the competing effect responsible for the biphasic response. This will help experimentalists and modellers alike obtain insights into how such behaviour may arise, and the associated ingredients which facilitate that (which may be relevant in other systems). Similarly, we highlight how altered behaviour at the network level may arise from a biphasic interaction pattern, providing the intuition therein and guide further experimental investigation (also see Response to Essential Revisions).

      (c) With regard to parameters (also see Response to Essential Comments) firstly we emphasize that we completely characterize at the substrate modification level, whether biphasic responses are possible as a function of intrinsic kinetic constants. This is done for every system studied. In Fig 2, we depict this, along with sample biphasic dose responses, for pictorial depiction. However, the essential point is that the parametric dependence on intrinsic kinetic parameters is completely done. We indicate in which cases biphasic responses are impossible irrespective of intrinsic kinetic parameters, where they can be obtained for every value of the intrinsic kinetic parameters, and where there are partial restrictions in the intrinsic kinetic parameter space for obtaining this. In the revision we have performed further parametric analysis to assess the impact of species total amount providing further insights. We have also shown that in all these systems biphasic responses can be obtained in ranges of kinetic parameters similar to those found experimentally (eg Wistel et al 2018) and for reasonable species total amounts in systems and synthetic biology. This is analyzed, and depicted in Figure 2-figure supplement 3 and Figure 2-figure supplement 4.

      (d) Also, in response to another comment (about behaviour changing in networks): we first emphasize that we start at the substrate modification level to uncover drivers of biphasic responses at this level. Biphasic responses arise from an inbuilt competing effect and we demonstrate different ways in which such an inbuilt competing effect arises, through sharing of enzymes or substrates. While it is true that the behaviour can change as part of a network (a) It still remains that there are these in-built competing effects which can generate biphasic responses (both substrate and enzyme) and this can manifest at a pathway or network level under suitable conditions (b) the fact that behaviour at a network level may be altered is exactly why we consider studies at the network level showing both biphasic patterns in interaction (the overall behaviour is determined by the motif and the biphasic pattern of interaction and studies involving interaction of biphasic responses at both the network and substrate modification level!! (subsection: The network level)

      (e) We have also expanded on a paragraph on testable predictions in the conclusions (p10).

      Taken together, we believe that these results should interest both experimentalists and modellers and have intrinsic value as well.

      While I appreciate that the authors adopted a style of presenting their results such that all the mathematics is buried in the figures, I found that it made reading the paper quite difficult, and contributed to my confusion about which results are general and insensitive to parameter choices and which are not. I believe a narrative that integrated the math with some simple intuition might have been more effective. For example, when the authors say in the text that model M0 is incapable of displaying biphasic response, how general is that result? Later on, when discussing model M2, they provide a criterion for biphasic response in terms of products of rate constants satisfying an inequality, but the meaning of this condition is not described. Such things make it hard to learn from the authors' work.

      This has indeed been incorporated, and we agree that presenting the intuition and mechanistic underpinning for the behaviour aids readability. In addition to the points about parameters which are now explained at length in the paper , there are a number of paragraphs providing the mechanistic underpinning and intuition for why the behaviour is obtained. Both these are discussed at length in Response to Essential Revisions. Thus, both the mechanistic intuition and the role of parameters are addressed in detail in the revision.

      When M0 is mentioned to be incapable of yielding biphasic responses we mean just that: irrespective of any parameter choice in the model. The meaning of the criterion in Model M2 is now discussed. We take the point about not being able to learn from the work seriously and have made various changes both on the intuition and clarifying the impact of parameters.

      The text is sprinkled with statements like "this reveals the plurality of information processing behaviors..." where the meaning is quite opaque (for this example, there is no description of "information processing" and what it might mean in this context) and therefore it makes it hard to understand what are the lessons learned from these calculations. Another example is found in the description of Erk regulation where the authors speak of "significant robustness" but what is meant by "significant" is also unclear.

      Yes, we agree that these phrases are distracting and not adding much and so we have removed them.

      Overall, I think this is an interesting attempt to provide a general mathematical framework for analyzing biphasic response of signaling networks, but the authors fall short for the reasons described above. I think a lot can be fixed by improving the way the results are presented.

      We have indeed taken these comments on board and aimed to improve the presentation

      Reviewer #2 (Public Review):

      Biphasic responses are widely observed in biological systems and the determination of general design principles underlying biphasic responses is an important problem. The authors attempt to study this problem using a range of biochemical signaling models ranging from simple enzymatic modification and de-modification of a single substrate to systems with multiple enzymes and substrates. The authors used analytical and computational calculations to determine conditions such as network topology, range of concentrations, and rate parameters that could give rise to biphasic responses. I think the approach and the result of their investigation are interesting and can be potentially useful. However, the conditions for biphasic responses are described in terms of parameter ranges or relationships in particular biochemical models, and these parameters have not been connected to the values of concentrations or rates in real biological systems. This makes it difficult to evaluate how these findings would be applicable in nature or in experiments. It might also help if some general mechanisms in terms of competition/cooperation of time scales/processes are gleaned which potentially can be used to analyze biphasic responses in real biological systems.

      We thank the reviewer for a careful reading of the manuscript and for the various comments and are happy to see the reviewer find the approach interesting. We address these comments in more detail below.

      Reading these comments, we recognized how various analysis and algebraic equations could appear opaque to a reader both in terms of what it conveys and its import. To address this, we made a number of changes.

      1. First and foremost, we provide the mechanistic underpinning and intuition for why a competing effect emerges in the first place. We do this for every substrate modification system we analyze and make further comments in the subsection focussing on the network level as well as ERK This intuition should help a reader where the result is coming from and be then able to see if it might apply in a quite different system. This is discussed in detail in Response to Essential Revisions.

      2. Secondly, we have discussed many aspects of the parameters in more detail. Our goal, especially in substrate modification systems was to be able to completely characterize the role of intrinsic kinetic parameters: whether biphasic responses was impossible irrespective of parameters, whether they were possible for every value of intrinsic kinetic parameters or whether they were possible in a subset of kinetic parameter space. This has been done for every substrate modification system, and has been discussed more explicitly in the revision. Furthermore, when biphasic responses were possible, we aimed to determine the impact of species total amounts which facilitated the response. Here we performed additional analytical and semi-analytical work. Additionally with the semi-analytical work and parameters chosen in ranges very similar to those found experimentally (eg Wistel et al 2018), we are able to show that biphasic responses can indeed be obtained in experimentally feasible ranges. Further aspects of the parameters are discussed in detail in the Response to Essential Revisions. In particular, a number of new paragraphs (p2-3, p6) and plots Figure 2-figure supplement 3 and Figure 2-figure supplement 4 specifically deal with this.

      Taken together these address the reviewers points.

    1. Author Response

      Reviewer #1 (Public Review):

      This interesting manuscript sets out to develop for the mouse a series of important concepts and models that this group has previously developed for models of monkey brains, where they showed that in a large-scale model, anterior → posterior spatial gradients such as spine density (and thus inferred strength of local coupling) lead to a transition from transient stimulus responses to persistent responses, capable of supporting working memory (WM). No such spine density gradient is found in the mouse. Here, the authors propose and use modeling to explore the idea, that the corresponding gradient may be that of density of inhibitory PV cells in different regions of the brain.

      The goal of the study - a large-scale, anatomically-constrained model of WM - is an extremely valuable one, and the authors' efforts in this direction should be supported. That said, some of the main claims in the manuscript were not, at least as currently written, clearly supported by the data, a number of important clarifications need to be made, and some claims of novelty are made in a way that, for a typical reader, may obscure the actual contribution being made.

      The biggest issue is that one of the main claims, that together with cell-type specific long-range targeting, "density of cell classes define working memory representations" (abstract), is not terribly clear. For example, Figs. 2D and 2E show that a brain region's hierarchical location tightly predicts its persistent firing rate (2D), but that PV cell fraction has a far weaker correlation (2E). Is hierarchical location sufficient? If PV cell fraction were constant across model brain regions, would we still get persistent activity modes? It seems likely that the answer may be "yes", but the answer, easily within reach of the authors, is surprisingly not in the current version of the manuscript. Figure 3D, for the thalamocortical model, shows no significant correlation of firing rate with PV density.

      Given the claim about PV density (in the abstract and the first main point of the discussion), this is a big concern. Yet it seems easily addressable: e.g. if indeed the authors found that hierarchy was sufficient and PV density immaterial, the model would be no less interesting. And if the authors demonstrated clearly that a PV density gradient is required, that would make the claim a solid one. If, within the model, such a causal demonstration is present, this reader at least missed it.

      MAJOR CONCERNS:

      (1) The model appears to be a model of a single side of the brain. Perhaps each brain region in the model could be considered an amalgam of that region across both sides of the brain. Yet given results like Li et al. Nature 2016, who show that persistent activity is robust to inhibition of one side, but not both sides of ALM, at the very least discussion of the issue is warranted.

      The model is indeed a one-hemisphere model, and an expansion to a bihemispheric model is considered for future work. We have added the following sentence in the Discussion section:

      “Future versions of the large-scale model may consider different interneuron types to understand their contributions to activity patterns in the cortex (Kim et al,2017; Meng et al., 2023; Tremblay and Rudy, 2016; Nigro et al., 2022), the role of interhemispheric projections in providing robustness for short-term memory encoding (Ni et al., 2016), and the inclusions of populations with tuning to various stimulus features and/or task parameters that would allow for switching across tasks (Yang et al, 2018).”

      (2) The authors make an interesting attempt to distinguish core WM regions from other regions such as "readout" regions, defined as showing persistent activity yet not having an effect on persistent activity elsewhere in the network.

      However, this definition seemed problematic: for example, consider a network that consists of 20 brain regions, all interconnected to each other, and all equivalent to each other, capable of displaying persistent activity thanks to mutual connectivity. Imagine that inhibition of any one of these regions is not sufficient to significantly perturb persistent activity in the other 19. Then they would all be labeled as "readout". Yet, by construction in this thought experiment, they are all equivalent to each other and are all core areas. Such redundancy may well be present in the brain. How would the authors address this redundancy issue?

      We acknowledge the importance of this thought experiment. Although we initially restricted the definition of core area to how a single area contributes to working memory, we proceeded with concurrent inhibition of multiple readout areas (see Essential Revisions response 6 above).

      (3) Also important to discuss would be the fact that every brain region in this model is set up as composed of two populations, and when long-range interactions are strong and the attractors strongly coupled, the entire brain is set up as a 1-bit working memory. How would results and the approach be impacted by considering WM for more flexible situations?

      We have used a model of two populations as the simplest way to integrate large-scale connectivity and inhibitory gradients. Indeed, future work should consider more realistic connectivity and populations with various degrees of tuning to different task parameters. (see Reviewer 1 response 1 above)

      (4) Another concern that is important yet easily addressed is the authors' use of the term "novel cell-type specific graph theory measures". Describing in the abstract and elsewhere the fact that what they mean is to take into account the sign of connections, not just their magnitude, would transmit to readers the essence of the contribution in a manner very simple to understand. Most readers would fail to grasp the essential point of the current labeling, which sounds potentially very vague and complex.

      We have reworded the abstract - see also Essential reviews response 2 above.

      (5) Finally, the overall significance of the study, and advances over previous work, were not entirely clear. In the discussion, the authors identify three major findings: (1) WM function is shaped by the PV cell density gradient. But as above, further work is required to make it clear that this claim is supported by the model. (2) if local recurrent excitation is insufficient to generate persistent activity, then long-range recurrent excitation is needed to generate it. I had trouble understanding why a model was needed to reach this conclusion - it seems as if it is simply a question of straightforward logic. The discussion states that in this regard, the work here "offers specific predictions to be tested experimentally", but I had trouble identifying what these specific predictions are. (3) Taking into account sign, not only magnitude, of connections, is important. This last point once again seemed a matter of straightforward logic, making its novelty difficult to assess.

      We thank the reviewer, we have addressed these issues in the Essential Revisions 3) above.

      Reviewer #2 (Public Review):

      This paper uses the mouse mesoscale connectome, combined with data on the number and fraction of PV-type interneurons, to build a large-scale model of working memory activity in response to inputs from various sensory modalities. The key claims of the paper are two-fold. First, previous work has shown that there does not appear to be an increase in the number of excitatory inputs (spines) per pyramidal neuron along the cortical hierarchy (and this increase was previously suggested to underlie working memory activity occurring preferentially in higher areas along the cortical hierarchy). Thus, the claim is that a key alternative mechanism in the mouse is the heterogeneity in the fraction of PV interneurons. Second, the authors claim to develop novel cell type-specific graph theory.

      I liked seeing the authors put all of the mouse connectomic information into a model to see how it behaved and expect that this will be useful to the community at large as a starting point for other researchers wishing to use and build upon such large-scale models. However, I have significant concerns about both primary scientific claims. With regard to the PV fraction, this does not look like a particularly robust result. First, it's a fairly weak result to start, much smaller than the simple effect of the location of an area along the cortical hierarchy (compare Figs. 2D, 2E; 3C, 3D). Second, the result seems to be heavily dependent upon having subdivided the somatosensory cortex into many separate points and focusing the main figures of the paper (and the only ones showing rates as a function of PV cell fraction) solely on simulations in which the sensory input is provided to the visual cortex. With regards to the claim of novel cell type-specific graph theory, there doesn't appear to be anything particularly novel. The authors simply make sure to assign negative rather than positive weights to inhibitory connections in their graph-theoretic analyses.

      Major issues:

      1) Weakness of result on effect of PV cell fraction. Comparing Figures 2D and 2E, or 3C and 3D, there is a very clear effect of cortical hierarchy on firing rate during the delay period in Figures 2D and 3C. However, in Figure 2E relating delay period firing rate to PV cell fraction, the result looks far weaker. (And similarly for Figs. 3C, 3D, with the latter result not even significant). Moreover, the PV cell fraction results are dominated by the zero firing rate brain regions (as opposed to being a nice graded set of rates, both for zeros and non-zeros, as with the cortical hierarchy results of Figures 2D), and these zeros are particularly contributed to by subdividing somatosensory (SS) into many subregions, thus contributing many points at the lower right of the graph.

      Further, it should be noted that Figure 2E is for visual inputs. In the supplementary Figure 2 - supplement 1, the authors do apply sensory inputs to auditory and somatosensory cortex...but then only show the result that the delay period firing rate increases along the cortical hierarchy (as in Figure 2D for the visual input), but strikingly omit the plots of firing rate versus PV cell fraction. This omission suggests that the result is even weaker for inputs to other sensory modalities, and thus difficult to justify as a defining principle.

      We have now made an effort to exhaustively compare the contributions of PV versus hierarchy in defining the firing rate activity patterns in the model - see Essential Revisions response 1 above. Moreover, we included plots of firing rate versus PV cell fraction for other sensory modalities, and the results would still support a common architecture for short-term memory maintenance.

      2) Graph theoretic analyses. The main comparison made is between graph-theoretic quantities when the quantities account for or do not account for, PV cells contributing negative connection strengths. This did not seem particularly novel.

      See Essential Revisions response 2 above

      3) It was not clear to me how much the cell-type specific loop strength results were a result of having inhibitory cell types, versus were a result of the assumption ('counter-stream inhibitory bias') that there is a different ratio of excitation to inhibition in top-down versus bottom-up connections. It seems like the main results were more a function of this assumed asymmetry in top-down vs. bottom-up than it was a function of just using cell-type per se. That is, if one ignored inhibitory neurons but put in the top-down vs. bottom-up asymmetry, would one get the same basic results? And, likewise, if one didn't assume asymmetry in the excitatory vs. inhibitory connectivity in top-down versus bottom-up connections, but kept the Pyramidal and PV cell fraction data, would the basic result go away?

      We have addressed the issue of cell-type specific loop strength in Essential Revisions response 2 above.

      4) In the Discussion, there is a third 'main finding' claimed: "when local recurrent excitation is not sufficient to sustain persistent activity...distributed working memory must emerge from long-range interactions between parcellated areas". Isn't this essentially true by definition?

      We have addressed this important issue in Essential Revisions response 3 above.

      5) I don't know if it's even "CIB" that's important or just "any asymmetry (excitatory or inhibitory) between top-down vs. bottom-up directions along the hierarchy". This is worth clarifying and thinking more about, as assigning this to inhibition may be over-attributing a more basic need for asymmetry to a particular mechanism.

      We found that this asymmetry is indeed crucial, which may be provided by CIB or, in some regimes, it is sufficient that a PV gradient is present - see Essential Revisions response 1 above.

      Other questions:

      1) Is it really true that less than 2% of neurons are PV neurons for some areas? Are there higher fractions of other inhibitory interneuron types for these areas, and does this provide a confound for interpreting model results that don't include these other types?

      Maybe related to the above, the authors write in the Results that local excitation in the model is proportional to PV interneuron density. However, in the methods, it looks like there are two terms: a constant inhibition term and a term proportional to density. Maybe this former term was used to account for other cell types. Also, is local excitation in the model likewise proportional to pyramidal interneuron density (and, if not, why not?)?

      The reviewer is correct in pointing out that the ‘constant inhibition term’, which we interpret as a minimal inhibition, accounts for other cell types. We have added the respective explanation in the Methods section. Future versions of the model may include different interneuron types - see Reviewer 1 Response 1 above.

      2) Non-essential areas. The categorization of areas as 'non-essential' as opposed to, e.g. "inputs" is confusing. It seems like the main point is that, since the delay period activity as a whole is bistable, certain areas' contributions may be small enough that, alone, they can't flip the network between its bistable down and up states. However, this does not mean that such areas (such as the purple 'non-essential' area in Figure 5a) are 'non-essential' in the more common sense of the word. Rather, it seems that the purple area is just a 'weaker input' area, and it's confusing to thus label it as 'non-essential' (especially since I'd guess that, whether or not an area flips on/off the bistability may also depend on the assumed strength of the external input signal, i.e. if one made the labeled 'input area' a bit too weak to alone trigger the bistability, then the purple area might become 'essential' to cross the threshold for triggering a bistable-up state).

      This is an important point, and a similar point was also raised by Reviewer 1. For simplicity, we have restricted the definition of the function of an area (e.g., input, vs core vs non essential) to how a single area contributes to working memory. The existence of ‘subnetworks’ for any of these functions is indeed plausible - and potentially important, but we have left this for future modeling work. (see Essential Revisions response 6 above). The point that distinguishes ‘input’ and ‘non-essential’ areas is simply whether inhibiting said area during the stimulus period affects stimulus-specific persistent activity. Surely some of the areas that we have classified as ‘non-essential’ have important roles, even for the contents of working memory, however they are not essential to produce the activity pattern we observe here.

      3) Relation between 'core areas' and loop strength. The measure underlying 'prediction accuracy = 0.93' in Figure 6D and the associated results seems incomplete by being unidirectional. It captures the direction: 'given high cell-type specific loop strength, then core area' but it does not capture the other direction: 'given a cell is part of a core area, is its predicted cell-type specific loop strength strong?'. It would be good to report statistics for both directions of association between loop strength and core area.

      Indeed the prediction accuracy refers to the direction loop strength->core area, for which we estimate how well a continuous variable (loop strength) predicts a binary variable (whether core area or not). A prediction in the reverse direction is not well defined, namely to predict a continuous variable from a binary variable, so the reverse association may be only indirectly inferred from Figure 8D.

      4) More justification would be useful on the assumption that the reticular nucleus provides tonic inhibition across the entire thalamus.

      Relatively little is known about how specific this inhibition may be. We have included references in the Discussion section that speak to this fact. (Crabtree 2018, Hardinger et al., 2023).

      5) Is NMDA/AMPA ratio constant across areas and is this another difference between mice and monkeys? I am aware of early work in the mouse (Myme et al., J. Neurophys., 2003) suggesting no changes at least in comparing two brain regions' layer 2/3, but has more work been performed related to this?

      Recent anatomical in-vitro autoradiography work in the macaque shows that NMDA/AMPA ratio (in terms of receptor density) varies across the cortical hierarchy (Klatzmann et al., 2022). Functionally NMDA receptors seem important in PFC L2/3 for persistent activity, while in V1, they contribute relatively little to the stimulus response, which is dominated by AMPA-mediated excitation. This was shown by a recent physiological study in the macaque (Yang et al., 2018). This could indeed point to a species difference, although like-for-like comparisons of equivalent experiments across species are lacking in the literature.. We have included this and other related references in our Discussion - see Essential Revision 4 above.

      6) Are bilateral connections between the left and right sides of a given area omitted and could those be important?

      These potentially important connections were omitted for simplicity in the model, please see Reviewer 1 Responses 1, 3 above.

      Reviewer #3 (Public Review):

      Combining dynamical modelling and recent findings of mouse brain anatomy, Ding et al. developed a cell-type-specific connectome-based dynamical model of the mouse brain underlying working memory. The authors find that there is a gradient across the cortex in terms of whether mnemonic information can be sustained persistently or only transiently, and this gradient is negatively correlated to the local density of parvalbumin (PV) positive inhibitory cells but positively correlated with mesoscale-defined cortical hierarchy. In addition, weighing connectivity strength by PV density at target areas provides a more faithful relationship between input strength and delay firing rate. The authors also investigate a model where cortical persistent activity can only be sustained with thalamus input intact, although this result is rather separate from the rest of the study. The authors then use this model to test the causal contributions of different areas to working memory. Although some of the in silico perturbations are consistent with existing experimental data, others are rather surprising and need to be further discussed. Finally, the authors investigate patterns of attractor states as a result of different local and long-range connections and suggest that distinct attractor states could underlie different task demands.

      The importance of PV density as a predictor for working memory activity patterns in the mouse brain is in contrast to recent computational findings in the primate brain where the number of spines (excitatory synapses per pyramidal cell) is the key predictor. This finding reveals important species differences and provides complementary mechanisms that can shape distributed patterns of working memory representation across cortical regions. The method of biologically-based near-whole-brain dynamical modeling of a cognitive function is compelling, and the main conclusions are mostly well supported by evidence. However, some aspects of the method, result, and discussion need to be clarified and extended.

      1) Based on existing anatomical data, the authors reveal a negative correlation between cortical hierarchy (defined by mesoscale connectivity; this concept needs to be explicitly defined in the Results session, not just in the Method section) and local PV density (Fig. 1). In the dynamical model, the authors find that working memory activity is positively (and strongly) correlated with cortical hierarchy and negatively (and less strongly) correlated with PV cell density (Fig. 2), and conclude that working memory activity depends on both. But could the negative correlation between activity and PV density simply result from the inherent relationship between hierarchy and PV density across regions? To strengthen this result, the authors should quantify the predictive power of local PV density on working memory activity beyond the predictive power of cortical hierarchy.

      We have systematically compared the relationship between PV and hierarchy in generating delay-patterns of activity - see Essential Revisions response 1 above.

      2) In Fig. 4, the authors find that cell-type-specific graph measures more accurately predict delay-period firing rates. Specifically, the authors weigh connections with a cell-type-projection coefficient, which is smaller when the PV cell fraction is higher in the target area. Considering that local PV cell fraction is already correlated with delay activity patterns, weighing the input with the same feature will naturally result in a better input-output relationship. This result will be strengthened if there is a more independent measure of cell-type-projection coefficient, such as the spine density of PV vs excitatory cells across regions, or even the percentage of inhibitory versus excitatory cells targeted by upstream region (even just for an example set of brain regions).

      We have compared different measures of cell-type projection coefficients and how they predict delay-patterns of activity and whether an area is a core area - see Essential Revisions response 2 above.

      3) The authors aim to identify a core subnetwork that generates persistent activity across the cortex by characterising delay activity as well as the effects of perturbations during the stimulus and delay period. Consistent with existing data, the model identifies frontal areas and medial orbital areas as core areas. Surprisingly, areas such as the gustatory area are also part of the core areas. These more nuanced predictions from the model should be further discussed. Also surprisingly, the secondary motor cortex (MOs), which has been indicated as a core area for short-term memory and motor planning by many existing studies is classified as a readout area. The authors explain this potential discrepancy as a difference in task demand. The task used in this study is a visual delayed response task, and the task(s) used to support the role of MOs in short-term memory is usually a whisker-based delayed response task or an auditory delay response task. In all these tasks, activity in the delay period is likely a mixture of sensory memory, decision, and motor preparation signals. Therefore, task demand is unlikely the reason for this discrepancy. On the other hand, motor effectors (saccade, lick, reach, orient) could be a potential reason why some areas are recruited as part of the core working-memory network in one task and not in another task. The authors should further discuss both of these points.

      We have addressed this important point in Essential Revisions response 5 above.

      4) As a non-expert in the field, it is rather difficult to grasp the relationship between the results in Fig. 7 and the rest of the paper. Are all the attractor states related to working memory? If so, why are the core regions for different attractor states so different? And are the core regions identified in Fig. 5 based on arbitrary parameters that happen to identify certain areas as core (PL)? The authors should at least further clarify the method used and discuss these results in the context of previous results in this study.

      Attractor states that have a stable baseline are, by definition, related to working memory in that there is a baseline and a memory state associated with the model. Some areas, such as PL are more likely to be associated with different core subnetworks given its position in the hierarchy. In the current version of the manuscript, we provide a motivation for the different attractor states and how they may relate to cognitive function.

    1. Author Response

      Reviewer #1

      While the article clearly outlines the strengths of the chosen approach, it lacks an equally clear exposition of its limitations and a more thorough comparison to established approaches. Two examples of limitations that should be stated more clearly, in my opinion: models need to be small enough to fit on a single machine (in contrast to e.g. NEURON and NEST which support distributed computation via MPI), and only single-compartment models are supported; both limitations are mentioned in passing in the discussion, but would merit a more upfront mention.

      We agree that our paper could be improved by more clearly stating the limitations of our approach and comparing it to established approaches. We have revised the paper and added two new subsections in the Discussion section to address these specific concerns:

      1. The Limitations subsection (L448 - L491) acknowledges restrictions of BrainPy paradigm which uses a Python-based object-oriented programming. It highlights three main categories of limitations: (a) approach limitations, (b) functionality limitations, (c) parallelization limitations. These limitations highlight areas where BrainPy may require further development to improve its functionality, performance, and compatibility with different modeling approaches.

      2. The Future Work subsection (L493 - L526) outlines development enhancements we aim to pursue in the near term. It emphasizes the need for further development in order to meet the demands of the field. Three key areas requiring attention are highlighted: (a) multi-compartment neuron models, (b) ultra-large-scale brain simulations, (c) bridging with acceleration computing systems.

      In addition to these changes, we have also made a number of other minor changes to the paper to improve its clarity and readability.

      The study does not verify the accuracy of the presented framework. While its basic approach (time-step-based simulation, standard numerical integration algorithms) is sufficiently similar to other software to not expect major discrepancies, an explicit comparison would remove any doubt. Quantitative measures of accuracies are particularly important in the context of benchmarks (see below), since simulations can be made arbitrarily fast by sacrificing performance.

      We agree that an explicit comparison would help alleviate any doubts and provide a more comprehensive understanding of our framework's accuracy. We have revised our manuscript to include a dedicated section, particularly Appendix 11. In this section, we verified that all simulators generated consistent average firing rates for the given benchmark network models (figure 1 and figure 2 in Appendix 11). These verifications were performed under different network sizes (ranging from 4e^3 to 4e^5) and different computing platforms (CPU, GPU and TPU). We also qualitatively compared the overall network activity patterns produced by each simulator to ensure they exhibited the same dynamics (figure 3 and figure 4 in Appendix 11). While exact spike-to-spike reproducibility was not guaranteed between different simulator implementations, we confirmed that our simulator produced activity consistent with the reference simulators for both firing rates and network-level dynamics. Additionally, BrainPy did not sacrifice simulation accuracy for speed performance. Despite using single precision floating point, BrainPy was able to produce consistent firing rates and raster diagrams across all simulations (see figure 3 and figure 4 in Appendix 11).

      We hope these revisions can ensure that our manuscript provides a clear and robust validation of the accuracy of our simulator.

      Benchmarking against other software is obviously important, but also full of potential pitfalls. The current article does not state clearly whether the results are strictly comparable. In particular: are the benchmarks on the different simulators calculating results to the same accuracy (use of single or double precision, same integration algorithm, etc.)? Does each simulator use the fastest possible execution mode (e.g. number of threads/processes for NEST, C++ standalone mode in Brian2, etc.)? What is exactly measured (compilation time, network generation time, simulation execution time, ...) - these components will scale differently with network size and simulation duration, so summing them up makes the results difficult to interpret. Details are also missing for the comparison between the XLA operator customization in C++ vs. Python: was the C++ variant written by the authors or by someone else? Does the NUMBA→XLA mechanism also support GPUs/TPUs? This comparison also seems to be missing from the GitHub repository provided for reproducing the paper results.

      We have carefully considered these comments and addressed each of these concerns regarding the benchmarks and examples presented in our paper.

      1. Lack of Details in Examples: In the revised version of the paper, we provide additional information and any other pertinent details to enhance the clarity and replicability of our results. Particularly, in Appendix 9, we provide the mathematical description, the number of neurons, the connection density, and delay times used in our multi-scale spiking network; in Appendix 10, we provide the detail description of reservoir models, evaluation metrics, training algorithms, and their implementations in BrainPy; in Appendix 11, we elaborate the hardware and software specifications and experimental details for benchmark comparisons.

      2. Inadequate Description of Benchmarking Procedures: In the revised paper, particularly, in L328-L329 of the main text at section of "Efficient performance of BrainPy" and in Appendix 11, we elaborate on the integration methods, simulation time steps, and floating-point precision used in our experiments. We also ensure that these parameters are clearly stated and identical across all simulators involved in the benchmarking process, see "Accuracy evaluations" in Appendix 11 (L1550 - L1580).

      3. Clarification on Measured Time: In the revised paper, we state that all simulations only measured the model execution time, excluding model construction time, synapse creation time, and compilation time, see "Performance measurements" in Appendix 11 (L1539 - L1548).

      4. Consideration of Acceleration Modes: In the revised version, we provide the simulation speed of other brain simulators on different acceleration modes, see Figure 8. For instance, we utilize the fastest possible option --- the C++ standalone mode in Brian2 --- for speed evaluations. Furthermore, we have requested the developers of the comparison simulators for optimizing the benchmark models, ensuring a fair and accurate comparison.

      5. Scaling Networks to Maintain Activity: In the revised manuscript, we adopt the suggestion of Reviewer #3 and apply the appropriate scaling techniques to maintain consistent network activity throughout our experiments. These details can be found in Appendix 11 (also see Appendix 11—figure 1 and Appendix 11—figure 2).

      Regarding the comparison between XLA operator customization in C++ and Python, we utilized our self-implemented C++ version, which is accessible in the Appendix 8 Listing 2. Presently, the NUMBA→XLA mechanism does not support GPUs/TPUs; however, we are working on expanding this capability to other platforms. We have made this clarification in the revised manuscript as well (see L1278 - L1285).

      While the authors convincingly argue for the merits of their Python-based/object-oriented approach, in my opinion, they do not fully acknowledge the advantages of domain-specific languages (NMODL, NestML, equation syntax of ANNarchy and Brian2, ...). In particular, such languages aim at a strong decoupling of the mathematical model description from its implementation and other parts of the model. In contrast, models described with BrainPy's approach often need to refer to such details, e.g. be aware of differences between dense and sparse connectivity schemes, online, or batch mode, etc. It might also be worth mentioning descriptive approaches to synaptic connectivity as supported by other simulators (connection syntax in Brian2, Connection Set Algebra for NEST).

      We have made revisions to better acknowledge the merits of DSLs while providing a more comprehensive comparison. These revisions are incorporated in Discussion (L452 - L466) and Appendix 1 (L778 - L788).

      Reviewer #2

      While the results presented are impressive, publishing further details of the benchmarks in an appendix would be helpful for evaluating the claims and the overall conclusion would be more convincing if the performance benefits were demonstrated on a wider selection of test cases. Unsatisfyingly, the authors gave up on making a direct comparison to Brian running on GPUs with GeNN which would have been a fairer comparison than CPU-based simulations. The code for the chosen benchmarks is also likely to be highly optimised by the authors for running on BrainPy but less so for the other platforms - a fairer test would be to invite the authors of the other simulators to optimise the same models and re-evaluate the benchmarks.

      We have carefully considered these comments and addressed each of these concerns regarding the benchmarks and examples presented in our paper.

      1. Lack of Details in Examples: In the revised version of the paper, we provide additional information and any other pertinent details to enhance the clarity and replicability of our results. Particularly, in Appendix 9, we provide the mathematical description, the number of neurons, the connection density, and delay times used in our multi-scale spiking network; in Appendix 10, we provide the detail description of reservoir models, evaluation metrics, training algorithms, and their implementations in BrainPy; in Appendix 11, we elaborate the hardware and software specifications and experimental details for benchmark comparisons.

      2. Inadequate Description of Benchmarking Procedures: In the revised paper, particularly, in L328-L329 of the main text at section of "Efficient performance of BrainPy" and in Appendix 11, we elaborate on the integration methods, simulation time steps, and floating-point precision used in our experiments. We also ensure that these parameters are clearly stated and identical across all simulators involved in the benchmarking process, see "Accuracy evaluations" in Appendix 11 (L1550 - L1580).

      3. Clarification on Measured Time: In the revised paper, we state that all simulations only measured the model execution time, excluding model construction time, synapse creation time, and compilation time, see "Performance measurements" in Appendix 11 (L1539 - L1548).

      4. Consideration of Acceleration Modes: In the revised version, we provide the simulation speed of other brain simulators on different acceleration modes, see Figure 8. For instance, we utilize the fastest possible option --- the C++ standalone mode in Brian2 --- for speed evaluations. Furthermore, we have requested the developers of the comparison simulators for optimizing the benchmark models, ensuring a fair and accurate comparison.

      5. Scaling Networks to Maintain Activity: In the revised manuscript, we adopt the suggestion of Reviewer #3 and apply the appropriate scaling techniques to maintain consistent network activity throughout our experiments. These details can be found in Appendix 11 (also see Appendix 11—figure 1 and Appendix 11—figure 2).

      Regarding the wider selection of test cases, we understand the importance of demonstrating the performance benefits on a broader range of scenarios. Particularly, we have designed two kinds of benchmark models:

      • Sparse connection models. This category models include COBA-LIF network and COBA-HH network. The former is a standard E/I balanced network for comparing simualtion speed of a brain simulator, while the latter uses the complex computational expensive HH neuron model as the elements. Both models can be effectively to demonstrate the capability of a brain simulator for the sparse and event-driven computation.

      • Dense connection models. The local circuits of a cortical column are usually connected densely (Science 366, 1093). Particularly, we use the decision making network proposed by (Wang, 2002) for evaluations.

      In the revised version, we include extensive experiments on these three test cases under different kinds of computing platforms (including CPU, GPU, and TPU) to strengthen the overall conclusion and provide a more comprehensive evaluation of our approach.

      Regarding the comparison to Brian running on GPUs with GeNN, we apologize for not including that in our initial submission. We have conducted the necessary experiments on all three benchmark models we have used in our evaluations and include these results in the revised version of the paper (see Figure 8). This addition will enhance the credibility of our findings and allow for a more meaningful comparison between different simulation platforms. Furthermore, we have also reached out to the authors of other simulators and invite them to optimize the same models used in our benchmarks. We believe this collaborative approach will ensure a more equitable evaluation of the simulators and provide a more robust and convincing analysis of our work.

      Furthermore, the manuscript reads like an advertisement for the platform with very little discussion of its limitations, weaknesses, or directions for further improvement. A more frank and balanced perspective would strengthen the manuscript and give the reader greater confidence in the platform.

      We agree that our paper could be improved by more clearly stating the limitations of our approach and comparing it to established approaches. We have revised the paper and added two new subsections in the Discussion section to address these specific concerns:

      1. The Limitations subsection (L448 - L491) acknowledges restrictions of BrainPy paradigm which uses a Python-based object-oriented programming. It highlights three main categories of limitations: (a) approach limitations, (b) functionality limitations, (c) parallelization limitations. These limitations highlight areas where BrainPy may require further development to improve its functionality, performance, and compatibility with different modeling approaches.

      2. The Future Work subsection (L493 - L526) outlines development enhancements we aim to pursue in the near term. It emphasizes the need for further development in order to meet the demands of the field. Three key areas requiring attention are highlighted: (a) multi-compartment neuron models, (b) ultra-large-scale brain simulations, (c) bridging with acceleration computing systems. In addition to these changes, we have also made a number of other minor changes to the paper to improve its clarity and readability.

      Since simulators wax and wane in popularity, it would be reassuring to see a roadmap for development with a proposed release cadence and a sustainable governance policy for the project. This would serve to both clearly indicate the areas of active development where community contributions would be most valuable and also to reassure potential users that the project is unlikely to be abandoned in the near future, ensuring that their time investment in learning to use the framework will not be wasted.

      We appreciate the reviewer raising the point for demonstrating the project's sustainability. In response to this feedback, we have made the following efforts.

      Firstly, we add and maintain a "Development roadmap" section in the BrainPy GitHub homepage (https://github.com/brainpy/BrainPy). This will enable the community to have a clear understanding of the project's direction and the areas of active development. Additionally, the "Future work" section in our revised paper has also outlined a comprehensive roadmap for next stages of the BrainPy development.

      Secondly, to address the concern about the sustainability of our project and the potential risk of abandonment, we have incorporated a ACKNOWLEDGMENTS.md file in the GitHub (https://github.com/brainpy/BrainPy/blob/master/ACKNOWLEDGMENTS.md) to outline our sustainable funding support. These supports demonstrates our commitment to the long-term maintenance and development of the project, thus may help to dispel doubts of users for the project abandonment.

      Similarly, a complex set of dependencies, which need to be modified for BrainPy, will likely make the project hard to maintain and so a similar plan to those given for the CI pipeline and documentation generation for automation of these modifications would be a good addition. It is also important to periodically reflect on whether it still makes sense to combine all the disparate tools into one framework as the codebase grows and starts to strain under modifications required to maintain its unification.

      We appreciate the reviewer's valuable suggestions on the BrainPy framework.

      First, BrainPy is a self-contained package designed specifically for brain dynamics programming. It boasts minimal dependencies, relying only on fundamental packages within the Python scientific computing ecosystem. In essence, BrainPy relies on numpy for array-based computations and utilizes jax and jaxlib for JIT compilation. While we currently utilize numba to customize dedicated operators, we can also remove this dependency by rewriting these operators with C++ code. We incorporate the use of brainpylib, a package developed by ourselves, which provides dedicated operators for CPUs and GPUs in the context of brain dynamics modeling. Additionally, BrainPy leverages mature solutions within the field for certain auxiliary functions. For instance, we integrate the use of tqdm to facilitate the display of a progress bar during model execution, and employ matplotlib for visualization purposes, capitalizing on its well-established capabilities in the scientific community.

      Second, we agree that there is a risk of overly complex dependencies and architectural strains. To mitigate this risk, we have taken the following changes:

      • We prioritize good software engineering practices like loose coupling, high cohesion and modularity in the framework design. This will isolate dependencies and changes to specific components. For example, brainpy.visualize nodule defines abstract visualization functions in which the visualization backend can be changed anytime.

      • We invest in automating aspects of the build, test, and release process to relieve manual maintenance burdens. We heavily use the GitHub actions for testing BrainPy codes and building documentations.

      • We document dependencies clearly and maintain backwards compatibility when possible. New APIs will be clearly stated supported after which BrainPy version, and deprecated APIs will be deprecated over multiple release cycles.

      • We continuously monitor code complexity metrics and refactor/simplify the architecture when needed.

      • When new tools have significantly different requirements, we will consider spinning them off into separate projects rather than forcing them into the core framework.

      Finally, a live demonstration would be a very useful addition to the project. For example, a Jupyter notebook hosted on mybinder.org or similar, and a fully configured Docker image, would each enable potential users to quickly experiment with BrainPy without having to install a stack of dependencies and troubleshoot version conflicts with their pre-existing setup. This would greatly lower the barrier to adoption and help to convince a larger base of modellers of the potential merits of BrainPy, which could be major, both in terms of the computational speed-up and ease of development for a wide range of modelling paradigms.

      We appreciate the reviewer's valuable feedback and suggestion. We have hosted a Jupyter notebook and a fully configured Docker image on mybinder.org (https://mybinder.org/v2/gh/brainpy/BrainPy-binder/main). Users can easily experiment with BrainPy without the need to install multiple dependencies or troubleshoot version conflicts.

      Reviewer #3

      One potential issue is that the scope of the neuro-simulator is not very clearly explained and the target audience is not well defined: is BrainPy primarily intended for computational neuroscientists or for neuro-AI practitioners? The simulator offers very detailed neural models (HH, fractional order models), classical point-models (LIF, AdEx), rate-coded models (reservoirs), but also deep learning layers (Conv, MaxPool, BatchNorm, LSTM). Is there an advantage to using BrainPy rather than PyTorch for purely deep networks? Is it possible to build hybrid models combining rate-coded reservoirs or convnets with a network of HH neurons? Without such a hybrid approach, it is unclear why the deep learning layers are needed.

      We appreciate the reviewer's concern regarding the scope of BrainPy and the need for clarification regarding the target audience.

      BrainPy is designed to cater to both computational neuroscientists and neuro-AI practitioners by integrating detailed neural models, classical point models, rate-coded models, and deep learning models. The platform aims to provide a general-purpose programming framework for modeling brain dynamics, allowing users to explore the dynamics of brain or brain-inspired models that combines insights from biology and machine learning.

      Particularly, brain dynamics models (provided in brainpy.dyn module) and deep learning models (provided in brainpy.dnn module) are closely integrated with each other in BrainPy. First, to build brain dynamics models, users should use the building blocks in brainpy.dnn module to create synaptic projections.

      Second, to build brain-inspired computing models for machine learning, users could also take advantages of neuronal and synaptic dynamics have been provided in brainpy.dyn module.

      To that end, BrainPy provides building blocks of detailed conductance-based models like Hodgkin-Huxley, as well as common deep learning layers like convolutions.

      Regarding the advantage of using BrainPy over PyTorch for purely deep networks, we acknowledge that existing deep learning libraries like Flax in the JAX ecosystem provide extensive tools and examples for constructing traditional deep neural networks. While BrainPy does implement standard deep learning layers, our primary focus is not to compete directly with those libraries. Instead, we provide these models for the seamless integration of deep learning layers within BrainPy's core modeling abstractions, including variables and dynamical systems. This integration allows researchers to incorporate common deep learning layers into their brain models. Additionally, the inclusion of deep learning layers in BrainPy serves as examples for customization and facilitates the development of tailored layers for neuroscience research. Researchers can modify or extend the implementations to suit their specific needs.

      In summary, BrainPy's scope focuses on the general-purpose brain dynamics programming. The target audience includes computational neuroscientists who want to incorporate insights from machine learning, as well as some ML researchers interested in integrating brain-like components.

      In terms of plasticity, only external training procedures are implemented (backpropagation, FORCE, surrogate gradients). No local plasticity mechanism (Hebbian learning for rate-coded networks, STDP and its variants for spiking networks) seems to be implemented, apart from STP. Is it a planned feature? Appendix 8 refers to bp.synplast.STDP(), but it is not present in the current code (https://github.com/brainpy/BrainPy/tree/master/brainpy/_src/dyn/synplast). Spiking networks without STDP are not going to be very useful to computational neuroscientists, so this suggests that the simulator targets primarily neuro-AI, i.e. AI researchers interested in using spiking models in a machine learning approach.

      We appreciate that the reviewer raising the limitations of BrainPy in terms of local plasticity mechanisms. We are sorry for the delay of implementing STDP models in BrainPy. Currently, we provide very general implementations of STDP. It can be compatible with any synaptic model (such as Exponential, Dual Exponential, AMPA, GABA, and NMDA dynamics), and common connection patterns (such as Dense, and Sparse connection patterns).

      bp.dyn.STDP_Song2001(pre, post, delay, syn, comm, out)

      It can also be easily used with the combination of short-term plasticity models. The modular design of BrainPy's framework also make the plasticity component straightforward to be implemented and integrated into existing models.

      A second weakness of the paper concerns the demos and benchmarks used to demonstrate the versatility and performance of BrainPy, which are not sufficiently described. In Fig. 4, it is for example not explained how the reservoirs are trained (only the readout weights, or also the recurrent ones? Using BPTT only makes sense when the recurrent weights are also trained.), nor how many neurons they have, what the final performance is, etc. The comparison with NEURON, NEST, and Brian2 is hard to trust without detailed explanations. Why are different numbers of neurons used for COBA and COBAHH? How long is the simulation in each setting? Which time is measured: the total time including compilation and network creation, or just the simulation time? Are the same numerical methods used for all simulators? It would also be interesting to discuss why the only result involving TPUs (Fig 8c) shows that it is worse than the V100 GPU. What could be the reason? Are there biologically-realistic networks that would benefit from a TPU? As the support for TPUs is a major selling point of BrainPy, it would be important to investigate its usage further.

      We appreciate the reviewer for raising the important question about the demos and benchmarks used to demonstrate the versatility and performance of BrainPy. To address these concerns, we have added more details in the revised paper, including:

      • In Fig. 4, we explain how the reservoirs are trained in Appendix 10, in which only the readout weights are trained, and they are trained using backpropagation, FORCE learning, and ridge regression algorithms, respectively. We also specify the number of neurons in each reservoir (see L1397), and the final performance of the reservoirs on the task (see Figure 4).

      • To enable readers to better interpret the simulator comparisons in Fig. 8, we have also added more detailed explanations of the comparison with NEURON, NEST, and Brian2 in Appendix 11.

      • In the current revised paper, we provide a comprehensive analysis of BrainPy's compatibility with different hardware platforms, including TPUs, and to identify the specific conditions under which TPUs may offer advantages (see Figure 8 and Appendix 11—figure 7 ). We have also discussed the potential benefits of TPUs for biologically-realistic networks (see L514 - L521). Particularly, for the biological network with arbitrary sparsity, TPUs does not show advantage over GPUs (see Appendix 11—figure 7). TPUs are best at exploiting certain kinds of structured sparsity, for example block sparsity.

    1. Author Response

      Reviewer #1 (Public Review):

      Due complicated and often unpredictable idiosyncratic differences, comparing fMRI topography between subjects typically would require extra expensive scan time and extra laborious analyzing steps to examine with specific functional localizer scan runs that contrast fMRI responses of every subject to different stimulus categories. To overcome this challenge, hyperaligning tools have recently been developed (e.g., Guntupalli et al., 2016; Haxby et al., 2011) based on aligning in a high-dimensional space of voxels of subjects' fMRI responses to watching a given movie. In the present study, Jiahui and colleagues propose a significantly improved version of hyperaligning functional brain topography between individuals. This new version, based on fMRI connectivity, works robustly on datasets when subjects watched different movies and were scanned with different parameters/scanners at different MRI centers.

      Robustness is the major strength of this study. Despite the fact that datasets from different subjects watching different movies at different MRI centers with different scan parameters were used, the results of functional brain topography from between-subject hyperalignment based on fMRI connectivity were comparable to the golden standard of within-subject functional localizations, and significantly better than regular surface anatomical alignments. These results also support the claim that the present approach is a useful improvement from previous hyperalignments based on time-locked fMRI voxel responses, which would require normative samples of subjects watching a same movie.

      We thank the reviewer for the appreciation of our work.

      Given the robustness, this new version of hyperalignment would provide much stronger statistical power for group-level comparisons with less costs of time and efforts to collect and analyze data from large sample size according to the current stringent standard, likely being useful to the whole research community of functional neuroimaging. That said, more discussions of the limit of the present hyperalignment approach would be helpful to potential eLife readers. For example, to what extend the present hyperalignment approach would be applicable to individuals with atypical functional brain topography such as brain lesion patients with e.g., acquired prosopagnosia? Even in typical populations, while bilateral fusiform face areas can be identified in the majority through functional localizer scans, the left fusiform face area sometimes cannot be found. Moreover, many top-down factors are known to modulate functional brain topography. Due to these factors, brain responses and functional connectivity may be different even when a same subject watched a same movie twice (e.g., Cui et al., 2021).

      We thank the reviewer for the suggestion and agree that it would be fascinating if the predictions can be made with high fidelity in neuropsychological populations. Although we are optimistic that our algorithm is able to generalize across diverse populations, to date, no previous literature has provided empirical evidence to illustrate the effectiveness, including optimizations and special applications beyond typical brains. Besides the neuropsychological population, it would also be valuable to study the generalization across a broad age range, for example, from infants to the elderly. The brain changes across age both anatomically and functionally, so it is a challenge to predict functional topographies based on a normative group that only includes young participants. With all these potential applications in mind, future research is needed to illustrate the efficacy, build the pipeline, and construct the representative normative groups to meet the requirements of accurate individualized predictions in diverse populations.

      In typical populations, although participants have great individual variabilities in their functional topographies, for instance, some participants have distinguishable patches of activations in their left ventral temporal cortex while some participants don’t, our algorithms successfully captured these individualized differences in the prediction. The figure below shows, as an example, the face-selective topographies of two individuals that have markedly different face-selective topographies on the left ventral temporal cortex. The left participant has prominent face-selective areas on the left ventral temporal cortex that are in similar sizes as the right side, while the right participant only has a few scattered small face-selective spots on the left side. No matter what their face-selective areas look like, our algorithm accurately recovered the individualized locations, shapes, and sizes, retaining the individual variability in the functional topographies.

      Functional connectivity profiles based on naturalistic stimuli are very stable across the cortex, even when participants watch different movies. In Figure 4-figure supplement 9, the mean correlations of fine-scaled connectome for most searchlights (r = 15mm) when participants watched The Grand Budapest Hotel and the Raiders of the Lost Ark were generally around 0.8. The mean correlations were about 0.9 between the first and second half of the same movie although the stimuli contents were different between the two halves. Thus, the fine-grained functional connectivity profiles remain highly stable and reliable across movie contents, which contributes to the robustness of cross-movie, time, and other parameters (e.g., scanner models, scanning parameter) predictions using our algorithms.

      We added a paragraph in the discuss section to address the concerns (page 18-19):

      “This study successfully illustrated that accurate individualized predictions are both robust and applicable across a variety of conditions, including movie types, languages, scanning parameters, and scanner models. Importantly, the intricate connectivity profiles remain consistent even when participants view entirely different movies, as evidenced by Figure 4-figure supplement 9, reinforcing the prediction's stability in various scenarios. However, all four datasets in this study only included typical participants with anatomically intact brains. An unanswered question is whether individualized topographies of neuropsychological populations with atypical cortical function (e.g., developmental prosopagnosics) or with lesioned brains (e.g., acquired prosopagnosics) could also be accurately predicted using the hyperalignment-based methods. Up to now, as far as we know, no previous literature has investigated this question. Beyond neuropsychological groups, it is also valuable to investigate how well the predictions will be across a wide range of age, from infants to the elderly. Future research is essential to adapt our algorithms to diverse populations.”

      Reviewer #2 (Public Review):

      Guo and her colleagues develop a new approach to map the category-selective functional topographies in individual participants based on their movie-viewing fMRI data and functional localizer data from a normative sample. The connectivity hyperalignment are used to derived the transformation matrices between the participants according to their functional connectomes during movies watching. The transformation matrices are then used to project the localizer data from the normative sample into the new participant and create the idiosyncratic cortical topography for the participant. The authors demonstrate that a target participant's individualized category-selective topography can be accurately estimated using connectivity hyperalignment, regardless of whether different movies are used to calculate the connectome and regardless of other data collection parameters. The new approach allows researchers to estimate a broad range of functional topographies based on naturalistic movies and a normative database, making it possible to integrate datasets from laboratories worldwide to map functional areas for individuals. The topic is of broad interest for neuroimaging community; the rationale of the study is straightforward and the experiments were well designed; the results are comprehensive. I have some concerns that the authors may want to address, particularly on the details of the pipeline used to map individual category-selective functional topographies.

      We thank the reviewer for the encouragement.

      1) How does the length of the scan-length of movie-viewing fMRI affect the accuracy in predicting the idiosyncratic cortical topography? Similarly, how does the number of participants in the normative database affect the prediction of the category-selective topography? This information is important for the researchers who are interested in using the approach in their studies.

      To investigate the influence of movie-viewing data length and the number of participants in the normative database on prediction performance, we systematically varied these parameters. Specifically, we altered the number of runs utilized in the analysis for both the normative and target data and experimented with varying the number of participants in the normative dataset using the Budapest and the Sraiders datasets. We have included a new Figure 4-figure supplement 5 to present a summary of these findings.

      The results reveal that both within-dataset and between-dataset prediction performances are positively correlated with the length of movie-viewing fMRI data used for both the normative and target groups. A similar trend was observed with respect to the number of participants included in the normative dataset. It is important to highlight, though, that, even when analyzing as little as one run of movie-viewing data—roughly 10-15 minutes, our hyperalignment-based prediction performance was significantly higher than that achieved using traditional surface alignment. This held true even when the normative dataset included as few as five participants.

      In summary, our results show that prediction performance generally improves with longer movie-viewing sessions and larger normative datasets. However, it is noteworthy that even with minimal data—10 minutes of movie-viewing and a small number of participants in the normative dataset—our algorithm still outperforms traditional surface alignment methods significantly.

      We also added sentences in the discussion section (page 15):

      “We investigated the influence of naturalistic movie length and the size of the training group on the prediction accuracy of individualized functional topographies. By incrementally increasing both the number of movie runs in the training and target dataset and the participants in the training group in the Budapest and Sraiders dataset, we observed enhanced prediction accuracy (Figure 4-figure supplement 5). Notably, even with just one movie run in the training or target dataset, or with a mere five participants in the training group, our prediction performance (Pearson r) ranged from about 0.6 to 0.7. This accuracy significantly outperformed results obtained using surface-based alignment.”

      2) The data show that category-selective topography can be accurately estimated using connectivity hyperalignment, regardless of whether different movies are used to calculate the connectome and regardless of other data collection parameters. I'm wondering whether the functional connectome from resting state fMRI can do the same job as the movie-watching fMRI. If it is yes, it will expand the approach to broader data.

      We agree with the reviewer that demonstrating the applicability of the resting state data will expand the application scenarios of this approach. Most previous findings on resting state connectivity, including the comparison between the naturalistic and the resting state paradigms, focused on the macro-scale similarities and differences (e.g., Samara et al., 2023). Very few studies have investigated the fine-scaled connectome based on resting state data. The study on connectivity hyperalignment (Guntupalli et al., 2018) demonstrated a shared fine-scale connectivity structure among individuals that co-exists with the common coarse-scale structure and built the algorithm to successfully hyperalign individuals to the shared fine-scaled space. Another study from our lab (Feilong et al., 2021) revealed that the fine-scaled connectivity profiles in both resting and task states are highly predictive of general intelligence, indicating reliable and biologically relevant fine-scaled resting state connectome structures. Thus, it is highly plausible that our approach is able to be generalized to the resting state data, generating significantly better predictions of individualized functional topographies than traditional surface alignment. However, due to the limitations of the current datasets, we do not have resting state data available in the current datasets to perform this analysis. We are in the process of collecting new data to explore this hypothesis in future work.

      We added sentences to the discussion section to discuss this idea (page 18):

      “Studies comparing movie-viewing and resting state functional connectivity have shown that both paradigms yield overlapping macroscale cortical organizations (29), though naturalistic viewing introduces unique modality-specific hierarchical gradients. However, there remains a gap in research comparing the fine-scaled connectomes of naturalistic and resting state paradigms. Guntupalli and colleagues (14) revealed a shared fine-scale structure that coexists with the coarse-scale structure, and connectivity hyperalignment successfully improved intersubject correlations across a wide variety of tasks. Feilong et al. (13) noted that the fine-scaled connectivity profiles in both resting and task states are highly predictive of general intelligence. This suggests a reliable and biologically relevant fine-scale resting state connectivity structure among individuals. Therefore, it is plausible that individualized functional topography could be effectively estimated using resting state functional connectivity, expanding the applicability of our approach. Future studies are needed to explore this direction.”

      3) The authors averaged the hyper-aligned functional localizer data from all of subjects to predict individual category-selective topographies. As there are large spatial variability in the functional areas across subjects, averaging the data from many subjects may blur boundaries of the functional areas. A better solution might be to average those subjects who show highly similar connectome to the target subjects.

      We appreciate the reviewer’s insightful question about optimizing prediction performance by selecting participants most similar in functional connectivity to the target individuals. This is a promising direction and difficult problem as well. Our approach is based on fine-scale connectome to hyperalign participants, thus different groups of participants may be similar to the target participant in different searchlights. In addition, based on results discussed in the response to Q2, the more participants included in the normative dataset, the better the prediction performance. Thus, there is a trade-off between the number of participants included in the normative dataset for the prediction and the overall similarity of those participants to the target participant.

      To quantitatively explore this idea, we used a searchlight in the right ventral temporal cortex, roughly at the location of posterior fusiform face area (pFFA).We sorted participants by their connectome similarity to each target participant and then examined prediction performance based on either the top nine most similar participants or the bottom nine least similar participants. Our results, presented in Figure 4-figure supplement 8, reveal that hyperalignment consistently outperforms surface alignment regardless of the subset of participants used. Notably, using the nine most similar participants did not significantly alter prediction performance (Tukey Test, z = -0.09, p = 0.996), while using the least similar participants did negatively impact it (Tukey Test, z = 2.492, p = 0.034). Interestingly, the stability of hyperalignment-based predictions remained high even when only a subset of participants was used, contrasting with the variability observed in surface-alignment-based predictions.

      Overall, these findings suggest that while selecting functionally similar participants is a promising avenue for future optimization, the process will require nuanced, searchlight-specific criteria. Each searchlight may necessitate its own set of optimal participants to balance between the performance boost from having more participants and the fidelity gained from participant similarity.

      We added the following to the discussion in the manuscript (page 16):

      “In our study, we used fine-scale connectomes, noting that some participants are more similar to the target participant in specific searchlights. It is an interesting question whether predictions could be enhanced by exclusively selecting those more similar participants for the target participant. To explore this option, we examined a searchlight in the right ventral temporal cortex that was roughly at the location of the posterior fusiform area (pFFA) using the top and bottom nine participants similar to each target participant measured by their fine-scale connectome similarities in the budapest dataset. Generally, using all or part of the participants for the prediction generated similar results (Figure 4-figure supplement 8). Compared to using all the participants, using only the top nine participants who are the most similar to the target participants did not significantly improve the prediction (Tukey Test, z = -0.09, p = 0.996), but using only the bottom nine participants generated significantly lower prediction accuracies (Tukey Test, z = 2.492, p = 0.034). This suggests a trade-off between the number of participants included in the prediction and the similarity of the participants. Future studies are needed to explore the optimal threshold for the number of participants included for each searchlight to refine the algorithm.”

      4) It is good to see that predictions made with hyperalignment were close to and sometimes even exceeded the reliability values measured by Cronbach's alpha. But, please clarify how the Cronbach's alpha is calculated.

      Cronbach’s alpha calculates the correlation score between localizer-based maps across the runs, and it reflects the amount of noise in maps based on individual localizer runs. Traditionally, the reliability was estimated based on split-half correlations. For example, Guntupalli et al. (2016) used correlations of category-selectivity maps between odd and even localizer runs as the measure of reliability. The odd/even split measure underestimated reliability and necessitated recalculation of correlations between maps for only half the data to provide valid comparisons. In contrast, Cronbach’s alpha involves all localizer runs and provides a more accurate statistical estimate of the reliability of the topographies estimated with localizer runs.

      Cronbach’s alpha has been used in many previously published works from our lab (e.g., Feilong et al., 2021; Jiahui et al., 2020, 2023). The code for implementing this metric is publicly accessible on the first author’s Github repository (https://github.com/GUOJiahui/face_DCNN/blob/main/code/cronbach_alpha.py).

      We added the detailed explanation above to the Material and Methods section (page 24):

      “Cronbach’s alpha calculates the correlation score between localizer-based maps across the runs, and it reflects the amount of noise in maps based on individual localizer runs. Traditionally, the reliability was estimated based on split-half correlations. The common odd/even split measure underestimated reliability and necessitated recalculation of correlations between maps for only half the data to provide valid comparisons. In contrast, Cronbach’s alpha involves all localizer runs and provides a more accurate statistical estimate of the reliability of the topographies estimated with localizer runs.”

      5) Which algorithm was used to perform surface-based anatomical alignment? Can the state-ofthe-art Multimodal Surface Matching (MSM) algorithm from HCP achieve better performance?

      We preprocessed our datasets using fMRIPrep, which employs algorithms from FreeSurfer’s recon-all for surface-based anatomical alignment. It is worth noting that different alignment methods can yield varying degrees of performance. For instance, a study by Coalson et al. (2018) compared the localization performance of multiple surface-based alignment methods, including Multimodal Surface Matching (MSM) and FreeSurfer. The study found that MSM outperformed FreeSurfer in terms of peak probabilities and spatial clustering, suggesting better overall localization.

      Additionally, Guntupalli et al. (2018) evaluated intersubject correlations (ISC) of functional connectivity from movie-viewing data using both Connectivity Hyperalignment (CHA) and MSM-All with the Human Connectome Project (HCP) dataset. The study showed that although MSM-All yielded marginally better ISC than traditional surface alignment, CHA’s performance was significantly superior.

      In summary, while using a more advanced alignment algorithm like MSM could marginally improve prediction performance, its advantages may not be substantial when compared to our CHA-based predictions. The combination of MSM and CHA represents an intriguing direction for future research, although it falls outside the scope of our current study.

      6) Is it necessary to project to the time course of the functional localizer from the normative sample into the new participants? Does it work if we just project the contrast maps from the normative samples to the new subjects?

      It is an interesting question and a practical alternative to researchers to know whether time series of the localizer runs are required to obtain reasonable predictions, as in some scenarios, contrast maps may be the only accessible data in the analysis. To quantitatively explore this possibility, we applied transformation matrices derived from the movie data to training participants’s individual pre-calculated contrast maps of all four categories, and evaluated the predictions. We found nearly similar prediction performance between the two flavors within and across datasets (Figure 4-figure supplement 7). However, it is worth noting that applying transformation matrices directly to contrast maps did not get as much improvement in the interactive steps as the other flavor in the advanced CHA, perhaps due to the scale changes when multiple iterations were implemented and the difficulty to properly normalize the t-maps compared to the regular time series.

      Overall, although our algorithm is originally designed to be used on the time course of the functional localizer runs, relatively comparable results can be generated even when the contrast maps are directly projected from the normative group to the target participant. However, to derive the best results with our approach, time series are recommended when the situation permits.

      We have also added the contents into the Discussion section (page 16):

      “Our original algorithm is designed to apply transformation matrices to the time series of localizer data of training participants before generating contrast maps. To explore whether directly applying these matrices to pre-calculated contrast maps yields comparable results, we conducted an additional analysis across the four categories. Our findings indicate that the prediction outcomes were indeed quite similar between the two approaches for both the within- and across-datasets predictions (Figure 4-figure supplement 7). However, it is worth noting that the improvements observed with enhanced CHA were not as pronounced when applied directly to the contrast maps as opposed to the time series.”

      7) Saygin and her colleagues have demonstrated that structural connectivity fingerprints can predict cortical selectivity for multiple visual categories across cortex (Osher DE et al, 2016, Cerebral Cortex; Saygin et al, 2011, Nat. Neurosci). I think there's a connection between those studies and the current study. If the author can discuss the connection between them, it may help us understand why CHA work so well.

      We thank the reviewer for raising this point that provides us with the chance of clarifying how our approach differs with methods previously reported in the literature. The computational logic underlying our approach is that we derived the transformation matrices between the training and the target participants in the high-dimensional space based on functional connectivity calculated from the movie data. Then, we applied these transformation matrices to the training participant’s localizer data to accomplish the prediction. On the other hand, Saygin and colleagues directly used diffusion-weighted imaging (DWI) data and predicted participants’ functional responses based on the anatomical-functional correspondence. They evaluated the prediction by calculating the mean absolute errors (AE) of the difference between the actual and predicted contrast responses. Although AE linearly increases with the quality of the prediction, it is difficult to measure the prediction performance of the shape, size, and location of the functional areas precisely using this mean value. With our algorithm, we were able to predict the general location and size of the areas and recover the individualized shapes, generating more powerful predictions. We also used the searchlight analysis to evaluate the performance across the cortex systematically. In addition, Osher et al. (2016) and Saygin et al. (2012) always have a few participants failing to show better predictions based on the connectivity than the group averaged method. Our algorithm is more stable, as all participants across all four datasets had better predicted performance using our algorithm than using the group average. However, although we did not directly use the anatomical-functional correspondence with DWI, the relationships between individual structural connectivity and cortical visual category selectivity could be one of the biological underpinnings that contribute to this robust and accurate prediction.

      The Connectivity-Based Shared Response Model (cSRM, Nastase et al., 2020) offers an alternative framework for aligning individuals through functional connectivity. While the overarching aim of cSRM and our methodology converges, substantial differences emerge in the respective implementation and application between the two methods that make our approach the more suitable for predicting individualized topographies. The most significant difference between the two is that, instead of focusing on within-individual connectivity profiles, cSRM used inter-subject functional connectivity (ISFC) in the initial step. This design requires that all participants must have time-locked time series, making the algorithm unusable for cross-content prediction and making it incompatible with resting-state data. Our approach, on the other hand, does not require time-locked stimuli, thereby offering a more flexible framework that permits generalization across different types of stimuli and experimental settings and enables bringing data across laboratories across the world together. Secondly, cSRM predominantly focuses on Region of Interest (ROI) analyses, whereas our model employs searchlight-based analyses designed to comprehensively cover the entire cortical sheet. Whole-brain coverage is needed to generate the topography that reflects the patterns across the cortex. Finally, with the optimized 1step method, our approach directly hyeraligns the training and target participants together, avoiding the accumulation of errors from the intermediate common space. cSRM, with an implementation similar to the classic connectivity hyperalignment, creates and hyperaligns all participants to a shared information space. In summary, while our approach and cSRM share a similar theoretical foundation, our approach has been specifically optimized to address the challenges and complexities in predicting individualized whole-brain functional topographies. Moreover, our approach demonstrates a remarkable ability to generalize across a variety of contexts and stimuli, offering a significant advantage in dealing with diverse experimental settings and datasets.

      We have added the contents to the discussion section (page 16-17):

      “By leveraging transformation matrices obtained from hyperaligning participants based on movie-viewing data, we successfully mapped these relationships to the training participants’ localizer data, enabling robust predictions. Prior work employing diffusion-weighted imaging (DWI) has underscored the link between anatomical connectivity and category selectivity across diverse visual fields (22, 23) and has established a notable congruence between structural and functional connectivities (24). These findings suggest that the unique anatomical connectivity patterns of individuals may serve as a foundational mechanism, contributing to the stable finescale functional connectome that underpins our approach. The connectivity-based Shared Response Model (cSRM) proposed by Nastase and colleagues (25) used connectivity to functionally align individuals similar to the connectivity hyperalignment algorithm. While both approaches share overarching goals, they diverge considerably in implementation and application. First and most important, cSRM used inter-subject functional connectivity (ISFC) rather than within-subject functional connectivity to initially estimate the connectome. As a result, cSRM requires participants to have time-locked fMRI time series. Therefore, unlike our algorithm, the cSRM approach does not support cross-content applications and also is not suitable for use with resting-state data. Second, cSRM is implemented based on a predefined cortical parcellation rather than the overlapping, regularly-spaced cortical searchlights applied in our method which are not constrained by areal borders. For the application, cSRM has mainly been used to do ROI analysis rather than the estimation of the whole-brain topography that requires broader coverage of the cortex with a searchlight analysis. Third, our method is specifically designed to work in each individual’s space, while cSRM decomposes data across subjects into shared and subjectspecific transformations, focusing on a communal connectivity space. In summary, although cSRM presents a promising alternative for similar aims, its current implementation precludes it from fulfilling the range of applications for which our method is optimized.”

      Reviewer #3 (Public Review):

      In this paper, Jiahui and colleagues propose a new method for learning individual-specific functional resonance imaging (fMRI) patterns from naturalistic stimuli, extending existing hyperalignment methods. They evaluate this method - enhanced connectivity hyperalignment (CHA) - across four datasets, each comprising between nine (Raiders) and twenty (Budapest, Sraiders) participants.

      The work promises to address a significant need in existing functional alignment methods: while hyperalignment and related methods have been increasingly used in the field to compare participants scanned with overlapping stimuli (or lack thereof, in the case of resting state data), their use remains largely tied to naturalistic stimuli. In this case, having non-overlapping stimuli is a significant constraint on application, as many researchers may have access to only partially overlapping stimuli or wish to compare stimuli acquired under different protocols and at different sites.

      It is surprising, however, that the authors do not cite a paper that has already successfully demonstrated a functional alignment method that can address exactly this need: a connectivitybased Shared Response Model (cSRM; Nastase et al., 2020, NeuroImage). It would be relevant for the authors to consider the cSRM method in relation to their enhanced CHA method in detail. In particular, both the relative predictive performance as well as associated computational costs would be useful for researchers to understand in considering enhanced CHA for their applications.

      We thank the reviewer for raising this point that provides us with the chance of clarifying how our approach differs with methods previously reported in the literature. The computational logic underlying our approach is that we derived the transformation matrices between the training and the target participants in the high-dimensional space based on functional connectivity calculated from the movie data. Then, we applied these transformation matrices to the training participant’s localizer data to accomplish the prediction. On the other hand, Saygin and colleagues directly used diffusion-weighted imaging (DWI) data and predicted participants’ functional responses based on the anatomical-functional correspondence. They evaluated the prediction by calculating the mean absolute errors (AE) of the difference between the actual and predicted contrast responses. Although AE linearly increases with the quality of the prediction, it is difficult to measure the prediction performance of the shape, size, and location of the functional areas precisely using this mean value. With our algorithm, we were able to predict the general location and size of the areas and recover the individualized shapes, generating more powerful predictions. We also used the searchlight analysis to evaluate the performance across the cortex systematically. In addition, Osher et al. (2016) and Saygin et al. (2012) always have a few participants failing to show better predictions based on the connectivity than the group averaged method. Our algorithm is more stable, as all participants across all four datasets had better predicted performance using our algorithm than using the group average. However, although we did not directly use the anatomical-functional correspondence with DWI, the relationships between individual structural connectivity and cortical visual category selectivity could be one of the biological underpinnings that contribute to this robust and accurate prediction.

      The Connectivity-Based Shared Response Model (cSRM, Nastase et al., 2020) offers an alternative framework for aligning individuals through functional connectivity. While the overarching aim of cSRM and our methodology converges, substantial differences emerge in the respective implementation and application between the two methods that make our approach the more suitable for predicting individualized topographies. The most significant difference between the two is that, instead of focusing on within-individual connectivity profiles, cSRM used inter-subject functional connectivity (ISFC) in the initial step. This design requires that all participants must have time-locked time series, making the algorithm unusable for cross-content prediction and making it incompatible with resting-state data. Our approach, on the other hand, does not require time-locked stimuli, thereby offering a more flexible framework that permits generalization across different types of stimuli and experimental settings and enables bringing data across laboratories across the world together. Secondly, cSRM predominantly focuses on Region of Interest (ROI) analyses, whereas our model employs searchlight-based analyses designed to comprehensively cover the entire cortical sheet. Whole-brain coverage is needed to generate the topography that reflects the patterns across the cortex. Finally, with the optimized 1step method, our approach directly hyeraligns the training and target participants together, avoiding the accumulation of errors from the intermediate common space. cSRM, with an implementation similar to the classic connectivity hyperalignment, creates and hyperaligns all participants to a shared information space. In summary, while our approach and cSRM share a similar theoretical foundation, our approach has been specifically optimized to address the challenges and complexities in predicting individualized whole-brain functional topographies. Moreover, our approach demonstrates a remarkable ability to generalize across a variety of contexts and stimuli, offering a significant advantage in dealing with diverse experimental settings and datasets.

      We have added the contents to the discussion section (page 16-17):

      “By leveraging transformation matrices obtained from hyperaligning participants based on movie-viewing data, we successfully mapped these relationships to the training participants’ localizer data, enabling robust predictions. Prior work employing diffusion-weighted imaging (DWI) has underscored the link between anatomical connectivity and category selectivity across diverse visual fields (22, 23) and has established a notable congruence between structural and functional connectivities (24). These findings suggest that the unique anatomical connectivity patterns of individuals may serve as a foundational mechanism, contributing to the stable finescale functional connectome that underpins our approach. The connectivity-based Shared Response Model (cSRM) proposed by Nastase and colleagues (25) used connectivity to functionally align individuals similar to the connectivity hyperalignment algorithm. While both approaches share overarching goals, they diverge considerably in implementation and application. First and most important, cSRM used inter-subject functional connectivity (ISFC) rather than within-subject functional connectivity to initially estimate the connectome. As a result, cSRM requires participants to have time-locked fMRI time series. Therefore, unlike our algorithm, the cSRM approach does not support cross-content applications and also is not suitable for use with resting-state data. Second, cSRM is implemented based on a predefined cortical parcellation rather than the overlapping, regularly-spaced cortical searchlights applied in our method which are not constrained by areal borders. For the application, cSRM has mainly been used to do ROI analysis rather than the estimation of the whole-brain topography that requires broader coverage of the cortex with a searchlight analysis. Third, our method is specifically designed to work in each individual’s space, while cSRM decomposes data across subjects into shared and subjectspecific transformations, focusing on a communal connectivity space. In summary, although cSRM presents a promising alternative for similar aims, its current implementation precludes it from fulfilling the range of applications for which our method is optimized.”

      With this in mind, I noted several current weaknesses in the paper:

      First, while the enhanced CHA method is a promising update on existing CHA techniques, it is unclear why this particular six step, iterative approach was adopted. That is: why was six steps chosen over any other number? At present, it is not clear if there is an explicit loss function that the authors are minimizing over their iterations. The relative computational cost of six iterations is also likely significant, particularly compared to previous hyperalignment algorithms. A more detailed theoretical understanding of why six iterations are necessary-or if other researchers could adopt a variable number according to the characteristics of their data-would significantly improve the transferability of this method.

      In the advanced connectivity hyperalignment implementation, we gradually increased the number of targets. The six steps were not intentionally chosen but were the result of the increase to the maximum number of fine-grained targets, namely single cortical vertices.

      Our datasets were resampled to the cortical mesh with 18,742 vertices across both hemispheres (approximately 3 mm vertex spacing; icoorder 5; 20,484 vertices before removing non-cortical vertices). Step 1 was the classic standard connectivity hyperalignment implementation based on the anatomically-aligned data. Since using dense connectivity targets (e.g., using all 18742 vertices on the surface) with anatomically-aligned data generates poor functional correspondence across participants (Busch et al., 2021), we used 1,284 vertices (icoorder 3, before removing the medial wall) as connectivity targets in step 1. However, it is beneficial to include more targets for calculating connectivity patterns after the first iteration of connectivity hyperalignment and repeated iterations to lead to a better solution by gradually aligning the information at finer scales. To better align across participants, we iterated the alignment for another two times (step 2 and step 3) with the same number of 1,284 coarse connectivity targets to ensure improved alignment before increasing the number of targets in the later steps. In step 4, we increased the number of targets to 5,124 (icoorder 4, before removing the medial wall), and iterated with this number of vertices for two times in total (step 4 & step 5) before using all vertices as targets. In the final step (step 6), all vertices were used as connectivity targets.

      It is true that the multiple iteration steps largely increased the computational complexity compared to the classic connectivity hyperalignment, but the prediction increase was steady across all datasets and became comparable to response hyperalignment performance which requires time-locked stimuli. We did not use an explicit loss function in the algorithm, but followed the natural progression of the number of potential connectivity targets in the implementation. On the other hand, the difference between the performance of the improved and the classic connectivity hyperalignment was relatively small (difference of r < 0.05), which indicates the effectiveness of our classic algorithm. It is up to the researchers’ own options to adopt the number of iterations and the pace of increasing the number of targets in each step. If computational resources are limited or if a shorter total computational time is the primary priority, using the classic connectivity hyperalignment may be the best option to balance the trade-offs.

      The Materials and Methods section had the details of the implementation (page 22-23):

      “Using dense connectivity targets (e.g., using all 18742 vertices on the surface) with anatomically-aligned data usually generates poor functional correspondence across participants (33). It is, however, beneficial to include more targets for calculating connectivity patterns after the first iteration of connectivity hyperalignment and repeated iterations to lead to a better solution by gradually aligning the information at finer scales.

      We used six steps to further improve the connectivity hyperalignment method. Step 1 was the initial connectivity hyperalignment step as described above that was based on the raw anatomically aligned movie data. The resultant transformation matrices were applied to those movie runs, and the hyperaligned data were then used in step 2 to calculate new connectivity patterns and calculate new transformation matrices. We repeated this procedure iteratively six times and derived transformation matrices for each step. In steps 1, 2, and 3, 642 × 2 (icoorder3, before removing the medial wall) connectivity targets were defined with 13 mm searchlights. In step 4 and 5, 2562 × 2 (icoorder 4, before removing the medial wall) connectivity targets were used with 7 mm searchlights to calculate target mean time series. In the final step 6, all 18742 vertices were included as separate connectivity targets, using each vertex’s time series rather than calculating the mean in a searchlight. Each step of this advanced connectivity hyperalignment algorithm increased the prediction performance (Figure 4-figure supplement 2).”

      But to help the readers understand the logic of the advanced connectivity hyperalignment algorithm used in this study, we expanded the discussion section (page 15):

      “Because using dense connectivity targets (e.g., using all vertices as connectivity targets) with anatomically-alignment data often leads to suboptimal alignment across participants (33), we started with coarse connectivity targets and gradually increased the number of connectivity targets to form a denser representation of connectivity profiles. The iterations improved the prediction performance step by step, and at the final step (step 6, all vertices were used as connectivity targets) in this analysis, the enhanced CHA generated comparable performance with RHA (Figure 4-figure supplement 4).”

      Second, the existing evaluations for enhanced CHA appear to be entirely based on imagederived correlations. That is, the authors compare the predicted image from CHA with the ground-truth image using correlation. While this provides promising initial evidence, correlation-based measures are often difficult to interpret given their sensitivity to image characteristics such as smoothness. Including Cronbach's alpha reliability as a baseline does not address this concern, as it is similarly an image-based statistic. It would be useful to see additional predictive experiments using frameworks such as time-segment classification, intersubject decoding, or encoding models.

      We appreciate the reviewer’s concern regarding the stability of local correlations in relation to image characteristics. To address this, we conducted additional analysis using different searchlight sizes (with radii of 10 mm, 15 mm, and 20 mm) to evaluate the predicted categoryselective maps, focusing specifically on the Budapest dataset. The local correlations between the predicted category-selective maps (obtained using enhanced CHA) and participants’ own maps based on classic localizer runs were calculated for each searchlight. We averaged these correlations across participants and plotted the resulting maps, as shown in Figure 4-figure supplement 10. Although using a larger searchlight radius is similar to employing a larger smoothing kernel, the results remained relatively stable across different searchlight sizes, particularly in regions selectively responsive to the specific category. This stability suggests that while the evaluation may be influenced by image-related features, the conclusion would remain consistent under varying parameters.

      As for the use of enhanced CHA, it serves as an optimized version of the classic CHA, specifically designed for predicting individualized functional topographies. Evaluating prediction performance in our study is based on t-value contrast maps for each participant. Given this, it's unclear how time-segment classification or other decoding/encoding models could be appropriately implemented for performance evaluation. However, prior research from our lab has already established the effectiveness of classic CHA. Specifically, Guntupalli et al. (2018) showed that classic CHA significantly improved intersubject correlations (ISC) of connectivity profiles across the cortex. They also revealed that CHA captured fine-scale variations in connectivity profiles for nearby cortical nodes across participants and led to improved betweensubject multivariate pattern classification accuracies (bsMVPC) of movie segments. These findings serve as robust evidence for the effectiveness of classic CHA, laying the groundwork for our enhanced CHA approach.

      We added Figure 4-figure supplement 10 to the supplementary material:

      Addressing these concerns and considering cSRM as a comparison model would significantly strengthen the paper. There are also notable strengths that I would encourage the authors to further pursue. In particular, the authors have access to a unique dataset in which the same Raiders of the Lost Ark stimulus was scanned for participants within the Budapest (SRaiders) dataset as well as non-overlapping participants in the Raiders dataset. Exploring the relative performance for cross-movie prediction within a dataset as compared to a shared movie prediction across datasets is particularly interesting for methods development. I would encourage the authors to explicitly report results in this framework to highlight both this unique testing structure as well as the performance of their enhanced CHA method.

      We appreciate the reviewer's suggestion to examine a shared time-series but non-overlapping participants scenario using the Sraiders and Raiders datasets. However, there are significant differences between the two datasets that preclude such direct comparison. These differences include varying scanning parameters, MRI scanners, localizer types, and data collection procedures. Due to these methodological divergences, the datasets cannot be treated as identical time-series.

      Firstly, the scanning parameters vary considerably. Sraiders were scanned with TR = 1 s (TR/TE = 1000/33 ms, flip angle = 59 °, resolution = 2.5 mm3 isotropic voxels, matrix size = 96 × 96, FoV = 240 × 240 mm, multiband acceleration factor = 4, and no in-plane acceleration), and Raiders were scanned with TR = 2.5 s (TR = 2.5 s, TE = 35 ms, Flip angle = 90°, 80 × 80 matrix, FOV = 240 mm × 240 mm, resolution = 0.938 mm × 0.938 mm × 1.0 mm).

      Secondly, participants in the Sraiders were scanned with a 3 T S Magnetom Prisma MRI scanner with a 32 channel head coil and the Raiders dataset, collected more than 10 years ago, used a 3T Philips Intera Achieva scanner with an eight-channel head coil.

      Thirdly, the stimuli presentations were different. In the Sraiders dataset, the movie Raiders of the Lost Ark was split into eight parts (~15 min each), and the first four parts were watched outside of the scanner prior to the scanning (~56 min). The later four parts were watched in the scanner (57 min) with audio. And in the Raiders dataset, the audio-visual movie was split into eight parts (~15 min each). Participants watched all eight parts in the scanner with audio (one part / per run).

      Fourthly and critically, the two datasets included two types of localizers. The Sraiders dataset included dynamic localizer runs, and the Raiders dataset only contained a static localizer that was similarly designed as in the Forrest dataset.

      With all four points, it is not suitable to treat the two datasets as identical time-series. The difference in the localizer type is a further issue. The topographies generated from the two types of localizers are dissimilar in many ways. For all categories, the dynamic localizer elicited stronger and broader category-selective activations than the static localizer, and the searchlight analysis showed that the dynamic localizer had higher reliabilities across the cortex, especially in regions that were selectively responsive to the target category. Due to these differences, crossdataset predictions yielded lower correlations than within-dataset predictions. This is not indicative of methodological failure but reflects diverging topographies activated by different localizers.

      In the manuscript, we have extensively analyzed cross-dataset predictions (Figure 2-figure supplement 1-Figure 4-figure supplement 4 & 6).

      ● Figure 2-figure supplement 1 demonstrates that, despite the limitations of cross-localizertype evaluation, both R-to-S (Raiders to Sraiders) and S-to-R (Sraiders to Raiders) predictions significantly outperformed surface alignment methods across categories.

      ● Figure Figure 2-figure supplement 2 confirms that the prediction performance remained stable across individual participants, underscoring the robustness of our methodology.

      ● Figure 3-figure supplement 1 & Figure 3-figure supplement 2 display contrast maps generated from both native and alternate localizers, revealing that the maps share similar topographies irrespective of the dataset origin.

      ● Figure 4-figure supplement 1 presents a correlation analysis of local similarities in R-to-S and S-to-R predictions, highlighting particularly strong correlations in the ventral face regions.

      ● Figure 4-figure supplement 2 employs histograms to showcase performance across major cortices and furnishes additional evidence regarding the influence of localizer types on the results.

      ● Figure 4-figure supplement 3 offers a searchlight analysis for other categories, enriching the scope of our investigation.

      ● Figure 4-figure supplement 4 affirms that the advanced CHA is effective in both R-to-S and S-to-R predictions.

      ● Figure 4-figure supplement 6 compares the efficacy of 1-step vs. 2-step prediction methods for R-to-S and S-to-R, showing a clear advantage for the 1-step approach.

      These analyses affirmed that our approach outperforms surface alignment methods. But the inherent limitations in data collection and localizer types preclude a direct exploration of the reviewer’s hypothesis. These complexities necessitate further research to fully validate the proposed scenario.

      Overall, I share the authors' enthusiasm for the potential of cross-movie, cross-dataset prediction, and I believe that methods such as enhanced CHA are likely to significantly improve our ability to make these comparisons in the near future. At present, however, I find that the theoretical and experimental support for enhanced CHA is incomplete. It is therefore difficult to assess how enhanced CHA meets its goals or how successfully other researchers would be able to adopt this method in their own experiments.

      We hope our new analysis and replies addressed the reviewer’s concerns.

    1. Author Response

      Reviewer #1 (Public Review):

      In this study, the authors describe an elegant genetic screen for mutants that suppress defects of MCT1 deletions which are deficient in mitochondrial fatty acid synthesis. This screen identified many genes, including that for Sit4. In addition, genes for retrograde signaling factors (Rtg1, Rtg2 and Rtg3), proteins influencing proteasomal degradation (Rpn4, Ubc4) or ribosomal proteins (Rps17A, Rps29A) were found. From this mix of components, the authors selected Sit4 for further analysis. In the first part of the study, they analyzed the effect of Sit4 in context of MCT1 mutant suppression. This more specific part is very detailed and thorough, the experiments are well controlled and convincing. The second, more general part of the study focused on the effect of Sit4 on the level of the mitochondrial membrane potential. This part is of high general interest, but less well developed. Nevertheless, this study is very interesting as it shows for the first time that phosphate export from mitochondrial is of general relevance for the membrane potential even in wild type cells (as long as they live from fermentation), that the Sit4 phosphatase is critical for this process and that the modulation of Sit4 activity influences processes relying on the membrane potential, such as the import of proteins into mitochondria. However, some aspects should be further clarified.

      1) It is not clear whether Sit4 is only relevant under fermentative conditions. Does Sit4 also influence the membrane potential in respiring cells? Fig. S2D shows the membrane potential in glucose and raffinose. Both carbon sources lead to fermentative growths. The authors should also test whether Sit4 levels influence the membrane potential when cells are grown under respirative conditions, such in ethanol, lactate or glycerol. Even if deletions of Sit4 affect respiration, mutants with altered activity can be easily analyzed.

      sit4Δ cells fail to grow on nonfermentable media as shown by us (Figure 2—figure supplement 1C) and others (Arndt et al., 1989; Dimmer et al., 2002; Jablonka et al., 2006). In our opinion, the exact reason is unclear, but there is an interesting observation that addition of aspartate can partially restore growth on ethanol (Jablonka et al., 2006). Despite the lack of thorough investigation on this sit4Δ defect, an early study speculated that this defect could be related to the cAMP-PKA pathway (Sutton et al., 1991). This study pointed out genetic interactions of SIT4 with multiple genes in cAMP-PKA (Sutton et al., 1991). In addition, sit4Δ cells have similar phenotypes as those cAMP-PKA null mutants, such as glycogen accumulation, caffeine resistant, and failure to grow on nonfermentable media (Sutton et al., 1991). We have not found sit4Δ mutants that could grow on nonfermentable media based on literature search.

      2) The authors should give a name to the pathway shown in Fig. 4D. This would make it easier to follow the text in the results and the discussion. This pathway was proposed and characterized in the 90s by George Clark-Walker and others, but never carefully studied on a mechanistic level. Even if the flux through this pathway cannot be measured in this study, the regulatory role of Sit4 for this process is the most important aspect of this manuscript.

      We now refer this mechanism as the mitochondrial ATP hydrolysis pathway.

      3) To further support their hypothesis, the authors should show that deletion of Pic1 or Atp1 wipes out the effect of a Sit4 deletion. In these petite-negative mutants, the phosphate export cycle cannot be carried out and thus, Sit4, should have no effect.

      The mitochondrial phosphate transport activity is electroneutral as it also pumps a proton together with inorganic phosphate. The F1 subunit of the ATP synthase (Atp1 and Atp2) is suggested among many literatures to be responsible for the ATP hydrolysis. We performed tetrad dissection to generate atp1Δ or atp2Δ in pho85Δ background. After streaking the single colony to a fresh plate, we noticed that atp1Δ mct1Δ and atp2Δ mct1Δ cells are lethal, and knocking out PHO85 rescued this synthetic lethality. It is not surprising that atp1Δ mct1Δ or atp2Δ mct1 Δ cells are lethal since the F1 subunit is important to generate a minimum of MMP in mct1 Δ cells when the ETC is absent (i.e., rho0 cells). However, knocking out PHO85 can generate MMP independent of F1 subunit of ATP synthase, which is suggested by the viable atp1Δ mct1Δ pho85Δ and atp2Δ mct1Δ pho85Δ cells. There are many ATPases in the mitochondrial matrix that could hydrolyze ATP for ADP/ATP carrier to generate MMP theoretically. However, we do not currently know exactly which ATPase(s) is activated by phosphate starvation. This data is now included as Figure 5—figure supplement 1F-G.

      4) What is the relevance of Sit4 for the Hap complex which regulates OXPHOS gene expression in yeast? The supplemental table suggests that Hap4 is strongly influenced by Sit4. Is this downstream of the proposed role in phosphate metabolism or a parallel Sit4 activity? This is a crucial point that should be addressed experimentally.

      To investigate the role of the Hap complex in MMP generation in sit4Δ cells, we overexpressed and knocked out HAP4, the catalytic subunit of the Hap complex, separately in wild-type and sit4Δ cells. We confirmed the HAP4 overexpression by the enriched abundance of ETC complexes as shown in the BN-PAGE (Figure 2—figure supplement 1E). However, we did not observe any rescue of ETC or ATP synthase in mct1Δ cells when HAP4 was overexpressed. The enriched level of ETC complexes by HAP4 overexpress is not sufficient to rescue the MMP (Figure 2—figure supplement 1F).

      Next, we knocked out HAP4 in sit4Δ cells. Knocking out SIT4 could still increase MMP in hap4Δ cells with a much-reduced magnitude, which phenocopied ETC subunit and RPO41 deletion in sit4Δ cells (Figure 2—figure supplement 1G).

      In conclusion, the Hap complex is involved in the MMP increase when SIT4 is absent. However, it is not sufficient to increase MMP by overexpressing HAP4. The Hap complex discussion is now included in the manuscript, and the data is presented as Figure 2—figure supplement 1E-G.

      5) The authors use the accumulation of Ilv2 precursors as proxy for mitochondrial protein import efficiency. Ilv2 was reported before as a protein which, if import into mitochondria is slow, is deviated into the nucleus in order to be degraded (Shakya,..., Hughes. 2021, Elife). Is it possible that the accumulation of the precursor is the result of a reduced degradation of pre-Ilv2 in the nucleus rather than an impaired mitochondrial import? Since a number of components of the ubiquitin-proteasome system were identified with Sit4 in the same screen, a role of Sit4 in proteasomal degradation seems possible. This should be tested.

      We thank the reviewer for pointing out this potential caveat with our Ilv2-FLAG reporter. With limited search and tests, we could not find another reporter that behaves like Ilv2FLAG. The reason Ilv2-FLAG is a perfect reporter for this study is because in wild-type cells, Ilv2-FLAG is not 100% imported. Therefore, we could demonstrate that mitochondria with higher MMP import more efficiently. Unfortunately, all of the mitochondrial proteins that we tested could efficiently import in wild-type cells. To identify other suitable mitochondrial proteins that behave like Ilv2-FLAG, we would need to conduct a more comprehensive screen.

      To address the concern of the involvement of protein degradation in obscuring the interpretation of Ilv2-FLAG import, we performed two experiments. First, we measured the proteasomal activity in wild-type and our mutants using a commercial kit (Cayman). We did not observe a statistically significant difference in 20S proteasomal activity between wild-type and sit4Δ cells.

      In the second experiment, we reduced the MMP of sit4 cells using CCCP treatment and measured the Ilv2-FLAG import. We first treated sit4Δ cells with different dosage of CCCP for six hours and measured their MMP. sit4Δ cells treated with 75 µM CCCP had comparable MMP to wild-type cells. When we treated sit4Δ cells with higher concentrations of CCCP, most of the cells did not survive after six hours. Next, we performed the Ilv2-FLAG import assay. We observed similar level of unimported Ilv2FLAG (marked with *) in sit4Δ cells treated with 75 µM CCCP. This result confirms that sit4Δ cells have similar Ilv2-FLAG turnover mechanism and activity as the wild-type cells, because when we lower the MMP in sit4Δ background we observe a similar level of unimported Ilv2-FLAG. We thus feel confident in concluding that the Ilv2-FLAG import results are indeed an accurate proxy for MMP level. These data are now included as Figure 1—figure supplement 1H-J in the manuscript.

      Author response image 1.

      Reviewer #2 (Public Review):

      This study reports interesting findings on the influence of a conserved phosphatase on mitochondrial biogenesis and function. In the absence of it, many nucleus-encoded mitochondrial proteins among which those involved in ATP generation are expressed much better than in normal cells. In addition to a better understanding of th mechanisms that regulate mitochondrial function, this work may help developing therapeutic strategies to diseases caused by mitochondrial dysfunction. However there are a number of issues that need clarification.

      1) The rationale of the screening assay to identify genes required for the gene expression modifications observed in mct1 mutant is not clear. Indeed, after crossing with the gene deletion libray, the cells become heterozygote for the mct1 deletion and should no longer be deficient in mtFAS. Thank you for clarifying this and if needed adjust the figure S1D to indicate that the mated cells are heterozygous for the mct1 and xxx mutations.

      We updated the methods section and the graphic for the genetic screen to clarify these points within the SGA workflow overview. After we created the heterozygote by mating mct1Δ cells with the individual KO cells in the collection, these diploids underwent sporulation and selection for the desired double KO haploid. As a result, the luciferase assay was performed in haploid cells with MCT1 and one additional non-essential gene deleted.

      2) The tests shown in Fig. S1E should be repeated on individual subclones (at least 100) obtained after plating for single colonies a glucose culture of mct1 mutant, to determine the proportion of cells with functional (rho+) mtDNA in the mct1 glucose and raffinose cultures. With for instance a 50% proportion of rho- cells, this could substantially influence the results of the analyses made with these cells (including those aiming to evaluate the MMP).

      We agree that this would provide a more confident estimate for population-level characterization of these colonies. It is important to note that we randomly chose 10 individual subclones, and 100% of these colonies were verified to be rho+. This suggests the population has functional mtDNA, and thus felt confident in the identity of our populations.

      3) The mitochondria area in mct1 cells (Fig.S1G) does not seem to be consistent with the tests in Fig. 1C. that indicate a diminished mitochondrial content in mct1 cells vs wild-type yeast. A better estimate (by WB for instance) of the mitochondrial content in the analyzed strains would enable to better evaluate MMP changes monitored with Mitotracker since the amount of mitochondria in cells correlate with the intensity of the fluorescence signal.

      As this reviewer pointed out, we quantified mitochondrial area based on Tom70-GFP signal. This measurement is quantified by mitochondrial area over cell size. Cell size is an important parameter when measuring organelle size as most of the organelles scale up and down with the cell size. mct1Δ cells generally have smaller cell size than WT cells. Therefore, the mitochondrial area of mct1Δ cells was not significantly different from WT cells when scaled to cell size. We believe this is the best method to compare mitochondrial area. As for quantifying MMP from these microscopy images, we measured the average MitoTracker Red fluorescence intensity of each mitochondria defined by Tom70-GFP. This method inherently normalizes to subtract the influence of mitochondria area when quantifying MMP.

      4) Page 12: "These data demonstrate that loss of SIT4 results in a mitochondrial phenotype suggestive of an enhanced energetic state: higher membrane potential, hyper-tubulated morphology and more effective protein import." Furthermore, the sit4 mutant shows higher levels of OXPHOS complexes compared to WT yeast.

      Despite these beneficial effects on mitochondria, the sit4 deletion strain fails to grow on respiratory substrates. It would be good to know whether the authors have some explanation for this apparent contradiction.

      We agree that this was initially puzzling. We provide a more complete explanation above (see comments to reviewer #1 - major concern #1). Briefly, the growth deficiency in non-fermentable media with sit4Δ cells was reported and studied by multiple groups (Arndt et al., 1989; Dimmer et al., 2002; Jablonka et al., 2006). These seems to indicate that sit4Δ cells contain more ETC complexes and more OCR but cannot respire on nonfermentable carbon source. However, we do not think there is yet a clear explanation for this phenotype. One interesting observation reported is the addition of aspartate partly restoring cells’ growth on ethanol (Jablonka et al., 2006). One early study speculates that this defect could be related to the cAMP-PKA pathway. Sutton et al. pointed out genetic interactions with sit4 and multiple genes in cAMP-PKA (Sutton et al., 1991). In addition, sit4Δ cells have similar phenotypes as those cAMP-PKA null mutants, such as glycogen accumulation, caffeine resistance, and failure to grow on non-fermentable media. However, to keep this manuscript succinct, we opted to stay focused on MMP.

      Reviewer #3 (Public Review):

      In this study, the authors investigate the genetic and environmental causes of elevated Mitochondrial Membrane Potential (MMP) in yeast, and also some physiological effects correlated with increased MMP.

      The study begins with a reanalysis of transcriptional data from a yeast mutant lacking the gene MCT1 whose deletion has been shown to cause defects in mitochondrial fatty acid synthesis. The authors note that in raffinose mct1del cells, unlike WT cells, fail to induce expression of many genes that code for subunits of the Electron Transport Chain (ETC) and ATP synthase. The deletion of MCT1 also causes induction of genes involved in acetyl-CoA production after exposure to raffinose. The authors therefore conduct a screen to identify mutants that suppress the induction of one of these acetylCoA genes, Cit2. They then validate the hits from this screen to see which of their suppressor mutants also reduce expression in four other genes induced in a mct1del strain. This yielded 17 genes that abolished induction of all 5 genes tested in an mct1del background during growth on raffinose.

      The authors chose to focus on one of these hits, the gene coding for the phosphatase SIT4 (related to human PP6) which also caused an increase in expression of two respiratory chain genes. The authors then investigated MMP and mitochondrial morphology in strains containing SIT4 and MCT1 deletions and surprisingly saw that sit4del cells had highly elevated MMP, more reticular mitochondria, and were able to fully import the acetolactate synthase protein Ilv2p and form ETC and ATP synthase complexes, even in cells with an mct1del background, rescuing the low MMP, fragmented mitochondria, low import of Ilv2 and an inability to form ETC and ATP synthase complexes phenotypes of the mct1del strain. Surprisingly, the authors find that even though MMP is high and ETC subunits are present in the sit4del mct1del double deletion strain, that strain has low oxygen consumption and cannot grow under respiratory conditions, indicating that the elevated MMP cannot come from fully functional ETC subunits. The authors also observe that deleting key subunits of ETC complex III (QCR2) and IV (COX5) strongly reduced the MMP of the sit4del mutant, which would suggest that the majority of the increase in MMP of the sit4del mutant was dependant on a partially functional ETC. The authors note that there was still an increase in MMP in the qcr2del sit4del and cox4del sit4del strains relative to qcr2del and cox4del strains indicating that some part of the increase in MMP was not dependent on the ETC.

      The authors dismiss the possibility that the increase in MMP could have been through the reversal of ATP synthase because they observe that inhibition of ATP synthase with oligomycin led to an increase of MMP in sit4del cells. Indicating that ATP synthase is operating in a forward direction in sit4del cells.

      Noting that genes for phosphate starvation are induced in sit4del cells, the authors investigate the effects of phosphate starvation on MMP. They found that phosphate starvation caused an increase in MMP and increased Ilv2p import even in the absence of a mitochondrial genome. They find that inhibition of the ADP/ATP carrier (AAC) with bongkrekic acid (BKA) abolishes the increase of MMP in response to phosphate starvation. They speculate that phosphate starvation causes an increase in MMP through the import and conversion of ATP to ADP and subsequent pumping of ADP and inorganic phosphate out of the mitochondria.

      They further show that MMP is also increased when the cyclin dependent kinase PHO85 which plays a role in phosphate signaling is deleted and argue that this indicates that it is not a decrease in phosphate which causes the increase in MMP under phosphate starvation, but rather the perception of a decrease in phosphate as signalled through PHO85. Unlike in the case of SIT4 deletion, the increase in MMP caused by the deletion of pho85 is abolished when MCT1 is deleted.

      Finally they show an increase in MMP in immortalized human cell lines following phosphate starvation and treatment with the phosphate transporter inhibitor phosphonoformic acid (PFA). They also show an increase in MMP in primary hepatocytes and in midgut cells of flies treated with PFA.

      The link between phosphate starvation and elevated MMP is an important and novel finding and the evidence is clear and compelling. Based on their experiments in various mammalian contexts, this link appears likely to be generalizable, and they propose and begin to test an interesting hypothesis for how MMP might occur in response to phosphate starvation in the absence of the Electron Transport Chain.

      The link between phosphate starvation and deletion of the conserved phosphatase SIT4 is also interesting and important, and while the authors' experiments and analysis suggest some connection between the two observations, that connection is still unclear.

      Major points

      Mitotracker is great fluorescent dye, but it measures membrane potential only indirectly. There is a danger when cells change growth rates, ion concentrations, or when the pH changes, all MMP indicating dyes change in fluorescence: their signal is confounded Change in phosphate levels can possibly do both, alter pH and ion concentrations. Because all conclusions of the manuscript are based on a change in MMP, it would be a great precaution to use a dye-independent measure of membrane potential, and confirm at least some key results.

      Mitochondrial MMP does strongly influence amino acid metabolism, and indeed the SIT4 knockout has a quite striking amino acid profile, with histidine, lysine, arginine, tyrosine being increased in concentration. http://ralser.charite.de/metabogenecards/Chr_04/YDL047W.html Could this amino acid profile support the conclusions of the authors? At least lysine and arginine are down in petites due to a lack of membrane potential and iron sulfur cluster export.- and here they are up. Along these lines, according to the same data resource, the knock-outs CSR2, ASF1, SSN8, YLR0358 and MRPL25 share the same metabolic profile. Due to limited time I did not re-analyse the data provided by the authors- but it would be worth checking if any of these genes did come up in the screens of the authors.

      We tested the mutants within the same cluster as SIT4 shown in this paper from the deletion collection and measured their MMP. yrl358cΔ cells have similar high MMP as observed in sit4Δ cells. However, this gene has a yet undefined function. Beyond YRL358C, we did not observe similar MMP increases in other gene deletions from this panel, which does not support the notion that amino acids such as histidine, lysine, arginine, or tyrosine play a determining effect in driving MMP.

      The media condition and strain used in the suggested paper is very different from what we used in our study. Instead of growing prototrophic cells in minimal media without any amino acids, we used auxotrophic yeast strains and grew them in media containing complete amino acids. So far, none of the other defects or signaling associated with SIT4 deletion could influence MMP as much as the phosphate signaling. We interpret these data to support the hypothesis that the MMP observation in sit4Δ cells is connected with the phosphate signaling as illustrated by the second half of the story in our manuscript.

      Author reponse image 2.

      One important claim in the manuscript attempts to explain a mechanism for the MMP increase in response to phosphate starvation which is independent of the ETC and ATP synthase.

      It seems to me the only direct evidence to support this claim is that inhibition of the AAC with BKA stops the increase of mitotracker fluorescence in response to phosphate starvation in both WT and rho0 cells (Figs 4B and 4C). It would strengthen the paper if the authors could provide some orthogonal evidence.

      This is a similar comment as raised by reviewer #1 - major concern #3. We refer the reviewer to our discussion and the new data above. Briefly, we do not think F1 subunit is responsible for the ATP hydrolysis activity to generate MMP in phosphate depleted situation. We believe there are additional ATPase(s) in the mitochondrial matrix that can be utilized to couple to ADP/ATP carrier for MMP generation during phosphate starvation. However, we have not identified the relevant ATPase(s) at this point, and it is likely that multiple ATPases could contribute to this activity.

      Introduction/Discussion The author might want to make the reader of the article aware that the 'reversal' of the ATP synthase directionality -i.e. ATP hydrolysis by the ATP synthase as a mechanism to create a membrane potential (in petites), has always been a provocative idea - but one that thus far could never be fully substantiated. Indeed some people that are very familiar with the topic, are skeptical this indeed happens. For instance, Vowinckel et al 2021 (PMID: 34799698) measured precise carbon balances for peptide cells, and found no evidence for a futile cycle - peptides grow slower, but accumulate the same biomass from glucose as peptides that re-evolve at a fast growth rate . Perhaps the manuscript could be updated accordingly.

      We thank the reviewer for pointing out this additional relevant study. We have rephased the referenced sentence in the introduction. The MMP generation in phosphate starvation is independent of the F1 portion of ATP synthase. Therefore, our data neither supports or refutes either of these arguments.

      In the introduction and conclusion there is discussion of MMP set points. In particular the authors state:

      "Critically, we find that cells often prioritize this MMP setpoint over other bioenergetic priorities, even in challenging environments, suggesting an important evolutionary benefit."

      This does not seem to be consistent with the central finding of the manuscript that MMP changes under phosphate starvation. MMP doesn't seem so much to have a 'set point' but rather be an important physiological variable that reacts to stimuli such as phosphate starvation.

      The reviewer raises a rational alternative hypothesis to the one that we have proposed. In reality, both of these are complete speculations to explain the data and we can’t think of any way to test the evolutionary basis for the mechanisms that we describe. We recognize that untested/untestable speculative arguments have limitations and there are viable alternative hypotheses. We have softened our language to ensure that it is clear that this is only a speculation.

      The authors suggest that deletion of Pho85 causes an increase in MMP because of cellular signaling. However, they also state in the conclusion:

      "Unlike phosphate starvation, the pho85D mutant has elevated intracellular phosphate concentrations. This suggests that the phosphate effect on MMP is likely to be elicited by cellular signaling downstream of phosphate sensing rather than some direct effect of environmental depletion of phosphate on mitochondrial energetics."

      The authors should cite the study that shows deletion of PHO85 causes increased intracellular phosphate concentrations. It also seems possible that the 'cellular signaling' that causes the increase in MMP could be a result of this increase in intracellular phosphate concentrations, which could constitute a direct effect of an environmental overload of phosphate on mitochondrial energetics.

      We now cited the literature that shows higher intracellular phosphate in pho85Δ cells (Gupta et al., 2019; Liu et al., 2017). Depleting phosphate in the media drastically reduced intracellular phosphate concentration, which is the opposing situation as pho85Δ cells. Nevertheless, we observed higher MMP in either situation. We concluded from these two observations that the increase in MMP is a response to the signaling activated by phosphate depletion rather than the intracellular phosphate abundance.

      Related to this point, in the conclusion, the authors state:

      "We now show that intracellular signaling can lead to an increased MMP even beyond the wild-type level in the absence of mitochondrial genome."

      In sum, the data shows that signaling is important here- but signaling alone is only the message - not the biophysical process that creates a membrane potential. The authors then could revise this slightly.

      We have rephrased this sentence as suggested, which now reads “We now show that intracellular signaling triggers a process that can lead to an increased MMP even beyond the wild-type level in the absence of mitochondrial genome”.

      The authors state in the conclusion that

      "We first made the observation that deletion of the SIT4 gene, which encodes the yeast homologue of the mammalian PP6 protein phosphatase, normalized many of the defects caused by loss of mtFAS, including gene expression programs, ETC complex assembly, mitochondrial morphology, and especially MMP (Fig. 1)"

      The data shown though indicates that a defect in mtFAS in terms of MMP, deletion of SIT4 causes a huge increase (and departure away from normality) whether or not mct1 is present (Fig 1D)

      We changed the word “normalized” to “reversed”. In the discussion section, we also emphasized that many of these increases are independent of mitochondrial dysfunction induced by loss of mtFAS.

      The language "SIT4 is required for both the positive and negative transcriptional regulation elicited by mitochondrial dysfunction" feels strong. SIT4 seems to influence positive transcriptional regulation in response to mitochondrial dysfunction caused by MCT1 deletion (but may not be the only thing as there appears to be an increase in CIT2 expression in a sit4del background following a further deletion of MCT1). In terms of negative regulation, SIT4 deletion clearly affects the baseline, but MCT1 deletion still causes down regulation of both examples shown in Fig 1B, showing that negative transcriptional regulation can still occur in the absence of SIT4. The authors might consider showing fold change of expression as they do in later figures (Figs 4B and C) to help the reader evaluate the quantitative changes they demonstrate.

      We now displayed the fold change as suggested. This sentence now reads “These data suggest that SIT4 positively and negatively influences transcriptional regulation elicited by mitochondrial dysfunction”.

      The authors induce phosphate starvation by adding increasing amounts of potassium phosphate monobasic at a pH of 4.1 to phosphate dropout media supplemented with potassium. The authors did well to avoid confounding effects of removing potassium. The final pH of YNB is typically around 5.2. Is it possible that the authors are confounding a change in pH with phosphate starvation? One would expect the media in the phosphate starvation condition to have a higher pH than the phosphate replacement or control media. Is a change in pH possibly a confounding factor when interpreting phosphate starvation? Perhaps the authors could quantify the pH of the media they use for the experiment to understand how much of a factor that could be. One needs to be careful with Miotracker and any other fluorescent dye when pH changes. Albeit having constraints on its own, MitoLoc as a protein rather than small molecule marker of MMP might be a good complement.

      We followed the protocol used by many other studies that depleted phosphate in the media. The reason we and others adjusted the media without inorganic phosphate to a pH of 4.1 is because that is the pH of phosphate monobasic. From there, we could add phosphate monobasic to create +Pi media without changing the media pH. Therefore, media containing different concentrations of phosphate all have the exact same pH. We now emphasize that all media containing different levels of inorganic phosphate have the same pH to the manuscript to eliminate such concern (see page 18).

      Even though all media have the similar pH, we also provided complementary data using a parallel approach to measure the MMP by assessing mitochondrial protein import as demonstrated previously with Ilv2-FLAG, which shares the same principle as mitoLoc.

      Reference

      Arndt, K. T., Styles, C. A., & Fink, G. R. (1989). A suppressor of a HIS4 transcriptional defect encodes a protein with homology to the catalytic subunit of protein phosphatases. Cell, 56(4), 527–537. https://doi.org/10.1016/00928674(89)90576-X

      Dimmer, K. S., Fritz, S., Fuchs, F., Messerschmitt, M., Weinbach, N., Neupert, W., & Westermann, B. (2002). Genetic basis of mitochondrial function and morphology in Saccharomyces cerevisiae. Molecular Biology of the Cell, 13(3), 847–853. https://doi.org/10.1091/mbc.01-12-0588

      Gupta, R., Walvekar, A. S., Liang, S., Rashida, Z., Shah, P., & Laxman, S. (2019). A tRNA modification balances carbon and nitrogen metabolism by regulating phosphate homeostasis. ELife, 8, e44795. https://doi.org/10.7554/eLife.44795

      Jablonka, W., Guzmán, S., Ramírez, J., & Montero-Lomelí, M. (2006). Deviation of carbohydrate metabolism by the SIT4 phosphatase in Saccharomyces cerevisiae. Biochimica et Biophysica Acta (BBA) - General Subjects, 1760(8), 1281–1291. https://doi.org/10.1016/j.bbagen.2006.02.014

      Liu, N.-N., Flanagan, P. R., Zeng, J., Jani, N. M., Cardenas, M. E., Moran, G. P., & Köhler, J. R. (2017). Phosphate is the third nutrient monitored by TOR in Candida albicans and provides a target for fungal-specific indirect TOR inhibition. Proceedings of the National Academy of Sciences, 114(24), 6346–6351. https://doi.org/10.1073/pnas.1617799114

      Sutton, A., Immanuel, D., & Arndt, K. T. (1991). The SIT4 protein phosphatase functions in late G1 for progression into S phase. Molecular and Cellular Biology, 11(4), 2133–2148.

    1. Author Response

      Reviewer #2 (Public Review):

      Weaknesses:

      1)The authors demonstrate that Isw1 has a role in responding to antifungals in Cryptococcus. However, it is not clear if changes in Isw1 stability represent a general response to stress. This study would have benefited from experiments to test: (1) if levels of Isw1 change in response to other stressors (e.g., heat, osmotic, or oxidative stress) and (2) if loss of Isw1 impacts resistance to other stressors.

      A series of experiments were conducted to illustrate and measure phenotypic traits associated with virulence. These traits encompassed capsule formation, melanin synthesis, cell proliferation under stressful conditions, and Isw1 expression levels in response to diverse environmental stimuli. Please see Figure 3a, 3b, 3c, Figure 3-figure supplement 1 and line 237-241.

      2) The authors demonstrate a critical role in the acetylation of K97 and ubiquitination of K441 in regulating Isw1 stability. Additionally, this study shows that K113 is also likely involved in this process. However, it appears that K113 can be either acetylated or ubiquitinated, and it is, thus, less clear if one of the two modifications or both modifications is critical at this residue. Additional experiments may be required to answer this question. This study would have benefited from an additional discussion on the results related to the modification of K113.

      We express our genuine gratitude for this insightful critique pertaining to the K113 site. In our study, we observed the presence of acetylation and ubiquitination changes at the K113 site in our mass spectrometry data. This finding suggests that a proportion of Isw1 is acetylated, while another proportion of Isw1 is ubiquitinated. In order to analyze the K113 function, a series of experiments were conducted, involving the production of triple, double, and single mutations at positions K89, K97, and K113. In addition, the utilization of K-to-R (mimicking deacetylation) and K-to-Q (mimicking acetylation) methodologies was implemented. To elucidate the significance of the acetylation modification of K113, a series of mutants were created. The K-to-R mutation was employed to indicate the deacetylation and deubiquitylation status, while the K-to-Q mutation was utilized to represent the acetylation and deubiquitylation status. In our dataset, it was shown that neither the single mutation of K113 K-to-R nor K-to-Q exhibited any discernible drug resistance phenotype. This finding suggests that, within the physiological context of the Isw1 protein, both post-translational modifications (PTMs) of K113 had minimal or no impact on the regulation of drug resistance. The reason for this phenomenon is because the acetylation modification of K97 imitates the process of ubiquitination of Isw1, hence reducing the interaction between Isw1 and Cdc4, which is an E3 ligase. Hence, the ubiquitination of K113 does not play a crucial role in the regulation of Isw1 protein stability under conditions where K97 is completely acetylated. Nevertheless, upon deacetylation of K97, we observed a notable increase in the abundance of Isw1 protein when K113 is substituted with R. This finding strongly supports the notion that ubiquitination of K113 plays a crucial role in maintaining the stability of the Isw1 protein. Hence, in the case of K97 acetylation, the PTM modifications of K113 are not required for maintaining Isw1 protein levels. However, in the event of K97 deacetylation, the ubiquitination of K113 becomes crucial in regulating protein stability. Considering the intricate post-translational modification (PTM) regulation observed at the K113 site, it would be advantageous to generate antibodies specific to K113ac and K113ub in order to comprehensively investigate the functional role of K113 in the regulatory processes. Nevertheless, the presence of antibodies targeting site-specific ubiquitination is infrequent in scientific literature. We regret any confusion that may have arisen from the previous remark and have made revisions to the manuscript to address this issue. Please refer to line 485-500.

      3)The authors demonstrate that overexpression of ISW1 in select clinical isolates of Cryptococcus increases sensitivity to antifungals. However, these experiments would have benefited from additional controls, such as including overexpression of ISW1 in the wild-type strain (H99) and antifungal-sensitive isolate (CDLC120).

      In response to your concern, we successfully generated the strains as required. In the revised manuscript, we demonstrated that the overexpression of the stable variant of Isw1 in H99 and CDLC120 strains induces heightened susceptibility to antifungal drugs. Please see Figure 8e, 8i and line 404-413.

      Reviewer #3 (Public Review):

      1) ISWI chromatin remodellers are well-characterised in many organisms. How many ISWI proteins does Cryptococcus contain? Why did the authors focus on ISWI?

      We express our gratitude for this criticism. The identification of Isw1 was conducted as a further investigation building upon the findings presented in our previously published data (Li Y, 2019). In prior research, the acetylome in C. neoformans was comprehensively analyzed, and a series of knockout strains were created to investigate the relationship between fungal pathogenicity and acetylation. The Isw1 mutant has been discovered as a modifier of drug resistance. The identification of fungal paralogs of ISW genes was initially observed in Saccharomyces cerevisiae, a species of yeast that has experienced genome duplication. This process involves two paralogs, Isw1 and Isw2, which emerged as a result of the whole genome duplication event (Kellis M, 2004; Tsukiyama T, 1999; Wolfe KH, 1997). Because C. neoformans has not gone through the complete genome duplication event, its genome only encodes one copy of ISW gene. Please see line 129-134..

      2) What is the ISWI protein complex(es)? The Mass-Spec analysis should reveal this.

      Prior research conducted on Saccharomyces cerevisiae has provided evidence that the ISWI complex is comprised of several subunits, namely Isw1, Ioc genes, Itc1, Chd1, and Sua7 (Mellor J, 2004; Smolle M, 2012; Sugiyama and Nikawa, 2001; Vary JC Jr, 2003; Yadon AN, 2013). Upon a thorough examination of the C. neoformans genome, we have not been able to identifying a similar the IOC gene family. This absence likely suggests an evolutionary loss of the IOC gene family in C. neoformans, as suggested on the FungiDB website. However, C. neoformans has Itc1, Chd1, and Sua7. While we concur with the aforementioned statement on the capability of Mass-Spec data to elucidate potential protein-protein interactions and aid in the identification of subunits within the ISWI complex, it is important to acknowledge that the PTM Mass-Spec methodology is solely employed for the purpose of identifying potential sites of protein modification. In order to comprehensively investigate the cryptoccocal ISWI complex, we conducted a standardized Isw1-Flag protein immunoprecipitation procedure, followed by Mass-Spec analysis. In the present study, a total of 22 proteins that interact with Isw1 were found in our experimental data. Among these proteins, 11 have been previously reported to be associated with the regulatory networks including Isw1. In the mass spectrometry results, the protein Itc1 was found to be co-immunoprecipitated with the protein Isw1. Although the Mass-Spec analysis did not reveal the presence of Chd1 and Sua7, our study demonstrated that Chd1 can be coimmunoprecipitated with Isw1 through the utilization of co-IP and immunoblotting techniques. However, no interaction between Isw1 and Sua7 was shown utilizing any of these methods. In brief, cryptococcal ISWI regulatory machinery is distantly related to that from S. cerevisiae. Please see Figure 2 and line 206-219.

      3) Is Cryptococcus ISWI a transcriptional activator or repressor?

      We regret the erroneous representation of Isw1 in the prior iteration of the manuscript. The misclassification of Isw1 as a transcriptional regulator has been identified, since it has been determined to function as a chromatin remodeler instead. The text has been suitably revised in accordance with academic standards. In the revised publication, we have presented a comprehensive transcriptome analysis of the isw1 Δ strain under both FLC treatment and no treatment conditions. This analysis offers valuable insights into the gene regulatory patterns associated with Isw1. In our dataset, we observed that Isw1 exerts a negative regulatory effect on the expression of genes that encode drug pumps, while simultaneously exerting a positive regulatory effect on the expression of genes that are essential for 5-FC resistance. Moreover, the ChIP-PCR study demonstrated the binding of Isw1 to the promoter regions of genes of interest. Hence, the chromatin remodeler Isw1 has a dual role, wherein it both facilitates the activation of certain genes and suppresses the expression of others, in response to varying forms of drug resistance. Please see line 142-153.

      4) Is ISWI function in drug resistance linked to its chromatin remodelling activity?

      In order to investigate the potential role of Isw1 on chromatin activity in the modulation of multidrug resistance, we have conducted protein truncation experiments. Specifically, we deleted the DNA binding domain, the helicase domain, and the SNF2 domain, which have been previously shown to regulate Isw1 chromatin activity in the model organism S. cerevisiae (Grune T, 2003; Mellor J, 2004; Pinskaya M, 2009; Rowbotham SP, 2011). The new data demonstrated that all truncation variants of Isw1 mutants had a growth phenotype consistent with that of the deletional strain isw1Δ. In addition, the levels of gene expression observed in these strains were also similar to those observed in the deletion strain isw1Δ. This finding provides evidence that the regulation of the drug resistance mechanism is influenced by these critical domains involved in modifying chromatin activities. Moreover, the Isw1-Flag strain was utilized to conduct chromatin immunoprecipitation and PCR experiments, which revealed that Isw1 exhibits the ability to directly bind to the promoter regions of target genes. The new findings added evidence substantially supporting the hypothesis that the Isw1 chromatin activity plays a crucial role in modulating its protein function, and acting as a central regulator of drug resistance in C. neoformans. Please see revised Figure 1g, 1h, 1i and line 186-199 in the revised manuscript text.

      5) Does ISWI interact with chromatin? If so, which are ISWI-target genes? Does drug treatment modulate chromatin binding?

      To effectively tackle this concern, we have pursued two distinct approaches to demonstrate the chromatin regulatory effects of Isw1. In this study, the DNA binding domain was deliberately removed through genetic manipulation. The data presented indicates that the Isw1 mutants with shorter variations exhibited a growth phenotype that was characterized by multidrug resistance. This growth phenotype correlates with the growth phenotype obtained in the isw1Δ deletion strain. Additionally, it was observed that the levels of gene expression in the strain were comparable to those detected in the deletion strain isw1Δ. This discovery offers empirical support for the notion that the control of the drug resistance mechanism is indeed impacted by the DNA binding capability of Isw1. Furthermore, the Isw1-Flag strain was employed to perform chromatin immunoprecipitation and PCR assays, demonstrating the direct binding capacity of Isw1 to the promoter regions of target genes. The results obtained from this comprehensive analysis of the revised data offer significant evidence for the proposition that Isw1 interacts with chromatin and that its chromatin activity plays a pivotal role in modulating its protein function. This interaction serves as a central regulatory mechanism for drug resistance in C. neoformans. Furthermore, a transcriptome analysis was performed on both wildtype and isw1 deletion strains in the absence of FLC therapy. Upon comparing the results obtained from two unique experimental settings, specifically those with and without FLC administration, a notable disparity in the control of gene expression between these two situations was identified. In the context of the isw1 deletion strain exposed to FLC treatment, a set of 21 genes, including those belonging to the ABC/MFS family and efflux pumps, displayed significant changes in their gene expression patterns. In particular, a total of 9 genes exhibited downregulation, whilst 12 genes displayed upregulation. In contrast, in the absence of FLC supplementation, a total of 9 genes exhibited alterations in gene expression, with 3 genes showing downregulation and 6 genes showing upregulation. Therefore, the Isw1 protein plays a crucial role in the activation of certain genes, while simultaneously having a suppressive effect on other genes. Hence, the Isw1 undergoes a reconfiguration of its regulatory apparatus in response to drugs. Despite that the performance of ChIP-seq analysis was necessary in this study, it was observed that the treatment of fungal cells resulted in a notable decrease in the abundance of the Isw1 protein. This decrease can be attributed to the activation of Isw1 protein degradation. Consequently, there was an insufficient amount of Isw1 protein available for successful enrichment and subsequent ChIP-seq analysis (please see Figure 4a and 4c). However, the data collected collectively have demonstrated the idea that Isw1 serves as a crucial master regulator of drug resistance in C. neoformans. The text has undergone revisions in order to present our findings in a precise and thorough manner. Please see Figure 1c, 1g, Supplementary File 2, and line 145-153, 186-188.

    1. Author Response

      The following is the authors’ response to the original reviews.

      eLife assessment:

      Multimodal experiences that for example contain both visual and tactile components are encoded as associative memories. This manuscript is a valuable contribution supporting structural and functional brain plasticity following associative training protocols that pair together different types of sensory stimuli. The results provide solid support for this plasticity being a basis for cross-modal associative memories.

      We appreciate eLife assessments to our discovery about the recruitment of associative memory neurons in cerebral cortices as a hub for the fulfillment of the first order and the second order of associative memory. Synapse interconnections among associative memory neurons mediate the reciprocal retrieval, the conversion and the translation of associated signals learnt in life span.

      Reviewer #1 (Public Review):

      This manuscript by Xu and colleagues addresses the important question of how multi-modal associations are encoded in the rodent brain. They use behavioral protocols to link stimuli to whisker movement and discover that the barrel cortex can be a hub for associations. Based on anatomical correlations, they suggest that structural plasticity between different areas can be linked to training. Moreover, they provide electrophysiological correlates that link to behavior and structure. Knock-down of nlg3 abolishes plasticity and learning. This study provides an important contribution as to how multi-modal associations can be formed across cortical regions.

      We sincerely thank Reviewer one’s comments, which is a great driving force for us to move forward to reveal the specific roles of neural circuits in associative memory and its relevant cognitive activities and emotional reactions.

      Reviewer #2 (Public Review):

      This manuscript by Xu et al. explores the potential joint storage/retrieval of associated signals in learning/memory and how that is encoded by some associative memory neurons using a mouse model. The authors examined mouse associative learning by pairing multimodal mouse learning including olfactory, tactile, gustatory, and pain/tail heating signals. The key finding is that after associative learning, barrel neurons respond to other multi-model stimulations. They found these barrel cortical neurons interconnect with other structures including piriform cortex, S1-Tr and gustatory cortical neurons. Further studies showed that Neuroligin 3 mediated the recruitment of associative memory neurons during paired stimulation group. The authors found that knockdown Neuroligin 3 in the barrel cortex suppressed the associative memory cell recruitment in the paired stimulation learning. Overall, while the findings of this study are interesting, the concept of associative learning involving multiple functionally connective cortical regions is not that novel. While some data presented are convincing, the other seems to lack rigor. In addition, more details and clarification of the experimental methods are needed.

      Thank you so much for your comments on our studies in terms of the recruitment of associative memory neurons as the hub for the joint storage and reciprocal retrieval of multi-modal associated signals. You are right about that the concept of associative memory neuron and the new established interconnection among cerebral cortices for the formation of associative memory are not novel. The original finding has been reported by senior author’s lab many years ago, which has also been presented in a book by Jin-Hui Wang “Associative Memory Cells: Basic Units of Memory Trace” published by Springer-Nature 2019. In addition, we have made certain clarifications in our revision, but the detailed information about experimental approaches and concepts are expected to be seen in our previous publications and this book as well.

      Reviewer #1 (Recommendations For The Authors):

      I have two points that I find would strengthen the manuscript further:

      1. Associative memories are also based on specificity, which is not addressed in this manuscript. The authors could discuss this and also the magnitude of plasticity. In general, I would suggest also testing plasticity in response to a non-linked stimulus to prove specificity.

      This a good point. In terms of the specificity of associative memory in our model, we have shown this point in our previous studies, such as Wang, et al. “Neurons in the barrel cortex turn into processing whisker and odor signals: a cellular mechanism for the storage and retrieval of associative signals”. Frontiers in Cellular Neuroscience 9-320:1-17 2015, and Jin-Hui Wang “Associative Memory Cells: Basic Units of Memory Trace” published by Springer-Nature 2019.

      1. Nlg3 knock-down is a strong intervention. The authors could discuss the implications of interfering with synapse assembly and mechanistic implications at the synaptic level. It could help to compare the consequences of this intervention to a post-training lesion.

      This is a good point. To prevent the possibility of post-training lesion by the intervention of Nlg3 knockdown, we have conducted the use of shRNA-scramble control. In addition, the discussion about the intervention of Nlg3 knockdown at synapse level has been added in our discussion.

      1. In general, the clarity of the wording in some sections/sentences could be improved.

      The rewording of certain sentences has been done in our revision.

      Reviewer #2 (Recommendations For The Authors):

      1. The writing of the manuscript needs major editing, there are grammatical errors even in the title. The extremely long introduction and discussion section with repeated details can be distracting from the main focus of the work.

      This point has been taken during our revision.

      1. Many bar graphs, such as Figure 5C and 5G, Figure 6C-6G, have low-resolution images, meaning that the axis titles and labels are unreadable.

      The resolution of Figures have been improved in our revision.

      1. The bar graph with data points and illustration in Figure 1E and 1G are misplaced.

      This mistake has been corrected in our revision.

      1. On page 23, Figure 2B, which layer(s) of the PC, S1Tr and GC were the images taken from? In the PSG group, why is there no red axon terminal signal observed in the three regions? does it indicate that there is no significant projection from the BC axon to PC, S1Tr, or GC neurons? Given that Thy1-YFP labeled glutamatergic neurons at PC, S1Tr, and GC and there is no discernable co-localization of yellow and green cells, can we assume that the glutamatergic neurons at PC, S1Tr, and GC are not involved in the associative learning after PSG paradigm? Lastly, the number of synapse contacts in Figure 2E is only 1-2 per 100um dendrite, but this is not quite consistent with the confocal images in Figure 2D. In Figure 2D, there are at least three tdTomato boutons on the cropped dendrite which is ~16um according to the scale bar.

      If we magnify Figure 2B, we are able to see red boutons, which can be seen in Figure 2C with a higher magnification. In addition, the distribution of synapse contacts is variable, we have demonstrated the averaged values of synapse contacts over dendrites in Figure 2E, such that the single original image may not exactly same as the statistical data.

      1. Figure 4C and Figure 8C, how were the percentages of associative neurons calculated after LFP recording? More details are needed on the method of this in vivo LFP/single unit recordings, including the spike sorting algorithm.

      In the section of Results, the total number of neurons recorded in each of groups has been given. For instance, the neurons recorded from PSG mice (Figure 4) were 70, which was used as denominator. With the number of neurons that responded to two or more signals, the percentage of associative memory neurons recruited in associative learning was calculated. This information has been added in our revision (please see the section of Results).

      1. The rationale for the authors choosing Neuroligin 3 as the target for investigating the formation of new synapse interconnections between BC, PC, S1Tr, and GC after PSG should be more clearly spelled out. Synaptic CAMs include SynCAM, NCAM, Neurexin, Cadherin et al all play a role in new synapse formation. Neuroligin 1 is expressed specifically in the CNS at excitatory synapses. Why did the authors choose to study Neuroligin 3 instead of Neuroligin 1?

      This is a good point. Based on our previous data, miRNA-324 is upregulated during the associative learning by our mouse model, which degrades neuroligin-3 mRNA. The role of neuroligin-3 in the formation of new synapses and the recruitment of associative memory neurons is studied in this paper.

      1. The behavioral results in Figure 5B-5G indicated that after pair-stimulation of WS-OS, WS-TS, or WS-GS, the memory learned in piriform, S1-Tr and gustatory cortical neurons can be retrieved from each other, by jumping over the barrel cortex. Is it possible that there is some direct interconnection formed between piriform, S1-Tr, and gustatory cortical neurons? Maybe they can try to do barrel cortical lesion or chemogenetic inhibition after PGS training and then repeat the behavioral tests as in Figure 5B-5G.

      We have done experiments to examine the potential direct interconnection among piriform, S1-Tr and gustatory cortical neurons, after the associative learning about twelve days. We have no convincing data to support this possibility at this moment.

      1. Some of the images showing the location of virus injections look VERY similar, such as Figure 3A left and right, Figures 7A and 7D. Larger variability of different animals/injection sites is definitely expected.

      The injected viruses in Figure 3 and Figure 7 are different, since AAV-carried fluorescent proteins in different cortical areas are different. In addition, if we carefully enlarge the images in the right and left panels of Figure 3A, we will see that the areas of AAV transfection in morphology are different. The similarity of injection areas as Reviewer two claimed indicates the more precision of our virus-injection sites.

      1. On page 49, are the green neurons in Figure 9B the BC cells? Just to be consistent, the authors should use the same color for BC cells as in Figure 9A. Also, label the primary and the secondary associative memory cells in Figure 9.

      Figure 9 has been thoroughly changed in our revision.

    1. Author Response

      The following is the authors’ response to the original reviews.

      Reviewer #1 (Public Review):

      Soudi, Jahani et al. provide a valuable comparative study of local adaptation in four species of sunflowers and investigate the repeatability of observed genomic signals of adaptation and their link to haploblocks, known to be numerous and important in this system. The study builds on previous work in sunflowers that have investigated haploblocks in those species and on methodologies developed to look at repeated signals of local adaptations. The authors provide solid evidence of both genotype-environment associations (GEA) and genome-wide association study (GWAS), as well as phenotypic correlations with the environment, to show that part of the local adaptation signal is repeatable and significantly co-occur in regions harboring haploblocks. Results also show that part of the signal is species specific and points to high genetic redundancy. The authors rightfully point out the complexities of the adaptation process and that the truth must lie somewhere between two extreme models of evolutionary genetics, i.e. a population genetics view of large effect loci and a quantitative genetics model. The authors take great care in acknowledging and investigating the multiple biases inherent to the used methods (GEA and GWAS) and use a conservative approach to draw their conclusions. The multiplicity of analyses and their interdependence make them slightly hard to understand and the manuscript would benefit from more careful explanations of concepts and logical links throughout. This work will be of interest to evolutionary biologists and population geneticists in particular, and constitutes an additional applied example to the comparative local adaptation literature.

      Some thoughts on the last paragraph of the discussion (L481-497): I think it would be fine to have some more thoughts here on the processes that could contribute to the presence/absence of inversions, maybe in an "Ideas and Speculation" subsection. To me, your results point to the fact that though inversions are often presented as important for local adaptation, they seem to be highly contingent on the context of adaptation in each species. First, repeatability results are only at the window/gene level in your results, the specific mutations are not under scrutiny. Is it possible that inversions are only necessary when sets of small effect mutations are used, opposite to a large effect mutation in other species? Additionally, in a model with epistasis, fitness effects of mutations are dependent on the genomic background and it is possible that inversions were necessary in only certain contexts, even for the same mutations, i.e. some adaptive path contingency. Finally, do you have specific demographic history knowledge in this system that maps to the observations of the presence of inversions or not? For example, have the species "using" inversions been subject to more gene flow compared to others?

      Thank you for the great suggestions and helpful comments. Regarding the question of demography, each of the species actually harbours quite a large number of haploblocks (13 in H. annuus spanning 326Mb, 6 in H. argophyllus spanning 114 Mb, and 18 in H. petiolaris spanning 467 Mb; see Todesco et al. 2020 for more details) so there does not seem to be any clear association with demography. We agree about the complexities that might underly the evolution of inversions that you outline above, and have refined some of the text where we discuss their evolution in the Discussion.

      Reviewer #2 (Public Review):

      In this study the authors sought to understand the extent of similarity among species in intraspecific adaptation to environmental heterogeneity at the phenotypic and genetic levels. A particular focus was to evaluate if regions that were associated with adaptation within putative inversions in one species were also candidates for adaptation in another species that lacked those inversions. This study is timely for the field of evolutionary genomics, due to recent interest surrounding how inversions arise and become established in adaptation.

      Major strengths

      Their study system was well suited to addressing the aims, given that the different species of sunflower all had GWAS data on the same phenotypes from common garden experiments as well as landscape genomic data, and orthologous SNPs could be identified. Organizing a dataset of this magnitude is no small feat. The authors integrate many state-of-the-art statistical methods that they have developed in previous research into a framework for correlating genomic Windows of Repeated Association (WRA, also amalgamated into Clusters of Repeated Association based on LD among windows) with Similarity In Phenotype-Environment Correlation (SIPEC). The WRA/CRA methods are very useful and the authors do an excellent job at outlining the rationale for these methods.

      Thank you!

      Major weaknesses

      The study results rely heavily on the SIPEC measure, but I found the values reported difficult to interpret biologically. For example, in Figure 4 there is a range of SIPEC from 0 to 0.03 for most species pairs, with some pairs only as high as ~0.01. This does not appear to be a high degree of similarity in phenotype-environment correlation. For example, given the equation on line 517 for a single phenotype, if one species has a phenotype-environment correlation of 1.0 and the other has a correlation of 0.02, I would postulate that these two species do not have similar evolutionary responses, but the equation would give a value of (1+0.02)10.02/1 = 0.02 which is pretty typical "higher" value in Figure 4. I also question the logic behind using absolute values of the correlations for the SIPEC, because if a trait increases with an environment in one species but decreases with the environment in another species, I would not predict that the genetic basis of adaptation would be similar (as a side note, I would not question the logic behind using absolute correlations for associations with alleles, due to the arbitrary nature of signing alleles). I might be missing something here, so I look forward to reading the author's responses on these thoughts.

      The reviewer makes a very good point about the range of SIPEC, and we have changed our analysis to reflect this, now reporting the maximum value of SIPEC for each environment (across the axes of the PCA on phenotypes that cumulatively explain 95% of the variance), in Figure 4 and Supplementary Figures S2 and S13. For consistency among manuscript versions and to illustrate the effect of this change, we retain the mean SIPEC value in one figure in the supplementary materials (S12), which shows the small effect of this change on the qualitative patterns. Figure 4 now shows that the maximum SIPEC value is regularly quite strong, which should address the reviewer’s concern that this is not being driven by anomalous and small values. We appreciate this point and think this change now more closely reflects how we are trying to estimate the biological feature of interest – that some axis of phenotypic space is strongly (or not) responding to selection from the environmental variable.

      With respect to the logic behind using absolute value, we still feel this is justified for traits, because if a trait evolves to be bigger or smaller, it may still use the same genes. For example, flowering time may change to be later or earlier, which would result in opposite correlations with a given environment, but might use the same gene (e.g. FT) for this. As such, we think keeping absolute value is more representative as otherwise species with strong but opposite patterns of adaptation would look like they were very different. We have added a statement on line 584 in the methods section to further clarify the reason for this choice.

      An additional potential problem with the analysis is that from the way the analysis is presented, it appears that the 33 environmental variables were essentially treated as independent data points (e.g. in Figure 4, Figure 5). It's not appropriate to treat the environmental variables independently because many of them are highly correlated. For example in Figure 4, many of the high similarity/CRA values tend to be categorized as temperature variables, which are likely to be highly correlated with each other. This seems like a type of pseudo replication and is a major weakness of the framework.

      This is a good point and we fully agree. It is for this reason that we didn’t present any p-values or statistical tests of the overall patterns that are shown in these figures (i.e. the linear relationship between SIPEC and number of CRAs in figure 4 and the tendency for most points to fall above the 1:1 line in figure 5). But to make sure this is even more clear, we have added statements to the captions of these figures to remind readers that points are non-independent. We still feel that in the absence of a formal test, the overall patterns are strongly consistent with this interpretation. A smaller number of non-pseudo-replicated points in Figure 4 would still likely show linear patterns. Similarly, there are almost no significant points falling below the 1:1 line in Figure 5, and it seems unlikely that pseudoreplication would generate this pattern.

      Below I highlight the main claims from the study and evaluate how well the results support the conclusions.

      "We find evidence of significant genome-wide repeatability in signatures of association to phenotypes and environments" (abstract)<br /> Given the questions above about SIPEC, I did not find this conclusion well supported with the way the data are presented in the manuscript.

      We have changed the reporting of the SIPEC metric so that it more clearly reflects whichever axis of phenotypic space is most strongly correlated with environment in both species (using max instead of mean). This shows similar qualitative patterns but illustrates that this happens across much higher values of SIPEC, showing that it is in fact driven by high correlations in each species (or non-similar correlations resulting in low values of SIPEC). While we agree about the pseudo-replication problem preventing formal statistical test of this hypothesis, the visual pattern is striking and seems unlikely to be an artefact, so we think this does still support this conclusion.

      "We find evidence of significant genome-wide repeatability in signatures of association to phenotypes and environments, which are particularly enriched within regions of the genome harbouring an inversion in one species. " (Abstract) And "increased repeatability found in regions of the genome that harbour inversions" (Discussion)<br /> These claims are supported by the data shown in Figure 4, which shows that haploblocks are enriched for WRAs. I want to clarify a point about the wording here, as my understanding of the analysis is that the authors test if haploblocks are enriched with WRAs, not whether WRAs are enriched for haploblocks. The wording of the abstract is claiming the latter, but I think what they tested was the former. Let me know if I'm missing something here.

      We are actually not interested in whether WRAs are enriched for haploblocks; we want to know if WRAs tend to occur more commonly within haploblocks than outside of them. We have tried to clarify that this is our aim in various places in the manuscript. Our analysis for Figure 5 is the one supporting these claims, and it uses the Chi-square test statistic to assess the number of WRAs and non-WRAs that fall within vs. outside of inversions, and a permutation test to assess the significance of this observation, for each environmental variable and phenotype. We don’t think that this test has any direction to it – it’s simply testing if there is non-random association between the levels of the two factors. Thus, we think the wording we have used is consistent with the test result and our aims. Perhaps the confusion arose from the two methods that we present in the Methods (one is used for Figure 5, the other for Figure S6C & D), so we have added clarifications there.

      Notwithstanding the concerns about highly correlated environments potentially inflating some of the patterns in the manuscript, to my knowledge this is the first attempt in the literature to try this kind of comparison, and the results does generally suggest that inversions are more likely capturing, rather than accumulating adaptive variation. However, I don't think the authors can claim that repeated signatures are enriched with haploblock regions, and the authors should take care to refrain from stating the relative importance of different regions of the genome to adaptation without an analysis.

      Actually, we don’t have a strong feeling about whether inversions are capturing vs. accumulating adaptive variation, as these results could be consistent with either. As described above, we do not understand why we can’t claim that repeated signatures are enriched within haploblocks. We thought the reviewer is perhaps referring to the fact that the points are pseudo-replicated in the figures due to environment? We note that a very large number of points are significantly different from random in terms of the distribution of WRAs within vs. outside of haploblocks (light- vs. dark-shaded symbols), and that almost all of them fall above the 1:1 line. While there may be pseudo-replication preventing a test of the bigger multi-environment/multi-species hypothesis across all phenotypes and environments, there is almost a complete lack of significant results in the other direction. This seems like quite strong evidence about enrichment of WRAs within haploblocks, across many environments/species contrasts. We have added some text to the description of patterns in figure 5 to try to clarify this.

      "While a large number of genomic regions show evidence of repeated adaptation, most of the strongest signatures of association still tend to be species-specific, indicating substantial genotypic redundancy for local adaptation in these species." (Abstract)<br /> Figure 3B certainly makes it look like there is very little similarity among species in the genetic basis of adaptation, which leaves the question as to how important the repeated signatures really are for adaptation if there are very few of them. (Is 3B for the whole genome or only that region?). This result seems to be at odds with the large number of CRAs and the claims about the importance of haploblock regions to adaptation, which extend from my previous point.

      Figure 3B is for the whole genome, we have added text to the figure caption to clarify this. We think that both interpretations are possible: that most of the regions of the genome that are driving adaptation are non-repeated, but that a small but significant proportion of regions driving adaptation are repeated above what would be expected at random. Thus, it seems that there is high redundancy, coupled with adaptation via some genes that seem particularly functionally important and non-redundant, and therefore repeated. We added clarifying text on lines 541-548.

      "we have shown evidence of significant repeatability in the basis of local adaptation (Figure 4, 5), but also an abundance of species-specific, non-repeated signatures (Figure 3)"<br /> While the claim is a solid one, I am left wondering how much of these genomes show repeated vs. non-repeated signatures, how much of these genomes have haploblocks, and how much overlap there really is. Finding a way to intuitively represent these unknowns would greatly strengthen the manuscript.

      We agree, and really struggled to find the best way to communicate both the repeated patterns and the large amount of non-repeated signatures. Unfortunately, we have more confidence in the validity of repeated patterns because for the non-repeated patterns, a strong signature of association to environment in only one species could just be the product of structureenvironment correlation, as we didn’t control for population structure. Thus, trying to quantify the proportion of non-repeated signatures is difficult to do with any accuracy and we preferred to avoid putting too much emphasis on the simple calculation of the proportion of top candidate windows that were also WRAs.

      Overall, I think the main claims from the study, the statistical framework, and the results could be revised to better support each other.

      Although the current version of the manuscript has some potential shortcomings with regards to the statistical approaches, and the impact of this paper in its present form could be stifled because the biology tended to get lost in the statistics, these shortcomings may be addressed by the authors.

      With some revisions, the framework and data could have a high impact and be of high utility to the community.

      Thank you for your very helpful comments and suggestions on our paper, we really appreciate it.

      Recommendations for the authors: please note that you control which revisions to undertake from the public reviews and recommendations for the authors

      Editor's comments:

      The reviewers make a series of reasonable suggestions that I echo. I found the paper quite hard to follow, and got fairly lost in the various layers of analyses done. Partially, this represents the complexity of empirical genomic data, which rarely deliver simple stories of convergence at a few genes. However, the properties of the various statistics used to detail local adaptation and convergence are not particularly clear and the figures presented were not intuitive representations of the data. This leaves the reader with an incomplete view of how much weight to put in the various lines of evidence marshaled. I would suggest simplifying the presentation of the results considerably. I add a few additional comments below.

      Great suggestion, we’ve added a schematic overview of the methods and main research questions to Figure S1 in the supplementary materials.

      A figure would help showing some of the signals of SNPs with putative signals of convergent environmental correlations across species, e.g. frequencies plotted against climate variables. This would help readers get a sense of how strong these signals were. These could be accompanied by the statistics calculated for these SNPs, that would allow the reader to start to get some intuitive sense of what the numbers mean.

      Great suggestion, we have added a schematic overview of the methods to Figure S1 that shows some of the values and illustrates how the methods work using visual examples from our data.

      In general, the introduction and some of the discussion of the inversion results feel oddly framed:<br /> Abstract line 36: "This shows that while inversions may facilitate local adaptation, at least some of the loci involved can still make substantial contributions without the benefit of recombination suppression."

      We have changed “some of the loci involved can still make substantial contributions without the benefit of recombination suppression” here to “some of the loci involved can still harbour mutations that make substantial contributions without the benefit of recombination suppression in species lacking a segregating inversion” as it hopefully clarifies that we’re not talking about individual alleles that are present in both species.

      Models of the role of local adaptation in the establishment of inversions (Kirkpatrick & Barton) assume that there are multiple locally adapted alleles already present. It is the load created by these alleles being constantly maintained in the face of migration and subsequent recombination that allow an inversion to be selected for because it keeps together locally adapted alleles. Thus these models predict that there could well be standing local adaptation at these loci in the absence of the inversion in other species, and that these locally adapted alleles while not fixed may be at high frequency. (After establishment, inversions housing locally adapted alleles, can shield more weakly, locally beneficial alleles from migration allow other alleles to build up.) Empirically it's interesting to find signals of local adaptation in other species that don't contain putative inversions. But the logic of the different predictions is not particularly clear from the introduction, and only becomes somewhat clearer in the discussion.

      Thank you for pointing out this murkiness, we have re-written portions of both the Introduction and Discussion to clarify this aspect.

      From the introduction: Inversions have been implicated in local adaptation in many species (Wellenreuther and Bernatchez 2018), likely due to their effect to suppress recombination among inverted and noninverted haplotypes, and thereby maintain LD among beneficial combinations of locally adapted alleles (Rieseberg 2001; Noor et al. 2001; Kirkpatrick and Barton 2006). This has been approached by models studying the establishment of inversions that capture combinations of locally adapted alleles present as standing variation (e.g., Kirkpatrick and Barton 2006), as well as models examining the accumulation of locally adapted mutations within inversions (e.g., Schaal et al. 2022). If there is variation in the density of loci that can potentially contribute to local adaptation, inversions would be expected to preferentially establish and be retained in regions harbouring a high density of such loci (and this expectation would hold for both the capture and accumulation models). We would also expect to see stronger signatures of repeated local adaptation in such high density regions. Despite mounting evidence of their importance in adaptation, it is unclear how inversions may covary with repeatability of adaptation among species. A fundamental parameter of importance in these models is the relationship between migration rate and strength of selection on individual alleles, which may not make persistent contributions to local adaptation without the suppressing effects of recombination if selection is too weak (Yeaman and Whitlock 2011; Bürger and Akerman 2011). If most alleles have small effects relative to migration rate and can only contribute to local adaptation via the benefit of the recombination-suppressing effect of an inversion, then we would expect little repeatability at the site of an inversion – other species lacking the inversion would not tend to use that same region for adaptation because selection would be too weak for alleles to persist. On the other hand, if some loci are particularly important for local adaptation and regularly yield mutations of large effect, with these patterns being conserved among species, repeatability within regions harbouring inversions may be substantial. Thus, studying whether adaptation at the same genomic region harbouring an inversion is observed in other species lacking the inversion can give insights about the underlying architecture of adaptation, and the evolution and maintenance of inversions.

      From the Discussion: The observed repeatability associated with inversions further supports the local adaptation model as an explanation for the long-term persistence of segregating inversions (at least in sunflowers, rather than mechanisms based on dominance or meiotic drive (Rieseberg 2001). If there is variation across the genome in the density of loci with the potential to be involved in local adaptation, then the establishment and maintenance of inversions would be biased towards regions harbouring a high density such loci under this model. If the genomic basis for local adaptation is conserved amongst species, then these same regions are more likely to have high repeatability. Thus, our observation of genomic regions harbouring inversions also being enriched for WRAs is consistent with this general model for inversion evolution. Unfortunately, our observations do not provide much insight into whether inversions evolve through the capture (e.g. Kirkpatrick and Barton 2006) or accumulation (e.g. Schaal et al. 2022) type of model, as either model would be consistent with our results. Most of the sunflower inversions are >1 My old, and therefore predate any current local adaptation patterns, but likely do not predate the genes underlying local adaptation (which appear to be shared among the species we studied). As for the alleles underlying local adaptation, they may be younger than the inversions, but as our work suggests, these regions are prone to harbouring locally adaptive alleles so it is possible that they also harboured other ancestral locally adaptive alleles.

      As a minor comment, there's a fair number of places where a more nuanced view of the field is needed, e.g.:<br /> "Models in evolutionary genetics tend to focus on extremes: population genetic approaches explore cases where strong selection deterministically drives a change in allele frequency" --This seems like a strange strawman. Population genetic models span a huge parameter range. The empirical approaches of looking for sweeps by detecting genome-wide statistical outliers is predicated on strong selection, but there are numerous papers that have looked for signals of weak selection genome-wide.

      Good point, we have changed our wording here.

      Reviewer #1 (Recommendations For The Authors):

      Comments

      My main comment on the manuscript is that the different levels and diversity of analyses are slightly hard to follow on the first, and even second, read. As there are several layers of correlations and comparisons, as well as some independent analyses, I wonder if it might be helpful to have a summary schematic figure of how all analyses fit together.

      Great idea, we have added Figure S1 that summarizes the main flow of the methods and research questions.

      • L169-171: Would it be more accurate to say that SIPEC is maximized when both species have strong correlations for an environmental variable across the same phenotypes? But maybe I misunderstood the index.

      Good point, we have now simplified SIPEC, reporting the max instead of the mean, which we think better reflects when similar patterns are happening in both species for some phenotype.

      • L191: Given the discussion in the introduction and elsewhere about the correction for population structure, which version is used here? Same for Figure 3.

      We have added clarification there.

      • L348: One [environmental] variable?

      Added

      • L353: Maybe add a percentage indication for 387 so that it is comparable to the following 23.3%.

      Good point, added

      -> L388 and paragraph: You mention "significant repeatability" but it is hard from the results at this point to have a broad idea of the amount of signal that is repeatable. Would it be possible to add here some quantitative measure of the proportion of signal repeatable or not, even if approximated?

      I wish we could, but I think the precision implied by such an approximation would involve a huge amount of uncertainty and likely inaccuracy. Because it is so hard to conclusively identify how many loci are significant but non-repeated, we really don’t have a good handle on the denominator here. We are pretty confident that the repeated loci are strongly enriched for true positives, but the non-repeated loci are also almost certainly strongly enriched for false positives. While we really want to be able to quantify this explicitly, we don’t think it’s possible given our data.

      -L415-418: "If there is variation [...] involved in local adaptation", I do not follow this argument, could you rephrase?

      Changed

      -L447-450: As you say in the supplementary methods, your analyses exclude 3/4 of the genome. Do you think this choice has a large impact on the number of outliers observed here as the genome-wide baseline would change?

      This is a very good question, but one that is quite complex and without a clear answer – we chose not to delve into it in the paper to keep the discussion streamlined. My (SY) feeling is that it is unlikely that regions harbouring transposable elements would contribute much to adaptation, but I think we really don’t know if that is true. Even excluding ¾ of the genome harbouring TEs, ¼ of the genome still constitutes a huge amount of sequence and a very large number of genes and it seems plausible that most genes and genic regions would not contribute to adaptation for a given trait, so I don’t think this would change the results too much in a qualitative way – but would almost certainly change the number of windows that are significant, etc.

      • L455-457: "As we are unable [...] potentially important drivers" Could you provide the logical link here between loci of small effect and them being important drivers. I presume you mean that the large effect loci found here only account for a small proportion of the heritability?

      Yes that’s what we meant here, so we’ve added some clarification.

      • L482: "enriched within inversions" should that be 'in genomic regions where there exist inversions in at least one species'? Thanks for catching that, yes. Changed.

      • Methods/SIPEC L512: Compared to the Results section it is unclear here what is referred to as an "environment" Is it a variable or a set of environment variables?

      This is done per environmental variable.

      I find the presence of the PCA for environment variables in Figure 2 misleading as my first interpretation was that PCs for environment were also used.

      Good point, we have clarified this on line 190-193.

      Maybe one potential addition to the formula would be to add an environment variable $j$ notation such that it reads "$SIPEC_j = \sum_i (|r_{ij,1}| + ...) ...$ where ... between environment variable $j$". I had initial difficulties to understand how this SIPEC was computed relating to environmental variables and this might help.

      Given the other changes we made to SIPEC, we felt it was simpler to just present it as a single calculation on a given combination of phenotype and environment for a pair of species, and then discuss taking the mean and maximum of this later.

      Finally, PCA axes explaining 95% of the variance are used, I would find it interesting to see how many PCs are used in comparison to the number of traits being measured.

      We have added the following sentence to the methods describing this:

      "For comparisons including H. argophyllus, 95% of the variance was typically explained by 8-10 PC axes (out of 28 or 29 phenotypes), whereas for comparisons among other taxa this included 21 or 22 PC axes (out of 65 or 66 phenotypes."

      Typos

      L52: --

      Changed

      L254: portions [of] their

      Changed

      L399: additional closing parenthesis

      Changed

      L458: signatures [of] repeated association

      Changed

      L554: performed [on]

      Changed

      L578: 5 ~~kp~~/kb windows

      Changed

      L601: ~~casual~~/causal SNPs

      Changed

      L615: ~~widow~~/window

      Changed

      L732: ~~Banding~~/Banting Postdoctoral Fellowship

      Changed

      L1002 & L960: [Supplementary] Figure

      Changed

      Supplementary: Some figure titles are in bold and others are not.

      Changed

      Reviewer #2 (Recommendations For The Authors):

      Overall I found the writing to be very clear and easy to follow. Despite my comments, it was clear that a lot of thought went into how to conduct the tests and visualize the results. I recommend ending the Discussion on a positive note, rather than an impossible test.

      Thanks for the positive suggestion, we have done this.

      In Figure 5, is the temperature variable missing in the legend and in the plot?

      No, for this plot we just combined the temperature/precipitation variables into one variable called “climate”.

    1. Author Response

      The following is the authors’ response to the original reviews.

      Reviewer #1 (Public Review):

      The first major issue is related to the imaging and tracking experiment to examine the formation and migration of F-actin foci as illustrated in figure 3. The formation and centripetally migration of F-actin foci is a significant finding of this MS for the promotion of B cells to switch from spreading to contraction response. Thus, I may suggest to recommend the authors to conduct one more rigorous fluorescent molecular tracking experiment to confirm this phenomenon. Molecular tracking usually requires low labeling density, and the lifeact-GFP labeling here do not meet this requirement which may cause misidentification of the moving molecules. Permeable dye-based fluorescent speckle microscopy is recommended here to track the actin foci if applicable (P. Risteski, Nat. Rev. Mol. Cell Biol., 2023, DOI: 10.1038/s41580-023-00588w & K. Hu, et al, Science, 2007, 315, 111-115).

      We thank the reviewer for the suggestion. We conducted the suggested experiment using membrane-permeable SiR-actin to track B-cell actin dynamics. Unfortunately, two significant issues prevented us from confirming the LifeAct-GFP results using fluorescent speckle microscopy. First, the concentration of SiR-actin required to visualize F-actin in the contact zone of mouse primary B-cells was relatively high due to their smaller sizes (~6 µm diameter) and non-adherent nature. With such a relatively high concentration of SiR-actin, we could not perform fluorescent speckle microscopy. Second, we observed that SiR-actin appeared to stabilize actin structures and reduce actin dynamics, further limiting its use in studying actin dynamics in B-cells.

      Additionally, kymograph is used for foci tracking in figure3 and figure4. Kymograph is indeed a powerful tool for tracking cell protrusion and retraction but is not fairly suitable here, since a Factin focus is a concentrated point which may not move strictly along the selected eight lines generating kymograph. Other imaging processing method should be used to track the foci, for example, time series max projection is recommended if applicable.

      We thank the reviewer for the suggestion and have tried the time series max projection. Unfortunately, it did not provide the resolution to identify individual actin foci, again probably due to the small size of primary mouse B-cells. While kymographs may not track the entire paths of these moving foci, we believe that the conclusions drawn from the kymography analysis in Figure 3 and 4 are reasonable. We generated eight kymographs for each cell in Figure 3 and three kymographs for each cell in Figure 4 to follow as many actin foci as possible within the spreading to contraction transition time window. Our analysis in Figure 3 identifies the fraction of actin foci originating from lamellipodia. In Figure 4, we used the kymographs to trace the path of putative clusters and used these to calculate their relative lifetimes and speed. While this is not what was suggested by the reviewer, our analysis provides qualitatively similar information to the time series max projection and reasonable comparisons between contracted and noncontracted cells, inhibitor-treated and untreated cells, and wild-type and WASP KO cells.

      The second major issue is about the relationship between actin foci formation and NMII recruitment in figure 5. The author concludes that 'N-WASP and Arp2/3 mediated branched actin polymerization promotes the recruitment and the reorganization of NMII ring-like structures by generating inner F-actin foci in the contact zone'. However, there is a lack of strong evidence to directly show the mechanism by which myosin is recruited and the up and down stream relationship between actin foci migration and myosin recruitment. Since myosin-induced actin retrograde flow is a classical model in adherent cells, is it possible that, here also in activated B cells, the recruited myosin driven the formation and migration of actin foci? This reviewer may recommend the author to investigate whether Myosin blocking (e.g., using Y27632) can eliminate the F-actin foci formation and migration.

      This is an excellent suggestion! In the revised manuscript, we have included new data showing that treatment with the non-muscle myosin II motor inhibitor blebbistatin, which is known to inhibit B-cell contraction but not spreading on Fab’-PLB (Seeley-Fallen et al. 2022. Frontiers in Immunology), interferes with the formation of inner actin foci ring-like structures, which are associated with B-cell contraction. These results together suggest that the generation of inner actin foci ring-like structure depends on the coordination between N-WASP-mediated actin polymerization and myosin contractile activity. We chose to use blebbistatin rather than Y27632 to inhibit non-muscle myosin II because in addition to the ROCK pathway, myosin light chain kinase can also activate myosin II, and Y27632 may have additional effects besides inhibiting myosin activity. The new data are shown in Figure 5G and H and discussed in the revised manuscript.

      Reviewer #2 (Public Review):

      Weaknesses: Minor as listed below. The working hypothesis of molecular crowding as a way to push out signalling molecules from the BCR dense foci is interesting. The authors provide evidence for that this is an active process mediated by N-WASP - Arp2/3 induced actin foci. Another possibility is that BCR dense foci formation is an indirect consequence of lamellipodia retraction. Future works should define the specific role of N-WASP, Arp2/3 and actin in the process to form BCR dense foci, especially as the BCR continue to signal in the cytoplasm.

      We thank the reviewer for the comments. We have included the possibility that lamellipodial retraction may be involved in increasing the molecular density of BCR clusters and suggested future studies on the potential roles of N-WASP-dependent inner actin foci and actomyosin structures in BCR internalization and intracellular signaling in the Discussion section.

      Reviewer #3 (Public Review):

      The author prove their claims by mean of thorough image analysis, mainly observing and quantifying the fluorescence and the dynamics of single clusters of antigen and actin foci and analyzing two-colors dynamical images. They perform their observation in control cells, on pharmacologically perturbed cells where the action of Arp2/3 or N-WASP is inhibited, and on modified primary cells (primary derived from genetically engineered mice) to silence N-WASP or WASP. The work is sound and complete, the experiments technically excellent and well explained. Some experiments and discussions are objectively harder to describe, and given the length of the work, the reader might find itself lost some times. A graphical abstract/summary of the main way N-WASP ultimately control signal attenuation would solve this minor point.

      We greatly appreciate the reviewer’s confirmation of our data quality and are delighted to accept the reviewer’s suggestion. In the revised manuscript, we have included a new figure (Figure 10) in the Discussion section, summarizing the results presented in the manuscript as a working model.

      Reviewer #1 (Recommendations For The Authors):

      Some minor points: Figure 1C, E, G and I shows three individual symbols, indicating three independent experiments described in legend. Please double check for accuracy.

      It is better to show statistical data with representative repeat, not the merged means of independent experiments. For example, figure 1C even indicates three "0" data in CK-666 treated cells, meaning no contracting cell was found in ~75 cells, while there are other repeats showing 45% - 50% contracting cells. This applies to all figures involving individual cell imaging data, such as figure 2D, in which 30 cells from three independent experiments were pooled. The authors shall clearly state that those independent experiments are statistically indistinguishable before pooling the data.

      We agree with the reviewer’s comments that these data have variability from individual mice, the quality of isolated primary B-cells, and the lateral mobility of planar lipid bilayers. To show the variability, we displayed the data from each experiment as individual data points. In the revised manuscript, we have utilized three colors of dots to represent three independent experiments in Figure 1C, E, G, and I, Figure 2B-G, and new Figure 5H, which show that the data from the three experiments have the same trend despite the variability.

      In figure 7B-C, figure 8 and figure 9. The significant test results were hard to understand in which groups they compared. Please describe it in more detail in the figure legend or the method section.

      In the legend, the authors claimed blue points in Figure 7B represented individual pCD79a clusters within an equal number of BCR clusters from each time points. The authors used means to qualify the change of blue points distribution. These shall be clearly stated in the Methods. Total BCR cluster numbers shall be shown also. This applies to Figure 7B, 7C, 7D and all figures in figure 8 and figure 9.

      We thank the reviewer for pointing it out. We have revised Figures 7-9, where we utilized square braces to indicate groups of clusters (blue points) being compared. We have also provided additional information in the figure legend and Method sections.

      Reviewer #2 (Recommendations For The Authors):

      199-200: What is the consequence of increased WASP activation in N-WASP knockout B cells? Is this evaluated as increased pWASP activity and/or increased actin polymerization of WASP knockout B cells. Does WASP and N-WASP have an additive or counteractive effect on each other during spreading and contraction?

      Indeed, the relationship between WASP and N-WASP, which are co-expressed in B-cells and other immune cells, is fascinating. Our previous studies, using WASP germline knockout, B-cellspecific N-WASP knockout, WASP and N-WASP double knockout mice, showed that WASP and N-WASP have both additive and counteractive effects during B-cell spreading, but B-cell contraction only depends on N-WASP (Liu et al. 2013. PLoS Biol). Double knockout B-cells fail to spread, and WASP knockout B-cells show reduced spreading but still contract, showing their additive effects. However, WASP and N-WASP suppress each other for activation, as detected by their phosphorylation. Phosphorylated WASP increases in the B-cell contact zone first, and phosphorylated N-WASP increases later when the phosphorylated WASP level decreases. Knocking out one of them enhances the phosphorylation of the other. Consequently, N-WASP knockout B-cells show increased spreading, probably due to enhanced activation of WASP, but exhibit delayed contraction. The revised manuscript has expanded the discussion on this area to relate it to the results presented in this manuscript.

      560-563: Was Syk and SHIP-1 measured in the same cell? If not, the conclusion should be tempered.

      Unfortunately, antibodies specific for Syk and SHIP-1 were from the same host, which did not allow us to stain them in the same cells. The revised manuscript has discussed this as a shortcoming of our work.

      1204-1205: Explain better "three randomly positioned kymographs were generated" - how were they selected?

      We apologize for this unclear sentence. The three kymographs were positioned to track as many inner F-actin foci as possible.

      328: Change "abolished" to "reduced" to describe the data. 354-356: Unclear sentence, please edit. 1171: (H) should be (G). 1325: "PI" should be "FI".

      We thank the reviewer for finding these typos and unclear sentences. We have made the corrections accordingly.

      Methods: The description of the TIRF microscopy method is good. Regarding the image analysis, it is somehow difficult to have a good understanding of what was analyzed just by reading the text. Please show an example of the pipeline for the analysis from a raw image and the processing steps.

      Figure 6-figure supplement 2 shows the image analysis process for tracking Fab’ clusters. We utilized the same approach for the image analysis of Figures 7-9.

      Discussion: Add a paragraph to state the limitations of the study. How do the findings here translate into in vivo activation of B cells and how can this be addressed based on the data presented in this study.

      We thank the reviewer for the suggestion. In several paragraphs of the revised Discussion section, we have brought up the limitations of the study and how these limitations affect the data interpretation. In addition, we have added Figure 10 and the associated text to present our working model, which explains how our findings reveal the cellular mechanism by which BCR surface signaling amplification transitions into attenuation, likely occurring in vivo.

      Figure 2: Add an example of the image analysis for foci determination. From the images, it is not always clear what is a foci and what is not which makes the "number of foci" data difficult to evaluate.

      We have added arrows to Figure 2A to indicate all identified inner F-actin foci in images.

      Figure 3: add a kymograph for the WKO analysis.

      In the revised Figure 4, we have provided a kymograph of a WKO B cell.

      Figure 4M: the analysis of the "relative speed" of the "WT" samples is lower compared to the other control samples "DMSO" and "CK-689". The conclusion is that WKO have similar "relative speed" as "WT" cells, but in fact the "WT" cells may have responded poorly in this experiment. What is the author's experience and explanation?

      We agree that the relative speeds of inner actin foci in the contact zone of WT and WKO B-cells are relatively low compared to DMSO and CK-689. Based on our experience, this parameter is very sensitive to the lateral mobility of planar lipid bilayers. We could only perform one pair of conditions using live cell images each time. The WT and WKO experiments were done at the end and might use relatively aged liposomes. However, it did not affect the number of inner actin foci formed and their relative lifetime, consistent with their similar relative speeds. Unfortunately, we lost the LifeAct-GFP-expressing WKO mouse colony and cannot redo this experiment using freshly made liposomes within a reasonable time.

      Figure 7B-D: Add a more detailed legend for the black and brown lines in the dot plots.

      We have expanded the legend for Figure 7B-D to provide additional details.

      Figure 8-9: Show representative images for SYK, pSYK, SHIP-1 and pSHIP-1. Add a more detailed legend for the black and brown lines in the dot plots.

      We have provided representative images for Syk, pSyk, SHIP-1, and pSHIP-1 in revised Figure 8 and 9.

      Reviewer #3 (Recommendations For The Authors):

      From the paper one understands that NMII is recruited by the actin foci and this recruitment pushes the foci towards the center of the synapse, in what resembles a positive feedback. Could the authors better elucidate this point? What happen at the peak of NMII recruitment? Could this be a mechanism used by the cell to end the contact and detach (which probably cannot be observed in this experimental setup)?

      This is an excellent comment! We have recently shown that NMIIA recruitment peaks right before B-cell contraction occurs, and inhibition of NMII by inhibitors or B-cell conditional knockout blocks B-cell contraction and enhances signaling (Seeley-Fallen et al. 2022. Frontiers in Immunology). In the revised manuscript, we have included new data showing that treatment with the NMII motor inhibitor blebbistatin, which is known to inhibit B-cell contraction but not spreading on Fab’-PLB (Seeley-Fallen et al. 2022. Frontiers in Immunology), interferes with the formation of inner actin foci associated with B-cell contraction. These results together suggest that the generation of inner actin foci depends on the coordination between N-WASP-activated actin polymerization and myosin contractile activity, supporting the reviewer’s comment. The new data are shown in Figure 5G and H and discussed in the revised manuscript.

      Whether the recruited NMII pulls B-cells away from antigen-presenting surfaces remains an interesting question. We have previously shown that high-affinity interaction of surface BCRs with membrane-anchored antigen can cause NMII-dependent B-cell membrane permeabilization, which triggers lysosome exocytosis and lysosomal enzyme-mediated antigen cleavage, allowing antigen internalization and presentation to T-cells (Maeda et al. 2021. eLife). Furthermore, NMII is required for B cells to internalize surface antigens (Natkanski et al. 2013. Science). These results support the possibility that actomyosin structures formed during B-cell contraction may further drive B-cells to internalize antigen. We have discussed this interesting point in the revised manuscript.

      Some experiments/quantification are a bit more complex than others and a reader might find hard to follow them (in particular figs 7,8 and 9). The comprehension could be improved by providing a guide to read them. E.g. it is not clear what the population distribution represents (and it is not particularly affected by any manipulation. How were the group for test chosen? It seems they are based on intensity categories taken every 100 units: is it the case? even if arbitrary, this should be stated it in the legend.

      We thank the reviewer for understanding the complexity of image analysis and pointing out the unclear points. Based on the reviewer’s comments, we have revised Figures 7-9 and the figure legend. We utilized square brackets to indicate groups of clusters (blue points) being compared. The comparison groups were chosen arbitrarily based on Fab’ peak fluorescence intensity every 90 units for Figure 7 and 8 and every 100 units for Figure 9.

      Can the author speculate on how the actin organization passes from actin foci to recruitment of NMII and arc formation? Is it a rearrangement of the actin network (percolation) or simply recruitment of monomers?

      Our previous and new results show that both N-WASP-activated Arp2/3 and NMII are required to form inner F-actin foci. Based on these results, we speculate that N-WASP and Arp2/3mediated actin polymerization may initiate the process and recruit NMII, and recruited NMII coordinates with actin polymerization to reorganize actin structures, promoting inner actin foci maturation and arc formation. We have included these possibilities in the revised discussion.

      The role of SHIP recruitment as way to inhibit the signal downstream of the BCR is an interesting finding. Is this related to the termination of the synapse? Could we relate the time scales (accurately measured in this work) to contact times observed in vivo?

      The reviewer raises an interesting question. In the discussion section, we have speculated that the actomyosin structures responsible for B-cell contraction are potentially the precursor cytoskeleton structures for antigen internalization. However, the relationship of B-cell contraction and signaling attenuation with the termination of the synapse remains unclear.

      The BCR has been shown to be internalised mechanically: do these new data suggest a mechanisms for force generation in antigen internalization at the actin foci? Related to that, how do the dynamics of N-WASP recruitment relate to the force measurement highlighted in Traction Force Microscopy experiments (see for example Wang Sci.Signal. 2018, Kumari Nat.Comm.2019)? What happens in situation when the actin foci are unable to get transported, e.g. as on the more classical antigen on coverslip configuration?

      Indeed, our results allow us to speculate that the actomyosin structures responsible for B-cell contraction potentially contribute to antigen internalization by mechanical forces. We previously showed that the B-cell-specific N-WASP knockout drastically reduced BCR internalization of soluble antigen (Liu et al. 2013. PLoS Biol), and that NMII is required for BCR internalization of membrane-associated antigen (Maeda et al. 2021. eLife and Natkanski et al. 2013. Science). The effect of N-WASP knockout on the internalization of membrane-associated antigen and traction forces generated at the contact membrane and whether traction forces are generated from the inner F-actin foci have not been determined but will be pursued in the future.

      Our previous publication compared the BCR and actin dynamics of B-cells interacting with Fab’ tethered to planer lipid bilayers (Fab’-PLB) and cover glass (Fab’-G) (Ketchum et al. 2014. Biophys J). B-cells interacting with Fab’-G do not contract and generate inner F-actin foci and exhibit less dynamic BCR clusters and actin cytoskeleton than B-cells interacting with Fab’-PLB. Actin foci remain coincident with Fab’ clusters on glass rather than being positioned behind Fab’ clusters on PLB, thus driving their centripetal movement.

      Minor remarks: When several experiments (mice) are presented in dot plots (e.g. fig 2D-G 4J-M), color dot plot (so called "smart plot") where each experiment is identified by a color, could be used to highlight the sample-to-sample variability.

      This is an excellent suggestion. In the revised manuscript, we have utilized three shades of dots to represent the data points from three independent experiments.

      Fig 6A: the fluorophore should be indicated in the picture (Fab'-AF546)

      The suggested correction has been made.

      Fig 6D: how is the contraction phase (purple rectangle) determined? Curve by curve or on the average curve? Please specify this in the legend.

      The contraction phase (purple rectangle) was determined using the average curve of the contact area by IRM over time. We have added this sentence to the revised figure legend.

      Minor typos in the material and methods: in some case C56BL/6 is written instead of C57BL/6 Corrected.

    1. Author Response

      Public Reviews:

      Reviewer #1 (Public Review):

      Summary:

      The investigators sought to determine whether Marco regulates the levels of aldosterone by limiting uptake of its parent molecule cholesterol in the adrenal gland. Instead, they identify an unexpected role for Marco on alveolar macrophages in lowering the levels of angiotensin-converting enzyme in the lung. This suggests an unexpected role of alveolar macrophages and lung ACE in the production of aldosterone.

      Strengths:

      The investigators suggest an unexpected role for ACE in the lung in the regulation of systemic aldosterone levels. The investigators suggest important sex-related differences in the regulation of aldosterone by alveolar macrophages and ACE in the lung. Studies to exclude a role for Marco in the adrenal gland are strong, suggesting an extra-adrenal source for the excess Marco observed in male Marco knockout mice.

      Weaknesses:

      While the investigators have identified important sex differences in the regulation of extrapulmonary ACE in the regulation of aldosterone levels, the mechanisms underlying these differences are not explored. The physiologic impact of the increased aldosterone levels observed in Marco -/- male mice on blood pressure or response to injury is not clear. The intracellular signaling mechanism linking lung macrophage levels with the expression of ACE in the lung is not supported by direct evidence.

      Reviewer #2 (Public Review):

      Summary:

      Tissue-resident macrophages are more and more thought to exert key homeostatic functions and contribute to physiological responses. In the report of O'Brien and Colleagues, the idea that the macrophage-expressed scavenger receptor MARCO could regulate adrenal corticosteroid output at steady-state was explored. The authors found that male MARCO-deficient mice exhibited higher plasma aldosterone levels and higher lung ACE expression as compared to wild-type mice, while the availability of cholesterol and the machinery required to produce aldosterone in the adrenal gland were not affected by MARCO deficiency. The authors take these data to conclude that MARCO in alveolar macrophages can negatively regulate ACE expression and aldosterone production at steady-state and that MARCO-deficient mice suffer from secondary hyperaldosteronism.

      Strengths:

      If properly demonstrated and validated, the fact that tissue-resident macrophages can exert physiological functions and influence endocrine systems would be highly significant and could be amenable to novel therapies.

      Weaknesses:

      The data provided by the authors currently do not support the major claim of the authors that alveolar macrophages, via MARCO, are involved in the regulation of a hormonal output in vivo at steady-state. At this point, there are two interesting but descriptive observations in male, but not female, MARCO-deficient animals, and overall, the study lacks key controls and validation experiments, as detailed below.

      Major weaknesses:

      1) According to the reviewer's own experience, the comparison between C57BL/6J wild-type mice and knock-out mice for which precise information about the genetic background and the history of breedings and crossings is lacking, can lead to misinterpretations of the results obtained. Hence, MARCO-deficient mice should be compared with true littermate controls.

      2) The use of mice globally deficient for MARCO combined with the fact that alveolar macrophages produce high levels of MARCO is not sufficient to prove that the phenotype observed is linked to alveolar macrophage-expressed MARCO (see below for suggestions of experiments).

      3) If the hypothesis of the authors is correct, then additional read-outs could be performed to reinforce their claims: levels of Angiotensin I would be lower in MARCO-deficient mice, levels of Antiotensin II would be higher in MARCO-deficient mice, Arterial blood pressure would be higher in MARCO-deficient mice, natremia would be higher in MARCO-deficient mice, while kaliemia would be lower in MARCO-deficient mice. In addition, co-culture experiments between MARCO-sufficient or deficient alveolar macrophages and lung endothelial cells, combined with the assessment of ACE expression, would allow the authors to evaluate whether the AM-expressed MARCO can directly regulate ACE expression.

      Recommendations for the authors: please note that you control which revisions to undertake from the public reviews and recommendations for the authors

      Reviewer #1 (Recommendations For The Authors):

      1. Corticosterone levels in male Marco -/- mice are not significantly different, but there is (by eye) substantially more variability in the knockout compared to the wild type. A power analysis should be performed to determine the number of mice needed to detect a similar % difference in corticosterone to the difference observed in aldosterone between male Marco knockout and wild-type mice. If necessary the experiments should be repeated with an adequately powered cohort.

      We thank the reviewer for their comments. We are prepared to carry out these power calculations and repeat the experiment if necessary.

      1. All of the data throughout the MS (particularly data in the lung) should be presented in male and female mice. For example, the induction of ACE in the lungs of Marco-/- female mice should be absent. Similar concerns relate to the dexamethasone suppression studies. Also would be useful if the single cell data could be examined by sex--should be possible even post hoc using Xist etc.

      We are prepared to measure the levels of Ace, biosynthetic enzyme expression in female mice by qPCR, and ACE protein expression by IF. Additionally, we will test females using the dexamethasone suppression study. The single cell RNA seq analysis was used primarily to inform our model, not for experimental readout. We will explore the dataset as the reviewer suggests and will add additional plots if the analysis substantively changes our previous findings.

      1. IF is notoriously unreliable in the lung, which has high levels of autofluorescence. This is the only method used to show ACE levels are increased in the absence of Marco. Orthogonal methods (e.g. immunoblots of flow-sorted cells, or ideally CITE-seq that includes both male and female mice) should be used.

      We have negative controls for antibody staining. Additionally, we also used qPCR to show an increase in Ace mRNA expression in the lung.

      1. Given the central importance of ACE staining to the conclusions, validation of the antibody should be included in the supplement.

      The vendor of this antibody has verified by cell treatment to ensure that the antibody binds to the antigen stated .We are prepared to additionally validate the antibody using other tissues as control, though we point out that ACE is expressed, albeit at lower levels, in endothelial cells throughout the body and so some signal is to be expected in most if not all tissues.

      1. The link between alveolar macrophage Marco and ACE is poorly explored.

      We are prepared do co-culture experiments of alveolar macrophages and endothelial cells and measure ACE/Ace expression as a consequence.

      1. Mechanisms explaining the substantial sex difference in the primary outcome are not explored.

      We argue that this would be outside the scope if this project, though we would consider exploring such experiments in future studies.

      1. Are there physiologic consequences either in homeostasis or under stress to the increased aldosterone (or lung ACE levels) observed in Marco-/- male mice?

      We are prepared to measure blood electrolytes and blood pressure in Marco-deficient and Marco-sufficient mice.

      Reviewer #2 (Recommendations For The Authors):

      Below is a suggestion of important control or validation experiments to be performed in order to support the authors' claims.

      1) It is imperative to validate that the phenotype observed in MARCO-deficient mice is indeed caused by the deficiency in MARCO. To this end, littermate mice issued from the crossing between heterozygous MARCO +/- mice should be compared to each other. C57BL/6J mice can first be crossed with MARCO-deficient mice in F0, and F1 heterozygous MARCO +/- mice should be crossed together to produce F2 MARCO +/+, MARCO +/- and MARCO -/- littermate mice that can be used for experiments.

      We thank the reviewer for their comments. We recognise the concern of the reviewer but due to limited experimenter availability we are unable to undertake such a breeding programme to address this particular concern.

      2) The use of mice in which AM, but not other cells, lack MARCO expression would demonstrate that the effect is indeed linked to AM. To this end, AM-deficient Csf2rb-deficient mice could be adoptively transferred with MARCO-deficient AM. In addition, the phenotype of MARCO-deficient mice should be restored by the adoptive transfer of wild-type, MARCO-expressing AM. Alternatively, bone marrow chimeras in which only the hematopoietic compartment is deficient in MARCO would be another option, albeit less specific for AM.

      We recognise the concern of the reviewer. We have access to an AM cell line which we plan to use to do co-culture experiments with an ACE-expressing endothelial cell line. In this way we will test whether this effect is linked to AMs.

      3) If the hypothesis of the authors is correct, then additional read-outs could be performed to reinforce their claims: levels of Angiotensin I would be lower in MARCO-deficient mice, levels of Antiotensin II would be higher in MARCO-deficient mice, Arterial blood pressure would be higher in MARCO-deficient mice, natremia would be higher in MARCO-deficient mice, while kaliemia would be lower in MARCO-deficient mice. Similar read-outs could also be performed in the models proposed in point 2).

      We are prepared to measure blood electrolytes and blood pressure (via tail cuff method) in Marco-deficient and Marco-sufficient mice.

      4) Co-culture experiments between MARCO-sufficient or deficient alveolar macrophages and lung endothelial cells, combined with the assessment of ACE expression, would allow the authors to evaluate whether the AM-expressed MARCO can directly regulate ACE expression.

      To address this concern, we plan to do a co-culture experiment as outlined above.

      Broadly, we thank the reviewers for taking the time to critically appraise this manuscript. The reviewers primary concern seems to be the lack of direct evidence of an effect of AMs on endothelial Ace expresion, which we plan to address as outlined above. We will adjust our conclusions as appropriate based on the results of the experiments outlined above.

    1. Author Response

      The following is the authors’ response to the previous reviews.

      Our comments on the initial eLife assessment

      “This study presents a useful inventory of the joint effects of genetic and environmental factors on psychotic-like experiences, and identifies cognitive ability as a potential underlying mediating pathway. The data were analyzed using solid and validated methodology based on a large, multi-center dataset. The claim that these findings are of relevance to psychosis risk and have implications for policy changes are partially supported by the results”

      We sincerely appreciate the editor and reviewers for their valuable feedback and their willingness to accommodate our perspectives in the first revision. In this revision, the comments from the reviewers have allowed us to further improve our manuscript. Regarding the eLife assessment, we would like to discuss two points.

      Firstly, regarding your point of our “findings are of relevance to psychosis risk…partially supported…”, we want to address that our study is closely related to psychosis risk. Childhood psychotic-like experiences (PLEs) are closely linked to psychotic risk and have been shown to increase the risk of general psychopathology, as mentioned in our Introduction and Discussion.

      The reviewers asked for clearer differentiation between PLEs and schizophrenia, which we incorporated in this revision (line 100~111; line 419~430). So, this revised version now clearly points out that findings are relevant primarily to psychosis risk, and only partially relevant to schizophrenia risk.

      Secondly, regarding “…implications for policy changes are partially supported…”, we have revised our study’s social contribution more clearly and specifically. Incorporating the comments, we have revised that our study offers an insight to the future studies by showing the importance of integrative approaches, considering multi-factorial neurocognition and psychopathology ranging from genes to environment (line 503~512), rather than offers direct policy implications.

      Our collaboration with eLife and the reviewers has proven satisfactory and enriching. The community, coupled with the innovative system and culture established around eLife, has significantly advanced the progression of scientific research. We are privileged to contribute to this endeavor.

      Recommendations for the authors:

      Reviewer #1 (Recommendations For The Authors):

      I am happy with the revisions provided by the authors and I think most of my concerns have been addressed satisfactorily. One remaining concern is the authors' conflation of PLEs and schizophrenia. They stated, for example, that it is necessary to adjust for schizophrenia PGS. Even though studies have found a statistical relationship between schizophrenia PGS and PLEs, this relationship is not very strong (although statistically significant) and other studies have found no relationship. Similarly, having PLEs increases the risk of developing psychosis, but that does not necessarily mean that this risk is substantial or specific. I think this needs more nuance in the manuscript and the term 'schizophrenia' should be used sparsely and very carefully as the paper has focused on PLEs. Otherwise, great work on the revisions, thank you.

      Thank you for your comment on the use of PLEs and schizophrenia. We clearly understand the differences between the two and we made relevant corrections throughout the manuscript. In particular, we added that PLEs are not a direct predictor of schizophrenia and corrected any expressions that may imply that PLEs are closely related to schizophrenia in the Introduction.

      “Psychotic-like experiences (PLEs), which are prevalent in childhood, indicate the risk of psychosis (van der Steen et al., 2019; Van Os & Reininghaus, 2016). Although they are not a direct precursor of schizophrenia, children reporting PLEs in ages of 9-11 years are at higher risk of psychotic disorders in adulthood (Kelleher & Cannon, 2011; Poulton et al., 2000). PLEs also point towards the potential for other psychopathologies including mood, anxiety, and substance disorders (van der Steen et al., 2019), are linked to deficits in cognitive intelligence (Cannon et al., 2002; Kelleher & Cannon, 2011) and show a stronger association with environmental risk factors during childhood than other internalizing/externalizing symptoms (Karcher, Schiffman, et al., 2021).

      Maladaptive cognitive intelligence may act as a mediator for the effects of genetic and environmental risks on the manifestation of psychotic symptoms (Cannon et al., 2000; Keefe et al., 2006; Reichenberg et al., 2005).” (line 100~111)

      We also revised any expressions that could be perceived as implying relevance to schizophrenia in the Discussion. “Prior research identifying the mediation of cognitive intelligence focused on either genetic (Karcher, Paul, et al., 2021) or environmental factors (Lewis et al., 2020) alone. Studies with older clinical samples have shown that cognitive deficit may be a precursor for the onset of psychotic disorders (Eastvold et al., 2007; Fett et al., 2020; Vorstman et al., 2015). Our study advances this by demonstrating the integrated effects of genetic and environmental factors on PLEs through the cognitive intelligence in 9-11 years old children. Such comprehensive analysis contributes to assessing the relative importance of various factors influencing children's cognition and mental health, and it can aid future studies designed for identifying health policy implications. Considering the directions and magnitudes of the effects, though the effects of PGS remain significant, aggregated effects of environmental factors account for much greater degrees on PLEs.” (line 419~430)

      Reviewer #2 (Recommendations For The Authors):

      I thank the authors for addressing most of my comments. I feel the manuscript has already greatly improved.

      I have a few more comments.

      1) Although I did not make this comment, I find the authors' reply to the following comment by Reviewer #1 unclear: Original comment 'I like that the assessment of CP (cognitive performance) and self-reports PLEs is of good quality. However, I was wondering which 4 items from the parent-reported CBCL (Child Behavior Checklist) were used and how did they correlate with the child-reported PLEs? And how was distress taken into account in the child self-reported PLEs measurement? Which PLEs measures were used?'

      The authors' response refers to correlation coefficients, but I think Reviewer #1's inquiry was on more than these correlations.

      Thank you for your concern. We think that this comment was referring to our previous manuscript submitted elsewhere. In our initial submission to eLife, we already added the details about the four items from the parent-reported CBCL and how distress was considered in the child self-reported PLEs measurement (Appendix S1, page 48).

      2) Regarding the authors' reply that they have 'standardized the use of 'cognitive capacity' - I do not understand what this means. How exactly was this term standardized? In fact, I can find the term 'cognitive capacity' only once and it seemed to have been deleted from the manuscript. This is fine, but it doesn't clearly align with the statement that this term has been standardized.

      We apologize for causing such confusion. What we meant was that throughout our revised manuscript, we used the term “cognitive phenotypes” instead of “cognitive capacity”.

      3) Regarding my initial comment that 'it needs to be described how cognitive performance was defined in Lee 2018.' - I believe this is still not clarified. The authors write 'CP was measured as the respondent's score on cognitive ability assessments', but it remains unclear what exactly these assessments were.

      Thank you for pointing this out. We added that “CP, measured as the respondent's score on cognitive ability assessments of general cognitive function and verbal-numerical reasoning, was assessed in participants from the COGENT consortium and the UK Biobank” (line 204~206).

      4) Regarding the authors' reply to my comment 'In the 'Path Modeling' section, please explain what 'factors and components' concretely refer to. How is this different from a standard SEM with latent factors?'

      I can see that the authors explained 'components' (=the weighted sum of observed variables), but please also add what you mean by 'factors' - and how these are different from 'components' (line 284). Furthermore, I don't think it is correct that SEMs can only model latent factors, but not components (=measured variables). I also cannot see how using a weighted sum of observed variables controls more effectively for bias in estimation than latent factors. However, even though I do have some knowledge on this method, I'm not an expert and would appreciate the authors, other reviewer and/or editor to weigh in on this point.

      Thank you for pointing this out. We added that latent factors are indirectly measured indicators that explain the covariance among observed variables (line 263~271). We also added that standard SEM method using latent factors assumes that observed variables within each construct share a common underlying factor, but if this assumption is not met, then the standard SEM method cannot effectively control for biases. This is the reason why the IGSCA method, which addresses this limitation by allowing for use of both composite and latent factors as constructs.

      “Standard SEM using latent factors (i.e., indirectly measured indicators that explain the covariance among observed variables) to represent indicators such as PGS or family SES relies on the assumption that observed variables within each construct share a common underlying factor. If this assumption is violated, standard SEM cannot effectively control for estimation biases. The IGSCA method addresses this limitation by allowing for the use of composite indicators (i.e., components)—defined as a weighted sum of observed variables—as constructs in the model, more effectively controlling bias in estimation compared to the standard SEM. During estimation, the IGSCA determines weights of each observed variable in such a way as to maximize the variances of all endogenous indicators and components.” (line 263~271)

      5) I overall disagree with the authors' following statement 'It has been suggested from prior studies that these variables (PGS, family SES, neighborhood SES, positive family and school environment, and PLEs) are less likely to share a common factor', but I appreciate the authors' argument.

      Thank you for your comment. To make clarify our statement in the manuscript, we changed the sentence to “Considering that the observed variables of the PGSs, family SES, neighborhood SES, positive family and school environment, and PLEs are evaluated as a composite index by prior research, the IGSCA method can mitigate bias more effectively by representing these constructs as components” (line 274~277).

      6) Regarding 'genetic ethnicity': please describe your methods on how this was defined.

      Genetic ethnicity was defined as the genetic ancestry of participants, which is included as one of observations in the original ABCD Study data. To avoid further confusion, we corrected ‘genetic ethnicity’ to ‘genetic ancestry’ throughout the manuscript.

      7) Regarding 'a more direct genetic predictor of PLEs' - I still don't understand what the contrast is here. More direct than what else?

      The description was unclear; we removed it from our manuscript.

      8) Regarding the factor loadings in Figure 3: I don't understand how deprivation loads positively on 'low neighborhood SES', but poverty loads negatively. Shouldn't they both show the same direction of effect/loading on neighbourhood SES, while 'years of residency' should show the opposite direction (i.e., deprivation and poverty = risk, while years of residency = protective)? Are these unexpected loadings?

      The authors did not yet respond to this point: 'Please also add the autocorrelations between the 3 PLE measures. I assume these were also modelled statistically, given the strong correlations between time points?' Were these correlations not modelled? Why not?

      Figure 3B is still unclear. Was intelligence included here? What is the difference between Figure 3A and B? The legend suggests that 3B shows the indirect effects, but figure 3B looks like a direct effect, while 3A seem to show the indirect effect.

      The reviewer’s confusion resulted from our incorrect description. The factor loadings of low neighborhood SES were marked incorrectly. The loading for ‘years of residence’ and ‘poverty’ should be switched: -0.3648 for ‘years of residence’ and +0.877 for ‘poverty’. This was a mistake when we were applying factor loadings in the Figure. We thank you for pointing this out.

      We apologize for missing your point on autocorrelation. Adding autocorrelations between the three PLEs is unrelated to our research goal. In this paper, we investigated how genetic and environmental factors explain the variations in PLEs between participants, regardless of changes over time. Since we used PLEs of multiple follow-ups to ensure that the results are robust irrespective of the timing of PLE measurements, taking autocorrelation into account is not necessary.

      The decision to add autocorrelation, which involves using the outcome variable at time (t-1) as a predictor for the outcome variable at time t, depends on the research focus. If your interest lies in explaining inter-individual variation in the rate of change in PLEs over a one-year period, then autocorrelation should be controlled for (typically, predictors measured at different time points are used in such cases). However, this was not the focus of this paper, which is why we did not apply autocorrelation in the SEM analysis.

      We apologize for the confusion between Figure 3A and 3B. To clarify, we added titles in the figure images as “Direct effects” and “Indirect effects”. We also changed the legend as well.

      “A. Direct pathways from PGS, high family SES, low neighborhood SES, and positive environment to cognitive intelligence and PLEs. Standardized path coefficients are indicated on each path as direct effect estimates (significance level *p<0.05). B. Indirect pathways to PLEs via intelligence were significant for polygenic scores, high family SES, low neighborhood SES, and positive environment, indicating the significant mediating role of intelligence.” (line 968~973)

      Figure 3A shows direct effects: i.e., the coefficients of paths from PGS, family SES, neighborhood SES, and positive environment to intelligence and PLEs, as well as the coefficient of paths from intelligence to PLEs. This is why Figure 3A shows colored arrows starting from PGS, family and neighborhood SES, and positive environment towards intelligence and PLEs, as well as the arrows from intelligence to PLEs. On the other hand, in Figure 3B, the colored arrows staring from PGS, family and neighborhood SES, and positive environment goes through intelligence, and heads towards PLEs. This was meant to show that the indirect effects shown in Figure 3B indicate the specific effects of PGS, family SES, neighborhood SES, and positive environment on PLEs mediated by intelligence.

      In short, Figure 3 can be seen as a diagram drawn from Table 2: direct effects of the genetic and environmental variables on intelligence and PLEs, and direct effects of intelligence on PLEs are shown in Figure 3A; indirect effects of genetic and environmental variables on PLEs mediated by intelligence are shown in Figure 3B.

      9) Regarding Supporting Information tables: to make these more digestible, I suggest using Excel and adding one table per sheet with a clear title and legend, indicating what each table shows. For example, Table S1 has 9(?) different subsections, all called the same (Linear Mixed Model: Multiethnic). It is not clear how each subsection differs from the others. Separate tables in separate excel sheets might be easier.

      Also, I think two decimal points might be good enough, enhancing readability of these tables.

      Thank you for your suggestion. We moved the supplementary tables into an external Excel file, with each sheet showing different tables, as well as titles, legends, and clear subsections.

      10) Regarding reporting exact p-values in Table 2: I don't understand. At the moment, categorical significance statements are reported. Were these not based on exact p-values (or how else was it decided if a finding was significant at a 0.05 (?) significance level).

      Either remove the significance column completely (as p-values cannot be estimated due to non-normality) or specify exactly/clarify what this column shows and this was derived.

      We apologize for the confusion. In Table 2, we checked the significance of each path using 95% confidence intervals with 5,000 bootstrapping iterations. Since 95% confidence intervals that does not include zero is equivalent to p-values below 0.05 significance level, we believe this is an appropriate alternative for reporting the significance of each path in the SEM model.

      We specified the reason why we were not able to calculate exact p-values (clean copy: line 299~303). “As a trade-off for obtaining robust nonparametric estimates without distributional assumptions for normality, the IGSCA method does not return exact p-values (Hwang, Cho, Jung, et al., 2021). As a reasonable alternative, we obtained 95% confidence intervals based on 5,000 bootstrap samples to test the statistical significance of parameter estimates.”

    1. Author Response

      The following is the authors’ response to the original reviews.

      We would first like to thank the reviewers for their time and effort in their critical review of our manuscript, and appreciate the opportunity to address these comments. We thank the reviewers for appreciating that our experimental design is well crafted, and contributes to the broader understanding of dietary exercise recommendations for metabolic health and muscle development. We have revised the figures and text in accordance with the reviewer’s recommendations, and hope that they appreciate the revised version.

      Reviewer #1:

      1) A significant limitation of this study pertains to the absence of a detailed exploration into the mechanistic underpinnings of the interaction between high protein intake and resistance exercise at the molecular level. The authors should provide a comprehensive discussion on potential avenues or prospective research directions to address this gap in understanding.

      We agree and have added some theories in the discussion on page 14.

      2) Figure 4 and Figure 7 can be moved to supplementary and text in the description can be arranged accordingly to make a better flow of the story.

      We agree with this suggestion and have made adjustments.

      3) The authors have used a high protein diet (36% calorie from protein) and a low protein diet (7% calorie from protein) for this study. The authors should explain whether this mouse diet is practically comparable to the human's high protein (2% of BW) and low protein diet (less than 0.8% BW) or not. The high protein diet is comparable to a human diet of 180 grams of protein ((0.36x2000 calories)/4 calories per gram=180 g), which is in a range that some people consume, particularly bodybuilders and athletes. The low protein diet is equivalent to 35 grams of protein per day ((0.07x2000 calories)/4 calories/gram=35g), and a diet of just 7% protein is not recommended for humans per the Acceptable Macronutrient Distribution Range (AMDR) of 10-35% dietary protein set by the Institute of Medicine (IOM). We have addressed this on page 14.

      4) The color coding of the error bar and lines does not match with the group description in almost every figure. Maybe the authors could choose more contrasting colors.

      Thanks, we have adjusted the coloring of the error bars and lines in all figures.

      5) In Figure 3C-E it seems like the number of biological samples is not consistent in the LP+WP group. If the authors have excluded any outlier from the analysis, that should be included in the methodology.

      We did list outliers in the methodology in the statistics section (page 19): “Outliers were determined using GraphPad Prism Grubbs’ calculator (https://www.graphpad.com/quickcalcs/grubbs1/).”

      Reviewer #2:

      Very nice work! I do not have a whole lot to say in terms of experiments, analysis, or data to present other than what is in my public review (and you cannot really provide it as it was not in the experimental design). The manuscript is also very well written. My only question is about the following two sentences in the introduction:

      "Both exercise and amino acids activate the mechanistic target of TOR (mTOR) protein kinase, which stimulates the protein synthesis machinery needed to stimulate skeletal muscle hypertrophy (Schiaffino et al., 2021). Therefore, The Academy of Nutrition and Dietetics recommends consuming 1.2-2.0 grams of protein per kg of body weight (BW) per day in physically active individuals (Thomas et al., 2016)." I am not sure how the second sentence follows from the first, so I am not convinced that "therefore" is the right adverb in the right place.

      Thanks for pointing this out. We have added a clarifying transition to the text (page 3).

    1. Author Response

      The following is the authors’ response to the original reviews.

      Reviewer #1 (Public Review):

      Summary:

      This important study from Godneeva et al. establishes a Drosophila model system for understanding how the activity of Tif1 proteins is modified by SUMO. The authors nicely show that Bonus, like homologous mammalian Tif1 proteins, is a repressor, and that it interacts with other co-repressors Mi-2/NuRD and setdb1 in Drosophila ovaries and S2 cells. They also show that Bonus is SUMOylated by Su(var)2-10 on at least one lysine at its N-terminus to promote its interaction with setdb1. By combining nice biochemistry with an elegant reporter gene approach, they show that SUMOylation is important for Bonus interaction with setdb1, and that this SUMO-dependent interaction triggers high levels of H3K9me3 deposition and gene silencing. While there are still major questions of how SUMO molecularly promotes this process, this study is a valuable first step that opens the door for interesting future experimentation.

      Major Point:

      The RNAseq and ChIPseq data is not available. This is critical for the review of the paper and would help the readers and reviewers interpret the Bonus mutant phenotype and its mechanism of repressing genes.

      The sequencing data have been deposited to the NCBI GEO archive. The accession number for all other RNA-seq and ChIP-seq data reported in this paper is GEO: GSE241375.

      1) The author's conclusion that Bonus SUMOylation is "essential for its chromatin localization" is not supported by the data. Figure 5F shows less 3KR mutant in the chromatin fraction but there is still significant signal.

      We appreciate the reviewer's feedback and agree that the term "essential" was not appropriate in this context. We have revised the manuscript to replace "essential" with "contributes to" to accurately reflect our findings.

      2) The author's conclusion that Bonus is SUMOylated at a single site close to its N-terminus is not necessarily true. In several SUMO and Bonus blots throughout the paper (5B, 6C, S4A), there are >2 differentially migrating species that could represent more than one SUMO added to Bonus. While the single K20R mutation eliminates all of these species in Fig 5C, it is possible that K20R SUMOylation is required for additional SUMOylation events on other residues. One way to determine if Bonus is SUMOylated on multiple sites is to add recombinant SUMO protease to the extract and see if multiple higher molecular weight bands collapse into a single migrating species (implying multiple SUMOs) or multiple migrating species (implying something else is altering gel migration).

      We appreciate the suggestion made by the reviewer. While we acknowledge the presence of occasional multiple bands in SUMO Western blots, the predominant pattern is the presence of unmodified Bon and a single additional band corresponding to SUMO-modified Bon. To investigate the possibility of multi-site SUMOylation, we performed requested experiment where we added SENP2 SUMO protease to the extract and checked Bon's SUMOylation. In the presence of NEM, we observed the unmodified form of Bon, as well as a single additional band representing a SUMO-modified form of Bon. Following SENP2 SUMO protease treatment, SUMOylation form of Bon was completely abolished in all samples, leaving only the unmodified Bon band (Extended Data Fig. 4D). This indicates that Bon is not SUMOylated on multiple sites and that the observed differential migration species likely result from other factors affecting gel migration.

      3) The authors state that most upregulated genes in BonusGLKD are not highly enriched in H3K9me3. The heatmap in figure 3D is not an ideal presentation of this argument. The authors should show an example of what the signal on a highly enriched gene looks like for comparison. The authors also argue that because most upregulated genes in BonusGLKD are not highly enriched in H3K9me3, they must be indirectly repressed. Another possibility is that bonus-mediated H3K9me3 is only important (and present) during early nurse cell differentiation and is later lost and dispensable during the rapid endocycles. After bonus establishes repression though H3K9me3, it might be maintained through bonus-Mi2/Nurd, something else, or nothing at all. The authors could discuss this possibility or perform H3K9me3 ChIP during cyst formation and early nurse cell differentiation rather than in whole ovaries, which are enriched for later stages.

      We thank the reviewer for their thoughtful comments and suggestions. In our revised manuscript we have included the tracks of gene that is highly enriched in H3K9me3 but remain unchanged upon Bon GLKD (Extended Data Fig. 3B). This addition allows for a visual comparison and better supports our argument that majority of genes upregulated in Bon GLKD are not enriched in H3K9me3 mark. We also appreciate the reviewer's suggestion regarding the potential temporal dynamics of Bon-mediated H3K9me3. It is indeed possible that Bon's role in establishing H3K9me3 might be more prominent during early nurse cell differentiation and less critical in later stages. We included discussion of this possibility in revised manuscript. To further explore it would be valuable to perform H3K9me3 ChIP during cyst formation and early nurse cell differentiation. However, given the limitations of our current resources and time limitations, we were unable to perform these experiments for the revised manuscript.

      4) The BonusGLKD RNAseq analysis is underwhelming. The conclusion that "Bonus represses tissue-specific genes" has limited value. Every gene that is not expressed in ovaries is "tissue-specific." What subset of tissue-specific genes does Bonus repress? What common features do these genes have and how do they compare to other sets of tissue-specific genes, such as those reportedly repressed by setdb1, Polycomb proteins, small ovary, l(3)mbt, and stonewall (among others in female germ cells). Comparing these available data sets could help the authors understand the mechanism of Bonus repression and how BonusGLKD leads to sterility. The authors could also further analyze the differences between nos-Gal4 and MT-Gal4 to better understand why nos- but not MT-driven knockdown is sterile.

      We appreciate the reviewer's feedback regarding the RNA-seq analysis and acknowledge the importance of identifying the specific subset of tissue-specific genes. The Figure 2C shows specific tissues where genes derepressed upon Bon GLKD are normally expressed. These are tissues/organs such as the head, digestive system, and nervous system. The reviewer's suggestion to compare our findings with existing datasets are valid and could indeed provide a more comprehensive understanding of Bon repression and its implications in female germ cells. However, many of the published datasets are based on mutant fly lines or use different GAL4 drivers to induce knockdowns, making direct comparisons challenging. We have conducted a preliminary analysis of available data, specifically nos-Gal4>SetDB1KD (GSE109852), and identified an overlap of 135 genes out of the 464 genes upregulated upon nos-Gal4>BonusKD with those affected by SetDB1 knockdown. We have included this result in the revised manuscript.

      Main Study Limitations:

      1) It is unclear which genes are directly vs indirectly regulated by bonus, which makes it difficult to understand Bonus's repressive mechanism. Several lines of experiments could help resolve this issue. 1) Bonus ChIPseq, which the authors mentioned was difficult. 2) RNAseq of BonusGLKD rescued with KR3 mutation. This would help separate SUMO/setdb1-dependent regulation from Mi-2 dependent regulation. Similarly, comparing differentially expressed genes in Su(var)2-10GLKD, setdb1GLKD, 3KR rescue, and MI-2 GLKD could identify overlapping targets and help refine how bonus represses subsets of genes through these different corepressors.

      We appreciate the reviewer's suggestions and agree that discrimination between direct and indirect Bon targets should be the next step in understanding Bon repressive mechanism. We have previously attempted to determine Bon direct targets using ChIP-seq approach. However, despite our multiple efforts using both native Bon antibodies and GFP-tagged Bon fly lines, analysis of ChIP-seq data did not reveal specific enrichment indicating that Bon – similar to many other chromatin-bound proteins – are not amenable to ChIP. The recommendation for RNA-seq analysis of Bon GLKD rescued with the 3KR mutation is valuable, and we will certainly consider it for future investigations.

      We compared differentially expressed genes in Su(var)2-10 GLKD and Mi-2 GLKD and found limited overlap: out of the 231 genes affected by Bon GLKD, 39 genes were affected in Mi-2 GLKD and 42 in Su(var)2-10 GLKD. We acknowledge the importance of understanding which genes are directly or indirectly regulated by Bon and the potential for further experiments to address this question.

      2) The paper falls short in discussing how SUMO might promote repression. This is important when considering the conservation (of lack thereof) of SUMOylation sites in Tif1 proteins in distantly related animals. One piece of data that was not discussed is the apparent localization of SUMOylated bonus in the cytoplasmic fraction of the blot in Figure 5F. Su(var)2-10 is mostly a nuclear protein, so is bonus SUMOylated in the nucleus and then exported to the cytoplasm? Also, setdb1 is a nuclear protein, so it is unlikely that the SUMOylated bonus directly interacts with setdb1 on target genes. Together with Fig 5E (unSUMOylatable Bonus aggregates in the nucleus), one could make a model where SUMO solubilizes bonus (perhaps by disassembling aggregates) and indirectly allows it to associate with setdb1 and chromatin. It is also important to note that in Figure 5I, the K3R mutation appears to lessen but not eliminate Bonus interaction with setdb1. This data again disfavors a model where SUMO establishes an interaction interface between setdb1 and Bonus. To determine which form of Bonus interacts with setdb1, the authors could perform a setdb1 pulldown and monitor the SUMOylation state of coIPed Bonus through mobility shift. If mostly unSUMOylated bonus interacts with setdb1, and SUMO indirectly promotes Bonus interaction with setdb1 (perhaps by disassembling Bonus aggregates), then the precise locations of Bonus SUMOylation sites could more easily shift during evolution, disfavoring the author's convergent evolution hypothesis.

      We appreciate the reviewer's valuable feedback. Regarding the observation of SUMOylated Bon in the cytoplasmic fraction in Figure 5F, we recognize its significance. This finding has prompted us to consider a model in which SUMOylation may play a role in translocating Bon from the nucleus to the cytoplasm, potentially influencing interactions with SetDB1 and chromatin indirectly. Furthermore, Figure 5I which shows only a partial reduction in Bon-SetDB1 interaction with the 3KR mutation, suggests that SUMO may not be the primary mediator of this interaction. We recognize the need for further investigations to clarify SUMO's exact role in this context. In response to the reviewer's suggestion, we conducted SetDB1 pulldown experiments in S2 cells. The results reveal that indeed SetDB1 primarily interacts with unmodified Bon which is by far more abundant compared to SUMOylated form (Extended Data Fig. 5C). We think this experiment presents certain technical challenges, as the signal for Bon, when used as prey in co-IP experiments, is relatively faint, making it inherently difficult to detect the lower levels of SUMO-modified Bon. Additionally, in revised manuscript we have added new result of determining Bon interactors in ovary using mass-spec analysis, which showed that SetDB1 associates with wild-type, but not SUMO-deficient Bon. While our data support the idea that SUMO may contribute to Bon solubilization, possibly by disassembling aggregates, thereby indirectly facilitating its association with SetDB1 and chromatin, we acknowledge that the precise mechanism remains unclear.

      Reviewer #2 (Public Review):

      Summary:

      The authors analyze the functions and regulation of Bon, the sole Drosophila ortholog of the TIF1 family of mammalian transcriptional regulators. Bon has been implicated in several developmental programs; however, the molecular details of its regulation have not been well understood. Here, the authors reveal the requirement of Bon in oogenesis, thus establishing a previously unknown biological function for this protein. Furthermore, careful molecular analysis convincingly established the role of Bon in transcriptional repression. This repressor function requires interactions with the NuRD complex and histone methyltransferase SetDB1, as well as sumoylation of Bon by the E3 SUMO ligase Su(var)2-10. Overall, this work represents a significant advance in our understanding of the functions and regulation of Bon and, more generally, the TIF1 family. Since Bon is the only TIF1 family member in Drosophila, the regulatory mechanisms delineated in this study may represent the prototypical and important modes of regulation of this protein family. The presented data are rigorous and convincing. As discussed below, this study can be strengthened by a demonstration of a direct association of Bon with its target genes, and by analysis of the biological consequences of the K20R mutation.

      Strengths:

      1. This study identified the requirement for Bon in oogenesis, a previously unknown function for this protein.
      2. Identified Bon target genes that are normally repressed in the ovary, and showed that the repression mechanism involves the repressive histone modification mark H3K9me3 deposition on at least some targets.
      3. Showed that Bon physically interacts with the components of the NuRD complex and SetDB1. These protein complexes are likely mediating Bon-dependent repression.
      4. Identified Bon sumoylation site (K20) that is conserved in insects. This site is required for repression in a tethering transcriptional reporter assay, and SUMO itself is required for repression and interaction with SetDB1. Interestingly, the K20-mutant Bon is mislocalized in the nucleus in distinct puncta.
      5. Showed that Su(var)2-10 is a SUMO E3 ligase for Bon and that Su(var)2-10 is required for Bon-mediated repression.

      Weaknesses:

      The study would be strengthened by demonstrating a direct recruitment of Bon to the target genes identified by RNA-seq. Given that the global ChIP-seq was not successful, a few possibilities could be explored. First, Bon ChIP-qPCR could be performed on the individual targets that were functionally confirmed (e.g. rbp6, pst). Second, a global Bon ChIP-seq has been reported in PMID: 21430782 - these data could be used to see if Bon is associated with specific targets identified in this study. In addition, it would be interesting to see if there is any overlap with the repressed target genes identified in Bon overexpression conditions in PMID: 36868234.

      We greatly appreciate the reviewer's suggestion to demonstrate the direct recruitment of Bon to the target genes. As described in our answer to reviewer #1, we attempted to determine Bon direct targets using ChIP-seq approach using both native Bon antibodies and GFP-tagged Bon fly lines. However, analysis of ChIP-seq data did not reveal specific enrichment. Similarly, Bon ChIP-qPCR on individual targets showed the same results suggesting that Bon – similar to many other chromatin-bound proteins – are not amenable to ChIP protocol, at least in standard conditions. To further explore this issue, we have analyzed results of a global Bon ChIP-seq reported in PMID: 21430782. We did not find Bon binding to individual targets, but even more importantly, we did not see clear Bon enrichment elsewhere in the genome confirming a conclusion that Bon targets on chromatin cannot be determined by ChIP. Additionally, we explored the possibility of overlap between target genes repressed by Bon in our study and those observed under Bon overexpression conditions in PMID: 36868234. While we did identify 41 genes in common, it's important to note that the datasets are derived from different tissues (pupal eyes vs. ovaries), making direct comparison problematic.

      The second area where the manuscript can be improved is to analyze the biological function of the K20R mutant Bonus protein. The molecular data suggest that this residue is important for function, and it would be important to confirm this in vivo.

      We appreciate the reviewer's suggestion to analyze the biological function of the K20R mutant Bon protein. While we acknowledge that we did not use single-site K20R mutant for in vivo experiments, we demonstrated that the mutant with the three-residue substitution (3KR) is incapable of inducing repression (Figure 5G). Given that other experiments consistently showed that K20 is the primarily SUMOylation site, this result supports the conclusion that K20 SUMOylation plays an important role in Bon-mediated transcriptional silencing.

      Reviewer #1 (Recommendations for The Authors):

      Make the RNAseq and ChIPseq data publicly available!

      The sequencing data have been deposited to the NCBI GEO archive. The accession number for all other RNA-seq and ChIP-seq data reported in this paper is GEO: GSE241375.

      Reviewer #2 (Recommendations for The Authors):

      It would be interesting to identify the biological basis of aberrant ovary development in Bon depletion conditions. Previous studies (e.g. PMID: 11336699) suggested that Bon loss of function clones are cell lethal, and the developmental defects in oogenesis presented in the current study offer an opportunity to delve more into the causes of cell loss, e.g. by showing that the cells die via apoptosis.

      Thank you for your valuable suggestion. In response to your comment, we performed a TUNEL assay to investigate whether germ cells in nos-Gal4>BonusKD ovaries undergo apoptosis. Our results indeed indicate that germ cells in these ovaries exhibit apoptosis, as evidenced by the TUNEL signal (Extended Data Fig. 1C). This information has been included in the revised manuscript to provide insights into the biological basis of aberrant ovary development in Bon depletion conditions.

      The K20 residue could also be ubiquitinated. This possibility could at least be discussed, particularly given the presence of the RING Ub ligase domain in Bon that might potentially perform self-ubiquitination.

      Indeed, the possibility that Bon can be ubiquitinated is a valid consideration. We have explored this possibility. We did not detect any signals with the Ubiquitin antibody in both wild-type Bon immunoprecipitant and triple-mutant [3KR] ovaries (in which K20 is also mutated) (Extended Data Fig. 4C). This suggests that K20 is more likely responsible for Bon SUMOylation rather than ubiquitination. We appreciate the reviewer's suggestion and have included this information into the revised manuscript.

    1. Author Response

      We very much appreciate all the reviewers’ positive feedback and additional comments and suggestions for this manuscript!

      In this provisional reply, we’d like to quickly address only one selected key point, for which we have already collected relevant experimental data:

      Reviewer 1 suggests that ‘it would have been more rigorous for the authors to independently reproduce the kinetics reported for nsp8/9 using their specific experimental conditions.’ We absolutely agree with this and have already carried out these kinetic experiments while our paper was under review. We have now measured kinetic parameters for cleavage of the nsp8/9 peptide in our own hands under the same conditions as we used for nsp4/5 and TRMT1. We measured kcat and KM values of 0.019 +/- 0.002 s-1 and 40 +/- 7.5 µM, respectively, for nsp8/9 cleavage; these data are very much in line with the previously reported values from MacDonald et al (kcat = 0.013 +/- 0.001 s-1, KM = 36 +/- 6.0 µM) that we used for comparison in Figure 4 and listed in Table S2. We will add our own measured kinetic values for nsp8/9 in the next version of our manuscript, but wanted to report these numbers as soon as possible, because this further supports and validates our claim that the human TRMT1 sequence is cleaved at a similar rate to the known nsp8/9 viral polypeptide cleavage site.

      We will provide a detailed, point-by-point reply to all reviewer comments accompanying the forthcoming revised manuscript, in which we intend to have new and updated data and additional MD simulations that directly address key questions raised by the reviewers.

    1. Author Response

      We thank the reviewers for their suggestions in improving the manuscript. We are currently working on a formal revision and plan to submit a revised manuscript in the near future. However, we would be remiss, if we did not address concerns regarding the conceptual merits of the paper. Below we speak to major points of note that address select reviewer comments and the eLife assessment of our manuscript.

      eLife assessment:

      However, the strength of evidence is incomplete due to the concern that larval contraction is a result of chilling the nervous system and muscles, which causes spreading depolarization and mechanical contraction of the body, rather than an active sensorimotor response to cold.

      Reviewer #3:

      The scientific premise is that a full body contraction in larvae that are exposed to noxious cold is a sensorimotor behavioral pathway. This premise is, to start with, questionable. A common definition of behavior is a set of "orderly movements with recognizable and repeatable patterns of activity produced by members of a species (Baker et al., 2001)." In the case of nociception behaviors, the patterns of movement are typically thought to play a protective role and to protect from potential tissue damage.

      Does noxious cold elicit a set of orderly movements with a recognizable and repeatable pattern in larvae? Can the patterns of movement that are stimulated by noxious cold allow the larvae to escape harm? Based on the available evidence, the answer to both questions is seemingly no.

      We thank the reviewer for their questions and clarify, here. Exposure to cold temperatures does elicit a recognizable and repeatable pattern of behavior across multiple strains, including both wildtype and genetic control strains (w1118, Oregon R) and numerous control conditions that have been previously published (Himmel et al., 2021, Himmel et al., 2023, Patel et al., 2022, Turner et al., 2016, Turner et al., 2018, Tenedini et al., 2019). Our initial publication on Drosophila cold nociception demonstrated a variety of cold-evoked behavior responses including head and/or tail raising of the larva as well as contraction behavior. These behaviors were repeatedly observed in assays involving either local cold stimulation with a cold probe or global cold stimulation on a cold plate. Head and/or tail raise behaviors are consistent with behavior that displaces the larval body from the cold surface, however, exposure to increasingly colder temperatures leads to an increasing level of cold-evoked contraction (CT) responses which result in a reduction of larval area (Turner et al., 2016). Presumably, increasing the level of CIII md neuron activation leads to greater activation of downstream circuitry. We previously performed optogenetic dose response assays to further clarify the increased prevalence CT response to strong noxious cold stimuli and investigated how CIII md neurons discriminate between innocuous touch and noxious cold stimuli. Here, we found that lower-level activation of CIII md neurons lead to predominantly touch-evoked behaviors whereas high-level activation led predominantly to cold-evoked responses (Turner et al., 2016). These analyses were coupled with stimulus-evoked calcium imaging, which revealed that touch-evoked Ca2+ levels were significantly lower than cold-evoked Ca2+ levels (Turner et al., 2016).

      In this manuscript, we confirm our previously published findings that neural silencing of CIII md neurons with either tetanus toxin expression or impairing action potential propagation results impaired cold-evoked CT responses (Turner et al., 2016, Turner et al., 2018). However, neural silencing of CIII md neurons did not eliminate cold-evoked CT responses. We interpret this finding as evidence that some component of cold-evoked CT response may be due to cold-induced muscle contraction. Furthermore, in this manuscript, we implicate the requirement of chordotonal (Ch) neurons in cold-evoked CT and demonstrate cold-evoked Ca2+ increases in Ch neurons. Furthermore, neural silencing of multiple sensory neuron types (CIII + Ch or CIII + CII) resulted in greater deficits in cold-evoked behaviors (Turner et al., 2016). Thus, the noxious cold stimulus is detected by multiple peripheral sensory neurons and inhibiting neural activity in CIII md neurons alone cannot eliminate cold-evoked CT responses.

      In this manuscript and in several other publications, studies have shown that optogenetic activation of CIII md neurons, or CIII neurons plus CII neurons or Ch neurons elicits CT-like responses (Hwang et al., 2007, Shearin et al., 2013, Turner et al., 2016). Conversely, optogenetic stimulation of CIII md neurons knocked down for paralytic, the α-subunit of voltage-gated sodium channel, did not elicit blue light-evoked CT responses due to impaired action potential propagation. These analyses collectively indicate that CIII md neuron activation is sufficient for eliciting CT-like responses. Additionally, we have previously published electrophysiological recordings of CIII md neurons under cold exposure. To address potential confounds of cold-induced muscle contraction on cold-induced electrical activity of CIII md neurons, we performed these analyses on de-muscled fillets revealing that CIII neural activity is not dependent upon muscles in response to cold. Exposure to noxious cold stimuli results in temperature-dependent increases in CIII neuron firing pattern consisting of both bursting and tonic firing (Himmel et al., 2021, Himmel et al., 2023, Maksymchuk et al., 2022, Patel et al., 2022, Himmel et al., 2022, Maksymchuk et al., 2023).

      Reviewer #3:

      Can the patterns of movement that are stimulated by noxious cold allow the larvae to escape harm?

      We were similarly curious about the neuroethological and/or protective implications of cold-evoked behaviors. In Drosophila larvae, noxious mechanical stimuli-evoked body rolling allows for lateral escape from predatory wasp (Hwang et al., 2007). Reducing the overall surface area that is exposed to cold (e.g., huddling behavior) serves as a protective strategy in many species (Canals et al., 1997, Contreras, 1984, Gilbert et al., 2006, Vickery and Millar, 1984, Hayes et al., 1992). Low temperatures can be fatal to poikilotherms (e.g., insects), however, many species have evolved the ability to cold acclimate thereby increasing their cold tolerance. To explore the potential evolutionary benefit of CIII-mediated contraction response to cold, we previously published work revealing a neural basis for cold acclimation in Drosophila larvae implicating these neurons (Himmel et al., 2021). We demonstrated that cold-evoked CT behavior is evolutionarily conserved across 11 different drosophilid species and that other cold-induced behaviors (e.g., tail raise) were also observed. Furthermore, drosophilid species adapted to rapid temperature swings were more likely to retain the ability to locomote even at lower temperatures (Himmel et al., 2021). Next, we elucidated the role of CIII md neurons in cold acclimation. Silencing CIII md neurons resulted in the inability to cold acclimate. We additionally investigated roles of Ch or CII md neurons, which alone did not inhibit the ability of larvae to cold acclimate. However, combinatorial silencing of CIII with CII or Ch neurons resulted in an inability to cold acclimate but did not obviously increase baseline cold tolerance. We explored how developmental exposure to noxious cold temperature impacts CIII md neuron cold-evoked firing pattern. Electrophysiological analyses revealed that cold acclimation results in hypersensitization in CIII md neurons (Himmel et al., 2021). Lastly, developmental optogenetic activation of CIII md neurons led to increased cold tolerance. Therefore, CIII md neurons are necessary and sufficient for cold tolerance and our collective evidence demonstrate that CIII-mediated cold nociception constitutes a peripheral neural basis for Drosophila larval cold acclimation (Himmel et al., 2021).

      Reviewer #3:

      It should be noted that this actuator drives very strong activation, and other studies with milder optogenetic stimulation of Class III neurons have shown that these cells produce behavioral responses that resemble gentle touch responses (Tsubouchi et al 2012 and Yan et al 2013)…The latter makes the reported Calcium responses to cold difficult to interpret in light of the fact that the strong muscle contractions driven by cold may actually be driving mechanosensory responses in these cells (ie through deformation of the mechanosensitive dendrites)…. Are the cIII calcium signals still observed in a preparation where cold induced muscle contractions are prevented?”

      We agree with the reviewer that mild activation of CIII md neurons results in gentle touch-like responses. In this manuscript, and other previously published work, it has been shown that optogenetic activation of CIII neurons, or CIII neurons and other sensory neurons, using a variety of optogenetic actuators (ChR2, ChETA, and CsChrimson) promotes bilateral contraction of the larval body along the anterior-posterior axis (Shearin et al., 2013, Hwang et al., 2007, Meloni et al., 2020, Turner et al., 2016, Patel and Cox, 2017, Patel et al., 2022, Himmel et al., 2023).

      As described above, in our initial publication documenting larval cold nociception in Drosophila, we investigated how CIII md neurons discriminate multimodal stimuli to elicit stimulus relevant behavioral responses. We reported that increased activation of CIII md neurons results in cold-evoked behaviors, where lower activation results in touch-evoked behaviors. Subsequent, calcium analyses revealed greater stimulus-evoked calcium response to noxious cold and milder calcium response to gentle touch (Turner et al., 2016).

      Though we have not performed cold-evoked Ca2+ imaging of CIII md neurons in larval preparations without muscles, we have recorded electrical responses of CIII md neurons in the absence of muscle contractions using de-muscled larvae fillets to analyze cold-evoked firing patterns of CIII md neurons (Himmel et al., 2021, Himmel et al., 2022, Himmel et al., 2023, Patel et al., 2022, Maksymchuk et al., 2022, Maksymchuk et al., 2023). These studies demonstrate the cold-evoked CIII neural activity is not dependent upon muscles.

      Reviewer #3:

      A major weakness of the study is that none of the second or third order neurons (that are downstream of CIII neurons) are found to trigger the CT behavioral responses even when strongly activated with the ChETA actuator (Figure 2 Supplement 2). These findings raise major concerns for this and prior studies and it does not support the hypothesis that the CIII neurons drive the CT behaviors.”

      We conducted extensive screening of interneuron populations post-synaptically connected to CIII neurons in an effort to identify post-synaptic partners that were sufficient to trigger CT response. Much to our surprise, we were unable to find any individual neuron type or driver line that was sufficient to elicit a CT response. However, we provide substantial supporting evidence for our co-activation experiments including neural silencing, EM connectivity and calcium imaging. We also report necessity for the reported second/third order neurons in cold-evoked behavioral responses, where inhibiting neural activity resulted in reduced cold-evoked behavior. Second/third order neurons also exhibit cold-evoked calcium responses. Lastly, we also report CIII-evoked (using optogenetics) increases in calcium response in downstream post-synaptic neurons.

      Previously published literature investigating CIV md neuron circuitry has implicated downstream neurons that are not sufficient to elicit rolling behavior upon activation. In CIV md neuron circuit dissection, select neurons are reported as acting downstream of CIV md neurons that require additional circuit components in order to execute rolling behavior. For example, A00c neuron activation alone does not lead to rolling behavior, however, co-activation of A00c and Basin-4 neurons facilitates rolling response (Ohyama et al., 2015). Similarly, co-activation of Basin-1 and Basin-4 neurons significantly enhance rolling probability relative to Basin-4 alone (Ohyama et al., 2015). Further, DnB neurons require Goro command neuron activity to promote rolling behavior (Burgos et al., 2018). Thus, there is precedent for co-activation requirements to elicit robust behavioral output in sensorimotor circuits and we employed a similar strategy after we discovered that activation of second or third order neurons alone did not elicit CT response.

      Reviewer #3:

      Later experiments in the paper that investigate strong CIII activation (with ChETA) in combination with other second and third order neurons does support the idea activating those neurons can facilitate body-wide muscle contractions. But many of the co-activated cells in question are either repeated in each abdominal neuromere or they project to cells that are found all along the ventral nerve cord, so it is therefore unsurprising that their activation would contribute to what appears to be a non-specific body-wide activation of muscles along the AP axis. Also, if these neurons are already downstream of the CIII neurons the logic of this co-activation approach is not particularly clear.”

      We agree with the reviewer’s comment that various cell-types that were investigated are repeated in every abdominal neuromere, however, only select post-synaptic neurons (Basin 1-4, DnB, mCSI, and Chair neurons) are segmentally repeated in every abdominal segment. Conversely, other projection and ascending neurons we investigated (A09e, A00c, A05q, Goro, TePn04/05, and A08n) are not segmentally repeated in every section. We used connectome evidence to guide our experiments on populations of neurons to explore in cold-evoked behavior and as alluded to above our co-activation approach was driven by the observation that an individual subpopulation of connected interneurons was not found to be sufficient to elicit CT behavior. That said, it does not change the findings that inhibition of neural activity in these subpopulations impairs cold-evoked behavior, nor does it change the observation that connected interneurons exhibit cold-evoked Ca2+ responses that can also be observed with optogenetic activation of CIII neurons. Reviewer #3: “The authors argument that the co-activation studies support "a population code" for cold nociception is a very optimistic interpretation of a brute force optogenetics approach that ultimately results in an enhancement of a relatively non-specific body-wide muscle convulsion.” Many studies exploring circuit bases of behavior have applied large-scale optogenetic, including co-activation strategies, or silencing screens to identify circuit components involved in specific behaviors under investigation. We employed similar methods in our circuit-based dissection and our conclusions are not solely based upon optogenetic analyses.

      References: BURGOS, A., HONJO, K., OHYAMA, T., QIAN, C. S., SHIN, G. J.-E., GOHL, D. M., SILIES, M., TRACEY, W. D., ZLATIC, M., CARDONA, A. & GRUEBER, W. B. 2018. Nociceptive interneurons control modular motor pathways to promote escape behavior in Drosophila. eLife, 7:e26016.

      CANALS, M., ROSENMANN, M. & BOZINOVIC, F. 1997. Geometrical aspects of the energetic effectivenes of huddling in small mammals. Acta Theriologica 42(3):321-328..

      CONTRERAS, L. C. 1984. Bioenergetics of Huddling: Test of a Psycho-Physiological Hypothesis. Journal of Mammalogy, 65, 256-262.

      GILBERT, C., ROBERTSON, G., LE MAHO, Y., NAITO, Y. & ANCEL, A. 2006. Huddling behavior in emperor penguins: Dynamics of huddling. Physiol Behav, 88, 479-88.

      HAYES, J. P., SPEAKMAN, J. R. & RACEY, P. A. 1992. The Contributions of Local Heating and Reducing Exposed Surface Area to the Energetic Benefits of Huddling by Short-Tailed Field Voles (Microtus agrestis). Physiological Zoology, 65, 742-762.

      HIMMEL, N. J., LETCHER, J. M., SAKURAI, A., GRAY, T. R., BENSON, M. N., DONALDSON, K. J. & COX, D. N. 2021. Identification of a neural basis for cold acclimation in Drosophila larvae. iScience, 24, 102657.

      HIMMEL, N. J., SAKURAI, A., DONALDSON, K. J. & COX, D. N. 2022. Protocols for measuring cold-evoked neural activity and cold tolerance in Drosophila larvae following fictive cold acclimation. STAR Protoc, 3, 101510.

      HIMMEL, N. J., SAKURAI, A., PATEL, A. A., BHATTACHARJEE, S., LETCHER, J. M., BENSON, M. N., GRAY, T. R., CYMBALYUK, G. S. & COX, D. N. 2023. Chloride-dependent mechanisms of multimodal sensory discrimination and nociceptive sensitization in Drosophila. elife, 12:e76863.

      HWANG, R. Y., ZHONG, L., XU, Y., JOHNSON, T., ZHANG, F., DEISSEROTH, K. & TRACEY, W. D. 2007. Nociceptive Neurons Protect Drosophila Larvae from Parasitoid Wasps. Current Biology, 17, 2105-2116.

      MAKSYMCHUK, N., SAKURAI, A., COX, D. N. & CYMBALYUK, G. 2022. Transient and Steady-State Properties of Drosophila Sensory Neurons Coding Noxious Cold Temperature. Frontiers in Cellular Neuroscience, 16:831803.

      MAKSYMCHUK, N., SAKURAI, A., COX, D. N. & CYMBALYUK, G. S. 2023. Cold-Temperature Coding with Bursting and Spiking Based on TRP Channel Dynamics in Drosophila Larva Sensory Neurons. Int J Mol Sci, 24(19):14638.

      MELONI, I., SACHIDANANDAN, D., THUM, A. S., KITTEL, R. J. & MURAWSKI, C. 2020. Controlling the behaviour of Drosophila melanogaster via smartphone optogenetics. Scientific Reports, 10, 17614.

      OHYAMA, T., SCHNEIDER-MIZELL, C. M., FETTER, R. D., ALEMAN, J. V., FRANCONVILLE, R., RIVERA-ALBA, M., MENSH, B. D., BRANSON, K. M., SIMPSON, J. H., TRUMAN, J. W., CARDONA, A. & ZLATIC, M. 2015. A multilevel multimodal circuit enhances action selection in Drosophila. Nature, 520, 633-639.

      PATEL, A. & COX, D. 2017. Behavioral and Functional Assays for Investigating Mechanisms of Noxious Cold Detection and Multimodal Sensory Processing in Drosophila Larvae. BIO-PROTOCOL, 7(13):e2388.

      PATEL, A. A., SAKURAI, A., HIMMEL, N. J. & COX, D. N. 2022. Modality specific roles for metabotropic GABAergic signaling and calcium induced calcium release mechanisms in regulating cold nociception. Front Mol Neurosci 15:942548.

      SHEARIN, H. K., DVARISHKIS, A. R., KOZELUH, C. D. & STOWERS, R. S. 2013. Expansion of the Gateway MultiSite Recombination Cloning Toolkit. PLoS ONE, 8, e77724-e77724.

      TENEDINI, F. M., SÁEZ GONZÁLEZ, M., HU, C., PEDERSEN, L. H., PETRUZZI, M. M., SPITZWECK, B., WANG, D., RICHTER, M., PETERSEN, M., SZPOTOWICZ, E., SCHWEIZER, M., SIGRIST, S. J., CALDERON DE ANDA, F. & SOBA, P. 2019. Maintenance of cell type-specific connectivity and circuit function requires Tao kinase. Nature Communications, 10, 3506.

      TURNER, H. N., ARMENGOL, K., PATEL, A. A., HIMMEL, N. J., SULLIVAN, L., IYER, S. C., BHATTACHARYA, S., IYER, E. P. R., LANDRY, C., GALKO, M. J. & COX, D. N. 2016. The TRP Channels Pkd2, NompC, and Trpm Act in Cold-Sensing Neurons to Mediate Unique Aversive Behaviors to Noxious Cold in Drosophila. Curr Biol, 26, 3116-3128.

      TURNER, H. N., PATEL, A. A., COX, D. N. & GALKO, M. J. 2018. Injury-induced cold sensitization in Drosophila larvae involves behavioral shifts that require the TRP channel Brv1. PLoS One, 13, e0209577.

      VICKERY, W. L. & MILLAR, J. S. 1984. The Energetics of Huddling by Endotherms. Oikos, 43, 88-93.

    1. Author Response

      Reviewer #1 (Public Review):

      Summary: The current study reports a cryo-EM structure of MFS transporter MelB trapped in an inward-facing state by a conformationally selective nanobody. The authors compare this structure to previously-resolved crystal structures of outward-facing MelB. Additionally, the authors report H/D exchange/ mass spec experiments that identify accessible residues in the protein.

      Strengths: The authors overcame very significant technical challenges to solve the first inward-facing structure of the small, model MFS transporter MelB by cryo-EM. The use of conformation-trapping nanobodies (which had been reported previously by this group) is particularly nice.

      We appreciate reviewer #1’s positive comments.

      Weaknesses: Maps and coordinates were not provided by the authors, which presents a gap in this assessment.

      We didn’t know specific requests for maps & coordinates during the initial submission but will provide them per request.

      The authors highlight the use of HDX experiments as a measurement of protein conformational dynamics. However, this experiment does not measure the conformational dynamics of the transporter, since in these experiments exchange is not initiated by ligand addition or another trigger. The experiment instead measures the accessibility of different residues, and of course, a freely-exchanging sodium bound transporter would have more exchangeable positions than when a conformation-trapping nanobody is bound. It is not clear what new mechanistic information this provides, since this property of the nanobody has already been established.

      We thank you for your comment. We will address your and reviewer 2’s similar questions later.

      Based on the evidence presented, it is somewhat speculative that the structure represents the EIIa-bound regulatory state.

      We believe that have presented convincing evidence obtained by ITC and gel-filtration chromatography to support this statement. The effects of Nb725 or EIIAGlc on MelB functions are similar: little change in Na+ binding, little change in Nb725 or EIIAGlc binding in the absence or presence of the EIIAGlc or Nb725, but a great reduction in sugar-binding affinity (sFigs. 2&3; tables 1&2; published two papers in J. Biol. Chem. 2014; 289: 33012-33019 and 2023; 299:104967). To make it clear, we will add the related data from the two JBC papers into the table 2. Nb725 and EIIAGlc can concurrently bind to MelBSt (sFigs. 2&3; tables 1&2). Further, we will provide a new figure to show that a complex composed of all three proteins can be isolated by gel-filtration chromatography. We have also established this finding with another Nb733 from the same family (JBC, 2023; 299:104967). However, given the EIIAGlc-bound structure has not been resolved yet, we will tune down the related argument.

      Reviewer #2 (Public Review):

      Summary: In this manuscript, Hariharan and colleagues present an elegant study regarding the mechanistic basis of sugar transport by the prototypical Na+-coupled transporter MelB. The authors identified a nanobody (Nb 725) that reduces melibiose binding but not Na+ binding. In vitro (ITC) experiments suggest that the conformation targeted by this nanobody is different from the published outward-open structures. They go on to solve the structure of this other conformational by cryo-EM using the Nanobody grafted with a fiducial marker and enhancer and, as predicted, capture a new conformation of MelB, namely the inward-open conformation. Through MD simulations and ITC measurements, they demonstrate that such state has a reduced affinity for sugar but that Na+ binding is mostly unaffected. A detailed observation and comparison between previously published structures in the outward-open conformation and this new conformational intermediate allows to strengthen and develop the mobile barrier hypothesis underpinning sugar transport. The conformational transition to the inward-facing state leads to the formation of a barrier on the extracellular side that directly affects the amino acid arrangement of the sugar binding site, leading to a decreased affinity that drives the direction of transport. In contrast, the Na+ binding remains the same. This structural data is complemented with dynamic insights from HDX-MS experiments conducted in the presence and absence of the Nb. These measurements highlight the overall protective effect of nanobody binding, consistent with the stabilization of one conformational intermediate.

      Strengths: The experimental strategy to isolate this elusive conformational intermediate is smart and well-executed. The biochemical and biophysical data were obtained in a lipid system (nanodiscs), which allows dismissing questions about detergent induced artefacts. The new conformation observed is of great interest and allows to have a better mechanistic understanding of ion-coupled sugar transport. The comparison between the two structures and the mobile barrier mechanism hypothesis is convincingly depicted and tested.

      We appreciate the reviewer’s insightful understanding of our novel findings and the associated explanations on the cation-coupled symport mechanisms.

      Weaknesses: This is excellent experimental work. My recommendations stem mostly from concerns regarding the interpretation of the observed results. In particular, I am somewhat puzzled by the important role the authors give to the regulatory protein EIIa with little structural or biophysical data to back up their claims. The hypothesis that the conformation captured by the Nb is physiologically and functionally equivalent to that caused by EIIa binding is definitely a worthy hypothesis, but it is not an experimental result. Evidence in support could include a structure with EIIa bound. Since it does not bind at the same location as the Nb, it seems feasible. Or, the authors could have performed HDX-MS in the presence of EIIa to determine if the effect is similar to that of Nb_725 binding. In the absence of these experiments, discussion about EIIa should be limited. Along the same lines, I find it misleading to put in the abstract a sentence such as "It is the first structure of a major facilitator superfamily (MFS) transporter with experimentally determined cation binding, and also a structure mimicking the physiological regulatory state of MelB under the global regulator EIIAGlc of the glucose-specific phosphoenolpyruvate:phosphotransferase system." None of this is supported by the experimental work presented in this article: the Na+ is modelled (with great confidence, but still) and whether this structure mimics the physiological state of MelB bound to EIIa is not known. The results of the paper are strong and interesting enough per se, and there is no need to inflate them with hypothesis that belongs to the discussion section.

      As stated in the response to reviewer 1, we believe that we presented strong data to argue for a structure mimicking the physiological regulatory state of MelB. The only missing data is the lack of the structure determination of the EIIA-bound state. We will change the title and tune down the related discussions in a new version.

      Regarding our statement in our abstract that “It is the first structure of a major facilitator superfamily (MFS) transporter with experimentally determined cation binding”, we believe that our claim is supported by the resolved Na+ binding in the cryoEM structure. So far, to our knowledge, there was no experimentally determined cation on its canonical binding site reported yet.

      I also note that the HDX-MS experiments do not distinguish between two conformational states, but rather an ensemble of states vs one state.

      We will address both reviewers 1 and 2 together. We agree with your comments and we compared the one (inward) state and ensembles of (predominantly outward) states. A lot of published data have demonstrated that the WT MelBSt predominantly populates outward-facing states, especially in the presence of Na+. The major differences in HDX-MS between the inward-facing state in the presence of the Nb and the outward-facing ensembles in the absence of the Nb should be related to the conformational changes between the inward- and outward-facing states, but not quantitatively. The type of measurements we performed do not contain information on the rates of conformational changes, but this study identified the dynamics regions involved in this conformational switch.

      Reviewer #3 (Public Review):

      Summary: The manuscript authored by Lan Guan and colleagues reveals the structure of the cytosol-facing conformation of the MelB sodium/Li coupled permease using the nab-Fab approach and cryoEM for structure determination. The study reveals the conformational transitions in the melB transport cycle and allows understanding the role of sugar and ion specificities within this transporter.

      Strengths: The study employs a very exciting strategy of transferring the CDRS of a conformation specific nano body to the nab-fab system to determine the inward-open structure of MelB. The resolution of the structure is reasonable enough to support the major conclusions of the study. This is overall a well-executed study.

      Thank you for your positive comments.

      Weaknesses: The authors seem to have mixed up the exothermic and endothermic aspects of ITC binding in their description. Positive heats correspond to endothermic heat changes in ITC and negative heat changes correspond to exothermic heats. The authors seem to suggest the opposite.

      This is consistently observed throughout the manuscript.

      All of our ITC data are correctly presented. Our data were collected from the NanoITC (TA instruments, Inc), which directly measures the heat release/enthalpic changes and projects exotherm with positive values. This is in contrast to the MicroCal device, which detects heat changes through voltage compensation and exotherm is depicted with negative values. We will further emphasize this in related figure legends.

    1. Author Response

      The following is the authors’ response to the original reviews.

      Reviewer #1:

      This manuscript describes a set of four passage-reading experiments which are paired with computational modeling to evaluate how task-optimization might modulate attention during reading. Broadly, participants show faster reading and modulated eye-movement patterns of short passages when given a preview of a question they will be asked. The attention weights of a Transformerbased neural network (BERT and variants) show a statistically reliable fit to these reading patterns above-and-beyond text- and semantic-similarity baseline metrics, as well as a recurrent-networkbased baseline. Reading strategies are modulated when questions are not previewed, and when participants are L1 versus L2 readers, and these patterns are also statistically tracked by the same transformer-based network.

      I should note that I served as a reviewer on an earlier version of this manuscript at a different venue. I had an overall positive view of the paper at that point, and the same opinion holds here as well.

      Strengths:

      • Task-optimization is a key notion in current models of reading and the current effort provides a computationally rigorous account of how such task effects might be modeled

      • Multiple experiments provide reasonable effort towards generalization across readers and different reading scenarios

      • Use of RNN-based baseline, text-based features, and semantic features provides a useful baseline for comparing Transformer-based models like BERT

      Thank you for the accurate summary and positive evaluation.

      Weaknesses:

      1) Generalization across neural network models seems, to me, somewhat limited: The transformerbased models differ from baseline models in numerous ways (model size, training data, scoring algorithm); it is thus not clear what properties of these models necessarily supports their fit to human reading patterns.

      Thank you for the insightful comment. To dissociate the effect of model architecture and the effect of training data, we have now compared the attention weights across three transformer-based models that have the same architecture but different training data/task: randomized (with all model parameters being randomized), pretrained, and fine-tuned models. Remarkably, even without training on any data, the attention weights in randomly initialized models exhibited significant similarity to human attention patterns (Figure. 3A). The predictive power of randomly initialized transformer-based models outperformed that of the SAR model. Through subsequent pre-training and fine-tuning, the predictive capacity of the models was further elevated. Therefore, both model architecture and the training data/task contribute to human-like attention distribution in the transformer models. We have now reported this result:

      “The attention weights of randomly initialized transformer-based models could predict the human word reading time and the predictive power, which was around 0.3, was significantly higher than the chance level and the SAR (Fig. 3A, Table S1). The attention weights of pre-trained transformerbased models could also predict the human word reading time, and the predictive power was around 0.5, significantly higher than the predictive power of heuristic models, the SAR, and randomly initialized transformer-based models (Fig. 3A, Table S1). The predictive power was further boosted for local but not global questions when the models were fine-tuned to perform the goal-directed reading task (Fig. 3A, Table S1).”

      In addition, we reported how training influenced the sensitivity of attention weights to text features and question relevance. As shown in Figure 4AB, attention in the randomized models were sensitive to text features across all layers. After pretraining, the models exhibited increased sensitivity to text features in the shallow layers, and decreased sensitivity to text features in deep layers. Subsequent finetuning on the reading comprehension task further attenuates the encoding of text features in deep layers but strengthens the sensitivity to task-relevant information.

      2) Inferential statistics are based on a series of linear regressions, but these differ markedly in model size (BERT models involve 144 attention-based regressor, while the RNN-based model uses just 1 attention-based regressor). How are improvements in model fit balanced against changes in model size?

      Thank you for pointing out this issue. The performance of linear regressions was evaluated based on 5-fold cross-validation, and the performance we reported was the performance on the test set. To match the number of parameters, we have now predicted human attention using the average of all heads. The predictive power of the average head was still significantly higher than the predictive power of the SAR model. We have now reported this result in our revised manuscript:

      “For the fine-tuned models, we also predict the human word reading time using an unweighted averaged of the 144 attention heads and the predictive power was 0.3, significantly higher than that achieved by the attention weights of SAR (P = 4 × 10-5, bootstrap).”

      Also, it was not clear to me how participant-level variance was accounted for in the modeling effort (mixed-effects regression?) These questions may well be easily remedied by more complete reporting.

      In the previous manuscript, the word reading time was averaged across participants, and we did not consider the variance between participants. We have now analyzed eye movements of each participant and used the linear mixed effects model to test how different factors affected human word reading time to account for participantslevel and item-level variances.

      “Furthermore, a linear mixed effect model also revealed that more than 85% of the DNN attention heads contribute to the prediction of human reading time when considering text features and question relevance as covariates (Supplementary Results).”

      “Supplementary Methods To characterize the influences of different factors on human word reading time, we employed linear mixed effects models [5] implemented in the lmerTest package [6] of R. For the baseline model, we treated the type of questions (local vs. global; local = baseline) and all text/task-related features as fixed factors, and considered the interaction between the type of questions and these text/taskrelated features. We included participants and items (i.e., questions) as random factors, each with associated random intercepts…”

      Supplementary Results The baseline mixed model revealed significant fixed effects for question type and all text/task-related features, as well as significant interactions between question type and these text/task-related features (Table S7). Upon involving SAR attention, we observed a statistically significant fixed effect associated with SAR attention. When involving attention weights of randomly initialized BERT, the mixed model revealed that most attention heads exhibited significant fixed effects, suggesting their contributions to the prediction of human word reading time. A broader range of attention heads showed significant fixed effects for both pre-trained and fine-tuned BERT.

      3) Experiment 1 was paired with a relatively comprehensive discussion of how attention weights mapped to reading times, but the same sort of analysis was not reported for Exps 2-4; this seems like a missed opportunity given the broader interest in testing how reading strategies might change across the different parameters of the four experiments.

      Thank you for the valuable suggestion. We have now also characterized how different reading measures, e.g., gaze duration and counts or rereading, were affected by text and task-related features in Experiments 2-4.

      For Experiment 2: “For local questions, consistent with Experiment 1, the effects of question relevance significantly increased from early to late processing stages that are separately indexed by gaze duration and counts of rereading (Fig. S9A, Table S3).”

      For Experiment 3: “For local questions, the layout effect was more salient for gaze duration than for counts of rereading. In contrast, the effect of word-related features and task relevance was more salient for counts of rereading than gaze duration (Fig. S9B, Table S3).”

      For Experiment 4: “Both the early and late processing stages of human reading were significantly affected by layout and word features, and the effects were larger for the late processing stage indexed by counts of rereading (Fig. S9C, Table S3).”

      4) Comparison of predictive power of BERT weights to human annotations of text relevance is limited: The annotation task asked participants to chose the 5 "most relevant" words for a given question; if >5 words carried utility in answering a question, this would not be captured by the annotation. It seems to me that the improvement of BERT over human annotations discussed around page 10-11 could well be due to this arbitrary limitation of the annotations.

      Thank you for the insightful comment. We only allowed a participant to label 5 words since we wanted the participant to only label the most important information. As the reviewer pointed out, five words may not be enough. However, this problem is alleviated by having >26 annotators per question. Although each participant can label up to 5 words, pooling the results across >26 annotators results in nonzero relevance rating for an average 21.1 words for local questions and 26.1 words for global question. More important, as was outlined in Experimental Materials, we asked additional participants to answer questions based on only 5 annotated keywords. The accuracy for question answering were 75.9% for global questions and 67.6% for local questions, which was close to the accuracy achieved when the complete passage was present (Fig. 1B), suggesting that even 5 keywords could support question answering.

      5) Abstract ln 35: This concluding sentence didn't really capture the key contribution of the paper which, at least from my perspective, was something closer to "we offer a computational account of how task optimization modulates attention during reading"

      p 4 ln 66: I think this sentence does a good job capturing the main contributions of this paper

      Thanks for your suggestion. We have modified our conclusion in Abstract accordingly.

      6) p 4 ln 81: "therefore is conceptually similar" maybe "may serve a conceptually similar role"

      We have rewritten the sentence.

      “Attention in DNN also functions as a mechanism to selectively extract useful information, and therefore attention may potentially serve a conceptually similar role in DNN.”

      7) p. 7 ln 140: "disproportional to the reading time" I didn't understand this sentence

      Sorry for the confusion and we have rewritten the sentence.

      “In Experiment 1, participants were allowed to read each passage for 2 minutes. Nevertheless, to encourage the participants to develop an effective reading strategy, the monetary reward the participant received decreased as they spent more time reading the passage (see Materials and Methods for details).”

      8) p 8 ln 151: This was another sentence that helped solidify the main research contributions for me; I wonder if this framing could be promoted earlier?

      Thank you for the suggestion and we have moved the sentence to Introduction.

      9) p. 33: I may be missing something here, but I didn't follow the reasoning behind quantifying model fit against eye-tracking measures using accuracy in a permutation test. Models are assessed in terms of the proportion of random shuffles that show a greater statistical correlation. Does that mean that an accuracy value like 0.3 (p. 10 ln 208) means that 0.7 random permutations of word order led to higher correlations between attention weights and RT? Given that RT is continuous, I wonder if a measure of model fit such as RMSE or even R^2 could be more interpretable.

      We have now realized that the term “prediction accuracy” was not clearly defined and have caused confusion. Therefore, in the revised manuscript, we have replaced this term with “predictive power”. Additionally, we have now introduced a clear definition of “prediction power” at its first mention in Result:

      “…the predictive power, i.e., the Pearson correlation coefficient between the predicted and real word reading time, was around 0.2”

      The permutation test was used to test if the predictive power is above chance. Specifically, if the predictive power is higher than the 95 percentile of the chancelevel predictive power estimated using permutations, the significant level (i.e., the p value) is 0.05. We have explained this in Statistical tests.

      10) p. 33: FDR-based multiple comparisons are noted several times, but wasn't clear to me what the comparison set is for any given test; more details would be helpful (e.g. X comparisons were conducted across passages/model-variants/whatever)

      Sorry for missing this important information. We have now mentioned which comparisons are corrected,

      “…Furthermore, the predictive power was higher for global than local questions (P = 4 × 10-5, bootstrap, FDR corrected for comparisons across 3 features, i.e., layout features, word features, and question relevance)…”

      Reviewer #2:

      In this study, researchers aim to understand the computational principles behind attention allocation in goal-directed reading tasks. They explore how deep neural networks (DNNs) optimized for reading tasks can predict reading time and attention distribution. The findings show that attention weights in transformer-based DNNs predict reading time for each word. Eye tracking reveals that readers focus on basic text features and question-relevant information during initial reading and rereading, respectively. Attention weights in shallow and deep DNN layers are separately influenced by text features and question relevance. Additionally, when readers read without a specific question in mind, DNNs optimized for word prediction tasks can predict their reading time. Based on these findings, the authors suggest that attention in real-world reading can be understood as a result of task optimization.

      The research question pursued by the study is interesting and important. The manuscript was well written and enjoyable to read. However, I do have some concerns.

      We thank the reviewer for the accurate summary and positive evaluation.

      1) In the first paragraph of the manuscript, it appears that the purpose of the study was to test the optimization hypothesis in natural tasks. However, the cited papers mainly focus on covert visual attention, while the present study primarily focuses on overt attention (eye movements). It is crucial to clearly distinguish between these two types of attention and state that the study mainly focuses on overt attention at the beginning of the manuscript.

      Thank you for pointing out this issue. We have explicitly mentioned that we focus on overt attention in the current study. Furthermore, we have also discussed that native readers may rely more on covert attention so that they do not need to spend more time overtly fixating at the task relevant words.

      In Introduction:

      “Reading is one of the most common and most sophisticated human behaviors [16, 17], and it is strongly regulated by attention: Since readers can only recognize a couple of words within one fixation, they have to overtly shift their fixation to read a line of text [3]. Thus, eye movements serve as an overt expression of attention allocation during reading [3, 18].”

      In Discussion:

      “Therefore, it is possible that when readers are more skilled and when the passage is relatively easy to read, their processing is so efficient so that they do not need extra time to encode task-relevant information and may rely on covert attention to prioritize the processing of task-relevant information.”

      2) The manuscript correctly describes attention in DNN as a mechanism to selectively extract useful information. However, eye-movement measures such as gaze duration and total reading time are primarily influenced by the time needed to process words. Therefore, there is a doubt whether the argument stating that attention in DNN is conceptually similar to the human attention mechanism at the computational level is correct. It is strongly suggested that the authors thoroughly discuss whether these concepts describe the same or different things.

      Thank you for bringing up this very important issue and we have added discussions about why human and DNN may generate similar attention distributions. For example, we found that both DNN and human attention distributions are modulated by task relevance and word properties, which include word length, word frequency, and word surprisal. The influence of task relevance is relatively straightforward since both human readers and DNN should rely more on task relevant words to answer questions. The influence of word properties is less apparent for models than for human readers and we have added discussions:

      For DNN’s sensitivity to word surprisal:

      “The transformer-based DNN models analyzed here are optimized in two steps, i.e., pre-training and fine-tuning. The results show that pre-training leads to text-based attention that can well explain general-purpose reading in Experiment 4, while the fine-tuning process leads to goal-directed attention in Experiments 1-3 (Fig. 4B & Fig. 5A). Pre-training is also achieved through task optimization, and the pre-training task used in all the three models analyzed here is to predict a word based on the context. The purpose of the word prediction task is to let models learn the general statistical regularity in a language based on large corpora, which is crucial for model performance on downstream tasks [21, 22, 33], and this process can naturally introduce the sensitivity to word surprisal, i.e., how unpredictable a word is given the context.”

      For DNN’s sensitivity to word length:

      “Additionally, the tokenization process in DNN can also contribute to the similarity between human and DNN attention distributions: DNN first separates words into tokens (e.g., “tokenization” is separated into “token” and “ization”). Tokens are units that are learned based on co-occurrence of letters, and is not strictly linked to any linguistically defined units. Since longer words tend to be separated into more tokens, i.e., fragments of frequently co-occurred letters, longer words receive more attention even if the model pay uniform attention to each of its input, i.e., a token.”

      3) When reporting how reading time was predicted by attention weights, the authors used "prediction accuracy." While this measure is useful for comparing different models, it is less informative for readers to understand the quality of the prediction. It would be more helpful if the results of regression models were also reported.

      Sorry for the confusion. The prediction accuracy was defined as the correlation coefficient between the predicted and actual eye-tracking measures. We have now realized that the term “prediction accuracy” might have caused confusion. Therefore, in the revised manuscript, we have replaced this term with “predictive power”. Additionally, we have now introduced a clear definition of “prediction power” at its first mention in Result:

      “…the predictive power, i.e., the Pearson correlation coefficient between the predicted and real word reading time, was around 0.2”

      4) The motivations of Experiments 2 and 3 could be better described. In their current form, it is challenging to understand how these experiments contribute to understanding the major research question of the study.

      Thank you for pointing out this issue. In Experiments 1, different types of questions were presented in separate blocks, and all the participants were L2 reader. Therefore, we conducted Experiments 2 and 3 to examine how reading behaviors were modulated when different types of questions were presented in a mixed manner, or when participants were L1 readers. We have now clarified the motivations:

      “In Experiment 1, different types of questions were presented in blocks which encouraged the participants to develop question-type-specific reading strategies. Next, we ran Experiment 2, in which questions from different types were mixed and presented in a randomized order, to test whether the participants developed question-type-specific strategies in Experiment 1.”

      “Experiments 1 and 2 recruited L2 readers. To investigate how language proficiency influenced task modulation of attention and the optimality of attention distribution, we ran Experiment 3, which was the same as Experiment 2 except that the participants were native English readers.”

      Reviewer #3:

      This paper presents several eyetracking experiments measuring task-directed reading behavior where subjects read texts and answered questions.

      It then models the measured reading times using attention patterns derived from deep-neural network models from the natural language processing literature.

      Results are taken to support the theoretical claim that human reading reflects task-optimized attention allocation.

      STRENGTHS:

      1) The paper leverages modern machine learning to model a high-level behavioral task (reading comprehension). While the claim that human attention reflects optimal behavior is not new, the paper considers a substantially more high-level task in comparison to prior work. The paper leverages recent models from the NLP literature which are known to provide strong performance on such question-answering tasks, and is methodologically well grounded in the NLP literature.

      2) The modeling uses text- and question-based features in addition to DNNs, specifically evaluates relevant effects, and compares vanilla pretrained and task-finetuned models. This makes the results more transparent and helps assess the contributions of task optimization. In particular, besides finetuned DNNs, the role of the task is further established by directly modeling the question relevance of each word. Specifically, the claim that human reading is predicted better by task-optimized attention distributions rests on (i) a role of question relevance in influencing reading in Expts 1-2 but not 4, and (ii) the fact that fine-tuned DNNs improve prediction of gaze in Expts 1-2 but not 4.

      3) The paper conducts experiments on both L2 and L1 speakers.

      We thank the reviewer for the accurate summary and positive evaluation.

      WEAKNESSES:

      1) The paper aims to show that human gaze is predicted the the DNN-derived task-optimal attention distribution, but the paper does not actually derive a task-optimal attention distribution. Rather, the DNNs are used to extract 144 different attention distributions, which are then put into a regression with coefficients fitted to predict human attention. As a consequence, the model has 144 free parameters without apparent a-priori constraint or theoretical interpretation. In this sense, there is a slight mismatch between what the modeling aims to establish and what it actually does.

      Regarding Weakness (1): This weakness should be made explicit, at least by rephrasing line 90. The authors could also evaluate whether there is either a specific attention head, or one specific linear combination (e.g. a simple average of all heads) that predicts the human data well.

      Thank you for pointing out this issue. One the one hand, we have now also predicted human attention using the average of all heads, i.e., the simple average suggested by the reviewer. The predictive power of the average head was still significantly higher than the predictive power of the SAR model. We have now reported this result in our revised manuscript.

      “For the fine-tuned models, we also predict the human word reading time using an unweighted averaged of the 144 attention heads and the predictive power was 0.3, significantly higher than that achieved by the attention weights of SAR (P = 4 × 10-5, bootstrap).”

      On the other hand, since different attention weights may contribute differently to the prediction of human reading time, we have now also reported the weights assigned to individual attention head during the original regression analysis (Fig. S4). It was observed that the weight was highly distributed across attention head and was not dominated by a single head.

      Even more importantly, we have now rephrased the statement in line 90 of the previous manuscript:

      “We employed DNNs to derive a set of attention weights that are optimized for the goal-directed reading task, and tested whether such optimal weights could explain human attention measured by eye tracking.”

      Furthermore, in Discussion, we mentioned that:

      “Furthermore, we demonstrate that both humans and transformer-based DNN models achieve taskoptimal attention distribution in multiple steps… Similarly, the DNN models do not yield a single attention distribution, and instead it generates multiple attention distributions, i.e., heads, for each layer. Here, we demonstrate that basic text features mainly modulate the attention weights in shallow layers, while the question relevance of a word modulates the attention weights in deep layers, reflecting hierarchical control of attention to optimize task performance. The attention weights in both the shallow and deep layers of DNN contribute to the explanation of human word reading time (Fig. S4).”

      2) While Experiment 1 tests questions from different types in blocks, and the paper mentions that this might encourage the development of question-type-specific reading strategies -- indeed, this specifically motivates Experiment 2, and is confirmed indirectly in the comparison of the effects found in the two experiments ("all these results indicated that the readers developed question-typespecific strategies in Experiment 1") -- the paper seems to miss the opportunity to also test whether DNNs fine-tuned for each of the question-types predict specifically the reading times on the respective question types in Experiment 1. Testing not only whether DNN-derived features can differentially predict normal reading vs targeted reading, but also different targeted reading tasks, would be a strong test of the approach.

      Regarding Weakness (2): results after finetuning for each question type could be reported.

      Thank you for the valuable suggestion. We have now fine-tuned the models separately based on global and local questions. The detailed fine-tuning parameters employed in the fine-tuning process were presented in Author response table 1.

      Author response table 1.

      The hyperparameter for fine-tuning DNN models with specific question type.

      The fine-tuning process yielded a slight reduction in loss (i.e., the negative logarithmic score of the correct option) on the validation set. Specifically, for BERT, the loss decreased from 1.08 to 0.96; for ALBERT, it decreased from 1.16 to 0.76; for RoBERTa, it went down from 0.68 to 0.54. Nevertheless, the fine-tuning process did not improve the prediction of reading time (Author response image 1). A likely reason is that the number of global and local questions for training is limited (local questions: 520; global questions: 280), and similar questions also exist in RACE dataset that is used for the original fine tuning (sample size: 87,866). Therefore, a small number of questions can significantly change the reading strategy of human readers but using these questions to effectively fine-tune a model seems to be a more challenging task.

      Author response image 1.

      Fine-tuning based on local and global questions does not significantly modulate the prediction of human reading time. Lighter-color symbols show the results for the 3 BERT-family models (i.e., BERT, ALBERT, and RoBERTa) and the darker-color symbols show the average over the 3 BERT-family models. trans_fine: model fine-tuned based on the RACE dataset; trans_local: models additionally fine-tuned using local questions; trans_global: models additionally fine-tuned using global questions.

      3) The paper compares the DNN-derived features to word-related features such as frequency and surprisal and reports that the DNN features are predictive even when the others are regressed out (Figure S3). However, these features are operationalized in a way that puts them at an unfair disadvantage when compared to the DNNs: word frequency is estimated from the BNC corpus; surprisal is derived from the same corpus and derived using a trigram model. The BNC corpus contains 100 Million words, whereas BERT was trained on several Billions of words. Relatedly, trigram models are now far surpassed by DNN-based language models. Specifically, it is known that such models do not fit human eyetracking reading times as well as modern DNN-based models (e.g., Figure 2 Dundee in: Wilcox et al, On the Predictive Power of Neural Language Models for Human Real-Time Comprehension Behavior, CogSci 2020). This means that the predictive power of the word-related features is likely to be underestimated and that some residual predictive power is contained in the DNNs, which may implicitly compute quantities related to frequency and surprisal, but were trained on more data. In order to establish that the DNN models are predictive over and above word-related features, and to reliably quantify the predictive power gained by this, the authors could draw on (1) frequency estimated from the corpora used for BERT (BookCorpus + Wikipedia), (2) either train a strong DNN language model, or simply estimate surprisal from a strong off-the-shelf model such as GPT-2.

      This concern does not fundamentally cast doubt on the conclusions, since the authors found a clear effect of the task relevance of individual words, which by definition is not contained in those baseline models. However, Figure S3 -- specifically Figure S3C -- is likely to inflate the contribution of the DNN model over and above the text-based features.

      Thank you for pointing out these issues. Following the valuable suggestion of the reviewer, we have now 1) computed word frequencies based on BookCorpus and Wikipedia and 2) calculated word surprisal using GPT-2.

      “The word features included word length, logarithmic word frequency estimated based on the BookCorpus [62] and English Wikipedia using SRILM [68], and word surprisal estimated from GPT-2 Medium [69].”

      These recalculated word frequency and surprisal are correlated with the original measures (word frequency: 0.98; surprisal: 0.59), and the updated results are also closely aligned with those reported in the previous manuscript.

      Others:

      1) How does the statistical modeling take into account that measures are repeated both within the items (same texts read by different subjects) and within the subjects (some subject read multiple texts)? I only see the items-level repetition be addressed in line 715-721 in comparing between local and global questions, but not elsewhere. The standard approach in the literature on human reading times (e.g. the Wilcox et al paper mentioned above, or ref. 44) is to use mixed-effects regression with appropriate random effects for items and subjects. The same question applies to the calculation of chance accuracy (line 702-709), which is done by shuffling words within a passage. Relatedly, how exactly was cross-validation (line 681) calculated? On the level of subjects, individual words, trials, texts, ...?

      Thank you for raising up this issue. In the previous manuscript, the word reading time was averaged across participants. The cross-validation was conducted on the level of texts (i.e., passages). Following the valuable suggestion, we have now separately analyzed each participant and applied the linear mixed effects models.

      “Furthermore, a linear mixed effect model also revealed that more than 85% of the DNN attention heads contribute to the prediction of human reading time when considering text features and question relevance as covariates (Supplementary Results).”

      “Supplementary Methods To characterize the influences of different factors on human word reading time, we employed linear mixed effects models [5] implemented in the lmerTest package [6] of R. For the baseline model, we treated the type of questions (local vs. global; local = baseline) and all text/task-related features as fixed factors, and considered the interaction between the type of questions and these text/taskrelated features. We included participants and items (i.e., questions) as random factors, each with associated random intercepts…”

      Supplementary Results The baseline mixed model revealed significant fixed effects for question type and all text/task-related features, as well as significant interactions between question type and these text/task-related features (Table S7). Upon involving SAR attention, we observed a statistically significant fixed effect associated with SAR attention. When involving attention weights of randomly initialized BERT, the mixed model revealed that most attention heads exhibited significant fixed effects, suggesting their contributions to the prediction of human word reading time. A broader range of attention heads showed significant fixed effects for both pre-trained and fine-tuned BERT.

      2) I could not find any statement about code availability (only about data availability). Will the source code and statistical analysis code also be made available?

      We have added the code availability statement.

      “The code is now available at https://github.com/jiajiezou/TOA.”

      3) The theoretical claim, and some basic features of the research, are quite similar to other recent work (Hahn and Keller, Modeling task effects in human reading with neural network-based attention, Cognition, 2023; cited with very little discussion as ref 44), which also considered task-directed reading in a question-answering task and derived task-optimized attention distributions. There are various differences, and the paper under consideration has both weaknesses and strengths when compared to that existing work -- e.g., that paper derived a single attention distribution from task optimization, but the paper under consideration provides more detailed qualitative analysis of the task effects, uses questions requiring more high-level reasoning, and uses more state-of-the-art DNNs.

      The paper would benefit from being more explicit about how the work under review provides a novel angle over Ref 44 (Hahn and Keller, Cognition, 2023).

      Thanks for bringing up this issue. We have now incorporated a more comprehensive discussion that compare the current study with the recent work conducted by Hahn and Keller:

      “When readers read a passage to answer a question that can be answered using a word-matching strategy [45], a recent study has demonstrated that the specific reading goal modulates the word reading time and the effect can be modeled using a RNN model [46]. Here, we focus on questions that cannot be answered using a word-matching strategy (Fig. 1B) and demonstrate that, for these challenging questions, attention is still modulated by the reading goal but the attention modulation cannot be explained by a word-matching model (Fig. S3). Instead, the attention effect is better captured by transformer models than an advanced RNN model, i.e., the SAR (Fig. 3A). Combining the current study and the study by Hahn et al. [46], it is possible that the word reading time during a general-purpose reading task can be explained by a word prediction task, the word reading time during a simple goal-directed reading task that can be solved by word matching can be modeled by a RNN model, while the word reading time during a more complex goal-directed reading task involving inference is better modeled using a transformer model. The current study also further demonstrates that elongated reading time on task-relevant words is caused by counts of rereading and further studies are required to establish whether earlier eye movement measures can be modulated by, e.g., a word matching task.”

      4) In Materials&Methods, line 599-636, specifically when "pretraining" is mentioned (line 632), it should be mentioned what datasets these DNNs were pretrained on.

      We have now mentioned this in the revised manuscript:

      “The pre-training process aimed to learn general statistical regularities in a language based on large corpora, i.e., BooksCorpus [62] and English Wikipedia…”

    1. Author Response

      Reviewer 1 (Public Review)

      Summary: The authors have made a novel and important effort to distinguish and include different sources of active deformations for fitting C elegans embryo development: cyclic muscle contrac- tions and actomyosion circumferential stresses. The combination and synchronisation of both contributions are, according to the model, responsible for different elongation rates, and can in- duce bending and torsion deformations, which are a priori not expected from purely contractile forces. The model can be applied to other growth processes in initially cylindrical shapes.

      Strengths: The model allows us to fit and deduce specific growth patterns, frequencies, and lo- cations of contractions that yield the observed axial elongation during the 240 min of the studied process.

      The deformation gradient is decomposed according to muscle and actomyosin activity, which can be distinguished and quantified. An energy-transferring process allows for the retrieval of the nec- essary permanent deformations that embryo development requires.

      Weaknesses: Despite the completeness of the model, the explanation of the methodology needs to be improved. Parameters and quantities are not always explained in the main text and are intro- duced on some occasions in an ordered manner. This makes the comprehension and deduction of methodology difficult. There are some minor comments that are listed below. The most important points are:

      How are the authors sure that there is a torsional deformation? Without tracking the muscle fibers, bending with respect to different angles for different Zs may yield a shape similar to the one in Figure 6E. Furthermore, it is unclear why the model yields torsion deformation. If material points of actomyosin rings do not change in reference configuration, no helicoidal growth should be happening.

      Our torsional deformations were obtained computationally, and the results are plotted in Figure 6 according to our formalism. In our approach, the torsional deformation results from the interaction between the vertical muscles and the circumferential actin network: the muscles bend the cylinder and the bending modifies the direction of the actin fibers, as demonstrated in the experiment.

      -The triple decomposition 𝐹 = 𝐹𝑒 ⋅ 𝐺𝑖 ⋅ 𝐺0 seems to complicate the expressions of growth and requires the use of angles alpha and beta due to the initial deformation 𝐺0. Why not use a simpler decomposition 𝐹 = 𝐹𝑒 ⋅ 𝐺, where 𝐺 contains all contributions from actomyosin and muscle contrac- tions in a material frame? This would avoid considering angles alpha and beta.

      𝐺0 represents the active strain during the early elongation stage and 𝐺𝑖 during the late elongation stage respectively. Such a decomposition which is not mandatory, allows a better un- derstanding. In addition, due to the late elongation stage, both muscle and actin networks must be considered, and their orientation changes with deformation. Therefore, it is clearer and simpler to express the active strain in terms of alpha and beta angles.

      The section "Energy transformation and Elongation" is unclear. Indeed, stresses need to relax, oth- erwise, the removal of muscle and actin activity would send the embryo back to its initial state. How- ever, the rationale behind the energy transfer is not explained. Authors seem to impose 𝑊𝑐 = 𝑊𝑟, and from this deduce the necessary actin contraction after muscle relaxation. Why should energy be maintained when muscle relaxes? Which mechanism physically imposes this energy transfer? Muscle contraction could indeed induce elongation if traction forces at the opposite side of the contracting muscle relax. In fact, an alternative approach for obtaining stress relaxation and axial elongation would be converting part of the elastic deformation 𝐹𝑒 to a permanent deformation 𝐹𝑝.

      In this section, we do assume that all the energy accumulated by the muscle contrac- tions will be converted into the energy necessary for elongation, and as our estimate in the article shows, 𝑊𝑐 is indeed greater than 𝑊𝑟, indicating that a significant fraction of 𝑊𝑐 is converted into dissipation and friction, but also into the reorganization of the actin cables. Indeed, elongation of the cylinder induces a significant reduction in the experimentally observed and also in the actin cable density. However, this reduction in cable density is not observed experimentally. Thus, elon- gation requires a reorganization of the actin network, which is part of the energy consumption and which explains the existence of a permanent deformation 𝐹𝑝.

      Self contact is ignored. This may well be a shape generator and responsible for bending deforma- tions. The convoluted shape of the embryo in the confined space deserves at least commenting on this limitation of the model.

      Thank you for your suggestion. We have considered the effect of contact between C. elegans and the eggshell in the energy dissipation section but we also agree that the self-contact of the worm in confinement will be important. Here, we focus mainly on active filaments: actomyosin and muscle, and we restrict ourselves to a cylindrical shell that is far from the embryo.

      Reviewer 2 (Public Review)

      Summary

      During C. elegans development, embryos undergo elongation of their body axis in the absence of cell proliferation or growth. This process relies in an essential way on periodic contractions of two pairs of muscles that extend along the embryo’s main axis. How contraction can lead to extension along the same direction is unknown.

      To address this question, the authors use a continuum description of a multicomponent elastic solid. The various components are the interior of the animal, the muscles, and the epidermis. The different components form separate compartments and are described as hyperelastic solids with different shear moduli. For simplicity, a cylindrical geometry is adopted. The authors consider first the early elongation phase, which is driven by contraction of the epidermis, and then late elongation, where contraction of the muscles injects elastic energy into the system, which is then released by elongation. The authors get elongation that can be successfully fitted to the elongation dynamics of wild-type worms and two mutant strains.

      Strengths

      The work proposes a physical mechanism underlying a puzzling biological phenomenon. The framework developed by the authors could be used to explain phenomena in other organisms and could be exploited in the design of soft robots.

      Weaknesses

      1) This reviewer considers that the quality of the writing is poor. Because of this the main result of this work, how elongation is achieved by contraction, remains unclear to me. In the opinion of this reviewer, the work is not accessible to a biologist. This is a real pity because the findings are potentially of great interest to developmental biologists and engineers alike.

      We regret that, despite a general introduction and a number of figures, the work does not seem accessible to biologists.

      2) The authors assume that the embryo is elastic throughout all stages of development. Is this assumption appropriate? In my opinion, the authors need to critically discuss this assumption and provide justification. Would this still be true for the adult? If so could the adult relax back to the state prior to elongation? The embryo should be able to do that, if the contractility of the epidermis were sufficiently reduced, right?

      Soft tissues are elastic, the modeling of soft tissues, even with large deformations, is now well established. The difference between a worm embryo and an adult is first of all the quality of the tissues, their low degree of heterogeneity, the weakness of the muscles and the absence of bones. As for the question of complete relaxation of the stresses, the fact that different components are attached to each other limits complete relaxation. We keep our fingerprints and cortical undula- tions, although they originate from an elastic instability that occurs in fetal life. It never disappears.

      The authors impose strains rather than stress. Since they want to understand the final deformation, I find this surprising. Maybe imposing strain or stress is equivalent, but then you should discuss this.

      Perhaps, the referee has in mind the question of active strain versus active stress and is concerned about the representation of biological forces such as those produced by actomyosin or muscle. In fact, both exist in morphoelasticity and are, of course, related. Usually, the choice is dictated by the simplicity of deriving quantitative results for comparison with experiments.

      4) Does your mechanism need 4 muscle strands or would 2 be sufficient?

      First, the 4 muscle strands are consistent with real C. elegans structures, and second, although we assume that two muscles on the same side contract simultaneously, their size and position affect the deformation results. Also, the time period we consider is just before the worm hatches. After that, the worm has to slide on the ground. So efficient muscles are needed.

      5) It is sometimes hard to understand, whether the authors are talking about the model or the worm.

      It will be corrected in the new version.

    1. Author Response

      The following is the authors’ response to the original reviews.

      The authors thank the reviewers for their thoughtful and constructive comments. We address each comment below and have uploaded a revised manuscript.

      Public Reviews

      1) One key point that could use further clarification is how to interpret densities in the reconstruction that do overlap with the template. If the omitted regions can be reliably reconstructed, and the density is smooth throughout, it implies the detected particles are not only (mostly) true positives but also their poses must be essentially correct. Therefore, why cannot the entire reconstruction be trusted, including portions overlapping with the template? In the "Future applications" section, the authors state that in order to obtain a reconstruction that is entirely devoid of template bias, it would be necessary to successively omit parts of the template structure through its entirety. I wonder if that is really necessary and if the presented approach of omitting template portions could be better framed as a "gold-standard" validation procedure.

      Our assumption is indeed that the entire reconstruction can be trusted if the omitted features are faithfully reproduced in the reconstruction. We have added a sentence in the discussion to clarify this. However, we think that assessing template bias will still require the omit test (see also our reply below). Also, as discussed in the manuscript, there is likely a little bias left, even if it is not directly visible in the reconstruction. Therefore, if the goal is an entirely unbiased reconstruction, the only way will be to successively omit parts of the template structure throughout the template.

      2) In other words, given the compelling evidence provided by the reconstructions in the omitted areas, I find it hard to imagine how the procedure would be "hallucinating" features in the rest of the structure, as the entire reconstruction depends on the same pose and defocus parameters. A possible experiment to test this hypothesis would be to go the opposite way, deliberately adding an unrealistic feature to the bait and checking whether it comes up in the reconstruction, while at the same time checking how it behaves in omitted parts.

      Template bias might be generated in different ways. A common situation is the presence of noise, which causes biased deviations of the best template match from their “true” match that would just align the target signal to the template. Another type of bias may occur when there is a mismatch between the template and the detected target. The target may still be detected if there is sufficient structural overlap with the template. Since there might not be a clear “correct” alignment of a mismatching target to the template, the best alignment may again be biased, generating artificial density in the reconstruction. This second case may produce bias that is more pronounced in the mismatching regions. The different origins of bias will have to be investigated more thoroughly in another study. For the present study, however, we maintain that unless there is some assessment of bias in a given location, one cannot completely rule out bias based on the absence of it elsewhere in the reconstruction.

      3) When assessing their approach to in situ data (the yeast ribosome), it is intriguing to see that the resolution downgraded from 3.1 to 8 Å when refinement of the particle poses against the current reconstruction was attempted. The authors do provide some possible explanations, such as the reduced signal of the reconstruction at high resolution and the crowded background, but it leaves one to wonder if this means that a 3.1 Å reconstruction could never be obtained from these data by conventional single-particle analysis procedures.

      The refinement results with our in situ data do indeed appear to be limited to low resolution when using the conventional single-particle pipeline and software. It might be possible to improve refinement by introducing certain priors, filters and masking functions that are optimized for the increased background and spectral properties of in situ data. Also, we have not tested all available software, and some might perform better than others. It is worth noting that in a different study using our data, by Cheng et al (2023) and cited in our manuscript, the resolution of the refined reconstruction using different software was ~7 Å resolution, i.e., close to what we report here. Finally, refinement of the detected targets against a high-resolution template does work but since it involved the template, we regard this as part of the template matching process.

      4) Furthermore, in the section "Quantifying template bias", the authors make the intriguing statement that there can still be some overfitting of noise even in true positives. I understand this overfitting would occur in the form of errors in the pose and defocus estimation, but a clarification would be helpful.

      We have added a sentence in the Discussion to clarify where this bias may come from.

      5) In the Discussion, the claim that "it is not necessary to use tomography to generate high-resolution reconstructions of macromolecular complexes in cells" is a misconception, at least in part. As demonstrated in works by the same group and others (https://doi.org/10.1016/j.xinn.2021.100166, https://doi.org/10.1038/s41467-023-36175-y, https://doi.org/10.1038/s41586-023-05831-0), 2D imaging of native cellular environments does offer a faster and better way to obtain high-resolution reconstructions compared to tomography. However, tomography provides the entire 3D context of the macromolecules, such as their localization to membranes and the cellular architecture, which can be readily visualized in a tomogram even at low resolution, so methods for structure determination from tilt series data such as subtomogram averaging remain of paramount importance. Most likely, a combination of 2D and 3D imaging approaches will be necessary to retrieve both the highest structural resolution and their cellular context to address biological questions.

      We agree and have modified our statement accordingly.

      6) The "Materials and Methods" section lacks a description of transmission electron microscopy data collection.

      We are sorry for this oversight and have added these details.

      7) Finally, the preprint version of this work posted on bioRxiv (https://doi.org/10.1101/2023.07.03.547552) contains the following competing interests statement, which is missing from the submitted version: "The authors are listed as inventors on a closely related patent application named "Methods and Systems for Imaging Interactions Between Particles and Fragments", filed on behalf of the University of Massachusetts."

      This is correct. The statement was missing in the first version of the uploaded manuscript and was added after consultation with the eLife editorial office.

      8) Quantification of the amount of model bias is then performed using omit maps, where every 20th residue is removed from the template and corresponding reconstructions are compared (for those residues) with the full-template reconstructions. As expected, model bias increases with lower thresholds for the picking. Some model bias (Omega=8%) remains even for very high thresholds. The authors state this may be due to overfitting of noise when template-matching true particles, instead of introducing false positives. Probably, that still represents some sort of problem. Especially because the authors then go on to show that their expectation of the number of false positives does not always match the correct number of false positives, probably due to inaccuracies in the noise model for more complicated images. This may warrant further in-depth discussion in a revised manuscript.

      We have added further thoughts regarding the mismatch between expected and actual number of false positives in the Discussion section. A full understanding of the issue likely requires further study, which is currently underway.

      9) The authors evaluate the effect of high-resolution 2D template matching on template bias in reconstructions, and provide a quantitative metric for overfitting. It is an interesting manuscript that made me reevaluate and correct some mistakes in my understanding of overfitting and template bias, and I'm sure it will be of great use to others in the field. However, its main point is to promote high-resolution 2D template matching (2DTM) as a more universal analysis method for in vitro and, more importantly, in situ data. While the experiments performed to that end are sound and well-executed in principle, I fail to make that specific conclusion from their results.

      We do not see 2DTM as a more universal analysis method for in vitro and in situ data, but as simply as another method that can be used. We have added a sentence in the introduction to clarify this.

      10) The authors correctly point out that overfitting is largely enabled by the presence of false-positives in the data set. They go on to perform their in situ experiments with ribosomes, which provide an extremely favorable amount of signal that is unrealistic for the vast majority of the proteome. This seems cherry-picked to keep the number of false-positives and false-negatives low. The relationship between overfitting/false-positive rate and the picking threshold will remain the same for smaller proteins (which is a very useful piece of knowledge from this study). However, the false-negative rate will increase a lot compared to ribosomes if the same high picking threshold is maintained. This will limit the applicability of 2DTM, especially for less-abundant proteins.

      The reviewer is correct that the lower SNR of smaller targets poses a fundamental limit to 2DTM. We have stated this in previous studies and have added a sentence in the introduction of the current manuscript to clarify this.

      11) I would like to see an ablation study: Take significantly smaller segments of the ribosome (for which the authors already have particle positions from full-template matching, which are reasonably close to the ground-truth), e.g. 50 kDa, 100 kDa, 200 kDa etc., and calculate the false-negative rate for the same picking threshold. If the resulting number of particles does plummet, it would be very helpful to discuss how that affects the utility of 2DTM for non-ribosomes in situ.

      The suggested ablation study is a good idea and was reported by Rickgauer et al (2020), cited in our manuscript. We added our own analysis for this dataset in Figure 4-figure supplement 1 and show the proportion of LSUs detected as a function of template mass, indicating detection limit of ~300 kDa. We also added a note in the Results section to explain that the threshold we use to limit false positives means that there are also false negatives, with a rate that depends on their molecular mass.

      12) Another point of concern is the dramatic resolution decrease to 8 A after multiple iterations of refinement against experimental reconstructions described in line 159. Was this a local search from the poses provided by 2DTM, or something more global? While this is not a manifestation of overfitting as the authors have conclusively shown, I think it adds an important point to the ongoing "But do we really need tomograms, or can we just 2D everything?" debate in the field, which is also central to the 2D part of 2DTM. Reaching 8 A with 12k ribosome particles would be considered a rather poor subtomogram averaging result these days. Being in the "we need tilt series to be less affected by non-Gaussian noise" camp myself, I wonder if this indicates 2D images are inherently worse for in situ samples. If they are, the same limitations would extend to template matching. In that case, shouldn't the authors advocate for 3DTM instead of 2DTM? It may not be needed for ribosomes, but could give smaller proteins the necessary edge.

      We have extensively discussed the advantages and disadvantages of both tomography and 2DTM (Lucas et al, 2021) and think it is not useful to talk in terms of “better” and “worse”. Instead, each technique has its areas of application, and we maintain that a combination of the two may give the best results. The limitation of 8 Å does not apply to reconstructions aligned against high-resolution templates, as demonstrated in the present study. Regarding noise models, there is also need for these in 3DTM, as explained in recent publications: Maurer et al (2023), bioRxiv, doi.org/10.1101/2023.09.06.556487; Cruz-León et al (2023), bioRxiv, doi.org/10.1101/2023.09.05.556310; Chaillet et al (2023), Int. J. Mol. Sci. 24, 13375.

      13) Right now, this study is also an invitation to practitioners who do not understand the picking threshold used here and cannot relate it to other template-matching programs to do a lot of questionable template matching and claim that the results are true because templates are "unoverfittable". I think such undesirable consequences should be discussed prominently.

      We have added a discussion of this point in the Discussion section.

      Recommendations for the authors

      1) Lines 58-59: What does "nominally untilted" mean? Has the lamella pre-tilt (milling angle) been taken into account or not? If yes, how?

      The lamella milling angle was not taken into account, so there is a tilt built into the sample of about 8° that was not compensated for by a counter-tilt of the microscope goniometer. We have added a note to explain this in the text of the manuscript.

      2) Lines 113-114: A brief explanation of the threshold calculation method from Rickgauer et al, 2017 to achieve an expected false positive rate of one per micrograph would be helpful here.

      We describe the equation for estimating the false discovery rate later in the manuscript. We have added a note in the text to point the reader to the relevant section of the manuscript.

      3) For consistency, it would be interesting to include a plot of the SNR peaks found by 2DTM in the in situ dataset, that could be directly compared to Figure 1 - figure supplement 1B.

      We have added this to Figure 2 - figure supplement 1A-C, to directly compare to Figure 1 – figure supplement 1A-C.

      4) Showing model-map FSC curves between the density retrieved from the omitted areas and their respective models would provide further evidence not only that they are correct but to what extent.

      An FSC calculation would be challenging for small regions, such as side chains and drugs, due to masking artifacts. Moreover, the model was built into an in vitro determined map and was not fit into the in vivo map calculated here. Therefore, deviations between the map and model may reflect differences between the two conditions and may not reflect the agreement of the map to the in vivo structure.

      5) Lines 128-130: The figure references are wrong. Here, Figure 1B should probably be Figure 1A (or 1B), and Figure 1C clearly refers to Supplementary Figure 1F (FSC curve).

      We have corrected the incorrect figure references.

      6) Line 125: Wrong figure reference, Figure 1A here refers to Supplementary Figure 1B (cross-correlation peaks).

      We have corrected the incorrect figure references.

      7) I haven't been able to find mention of code availability in the manuscript. Given that it is a major outcome of the study, I think it should be provided.

      The code is available from the cisTEM repository, github.com/timothygrant80/cisTEM, and an executable version of the program measure_template_bias has been posted for download on the cisTEM webpage, cistem.org. We have added a note in the Methods section to point the readers to these resources.

      8) Line 50: "An additional complication of subtomogram averaging for in situ imaging is the selection of valid targets" - This is not specific to subtomogram averaging, but to in situ samples.

      We agree and have updated the text to reflect this.

      9) Line 77: "if this is true for high-resolution features, which are more susceptible to noise overfitting" - This is not intuitive to me. High-resolution features require more information to be overfitted with a constant set of model parameters, thus making their overfitting harder.

      The reviewer is correct that there is more information at high resolution, partially compensating for the low SNR. However, the overall refinement behavior is still dominated by overfitting at high resolution, as we have demonstrated in an earlier publication in Stewart & Grigorieff (2004), Ultramicroscopy 102, 67–84.

      10) Line 316: "Baited reconstruction is substantially faster and a more streamlined" - To back this and other similar statements, it would be helpful if the authors provided some time measurements for the execution of their potentially very computationally expensive search.

      The current implementation of 2DTM requires 45 GPU hours per template per K3 image to search 13 defocus planes. However, for a comparison, the manual work for annotation, as well as additional processing to align and classify sub-tomograms to generate high resolution averages should also be considered in this comparison. These are highly project-dependent and can exceed the time required for 3DTM manifold. We have clarified this in our Discussion section.

      11) Line 319: "We expect focused classification to identify sub-populations to further improve the resolution" - How would this work if refining the 2D data without a high-resolution template resulted in significantly worse resolution even for a ribosome? Or is this meant to be done with prior knowledge of every state?

      Classification can be done using existing single particle software. To avoid alignment errors, as described above, particle alignment angles and shifts are fixed during classification. This leaves only the particle occupancy per class to be refined, which appears to lead to good classification. We have added a brief note to explain this strategy. However, since this is not shown in this manuscript, we have not added a more extensive discussion of particle classification.

      12) Line 354: "without requiring manual intervention or expert knowledge" - Previous expert knowledge was arguably provided in the form of a high-resolution structure.

      We agree with the reviewer and have clarified our statement.

    1. Author Response

      The following is the authors’ response to the original reviews.

      Reviewer #1 (Public Review)

      Summary:

      Huang and colleagues present a method for approximation of linkage disequilibrium (LD) matrices. The problem of computing LD matrices is the problem of computing a correlation matrix. In the cases considered by the authors, the number of rows (n), corresponding to individuals, is small compared to the number of columns (m), corresponding to the number of variants. Computing the correlation matrix has cubic time complexity , which is prohibitive for large samples. The authors approach this using three main strategies:

      1. they compute a coarsened approximation of the LD matrix by dividing the genome into variant-wise blocks which statistics are effectively averaged over;

      2. they use a trick to get the coarsened LD matrix from a coarsened genomic relatedness matrix (GRM), which, with time complexity, is faster when n << m;

      3. they use the Mailman algorithm to improve the speed of basic linear algebra operations by a factor of log(max(m,n)). The authors apply this approach to several datasets.

      Strengths:

      The authors demonstrate that their proposed method performs in line with theoretical explanations.

      The coarsened LD matrix is useful for describing global patterns of LD, which do not necessarily require variant-level resolution.

      They provide an open-source implementation of their software.

      Weaknesses:

      The coarsened LD matrix is of limited utility outside of analyzing macroscale LD characteristics. The method still essentially has cubic complexity--albeit the factors are smaller and Mailman reduces this appreciably. It would be interesting if the authors were able to apply randomized or iterative approaches to achieve more fundamental gains. The algorithm remains slow when n is large and/or the grid resolution is increased.

      Thanks for your positive and accurate evaluation! We acknowledge the weakness and include some sentences in Discussion.

      “The weakness of the proposed method is obvious that the algorithm remains slow when the sample size is large or the grid resolution is increased. With the availability of such as UK Biobank data (Bycroft et al., 2018), the proposed method may not be adequate, and much advanced methods, such as randomized implementation for the proposed methods, are needed.”  

      Reviewer #2 (Public Review)

      Summary:

      In this paper, the authors point out that the standard approach of estimating LD is inefficient for datasets with large numbers of SNPs, with a computational cost of , where n is the number of individuals and m is the number of SNPs. Using the known relationship between the LD matrix and the genomic- relatedness matrix, they can calculate the mean level of LD within the genome or across genomic segments with a computational cost of . Since in most datasets, n<<m, this can lead to major computational improvements. They have produced software written in C++ to implement this algorithm, which they call X-LD. Using the output of their method, they estimate the LD decay and the mean extended LD for various subpopulations from the 1000 Genomes Project data.

      Strengths:

      Generally, for computational papers like this, the proof is in the pudding, and the authors appear to have been successful at their aim of producing an efficient computational tool. The most compelling evidence of this in the paper is Figure 2 and Supplementary Figure S2. In Figure 2, they report how well their X- LD estimates of LD compare to estimates based on the standard approach using PLINK. They appear to have very good agreement. In Figure S2, they report the computational runtime of X-LD vs PLINK, and as expected X-LD is faster than PLINK as long as it is evaluating LD for more than 8000 SNPs.

      Weakness:

      While the X-LD software appears to work well, I had a hard time following the manuscript enough to make a very good assessment of the work. This is partly because many parameters used are not defined clearly or at all in some cases. My best effort to intuit what the parameters meant often led me to find what appeared to be errors in their derivation. As a result, I am left worrying if the performance of X-LD is due to errors cancelling out in the particular setting they consider, making it potentially prone to errors when taken to different contexts.

      Thanks for you critical reading and evaluation. We do feel apologize for typos, which have been corrected and clearly defined now (see Eq 1 and Table 1). In addition, we include more detailed mathematical steps, which explain how LD decay regression is constructed and consequently finds its interpretation (see the detailed derivation steps between Eq 3 and Eq 4).

      Impact:

      I feel like there is value in the work that has been done here if there were more clarity in the writing. Currently, LD calculations are a costly step in tools like LD score regression and Bayesian prediction algorithms, so a more efficient way to conduct these calculations would be useful broadly. However, given the difficulty I had following the manuscript, I was not able to assess when the authors’ approach would be appropriate for an extension such as that.

      See our replies below in responding to your more detailed questions.

      Reviewer #1 (Recommendations For The Authors)

      There are numerous linguistic errors throughout, making it challenging to read.

      It is unclear how the intercepts were chosen in Figure S2. Since theory only gives you the slopes, it seems like it would make more sense to choose the intercept such that it aligns with the empirical results in some way.

      Thanks for your critical evaluation. We do feel apologize some typos, and we have read it through and clarify the text as much as possible. In addition, we included Table 1, which introduces mathematical symbols of the paper.

      In Figure S2, the two algorithms being compared have different software implementations, PLINK vs X-LD. Their real performance not only depended on the time complexity of the algorithms (right-side y-axis), but also how the software was coded. PLINK is known for its excellent programming. If we could have programmed as well as Chris Chang, the performance of X-LD should have been even better and approach the ratio m/n. However, even under less skilled programming, X-LD outperformed plink.

      Reviewer #2 (Recommendations For The Authors):

      Thank you for the chance to review your manuscript. It looks like compelling work that could be improved by greater detail. Providing the level of detail necessary may require creating a Supplementary Note that does a lot of hand-holding for readers like me who are mathematically literate but who don’t have the background that you do. Then you can refer readers to the Supplement if they can’t follow your work.

      We fix the problems and style issues as possible as we can.

      Regarding the weakness section in the public review, here are a few examples of where I got confused, though this list is not exhaustive.

      1) Consider Equation 1 (line 100), which I believe must be incorrect. Imagine that g consists of two SNPs on different chromosomes with correlation rho. Then ell_g (which is defined as the average squared elements of the correlation matrix) would be

      ell_g = 1/4 (1 + 1 + rho^2 + rho^2) = (1+rho^2)/2.

      But ell_1=1 and ell_2=1 and ell_12=rho^2 (The average squared elements of the chromosome-specific correlation matrices and the cross-chromosome correlation matrix, respectively). So

      sum(ell_i)+sum(ell_ij) = 1 + 1 + rho^2 + rho^2 = (1+rho^2)*2.

      I believe your formulas would hold if you defined your LD values as the sum of squared correlations instead of the mean, but then I don’t know if the math in the subsequent sections holds. I think this problem also holds for Eq 2 and therefore makes Eqs 3 and 4 difficult to interpret.

      Thanks for your attentive review and invaluable suggestions. We acknowledge the typo in calculating the mean in Eq 1, resulting in difficulties in understanding the equations. We sincerely apologize for this oversight. To address this issue and ensure clarity in the interpretation of Eq 3 and Eq 4, we have provided more detailed explanations (see the derivation between Eq 3 and Eq 4).

      2) I didn’t know what the parameters are in Equation 3. The vector ell needs to be defined. Is it the vector of ell_i for each chromosomal segment i? I’m also confused by the definition of m_i, which is defined on line 113 as the “SNP number of the i-th chromosome.” Do the authors mean the number of SNPs on the i-th chromosomal segment? If so, it wasn’t clear to me how Eq 2 and Eq 3 imply Eq 4. Further, it wasn’t clear to me why E(b1) quantifies the average LD decay of the genome. I’m used to seeing plots of average LD as a function of distance between SNPs to calculate this, though I’m admittedly not a population geneticist, so maybe this is standard. Standard or not, readers deserve to have their hands held a bit more through this either in the text or in a Supplementary Note.

      Thanks for your insightful feedback. When we were writing this paper, our actually focus was Eq 3 and to establish the relationship between chromosomal LD and the reciprocal of the length of chromosome (Fig 6A) – which was surrogated by the number of SNPs, the correlation between ell_i and 1/m_i.

      We asked around our friends who are population geneticists, who anticipated the correlation between chromosomal LD (ell) and 1/m. The rationale simple if one knows the very basis of population genetics. A long chromosome experiences more recombination, which weakens LD for a pair of loci. In particular, for a pair of loci D_t=D_0 (1-c)^t. D_t the LD at the t generation, D_0 at the 0 generation, and c the recombination fraction. As recombination hotspots are nearly even distributed along the genome, such as reported by Science 2019;363:eaau8861, the chromosome will be broken into the shape in Author response image 1 (Fig 1C, newly added). Along the diagonal you see tight LD block, which will be vanished in the further as predicted by D_t equation, and any loci far away from each other will not be in LD otherwise raised by such as population structure. Ideally, we assume the diagonal block of aveage size of m×m and average LD of a SNP with other SNPs inside the diagonal block (red) is l_u; and, in contrast, off-diagonal average LD (light red) to be l_uv. This logic is hidden but employed in such as ld score regression and prs refinement using LD structure.

      Author response image 1.

      But, how to estimate chromosomal LD (ell), which is overwhelming as our friends said! So, the Figure 6A is logically anticipated by a seasoned population geneticist, but has never been realized because of is nightmare. Often, those signature patterns should have been employed as showcases in releasing new reference data, such as HapMap. However, to our knowledge, this signature linear relationship has never been illustrated in those reference data.

      If you further test a population geneticist, if any chromosome will deviate from this line (Fig 6A)? The answer most likely will be chromosome 6 because of the LD tight HLA region. However, it is chromosome 11 because of its most completed sequenced centromere. Chr 11 is a surprise! With T2T sequenced population, Chr 11 will not deviate much. We predict!

      However, we suspect whether people appreciate this point, we shift our focus to efficient computation of LD—which is more likely understood. We acknowledge the lack of clarity in notation definitions and the absence of the derivation for the interpretation of b1 and b0 for LD decay regression. So, we have added a table to provide an explanation of the notation (see the Table 1) and provided additional derivations, which explained how LD decay regression was derived (see the derivation between Eq 3 and Eq 4). Figure 1C provides illustration for the underlying assumption under LD.

      The technique to bridge Eq 2~3 to Eq 4 is called “building interpretation”. It once was one of the kernel tasks for population genetics or statistical genetics, and a classical example is Haseman-Elston regression (Behavior Genetics, 1972, 2:3-19). When it is moving towards a data-driven style, the culture becomes “shut up, calculate”. Finding interpretation for a regression is a vanishing craftmanship, and people often end up with unclear results!

      3) In line 135, it’s not clear to me what is meant by . If it is , then wouldn’t the resulting matrix be a matrix of zeros since is zero everywhere except the lower off-diagonal? So maybe it is ? But then later in that line, you say that the square of this matrix is the sum of several terms of the form . Are these the scalar elements of the G matrix? But then the sum is a scalar, which can’t be true since is a matrix.

      Thanks for your attentive review. We indeed confused the definition of matrices and their elements, and should refer to the stacked off-diagonal elements of matrix . So, is a vector for variable – the relationship between sample i and j. We assume the reviewer use R software, then corresponds to mean .

      See the text between Eq 5 and Eq 6.

      “We extract two vectors , which stacks the off-diagonal elements of , and , which takes the diagonal elements of .”

      In addition, , so the ground truth is that , but not zero.

      To clarify these math symbols, we replace G with K, so as to be consistent with our other works (see Table 1).

      To derive the means and the sampling variances for and , the Eq 7 can be established by some modifications on the Delta method as exampled in Appendix I of Lynch and Walsh’s book (Lynch and Walsh, 1998). We added this sentence near Eq 7 in the main text.

    1. Author Response

      Reviewer #1:

      We thank Reviewer #1 for their review of our manuscript.

      Reviewer #1, comment #1: “The authors of this manuscript are from the Canadian, public interest open-science company YCharos.”.

      It is important to state that none of the authors work for YCharOS. The YCharOS company has created an open ecosystem consisting of antibody manufacturers, knockout cell lines providers, academics, granting agencies and publishers. The Antibody Characterization Group (participating authors are affiliated to the Department of Neurology and Neurosurgery, Structural Genomics Consortium, The Montreal Neurological Institute, McGill University) works in collaboration with YCharOS to have access to commercial antibodies and knockout cell lines donated by YCharOS’ manufacturer partners.

      Reviewer #1, comment #2: In regard to ZENODO antibody characterization reports prepared by this group, Reviewer #1 wrote: “While the results are convincing, they could be more accessible. In the current format, researchers have to download reports for each target and look through all images to identify the most useful antibodies from the images. The reports I reviewed did not draw conclusions on performance. A searchable database that returns validated antibodies for each application seems necessary.”

      After careful consideration and consultation with YCharOS industry partners, we decided not to rate the performance of the antibodies tested. It was determined that antibody selection is best left to the user, who should analyze all parameters, including the type of antibody to be chosen (recombinant-monoclonal, recombinant-polyclonal, monoclonal), the species used to generate the antibody, the species predicted to react with the antibody, performance in a specific application, antigen sequences, and antibody cost.

      Reviewer #1, comment #3: “A key question is to what extent off-target binding was predictable from the WBs provided by the manufacturers. Thus, how often did the authors find multiple bands when the catalogue image showed a single band and vice versa?”

      In many cases, the antibodies were tested on cell lines other than those used by the manufacturers. Given that protein expression is specific to each line, we can't answer this question properly.

      Reviewer #1, comment #4: “Cross-reactive proteins will generally not be detected when blots are stained with an antibody reactive with a different epitope than the one used for IP. Possible solutions to overcome this limitation such as the use of mass spectrometry as readout should be discussed (Nature Methods volume 12, pages 725- 731 (2015)”.

      Our protocols only inform whether an antibody can capture the intended target, without any evaluation of the extend to the capture of unwanted, cross-reactive proteins. Thus, our data can only be used to aid in selection of the best performing antibodies for IP – our data does not inform profiling of non-specific interactions.

      IP/mass spec is an excellent approach for evaluating antibody performance for IP, and authors on this manuscript are experts in proteomics and recognize the importance of this methodology. We have considered implementing IP/mass in our platform. However, there are limitations, such as the cost of the approach and the difficulty of detecting smaller proteins or proteins with a certain amino acid composition (high presence of Cys, Arg or Lys). Fundamentally, we have decided to focus on throughput relative to details in this regard.

      Reviewer #1, comment #5: “Performance in immunofluorescence microscopy was performed on cells that were fixed in 4% paraformaldehyde and then permeabilized with 0.1% Triton-X100. It seems reasonable to assume that this treatment mainly yields folded proteins wherein some epitopes are masked due to cross-linking. The expectation is therefore that results from IP are more predictive for on-target binding in IF than are WB results (Nature Methods volume 12, pages725-731 (2015). It is therefore surprising that IP and WB were found to have similar predictive value for performance in IF (supplemental Fig. 3). It would be useful to know if failure in IF was defined as lack of signal, lack of specificity (i.e. off-target binding) or both. Again, it is important to note the IP/western protocol used here does not test for specificity.”

      The assessment of antibody performance is biased by how antibodies were originally tested by suppliers. Manufacturers primarily validate their antibody by WB. Thus, most antibodies immunodetect their intended target for WB. Thus, in retrospect, we tested a biased pool of antibodies that detect linear epitopes. Still, we observed that a large cohort of antibodies show specificity for their target across all three applications or for specific combinations of applications. This slightly challenges the idea that antibodies are fit-for-purpose reagents and can recognize either linear or native epitopes - a significant number of antibodies can specifically detect both types of epitope.

      Reviewer #1, comment #6: “The authors report that recombinant antibodies perform better than standard monoclonals/mAbs or polyclonal antibodies. Again, a key question is to what extent this was predictable from the validation data provided by the manufacturers. It seems possible that the recombinant antibodies submitted by the manufacturers had undergone more extensive validation than standard mAbs and polyclonals”.

      Our antibody manufacturing partners indicated that the recombinant antibodies are more recent products and have been more extensively characterized relative to standard polyclonal or monoclonal antibodies.

      The main message is that recombinant antibodies can be used in all applications once validated. Although recombinant antibodies are available for many proteins, the scientific community is not adopting these renewable regents as we believe it should. We hope that the data provided will encourage scientists to adopt recombinant technologies when available to improve research reproducibility.

      Reviewer #1, comment #7: “Overall, the manuscript describes a landmark effort for systematic validation of research antibodies. The results are of great importance for the very large number of researchers who use antibodies in their research. The main limitations are the high cost and low throughput. While thorough testing of 614 antibodies is impressive and important, the feasibility of testing hundreds of thousands of antibodies on the market should be discussed in more detail.”

      We thank the reviewer for this comment. One of our challenges is to increase the platform's throughput to succeed in our mission to characterize antibodies for all human gene products. We will continue to test antibodies using protocols agreed upon with our partners, commonly used in the laboratory, to ensure that ZENODO reports can serve as a guide to the wider community.

      In terms of development our marketing efforts have been substantially accelerated by our new partnership with the journal F1000. We have begun to convert our reports into peer-reviewed papers (20 ZENODO reports were converted into F1000 articles). This conversion allows researchers to find our work via PubMed, and easily cite any study. Producing peer-reviewed articles also further enhances the credibility of our research and our project as a whole: https://f1000research.com/ycharos

      Colleagues have published a letter to Nature explaining the problem and our technology platform: (Kahn, et al., Nature, 2023, DOI: https://doi.org/10.1038/d41586-023-02566-w).

      This project has been presented worldwide, with a presence at major antibody conferences, such as the annual Antibody Validation meeting in Bath (PSM attended the meeting in September 2023). The authors are organizing a sponsored mini-symposium on antibody validation at the next American Society for Cell Biology (ASCB) meeting in December 2023 (Boston, USA): https://plan.core- apps.com/ascbembo2023/event/6fb928f06b0d672e088c6fa88e4d77fb

      Colleagues have prepared petitions addressed to various governmental organizations (US, Canada, UK) to support characterization and validation of renewable antibodies: https://www.thesgc.org/news/support- characterization-and-validation-renewable-antibodies.

      Reviewer #2

      We thank Reviewer #2 for the review of the antibody characterization reports we have uploaded to ZENODO. A manuscript describing the full standard operating procedures of the platform, which has been used in all reports is in preparation, and should be available on a preprint server before the end of the year. Our protocols were reviewed and approved by each of YCharOS' manufacturer partners. Moreover, a recent editorial describes the platform used here and gives advice on how to interpret the data: https://doi.org/10.12688/f1000research.141719.1)

      Reviewer #2, comment #1: “A discussion of how the working concentrations of antibodies are selected and validated is required. Based on the dilutions described in the reports, it seems that dilutions suggested by the manufacturer were used - For LRRK2 it seems that antibody concentrations ranging from 0.06 to over 5 µg/ml for WB were used. Often commercial antibody comes in a BSA-containing buffer making it hard to validate the concentration of the antibody claimed by the manufacturer”.

      The concentration recommended by the manufacturer is our starting point. For WB, when the signal is at the level of detectability, we will repeat with a ~5-10 fold increase in antibody concentration. For >80% of the antibody tested, the use of the recommended concentration led to the detection of bands (specific or not to the target protein).

      Reviewer #2, comment #2: “In the authors' experience are the manufacturer's concentrations reliable? Additionally, if the information regarding applications provided by the manufacturers is unreliable how do the authors suggest working concentrations for antibodies to be assessed”?

      We do not evaluate the concentration of antibodies internally. In the immunoprecipitation experiments, we use 2.0 µg of antibody for each IP, based on the concentration provided by the manufacturers. On Ponceau staining of membranes, we can observe the heavy and light chains of the primary antibodies used, giving an indication of the amount of antibodies added to the cell lysate. In most cases, the intensity of the heavy and light chains is comparable.

      Reviewer #2, comment #3: “We understand that it would not be feasible to test every antibody at different concentrations, but this is an issue that should at least be mentioned. An antibody might be put in the wrong performance category solely because of the wrong concentration being used. Ie if an excellent antibody is used at too high a concentration, it may detect non-specific proteins that are not seen at lower dilutions where the antibody still picks up the desired antigen well”.

      We agree with Reviewer #2, we do not use an optimal concentration for all tested antibodies. As mentioned previously, the concentration recommended by the manufacturer is our starting point. By testing multiple antibodies side-by-side against a single target protein, we can generally identify one or more specific and selective antibodies. We leave it to users of our reports to optimize the antibody concentration to suit their experimental needs.

      Reviewer #2, comment #4: “Do the authors check different WB conditions ie 2h primary antibody with BSA or milk vs. overnight at 4 degrees with BSA or Milk”?

      All primary antibodies are always tested in milk overnight at 4 degrees. The overnight incubation is convenient in the timeline of the protocol. All protocols were agreed upon after careful consultation with our partners.

      Reviewer #2, comment #5: “Do the authors provide detailed WB protocols that include the description of the electrophoresis and type of gels used, transfer buffer and transfer method and time used, and conditions for all the primary and secondary blotting including times, buffers and dilutions of all antibodies and other reagents”?

      This information is included in all ZENODO reports.

      Reviewer #2, comment #6: “Do the authors discuss detection approaches- we have noticed for some antibodies there are significant different results using LICOR, ECL and other detection methods, with certain especially weaker antibodies preferring ECL-based methods”.

      We only use ECL-based methods.

      Reviewer #2, comment #7: “For IPs the amount of antibody needed can also vary-for some we can use 1 microgram or less, but for others, we need 5 to 10 micrograms. The amount of antibody needed to get maximal IP should be stated”.

      We use 2.0 ug of antibodies and we have found this to be adequate for lower abundance proteins (e.g. Parkin - https://zenodo.org/records/5747356) and higher abundance proteins (e.g. PRDX6 - https://zenodo.org/records/4730953). Abundance is based on PaxDb.com. For Parkin and PRDX6, we were able to enrich the expected target in the IP and observe depletion in the unbound fraction. Optimization of the IP conditions is left to the antibody users.

      Reviewer #2, comment #8: “Doing IPs with commercial antibodies can be very expensive or infeasible if many micrograms are needed especially if only packages of 10 micrograms for several hundred dollars are provided”.

      This is a major advantage of the side-by-side comparison: the reader is free to choose between high-performance antibodies from different manufacturers, with varying antibody costs. We also work in partnership with the Developmental Studies Hybridoma Band (DSHB), which supplies antibodies on a cost recovery basis.

      Reviewer #2, comment #9: “For IPs it is important to determine the percentage of antigen that is depleted from the supernatant for each IP. We think that this should be calculated and recorded in the Zenodo data. Some antibodies will only IP 10% of antigen whereas others may do 50% and others 80-90%. One rarely sees 100% depletion. For IPs the buffer detergent and salt concentration might also strongly influence the degree of IP and therefore these should be clearly stated”.

      In Box 1, we define criteria of success. For IP, “under the conditions used, a successful primary antibody immunocaptures the target protein to at least 10% of the starting material”. Colleagues have written an editorial on how to interpret and analyze antibody performance https://f1000research.com/articles/12-1344).

      The cell lysis buffer is a critical reagent when considering IP experiments. We use a commercial buffer consisting of 25 mM Tris-HCl pH 7.4, 150 mM NaCl, 1 mM EDTA, 1% NP-40 and 5% glycerol (Thermo Fisher, cat. #87787). This buffer is efficient to extract the target proteins we have studied thus far.

      Reviewer #2, comment #10: “Whether antibodies cross-react with human, mouse and other species of antigens is always a major question. It is always good to test human and mouse cell lines if possible. If antibodies cross-react in WB, in the authors' experience will they also cross-react for IF and IP”?

      The authors started this initiative by focusing on the 20,000 human proteins, defining an end point. We and our collaborators found that most of the cherry-picked selective antibodies for WB for human proteins, which manufacturers claim react with the murine version of the target proteins, were selective for murine tissue lysates.

      Indeed, poorly performing antibodies in WB mostly failed IF and IP. However, selective antibodies for IF or specific for IP were generally (>90%) selective for WB.

      Reviewer #2, comment #11: “Cell lines express proteins at vastly different levels and it is possible that the selected cell line does not express the antigen or expresses it at very low levels - this could be a reason for wrongly assessing an antibody not working. It would be useful to use cell lines in which MS data has defined the copy number of protein per cell and this figure could be included in the antibody data if available. This MS data is available for the vast majority of commonly used cells”.

      We agree with Reviewer #2 that MS data are useful for target protein selection. At the moment, our approach using transcriptomic data provided on DepMap.org proved to be a successful mechanism for cell line selection. We have identified a specific antibody for WB for each target, enabling the validation of expression in the cell line selected.

      For some protein targets, the parental line corresponding to the only commercial or academic knockout line available has weak protein expression. We thus needed to generate a KO clone in a second cell line background with high expression, and indeed found that some antibodies which failed in the first commercial line were successful in the new higher-expressing line (e.g CHCHD10 - https://zenodo.org/records/5259992).

      Reviewer #2, comment #12: “Some proteins are glycosylated, ubiquitylated or degraded rapidly making them hard to see in WB analysis”.

      We used the full gel/membrane length when analyzing antibody performance by WB. Indeed, proteins can show different isoforms and molecular weights compared to that based on amino acid sequence (e.g. SLC19A1 -https://zenodo.org/records/7324605).

      Reviewer #2, comment # 13: “We have occasionally had proteins that appear unstable when heated with SDS- sample buffer before WB. For these, we still use SDS-Sample buffer but omit the heating step. I often wonder how necessary the heating step is”.

      For WB, samples are heated to 65 degrees, then spun to remove any precipitate.

      Reviewer #2, comment # 14: “For IF the methods by which cells are fixed and stained, and the microscope and settings, can significantly influence the final result. It would be important to carefully record all the methods and the microscope used”.

      We agree with Reviewer #2 that many parameters influence antibody performance for imaging purposes. We are progressively implementing the OMERO software to monitor any experimental parameters and information (metadata) about the microscope itself.

      Reviewer #2, comment # 15: “How do the authors recommend antibodies are stored? These should be very stable, but I have had reports from the lab that some antibodies become less good when stored and others that recommend storing at 4 degrees”.

      Antibodies are aliquoted to avoid freeze-thaw cycles and stored at -20 degrees. If it is recommended to store antibodies at 4 degrees, we add glycerol to a final concentration of 50% and store them at -20 degrees.

      Reviewer #2, comment # 16: “Would other researchers not part of the authors' team, be able to add their own data to this database validating or de-validating antibodies? This would rapidly increase the number of antibodies for which useful data would be available for. It would be nice to greatly expand the number of antibodies being used in research and this is not feasible for a single team to undertake”.

      Yes! We believe that only a community effort can resolve the antibody liability crisis. We partner with the Antibody Registry (antibodyregistry.org - led by co-author Anita Bandrowski). In the Registry, each antibody is labelled with a unique identifier, and third-party validation information can be easily tagged to any antibody. Antibody users are invited to upload information about an antibody they have characterized into the Registry.

    1. Author Response

      The following is the authors’ response to the original reviews.

      Thank you for your consideration and insightful comments on our article.

      We have gone through all the reviewers' comments and addressed all their questions and concerns point by point.

      As per their recommendation, we have amended our manuscript by providing more information about the experimental procedure and statistical analysis followed, and removed some analyses with a reduced number of imaging sessions. In addition, as a Resource and Tools article, the claim of our paper has been adjusted to a proof-of-concept paper showing robust and reliable preliminary results. In the meantime, we have provided 3 new Supplementary Figures, including one showing data from all individual animals.

      Reviewer #1 (Public Review):

      The authors apply a new approach to monitor brain-wide changes in sensory-evoked hemodynamic activity after focal stroke in fully conscious rats. Using functional ultrasound (fUS), they report immediate and lasting (up to 5 days) depression of sensory-evoked responses in somatosensory thalamic and cortical regions.

      Strengths: This a technically challenging and proof-of-concept study that employs new methods to study brain-wide changes in sensory-evoked neural activity, inferred from changes in cerebral blood flow. Despite the minor typos/grammatical errors and small sample size, the authors provide compelling images and rigorous analysis to support their conclusions. Overall, this was a very technically difficult study that was well executed. I believe that it will pave the way for more extensive studies using this methodological approach. Therefore I support this study and my recommendations to improve it are relatively minor in nature and should be simple for the authors to address.

      Weaknesses: The primary weakness of this paper is the small sample sizes. Drawing conclusions based on the small sham control group (n=2) or 5-day stroke recovery group (n=2), is rather tenuous. One way to alleviate some uncertainty with regard to the conclusions would be to state in the discussion that the findings (ie. loss of thalamocortical function after stroke) are perfectly consistent with previous studies that examined thalamocortical function after stroke. The authors missed some of these supporting studies in their reference list (see PMID: 28643802, 1400649). A second issue that can easily be resolved is their analysis of the 69 brain regions. This seems like a very important part of the study and one of the primary advantages of employing efUS. As presented, I had difficulty seeing the data. I think it would be worthwhile to expand Fig 3 (especially 3C) into a full-page figure with an accompanying table in the Supplementary info section describing the % change in CBF for each brain region.

      Other Recommendations for the authors:.

      • Since there is variability in spreading depolarizations, was there any trend in the relationship between # SD's and ischemic volume? I know there are few data points but a scatterplot might be of interest.

      • For statistical comparisons of 'response curves' in Fig 3 and 4, what exactly was the primary dependent measure: changes in peak amplitude (%) or area under the curve?

      • There are several typos and minor grammatical errors in the manuscript. Some editing is recommended.

      We thank the reviewer for the comments and suggestion, we have adapted our message to a proof-of-concept paper showing robust and reliable preliminary results. We also thank the reviewer for pointing out important references that support our observation and have added them to our article. We have provided a supplementary full-page version of the current Figure 3C (see Supplementary Figure 3).

      Regarding the recommendations, we strongly agree that it would be of interest to link SDs and ischaemia, but unfortunately this can't be done because our experimental design, i.e. narrow cranial window and single static plane, does not allow brain-wide quantification of ischemic volume. This would be possible either by scanning the brain or by using a matrix array (also discussed in the manuscript).

      For statistical analysis of the hemodynamic response curves, we have adapted them to compare the area under the curve (AUC). In addition, we have provided a new Supplementary Figure 4 showing the associated values and statistics.

      We have edited typos and errors.

      Reviewer #2 (Public Review):

      Brunner et al. present a new and promising application of functional ultrasound (fUS) imaging to follow the evolution of perfusion and haemodynamics upon thrombotic stroke in awake rats. The authors leveraged a chemically induced occlusion of the rat Medial Cerebral Artery (MCA) with ferric chloride in awake rats, while imaging with fUS cerebral perfusion with high spatio and temporal resolution (100µm x 110µm x 300µm x 0.8s). The authors also measured evoked haemodynamic response at different timepoints following whisker stimulation.

      As the fUS setup of the authors is limited to 2D imaging, Brunner and colleagues focused on a single coronal slice where they identified the primary Somatosensory Barrel Field of the Cortex (S1BF), directly perfused by the MCA and relay nuclei of the Thalamus: the Posterior (Po) and the Ventroposterior Medial (VPM) nuclei of the Thalamus. All these regions are involved in the sensory processing of whisker stimulation. By investigating these regions the authors present the hyper-acute effect of the stroke with these main results:

      • MCA occlusion results in a fast and important loss of perfusion in the ipsilesional cortex.

      • Thrombolysis is followed by Spreading Depolarisation measured in the Retrosplenial cortex.

      • Stroke-induced hypo-perfusion is associated with a significant drop in ipsilesional cortical response to whisker stimulation, and a milder one in ipsilesional subcortical relays.

      • Contralesional hemisphere is almost not affected by stroke with the exception of the cortex which presents a mildly reduced response to the stimulation.

      In addition, the authors demonstrate that their protocol allows to follow up stroke evolution up to five days post-induction. They further show that fUS can estimate the size of the infarcted volume with brilliance mode (B-mode), confirming the presence of the identified lesional tissue with post-mortem cresyl violet staining.

      Upon measuring functional response to whisker stimulation 5 days after stroke induction, the authors report that:

      • The ipsilesional cortex presents no response to the stimulation

      • The ipsilesional thalamic relays are less activated than hyper acutely

      • The contralesional cortex and subcortical regions are also less activated 5d after the stroke.

      These observations mainly validate the new method as a way to chronically image the longitudinal sequelae of stroke in awake animals. However, the potentially more intriguing results the authors describe in terms of functional reorganization of functional activity following stroke appear to be preliminary, and underpowered ( N = 5 animals were imaged to describe hyper-acute session, and N = 2 in a five day follow-up). While highly preliminary, the research model proposed by the author (where the loss of the infarcted cortex induces reduces activity in connected regions, whether by cortico-thalamic or cortico-cortical loss of excitatory drive), is interesting. This hypothesis would require a greatly expanded, sufficiently powered study to be validated (or disproven).

      We thank the reviewer for the careful and accurate description of our work. We have addressed all the comments, recommendations and concerns raised by providing details of the experimental procedure and statistical analysis followed, and by removing some analyses associated with a reduced number of imaging sessions (at d5, n=2).

      Reviewer #3 (Public Review):

      The authors set out to demonstrate the utility of functional ultrasound for evaluating changes in brain hemodynamics elicited acutely and subacutely by the middle cerebral artery occlusion model of ischemic stroke in awake rats.

      Functional ultrasound affords a distinct set of tradeoffs relative to competing imaging modalities. Acclimatization of rats for awake imaging has proven difficult with most, and the high quality of presented data in awake rats is a major achievement. The major weakness of the approach is in its being restricted to single-slice acquisitions, which also complicates the registration of acquisition across multiple imaging sessions within the same animal. Establishing that awake imaging represents an advancement in relation to studies under anesthesia hinges upon the establishment of the level of stress experienced by the animals in the course of imaging, i.e., requires providing data on the assessment of stress over the course of these long imaging sessions. This is particularly significant given how significant a stressor physical restraint has been established to be in rodent models of stress. Furthermore, assessment of the robustness of these measurements is of particular significance for supporting the wide applicability of this approach to preclinical studies of brain injury: the individual animal data (effect sizes, activation areas, kinetics) should thus be displayed and the statistical analysis expanded. Both within-subject, within/across sessions, and across-subjects variability should be evaluated. Thoughtful comments on the relationship between power doppler signal and cerebral blood volume are important to include and facilitate comparisons to studies recording other blood volume-weighted signals. Finally, the contextualization of the observations with respect to other studies examining acute and subacute changes in brain hemodynamics post focal ischemic stroke in rats is needed. It is also quite helpful, for establishing the robustness of the approach, when the statistical parametric maps are shown in full (i.e. unmasked).

      We would like to thank the reviewer for the comments, recommendations and concerns he/she/they raised. We have addressed all the points to clarify our article and make it more relevant and informative for readers.

      Reviewer #2 (Recommendations For The Authors):

      The work described by Brunner et al is primarily a methodological paper, with potentially interesting, yet not robust enough, novel biological insight into the mechanisms of stroke. Nonetheless, the method employed is interesting and potentially well-validated.

      General comments/suggestions

      1- One potential concern I have is related to the relatively low sample size used, with n=5 for the main results and only n=2 for the follow-up after 5d. I am not sure much can be generalized using only two animals in any research study and this N = 2 dataset should probably be removed entirely from the study. Moreover, I found the statistical methods used were only superficially described, which prevented me from assessing whether the results reported by the authors are biologically relevant or not (including some significant differences in rCBV well below 1% estimated over two individuals).

      We fully agree with the reviewer’s comment and balanced our claim by considering this work as a proof-of-concept on brain imaging of multiple aspects of stroke hemodynamics (ischemia, spreading depolarization-like events, cortico-thalamic functions) in awake head-fixed rats. Therefore, we attenuated our message along the entire manuscript to prevent misunderstanding and over statement (e.g., Lines 356, 441, 455), we also remove statistics from the analysis at d5 post-stroke, see Figure 4 and associated paragraph from Line 356.

      2- Based on their investigations, the authors propose a model where the loss of infarcted cortex induces reduced activity in connected regions, whether by cortico-thalamic or cortico-cortical loss of excitatory drive. This is an intriguing framework but this hypothesis would require a more complete, well-powered study to be substantiated.

      I think a clear recognition of the fact that these findings are just preliminary and not validated should be more explicitly reported. I also marginally note here that these results are in contrast with previous reports from the same team where occlusion of the MCA induced increased response to whisker stimulation in anaesthetised rats. These contradictory findings are not discussed in this manuscript.

      As mentioned above, we explicit more on the proof-of-concept proposed in this work as well as clearly stating on the preliminary aspect of the findings described in this work. As mentioned above, we attenuated our message along the entire manuscript to prevent misunderstanding and over statement (e.g., Lines 348, 433, 447), we also remove statistics from the analysis at d5 post-stroke, see figure 4 and associated paragraph from Line 348.

      We thanks the reviewer for pointing out the missing link with our previous work performed under anesthesia. We therefore provided a discussion point on this contradictory finding (Line 441).

      3- In a previous study from the same group perfusion was imaged in 3D either by means of a motorized probe or by using a 2D matrix arrays. It would be interesting to discuss why a 2D approach was chosen in this study over those previous methods.

      Indeed, brain-wide coverage would be of great interest in such experiment context. As mentionned by the reviewer, two strategies can be used:

      • One can scan the brain using a motorized probe as performed for different purposes by Sieu et al., Nature Methods, 2015; Hingot, Brodin et al., Theranostics 2020; Macé et al., Neuron 2019 and also by our group in Sans-Dublanc, Chrzanowska et al., Neuron, 2022; Brunner et al. Frontiers in Neuroscience 2022 and Brunner et al., JCBFM 2023. (This list of publication is not exhaustive).

      • A second approach aims at using a 2D matrix array to capture functions at brain-wide scale. So far, this strategy has been employed in a couple of studies (Rabut et al., Nature Methods, 2019 and Brunner, Grillet et al., Neuron, 2020).

      The strategy consisting of scanning (manually or using a motor) strongly limits investigation on brain functions, as performing an accurate covering of the functional regions requires an extensive and time-consumming scanning: brain functions must be addressed several time to capture a reliable and robust signal for all the brain section scanned (see Brunner et al., 2022). Unfortunately, this strategy prevents us to accurately capture other brain hemodynamics like the dynamic of the ischemia or the spreading depolarization event.

      On the other hand, the volumetric functional ultrasound imaging (vfUSI) would be suited for brain-wide coverage capturing large-scale brain functions (see Brunner, Grillet et al. Neuron 2020) and hemodynamic events (see Rabut et al., Nature Methods, 2019) but at the cost of the resolution, frame rate and larger cranial window. Unfortunately, this technology was not available when this work was conducted.

      Such experimental opportunities have been suggested at the end of the manuscript: “To overcome such limitation, one can extend the size of the cranial window to allow for larger scale imaging either by sequentially scanning the brain27,28,31,32,59,69,71,72, or by using the recently developed volumetric fUS which provides whole-brain imaging capabilities in anesthetized73 and awake rats30.“

      4- Overall the registration scheme seems suboptimal which ultimately questions the specificity of the findings in thalamic regions. It would be interesting to validate this procedure, especially the probe repositioning five days after the stroke.

      Positioning was not difficult part of this experiment. First, all head posts were implanted in the same position relative to the skull references bregma and lambda. Second, the head fixation ensures the same placement of the headpost for all animals. Finally, fine adjustement of the ultrasound probe position were done using a micromanipulator by finding key landmarks from the µDoppler image. In practice, minimal adjustements were needed to find back the same imaging plane. We provide additional information about the positionning in the Materials and Methods section.

      New text – Line 126: “Positionning.

      The mechanical fixation of the head-post ensures an easy and repeatabe positionning of the ultrasound probe across imaging session. The ultrasound probe is indeed fixed to a micromanipulator enabling light adjustements To find the plane of interest (containing both S1BF and thalamic relays: bregma - 3.4mm), we used brain landmarks (e.g., surface of the brain, hippocampus, superior sagittal sinus, large vessels). Note that as the headpost was carefully placed in the same position relative to the skulls landmarks (bregma and lambda), the position of the region of interest was minimal across animals.”

      Second, at d5 post-stroke, we positionned the ultrasound probe over the imaging window as described in the Materials and Methods section and use brain landmarks from baseline/post-stroke image to maximize the position of brain image. We better detail the procedure followed.

      Original text: “First, we used the vascular markers and the shape of the hippocampus31,32 to find back the coronal cross-section imaged during the pre-stroke session. Five days after the MCA occlusion,….”

      New text – Line 360 :“Five days after the MCA occlusion, we first placed the ultrasound probe over the imaging window and adjusted its position (using micromanipulator) to find back the recording plane from Pre-Stroke session using Bmode (morphological mode) and µDoppler imaging using brain vascular landmarks (i.e., vascular patterns, brain surface and hippocampus34,35; see Figure 2B).”

      More detailed questions/comments/suggestions

      Methods

      ARRIVE methodology

      • Point 2b: sample size is not adequately explained, especially the use of n = 2 animals for 5d follow up

      We have explicited the sample size by adding a short paragraph at the beginning of the Results section. We also make the Supplementary Table 1 more accurate. New text – Line 239: “Animals

      Report on animal use, experimentation, exclusion criteria can be found in Supplementary Table 1. Rat#1 was excluded after the control session as the imaging window was too anterior to capture both cortical and thalamic responses. Ra#2 was excluded as hemodynamic responses were inconsistent during baseline (pre-stroke) period. Rat#3 showed early post-stroke reperfusion and was excluded from stroke analysis, the control session (pre-stroke) from Rat#3 was analyzed.”

      • Point 7: statistical methods: The quantification used to assess significant differences in stimulation traces is poorly described.

      We have amended the Materials and Methods section about statistics and provided Supplementary Figure 4.

      New text – Line 221: “Activated brain regions were detected from hemodynamic response time-courses using GLM followed by t-test across animals as proposed in Brunner, Grillet et al.,34. The area under the curve (AUC) from hemodynamic response time-courses was computed for individual trials in S1BF, VPM and Po regions, for all the periods of the recording and for all rats included in this work. AUC were compared and analysed using a non-parametric Kruskal-Wallis test corrected for multiple comparison using a Dunn’s test. Tests were performed using GraphPad Prism 10.0.1. “

      Functional Ultrasound Imaging acquisition

      • References 26 and 28 imply 2.5Hz and 2Hz acquisition rates, respectively. Why does the same method result in a 1.25Hz acquisition rate here? Can you confirm the same spatial resolution in these conditions?

      The spatial resolution is independent of the temporal resolution (frame rate). The spatial resolution depends on the resolution of the compound image and the temporal resolution is given by the number of compound images to generate a single Doppler image (exposure time). By increasing the number of compound images, the frame rate decreases while increasing the signal to noise ratio and sensistivity. For some work, a pause between 2 frames is used (mostly due to technical limitations in the software (processing time , or execution of a real-time display/processing by the user), however this reduces the frame rate.

      Author response table 1.

      Comparing with the sequences used in references 26 and 28, we have the following timing parameters

      In this work, we decided to reduce the frame rate to have less images but with higher SNR. The 0.3s were added by technical considerations in this specific implementation.

      New text – Line 158:“ To obtain a single vascular image we acquired a set of 250 compound images in 0.5s, an extra 0.3s pause is included between each image to have some processing time to display the images for real-time monitoring of the experiment. “

      Activity Maps

      • How is the use of a 40s window motivated?

      The 40s window has been choosen to better compare hemodynamic responses to either left or right whisker stimulation and centered the period of interest on the start of the stimulation. Original text:” Pre- and post-stroke recordings are reshaped in shorter 40-s sessions, i.e., 50 frames, …”

      New text – Line 206:“ Pre- and post-stroke recordings are reshaped in 40-s sessions, i.e., 50 frames, centered on the start of the stimulation (at 20s), …”

      • I think the manuscript would benefit from the use of an established, event-based GLM for activity mapping.

      We thank the reviewer for this suggestion, here we used a z-score for activity mapping that is largerly established in the neuroimaging realm.

      • The statistical thresholds used should account for multiple comparisons.

      We have amended the Materials and Methods section, and figure captions about statistics and provided Supplementary Figure 4.

      Statistical analyses

      • Overall this section is only superficially described, and lacks detailed information.

      We have amended the Materials and Methods section about statistics and provided Supplementary Figure 4.

      New text – Line 221 : “Activated brain regions were detected from hemodynamic response time-courses using GLM followed by t-test across animals as proposed in Brunner, Grillet et al.,34. The area under the curve (AUC) from hemodynamic response time-courses was computed for individual trials in S1BF, VPM and Po regions, for all the periods of the recording and for all rats included in this work. AUC were compared and analysed using a non-parametric Kruskal-Wallis test corrected for multiple comparison using a Dunn’s test. Tests were performed using GraphPad Prism 10.0.1. “

      • Are average rCBV changes referred to in the 40s window?

      The rCBV changes are referring to the pre-stimulation baseline. We have modified the text accordingly (Line 206).

      • Were normality and variance equality requirements verified in the group with n=2?

      Based on reviewers comment’s on the limited amount of recording at 5d, we have decided to remove this statistical analysis. The manuscript, figure and caption were corrected accordingly.

      • There is no method for cresyl violet staining

      We thank the review for highlighting this omission. We have provided a paragraph in the Materials & Methods section detailling the histology procedure – Line 228:

      “Histopathology

      Rats were killed 24hrs after the occlusion for histological analysis of the infarcted tissue. Rats received a lethal injection of pentobarbital (100mg/kg i.p. Dolethal, Vetoquinol, France). Using a peristaltic pump, they were transcardially perfused with phosphate-buffered saline followed by 4% paraformaldehyde (Sigma-Aldrich, USA). Brains were collected and post-fixed overnight. 50-μm thick coronal brain sections across the MCA territory were sliced on a vibratome (VT1000S, Leica Microsystems, Germany) and analyzed using the cresyl violet (Electron Microscopy Sciences, USA) staining procedure (see Open Lab Book for procedure). Slices were mounted with DPX mounting medium (Sigma-Aldrich, USA) and scanned using a bright-field microscope.”

      Results 1: Real time imaging of stroke induction in awake rats

      • Why is the window so narrow in the anteroposterior direction?

      The imaging window was defined based on the brain regions investigated in this work, meaning the primary somatosensory cortex (S1BF) and the ventroposterior medial thalamic relay (VPM). From Paxinos atlas, a position of interest is located at Bregma -3.4mm. The cranial window was performed accordingly, and restricted couple of mm to avoid non-needed procedure and brain exposure. We added a new sentence in the Materials & Methods section – Line 116: “This cranial window aims to cover bilateral thalamo-cortical circuits of the somatosensory whisker-to-barrel pathway.”

      • What validation was employed for the habituation protocol? Are animals stressed by the procedure? Do you have cortisol data to show? Ar animal weights throughout the procedure?

      The habituation protocol employed in this work follows recommandations from the expert in the field and peers (Martin et al., Journal of Neuroscience Methods, 2002; Martin et al., Neuroimage 2006; Topchiy et al., Behav Brain Res 2009). We have amended the corresponding paragraph in the Materials & Methods section detailling the habituation procedure:

      Original text: “Body restraint and head fixation.

      Rats were habituated to the workbench and to be restrained in a sling suit (Lomir Biomedical inc, Canada), progressively increasing the restraining period from minutes to hours33,34. After the headpost implantation (see below), rats were habituated to be head-fixed while restrained in the sling. The period of fixation was progressively increased from minutes to hours. Water and food gel (DietGel, ClearH2O, USA) were provided along the habituation session. Once habituated, the cranial window for imaging was performed as described below (Figure 1A-C).”

      New text - Line 90:“ Body restraint and head fixation.

      The body restraint and head fixation procedures are adapted from published protocols and setup dedicated for brain imaging of awake rats39–41. Rats were habituated to the workbench and to be restrained in a sling suit (Lomir Biomedical inc, Canada) by progressively increasing restraining periods from minutes (5mins, 10mins, 30mins) to hours (1 and 3hrs) for one or two weeks. The habituation to head-fixation started by short (5 to 30s) and gentle head-fixation of the headpost between fingers. The headpost was then secured between clamps for fixation periods progressively increased following the same procedure as with the sling. For both body restraint and head fixation, the initial struggling and vocalization diminished over sessions. Water and food gel (DietGel, ClearH2O, USA) were provided for all body restraint and head-fixation habituation sessions. Once habituated, the cranial window for imaging was performed as described below (Figure 1A-C).”

      • The observation of contralateral oligemia is based only on RSG traces.

      We provided contralesional perfusion changes for all regions in Supplementary Figure 1.

      • The spatial and temporal distribution of Bmode measured hyperechogenicity is surprising and should be discussed. Reference 29 describes for instance non-overlap with an area of hypo-perfusion. Overlap between hypo-perfused and infarct volumes should be systematically investigated and coregistered with histology. Moreover, reference 40, while using a different model, presents hyperechogenicity at 5h.

      The B-mode images in Figure 2B are presented as an illustration of the potential morphological changes detected at different timepoint. However, our study focuses on functional responses and not on the evolution of the morphological changes. Indeed, this Bmode images remain difficult to interpret as they show a structural reorganization at the level of the ultrasound scatterers which has not been directly linked with tissue infarction, oedema, orother histological conditions.

      Regarding the reference 40, the authors found an hyper-echogenicity at 5h a time window is not covered by our protocol. In reference 29, we indeed detailed a mismatch between the µDoppler images and histopathology. As suggested by the reviewer, seeking for other potential mismatchs/overlaps between Bmode/µDoppler and histopathology is an interesting field on investigation, but remains out of the scope of this work.

      Results 3: Delayed alteration of the somatosensory thalamocortical pathway

      • These results are underpowered and as such should probably be removed entirely from the paper (or substantiated with greater Ns of animals). Based on reviewers comment’s on the limited amount of recording at 5d, we have decided to remove this statistical analysis. The manuscript, figure and caption were corrected accordingly.

      • If I am not mistaken, reference 28 describes a protocol for awake mouse imaging, and thereby does not introduce any hippocampal landmark allowing effective positioning of the probe.

      We thanks the reviewer for this comment. While not used in the figure detailling image registration in reference 28, step 42 (page 17) from the protocol mentions the use of hippocampal landmark to position of the imaged brain to the atlas. The hippocampal landmark is also used in Brunner et al., JCBFM 2023, we have added this reference which is more appropriate to this work (i.e., rat model, digitalized paxinos atlas, linear ultrasound transducer).

      • Significant difference in ispsilesional VPM with post-stroke period looks spurious.

      We have amended the Materials and Methods section about statistics and provided Supplementary Figure 4.

      Discussion:

      The sentence "might result from the direct loss of the excitatory corticothalamic feedback to the VPM" should be moderated in the absence of electrophysiology support. Such a decrease could be explained by reduced perfusion due to the challenge.

      The reviewer is right and we believe the tense used in the sentence already balance the claim. However, we clarified on how such result could be better validated.

      Original text: “Further work will need to dissect the complex and long-lasting post-stroke alterations of the functional whisker-to-barrel pathway, including at the neuronal level, as fUS only reports on hemodynamics as a proxy of local neuronal activity27,28,60,66–68“

      New text – Line 445: “Therefore, further studies will be needed to accurately dissect the complex and long-lasting post-stroke alterations of the functional whisker-to-barrel pathway, including at the neuronal level by direct electrophysiology recordings and imaging, as fUS only reports on hemodynamics as a proxy of local neuronal activity30,31,63,74–76.“

      Figure 2

      • Panel B would be more informative if presented as an average.

      The aim of this figure is to show the raw data of a typical case. Averaging µDoppler images wouldn’t be illustrative as individual vessels will not be visible anymore. Because the vessels are in different positions from one animal to another, an average image would be blurred.

      • Panel C lacks contralateral S1BF trace.

      We have provided contralesional perfusion changes for all regions in Supplementary Figure 1.

      • Methods for detection of SDs refer to non-peer-reviewed reference 29, where SD is defined as 50% over baseline level. What is the actual threshold/method used to define a SD in this study?

      We better detailled this procedure in the Materials & Methods section - Line 195: “The detection of hemodynamic events associated with spreading depolarizations (SDs) was performed based on the temporal analysis of the rCBV signal in the retrosplenial granular (RSGc) and dysgranular (RSD) cortices of the left hemisphere (ipsi-lesional). SDs were defined as transient increase of rCBV signal (+25%) detected with a temporal delay of <10 frames (i.e., 8secs) between the two regions of interest, validating both the hyperemia and spreading features of hemodynamic events associated with spreading depolarizations.”

      • For panel F, a measure of variance would be more suited to show stereotypic profile across animals as the number of SDs varies between animals.

      Figure 2F indeed shows the average profile of hemodynamic events associated with spreading depolarizations (black line) with the variance (95% confidence interval error bands in gray). We have adjusted the corresponding figure caption to make this information more clear.

      Figure 3

      • The exact stimulation employed is not clear as the methods describe a 1.33 min delay between two whisker pad stimulations, but the figure reports 40s. The description is thereby ambiguous. We thank the reviewer for pointing out this potiential confusion which allowed us to correct a mistake

      • The effective delay between two stimulations delivered to the whisker pads is 40 seconds

      • The effective delay between two stimulations delivered to the same whisker pad is 80 seconds from start to start or 75 seconds from end to start.

      The text was amended accordingly in line 144: “Thus, the effective delay between two stimulations delivered to the same whisker pad is 80 seconds from start to start.“

      • In panel B the choice of colormap and transparency for template overlay is not explained and is confusing given the employed threshold of 1.6. Which mask was used to overlay the activation map on the template? Why black color to represent a supposedly significant difference?

      We thank the reviewer for pointing out this potiential confusion. We have adjusted the colormap in Figures 3 and 4.

      • The pre-stroke thalamic response is clearly localized in VPM for left stimulation, while it overlaps VPM and Po for the right stimulation. This questions the accuracy of the employed registration scheme and consequently the choice of these ROIs, which appear quite small as compared to the resolution and this positioning precision.

      We see the point of the reviewer, here the apparent difference because the brain is slighly tilted. By adjusting the angle for both activity maps (see Author response image 1) we confirm that both maps are very similar including the for activated areas VPM and Po.

      Author response image 1.

      • It would be interesting to see the same activation maps for all animals in supplementary.

      We have provided the Supplementary Figure 5 that contains both ipsilateral and contralateral responses to whiskers stimulation (from both left and right pads) for all trials and all rats included in this work.

      • Looking at panel C, more cortical regions seem to respond to the stimulation above S1BF.

      The reviewer is right and we have indeed mentioned this point several times in the original manuscript in:

      • the result section: “We also detected significant increase of activity in S2, AuD, Ect (*p<0.0001) and PRh (p<0.001) cortices and VPL nucleus (**p<0.01; the list of acronyms is provided in Supplementary Table 2), brain regions receiving direct efferent projections from the S1BF45,48,49, VPM or Po nuclei50–52.”

      • the caption of Figure 4: “S1BF, S2, AuD, VPM, VPL and Po regions are brain regions significatively activated (all pvalue<0.01; GLM followed by t-test.”

      • the conclusion section : “Functional responses to mechanical whisker stimulation were detected in several regions relaying the information from the whisker to the cortex, including the VPM and Po nuclei of the thalamus, and S1BF, the somatosensory barrel-field cortex. Responses were also observed in the S2 cortex involved in the multisensory integration of the information43,44,61, the auditory cortex as it receives direct efferent projection from S1BF45,61, and the VPL nuclei of the thalamus connected via corticothalamic projections45.“

      • It would be interesting to see bilateral traces as supplementary figures.

      We have provided the Supplementary Figure 5 that contains both ipsilateral and contralateral responses to whiskers stimulation (from both left and right pads) for all trials and all rats included in this work.

      • In both panels C and D, n=5 is reported, but methods state the use of 7 animals. Please clarify how animals have been used in the different studies

      We have clarified the report on animal use and amended the Supplementary Table 1 accordingly.

      • In Panel D, the 95% CI intervals seem particularly narrow. Might this be the result of considering multiple trials as independent events? A GLM analysis would avoid this statistical fallacy.

      We have provided the Supplementary Figure 5 that contains both ipsilateral and contralateral responses to whiskers stimulation (from both left and right pads) for all trials and all rats included in this work. The statistical analysis has been adjusted (see Materials and Methods) and completed with a Supplementary Figure 4

      Figure 4 - See comments above for Figure 3

      We have adjusted the Figure 3 accordingly to reviewer’s suggestions

      Reviewer #3 (Recommendations For The Authors):

      1) Introduction: Given the emphasis on the awake state, it would be helpful to note that a significant portion of strokes occur during sleep - as well as comment on its hemodynamic difference with respect to an awake state.

      We agree with the reviewer on the remark that some strokes occur during sleep phase. However, here the awake state, which has been poorly addressed in the litterature, is opposed to anesthesia a condition largerly used to investigate brain functions after stroke. We added a point and corresponding references about wake-up stroke, see Line 49.

      2) The effects of anesthetics on stroke are quite variable and the literature data on the topic is rather divergent: it would be helpful for the introduction to reflect the large level of discord in the literature and the wide-ranging mechanisms of action of different anesthetics.

      We thank the reviewer for this comment. We have completed our original sentence in the introduction to better reflect the various effects of anesthetics on stroke, see Line 50

      3) The reference list (14-17) to other studies of brain hemodynamic changes post ischemic stroke is egregiously short. Please expand. Similarly, the list of citations to other functional ultrasound rodent studies in the literature (23-24) is misleading: other groups have published similar work and ought to be cited.

      We thank the reviewer for this comment and added complementary references. However, we believe that the references 14-17 pointed by the reviewer are not only refering to brain hemodynamic changes but mostly on network and function as stated in the manuscript. Regarding references on fUS (23-24) mentioned by the reviewer, we did not limited our citation on functional ultrasound imaging to those 2 articles but on 15+ from 4 different research groups.

      4) It would be helpful if the authors used "spreading depolarization" the way it has been utilized in the many decades of research on them in the literature, namely, as waves of hyper/hypoactivity in the electrophysiological signals. Please use a distinct term to refer to waves of changes in the hemodynamic state.

      We have amended the terminology used in the manuscript. “Spreading depolarization” has been replaced by “hemodynamic events associated with spreading depolarizations” or similar.

      5) Why is this investigation restricted to male rats?

      As a proof of concept, we did not performed experiments in female rats. We agree that further investigation would require a gender mix. We added a line in the discussion.

      New text – Line 455:” Finally, it is important to note that this proof-of-concept work did not specifically focus the impact of sex dimorphism on the stroke or early behavioral outcomes following the insult that would greatly enhance the translational value of such preclinical stroke study80.”

      6) Were the animals tested during their active phase? If not, why not, and what are the implications of testing their responses during the sleep phase?

      We think there is a misunderstanding here as we investigated brain functions in awake head-fixed rats. Therefore, the sleep/active phases were not investigated neither mentioned in the manuscript.

      7) How is the level of stress monitored/established?

      In this work, we followed established procedure used to reduce stress and disconfort of the rats all along the experiment. The procedure used is now better detailled in the Materials and Methods section. However, the level of stress was not monitored, and would be of interest to considere in future experiments.

      8) What are the sequelae of stress on brain hemodynamics, especially given 1-4 hour long sessions.

      This is a good remark. While we cannot state on how the stress impacts brain hemodynamics, the data extracted show that hemodynamics reponse functions were stable and robust over hour-long recording (see control and pre-stroke sessions in Supplementary Figure 5).

      9) How is the animal prepared for stroke induction? In general, the methodological steps surrounding animal handling and preparation are exceedingly terse.

      We provided more details about the handling and preparation of the rats in the Materials and Methods section.

      Original text: “Body restraint and head fixation.

      Rats were habituated to the workbench and to be restrained in a sling suit (Lomir Biomedical inc, Canada), progressively increasing the restraining period from minutes to hours33,34. After the headpost implantation (see below), rats were habituated to be head-fixed while restrained in the sling. The period of fixation was progressively increased from minutes to hours. Water and food gel (DietGel, ClearH2O, USA) were provided along the habituation session. Once habituated, the cranial window for imaging was performed as described below (Figure 1A-C).”

      New text - Line 90:“ Body restraint and head fixation.

      The body restraint and head fixation procedures are adapted from published protocols and setup dedicated for brain imaging of awake rats39–41. Rats were habituated to the workbench and to be restrained in a sling suit (Lomir Biomedical inc, Canada) by progressively increasing restraining periods from minutes (5mins, 10mins, 30mins) to hours (1 and 3hrs) for one or two weeks. The habituation to head-fixation started by short (5 to 30s) and gentle head-fixation of the headpost between fingers. The headpost was then secured between clamps for fixation periods progressively increased following the same procedure as with the sling. For both body restraint and head fixation, the initial struggling and vocalization diminished over sessions. Water and food gel (DietGel, ClearH2O, USA) were provided for all body restraint and head-fixation habituation sessions. Once habituated, the cranial window for imaging was performed as described below (Figure 1A-C).”

      10) What is the reproducibility of the chemo-thrombotic model timeline? What are its limitations?

      We have provided more information on the chemo-thrombotic model and its limitations in the discussion section to discuss

      New text – Line 402:” However, to adequatly and efficiently occlude the vessel of interest, removing a piece of skull remains required. As mentioned in the report on animal use, one rat was excluded from the analysis as the MCA spontaneously reperfuses, thus dropping the success rate of such model.”

      11) What is the motivation behind the 5-days post stroke timepoint selection?

      In addition to demonstrating the feasability of imaging brain functions at different timepoint following the ischemia, the motivation to performed this delayed session was to capture functional diaschisis which is known to occur few days after the initial insult. More recurrent imaging sessions covering a longer post-stroke period would be of high interest to better capture the impact of ischemia on both the brain hemodynamics and functions.

      12) How predictive is hyperacute hemodynamics imaging of the long-term outcome?

      We thanks the reviewer for this question, that remains of major interest in the stroke realm. However, the prediction of long-term outcome would require to capture brain hemodynamic at larger scale as performed in Hingot et al., Theranostics 2020 and Brunner et al. JCBFM 2023, a coverage not accessible with the imaging window proposed in this work.

      13) It would be greatly reassuring if the authors presented the statistical parametric maps without masking regions of interest (eg Fig3B).

      We thank the reviewer for pointing out this potential confusion. In the first version of the figure, the colormap used of activity maps was indeed non optimal. Therefore, we i) adjusted the colormap used in Fig 3 and 4 and ii) provided non-thresholded z-score maps for all rats in Supplementary Figure 5.

      14) Fig 3C is hard to make out.

      We provided a full page version of the Figure 3C in Supplementary Figure 3.

      15) Figs 3,4 should incorporate box and whisker plots of data across all rats scatter plots of individual animal data.

      We are not sure which kind of data the reviewer wants to have displayed here. However, we have provided the Supplementary Figure 5 that contains both ipsilateral and contralateral responses to whiskers stimulation (from both left and right pads) for all trials and for individual animal included in this work.

      16) The final panels in Figures 3,4 would more tellingly include the plots of the linear models fitted.

      Based on all reviewers’ comments, we have adjusted and clarified the statistical analysis performed (see Materials and Method) and completed with a Supplementary Figure 4.

      17) The frame rate calculations are not adding up unless averaging and pauses are included so some more details should be stated. Are tilted plane waves averaged before compounding as in prior publications?

      The angles are averaged 6 times before compounding to reduce signal to noise ration and there is a pause of 0.3s between each Doppler image. See also question “Functional Ultrasound Imaging acquisition” from reviewer 2. We also provided supplementary and key information about the sequence used in this work.

      We have provided complementary information in the manuscript:

      Original text:” The ultrasound sequence generated by the software is the same as in Macé et al.,26 and Brunner, Grillet et al., Briefly, the ultrafast scanner images the brain 140 with 5 tilted plane-waves (-6°, -3°, +0.5°, +3°, +6°) at a 10-kHz frame rate. The 5 plane-wave images are added to create compound images at a frame rate of 500Hz. Each set of 250 compound images is 142 filtered to extract the blood signal. Finally, the intensity of the filtered images is averaged to obtain a 143 vascular image of the rat brain at a frame rate of 1.25Hz. Then, the acquired images are processed with a dedicated GPU architecture, displayed in real-time for data visualization, and stored for subsequent off-line analysis.”

      New text – Line 146:” The ultrasound sequence generated by the software is adapted from Macé et al.31 and Brunner, Grillet et al.34 Ultrafast images of the brain were generated using 5 tilted plane-waves (-6°, -3°, +0.5°, +3°, +6°). Each plane wave is repeated 6 times and the recorded echoes are averaged to increase the signal to noise ration. The 5 plane-wave images are added to create compound images at a frame rate of 500Hz. To obtain a single vascular image we acquired a set of 250 compound images in 0.5s, an extra 0.3s pause is included between each image to have some processing time to display the images for real-time monitoring of the experiment. The set of 250 compound images has a mixed information of blood and tissue signal. To extract the blood signal we apply a low pass filter (cutt off 15Hz) and an SVD filter that eliminates 20 singular values. This filter aims to select all the signal from blood moving with an axial velocity higher than ~1mm/s. To obtain a vascular iimage we compute the intensity of the blood signal i.e., Power Doppler image. This image is in first approximation proportional to the cerebral blood volume26,28. Overall, this process enables a continious acquisition of power Doppler images at a frame rate of 1.25Hz during several hours.”

      18) Ultrasound data processing: The filtering process should have more description. It would be highly instructive to explain that the power Doppler signal is being used and comment clearly on its relationship to blood volume, commenting on stalled flow mircrovessels/RBC-devoid micrrovessels, and considerations of vessel orientation.

      The compound image has a mixed information of blood and tissu signal. To extract the blood signal, we applied a low pass filter (cutt off 15Hz) and an SVD filter that eliminates 20 singular values. This filter selects all the signal from blood moving with an axial velocity higher than ~1mm/s. To obtain a vascular iimage we compute the intensity of the blood signal (Power Doppler image). This power Doppler image is in first approximation proportional to the cerebral blood volume.

      These information have been added in the Materials and Methods section of the manuscript.

      19) Does the SVD processing have the same cut off (20 singular values) as in prior publications as a standard value, or is that adjusted for each study? There are enough minor differences between sequences that these details are uncertain. Do the overall hemodynamics measurements (Fig 2) include all data acquired, or do they exclude the whisker stimulation events, and if so, how long of a window is excluded? The explanation of the activity maps should be rephrased e.g. "... recordings are segmented in shorter 40-s time windows encompassing the whisker stimulation trials..."

      We agree that these details are important, all these information have been added to the manuscript

      • SVD processing: We eliminate 20 singular values as in cited studies.

      • Sequence: we have included more details about the sequence.

      • Processing: all data during the whisker stimulation is used.

      • We have rephrased the explanation about the activity maps.

      20) Discuss the methodology behind histological data shown in Fig. 1.

      We thank the review for highlighting this omission. We have provided a paragraph in the Materials & Methods section detailling the histology procedure (Line 228):

      “Histopathology

      Rats were killed 24hrs after the occlusion for histological analysis of the infarcted tissue. Rats received a lethal injection of pentobarbital (100mg/kg i.p. Dolethal, Vetoquinol, France). Using a peristaltic pump, they were transcardially perfused with phosphate-buffered saline followed by 4% paraformaldehyde (Sigma-Aldrich, USA). Brains were collected and post-fixed overnight. 50-μm thick coronal brain sections across the MCA territory were sliced on a vibratome (VT1000S, Leica Microsystems, Germany) and analyzed using the cresyl violet (Electron Microscopy Sciences, USA) staining procedure (see Open Lab Book for procedure). Slices were mounted with DPX mounting medium (Sigma-Aldrich, USA) and scanned using a bright-field microscope

    1. Author Response

      The following is the authors’ response to the original reviews.

      We were pleased with seeing our work published as a Reviewed Preprint online so swiftly. Now, we would like to take the opportunity to include our responses to the comments made by the reviewers into the Reviewed Preprint and also submit a revised version of the manuscript, in which we have incorporated and addressed the reviewers’ comments.

      We believe that our revisions have significantly improved the quality of the manuscript. Specifically, we have described our results more precisely and explained certain decisions that were made in the analysis pipeline more clearly. For example, Figure 4 was improved substantially, by incorporating a schematic representation of how ERP traces were extracted from neural data. Furthermore, we have added three paragraphs in the Discussion where we elaborate on 1) the two observed interaction effects between attention and drug condition, 2) the relation between behavioral, computational, and neural effects, and 3) the statistical robustness of our findings. As such, we believe our interpretation of the results and their robustness now more faithfully represents our observations.

      Moreover, we have incorporated the Supplementary Information and Figures, initially presented as a separate section of the manuscript, to the main manuscript and its accompanying supplementary figures. Thereby, the structure of the paper now better follows the eLife format. As a result, some of the previously included supplementary figures are now described in text of the main manuscript.

      Reviewer #1 comments:

      In the results section on page 6, the authors conclude that "Attention and ATX both enhanced the rate of evidence accumulation towards a decision threshold, whereas cholinergic effects were negligible." I believe "negligible" is wrong here: the corresponding effects of donepezil had p-values of .09 (effect of donepezil on drift rate), .07 (effect of donepezil on the cue validity effect on drift rate) and .09 (effect of donepezil on non-decision time), and were all in the same direction as the effects of atomoxetine, and would presumably have been significant with a somewhat larger sample size. I would say the effects of donepezil were "in the same direction but less robust" (or at the very least "less robust") instead of "negligible".

      We agree with the reviewer that ‘negligible’ may not properly capture the effects of DNP on DDM parameter estimates. Although we do feel that caution is warranted in interpreting the effects of DNP on computational parameter estimates, we have now described these effects in line with the reviewer’s suggestion: in the same direction as the effects of ATX, but not (or less) statistically robust.

      "In the results section on page 8, the authors conclude that "Summarizing, we show that drug condition and cue validity both affect the CPP, but they do so by affecting different features of this component (i.e. peak amplitude and slope, respectively)." This conclusion is a bit problematic for two reasons. First, drug condition had a significant effect not only on peak amplitude but also on slope. Second, cue validity had a significant effect not only on slope but also on peak amplitude. It may well be that some effects were more significant than others, but I think this does not warrant the authors' conclusion.

      Indeed, we observed that cue validity affected both CPP peak amplitude and slope and some effects were more significant than others. As such, we agree with the reviewer that the conclusion that cue validity and drug condition affect different features of the CPP was too strongly formulated. We have changed this statement in the manuscript to reflect the observed data pattern more appropriately. We would however like to point out that this does not undermine our main conclusion. Spatial attention and drug condition showed only limited interaction effects in terms of behavior and neural data and their effects on occipital activity were separable in terms of timing and spatial profile. Therefore, our conclusion that catecholamines and spatial attention jointly shape perceptual decision-making remains valid.

      In the discussion section on page 11, the authors conclude that "First, although both attention and catecholaminergic enhancement affected centro-parietal decision signals in the EEG related to evidence accumulation (O'Connell et al., 2012; Twomey et al., 2015), attention mainly affected the build-up rate (slope) whereas ATX increased the amplitude of the CPP component (Figure 3D-F)." As I wrote above, I believe it is not correct that "attention mainly affected the build-up rate or slope", given that the effect of cue-validity on CPP slope was also significant. Also, while the authors' data do support the conclusion that ATX increased the amplitude and not the slope of the CPP component, a previous study in humans found the opposite: ATX increased the slope but did not affect the peak amplitude of the CPP (Loughnane et al 2019, JoCN, https://pubmed.ncbi.nlm.nih.gov/30883291). Although the authors cite this study (as from 2018 instead of 2019), they do not draw attention to this important discrepancy between the two studies. I encourage the authors to dedicate some discussion to these conflicting findings.

      We thank the reviewer for spotting this error, we cited the preprint version (from 2018) of Loughnane and colleagues and not the published JoCN paper (from 2019). We have changed this in the updated version of the manuscript. We further thank the reviewer for asking about this interesting discrepancy between our observation that ATX increased CPP peak amplitude in absence of slope effects and the observation by Loughnane et al. (2019, JoCN) that ATX increased CPP slope, but not amplitude. We first would like to point out that the peak amplitude effect in Loughnane et al. (2019) was in the same direction as our reported effect, with numerically higher peak amplitudes for ATX compared to PLC (Figure 2A – right panel in Loughnane et al., 2019). However, as their omnibus main effect of drug condition on CPP peak amplitude was not significant, they did not provide statistics for a pairwise comparison of ATX and PLC in terms of CPP peak amplitude, which makes it hard to compare the effects directly. Regardless, Loughnane et al. (2019) did observe an effect on CPP slope, whereas we did not. Speculatively, this difference could be related to the behavioral tasks that were used in both studies. Below we have added a new paragraph from the Discussion in which we elaborate on this more.

      In Discussion, page 15:

      Here, we demonstrated that response accuracy and response speed are differentially represented in the CPP, with correct vs. erroneous responses resulting in a higher slope and peak amplitude, whereas fast vs. slow responses are only associated with increased slopes (Figure 3A-B). Speculatively, the specific effect of any (pharmacological) manipulation on the CPP may depend on task-setting. For example, Loughnane et al. (2019) used a visual task on which participants did not make many errors (hit rate>98%, no false alarms), whereas we applied a task in which participants regularly made errors (roughly 25% of all trials). Possibly, the effects of ATX from Loughnane et al. (2019) in terms of behavior (RT effect, not accuracy/d’) and CPP feature (slope effect, not peak) may therefore have been different from the effects of ATX we observed on behavior (d’ effect, not RT) and CPP feature (peak effect, not slope). Regardless, when we compared subjects with high and low drift rates (Figure 3C), we observed that both CPP slope and CPP peak were increased for the high vs. low drift group (independent of the drug or attentional manipulation). This indicates that both CPP slope and CPP peak were associated with drift rate from the DDM. Clearly, more work is needed to fully understand how evidence accumulation unfolds in neural systems, which could consequently inform future behavioral models of evidence accumulation as well.

      On page 12 and page 14 the authors suggest a selective effect of ATX on tonic catecholamine activity, but to my knowledge the exact effects of ATX on phasic vs. tonic catecholamine activity are unknown. Although microdialysis studies have shown that a single dose of atomoxetine increases catecholamine concentrations in rodents, it is unknown whether this reflects an increase in tonic and/or phasic activity, due to the limited temporal resolution of microanalysis. Thus, atomoxetine may affect tonic and/or phasic catecholamine activity, and which of these two effects dominates is still unknown, I think.

      We agree with the reviewer that the direct effects of ATX on tonic versus phasic catecholaminergic activity are not clear as initially stated in the manuscript. Equally problematic, previous work has demonstrated that changes in tonic neuromodulation shape evoked neuromodulatory discharge (Aston-Jones & Cohen, 2005, Annu. Rev. Neurosci; Knapen et al., 2016, PLoS ONE). As such, any effect of ATX on tonic neuromodulatory drive would probably have affected phasic catecholaminergic responses as well, although this claim will have to be experimentally addressed. We think that because of the close relation between tonic and phasic neuromodulation, it may indeed be better to refrain from the simplistic interpretation that ATX (and DNP) solely and specifically affects tonic neuromodulation. We have used more neutral language in that regard in the updated version of the manuscript, for example by only mentioning elevated neuromodulator levels (not specifying tonic or phasic). Moreover, we have extended a part of our previous Discussion, to elaborate this issue in more detail. An excerpt of this paragraph, consisting of previous and newly added text, can be seen below.

      In Discussion, page 14:

      In contrast with recent work associating catecholaminergic and cholinergic activity with attention by virtue of modulating prestimulus alpha-power shifts (Bauer et al., 2012; Dahl et al., 2020, 2022) and attentional cue-locked gamma-power (Bauer et al., 2012; Howe et al., 2017), the current work shows that the effects of neuromodulator activity are relatively global and non-specific, whereas the effects of spatial attention are more specific to certain locations in space. Our findings are, however, not necessarily at odds with these previous studies. Most recent work associates phasic (event-related) arousal with selective attention (for reviews see: Dahl et al., 2022; Thiele & Bellgrove, 2018). For example, cue detection in visual tasks is known to be related to cholinergic transients occurring after cue onset (Howe et al., 2017; Parikh et al., 2007). Contrarily, in our work we aimed to investigate the effects of increased baseline levels of neuromodulation by suppressing the reuptake of catecholamines and the breakdown of acetylcholine throughout cortex and subcortical structures. Tonic and phasic neuromodulation have previously been shown to differentially modulate behavior and neural activity (de Gee et al., 2014, 2020, 2021; McGinley et al., 2015; McGinley, Vinck, et al., 2015; van Kempen et al., 2019). Note, however, that it is difficult to investigate causal effects of tonic neuromodulation in isolation of changes in phasic neuromodulation, mostly because phasic and tonic activity are thought to be anti-correlated, with lower phasic responses following high baseline activity and vice versa (Aston- Jones & Cohen, 2005; de Gee et al., 2020; Knapen et al., 2016). As such, pharmacologically elevating tonic neuromodulator levels may have resulted in changes in phasic neuromodulatory responses as well. Concurrent and systematic modulations of tonic (e.g. with pharmacology) and phasic (e.g. with accessory stimuli; Bruel et al., 2022; Tona et al., 2016) neuromodulator activity may be necessary to disentangle the respective and interactive effects of tonic and phasic neuromodulator activity on human perceptual decision-making.

      Reviewer #2 comments:

      The main weakness of the paper lies in the strength of evidence provided, and how the results tally with each other. To begin with, there are a lot of significance tests performed here, increasing the chances of false positives. Multiple comparison testing is only performed across time in the EEG results, and not across post-hoc comparisons throughout the paper. In and of itself, it does not invalidate any result per se, but it does colour the interpretation of any results of weak significance, of which there are quite a few. For example, the effect of Drug on d' and subsequent post-hoc comparisons, also effect of ATX on CPP amplitude and others.

      We agree with the reviewer that the statistical evidence for some of the results presented in this study is limited. This issue mostly concerns the effects of the pharmacological manipulation (effects of attention were strong and robust), which is unfortunately often the case given the high inter-individual variability in responses to pharmaceutical agents. We have added a paragraph to the Discussion in which we discuss this limitation of the current study. Furthermore, we discuss our findings in the context of previous work, thereby showing that - although not always robust- most of the reported drug effects were in the direction that could be expected based on previous literature. We have pasted that paragraph below.

      In Discussion, pages 16:

      Although the effects of the attentional manipulation were generally strong and robust, the statistical reliability of the effects of the pharmacological manipulation was more modest for some comparisons. This may partly be explained by high inter-individual variability in responses to pharmaceutical agents. For example, initial levels of catecholamines may modulate the effect of catecholaminergic stimulants on task performance, as task performance is supposed to be optimal at intermediate levels of catecholaminergic neuromodulation (Cools & D’Esposito, 2011). While acknowledging this, we would like to highlight that many of the observed effects of ATX were in the expected direction and in line with previous work. First, pharmacologically enhancing catecholaminergic levels have previously been shown to increase perceptual sensitivity (d’) (Gelbard-Sagiv et al., 2018), a finding that we have replicated here. Second, methylphenidate (MPH), a pharmaceutical agent that elevates catecholaminergic levels as well, has been shown to increase drift rate as derived from drift diffusion modeling on visual tasks (Beste et al., 2018) in line with our ATX observations. Third, a previous study using ATX to elevate catecholaminergic levels observed that ATX increased CPP slope (Loughnane et al., 2019). Although in our case ATX increased the CPP peak and not its slope, this provide causal evidence that centro-parietal ERP signals related to sensory evidence accumulation are modulated by the catecholaminergic system (Nieuwenhuis et al., 2005). Fourth, we observed that elevated levels of catecholamines affected stimulus driven occipital activity relatively late in time and close to the behavioral response, which resonates with previous observations (Gelbard-Sagiv et al., 2018). Finally, ATX had robust effects on physiological responses (heart rate, blood pressure, pupil size), cue-locked ERP signals and oscillatory power dynamics in the alpha-band, leading up to stimulus presentation. We concur, however, that more work is needed to firmly establish how (various forms of) attention and catecholaminergic neuromodulation affect perceptual decision-making.

      The lack of an overall RT effect of Drug leaves any DDM result a little underwhelming. How do these results tally? One potential avenue for lack of RT effect in ATX condition is increased drift rate but also increased non-decision time, working against each other. However, it may be difficult to validate these results theoretically.

      As the reviewer remarks, an increase in performance/d’ in absence of any RT effects can be algorithmically explained by a combination of increased drift rate and prolonged non-decision time. This is indeed what we observed for ATX. Non-decision time is generally thought to reflect the time necessary for stimulus encoding and motor execution and as such is seen as separate from the evidence-accumulation decision process. We deem it possible that ATX simultaneously prolonged stimulus encoding/motor execution (reflected in changes in non-decision time) and fastened evidence accumulation (reflected in changes in drift rate). Although our neural data did not provide evidence for this claim, previous work has demonstrated that increased baseline (pupil-linked) arousal/neuromodulation is associated with a decreased build-up rate of a neural signal associated with motor execution (β-power over motor cortex, Van Kempen et al., 2019, eLife), potentially linking increased non-decision time under ATX to slowing down of motor execution processes. The same authors also report relationships between baseline (pupil-linked) arousal/neuromodulation and activity over occipital and centroparietal cortices, respectively associated with sensory processing and sensory evidence accumulation, suggesting that baseline neuromodulation may affect all stages leading up to a decision (sensory processing, evidence accumulation and motor execution). Note also that the attentional manipulation seems to simultaneously increase drift rate and shorten non-decision time in our case, as one would expect (Figure 2E, Figure 2 – Supplements 4&5).

      There is an interaction between ATX and Cue in terms of drift rate, this goes against the main thesis of the paper of distinct and non-interacting contributions of neuromodulators and attention. This finding is then ignored. There is also a greater EDAN later for ATX compared to PLA later in the results, which would also indicate interaction of neuromodulators and attention but this is also somewhat ignored.

      There are indeed some interesting interaction effects between ATX and spatial attention (cue), as pointed out by the reviewer. However, we did also observe striking differences in the effects of ATX and attention on stimulus-locked occipital activity (in timing and spatial specificity) as well as independent (main) effects on CPP amplitude and pre-stimulus alpha power. Therefore, throughout the paper we tried to carefully describe the effects of attention and ATX as largely independently and jointly modulating perceptual decision-making, while at the same time highlighting the interaction effects that we observed, where present. We have highlighted the effects the reviewer refers to even more explicitly in a separate paragraph that we added to the discussion, pasted below.

      In Discussion, page 13-14:

      We did observe two striking interaction effects between the catecholaminergic system and spatial attention. First, effects of attention on drift rate were increased under catecholaminergic enhancement (Figure 2D). Although this interaction effect was not reflected in CPP slope/peak amplitude, this does suggest that catecholamines and spatial attention might together shape sensory evidence accumulation in a non-linear manner. Second, the amplitude of the cue-locked early lateralized ERP component (resembling the EDAN) was increased under ATX as compared to PLC. The underlying neural processes driving the EDAN ERP, as well as its associated functions, have been a topic of debate. Some have argued that the EDAN reflects early attentional orienting (Praamstra & Kourtis, 2010) but others have claimed it is mere a visually evoked response and reflects visual processing of the cue (Velzen & Eimer, 2003). Thus, whether this effect reflects a modulation of ATX on early attentional processes or rather a modulation of early visual responses to sensory input in general is a matter for future experimentation.

      The CPP results are somewhat unclear. Although there is an effect of ATX on drift rate algorithmically, there is no effect of ATX on CPP slope. On the other hand, even though there is no effect of DNP on drift rate, there is an effect of DNP on CPP slope. Perhaps one may say that the effect of DNP on drift rate trended towards significance, but overall the combination of effects here is a little unconvincing. In addition, there is an effect of ATX on CPP amplitude, but how does this tally with behaviour? Would you expect greater CPP amplitude to lead to faster or slower RTs? The authors do recognise this discrepancy in the Discussion, but discount it by saying the relationship between algorithmic and CPP parameters in terms of DDM is unclear, which undermines the reasoning behind the CPP analyses (and especially the one correlating CPP slope with DDM drift rate).

      We thank the reviewer for pointing out this dissociation of drug effects in terms of the algorithmic (DDM) and neural (CPP) ‘implementations’ of the evidence accumulating process underlying perceptual decisions. We have added a new paragraph to the discussion where we interpret the effects of ATX on the neural and algorithmic levels of evidence accumulation. Below we have pasted that paragraph:

      In Discussion, page 14-15:

      We reported attentional and neuromodulatory effects on algorithmic (DDM, Figure 2) and neural (CPP, Figure 3) markers of sensory evidence accumulation. Recent work has started to investigate the association of these two descriptors of the accumulation process, aiming to uncover whether neural activity over centroparietal regions reflects evidence accumulation, as proposed by computational accumulation-to-threshold models (Kelly & O’Connell, 2015; O’Connell et al., 2018; O’Connell & Kelly, 2021; Twomey et al., 2015). Currently, the CPP is often thought to reflect the decision variable, i.e. the (unsigned) evidence for a decision (Twomey et al., 2015), and consequently its slope should correspond with drift rate, whereas its amplitude at any time should correspond with the so-far accumulated evidence. As -computationally- the decision is reached when evidence crosses a decision bound (the threshold), it may be argued that the peak amplitude of the CPP (roughly) corresponds with the decision boundary. This seems to contradict our observation that 1) ATX modulated drift rate, but not CPP slope and 2) ATX did not modulate boundary separation, but did modulate CPP peak. Note, however, that previous studies using pharmacology or pupil-linked indexes of (catecholaminergic) neuromodulation have also demonstrated effects on both CPP peak (van Kempen et al., 2019) and CPP slope (Loughnane et al., 2019).

      The posterior component effects are problematic. The main issue is the lack of clarification of and justification for the choice of posterior component. The analysis is introduced in the context of the target selection signal the N2pc/N2c, but the component which follows is defined relative to Cue, albeit post-target. Thus this analysis tells us the effect of Cue on early posterior (possibly) visual ERP components, but it is not related to target selection as it is pooled across target/distractor. Even if we ignore this, the results themselves wrt Drug lack context. There is a trending lower amplitude for ATX at later latencies at temporo-parietal electrodes, and more positive for DNP, relative to PLA. Is this what one would expect given behaviour? This is where the issue of correct component identification becomes critical in order to inform any priors on expected ERP results given behaviour.

      We thank the reviewer for raising this issue with the occipital ERP analysis, allowing us to clarify our decisions regarding the analyses and our interpretations of the results. First, the selection of electrodes was based on, and identical to, previous studies investigating lateralized target selection signals in visual tasks containing bilateral visual stimuli (Loughnane et al., 2016; Newman et al., 2017; Papaioannou & Luck, 2020; van Kempen et al., 2019). Second, the ERPs were defined relative to both the direction of the cue as well as the location of the target. As cue direction and target location were not always congruent (cue validity=80%), we could adopt a 2x2 (cue direction x stimulus identity) design for our ERP analyses (we are ignoring drug condition for explanation purposes). For example, for validly cued target trials we extracted two ERP traces: 1) from the hemisphere contralateral to both the cue and the target stimulus (representing processing of cued target stimulus) and 2) from the hemisphere ipsilateral to the cue and the target stimulus (representing processing of non-cued noise stimulus). However, for invalidly cued trials, ERP traces were extracted from 3) the hemisphere contralateral to cue direction and ipsilateral to the target stimulus (reflecting processing of cued noise stimuli) as well as 4) from the hemisphere ipsilateral to cue direction but contralateral to the target stimulus (reflecting processing of non-cued target stimuli). By defining our ERPs as such, we were able to gauge effects of cue direction (reflecting general shifts in attention), stimulus identity (reflecting target vs. noise selection processes) and their interaction (reflecting cue validity) on activity over occipito-temporal activity. Third, we did not pool data (across target/noise stimuli) for statistical analyses, but only for visualization purposes. To clarify how we extracted ERP traces, we have changed Figure 4 substantially. The updated figure now contains a schematic of how these four distinct ERP traces (cue x stimulus identity) were extracted from neural activity. Moreover, for clarity sake, we now show all 12 ERP traces (3x2x2, drug condition x cue direction x stimulus identity) as well as the three main effects that we observed after performing a 3x2x2 repeated measures (rm)ANOVA over time.

      We observed robust (cluster-corrected) effects of cue direction (not validity) on early occipital activity (Fig. 4C – left panel) and of stimulus identity (target/noise) and drug condition on later occipital activity (Fig. 4C – middle and right panel). These results crucially highlight the different temporal (early/late) and spatial (lateralized/not lateralized) profiles of cue, target and drug effects on occipital activity. Moreover, we observed a specific order of drug effects on late occipital activity (DNP>PLC>ATX). The behavioral relevance of this pattern of effects remains elusive. Although the effects of drug condition coincide in time with those of target selection (i.e. when activity contralateral and ipsilateral to the target stimulus was different), the effects of drug were bilateral, meaning that occipito-temporal activity related to the processing of the target (task-relevant) stimulus and non-target (task-irrelevant) stimulus was equally modulated by these pharmaceutical agents. One might argue that these effects show that neither ATX nor DNP modulated the signal-to-noise ratio (SNR), a feature that describes how well relevant stimulus information (signal) can be discerned from irrelevant information (noise). Although it may be tempting to extrapolate this finding to behavior, by suggesting that on the basis of these drug effect neither ATX nor DNP could have modulated d’ (behavioral measure describing how well signal is separated from noise), we would like to point out that our behavioral task specifically concerned a discrimination task about the (orientation of the) target stimulus in which the difference between signal and noise was only relevant for localization purposes and thus has a less direct relation with task performance. As such it is difficult to grasp how the modulation of late occipito-temporal activity by ATX and DNP relates to their behavioral effects. Moreover, the bilateral effect of both ATX and DNP also suggests an absence of interaction effects between drug conditions and visuo-spatial attention, as the effects of ATX/DNP were similar across all cue and target identity conditions.

    1. Author Response

      The following is the authors’ response to the original reviews.

      Reviewer #1 (Public Review):*

      The manuscript by Hariani et al. presents experiments designed to improve our understanding of the connectivity and computational role of Unipolar Brush Cells (UBCs) within the cerebellar cortex, primarily lobes IX and X. The authors develop and cross several genetic lines of mice that express distinct fluorophores in subsets of UBCs, combined with immunocytochemistry that also distinguishes subtypes of UBCs, and they use confocal microscopy and electrophysiology to characterize the electrical and synaptic properties of subsets of so-labelled cells, and their synaptic connectivity within the cerebellar cortex. The authors then generate a computer model to test the possible computational functions of such interconnected UBCs.

      Using these approaches, the authors report that:

      1) GRP-driven TDtomato is expressed exclusively in a subset (20%) of ON-UBCs, defined electrophysiologically (excited by mossy fiber afferent stimulation via activation of UBC AMPA and mGluR1 receptors) and immunocytochemically by their expression of mGluR1.

      2) UBCs ID'd/tagged by mCitrine expression in Brainbow mouse line P079 are expressed in a similar minority subset of OFF-UBCs defined electrophysiologically (inhibited by mossy fiber afferent stimulation via activation of UBC mGluR2 receptors) and immunocytochemically by their expression of Calretinin. However, such mCitrine expression was also detected in some mGluR1 positive UBCs, which may not have shown up electrophysiologically because of the weaker fluorophore expression without antibody amplification.

      This is correctly stated with the exception that the P079 mouse line itself expresses mCitrine. The Brainbow mouse line was used in the connectivity study by crossing it to the GRP-Cre or Calretinin-Cre lines.

      3) Confocal analysis of crossed lines of mice (GRP X P079) stained with antibodies to mGluR1 and calretinin documented the existence of all possible permutations of interconnectivity between cells (ON-ON, ON-OFF, OFF-OFF, OFF-ON), but their overall abundance was low, and neither their absolute nor relative abundance was quantified.

      They were certainly rare to observe using our approaches, but we reasoned that the densities of such connections are not possible to estimate accurately. Please see discussion below.

      4) A computational model (NEURON ) indicated that the presence of an intermediary UBC (in a polysynaptic circuit from MF to UBC to UBC) could prolong bursts (MF-ON-ON), prolong pauses (MF-ON-OFF), cause a delayed burst (MF-OFF- OFF), cause a delayed pause (MF-OFF-ON) relative to solely MF to UBC synapses which would simply exhibit long bursts (MF-ON) or long pauses (MF-OFF).

      The authors thus conclude that the pattern of interconnected UBCs provides an extended and more nuanced pattern of firing within the cerebellar cortex that could mediate longer-lasting sensorimotor responses.

      The cerebellum's long-known role in motor skills and reflexes, and associated disorders, combined with our nascent understanding of its role in cognitive, emotional, and appetitive processing, makes understanding its circuitry and processing functions of broad interest to the neuroscience and biomedical community. The focus on UBCs, which are largely restricted to vestibular lobules of the cerebellum reduces the breadth of likely interest somewhat. The overall design of specific experiments is rigorous and the use of fluorophore expressing mouse lines is creative. The data that is presented and the writing are clear. However, the overall experimental design has issues that reduce overall interpretation (please see specific issues for details), which combined with a lack of thorough analysis of the experimental outcomes severely undermines the value of the NEURON model results and the advance in our understanding of cerebellar processing in situ (again, please see specific issues for details).

      Specific issues:

      1) All data gathered with inhibition blocked. All of the UBC response data (Fig. 1) was gathered in the presence of GABAAR and Glycine R blockers. While such an approach is appropriate generally for isolating glutamatergic synaptic currents, and specifically for examining and characterizing monosynaptic responses to single stimuli, it becomes problematic in the context of assaying synaptic and action potential response durations for long-lasting responses, and in particular for trains of stimuli, when feed-forward and feed-back inhibition modulates responses to afferent stimulation. That is, even for single MF stimuli, given the >500ms duration of UBC synaptic currents, there is plenty of time for feedback inhibition from Golgi cells (or feedforward, from MF to Golgi cell excitation) to interrupt AP firing driven by the direct glutamatergic synaptic excitation. This issue is compounded further for all of the experiments examining trains of MF stimuli. Beyond the impact of feedback inhibition on the AP firing of any given UBC, it would also obviously reduce/alter/interrupt that UBC's synaptic drive of downstream UBCs. This issue fundamentally undermines our ability to interpret the simulation data of Vm and AP firing of both the modeled intermediate and downstream UBC, in terms of applying it to possible cerebellar cortical processing in situ.

      The goal of Figure 1 was to determine the cell types of labeled UBCs in transgenic mouse lines, which is determined entirely by their synaptic responses to glutamate (Borges-Merjane and Trussell, 2015). Thus, blocking inhibition was essential to produce clear results in the characterization of GRP and P079 UBCs. While GABAergic/glycinergic feedforward and feedback inhibition is certainly important in the intact circuit, it was not our intention, nor was it possible, to study its contribution in the present study. Leaving inhibition unblocked does not lead to a physiologically realistic stimulation pattern in acute brain slices, because electrical stimulation produces synchronous excitation and inhibition by directly exciting Golgi cells, rather than their synaptic inputs. The main inhibition that UBCs receive that are crucial to determining burst or pause durations is not via GABA/glycine, but instead through mGluR2, which lasts for 100-1000s of milliseconds. The main excitation that drives UBC firing is mGluR1 and AMPA, which both last 100-1000s of milliseconds. Thus, these large conductances are unlikely to be significantly shaped by 1-10 ms IPSCs from feedforward and feedback GABA/glycine inhibition. Recent studies that examined the duration of bursting or pausing in UBCs had inhibition blocked in their experiments, presumably for the reasons outlined above (Guo et al., 2021; Huson et al., 2023).

      In Author response image 1 is an example showing the synaptic currents and firing patterns in an ON UBC before and after blocking inhibition. The GABA/glycinergic inhibition is fast, occurs soon after the stimuli and has little to no effect on the slow inward current that develops after the end of stimulation, which is what drives firing for 100s of milliseconds.

      Author response image 1.

      Example showing small effect of GABAergic and glycinergic inhibition on excitatory currents and burst duration. A) Excitatory postsynaptic currents in response to train of 10 presynaptic stimuli at 50 Hz before (black) and after (Grey) blocking GABA and glycine receptors. The slow inward current that occurs at the end of stimulation is little affected. B) Expanded view of the synaptic currents evoked during the train of stimuli. GABA/glycine receptors mediate the fast outward currents that occur immediately after the first couple stimuli. C) Three examples of the bursts caused by the 50 Hz stimulation in the same cell without blocking GABA and glycine receptors. D) Three examples in the same cell after blocking GABA and glycine receptors.

      2) No consideration for the involvement of polysynaptic UBCs driving UBC responses to MF stimulation in electrophysiology experiments. Given the established existence (in this manuscript and Dino et al. 2000 Neurosci, Dino et al. 2000 ProgBrainRes, Nunzi and Mugnaini 2000 JCompNeurol, Nunzi et al. 2001 JCompNeurol) of polysynaptic connections from MFs to UBCs to UBCs, the MF evoked UBC responses established in this manuscript, especially responses to trains of stimuli could be mediated by direct MF inputs, or to polysynaptic UBC inputs, or possibly both (to my awareness not established either way). Thus the response durations could already include extension of duration by polysynaptic inputs, and so would overestimate the duration of monosynaptic inputs, and thus polysynaptic amplification/modulation, observed in the NEURON model.

      We are confident that the synaptic responses shown are monosynaptic for several reasons. UBCs receive a single mossy fiber input on their dendritic brush, and thus if our stimulation produces a reliable, short-latency response consistent with a monosynaptic input, then there is not likely to be a disynaptic input, because the main input is accounted for by the monosynaptic response. In all cells included in our data set, the fast AMPA receptor-mediated currents always occurred with short latency (1.24 ± 0.29 ms; mean ± SD; n = 13), high reliability (no failures to produce an EPSC in any of the 13 GRP UBCs in this data set), and low jitter (SD of latency; 0.074 ± 0.046 ms; mean ± SD; n = 13). These measurements have been added to the results section. In some rare cases, we did observe disynaptic currents, which were easily distinguishable because a single electrical stimulation produced a burst of EPSCs at variable latencies. Please see example in Author response image 2. These cases of disynaptic input, which have been reported by others (Diño et al., 2000; Nunzi and Mugnaini, 2000; van Dorp and De Zeeuw, 2015) support the conclusion that UBCs receive input from other UBCs.

      Author response image 2.

      Example of GRP UBC with disynaptic input. Three examples of the effect of a single presynaptic stimulus (triangle) in a GRP UBC with presumed disynaptic input. Note the variable latency of the first evoked EPSC, bursts of EPSCs, and spontaneous EPSCs.

      3) Lack of quantification of subtypes of UBC interconnectivity. Given that it is already established that UBCs synapse onto other UBCs (see refs above), the main potential advance of this manuscript in terms of connectivity is the establishment and quantification of ON-ON, ON-OFF, OFF-ON, and OFF-OFF subtypes of UBC interconnections. But, the authors only establish that each type exists, showing specific examples, but no quantification of the absolute or relative density was provided, and the authors' unquantified wording explicitly or implicitly states that they are not common. This lack of quantification and likely small number makes it difficult to know how important or what impact such synapses have on cerebellar processing, in the model and in situ.

      As noted by the reviewer, the connections between UBCs were rare to observe. We decided against attempting to quantify the absolute or relative density of connections for several reasons. A major reason for rare observations of anatomical connections between UBCs is likely due to the sparse labeling. First, the GRP mouse line only labels 20% of ON UBCs and we are unable to test whether postsynaptic connectivity of GRP ON UBCs is the same as that of the rest of the population of ON UBCs that are not labeled in the GRP mouse line. Second, the Brainbow reporter mouse only labels a small population of Cre expressing cells for unknown reasons. Third, the Brainbow reporter expression was so low that antibody amplification was necessary, which then limited the labeled cells to those close to the surface of the brain slices, because of known antibody penetration difficulties. Therefore, we refrained from estimating the density of these connections, because each of these variables reduced the labeling to unknown degrees and we reasoned that extrapolating our rare observations to the total population would be inaccurate.

      A paper that investigated UBC connectivity using organotypic slice cultures from P8 mice suggests that 2/3 of the UBC population receives UBC input, based on the observation that 2/3 of the mossy fibers did not degenerate as would be expected after 2 days in vitro if they were severed from a distant cell body (Nunzi and Mugnaini, 2000). It remains to be seen if this high proportion is due to the young age of these mice or is also the case in adult mice. Even if these connections are indeed rare, they are expected to have profound effects on the circuit, as each UBC has multiple mossy fiber terminals (Berthie and Axelrad, 1994), and mossy fiber terminals are estimated to contact 40 granule cells each (Jakab and Hamori, 1988). We have added a comment regarding this point to the discussion.

      4) Lack of critical parameters in NEURON model.

      A) The model uses # of molecules of glutamate released as the presumed quantal content, and this factor is constant. However, no consideration of changes in # of vesicles released from single versus trains of APs from MFs or UBCs is included. At most simple synapses, two sequential APs alters release probability, either up or down, and release probability changes dynamically with trains of APs. It is therefore reasonable to imagine UBC axon release probability is at least as complicated, and given the large surface area of contact between two UBCs, the number of vesicles released for any given AP is also likely more complex.

      B) the model does not include desensitization of AMPA receptors, which in the case of UBCs can paradoxically reduce response magnitude as vesicle release and consequent glutamate concentration in the cleft increases (Linney et al. 1997 JNeurophysiol, Lu et al. 2017 Neuron, Balmer et al. 2021 eLIFE), as would occur with trains of stimuli at MF to ON-UBCs.

      A) The model produces synaptic AMPA and mGluR2 currents that reproduce those we recorded in vitro. We did not find it necessary to implement changes in glutamate release during a train as the model was fit to UBC data with the assumption that the glutamate transient did not change during the train. If there is a change in neurotransmitter release during a train, it is therefore built into the model, which has the advantage of reducing its complexity. UBCs are a special case where the postsynaptic currents are mediated mostly by the total amount of transmitter released. Most of the evoked current occurs tens to hundreds of milliseconds after neurotransmitter release and is therefore much more sensitive to total release and less sensitive to how it is released during the train. Author response image 3 shows the effect of reducing the amount of glutamate released by 10% on each stimulus in the model. Despite a significant change in the pattern of neurotransmitter release, as well as a reduction in the total amount of glutamate, the slow EPSC still decays over the course of hundreds of milliseconds.

      Author response image 3.

      Effect of short-term depression of neurotransmitter release. A) The top trace shows the glutamate transient that drives the AMPA receptor model used in our study. No change in release is implemented, although the slow tail of each transient summates during the train. The bottom trace shows the modeled AMPA receptor mediated current. B) In this model the amount of glutamate released is reduced by 10% on each stimulus. The duration of the slow AMPA current that develops at the end of stimulation is similar, despite a profound change in the pattern of neurotransmitter exposure.

      B) The detailed kinetic AMPA receptor model used here accurately reproduces desensitization, and in fact recovery from desensitization is what mediates the slow ON UBC current. This AMPA receptor is a 13-state model, including 4 open states with 1-4 glutamates bound, 4 closed states with 1-4 glutamates bound, 4 desensitized states with 1-4 glutamates bound, and 5 closed states with 0-4 glutamates bound. The forward and reverse rates between different states in the model were fit to AMPA receptor currents recorded from dissociated UBCs and they accurately reproduced the ON UBC currents evoked by synaptic stimulation in our previous work (Balmer et al., 2021).

      5) Lack of quantification of various electrophysiological responses. UBCs are defined (ON or OFF) based on inward or outward synaptic response, but no information is provided about the range of the key parameter of duration across cells, which seems most critical to the current considerations. There is a similar lack of quantification across cells of AP duration in response to stimulation or current injections, or during baseline. The latter lack is particularly problematic because, in agreement with previous publications, the raw data in Fig. 1 shows ON UBCs as quiescent until MF stimulation and OFF UBCs firing spontaneously until MF stimulation, but, for example, at least one ON UBC in the NEURON model is firing spontaneously until synaptically activated by an OFF UBC (Fig. 11A), and an OFF UBC is silent until stimulated by a presynaptic OFF UBC (Fig. 11C). This may be expected/explainable theoretically, but then such cells should be observed in the raw data.

      To address this reasonable concern of a general lack of quantification of electrophysiological responses we have added data characterizing the slow inward and outward currents evoked by synaptic stimulation in GRP and P079 UBCs in the results section and in new panels in Figure 1. We report the action potential pause lengths in P079 UBCs and burst lengths in ON UBCs in the results section. However, we favor the duration of the currents to the length of burst and pause, because the currents do not depend on a stable resting membrane potential, which is itself difficult to determine in intracellular recordings of these small cells. We have added peak times and decay time constants of the slow inward and outward currents in ON and OFF UBCs in the results section and have added new panels to figure 1.

      In a series of recent publications that focused on UBC firing, the authors argue that cell-attached recordings are necessary to determine accurately the burst and pause lengths, as well as spontaneous firing rates (Guo et al., 2021; Huson et al., 2023). (The trade-off of these extracellular recordings is that the monosynaptic nature of the input is nearly impossible to confirm.) Spontaneous firing rates were variable within both GRP and P079 UBCs from silent to firing regularly or in bursts, as previously reported for UBCs (Kim et al., 2012; van Dorp and De Zeeuw, 2015). For clarity, we chose to model the GRP UBCs as silent unless receiving synaptic input and P079 UBCs as active unless receiving synaptic input. As the reviewer suggests, we have observed UBCs firing in the patterns similar to those shown in the model UBCs that have input from a spontaneously active presynaptic UBC. In Author response image 4 are some examples.

      Author response image 4.

      Examples of UBCs that receive spontaneous input. A) Three ON UBCs that had spontaneous EPSCs, suggesting the presence of an active presynaptic UBC. B) Two OFF UBCs that had spontaneous outward currents.

      Reviewer #2 (Public Review):

      In this paper, the authors presented a compelling rationale for investigating the role of UBCs in prolonging and diversifying signals. Based on the two types of UBCs known as ON and OFF UBC subtypes, they have highlighted the existing gaps in understanding UBCs connectivity and the need to investigate whether UBCs target UBCs of the same subtype, different subtypes, or both. The importance of this knowledge is for understanding how sensory signals are extended and diversified in the granule cell layer.

      The authors designed very interesting approaches to study UBCs connectivity by utilizing transgenic mice expressing GFP and RFP in UBCs, Brainbow approach, immunohistochemical and electrophysiological analysis, and computational models to understand how the feed-forward circuits of interconnected UBCs transform their inputs.

      This study provided evidence for the existence of distinct ON and OFF UBC subtypes based on their electrophysiological properties, anatomical characteristics, and expression patterns of mGluR1 and calretinin in the cerebellum. The findings support the classification of GRP UBCs as ON UBCs and P079 UBCs as OFF UBCs and suggest the presence of synaptic connections between the ON and OFF UBC subtypes. In addition, they found that GRP and P079 UBCs form parallel and convergent pathways and have different membrane capacitance and excitability. Furthermore, they showed that UBCs of the same subtype provide input to one another and modify the input to granule cells, which could provide a circuit mechanism to diversify and extend the pattern of spiking produced by mossy fiber input. Accordingly, they suggested that these transformations could provide a circuit mechanism for maintaining a sensory representation of movement for seconds.

      Overall, the article is well written in a sound detailed format, very interesting with excellent discovery and suggested model, however, I have some comments/suggestions that may help to improve this manuscript:

      • The discovery of UBCs innervating each other and their own subtypes, suggesting the presence of feed-forward networks in the cerebellum, is an incredibly fascinating and exciting finding followed by an intriguing model by authors. However, it is worth considering an alternative model as well. I acknowledge that visualizing such interactions using current tools and methods can be challenging ("The approaches used here were not able to determine the existence of networks of more than 2 UBCs connected one after the other. If present, 3 or more UBCs in series could extend and transform the input in even more dramatic ways. The temporal diversity that UBC circuits generate may underlie the flexibility of the cerebellum to coordinate movements over a broad range of behaviors."). Therefore, if this is the case in which more than 2 UBCs connected one after the other, then an alternative model PERHAPS resembles the basal nuclei, with its direct and indirect circuits, can be considered (maybe a type of circular model). The basal nuclei circuits are also regulated by modulators such as D1 dopamine receptors in the direct pathway, causing depolarization, and D2 dopamine receptors in the indirect pathway, resulting in hyperpolarization upon dopamine activation. This approach could involve using computational models to gain insight into potential alternatives within this pathway (may be a future direction).

      Thank you for this suggestion to consider the potentially similar circuit interactions in the basal nuclei. We will certainly investigate this further as we move forward with modeling the feed-forward networks in the cerebellum.

      • GRP UBCs are more densely distributed in lobes VI-IX, while P079 UBCs are more densely distributed in the dorsal leaflet of lobe X in sagittal sections. While the cerebellum is well known for its characteristic stripy pattern, are UBC distributions the same in coronal/transverse section?

      UBCs of different types, based on their expression of specific proteins, have overlapping but somewhat distinct distributions in coronal sections. The densities of calretinin-expressing UBCs are higher within Zebrin II positive zones and form sagittal stripes, whereas the densities of mGluR1-expressing and PLCb4-expressing UBCs vary less but are in their highest densities at the midline (Chung et al., 2009; Sekerkova et al., 2014). The difference noted by the reviewer between the dorsal and ventral leaflets of lobe X are the most distinct that we know of in the GRP and P079 populations.

      • The extension of the axons from both subtypes of UBCs show they are long enough to pass several UBCs and even projections are directed toward the white matter (e.g. Fig 9A), suggesting targeting the UBCs or granule cells in other lobules. Is it suggesting UBCs connectivity between different lobules (perhaps longitudinal connectivity)? Is there any observation or information in coronal/transverse section to visualize mediolateral connectivity?

      This is certainly worth exploring in future work. UBCs have been reported to project their axons into and across the white matter (Diño et al., 2000). To our knowledge, whether UBCs project their axons out of one lobule and into another has not been examined.

      • The limitation in identifying networks involving more than two sequentially connected UBCs was briefly noted. I suggest including a paragraph describing limitations and discussing the implications of the findings would enhance the overall impact of the research and broaden our understanding of cerebellar function.

      • It is a pity that there is no clear conclusion to the discussion of this very interesting study. I suggest providing the key points as a conclusion.

      Thank you for these suggestions. Limitations and implications are included throughout the discussion section and we feel that the summary figure and significance statement now sufficiently convey the key conclusions of the study.

      • Please make the correction in Figure 2A by relabeling it as IXa, IXb, and IXc to correct the typographical error.

      Fixed

      • I recommend rotating Figure 7A to align its orientation with the other figures for consistency.

      Fixed

      Reviewer #1 (Recommendations For The Authors):

      Minor comments that should be addressed for clarity:

      1) In the NEURON model, why was the reversal potential for the leak conductance and Gmax for Ih different for the two types of UBCs. Relatedly, why is Erev for GABAB -95mV if Ek is -90mV?

      The h-current (Ih) was estimated from a hyperpolarizing current step in both cell types and these data have been added to the result section and as a panel in Figure 1. The conductance of Ih in the model cells were adjusted accordingly, with OFF UBCs having ~3 times that of ON UBCs and approximated the measured voltage sag, as we now describe in the methods section. The reversal potential of the model mGluR2 current (which is based on a model of GABAB) has been fixed.

      2) Line 69 justification for their dual genetic approach is a bit too strong: "Paired recordings not possible". It may be difficult, but it is certainly possible.

      Reworded

      3) Confusing wording, only one stat for two parameters? Line 93: These currents were produced by both mGluR1 and AMPA receptors, as they were blocked by their antagonists JNJ16259685 and GYKI53655, respectively (92.86% {plus minus} 3.25; paired t-test; P=0.0066; n = 9; 95 mean {plus minus} SEM) (Fig 1D-E).

      Reworded

      References

      Balmer TS, Borges-Merjane C, Trussell LO (2021) Incomplete removal of extracellular glutamate controls synaptic transmission and integration at a cerebellar synapse. eLife 10:e63819.

      Berthie B, Axelrad H (1994) Granular layer collaterals of the unipolar brush cell axon display rosette-like excrescences. A Golgi study in the rat cerebellar cortex. Neuroscience Letters 167:161–165.

      Borges-Merjane C, Trussell LO (2015) ON and OFF unipolar brush cells transform multisensory inputs to the auditory system. Neuron 85:1029–1042.

      Chung SH, Sillitoe RV, Croci L, Badaloni A, Consalez G, Hawkes R (2009) Purkinje cell phenotype restricts the distribution of unipolar brush cells. Neuroscience 164:1496–1508.

      Diño MR, Schuerger RJ, Liu Y-B, Slater NT, Mugnaini E (2000) Unipolar brush cell: a potential feedforward excitatory interneuron of the cerebellum. Neuroscience 98:625–636.

      Guo C, Huson V, Macosko EZ, Regehr WG (2021) Graded heterogeneity of metabotropic signaling underlies a continuum of cell-intrinsic temporal responses in unipolar brush cells. Nat Commun 12:5491.

      Huson V, Newman LN, Regehr WG (2023) A continuum of response properties across the population of Unipolar Brush Cells in the Dorsal Cochlear Nucleus. J Neurosci Available at: https://www.jneurosci.org/content/early/2023/07/26/JNEUROSCI.0873-23.2023 [Accessed August 15, 2023].

      Jakab RL, Hamori J (1988) Quantitative morphology and synaptology of cerebellar glomeruli in the rat. Anatomy and embryology 179:81–88.

      Kim JA, Sekerkova G, Mugnaini E, Martina M (2012) Electrophysiological, morphological, and topological properties of two histochemically distinct subpopulations of cerebellar unipolar brush cells. Cerebellum 11:1012–1025.

      Nunzi M-G, Mugnaini E (2000) Unipolar brush cell axons form a large system of intrinsic mossy fibers in the postnatal vestibulocerebellum. Journal of Comparative Neurology 422:55–65.

      Sekerkova G, Watanabe M, Martina M, Mugnaini E (2014) Differential distribution of phospholipase C beta isoforms and diaglycerol kinase-beta in rodents cerebella corroborates the division of unipolar brush cells into two major subtypes. Brain structure & function 219:719–749.

      van Dorp S, De Zeeuw CI (2015) Forward signaling by unipolar brush cells in the mouse cerebellum. Cerebellum 14:528– 533.

    1. Author Response

      The following is the authors’ response to the original reviews.

      Cook, Watt, and colleagues previously reported that a mouse model of Spinocerebellar ataxia type 6 (SCA6) displayed defects in BDNF and TrkB levels at an early disease stage. Moreover, they have shown that one month of exercise elevated cerebellar BDNF expression and improved ataxia and cerebellar Purkinje cell firing rate deficits. In the current work, they attempt to define the mechanism underlying the pathophysiological changes occurring in SCA6. For this, they carried out RNA sequencing of cerebellar vermis tissue in 12-month-old SCA6 mice, a time when the disease is already at an advanced stage, and identified widespread dysregulation of many genes involved in the endo-lysosomal system. Focusing on BDNF/TrkB expression, localization, and signaling they found that, in 7-8 month-old SCA6 mice early endosomes are enlarged and accumulate BDNF and TrkB in Purkinje cells. Curiously, TrkB appears to be reduced in the recycling endosomes compartment, despite the fact that recycling endosomes are morphologically normal in SCA6. In addition, the authors describe a reduction in the Late endosomes in SCA6 Purkinje cells associated with reduced BDNF levels and a probable deficit in late endosome maturation.

      We would like to thank the reviewers for their careful reading of the paper, their feedback has helped us to add information and experiments to the paper that enhance the clarity of the findings.

      Strengths:

      The article is well written, and the findings are relevant for the neuropathology of different neurodegenerative diseases where dysfunction of early endosomes is observed. The authors have provided a detailed analysis of the endo-lysosomal system in SCA6 mice. They have shown that TrkB recycling to the cell membrane in recycling endosomes is reduced, and the late endosome transport of BDNF for degradation is impaired. The findings will be crucial in understanding underlying pathology. Lastly, the deficits in early endosomes are rescued by chronic administration of 7,8-DHF.

      We thank the reviewers for their positive feedback on this work.

      Weaknesses:

      The specificity of BDNF and TrkB immunostaining requires additional controls, as it has been very difficult to detect immunostaining of BDNF. In addition, in many of the figures, the background or outside of Purkinje cell boundaries also exhibits a positive signal.

      We agree with the reviewers that the performance of the BDNF and TrkB antibodies is an important concern. We have ourselves had difficulties with the performance of many antibodies and the images in this paper are the result of many years of optimization. We have therefore added further detail about the antibody optimization to the methods section of this paper, and have carried out new staining experiments with additional controls. We have added 2 new figure panels in supplementary figures 3 and 4 to demonstrate these tests.

      In the case of anti-BDNF antibodies, we have tested several antibodies and staining protocols and found that in our hands, the only antibody that reliably stained BDNF with a good signal to noise ratio was the one used in this paper (abcam ab108319). Even for this antibody, the staining was greatly enhanced by the use of a heat induced epitope retrieval (HIER) step, which allowed the visualization of BDNF within intracellular structures such as endosomes. When we quantified the intensity of this staining in our previous paper, the results were in agreement with those from a BDNF ELISA used to measure levels of BDNF in the cerebellar vermis of WT and SCA6 mice (Cook et al., 2022), which corroborates these results. As the staining was carried out in tissue sections and not dissociated cells, we also see positive signal from the BDNF staining outside of the Purkinje cells, since BDNF acts on cell-surface receptors and is thus released into the extracellular space around cells (Kuczewski et al., 2008) and is detectable in the extracellular matrix (Lam et al., 2019) and presynaptic terminals around neurons (Camuso et al., 2022; Choo et al., 2017). This is in contrast to studies that image BDNF mRNA with in-situ hybridization, which labels BDNF mRNA predominantly found in cells, and cannot tell us about sub-cellular or extracellular localization of BDNF protein. Together, these factors explain why we observe staining that is not cell- limited, but extends into the space around the cells of interest.

      We have added an additional supplemental figure to demonstrate the importance of using HIER when staining slices with anti-BDNF (Supplementary figure 3). We tested HIER protocols that involved heating the slices to 95°C in a variety of buffers. The buffers tested were sodium citrate buffer (10 mM sodium citrate, 0.05% Tween 20, pH 6), Tris buffer (10mM TBS, 0.05% Tween 20, pH 10), EDTA buffer (1mM EDTA, 0.05% Tween 20, pH 8) and neutral PBS. The PBS produced the best result, enhancing the staining of both anti-BDNF and anti-EEA1 antibodies (Supplementary figure 3). Therefore all slices stained using those antibodies were heated to 95°C in PBS using a heat block or thermocycler for 10 minutes, then allowed to cool before staining proceeded.

      The antibody we use (abcam ab108319) has been used in hundreds of other publications, including Javed et al., 2021 who ectopically expressed BDNF and noted colocalization between the antibody staining and the GFP tag of the BDNF construct, and Lejkowska et al., 2019 who overexpressed BDNF and saw a dramatic increase in antibody staining as well. The colocalization between ectopically expressed BDNF and the antibody in these studies demonstrates the specificity of the antibody.

      However, to further validate antibody specificity we used liver tissue as a negative control. In liver tissue from rodents and humans, the majority of the liver contains negligible levels of BDNF (Koppel et al., 2009; Vivacqua et al., 2014), see also the Human Protein Atlas. The exception is some cholangiocytes: epithelial cells that express BDNF at high levels (Vivacqua et al., 2014). We obtained liver tissue from a WT mouse that was undergoing surgery for an unrelated project and fixed and processed the tissue as we did for brain tissue (outlined in methods section). As we would expect, most of the cells in the liver showed BDNF immunoreactivity that was comparable to background levels (Supplementary figure 3). Interestingly, we were also able to detect sparse highly BDNF-positive cells in the liver, presumed cholangiocytes (Supp. Fig. 3). This pattern of liver BDNF expression is as predicted in the literature, and thus acts as a control for our antibody. We therefore believe that in our hands this antibody is able to stain BDNF with an appropriate degree of specificity.

      We also carried out staining experiments using a second anti-TrkB antibody that we had previously used to detect TrkB via Western bloing. We carried out immunohistochemistry as previously described using tissue sections from a WT mouse. The staining with the two different antibodies was carried out at the same time and all other reagents were kept constant. We found that both antibodies labelled TrkB in a similar pattern of localization, including in the early endosomes of the Purkinje cells (Supplementary figure 4). The second antibody however did have a lower signal to noise ratio and so we believe that the original anti-TrkB antibody used in this manuscript (EMD Millipore ab9872) is optimal for staining cerebellar tissue sections in our hands.

      One important concern about the conclusions is that the RNAseq experiment was conducted in 12-month- old SCA6 mice suggesting that the defects in the endo-lysosomal system may be caused by other pathophysiological events and, likewise, the impairment in BDNF signaling may also be indirect, as also noted by the authors. Indeed, Purkinje cells in SCA6 mice have an impaired ability to degrade other endocytosed cargo beyond BDNF and TrkB, most likely because of trafficking deficits that result in a disruption in the transport of cargo to the lysosomes and lysosomal dysfunction.

      We agree with the reviewers that the defects in the endo-lysosomal system may be caused by other events occurring in the course of disease progression. As mentioned by the reviewers, we have noted this possibility in the text. Detailed investigation into the sequence of events and the root causes of signaling disruption in SCA6 merits future study and we aim to address this in future work. We have expanded this explanation in the text.

      Moreover, the beneficial effects of 7,8-DHF treatment on motor coordination may be caused by 7,8-DHF properties other than the putative agonist role on TrkB. Indeed, many reservations have been raised about using 7,8-DHF as an agonist of TrkB activity. Several studies have now debunked (Todd et al. PlosONE 2014, PMID: 24503862; Boltaev et al. Sci Signal 2017, PMID: 28831019) or at the very least questioned (Lowe D, Science 2017: see Discussion: https://www.science.org/content/blog-post/those-compounds-aren-t- what-you-think-they-are Wang et al. Cell 2022 PMID: 34963057). Another interpretation is that 7,8-DHF possesses antioxidant activity and neuroprotection against cytotoxicity in HT-22 and PC12 cells, both of which do not express TrkB (Chen et al. Neurosci Lett 201, PMID: 21651962; Han et al. Neurochem Int. 2014, PMID: 24220540). Thus, while this flavonoid may have a beneficial effect on the pathophysiology of SCA6, it is most unlikely that mechanistically this occurs through a TrkB agonistic effect considering the potent anti-oxidant and anti-inflammatory roles of flavonoids in neurodegenerative diseases (Jones et al. Trends Pharmacol Sci 2012, PMID: 22980637).

      We thank the reviewers for raising this important point. We have noted in our previous paper (Cook et al., 2022) that 7,8-DHF may not be acting as a TrkB agonist in SCA6 mice, and are in agreement that other explanations are possible. We have now added information to the text of this paper to highlight this possibility. We did show in our previous paper that 7,8-DHF administration activates Akt signaling in the cerebellum of SCA6 mice, a signaling event that is known to take place downstream of TrkB activation. Additionally, 7,8-DHF treatment led to the increase of TrkB levels in the cerebellum of SCA6 mice (Cook et al., 2022), implicating TrkB in the mechanism of action, even if mechanistically, this is not via direct TrkB activation alone. However, even if the mechanism is currently incompletely explained, we believe that 7,8- DHF remains a valuable treatment strategy for SCA6. We have tried to rewrite the Discussion to highlight what we think is the most important takeaway: that 7,8-DHF can rescue endosomal and other deficits in SCA6, even if we do not currently know the full mechanism of action. We have therefore amended the text to add more detail about other potential explanations for the mechanism of action of 7,8-DHF.

      References

      Camuso S, La Rosa P, Fiorenza MT, Canterini S. 2022. Pleiotropic effects of BDNF on the cerebellum and hippocampus: Implications for neurodevelopmental disorders. Neurobiol Dis. doi:10.1016/j.nbd.2021.105606

      Choo M, Miyazaki T, Yamazaki M, Kawamura M, Nakazawa T, Zhang J, Tanimura A, Uesaka N, Watanabe M, Sakimura K, Kano M. 2017. Retrograde BDNF to TrkB signaling promotes synapse elimination in the developing cerebellum. Nat Commun 8:195. doi:10.1038/s41467-017-00260-w

      Cook AA, Jayabal S, Sheng J, Fields E, Leung TCS, Quilez S, McNicholas E, Lau L, Huang S, Watt AJ. 2022. Activation of TrkB-Akt signaling rescues deficits in a mouse model of SCA6. Sci Adv 8:3260. doi:10.1126/sciadv.abh3260

      Javed S, Lee YJ, Xu J, Huang WH. 2021. Temporal dissection of Rai1 function reveals brain-derived neurotrophic factor as a potential therapeutic target for Smith-Magenis syndrome. Hum Mol Genet 31:275–288. doi:10.1093/HMG/DDAB245

      Koppel I, Aid-Pavlidis T, Jaanson K, Sepp M, Pruunsild P, Palm K, Timmusk T. 2009. Tissue-specific and neural activity-regulated expression of human BDNF gene in BAC transgenic mice. BMC Neurosci 10:68. doi:10.1186/1471-2202-10-68

      Kuczewski N, Porcher C, Ferrand N, Fiorentino H, Pellegrino C, Kolarow R, Lessmann V, Medina I, Gaiarsa JL. 2008. Backpropagating action potentials trigger dendritic release of BDNF during spontaneous network activity. J Neurosci 28:7013–7023. doi:10.1523/JNEUROSCI.1673-08.2008

      Lam D, Enright HA, Cadena J, Peters SKG, Sales AP, Osburn JJ, Soscia DA, Kulp KS, Wheeler EK, Fischer NO. 2019. Tissue-specific extracellular matrix accelerates the formation of neural networks and communities in a neuron-glia co-culture on a multi-electrode array. Sci Rep 9. doi:10.1038/s41598- 019-40128-1

      Lejkowska R, Kawa MP, Pius-Sadowska E, Rogińska D, Łuczkowska K, Machaliński B, Machalińska A. 2019. Preclinical Evaluation of Long-Term Neuroprotective Effects of BDNF-Engineered Mesenchymal Stromal Cells as Intravitreal Therapy for Chronic Retinal Degeneration in Rd6 Mutant Mice. Int J Mol Sci 2019, Vol 20, Page 777 20:777. doi:10.3390/IJMS20030777

      Vivacqua G, Renzi A, Carpino G, Franchitto A, Gaudio E. 2014. Expression of brain derivated neurotrophic factor and of its receptors: TrKB and p75NT in normal and bile duct ligated rat liver. Ital J Anat Embryol 119:111–129. doi:10.13128/IJAE-15138

    1. Author Response

      The following is the authors’ response to the original reviews.

      We thank the reviewers and editor for their thoughful and careful evaluation of our manuscript. We appreciate your time and effort and have incorporated many of these suggestions to improve our revised manuscript.

      Reviewer #1 (Public Review):

      Summary: Cullinan et al. explore the hypothesis that the cytoplasmic N- and C-termini of ASIC1a, not resolved in x-ray or cryo-EM structures, form a dynamic complex that breaks apart at low pH, exposing a C-terminal binding site for RIPK1, a regulator of necrotic cell death. They expressed channels tagged at their N- and C-termini with the fluorescent, non-canonical amino acid ANAP in CHO cells using amber stop-codon suppression. Interaction between the termini was assessed by FRET between ANAP and colored transition metal ions bound either to a cysteine reactive chelator attached to the channel (TETAC) or metal-chelating lipids (C18-NTA). A key advantage to using metal ions is that they are very poor FRET acceptors, i.e. they must be very close to the donor for FRET to occur. This is ideal for measuring small distances/changes in distance on the scales expected from the initial hypothesis. In order to apply chelated metal ions, CHO cells were mechanically unroofed, providing access to the inner leaflet of the plasma membrane. At high pH, the N- and C- termini are close enough for FRET to be measured, but apparently too far apart to be explained by a direct binding interaction. At low pH, there was an apparent increase in FRET between the termini. FRET between ANAP on the N-and Ctermini and metal ions bound to the plasma membrane suggests that both termini move away from the plasma membrane at low pH. The authors propose an alternative hypothesis whereby close association with the plasma membrane precludes RIPK1 binding to the C-terminus of ASIC1a.

      Strengths: The findings presented here are certainly valuable for the ion channel/signaling field and the technical approach only increases the significance of the work. The choice of techniques is appropriate for this study and the results are clear and high quality. Sufficient evidence is presented against the starting hypothesis.

      Weaknesses: I have a few questions about certain controls and assumptions that I would like to see discussed more explicitly in the manuscript.

      My biggest concern is with the C-terminal citrine tag. Might this prevent the hypothesized interaction between the N- and C-termini? What about the serine to cysteine mutations? The authors might consider a control experiment in channels lacking the C-terminal FP tag.

      While it is certainly possible that the C-terminal citrine tag is preventing the hypothesized interaction between the intracellular termini, there are a few things that mitigate (but not eliminate) this concern. First, previous work looking at the interaction between the intracellular termini used FPs on both the N- and C-termini and concluded that in fact there is an interaction (PMID:31980622). Our channels have only a single FP, and we use a higher resolution FRET approach. Second, we aVach our citrine tag with a 11-residue linker, allowing for enhanced flexibility of the region and hopefully allowing for more space for an interaction that was posited to be between the very proximal part of the C-terminus (near the membrane and away from the tag) and the untagged N-terminus. Third, we previously showed that Stomatin, a much larger protein than the NTD, could bind the distal C-terminus of rASIC3 with a large fluorescent protein connected by the same linker on the C-terminus. In the case of Stomatin, the interaction involved the residues at the distal portion of the C-terminus close to the bulky FP. Interestingly, while we did not publish this, without this flexible linker, Stomatin could not regulate the channel and likely did not bind.

      Despite this, we agree that this is possible and have added a statement in our limitations section explicitly saying this.

      Figure 2 supplement 1 shows apparent read-through of the N-terminal stop codons. Given that most of the paper uses N-terminal ANAP tags, this figure should be moved out of the supplement. Do Nterminally truncated subunits form functional channels? Do the authors expect N-terminally truncated subunits to co-assemble in trimers with full-length subunits? The authors should include a more explicit discussion regarding the effect of truncated channels on their FRET signal in the case of such co-assembly.

      The positions that show readthrough (E6, L18, H515) were not used in the study. We eliminated them largely on the basis of these westerns. We elected to put the bulk of the blots in the supplement simply because of how many there were. We believe this is the best compromise. It allows us to show representative blots for all our positions without making an illegible figure with 7 blots.

      The N-terminally truncated subunits would create very short peptides that are not able to create functional channels. A premature stop at say E8 would create a 7-mer. Our longest N-terminal truncation would only create a protein of 32 amino acids. These don’t contain the transmembrane segments and thus cannot make functional channels.

      As the epitope used for the western blots in Figure 2 and supplements is part of the C-terminal tag, these blots do not provide an estimate of the fraction of C-terminally truncated channels (those that failed to incorporate ANAP at the stop codon). What effect would C-terminally truncated channels have on the FRET signal if incorporated into trimers with full-length subunits?

      Alternatively, C-terminally truncated subunits would be able to form functional channels because they contain the full N-terminus, the transmembrane domains, the extracellular domain and a portion of the C-terminus. We don’t think this is a major contaminant to our experiments. The only two C-terminal ANAP positions we use are 464 and 505. In each of these cases, they are only used for memFRET. The ones that do not contain ANAP are essentially “invisible” to the experiment. Since we are measuring their proximity to the membrane, having some missing should not maVer. However, there is some chance that truncations in some subunits could allosterically affect the position of the CT in other subunits. We have added a discussion of this in the manuscript.

      Some general discussion of these results in the context of trimeric channels would be helpful. Is the putative interaction of the termini within or between subunits? Are the distances between subunits large enough to preclude FRET between donors on one subunit and acceptor ions bound on multiple subunits?

      Thank you for this comment. We did not directly test whether the distances are within or between subunits. We considered using a concatemer to do this, however, the concatemeric channels do not express particularly well. Then, UAA incorporation hurts the expression as well. It was unlikely we would be able to get sufficient expression for tmFRET.

      However, the Maclean group has previously tested this using FRET between concatenated subunits and determined that FRET is stronger within than between subunits. We have updated the manuscript to reflect a more thorough discussion of our results in the context of their trimeric assembly.

      The authors conclude that the relatively small amount of FRET between the cytoplasmic termini suggests that the interaction previously modeled in Rosetta is unlikely. Is it possible that the proposed structure is correct, but labile? For example, could it be that the FRET signal is the time average of a state in which the termini directly interact (as in the Rosetta model) and one in which they do not?

      The proposed RoseVa model does not include the reentrant loop of the channel, so it is probable that this model would change if it were redone to include this new feature of the channel.

      However, we do discuss the limitation of FRET as a method that measures a time average that is weighted towards closest approach in our discussion section. The termini are most certainly dynamic and it is possible that spend some time in close proximity. Given that FRET is biased towards closest approach, we actually think this strengthens our argument that the termini don’t spend a great deal of time in complex. In addition, our MST data suggests that the termini do not bind. We have added some commentary on this to the discussion section for clarity.

      Reviewer #2 (Public Review):

      Summary:

      The authors use previously characterised FRET methods to measure distances between intracellular segments of ASIC and with the membrane. The distances are measured across different conditions and at multiple positions in a very complete study. The picture that emerges is that the N- and C-termini do not associate.

      Strengths:

      Good controls, good range of measurements, advanced, well-chosen and carefully performed FRET measurements. The paper is a technical triumph. Particularly, given the weak fluorescence of ANAP, the extent of measurements and the combination with TETAC is noteworthy.

      The distance measurements are largely coherent and favour the interpretation that the N and C terminus are not close together as previously claimed.

      Weaknesses:

      One difficulty is that we do not have a positive control for what binding of something to either N- or Cterminus would look like (either in FRET or otherwise).

      We acknowledge that this is a challenge for the approach. Having a positive control for binding would be great but we are not sure such a thing exists. You could certainly imagine a complex between two domains where each label (ANAP and TETAC) are pointed away from one other (giving comparatively modest quenching) or one where they are very close (giving comparatively large quenching), both of which could still be bound. This is essentially a less significant version of the problem with using FPs to measure proximity…they are not very good proxies for the position of the termini. These small labels are certainly beVer proxies but still not perfect. Our conclusion here is based more on the totality of the data. We tried many combinations and saw no sign of distances closer than ~ 20A at resting pH. We think the simplest explanation is that they are not close to one another but we tried to lay out the limitations in the discussion.

      One limitation that is not mentioned is the unroofing. The concept of interaction with intracellular domains is being examined. But the authors use unroofing to measure the positions, fully disrupting the cytoplasm. Thus it is not excluded that the unroofing disrupts that interaction. This should be mentioned as a possible (if unlikely) limitation.

      Thank you for your comment. We discuss unroofing as a potential limitation because it exposes both sides of the plasma membrane to changes in pH. We have updated this section to include acknowledgement of the possibility that unroofing disrupts the interaction via washout of other critical proteins.

      Reviewer #3 (Public Review):

      Summary: The manuscript by Cullinan et al., uses ANAP-tmFRET to test the hypothesis that the NTD and CTD form a complex at rest and to probe these domains for acid-induced conformational changes. They find convincing evidence that the NTD and CTD do not have a propensity to form a complex. They also report these domains are parallel to the membrane and that the NTD moves towards, and the CTD away, from the membrane upon acidification.

      Strengths:

      The major strength of the paper is the use of tmFRET, which excels at measuring short distances and is insensitive to orientation effects. The donor-acceptor pairs here are also great choices as they are minimally disruptive to the structure being studied.

      Furthermore, they conduct these measurements over several positions with the N and C tails, both between the tails and to the membrane. Finally, to support their main point, MST is conducted to measure the association of recombinant N and C peptides, finding no evidence of association or complex formation.

      Weaknesses:

      While tmFRET is a strength, using ANAP as a donor requires the cells to be unroofed to eliminate background signal. This causes two problems. First, it removes any possible low affinity interacting proteins such as actinin (PMID 19028690). Second, the pH changes now occur to both 'extracellular' and 'intracellular' lipid planes. Thus, it is unclear if any conformational changes in the N and CTDs arise from desensitization of the receptor or protonation of specific amino acids in the N or CTDs or even protonation of certain phospholipid groups such as in phosphatidylserine. The authors do comment that prolonged extracellular acidification leads to intracellular acidification as well. But the concerns over disruption by unroofing/washing and relevance of the changes remain.

      We acknowledge that unroofing is a limitation of our approach and noted it in the discussion. However, we have updated the section to include the possibility that the act of unroofing and washing could also disrupt the potential interaction between the intracellular domains as well as between these domains and other intracellular proteins. This was the best approach we could use to address our questions and it required that we unroof the cells. However, we look forward to future studies or new techniques that do not require the unroofing of the cells.

      The distances calculated depend on the R0 between donor and acceptor. In turn, this depends on the donor's emission spectrum and quantum yield. The spectrum and yield of ANAP is very sensitive to local environment. It is a useful fluorophore for patch fluorometry for precisely this reason, and gating-induced conformational changes in the CTD have been reported just from changes in ANAP emission alone (PMID 29425514). Therefore, using a single R0 value for all positions (and both pHs at a single position) is inappropriate. The authors should either include this caveat and give some estimate of how big an impact changes spectrum and yield might have, or actually measure the emission spectra at all positions tested.

      This is a reasonable concern and one we considered. Measuring the quantum yield would be quite difficult. However, we have measured spectra at a number of positions and see a relatively minimal shik in the peak. Most positions peak between 481 and 484nm. If you calculate the difference in R0 using theoretical spectra with a blue shik of 20nm, the difference in R0 is only ~1.5A. A shik of 20nm is on the higher side of anything we have seen in the literature (PMID 30038260) and since even with that large a shik, the difference is minimal we do not think measuring spectra for each position would impact the overall conclusions presented. As you noted, though, the quantum yield also changes. Assuming a change in yield from 0.22 to 0.47, the largest we found reported in the literature (PMID:29923827) , the R0 would increase by 2A. This same paper showed that the blue shiked position was the one with the higher extinction coefficient so these changes would be working in opposition to one another making the difference in R0 even smaller. It is important to note, that while tmFRET is a much more powerful measure of distance than standard FRET, these distances, as you point out, are quite challenging to measure precisely. Our conclusions are based less on the absolute distances and more on the observation that no positions show large quenching and that if there is any change upon acidification, it is in the wrong direction.

      Overall, the writing and presentation of figures could be much improved with specific points mentioned in the recommendations for authors section.

      See below.

      The authors argue that the CTD is largely parallel to the plasma membrane, yet appear to base this conclusion on ANAP to membrane FRET of positions S464 and M505. Two positions is insufficient evidence to support such a claim. Some intermediate positions are needed.

      We do not see in the paper where we suggest that the CTD is parallel. However, your point that we could try and determine if this was the case is correct. However, we aVempted to create several other CTD TAG mutants but struggled with readthrough and poor expression of these mutants so we opted to just include S464 and M505. Our point from these data is only that the distal CTD (505) must spend significant time near the membrane to explain our FRET data.

      Upon acidification, NTD position Q14 moves towards the plasma membrane (Figure 8B). Q14 also gets closer to C515 or doesn't change relative to 505 (Figures 7C and B) upon acidification. Yet position 505 moves away from the membrane (Figure 8D). How can the NTD move closer to the membrane, and to the CTD but yet the CTD move further from the membrane? Some comment or clarification is needed.

      This is a reasonable question and one that is hard to definitively answer. Our goal here was to test the hypothesis that the termini are bound at rest. Mapping the precise positions of the termini is difficult for reasons we will enumerate in the question that asks why we didn’t make a model. There are potentially multiple explanations but the easiest one would be that the CTD could move away from the membrane but closer to Q14, for instance, if the distal termini, say, rotated towards the NTD. This would move 505 closer and have no impact on whether or not the NTD and CTD moved away or toward the membrane.

      Reviewer #1 (Recommendations For The Authors):

      Minor concerns

      The authors show the spectrum of ANAP attached to beads and use this spectrum to calculate R0 for their FRET measurements. Peak ANAP fluorescence is dependent on local environment and many reports show ANAP in protein blue-shiked relative to the values reported here. How would this affect the distance measurements reported?

      This is an important point. See above for the answer.

      Could the lack of interaction between the N- and C-terminal peptides in Figure 7 arise from the cysteine to serine mutations or lack of structure in the synthetic peptides. How were peptide concentrations measured/verified for the experiment?

      It is possible that cysteine to serine mutations could prevent the interaction. It is also possible that these peptides are not capable of adopting their native fold without the presence of the plasma membrane or due to being synthetically created. However, the termini are thought to be largely unstructured. We received these peptides in lyophilized form at >95% purity and resuspended to our desired stock concentration (3 mM C-terminus, 1 mM N-terminus). Even if our concentration was off, we see no signs of interaction up to quite a high concentration.

      How was photobleaching measured for correcting the data?

      We executed several mock experiments at various TAG positions using either pH 8 and pH 6, where we performed the experiments as usual but with a mock solution exchange when we would normally add the metal. We normalized the L-ANAP fluorescence to the first image and averaged together these values for pH 8 and pH 6. We then corrected using Equation 2 in the manuscript..

      We have updated the methods to include how we adjusted for bleaching.

      The authors may wish to make it more explicit that their Zn2+ controls also preclude the possibility that a changing FRET signal between ANAP and citrine may affect their data.

      Thank you for this comment. We agree, it would strengthen the manuscript to include this statement. We have now included this.

      It might be useful to the reader if the authors could include (as a supplement) plots of their data (like in Figure 6), in which FRET efficiency has been converted to distance.

      We considered this idea as well but felt like showing the actual data in the figures and the distances in a table would be best.

      Figure 5D is mentioned in the text before any other figures. This is unconventional. Could this panel be moved to Figure 1 or the mention moved to later?

      Changed

      western blot is not capitalized.

      Changed.

      Figure 1, the ANAP structure shown is the methyl ester, which is presumably cleaved before ANAP is conjugated to the tRNA. The authors may wish to replace this with the free acid structure.

      This is a fair point. We originally used the methyl ester structure to indicate the version of ANAP we chose to use. However, you are correct that the methyl ester is cleaved before conjugation to the tRNA. We replaced the methyl ester with the free acid structure to clarify this.

      Figures 1 and 4 should have scale bars for the images.

      Scale bars have been added to figures 1, 4, and 5.

      In Figure 3, the letters in the structures (particularly TETAC) are way too small. Please increase the font size.

      Changed

      In Figure 3 and Figure 3 supplement 1, the axes are labeled "Absorbance (M-1cm-1)." Absorbance is dimensionless. The authors are likely reporting the extinction coefficient.

      Thank you for catching this. We adjusted the axes to extinction coefficient.

      In Figures 5 B and C, it might be clearer if the headers read "Initial, +Cu2+/TETAC, DTT" rather than "Initial, FRET, Recovery."

      Changed

      The panel labels for Figure 8 seem to be out of order.

      Changed

      The L for L-ANAP should be rendered, by convention, in small caps.

      This is a good example of learning something new from the review process. This is the first I have ever heard of small caps. We can find no other papers that use small caps for L-ANAP so I am not 100% sure what convention this is referring to and don’t want to change the wrong thing in the paper. We are happy to change if the editorial staff at eLife agree but have lek this for now.

      Reviewer #2 (Recommendations For The Authors):

      With so many distances measured, why was not even a basic structural model attempted?

      We certainly considered it, but a number of things lead us to conclude that it might imply more certainty about the structure of these termini than we hope to give. 1) Given that the FRET is a time average of positions, these distance constraints would not do much constraining. 2) Given that the termini are likely unstructured and flexible this makes the problem in 1 worse. 3) There is no structural information to use as a starting point for a model. 4) The flexibility of the linkers for each FRET pair also introduces uncertainty. This can, in theory, be modeled as they do in EPR but all of this together made us decide not to do this. What we hope readers take home, is the overall picture of the data is not consistent with the original RIPK1 hypothesis.

      Maybe it would be good to draw a band on the graphs in Figure 6 for the FRET signal expected for interaction (and thus, disfavoured by these data). This would at least give context.

      We agree this could be helpful, but it is not so easy to do. What distance would we choose? We could put a line at ~5Å (the model predicted distance). As we noted above, a number of distances could be compatible with an interaction. However, we think it’s unlikely that if a complex was formed that none of our measurements would show a distance closer than 20Å at rest and that an unbinding event would then lead to a decrease in distance. This, to us, is the take home message.

      Minor points:

      "Aker unroofing the cells, only fluorescence associated with the "footprint", or dorsal surface, of the cell membrane is lek behind."

      The authors use dorsal and ventral in this section to describe parts of an adherent cell. But in the first instance, they remove the dorsal part of the cell, and then in this phrase, the dorsal part is lek behind....I am a bit confused.

      Thank you for pointing out this mistake, we have fixed this. It is indeed the ventral surface lek behind.

      "bind at rest an" - and?

      Changed

      "One previous study used a different approach to try and map the topography of the intracellular termini of ASIC1a comparable to our memFRET experiments." I think a citation is due.

      Citation added

      "great deal of precedent" even if this result is from my own lab, I would prefer that the authors note that it's one study from one lab! I think best just to delete "great deal of".

      “Great deal of” deleted

      I think the column "Significance" in the tables is unnecessary when the P value is given.

      Thank you for this suggestion. We agree and have made the change.

      Figure 7a Q14TAG has a clearly bimodal distribution at pH 8. What could be the meaning of this result? The authors do not mention it that I could find. Perhaps there is no meaning. The authors should state what they think is (or is not) going on.

      This is a good question and we don’t have a good answer. It appears to be experimental variability. The data from the “low fret” in this experimental condition all came from the same days. So something was different that day. We considered that they might be outliers to exclude but thought showing all of our data was the beVer path. We reperformed the ANOVA here separating out the “outlier” day and nothing of substance changed. Both populations were still different with P value less than 0.001.

      Typo: Lumencore

      Changed

      Maybe just a matter of taste but the panel created with Biorender in Figure 8 is not attractive and depicts the channel differently to in Figure 5D, which is again different from Figure 1A. Surely one advantage of using computer-generated artwork could be to have consistency.

      We agree and have used the same cartoon for all of our images with the one exception being the schematics that are just meant to show the positions that are present in each bar graph.

      Figure 4A was squashed to fit (text aspect ratio is wrong).

      Fixed

      Reviewer #3 (Recommendations For The Authors):

      Citrine is used to report incorporation. Yet citrine has a strong tendency to dimerize (PMID 27240257). Did the authors use mCitrine or just Citrine? This is quite important in interpreting their data.

      Thank you for pointing out this important distinction. We use mCitirine which we have added to the methods.

      The manuscript has numerous instances of imprecise language. For example, page 10, last para, first line, "previous studies have looked at..." or page 7, final paragraph "tell a similar story". Related, the figures could be much better. For example, in Figure 1, where the authors depict the anap chemical in red, as opposed to the blue one might expect of a blue emiqng fluorophore. In figure 6, ANAP is also in red with the quenching group in green. This is opposite to how one typically thinks of FRET with the warmer color being the acceptor not the donor. Moreover, the pH 6 condition is also colored the same shade of red as the ANAP. Labels of Cys positions would again be useful here. In Figure 3, the heteroatoms of TETAC and C18-NTA are very small and difficult to see. It would also be good to label these structures, and the spectra below, so the reader can tell at a glance without looking at the caption, what the structures and spectra arise from. Also, how are the absorption spectra normalized? This is not discussed in the methods. The lack of attention to presentation mars an otherwise nice study.

      Thank you for these points. We have made modifications to the manuscript to address these comments.

      Abstract, second last line "Aker prolonged acidification, ...", 'prolonged' could be interpreted as 'it takes a while for the domain to move' or 'the movement only happens aker a while'. This not what the authors intend to convey. Consider modifying to just 'Aker acidification,'

      We updated the main text to indicate that prolonged acidification is intended to describe acidification that occurs over the minutes timescale.

      Pdf page 6, bottom para on Anap incorporation not altering channel function: What is meant by 'steady state pH dependence of activation'? This implies the authors applied a pH stimulus, then waited until equilibrium was achieved ie. until desensitization was complete and measured the current at that point. It seems more likely they simply applied different pH stimuli and measured the peak response and that the use of 'steady state' here is a typo.

      We removed the phrase steady state.

      Same section, controls of electrophysiology allude to 485, 505 and 515 ANAP-containing channels. In fact, the authors have no way of determining what fraction (if any) of the pH evoked currents arise from channels containing Anap in those positions versus from simply having a translation stop but still functioning. This should be mentioned.

      This is correct. We cannot be sure the CTD TAG positions are not a mixture of ANAP-containing channels and truncations. See above for why we do not think this a big concern for the FRET experiments. Functionally, though, you are correct that we cannot tell. We now mention this in the paper.

      Methods, the abbreviation for SBT should be defined somewhere.

      Added.

      Methods, unroofing section, middle paragraph, the authors use nM not nm to list wavelengths of light.

      Changed.

      Figure 3C-D: There's an unexpected blip in the Anap emission spectra at ~500 nm. Are the grating efficiency of the spectrograph and quantum efficiency of the camera accounted for in these spectra?

      This is a good question. The data are not corrected for either camera efficiency or grating efficiency. We don’t have easy access to the actual data (although we can see a pdf version of each). There is a liVle blip in the grating efficiency graph that could partly explain the blip in our spectra.

      Figure 5C, were recovery experiments routinely done? If so, would be good to show more than n = 1 in the plot to get an idea of reproducibility.

      Recovery experiments were done in every experiment but are not shown for simplicity. We have included all FRET and recovery data for position Q14TAG-C469 at pH 6 in figure 5C to show reproducibility of our FRET and recovery data.

      Table 1, considering adding a Δ distance column (pH 8 versus 6) so the magnitude of changes are more easily seen.

      This is a reasonable suggestion but we decided not to include a Δ distance column. The data are whole numbers and people can easily determine the Δ distance. We felt that including that column would bring too much focus on what we think are preVy small changes. Our hope is that readers take away that the data are not consistent with complex formation between the determine and focus less on absolute distances.

      Figure 7A, Q14tag pH 8 condition has a quite a bit of spread and, likely, two populations. These data, as well as G11, are unlikely to be parametric and hence ANOVA is inappropriate. A normality test, and likely Kruskal-Wallis test is called for.

      Aker testing for normality, the data for Q14TAG C485 pH8 are non-normally distributed. However, a Kruskal Wallis is a non-parametric test for a one-way ANOVA and not applicable here. We separated the data out into population 1 and 2 and repeated the two-way ANOVA statistical test. When Q14TAG pH 8 is split into 2 populations, the statistics hardly change. When the data is not separated, Q14TAG pH 8 relative to pH 6 has a p-value <0.0001. When the 2 populations are separated, both populations relative to Q14TAG pH 6 still have a p-value of <0.0001.

    1. Author Response

      eLife assessment

      This paper by Aitchison and colleagues describes nanobody neutralizing and binding activity against various SARS-CoV-2 variants of concern. The findings are important in that the described nanobodies may have broad therapeutic relevance against current and future variants of concern and may be able to avoid significant resistance. The claims are incomplete: while the study is well-executed and uses a nice balance of biochemical and cellular assays, the efficacy of the proposed nanobody library against VOCs is not completely supported as IC50 values appear to increase against newer variants and are higher than previously used therapeutic bNAbs, animal data showing in vivo efficacy is lacking, and protection against future possible variants is not proven.

      This manuscript is a follow-up of our previous eLife manuscript “Highly synergistic combinations of nanobodies that target SARS-CoV-2 and are resistant to escape” https://elifesciences.org/articles/73027 where we described an “impressive collection of hundreds of new nanobodies binding SARS-CoV-2 spike by combining in vivo antibody affinity maturation and proteomics. [Editor’s evaluation]”. As a follow-up this submission extends the findings of our previous eLife publication and thus focuses on how our repertoire functions in the context of a rapidly evolving SARS-CoV-2 virus, relying on the established methodologies and approaches of the original paper. We explore how nanobody functions have been influenced by the emergence of SARS-CoV-2 variants containing extensive mutations in spike protein, which largely reduced the usefulness of therapeutic monoclonal antibody therapeutics. Our findings show that while some nanobodies lost efficacy in binding to and neutralizing these evolved spikes, a surprising number of nanobodies retained their binding and neutralization activity. This is an important finding, because these efficacious nanobodies target regions that appear rarely targetable by monoclonal antibodies. We also provide experimental validation of the importance of the interplay between binding and neutralization in synergy experiments, where even weakened binding still contributed to strongly enhancing the neutralization.

      Reviewer #1 (Public Review):

      Summary:

      In this manuscript, Ketaren, Mast, Fridy et al. assessed the ability of a previously generated llama nanobody library (Mast, Fridy et al. 2021) to bind and neutralize SARS-CoV-2 delta and omicron variants. The authors identified multiple nanobodies that retain neutralizing and/or binding capacity against delta, BA.1 and BA.4/5. Nanobody epitope mapping on spike proteins using structural modeling revealed possible mechanisms of immune evasion by viral variants as well as mechanisms of cross-variant neutralization by nanobodies. The authors additionally identified two nanobody pairs involving non-neutralizing nanobodies that exhibited synergy in neutralization against the delta variant. These results enabled the refinement of target epitopes of the nanobody repertoire and the discovery of several pan-variant nanobodies for further preclinical development.

      Strengths:

      Overall, this study is well executed and provides a valuable framework for assessing the impact of emerging SARS-CoV-2 variants on nanobodies using a combination of in vitro biochemical and cellular assays as well as computational approaches. There are interesting insights generated from the epitope mapping analyses, which offer possible explanations for how delta and omicron variants escape nanobody responses, as well as how some nanobodies exhibit cross-variant neutralization capacity. These analyses laid out a clear path forward for optimizing these promising next-gen therapeutics, particularly in the face of rapidly emerging SARS-CoV-2 variants. This work will be of interest to researchers in the fields of antibody/nanobody engineering, SARS-CoV-2 therapeutics, and host-virus interaction.

      Weaknesses:

      A main weakness of the study is that the efficacy statement is not thoroughly supported. While the authors comprehensively characterized the neutralizing ability of nanobodies in vitro, there is no animal data involving mice or hamsters to demonstrate the real protective efficacy in vivo. Yet, in the title and throughout the manuscript, the authors repeatedly used phrases like "retains efficacy" or "remains efficacious" to describe the nanobodies' neutralization or binding capacities.

      This claim is not well supported by the data and underestimates the impact of variants on the nanobodies, especially the omicron sublineages. For example, the authors showed that S1-RBD-15 had a ~100-fold reduction in neutralization titer against Omicron, with an IC50 at around 1 uM. This is much higher than the IC50 value of a typical anti-ancestral RBD nanobody reported in the previous study (Mast, Fridy et al. 2021). In fact, the authors themselves ascribe nanobodies with an IC50 above 1 uM as weak neutralizers. And there were many in the range of 0.1-1 uM.

      Furthermore, many nanobodies selected for affinity measurement against BA.4/5 had no detectable binding.

      Without providing in vivo protection data or including monoclonal antibodies that are known to be efficacious against variants in the in vitro assays as a benchmark, it is difficult to evaluate the efficacy just with the IC50 values.

      We respectfully disagree with the reviewer on several aspects of this critique.

      As to our use of the word efficacy - the quality of being successful in producing an intended result; effectiveness - we were specific to nanobody binding and in vitro neutralization of the variant spike proteins tested in the manuscript. Indeed, our manuscript made no claim of efficacy outside of this intended meaning. However, to prevent misinterpretation we will modify the final paragraph of our introduction to state explicitly that the nanobody repertoire retains efficacy in binding and neutralizing variants of spike. The final paragraph of the Introduction will include the following:

      “Here, we demonstrate that a subset of our previously published repertoire of nanobodies, generated against spike from the ancestral SARS-CoV-2 virus (Mast, Fridy et al. 2021), retains binding and in vitro neutralization efficacy against circulating variants of concern (VoC), including omicron BA.4/BA.5.”

      We agree that in vivo neutralization data would be an important complement to the in vitro binding and neutralization data. Experiments along these lines are ongoing, but are not considered part of a follow-up to our original paper where in vivo data were not included.

      We disagree with the Reviewer that “This claim is not well supported by the data and underestimates the impact of variants on the nanobodies, especially the omicron sublineages.” As we specifically state: “In comparison, groups I, I/II, I/IV, V, VII, VIII and the anti-S2 nanobodies contained the majority of omicron BA.1 neutralizers, though here the neutralization potency of many nanobodies was decreased compared to wild-type. This decrease in neutralization potency largely correlates with the accumulation of omicron BA.1 specific mutations throughout the RBD, which likely alters the epitope-binding site of these nanobodies, weakening their interaction with BA.1 spike (Fig. 1B). (emphasis added)”

      Naturally, we expected that some of our nanobodies would lose the ability to bind BA.4/BA.5. This enabled us to determine which areas on spike remained susceptible to our nanobodies. We show that 10/29 nanobodies tested retained binding to BA.4/5. We did not test our entire repertoire, just a subset was selected for. We stated the following:

      “Of the nanobodies that neutralized both delta and omicron BA.1, representatives from each of the nanobody epitope groups were selected for SPR analysis, where S1 binders with mapped epitopes that neutralized one or both variants well, were prioritized.”

      Reviewer #2 (Public Review):

      Summary:

      Interest in using nanobodies for therapeutic interventions in infectious diseases is growing due to their ability to bind hidden or cryptic epitopes that are inaccessible to conventional immunoglobulins. In the present study, the authors were posed (sic) to characterize nanobodies derived from the library produced earlier with the Wuhan strain of SARS-CoV-2, map their epitopes on SARS-CoV-2 spike protein, and demonstrate that some nanobodies retain binding and even neutralization against antigenically distant Variants of Concern (VOCs) that are currently circulating.

      Strengths:

      The authors demonstrate that some nanobodies - despite being obtained against the ancestral virus strain - retain high affinity binding to antigenically distant SARS-CoV-2 strains. This is despite the majority of the repertoire losing binding. Although limited to only two nanobody combinations, the demonstration of synergy in virus neutralization between nanobodies targeting different epitopes is compelling.

      We thank the Reviewer for this positive summary of the strengths of our study. In our previous work, we applied stringent criteria for the down-selection of nanobodies based on their affinity and diversity, as elaborated on in https://elifesciences.org/articles/73027. The current dataset is a further judiciously curated subset, featuring 41 nanobodies chosen to represent and inform on the 10 structurally mapped epitope groups that we initially identified. This subset is but the tip of an iceberg. For each nanobody demonstrating high-affinity binding and neutralization, we possess multiple sequence variants, offering alternative avenues for investigation. Moreover, our repertoire has since been further elaborated by use of a yeast display library (Cross et al., 2023 JBC) providing additional nanobodies capable of targeting the same epitopes. Our findings presented here, thus serve as a heuristic, enabling us to distill the much larger repertoire into manageable and informative clusters of data. We will modify our manuscript to be more explicit of these facts.

      Weaknesses:

      The authors imply that nanobodies that retain binding/neutralization of early Omicron sublineages will be active against currently circulating and future virus strains. Unfortunately, no reasoning for such a conclusion nor data supporting this prediction are provided.

      The nanobodies we propose to retain binding to current and emerging omicron sublineages at the time (Fig. 4) are those that still bind to omicron BA.1, BA.4/5. The structures of XBB and BQ.1 are not divergent enough from these aforementioned omicron sublineages in the regions we propose our nanobodies retain binding (Fig. 4) to result in loss of binding. Thus, we hypothesize that the epitopes where these nanobodies bind or are predicted to bind (outlined in black (Fig. 4)), represent regions on spike vulnerable to nanobody intervention. Importantly, we also now have further experimental data to support our predictions that these nanobodies in Fig. 4 will retain binding (see plot in Author response image 1). We will provide additional data and complements to key figures to help illustrate this in the revised manuscript.

      Author response image 1.

    1. Author Response

      In this paper, we examine the behavioral context that generates foraging decisions at the boundaries of food patches in the nematode C. elegans. By analyzing animal locomotion at high spatial and temporal resolution, we identify discrete behavioral responses to encountering the edge of a food patch that can be understood as a decision: either to remain inside the food patch or to leave it. We find that the decision to leave a food patch is associated with increased behavioral arousal that unfolds on long and short timescales. The coupling of increased arousal to lawn leaving decisions is preserved across genetic, neuronal, and environmental manipulations that alter global arousal levels. However, genetic inactivation of a set of chemosensory neurons disrupts the coupling of arousal and lawn leaving, revealing a potential site of integration between internal signals and external sensation that governs foraging.

      We appreciate the reviewers’ thoughtful engagement with this work. In addition to modifications in the text to address minor concerns and ambiguities, we have conducted new analyses and made text and figure edits to strengthen or explain our conclusions. We have also investigated possible confounding explanations to our interpretation of the data.

      In newly added analysis, we show that increased arousal does not result in increased proximity to the lawn boundary, which would be a trivial reason why roaming animals leave more than dwelling ones (new Figure 2-Supplement 1E).

      We also addressed the concern that classifying the brief speed acceleration motif as a roaming state would inflate the apparent coupling of roaming to leaving. By measuring the duration of roaming states prior to leaving, we in fact found the opposite: roaming states that precede leaving are slightly longer than other roaming states, not short acceleration events (new Figure 2-Supplement 4).

      The reviewers also asked reasonable questions about variability between batches of experiments. In particular, reviewers pointed out high levels of roaming in wild type controls accompanying npr-1 mutants. Indeed, the simultaneously-tested wild type animals roamed more than usual in this experiment (Fig. 4C,K) and less than usual in other panels (Fig. 4A,B,I,J) in these small datasets. There is more to do here, but the results support the general point that roaming and leaving are correlated in several neuromodulatory mutants that regulate roaming. We have included a new sentence in the Figure 4 legend to draw the reader’s attention to the potential limitations of these results, and to explicitly state that results should not be compared across panels. Similarly, there is more to be done to understand tax-4, as we did not test all tax-4-expressing sensory neurons for their effects on roaming and leaving.

      In private comments, reviewers also asked about experimental design and statistics and were concerned that certain assays conducted on just a few days may not represent independent experiments. We have updated the Methods section to improve the description of the behavioral experiments, including more information about the behavioral chambers and imaging conditions. We note that for all experiments we tested all relevant genotypes in the same batches and days, enabling comparisons of experimental animals with matched controls conducted at the same time.

      Reviewers asked us to compare our results to those generated by Rhoades, et al. (2019) and Cermak, et al. (2020). To the best of our knowledge, our results are fully consistent with those studies. The study by Rhoades and co-authors is primarily concerned with behavioral slowing upon first encountering a food patch, and thus does not include data regarding roaming or lawn leaving (Rhoades et al., 2019). As we mention in the text, we were initially surprised that tph-1 did not eliminate regulation of roaming by feeding, but there are straightforward explanations (redundant transmitters, other neurons). tph-1 did have a significant, albeit small, effect. The study by Cermak and co-authors presents an alternative Hidden Markov Model that uses whole animal postures to segment on-food behavior into 9 states including 8 dwelling states and a single roaming state (Cermak et al., 2020); we refer to this analysis in the discussion. Cermak’s paper and ours differ in experimental conditions, the behaviors measured, and the models used to analyze them. The animals in the Cermak paper are exposed to a large bacterial lawn of uniform density, whereas animals in our study are recorded on small bacterial lawns with thick edges. The analysis tools also differ in their use of animal posture (Cermak only) and autoregressive dynamics (our work only). Further studies of the neurons and molecules involved may help to fully harmonize these models.

      References

      Cermak, N., Yu, S.K., Clark, R., Huang, Y.C., Baskoylu, S.N., and Flavell, S.W. (2020). Whole-organism behavioral profiling reveals a role for dopamine in statedependent motor program coupling in C. Elegans. Elife 9, 1–34.

      Rhoades, J.L., Nelson, J.C., Nwabudike, I., Yu, S.K., McLachlan, I.G., Madan, G.K., Abebe, E., Powers, J.R., Colón-Ramos, D.A., and Flavell, S.W. (2019). ASICs Mediate Food Responses in an Enteric Serotonergic Neuron that Controls Foraging Behaviors. Cell 176, 85-97.e14.

    1. Author Response

      The following is the authors’ response to the original reviews.

      Reviewer 1

      We now make clear throughout the manuscript that our proposition, holding the fast cassette as central to control over powerful movements governed by the PMn, remains a hypothesis. However, we provide additional rationale for our thinking that this is the case based on functional distinctions between the PMns and SMns. Both reviewers 1 and 2 also questioned why so few synaptic and ion channel genes are seen for the SMn type. As pointed out by the reviewer, the idea that small differences in birthdates between Mn types seems like an unlikely explanation and was removed. Now, we better develop the idea that the low levels of expression of both ion channel and synaptic genes in SMns are consistent with the finding from electrophysiology that point to greatly lowered levels of transmitter release, compared to PMns. Additionally, for the purpose of identifying all synaptic and ion channel genes shared equally between Mn types, we re-examined the transcriptome. Figure 7A & B now reflect all genes in these two categories detected above threshold in PMn and SMn types, and not just examples.

      Reviewer 2

      We have added cell types in mammalian circuits shown to express the ion channel cassette members. Examples include the calyx of Held in the auditory circuit and the cerebellar Purkinje neurons. As we show with zebrafish PMn these mammalian neurons form fast, reliable circuits. In these cases, it is noteworthy that our proposal is the first to link all three as functional partners in fast AP firing and high-fidelity synaptic transmission. The suggestion that pancreatic cells would be represented in our data is deemed highly unlikely as our technique separated out the spinal cords prior to dissociation. Finally, as suggested, we added the disclaimer that we can not exclude the possibility that clusters sharing both glia and neuronal markers may represent cell doublets. Other minor corrections were all made.

      Reviewer 3

      First, we agree that the role of PMns is not restricted to escape behavior. They have been shown to participate in the highest speed of swimming as well. We have made this clear throughout the paper.

      Second, we are at odds with this reviewer over the Type I and Type II V2a recruitment during high speed swimming. We agree that both V2a types of interneurons are involved in high speed swimming and likely escape, as both directly innervate the PMns, as pointed out by the reviewer in Figure 2c of Menelaou and McLean 2019. However, the reviewer interprets Figure 2c to show that Type I, not Type II, V2a is more highly recruited over the range of higher swimming speeds whereas we conclude just the opposite. These data, along with other papers we cited, have been firmed up in the text to support a central role played by Type II.

      Third, the reviewer recommends we remove Figures 6b and 6c relating to our two newly discovered SMn markers, fox1b and alcamb. Our data shown in Figure 6a shows that these markers label SMn somas in two distinct layers along the dorsal-ventral axis in the spinal cord. The reviewer objects to Figures 6b and 6c which compare the location of our two markers to the distributions of two well studied SMn labeling transgenic lines, islet:GFP and gata2:GFP. The correspondence is not absolute but suggests that the fox1b labels islet SMns and alcamb labels the gata2 SMns. In the previous version of the paper, we suggested that this correspondence might further signal different dorsal-ventral projections. This suggestion was based solely on reports that islet and gata2 transgenic lines preferentially label SMns with different projections. We do not view this particular point as important and in light of the controversy surrounding these projections, as noted by the reviewer, we removed all reference to the subject of muscle target areas. We focus instead, on our finding of two new markers that label different dorsal ventral soma layers which MAY correspond to previously described SMn types. This reasoning is made clear in the manuscript and, because of its potential importance, we elected to retain Figures 6b and 6c as a call for future testing.

      The reviewer makes other suggestions that were all incorporated. The CoLo estimates indeed were too high, as questioned by the reviewer, because, early on, we inadvertently counted two clusters rather than the single cluster that was later authenticated. This has been corrected to reflect 1.1% in Table 1. The evx1 and evx2 data have been added to Figure 4C. Nomenclature is corrected for KA neurons. We make clear that the axonal projections for CoLo were made with mCherry expression not the in-situ label. The Hayashi reference was added.

    1. Author Response

      The following is the authors’ response to the original reviews.

      Reviewer #1 (Recommendations for The Authors)

      MAJOR CONCERNS

      1) Not addressed, but perhaps relevant, is that most of the postembryonic fish growth results from stem cells located in the ciliary marginal zone that make new neurons and Muller glia throughout the fish's life. Thus, Muller cell heterogeneity may result from the central to the peripheral gradient of Muller glial cell maturation.

      1a. Müller glial cell heterogeneity needs to be confirmed using, for example, in situ hybridization studies with gene-specific probes identified in the scRNAseq that distinguish these 2 populations. An additional approach could be the use of transgenic lines harboring tagged endogenous or transgene that reflects the promoter activity of the Muller glia subtypespecific gene.

      We thank the reviewer for the insightful comments and agree on the importance to substantiate the Müller glia heterogeneity in our manuscript. Our study is not the only study that provides evidence for Müller glia heterogeneity. In particular, we would like to refer to a recent publication (Krylov et al., 2023). Using single cell RNA sequencing, Krylov et al. detect Müller glia heterogeneity in the uninjured retina, as well as upon selective, genetic ablation of distinct subtypes of photoreceptors (e.g. long and short wavelength sensitive cones, as well as rods). They observe six distinct clusters of quiescent Müller glia that show differential spatial distribution along the dorsal/ventral retinal axis. For instance, they report a ventral quiescent Müller glia population that shares some marker genes (aldh1a3, rdh10a, smoc1) with our nonreactive Müller glia 2 (cluster 2, supplementary files 1 and 2). Moreover, the authors report that Müller glia located at different positions along the dorsal/ventral axis exhibit distinct patterns of pcna upregulation as well as subsequent re-activation upon photoreceptor ablation. We have added the supportive information from Krylov et al. in the discussion section (lines: 781-789) of our manuscript.

      2) Most interesting, but also least substantiated, is the authors' report of 2 different quiescent Muller glial cell populations in the uninjured retina and 2 different reactive Muller cell populations in the injured retina. If these populations exist independently of each other, it would be important to investigate if they differentially impacted retina regeneration.

      2a. CRISPR knockdown in F0 of factors thought to be involved in specific Müller glia-derived progenitor trajectories would be important to lend some functional significance to the data.

      We fully agree with the reviewer that addition of functional data would enrich the manuscript with valuable information. However, we don´t believe that the suggested CRISPR knockdown of selected genes in F0 animals (also known as crispants) represents a suitable approach. Crispants have been used successfully to investigate genetic contributions in embryonic-tolarval stages (the first few days) of zebrafish development, as injection of multiple gRNAs targeting the same gene is sufficient to achieve a bi-allelic knockout of the gene of up to 90% (Kroll et al., 2021). However, unless both alleles of the target gene(s) is/are mutated already early on with nearly 100%, it is unlikely that the gRNA inactivation would work equally well during subsequent development into adult stages (several months later, and after exponential growth and volume increase of the animal). Even if biallelic inactivation in the crispants does work early on, it remains unclear whether and how crispants survive to adulthood, which will be necessary in order to address gene function in the context of retina regeneration. Moreover, since we observe that the genetic events during adult retina regeneration are highly similar to the events during retina development, we would rather expect the crispants already display developmental phenotypes, which would further hamper the study of potential regenerationspecific phenotypes in adult animals. We are convinced that only ‘clean’ conditional gene inactivation studies will be suitable to address the impact of Müller glia and derived progenitor trajectories on retina regeneration. In this respect, we have recently developed the new conditional Cre-Controlled CRISPR mutagenesis system (Hans et al., Nature Comm 2021). We are currently establishing stable lines to enable controlled and specific gene inactivation, but have only obtained preliminary results so far; the final analysis will take much more time and is, therefore, beyond the scope of this work.

      3) The discussion should be modified to relate the data here presented with those described in Hoang et al., 2020.

      We followed the suggestions of the reviewer and compared our single cell RNA sequencing dataset to that described in Hoang et al., 2020. As one might expect, the comparison between the two datasets showed similarities but also significant differences due to the different experimental set-ups. We show the results of this comparison in additional main (new Figure 9) and supplementary figures (new Figure 9-figure supplement 1). In order to compare our newly obtained scRNAseq dataset of MG and MG-lineage-derived cells of the regenerating zebrafish retina to the previously published dataset of light-lesioned retina (Hoang et al., 2020), we employed the ingestion method (Scanpy, https://scanpy-tutorials.readthedocs.io/en/latest/ integrating-data-using-ingest.html) and mapped the clusters identified by Hoang and colleagues to our clusters (new Figure 9). While we applied a short-term lineage tracing strategy and only sequenced the enriched population of FAC-sorted MG and MG-derived cells of the regenerating zebrafish retina, Hoang and colleagues sequenced all retinal cells in the light-lesioned retina. Consequently, comparison between the two datasets uncovered similarities, but also significant differences, due to the different experimental set-ups (Figure 9A). Consistently, the cluster annotated as resting MG in Hoang et al. mapped to clusters annotated as non-reactive MG 1 and 2 in our dataset (new Figure 9B). The cluster annotated as activated MG in Hoang et al. mapped to clusters annotated as reactive MG 1 and 2, as well as to the cluster with hybrid identity of MG/progenitors in our dataset. Interestingly, some cells annotated as activated MG in Hoang et al. mapped also to neurogenic progenitor 2 and 3 clusters in our dataset (Figure 9B). The cluster annotated as progenitors in Hoang et al. mapped to the progenitor area in our dataset, which included neurogenic progenitors 2, 3 as well as photoreceptor and horizontal cell precursors (new Figure 9B). Finally, retinal ganglion cells, cones, GABAergic amacrine cells and bipolar cells annotated in Hoang et al. perfectly mapped to retinal ganglion cells, cone, amacrine and bipolar cells in our dataset (new Figure 9B). While we did not detect a mature horizontal cell cluster, Hoang and colleagues annotated a horizontal cell cluster, which cells mapped to reactive MG 2, MG/progenitors 1 and part of progenitors 3 in our dataset (new Figure 9B). Moreover, Hoang and colleagues annotated rod photoreceptors that mapped to progenitors 3, photoreceptor precursors, red and blue cones, horizontal cell precursors and bipolar cells in our dataset (new Figure 9B). Finally, due to the different cell isolation protocol, Hoang and colleagues annotated additional cell clusters that did not map to any cluster in our more selective dataset, and included oligodendrocytes, pericytes, retinal pigmented epithelial cells as well as vascular/endothelial cells (new Figure 9B). Next, we selected representative marker genes per cluster from our scRNAseq dataset and checked their expression in the dataset by Hoang and colleagues (Figure 9-figure supplement 1). The dot plot showing the expression of selected gene candidates per cluster further corroborated the large overlap between clusters annotated in the present study with those annotated in the study by Hoang and colleagues. These novel comparisons to the data of Hoang et al. are now included in the resubmitted version, and are described and discussed in an additional paragraph in the results (lines: 482-517) as well as discussion (lines: 766-807) sections.

      MINOR CONCERNS

      1) Fig 1C is difficult to interpret. I am also confused by the color coding which is not presented in the figure legend - why 3 shades of red and two of blue? Please define each (for example, what's the difference between red, purple, and light red in the 6dpl panel?). What are the white areas outlined by blue and red circles/cells (looks like a topography plot)? It appears that there is a fairly large amount of pcna:EGFP expression in the uninjured retina - what are these cells?

      We have replaced Figure 1C with a better one and rephrased/extended the explanation of the figure in the results (lines: 192-195). Figure 1C depicts contour plots, which represent the relative frequency of data. Each contour line encloses an equal percentage of events (that is, cells), and contour lines that are closely packed indicate a high concentration of events. In flow cytometry, contour plots are used to represent highly frequent events, as this kind of plots are independent on sample size.

      Concerning the observed pcna:EGFP expressing cells in the uninjured retina, we interpret them as proliferating cells coming from the ciliary marginal zone and from Müller glia of the central retina, which represent progenitors and Müller glia that have re-entered the cell cycle to generate rod progenitors, respectively. Consistent with that, we observe pcna:EGFPpositive cells in the ciliary marginal zone as well as central retina using immunofluorescence, as shown in Figure 1-figure supplement 1.

      2) Results, lines 186-188 are not presented clearly: EGFP+ cells may persist for some time after they leave the cell cycle, so stating EGFP+ cells are proliferating may not be correct. How long does PCNA promoter activity and EGFP expression remain after Muller cells exit the cell cycle? mCherry+/EGFP- cells may be non-reactive Muller glia or reactive Muller glia that have not entered the cell cycle. It seems likely that Muller glia start reprogramming before undergoing cell division.

      We agree with the reviewer that EGFP persists for some time after the cells have left the cell cycle, which we actually describe and use to benefit in our study. We do not know for how long exactly the pcna promoter is active within the cell cycle, but EGFP is known to have a half-life of approximately 24 hours (Li et al., 1998). Even though we cannot make a statement about EGFP persistence in Müller glia, we note that previous reports (Lahne et al., 2015; Nagashima et al., 2013; Nelson et al., 2013; Thummel et al., 2008) and our study (Figure 3-figure supplement 2) show PCNA at the protein level in Müller glia cells between 24 and 48 hpl, including our sampled 44 hpl time point (lines: 69-73). We also agree with the reviewer that Müller glia will become reactive to the injury most likely prior (lines: 67-69) to activation of the pcna promoter, meaning that Müller glia are EGFP-negative at this time point due to the immature status of EGFP after translation. However, we are confident that our data also comprises this cell state (early phase of Müller glia activation) because we sampled proliferating (EGFP- and mCherry-double positive cells) as well as non-proliferating Müller glia (mCherry-only positive cells) at all time points (lines: 213-215 and Figure 1C). We interpret that the early phase of Müller glia activation corresponds to Müller glia transitioning from a nonreactive to a reactive state. With respect to our UMAP, we map this cell state in cluster 1 localizing to the top left part of the cluster, abutting cluster 3, the reactive Müller glia 1 (Figure 2B).

      3) I am concerned by the observation that microglia were identified by scRNAseq as a contaminating cell population. Since FACS was based on gfap:mCherry expression, why did microglia end up in the mix? Also, what are the ‘...low-quality cells expressing many ribosomal transcripts...’ and why, if they are low-quality cells, did they pass the sequencing quality control as stated on lines 208-209?

      The reviewer is right that microglia should actually not end up in the sample when using the gfap:mCherry line. However, microglia always displayed a certain level of autofluorescence in our experimental set-up (possibly because they may have ingested some cell debris), which may have contributed to their presence in the FACS samples. In contrast to the reviewer, we were not concerned about this ‘contamination’, because the microglia could be easily identified and sorted out using bioinformatics. This is supported by the presented supplementary figure in which microglia separate from the core of clusters containing Müller glia and Müller gliaderived cells in the UMAP of the full dataset (Figure 2-figure supplement 1).

      We also acknowledge that ‘low quality cells’ is not an appropriate term for cells in the cluster expressing ribosomal mRNAs at high levels, as ribosomal enrichment actually does not give any information concerning their quality. We referred to them as ‘low quality’ because the enrichment in ribosomal transcripts masks their identity considerably. To correct this, we now renamed cells in this cluster descriptively as ‘ribosomal gene-enriched’ cells (Figure 2-figure supplement 1, line: 226).

      4) Fig. 2: please list in the text or fig legend the specific genes used to identify each cell cycle state. Why is cluster 3 considered a reactive Muller population when expressing S phase markers and PCNA? These features seem to distinguish cluster 3 from 4 and may suggest cluster 3 is a progenitor population. Further explanation is necessary to understand the assignments.

      Information about the specific genes used to identify each cell cycle state is provided in the paragraph “Bioinformatic analysis” (lines: 925-934) in the Materials and Methods section. We considered listing all the markers in either the results or the figure legends as well, but decided against it, as it impairs readability in our opinion. Nevertheless, we have now highlighted also in the results (line: 261) that the list of cell cycle markers is available in the Materials and Methods section.

      We understand the reviewer´s point that cluster 3 represents progenitors and not Müller glia, when PCNA expression is considered as a sole marker of progenitors or of Müller glia reprogrammed to a progenitor state (Hoang et al., 2020). However, we disagree with this view for three reasons. First, although PCNA is used as a marker of Müller glia reprogrammed to a progenitor state and of progenitors in Hoang et al., 2020, it should be noted that PCNA-positive, Müller glia cells are present in the central retina already in uninjured conditions, when regeneration-associated, Müller glia-derived progenitors are not detectable. Second, cluster 3 is evident only at 44 hpl, a time point at which Müller glia cells are about to divide or have undergone their first and only cell division. In this regard, we would like to refer to the discussion about Müller glia and Müller glia-derived progenitors as distinct populations in Lenkowski and Raymond, 2014. Third, we have performed in situ hybridization for starmaker (stm), a marker gene highly specific for cells in cluster 3 (supplementary files 1 and 3), combined with immunohistochemistry for GFAP and PCNA. The results of the staining are depicted in a new Figure 3-figure supplement 2. In strong agreement with our sequencing results, we observe stm expression only at 44 hpl, whereas no signal is detected in the uninjured as well as 4 and 6 dpl retina (Figure 3- figure supplement 2). Virtually all stm-positive cells at 44 hpl are also PCNA- and GFAP-double positive cells displaying a clear Müller glia morphology (Figure 3- figure supplement 2). Hence, we interpret cells in cluster 3 as reactive Müller glia, indicating that pcna can be used as a marker of progenitors, but not exclusively of progenitors, prevalently at later stages. At 44 hpl, Müller glia express pcna in order to undergo asymmetric cell division giving rise to the renewed Müller glia and the multipotent progenitor that will continue dividing.

      5) I am confused by the crlf1a scRNAseq data indicating it is associated with proliferating PCNA+ reactive Muller glia Cluster 3 and PCNA- reactive Muller glia Cluster4 at 44 hpl (Fig. 3), yet in Fig. 4 crlf1a in situ signal is exclusively associated with proliferating Muller glia at 44 hpl. Why don't we observe the crlf1a+/PCNA- cell population?

      We highlight that crlf1a expression is actually detected also at 4 dpl (Fig. 3). We also note that immunofluorescence in Fig 3. shows crlf1a mRNA and PCNA protein, whereas single cell RNA sequencing detects crlf1a and pcna transcripts. In this context, it is possible that crlf1a-, PCNAdouble positive cells detected at 4 dpl are still positive for the PCNA protein, but no longer express the pcna transcript. Double in situ hybridization for pcna and crlf1a would be needed to fully address whether crlf1a-positive cells are still pcna-positive at 4 dpl. It is also possible that crlf1a-, GFAP-double positive, PCNA-negative Müller glia are fewer and only masked in the crowd of crlf1a-, PCNA-double positive, GFAP-negative progenitors at 4 dpl (Raymond et al., 2006). We amended the discussion section with this information (lines: 634-654).

      6) scRNAseq cluster 3 is a proliferating population that is assigned "reactive Muller glia", whereas cluster 5 is assigned Muller glia/progenitor and in the Discussion referred to as MG about to go or already underwent asymmetric division to generate a progenitor (lines 568-571). I don't understand why cluster 3 is not referred to as the one harboring reactive MG/progenitors that underwent or are undergoing asymmetric cell division - The timing is right, as are the markers.

      We would like to refer the reviewer to the discussion in point 4, including the changes we introduced in the Materials and Methods (Lines 925-934). As mentioned above, we do not agree that PCNA alone represents an exclusive marker of progenitors, but is rather a marker of cells undergoing proliferation. Moreover, we note that Müller glia first and only division occurs between 31 and 48 hpl. Finally, as mentioned above, expression of stm is a unique marker for cluster 3, which is only evident at 44 hpl, but not of cluster 5, which is evident at 4 dpl.

      It seems cluster 5 might better fit the amplifying progenitor stage where some MG markers are retained but diluted by cell division. Please clarify the reasoning behind the labeling of this cluster. It is not clear why this cluster has to contain self-renewed Muller glia - why wouldn't these Muller cells partition to quiescent MG clusters 1 and 2 or reactive Muller glia in clusters 3 and 4?

      We partially agree with the reviewer that cluster 5 might better fit the amplifying progenitor state, and this is why we indicate this cluster as a “crossroad in the trajectory” in the discussion (lines: 613-631). However, we cannot entirely exclude that cells in cluster 5 contain selfrenewed Müller glia (differential gene expression analysis highlights glial markers too, see Figure 3A, supplementary file 6). Cells that we interpret as self-renewing Müller glia do not partition back to quiescent Müller glia (cluster 1 and 2) because they are on the way to be quiescent Müller glia again, yet they did not reach that point, maybe due to sampling reasons. Unfortunately, our short-term lineage tracing strategy ceases at 6 dpl. We also speculate in the discussion (lines: 679-682) that if we had sampled at later time points (e.g. at 14 dpl), we might have been able to detect the density of the cells in the glial area moving back to clusters 1 or 2 (cell density plots, Figure 2B).

      I also have trouble understanding cluster 4's assignment. The Discussion states it represents cells at the crossroad of glial and neurogenic trajectory containing self-renewed Muller glia as well as first-born MG-derived progenitors. However, it is populated by cells after 44 hpl (Fig. 2B) which is when reactive Muller glia are detected and lacks proliferative markers.

      We think that there is a misunderstanding here. We never refer to cluster 4 as a crossroad in the glial and neurogenic trajectory. We state that cluster 5 is actually the crossroad between the two trajectories (line 629). We further propose that self-renewed MG close the cycle via late reactive MG (cluster 4) and return into non-reactive Müller glia (clusters 1 and 2, red, dashed line in Figure 10) (now described in lines 631-633). The cell density plots support the direction of the cycle closing towards non-reactive Müller glia, in particular at 4 and 6 dpl (Figure 2B).

      Might cluster 4 represent a population of reactive MG remaining at 4 dpl that never entered the cell cycle and therefore would be devoid of Muller glia-derived progenitors?

      As stated in the manuscript, we actually think that marker expression as well as the cell density plots support our assignment of cluster 4 to represent self-renewed Müller glia closing the cycle to non-reactive Müller glia. Our assignment also fits well with the expected events following asymmetric cell division. However, as we cannot rule out the reviewer´s entire idea, we included the suggestion in the updated discussion (lines 651-654).

      7) Results, lines 163-164; Please provide a reference for "..... consistent with the previously described....."

      We thank the reviewer for this observation and we added the appropriate references (Fimbel et al., 2007; Lenkowski and Raymond, 2014; Thummel et al., 2008) in the updated version of the manuscript (lines: 171-172).

      Reviewer #2 (Recommendations For The Authors):

      Overall, this very thorough study provides interesting and unexpected results. The published data set will be useful for many subsequent studies. I have only a few remarks that the authors may consider discussing. Their cluster analysis revealed most of the expected cell clusters with some interesting surprises. One relates to photoreceptors where the authors describe well-separated clusters for red and green cones, while rods, UV and blue cones do not form clusters. For rods, this is discussed, but I miss a brief discussion on the "missing" cone subtypes.

      We thank the reviewer for the insightful comments. It is correct that we indeed detect only red and blue cones, as indicated by their expression of red-sensitive opsin gene (opn1lw2) and the blue-sensitive opsin gene (opn1sw2), respectively. It is possible that missing cone subtypes are born later than 6 dpl. As the reviewer suggested, we amended the discussion and added information about the missing cone subtypes (lines: 724-726).

      I am also intrigued by the two, quite separated amacrine cell clusters, while bipolar cells cluster in one cluster, without separation in (say) ON and OFF bipolar cells. This may also merit a discussion. What are their ideas on the small and quite separated amacrine cell cluster (cluster 14).

      Bipolar cells in cluster 15 are very sparse in our dataset, with only 40 cells in total. Hence, the sample size might be too small to be separated into ON and OFF subtypes. Alternatively, cells might be still immature, as we use 6 dpl as our latest sampled time point. Concerning cells in cluster 14, we think they are starburst amacrine cells, as indicated by their simultaneous expression of gad1b and chata (Figure 8-figure supplement 2B), which is a characteristic feature of starburst amacrine cells in mouse (O´Malley et al., 1992). We added this observation in the discussion (lines: 706-712).

    1. Author Response

      The following is the authors’ response to the original reviews.

      The Authors wish to thank the Reviewers for their detailed and insightful comments. By properly addressing these critiques, we sincerely believe our finished product will be substantially improved and provide greater insight to the academic community.

      Both Reviewers noted the importance of identifying the limitations of our study with particular emphasis on embedded implant heating due to switching gradient coils. Understanding the limitations of any model and/or simulation process is critical when adopting its use, especially when estimating the safety of embedded devices. For this reason, we have included the following text and corresponding references in our Discussion section:

      While the workflow presented herein establishes a validated approach to estimate RF heating due to the presence of a passive implant within a human subject undergoing an MR procedure, certain limitations and proper use stipulations of this methodology should be identified. These include:

      1) The approach of embedding a given passive implant must be carefully considered and supervised by an orthopaedic subject matter expert, preferably an orthopaedic surgeon. While the procedures described above focus on insertion and registration of an implant to make it numerically suitable for simulation, relevant anatomic and physiological considerations must also be addressed to ensure a physically realistic and appropriate result. This will enable a proper simulated fit and no empty spaces or unintended tissue deformations.

      2) Temperature changes presented are due only to RF energy deposition. The results do not take into account the impact of low-frequency induction heating of metallic implants naturally caused by the switching gradient coils. Important work on this subject matter has recently been reported in [21],[22],[23],[24],[25],[26],[27]. Unless an orthopaedic implant has a loop path, heating due to gradient fields is typically less than heating due to RF energy deposition. The present testbed would be applicable to the induction heating of implants (and the expected temperature rise of nearby tissues), after switching from Ansys HFSS (the full wave electromagnetic FEM solver) to Ansys Maxwell (the eddy current FEM solver). Two examples of this kind have already been considered in [25],[45].

      3) The procedures presented in this work have been based on the response of a single human model of advanced age and high morbidity.

      4) Finally, validation was achieved using available published data [42]-[44] and relies upon the legitimacy and veracity of that data. Coil geometry, power settings, and other relevant parameters were taken explicitly from these sources and modeled to enable a faithful comparison.

    1. Author Response

      The following is the authors’ response to the original reviews.

      Reviewer #1 (Public Review):

      Summary:

      Heitmann et al introduce a novel method for predicting the potential of drug candidates to cause Torsades de Pointes using simulations. Despite the fact that a multitude of such methods have been proposed in the past decade, this approach manages to provide novelty in a way that is potentially paradigm-shifting. The figures are beautiful and manage to convey difficult concepts intuitively.

      Strengths:

      (1) Novel combination of detailed mechanistic simulations with rigorous statistical modeling

      (2) A method for predicting drug safety that can be used during drug development (3) A clear explication of difficult concepts.

      Weaknesses:

      (1) In this reviewer's opinion, the most important scientific issue that can be addressed is the fact that when a drug blocks multiple channels, it is not only the IC50 but also the Hill coefficient that can differ. By the same token, two drugs that block the same channel may have identical IC50s but different Hill coefficients. This is important to consider since concentration-dependence is an important part of the results presented here. If the Hill coefficients were to be significantly different, the concentration- dependent curves shown in Figure 6 could look very different.

      See our response below.

      (2) The curved lines shown in Figure 6 can initially be difficult to comprehend, especially when all the previous presentations emphasized linearity. But a further issue is obscured in these plots, which is the fact that they show a two-dimensional projection of a 4dimensional space. Some of the drugs might hit the channels that are not shown (INaL & IKs), whereas others will not. It is unclear, and unaddressed in the manuscript, how differences in the "hidden channels" will influence the shapes of these curves. An example, or at least some verbal description, could be very helpful.

      See our response below.

      Reviewer #1 (Recommendations For The Authors):

      The manuscript is generally well-written (with one important exception, see below). The manuscript can be improved with a few suggested modifications, ordered from most important to least important.

      (1) In this reviewer's opinion, the most important scientific issue that the authors need to address is the fact that when a drug blocks multiple channels, it is not only the IC50 but also the Hill coefficient that can differ. By the same token, two drugs that block the same channel may have identical IC50s but different Hill coefficients. This is important to consider since concentration-dependence is an important part of the results presented here.

      In a recent study (Varshneya et al, CPT PSP 2021 (PMID: 33205613)) they originally ran simulations with Hill coefficients of 1 for all the 4 drugs and 7 channels, then re-ran the simulations with differing Hill coefficients. The results were quantitatively quite different than what was originally obtained, even though the overall trends were identical. A look at the table provided in that paper's supplement shows that the estimated Hill coefficients range from 0.5 to 1.9, which is a pretty wide range.

      In this case, I don't think the authors should re-run the entire analysis. That would require entirely too much work and potentially detract from the elegant presentation of the manuscript in its current form. Although I haven't looked at the Llopis-Lorente dataset recently, I doubt that reliable Hill coefficients have been obtained for all 105 drugs. However, the Crumb et al dataset (PMID: 27060526) does provide this information for 30 drugs.

      Perhaps the authors could choose an example of two drugs that affect similar channels but with differences in the estimated Hill coefficients. Or even a carefully-designed hypothetical example could be of value. At the very least, Hill coefficients need to be mentioned as a limitation, but this would be stronger if it were coupled with at least some novel analyses.

      We fixed the Hill coefficients to h=1 because there is no evidence for co-operative drug binding in the literature that would require coefficients other than one. There is also the practical matter that only 17 of the 109 drugs in the dataset have a complete set of Hill coefficients. We have revised the Methods (Drug datasets) to make these justifications explicit:

      Lines 560-566: “… We also fixed the Hill coefficients at h = 1 because (i) there is no evidence for co-operative drug binding in the literature, and thus no theoretical justification for using coefficients other than one; (ii) only 17 of the 109 drugs in the dataset had a complete set of Hill coefficients (hCaL, hKr, hNaL, hKs) anyway. …”

      Out of interest, we re-ran our analysis using only those n=17 drugs (Amiodarone, Amitriptyline, Bepridil, Chlorpromazine, Diltiazem, Dofetilide, Flecainide, Mibefradil, Moxifloxacin, Nilotinib, Ondansetron, Quinidine, Quinine, Ranolazine, Saquinavir, Terfenadine and Verapamil). When the Hill coefficients were fixed at h=1, the prediction accuracy was 88.2% irrespective of the dosage (Author response image 1). When we used the estimated (free) Hill coefficients, the prediction accuracy remained unchanged (88.2%) for all doses except the lowest (1x to 2x) where it dropped to 82.4%. We concluded that using the Hill coefficients from the dataset made little difference to the results.

      Author response image 1.

      (2) I initially had a hard time understanding the curved lines shown in Figure 6 when all the previous presentations emphasized linearity. After thinking for a while, I was able to get it, but there was a further issue that I still struggle with. That is the fact that the plots all show a two-dimensional projection of a 4-dimensional space. Some of the drugs might hit the channels that are not shown (INaL & IKs), whereas others will not. How will differences in the "hidden channels" influence the shapes of these curves? An example, or at least some verbal description, could be very helpful.

      We omitted GKs and GNaL from Figure 6 because they added little to the story. Those “hidden” channels operate in the same manner as GKr and GNaL. They are shown in Supplementary Dataset S1. We have included more explicit references to the Supplementary in both the main text and the caption of Figure 6. We have also rewritten the section on ‘The effect of dosage on multi-channel block’ (lines 249-268) to better convey that the drug acts in four dimensions.

      (3) I also struggled a bit with Figure 3 and the section "Drug risk metric." What made this confusing was the PQR notation on the figure and the equations represented as A and B. Can these be presented in a common notation, or can the relationship be defined?

      We have replaced the PQR notation in Figure 3A with vector notation A and B to be consistent with the equations.

      Also in Figure 3B, I was unclear about the units on the x-axis. Is each step (e.g. from 0 to 1) the same distance as a single log unit along the abscissa or ordinate in Figure 3A?

      Yes it is. We have revised the caption for Figure 3B to explain it better.

      (4) The manuscript manages to explain difficult concepts clearly, and it is generally wellwritten. The important exception, however, is that the manuscript contains far too many sentence fragments. These often occur when the authors explain a difficult concept, then follow up with something that is essentially "and this in addition" or "with the exception of this."

      Lines 220-223: "In comparison, Linezolid is an antibacterial agent that has no clinical evidence of Torsades (Class 4) even though it too blocks IKr. Albeit less than it blocks ICaL (Figure 5A, right)."

      Lines 242-245: "Conversely, Linezolid shifts the population 1.18 units away from the ectopic regime. So only 0.0095% of those who received Linezolid would be susceptible. A substantial drop from the baseline rate of 0.93%."

      There are several others that I didn't note, so the authors should perform a careful copy edit of the entire manuscript.

      Thank you. We have remediated the fragmented sentences throughout.

      Reviewer #2 (Public Review):

      Summary:

      In the paper from Hartman, Vandenberg, and Hill entitled "assessing drug safety, by identifying the access of arrhythmia and cardio, myocytes, electro physiology", the authors, define a new metric, the axis of arrhythmia" that essentially describes the parameter space of ion channel conductance combinations, where early after depolarization can be observed.

      Strengths:

      There is an elegance to the way the authors have communicated the scoring system. The method is potentially useful because of its simplicity, accessibility, and ease of use. I do think it adds to the field for this reason - a number of existing methods are overly complex and unwieldy and not necessarily better than the simple parameter regime scan presented here.

      Weaknesses:

      The method described in the manuscript suffers from a number of weaknesses that plague current screening methods. Included in these are the data quality and selection used to inform the drug-blocking profile. It's well known that drug measurements vary widely, depending on the measurement conditions.

      We agree and have added a new section to describe these limitations, as follows:

      Lines 467-478: Limitations. The method was evaluated using a dataset of drugs that were drawn from multiple sources and diverse experimental conditions (LlopisLorente et al., 2020). It is known that such measurements differ prominently between laboratories and recording platforms (Kramer et al., 2020). Some drugs in the dataset combined measurements from disparate experiments while others had missing values. Of all the drugs in the dataset, only 17 had a complete set of IC50 values for ICaL, IKr, INaL and IKs. The accuracy of the predictions are therefore limited by the quality of the drug potency measurements.

      There doesn't seem to be any consideration of pacing frequency, which is an important consideration for arrhythmia triggers, resulting from repolarization abnormalities, but also depolarization abnormalities.

      It is true that we did not consider the effect of pacing frequency. We have included this in the limitations:

      Lines 479-485: The accuracy of the axis of arrhythmia is likewise limited by the quality of the biophysical model from which it is derived. The present study only investigated one particular variant of the ORd model (O’Hara et al., 2011; KroghMadsen et al., 2017) paced at 1 Hz. Other models and pacing rates are likely to produce differing estimates of the axis.

      Extremely high doses of drugs are used to assess the population risk. But does the method yield important information when realistic drug concentrations are used?

      Yes it does. The drugs were assessed across a range of doses from 1x to 32x therapeutic dose (Figure 8A). The prediction accuracy at low doses is 88.1%.

      In the discussion, the comparison to conventional approaches suggests that the presented method isn't necessarily better than conventional methods.

      The comparison is not just about accuracy. Our method achieves the same results at greatly reduced computational cost without loss of biophysical interpretation. We emphasise this in the Conclusion:

      Lines 446-465: Conclusion. Our approach resolves the debate between model complexity and biophysical realism by combining both approaches into the same enterprise. Complex biophysical models were used to identify the relationship between ion channels and torsadogenic risk — as it is best understood by theory. Those findings were then reduced to a simpler linear model that can be applied to novel drugs without recapitulating the complex computer simulations. The reduced model retains a bio-physical description of multi-channel drug block, but only as far as necessary to predict the likelihood of early after-depolarizations. It does not reproduce the action potential itself. Our approach thus represents a convergence of biophysical and simple models which retains the essential biophysics while discarding the unnecessary details. We believe the benefits of this approach will accelerate the adoption of computational assays in safety pharmacology and ultimately reduce the burden of animal testing.

      In conclusion, I have struggled to grasp the exceptional novelty of the new metric as presented, especially when considering that the badly needed future state must include a component of precision medicine.

      Safety pharmacology has a different aim to precision medicine. The former concerns the population whereas the latter concerns the individual. The novelty of our metric lies in reducing the complexity of multi-channel drug effects to a linear model that retains a biophysical interpretation.

      Reviewer #2 (Recommendations For The Authors):

      A large majority of drugs have more complex effects than a simple reduction and channel conductance. Some of these are included in the 109 drugs shown in Figure 7. An example is ranolazine, which is well known to have potent late sodium channel blocking effects - how are such effects included in the model as presented? I think at least suggesting how the approach can be expanded for broader applicability would be important to discuss.

      Our method does consider the simultaneous effect of the drug on multiple ion channels, specifically the L-type calcium current (ICaL), the delayed rectifier potassium currents (IKr and IKs), and the late sodium current (INaL). In the case of ranolazine (class 3 risk), the dose-responses for all four ion channels, based on IC50s published in Llopis-Lorente et al. are given in Supplementary Dataset S1.

      The response curves in Author response image 2 show that in this dataset, ranolazine blocks IKr and INaL almost equally - being only slightly less potent against IKr. There are two issues to consider here that potentially contribute to ranolazine being misclassified as pro-arrhythmic. First, the cell model is more sensitive to block of IKr than INaL. As a result, in the context of an equipotent drug, the prolonging effect of IKr block outweighs the balancing effect of INaL block, resulting in a pro-arrhythmic risk score. Second, the potency of IKr block in this dataset may be overestimated which in turn exaggerates the risk score. For example, measurements of ranolazine block of IKr from our own laboratory (Windley et al J Pharmacol Toxicol 87, 99–107, 2017) suggest that the IC50 of IKr is higher (35700 nM) than that reported in the LlopisLorente dataset (12000 nM). If this were taken into account, there would be less block of IKr relative to INaL, resulting in a safer risk score.

      Author response image 2.

    1. Author Response

      The following is the authors’ response to the previous reviews

      Reviewer #1 (Public Review):

      Comments on the original submission:

      Trypanosoma brucei undergoes antigenic variation to evade the mammalian host's immune response. To achieve this, T. brucei regularly expresses different VSGs as its major surface antigen. VSG expression sites are exclusively subtelomeric, and VSG transcription by RNA polymerase I is strictly monoallelic. It has been shown that T. brucei RAP1, a telomeric protein, and the phosphoinositol pathway are essential for VSG monoallelic expression. In previous studies, Cestari et al. (ref. 24) has shown that PIP5pase interacts with RAP1 and that RAP1 binds PI(3,4,5)P3. RNAseq and ChIPseq analyses have been performed previously in PIP5pase conditional knockout cells, too (ref. 24). In the current study, Touray et al. did similar analyses except that catalytic dead PIP5pase mutant was used and the DNA and PI(3,4,5)P3 binding activities of RAP1 fragments were examined. Specifically, the authors examined the transcriptome profile and did RAP1 ChIPseq in PIP5pase catalytic dead mutant. The authors also expressed several C-terminal His6-tagged RAP1 recombinant proteins (full-length, aa1300, aa301-560, and aa 561-855). These fragments' DNA binding activities were examined by EMSA analysis and their phosphoinositides binding activities were examined by affinity pulldown of biotin-conjugated phosphoinositides. As a result, the authors confirmed that VSG silencing (both BES-linked and MES-linked VSGs) depends on PIP5pase catalytic activity, but the overall knowledge improvement is incremental. The most convincing data come from the phosphoinositide binding assay as it clearly shows that N-terminus of RAP1 binds PI(3,4,5)P3 but not PI(4,5)P2, although this is only assayed in vitro, while the in vivo binding of full-length RAP1 to PI(3,4,5)P3 has been previously published by Cestari et al (ref. 24) already. Considering that many phosphoinositides exert their regulatory role by modulate the subcellular localization of their bound proteins, it is reasonable to hypothesize that binding to PI(3,4,5)P3 can remove RAP1 from the chromatin. However, no convincing data have been shown to support the author's hypothesis that this regulation is through an "allosteric switch".

      Comments on revised manuscript:

      In this revised manuscript, Touray et al. have responded to reviewers' comments with some revisions satisfactorily. However, the authors still haven't addressed some key scientific rigor issues, which are listed below:

      1) It is critical to clearly state whether the observations are made for the endogenous WT protein or the tagged protein. It is good that the authors currently clearly indicate the results observed in vivo are for the RAP1-HA protein. However, this is not as clearly stated for in vitro EMSA analyses. In addition, in discussion, the authors simply assumed that the c-terminally tagged RAP1 behaves the same as WT RAP1 and all conclusions were made about WT RAP1.

      There are two choices here. The authors can validate that RAP1-HA still retains RAP1's essential function as a sole allele in T. brucei cells (as was recommended previously). Indeed, HA-tagged RAP1 has been studied before, but it is the N-terminally HA-tagged RAP1 that has been shown to retain its essential functions. Adding the HA tag to the C-terminus of RAP1 may well cause certain defects to RAP1. For example, N-terminally HA-tagged TERT does not complement the telomere shortening phenotype in TERT null T. brucei cells, while C-terminally GFP-tagged TERT does, indicating that HA-TERT is not fully functional while TERT-GFP likely has its essential functions (Dreesen, RU thesis). Although RAP1-HA behaves similar to WT RAP1 in many ways, it is still not fully validated that this protein retains essential functions of RAP1. By the way, it has been published that cells lacking one allele of RAP1 behave as WT cells for cell growth and VSG silencing (Yang et al. 2009, Cell; Afrin et al. 2020, mSphere). In addition, although RAP1 may interact with TRF weakly, the interaction is direct, as shown in yeast 2-hybrid analysis in (Yang et al. 2009, Cell).

      Alternatively, if the authors do not wish to validate the functionality of RAP1-HA, they need to add one paragraph at the beginning of the discussion to clearly state that RAP1-HA may not behave exactly as WT RAP1. This is important for readers to better interpret the results. In addition, the authors need to tune down the current conclusions dramatically, as all described observations are made on RAP1-HA but not the WT RAP1.

      The results with RAP1-HA are consistent with previous knowledge of RAP1 interactions with telomeric proteins and DNA. Hence, the C-terminal HA-tagged RAP1 seems, by all measures, functional. Nevertheless, to make it clear for the reader, we added a note in the discussion, lines 244-246: “Although we showed that C-terminal HA-tagged RAP1 protein has telomeric localization (Cestari et al. 2015, PNAS) and interactions with other telomeric proteins (Cestari et al. 2019 Mol Cell Biol); we cannot rule out potential differences between HA-tagged and non tagged RAP1.”

      For a similar reason, the current EMSA results truly reflect how C-terminally His6-tagged RAP1 and RAP1 fragments behave. If the authors choose not to remove the His6 tag, it is essential that they use "RAP1-His6" to refer to these recombinant proteins. It is also essential for the authors to clearly state in the discussion that the tagged RAP1 fragments bind DNA, but the current data do not reveal whether WT RAP1 binds DNA. In addition, the authors incorrectly stated that "disruption of the MybL domain sequence did not eliminate RAP1-telomere binding in vivo" (lines 165-166). In ref 29, deletion of Myb domain did not abolish RAP1-telomere association. However, point mutations in MybL domain that abolish RAP1's DNA binding activities clearly disrupted RAP1's association with the telomere chromatin. Therefore, the current observation is not completely consistent with that published in ref 29.

      We stated in line 149-150 “…we expressed and purified from E. coli recombinant 6xHistagged T. brucei RAP1 (rRAP1)”. To clarify to the authors, we replaced rRAP1 with rRAP1-His throughout the manuscript and figures. As for the statement that “disruption of the MybL domain sequence did not eliminate RAP1-telomere binding in vivo" (lines 165-166).”. We removed the statement from the manuscript.

      2) There is no evidence, in vitro or in vivo, that binding PI(3,4,5)P3 to RAP1 causes conformational change in RAP1. The BRCT domain of RAP1 is known for its ability to homodimerize (Afrin et al. 2020, mSphere). It is therefore possible that binding of PI(3,4,5)P3 to RAP1 simply disrupts its homodimerization function. The authors clearly have extrapolated their conclusions based on available data. It is therefore important to revise the discussion and make appropriate statements.

      We did not state that PI(3,4,5)P3 causes RAP1 conformational changes. We discussed the possibility. We stated in lines 199-201: “PI(3,4,5)P3 inhibition of RAP1-DNA binding might be due to its association with RAP1 N-terminus causing conformational changes that affect Myb and MybL domains association with DNA.” This is a reasonable discussion, given the data presented in the manuscript.

      Reviewer #2 (Public Review):

      In this manuscript, Touray et al investigate the mechanisms by which PIP5Pase and RAP1 control VSG expression in T. brucei and demonstrate an important role for this enzyme in a signalling pathway that likely plays a role in antigenic variation in T. brucei. While these data do not definitively show a role for this pathway in antigenic variation, the data are critical for establishing this pathway as a potential way the parasite could control antigenic variation and thus represent a fundamental discovery.

      The methods used in the study are generally well-controlled. The authors provide evidence that RAP1 binds to PI(3,4,5)P3 through its N-terminus and that this binding regulates RAP1 binding to VSG expression sites, which in turn regulates VSG silencing. Overall their results support the conclusions made in the manuscript. Readers should take into consideration that the epitope tags on RAP1 could alter its function, however.

      There are a few small caveats that are worth noting. First, the analysis of VSG derepression and switching in Figure 1 relies on a genome which does not contain minichromosomal (MC) VSG sequences. This means that MC VSGs could theoretically be mis-assigned as coming from another genomic location in the absence of an MC reference. As the origin of the VSGs in these clones isn't a major point in the paper, I do not think this is a major concern, but I would not over-interpret the particular details of switching outcomes in these experiments.

      We agree with the reviewer and thus made no speculations on minichromosomes. The data analysis must rely on the available genome, and the reference genome used is well-assembled with PacBio sequences and Hi-C data (Muller et al. 2018, Nature).

      Another aspect of this work that is perhaps important, but not discussed much by the authors, is the fact that signalling is extremely poorly understood in T. brucei. In Figure 1B, the RNA-seq data show many genes upregulated after expression of the Mut PIP5Pase (not just VSGs). The authors rightly avoid claiming that this pathway is exclusive to VSGs, but I wonder if these data could provide insight into the other biological processes that might be controlled by this signaling pathway in T. brucei.

      We published that the inositol phosphate pathway also plays a role in T. brucei development (Cestari et al. 2018, Mol Biol Cell; reviewed by Cestari I 2020, PLOS Pathogens)

      Overall, this is an excellent study which represents an important step forward in understanding how antigenic variation is controlled in T. brucei. The possibility that this process could be controlled via a signalling pathway has been speculated for a long time, and this study provides the first mechanistic evidence for that possibility.

      Reviewer #1 (Recommendations For The Authors):

      Please see the public review for recommendations.1. It is critical to clearly state whether the observations are made for the endogenous WT protein or the tagged protein. It is good that the authors currently clearly indicate the results observed in vivo are for the RAP1-HA protein. However, this is not as clearly stated for in vitro EMSA analyses. In addition, in discussion, the authors simply assumed that the c-terminally tagged RAP1 behaves the same as WT RAP1 and all conclusions were made about WT RAP1.

      There are two choices here. The authors can validate that RAP1-HA still retains RAP1's essential function as a sole allele in T. brucei cells (as was recommended previously). Indeed, HA-tagged RAP1 has been studied before, but it is the N-terminally HA-tagged RAP1 that has been shown to retain its essential functions. Adding the HA tag to the C-terminus of RAP1 may well cause certain defects to RAP1. For example, N-terminally HA-tagged TERT does not complement the telomere shortening phenotype in TERT null T. brucei cells, while C-terminally GFP-tagged TERT does, indicating that HA-TERT is not fully functional while TERT-GFP likely has its essential functions (Dreesen, RU thesis). Although RAP1-HA behaves similar to WT RAP1 in many ways, it is still not fully validated that this protein retains essential functions of RAP1. By the way, it has been published that cells lacking one allele of RAP1 behaves as WT cells for cell growth and VSG silencing (Yang et al. 2009, Cell; Afrin et al. 2020, mSphere). In addition, although RAP1 may interact with TRF weakly, the interaction is direct, as shown in yeast 2-hybrid analysis in (Yang et al. 2009, Cell).

      Alternatively, if the authors do not wish to validate the functionality of RAP1-HA, they need to add one paragraph at the beginning of the discussion to clearly state that RAP1-HA may not behave exactly as WT RAP1. This is important for readers to better interpret the results. In addition, the authors need to tune down the current conclusions dramatically, as all described observations are made on RAP1-HA but not the WT RAP1.

      The results with RAP1-HA are consistent with previous knowledge of RAP1 interactions with telomeric proteins and DNA. Hence, the C-terminal HA-tagged RAP1 seems, by all measures, functional. Nevertheless, to make it clear for the reader, we added a note in the discussion, lines 244-246: “Although we showed that C-terminal HA-tagged RAP1 protein has telomeric localization (Cestari et al. 2015, PNAS) and interactions with other telomeric proteins (Cestari et al. 2019 Mol Cell Biol); we cannot rule out potential differences between HA-tagged and non tagged RAP1.”

      For a similar reason, the current EMSA results truly reflect how C-terminally His6-tagged RAP1 and RAP1 fragments behave. If the authors choose not to remove the His6 tag, it is essential that they use "RAP1-His6" to refer to these recombinant proteins. It is also essential for the authors to clearly state in the discussion that the tagged RAP1 fragments bind DNA, but the current data do not reveal whether WT RAP1 binds DNA. In addition, the authors incorrectly stated that "disruption of the MybL domain sequence did not eliminate RAP1-telomere binding in vivo" (lines 165-166). In ref 29, deletion of Myb domain did not abolish RAP1-telomere association. However, point mutations in MybL domain that abolish RAP1's DNA binding activities clearly disrupted RAP1's association with the telomere chromatin. Therefore, the current observation is not completely consistent with that published in ref 29.

      We stated in lines 149-150 “…we expressed and purified from E. coli recombinant 6xHistagged T. brucei RAP1 (rRAP1)”. To clarify to the authors, we replaced rRAP1 with rRAP1-His throughout the manuscript text. As for the statement that “disruption of the MybL domain sequence did not eliminate RAP1telomere binding in vivo" (lines 165-166).”. We removed the statement from the manuscript.

      2) There is no evidence, in vitro or in vivo, that binding PI(3,4,5)P3 to RAP1 causes conformational change in RAP1. The BRCT domain of RAP1 is known for its ability to homodimerize (Afrin et al. 2020, mSphere). It is therefore possible that binding of PI(3,4,5)P3 to RAP1 simply disrupts its homodimerization function. The authors clearly have extrapolated their conclusions based on available data. It is therefore important to revise the discussion and make appropriate statements.

      We did not state that PI(3,4,5)P3 causes RAP1 conformational changes. We discussed the possibility. We stated in lines 199-201: “PI(3,4,5)P3 inhibition of RAP1-DNA binding might be due to its association with RAP1 N-terminus causing conformational changes that affect Myb and MybL domains association with DNA.” This is a reasonable discussion, given the data presented in the manuscript.

    1. Author Response

      The following is the authors’ response to the original reviews.

      We greatly appreciate the valuable and constructive review of our manuscript. The reviewers’ comments have helped us to improve the quality of the paper. Here we provide detailed responses to the reviewers’ comments and discuss the new experiments we performed.

      Reviewer #1

      Summary:

      In this study, the authors generate a Drosophila model to assess disease-linked allelic variants in the UBA5 gene. In humans, variants in UBA5 have been associated with DEE44, characterized by developmental delay, seizures, and encephalopathy. Here, the authors set out to characterize the relationship between 12 disease-linked variants in UBA5 using a variety of assays in their Drosophila Uba5 model. They first show that human UBA5 can substitute all essential functions of the Drosophila Uba5 ortholog, and then assess phenotypes in flies expressing the various disease variants. Using these assays, the authors classify the alleles into mild, intermediate, and severe loss-of-function alleles. Further, the authors establish several important in vitro assays to determine the impacts of the disease alleles on Uba5 stability and function. Together, they find a relatively close correlation between in vivo and in vitro relationships between Uba5 alleles and establish a new Drosophila model to probe the etiology of Uba5-related disorders.

      Strengths:

      Overall, this is a convincing and well-executed study. There is clearly a need to assess disease-associated allelic variants to better understand human disorders, particularly for rare diseases, and this humanized fly model of Uba5 is a powerful system to rapidly evaluate variants and relationships to various phenotypes. The manuscript is well written, and the experiments are appropriately controlled.

      Recommendations For The Authors:

      1) It would seem of value to determine what tissue(s) the essential function of Uba5 resides. The authors nicely detail the expression of Uba5 in a subset of neurons and glia, and indicate it is expressed in a variety of other tissues. Null mutants are embryonic lethal, suggesting an essential function. From the mouse study cited, it appears Uba5 functions early in development in the hematopoietic system. The authors can express their UAS-Uba5 rescue construct using a variety of tissue-specific Gal4 lines to determine whether the essential function of Uba5 is in the nervous system or other tissues, which would be of interest in understanding key functions of Uba5.

      We thank the reviewer for the suggestion. We tried to rescue the lethality of the Uba5 mutants by expressing human UBA5 reference protein in different tissues. We found that ubiquitous expression of UBA5 (da-GAL4 or act-GAL4) successfully rescues the lethality, however, expression of UBA5 in neurons (elav-GAL4), glia (repo-GAL4), or both neurons and glia does not. In addition, expression of UBA5 in fat body (SPARC-GAL4) or muscles (Mef2-GAL4) does not rescue the lethality either. These results suggest that Uba5 is required in multiple tissues in flies. These data are included in the revised manuscript.

      2). Do intermediate Uba5 alleles impact synaptic function or growth? The etiology of the disease is linked with epilepsy and neurodevelopmental disorders, and the interesting parallels the authors note between Uba5 and Para expression indicate perhaps shared roles in neurons that drive firing activity. Together, these lines of evidence may suggest the Uba5 alleles may have possible impacts on synaptic growth, morphology, and/or function. It would be of interest to examine the larval neuromuscular junction and assess NMJ growth, morphology, and perform some basic electrophysiology to determine if there are any functional defects.

      Following the reviewer’s suggestion, we tested the morphology of NMJs in the humanized flies. We did not observe any obvious changes in the number or size of the synaptic boutons caused by the Group II variants. Hence, we conclude that the Uba5 variants do not cause an obvious defect in synaptic growth. The results are included in the Figure S3.

      More generally, can the authors comment on the expression pattern of Uba5? One might consider something like Uba5 to be a "housekeeping" gene and expressed/required in most if not all cell types. From the data presented in Fig. 2, it appears expression is more sparse, perhaps, as the authors point out, because of roles in mature neurons that actively fire (like Para). Are neuronal targets of Uba5 known, which might suggest key pathways it modulates?

      We showed that Uba5 is broadly expressed in third instar larvae. FlyAtlas2 and FlyCellAtlas datasets show that Uba5 is broadly expressed but not in all the cells. In the larval CNS and adult brain, Uba5 is not expressed in all cells either. Hence, we cannot say Uba5 is a “housekeeping” gene. Regarding the neuronal targets of Uba5, we do not know which types of neurons express Uba5 and which pathways Uba5 modulates. This could be studied in the future.

      3) Does strong overexpression of the various Uba5 alleles in otherwise wild-type flies cause any phenotypes? This might support possible antimorphic/dominant negative functions of some of the variants. Is it plausible that any of the alleles could impact oligomerization of Uba5?

      We have not observed compromised viability or any obvious phenotype in flies overexpressing human reference UBA5 or UBA5 variants. So, our results do not support a dominant negative effect of any of the variants.

      To our knowledge, people do not have sufficient knowledge on UBA5 dimerization to speculate on whether some variants could play a dominant negative role. There is one variant, V260M, that lies at the dimer interface. We showed that the V260M variant biochemically affects ATP binding as well as UFM1 activation, but we do not have evidence to support that it causes dominant negative effects by affecting UBA5 dimerization.

      Minor points:

      1) Page 5 line 45: It seems a reference is missing about the temperature dependence of Gal4 activity.

      We apologize for the missing reference. We have incorporated a reference to PMID 25824290.

      2) It might be of interest to assay the various transgenic rescue alleles at a higher temperature (say 29C) in addition to the nice work looking at 18/25C survival. Perhaps some of the alleles display temperature sensitivity at low (18) and high (29) temperatures.

      We now include the survival rate data at 29C. The enzyme dead and severe LoF variants fail to rescue the lethality at 29C, while the mild (Group IA and IB) variants fully rescue. For the three Group II variants, the survival rate at 29C is higher than that at 25C and 18C. The results support the dosage sensitive effects of UBA5 overexpression, but do not support any variant to be temperature sensitive within this range.

      Reviewer #2

      Relative simplicity and genetic accessibility of the fly brain make it a premier model system for studying the function of genes linked to various diseases in humans. Here, Pan et al. show that human UBA5, whose mutations cause developmental and epileptic encephalopathy, can functionally replace the fly homolog Uba5. The authors then systematically express in flies the different versions of the gene carrying clinically relevant SNPs and perform extensive phenotypic characterization such as survival rate, developmental timing, lifespan, locomotor and seizure activity, as well as in vitro biochemical characterization (stability, ATP binding, UFM-1 activation) of the corresponding recombinant proteins. The biochemical effects are well predicted by (or at least consistent with) the location of affected amino acids in the previously described Uba5 protein structure. Most strikingly, the severity of biochemical defects appears to closely track the severity of phenotypic defects observed in vivo in flies. While the paper does not provide many novel insights into the function of Uba5, it convincingly establishes the fly nervous system as a powerful model for future mechanistic studies.

      One potential limitation is the design of the expression system in this work. Even though the authors state that "human cDNA is expressed under the control of the endogenous Uba5 enhancer and promoter", it is in fact the Gal4 gene that is expressed from the endogenous locus, meaning that the cDNA expression level would inevitably be amplified in comparison. The fact that different effects were observed when some experiments were performed at different temperatures (18 vs. 25) is also consistent with this. While I do not think this caveat weakens the conclusions of this paper, it may impact the interpretation of future experiments that use these tools, and thus should be clearly discussed in the paper. Especially considering the authors argue that most disease variants of UBA5 are partial loss-of-functions, the amplification effect could potentially mask the phenotypes of milder hypomorphic alleles. If the authors could also show that the T2A-Gal4 expression pattern in the brain matches well with that of endogenous RNA or protein (e.g. using HCR-FISH or antibody), it would help to alleviate this concern.

      We thank the reviewer for pointing out the issue.

      Regarding the humanization strategy we used in the study, we agree that this is a binary system which could induce overexpression of the target protein. However, as the reviewer also points out, this temperature sensitive system also enables us to flexibly adjust the expression level of the target protein (PMIDs 34113007, 35348658, 36206744), which is especially useful to study partial LoF variants. In our study we have successfully compared the relevant allelic strength of most of the variants.

      We agree with the reviewer that a masking effect may exist in our system due to its gene overexpression nature. However, we cannot conclude that this masking effect really affects the three Group IA variants in our tests. The three variants are mild LoF, which is supported by our biochemical assays. Individuals homozygous for one of the Group IA variants, p.A371T, do not have any obvious phenotype, which is also consistent with our findings in flies.

      Regarding the expression pattern of the T2A-GAL4, the Bellen lab has generated T2A-GAL4 lines for more than 3,000 genes. The expression pattern of many GAL4 lines faithfully reflect the expression pattern of the endogenous genes, which has been shown in our previous publications (PMIDs 25824290, 29565247, 31674908).

      Recommendations For The Authors:

      As related to the expression pattern comment in the public review, I think the authors could also take advantage of Fly Cell Atlas or other available scRNA-seq atlases of the fly brain to present a much more detailed description of the Uba5 expression profile with minimal additional effort. If the cells that express it share other features or genes (other than the para that the authors mention), this could lead to further insights about the gene's neuronal or glial functions.

      In response to the reviewer, we show the expression pattern of Uba5 documented in FlyCellAtlas and another adult brain single-cell RNA seq profile (PMID 29909982) in the revised manuscript.

      In addition, one of the mutants (assuming the same one) is referred to as Leu254Pro in some parts of the manuscript while in some other parts (including tables 1-2) it is Lys254Pro.

      We apologize for the mistakes. The variant should be Leu254Pro and we have made these corrections in the revised manuscript.

      Reviewer #3

      Summary:

      Variants in the UBA5 gene are associated with rare developmental and epileptic encephalopathy, DEE44. This research developed a system to assess in vivo and in vitro genotype-phenotype relationships between UBA5 allele series by humanized UBA5 fly models and biochemical activity assays. This study provides a basis for evaluating current and future individuals afflicted with this rare disease.

      Strengths:

      The authors developed a method to measure the enzymatic reaction activity of UBA5 mutants over time by applying the UbiReal method, which can monitor each reaction step of ubiquitination in real time using fluorescence polarization. They also classified fruit fly carrying humanized UBA5 variants into groups based on phenotype. They found a correlation between biochemical UBA5 activity and phenotype severity.

      Weaknesses:

      In the case of human DEE44, compound heterozygotes with both loss-of-function and hypomorphic forms (e.g., p.Ala371Thr, p.Asp389Gly, p.Asp389Tyr) may cause disease states. The presented models have failed to evaluate such cases.

      We agree with the reviewer that our current system has a limitation that it evaluates one variant at a time rather than any combination of variants. However, our biochemical data do show that the three Group IA variants are mild LoF variants rather than benign variants. One of these variants, p.A371T, does not cause any obvious phenotype in homozygous individuals, which is also consistent with our findings in flies. The modeling of variant combinations, especially the Group IA/Group III combinations could be carried out in future studies.

      Recommendations For The Authors:

      Figure 3G. Typo. "ContonS" should be replaced by "CantonS."

      We apologize for the spelling mistake. We correct the typo in the revised manuscript.

      Figure 5. The labels should be in uppercase instead of lowercase.

      We correct the panel labels in the revised manuscript.

      Figure 6A. Is the molecular weight of UBA5~UFM1 intermediate (99 kDa) in model Figure correct? In Fig. 6B, the molecular weight of UBA5~UFM1 intermediate seems to be 70-75 kDa.

      Both are correct. The molecular weight depicted in the schematic of Figure 6A is based on the UBA5 dimer, which dissociates in the SDS-PAGE gel shown in Figure 6B. We have reconfigured the schematic to make this more apparent.

      Figure. 6E, F, H, and I. The time points for quantification in these figures should be specified.

      We apologize for the confusion. The details on data quantification are now more thoroughly explained in the Methods.

    1. Author Response

      The following is the authors’ response to the original reviews.

      Reviewer #1:

      In this manuscript, the authors investigate differences between Tibetans and Han Chinese at altitude in terms of placental transcriptomes during full-term pregnancy. Most importantly, they found that the inter-population differentiation is mostly male-specific and the observed direction of transcriptional differentiation seems to be adaptive at high altitude. In general, it is of great importance and provides new insights into the functional basis of Tibetan high-altitude adaptations, which so far have been mostly studied via population genetic measures only. More specifically, I firmly believe that we need more phenotype data (including molecular phenotypes such as gene expression data) to fully understand Tibetan adaptations to high altitude, and this manuscript is a rare example of such a study. I have a few suggestions and/or questions with which I hope to improve the manuscript further, especially in terms of 1) testing if the observed DEG patterns are truly adaptive, and 2) how and whether the findings in this study can be linked to EPAS1 and EGLN1, the signature adaptation genes in Tibetans.

      We appreciate the reviewer’s constructive comments. We have addressed these points and the details are discussed below.

      Major Comments:

      1) The DEG analysis is the most central result in this manuscript, but the discrepancy between sex-combined and sex-specific DEGs is quite mind-boggling. For those that were differentially expressed in the sex-specific sets but not in the sex-combined one, the authors suggest an opposite direction of DE as an explanation (page 11, Figure S5). But Figure S5A does not show such a trend, showing that down-regulated genes in males are mostly not at all differentially expressed in females. Figure S5B does show such a trend, but it doesn't seem to be a dominant explanation. I would like to recommend the authors test alternative ways of analysis to boost statistical power for DEG detection other than simply splitting data into males and females and performing analysis in each subset. For example, the authors may consider utilizing gene-by-environment interaction analysis schemes here biological sex as an environmental factor.

      We agree with reviewer that the opposite direction of DEGs is likely only one of the possible explanations for the discrepancy between the sex-combined and the sex-specific DEGs. We have toned down the description of this point in the revised manuscripts.

      Following the suggestion of reviewer, we performed a ANCOVA analysis to evaluate the variance explained by sex from the expression data. For each gene, univariate comparisons of the average of gene expression between Tibetans and Han Chinese were made by using the ANCOVA test in R aov function with sex as covariates: aov (Expression ~ Ethnicity + Fetal sex). We observed a significantly higher variance explained by sex than by ethnicity in six layers of the placenta (except for the CN layer) (Author response image 1). For example, in the UC layer, fetal sex can explain ~0.203 variance, while the ethnicity explains ~0.107 variance (P-value = 4.9e-4). These results suggest a significant contribution of fetal sex for the observed variance of gene expression, consist with the observed sex-biased DEG patterns.

      Author response image 1.

      The ANCOVA results of the seven layers of placenta. The scatter plot shows the comparison of the explained variance (y-axis) and significance (x-axis, denoted by –log10(P-value)) between ethnicity (dots in red) and fetal sex (dots in blue). Each dot represents an investigated gene, and only genes with P<0.05 in significance are shown in the plots. The table is the summary statistics of the ANCOVA analysis.

      2) Please clarify how the authors handled multiple testing correction of p-values.

      There were three analyses involving multiple testing in this study: 1) for the differential expression analysis, we obtained the multiple corrected p-values by Benjamini-Hochberg FDR (false discovery rate) procedure; 2) for the GO enrichment analysis, we calculated the FDR-adjusted q-values from the overall p-values to correct for multiple testing.

      3) for the WGCNA analysis, considering the 12 traits were involved, including population, birth weight (BW), biparietal diameter (BPD), femur length (FL), gestation time (GT), placental weight (PW), placental volume (PLV), abdominal girth (AG), amniotic fluid maximcon depth (AFMD), amniotic fluid (AFI), fetal heart rate (FH) and fundal height (FUH). We calculated a Bonferroni threshold (p-value = 0.05/the number of independent traits) using the correlation matrix of the traits to evaluate the significant modules. We estimated the number of independent traits among the 12 investigated traits was 4 (Author response image 2). Therefore, we used a more stringent significant threshold p-value = 0.0125 (0.05/4) as the final threshold to correct the multiple testing brought by multiple traits in our WGCNA analyses. We have updated this section based on the new threshold.

      Author response image 2.

      The correlation matrix of 12 traits involved in the WGCNA analysis. The correlation coefficients larger than 0.2 (or smaller than -0.2) are regarded as significant correlation and marked in gradient colors.

      3) The "natural selection acts on the placental DEGs ..." section is potentially misleading readers to assume that the manuscript reports evidence for positive selection on the observed DEG pattern between Tibetans and Han, which is not.

      a) Currently the section simply describes an overlap between DEGs and a set of 192 genes likely under positive selection in Tibetans (TSNGs). The overlap is quite small, leading to only 13 genes in total (Figure 6). The authors are currently not providing any statistical measure of whether this overlap is significantly enriched or at the level expected for random sampling.

      We understand the reviewer’s point that the observed gene counts overlapped between DEGs from the three sets (4 for female + male; 9 for male only and 0 for female only) with TSNGs should be tested using a statistical method. Therefore, we adopted permutation approach to evaluate the enrichment of the overlapped DEGs with TSNGs.

      For each permutation, we randomly extracted 192 genes from the human genome, then overlapped with DEGs of the three sets (female + male; female only and male only) and counted the gene numbers. After 10,000 permutations, we constructed a null distribution for each set, and found that the overlaps between DEGs and TSNGs were significantly enriched in the “female + male” set (p-value = 0.048) and the “male only” set (p-value = 9e-4), but not in the “female only” set (p-value = 0.1158) (Author response image 3). This result suggests that the observed DEGs are significantly enriched in TSNGs when compared to random sampling, especially for the male DEGs. We added this analysis in the revised manuscript.

      Author response image 3.

      The distribution of 10,000 permutation tests of counts of the overlapped genes between DEGs and the 192 randomly selected genes in the genome. The red-dashed lines indicate the observed values based on the 192 TSNGs.

      b) The authors are describing sets of DEGs that seem to affect important phenotypic changes in a consistent and adaptive direction. A relevant form of natural selection for this situation may be polygenic adaptation while the authors only consider strong positive selection at a single variant/gene level.

      We agree with reviewer that polygenic adaptation might be a potential mechanism for DEGs to take effect on the adaptive phenotypes. Therefore, following the suggestion in the comment below, we conducted a polygenic adaptation analysis using eQTL information.

      c) The manuscript is currently providing no eQTL information that can explain the differential expression of key genes. The authors can actually do this based on the genotype and expression data of the individuals in this study. Combining eQTL info, they can set up a test for polygenic adaptation (e.g., Berg and Coop; https://journals.plos.org/plosgenetics/article?id=10.1371/journal.pgen.1004412). This will provide a powerful and direct test for the adaptiveness of the observed DEG pattern.

      Following the reviewer’s suggestion, we employed the PolyGraph (Racimo et al., 2018) tool to identify the signatures of polygenic selection in Tibetans using eQTL information. We conducted eQTL analysis for the seven layers, and collected a set of 5,251 eQTLs, covering the SNPs associated with gene expression with a significanct p-value < 5e-8. To obtain a list of independent eQTLs, we removed those SNPs in linkage disequilibrium (r2 > 0.2 in 1000 Genome Project). Finally, we obtained 176 independent eQTLs. At the same time, we generated a set of 1,308,436 independent SNPs of Tibetans as the control panel. The PolyGraph result showed that Tibetans have a clear signature of polygenic selection on gene expression (Bonferroni-correction p-value = 0.003) (Author response image 4).

      We have added this result in the revised manuscript (Figure S4), and added a detailed description of polygenic adaption in the Methods section.

      Author response image 4.

      Polygraphs for the eQTLs that show evidence for polygenic adaptation in the five-leaf tree built using the allele frequency data of 1001 Tibetans (Zheng et al. 2023) and 1000 Genome Project. The colors indicate the marginal posterior mean estimate of the selection parameter for variants associated with the gene expression. r, q, s and v in the tree nodes refer to the nodes in terminal branches and internal branches. TBN, Tibetans; CHB, Han Chinese in Beijing; JPT, Japanese in Tokyo, Japan; CEU, Northern Europeans from Utah; YRI, Yoruba in Ibadan, Nigeria.

      4) The manuscript is currently only minimally discussing how findings are linked to EPAS1 and EGLN1 genes, which show the hallmark signature of positive selection in Tibetans. In fact, the authors' group previously reported male-specific association between EPAS1 SNPs and blood hemoglobin level. Many readers will be intrigued to see a discussion about this point.

      According to the reviewer’s suggestion, in the revised manuscript, we added a paragraph to discuss the relationship between our transcriptomic data and the two genes with strong selective signals, i.e. EPAS1 and EGLN1.

      “As the gene with the strongest signal of natural selection in Tibetans, EPAS1 has been reported in numerus studies on its contribution to high altitude adaptation. In this study, we detected a significant expression reduction of EPAS1 in the Tibetan UC compared to the high-altitude Han. It was reported that the selected-for EPAS1 variants/haplotype were associated with lower hemoglobin levels in the Tibetan highlanders with a major effect (Beall et al., 2010; Peng et al., 2017), and the low hemoglobin concentration of Tibetans is causally associated with a better reproductive success (Cho et al., 2017). Therefore, we speculate that the selective pressure on EPAS1 is likely through its effect on hemoglobin, rather than directly on the reproductive traits. The down-regulation of EPAS1 in placentas likely reflects a blunted hypoxic response that may improve vasodilation of UC for better blood flow, and eventually leading to the higher BW in Tibetans (He et al., 2023). For EGLN1, another well-known gene in Tibetans, we detected between-population expression difference in the male UC layer, but not in other placental layers. Considering the known adaptation mechanism of EGLN1 is attributed to the two Tibetan-enriched missense mutations, the contribution of EGLN1 to the gene expression changes in the Tibetan UC is unexpected and worth to be explored in the future.”

      Reviewer #2 (Public Review):

      In this manuscript, the authors use newly-generated, large-scale transcriptomic data along with histological data to attempt to dissect the mechanisms by which individuals with Tibetan ancestry are able to mitigate the negative effects of high elevation on birth weight. They present detailed analyses of the transcriptomic data and find significant sex differences in the placenta transcriptome.

      I have significant concerns about the conclusions that are presented. The analyses also lack the information necessary to evaluate their reliability.

      The experimental design does not include a low elevation comparison and thus cannot be used to answer questions about how ancestry influences hypoxia responses and thus birthweight at high elevations. Importantly, because the placenta tissues (and trophoblasts specifically) are quickly evolving, there are a priori good reasons to expect to find population differences irrespective of adaptive evolution that might contribute to fetal growth protection. There are also significant details missing in the analyses that are necessary to substantiate and replicate the analyses presented.

      Although the datasets are ultimately valuable as reference sets, the absence of low elevation comparisons for Tibetans and Han Chinese individuals undermines the ability of the authors to assess whether differences observed between populations are linked to hypoxia responses or variation in the outcomes of interest (i.e., hypoxia-dependent fetal growth restriction).

      We understand the reviewer’s concern about the lack of low-altitude comparison. For the placenta transcriptomic data, actually, we previously studied the comparison of placenta from high-altitude Tibetans and low-altitude Han Chinese, including 63 placentas of Tibetans living at Lhasa (elevation: 3650m) and 14 placentas of Han in Kunming (elevation: 1800m) (Peng et al. 2017). The main finding was that in general, the expression profiles are similar between the high-altitude Tibetans and the low-altitude Han. In particular, most high-altitude Tibetans have a similar level of EPAS1 expression in the placenta as the lowlander Han Chinese, a reflection of Tibetans’ adaptation at altitude. In other words, (Peng et al. 2017). In this study, we observed a significant down-regulation of EPAS1 in the Tibetan UC when compared to Han Chinese living at the same high altitude. Therefore, the observed differences between Tibetans and Han Chinese placenta at high altitude are due to the adaptation of Tibetans.

      For phenotypic data, we made a systematical comparison of reproductive outcomes in our previous studies (He et al., 2023; He et al., 2022). We proved that polygenic adaptation of reproduction in Tibetans tends to reduce the chance of preterm birth and eliminate the restriction on fetal development at high altitude. Compared to the high-altitude Han Chinese migrants, the high-altitude Tibetans exhibit a less birth weight reduction and infant mortality induced by hypoxia, similar with the lowland Han Chinese as reference.

      In summary, although we cannot make combination analysis with our high-altitude data and the published low-altitude data because of batch effect and difference of sampling strategy, we obtained more supportive evidence for the adaptation of placenta expression regulation in Tibetans. To be objective, we have discussed the limitation of the lack of lowlander placenta data in the Discussion section.

      The authors attempt to tackle this phenotypic association by looking for correlations between gene networks (WGCNA) and individual genes with birthweight and other measurements collected at birth. I have some reservations about this approach with only two groups (i.e., missing the lowland comparison), but it is further problematic that the authors do not present data demonstrating that there are differences in birthweight or any other traits between the populations in the samples they collected.

      Throughout, I thus find conclusions about the adaptive value and hypoxia-responses made by the authors to be unsubstantiated and/or the data to be inadequate. There are also a gratuitous number of speculative statements about mechanisms by which differential gene expression leads to the protection of birthweight that are not evaluated and thus cannot be substantiated by the data presented.

      As currently presented and discussed, these results thus can only be used to evaluate population differences and tissue-specific variation therein.

      We understand the reviewer’s point that the observed differences of gene expression between Tibetan natives and Han immigrants living at high altitude might be explained by ancestral divergence, rather than hypoxia-associated response and genetic adaptation of native Tibetans.

      Firstly, we conclude that Tibetans have a better reproductive outcome, not only based on the two highlander groups living at the same altitude, but also relied on the change direction compared to the lowland level. For example, we observed a significant higher BW in Tibetans than Han migrants in our dataset (35 Tibetans vs. 34 Han: p-value = 0.012) (Author response image 5), and in a larger dataset (He et al. 2023) (1,317 Tibetans vs. 87 Han: p-value = 1.1e-6), suggesting an adaptation of Tibetans because BW decreases with the increase of altitude. The logic was the same to the other traits. Following the suggestion of reviewer, we added these phenotype comparisons in the revised manuscripts. The detailed information of the investigated samples and the statistic results were also added as supplementary tables in the revised version.

      For the WGCNA, we agree with the reviewer that the detected modules both showing significant correlation with population and other reproductive traits cannot be fully explained by adaptation of Tibetans. Therefore, we tuned down the description of this section and added other possible explanations, such as population differences, in the discussion.

      Author response image 5.

      Comparison of 11 reproductive traits between Tibetans and Han immigrants. (A) comparison based on the dataset of this study (35 Tibetans vs. 34 Han); (B) correlation between BW and altitude (left panel) and comparison analysis based on the larger sample size (the data were retrieved from (He et al., 2023)). Univariate comparisons of the average of each trait cross population were made by using the ANCOVA test in R aov function with fetal sex and maternal age as covariates.

      There is also some important methodological information missing that makes it difficult or impossible to assess the quality of the underlying data and/or reproduce the analyses, further limiting the potential impact of these data:

      1) Transcriptome data processing and analyses: RNA quality information is not mentioned (i.e., RIN). What # of reads are mapped to annotated regions? How many genes were expressed in each tissue (important for contextualizing the # of DE genes reported - are these a significant proportion of expressed genes or just a small subset?).

      According to the reviewer’s suggestion, we added more information about transcriptome data processing and analyses in the revised Methods and Results:

      “After RNA extraction, we assessed the RNA integrity and purity using 1% agarose gel electrophoresis. The RIN value of extracted RNA was 7.56 ± 0.71.”

      “In total, 10.6 billion reads were mapped to the annotated regions, and 17,283 genes express in all the investigated placenta.”

      “We identified 579 differentially expressed genes (DEGs) between Tibetans and Han, accounting for 3.4% of the total number of expressed genes.”

      2) The methods suggest that DE analyses were run using data that were normalized prior to reading them into DESeq2. DESeq2 has an internal normalization process and should not be used on data that was already normalized. Please clarify how and when normalization was performed.

      Actually, we made raw read count matrix as input file when conducting differential analysis using DESeq2, rather than using the normalized data. We have updated our description in the method section of the revised manuscript.

      3) For enrichment analyses, the background gene set (all expressed genes? all genes in the genome? or only genes expressed in the tissue of interest?) has deterministic effects on the outcomes. The background sets are not specified for any analyses.

      Actually, we utilized the genes expressed in placenta as the background gene set for enrichment analyses. The genes with more than two transcripts per million transcripts (TPM) were regarded as an expressed gene, which is commonly used criteria for RNA-seq data.

      4) In the WGCNA analysis, P-values for correlations of modules with phenotype data (birthweight etc.) should be corrected for multiple testing (i.e., running the module correlation for each outcome variables) and p.adjust used to evaluate associations to limit false positives given the large number of correlations being run.

      As we explained in response to comment#2 of Reviwer-1, we used a more stringent significant threshold of p-value = 0.0125 (0.05/4) as the final threshold to correct the multiple testing brought by multiple traits in the WGCNA analysis.

      5) The plots for umbilical histological data (Fig 5 C) contain more than 5 points, but the use of replicate sections is not specified. If replicate sections were used, the authors should control for non-independence of replicate sections in their analyses (i.e., random effects model).

      We did not use replicate sections. Figure 5C shows the umbilical artery intima and media. Because each human umbilical cord includes two umbilical arteries, the 5 vs. 5 individual comparison generates 10 vs. 10 umbilical artery comparison. To be clearer, we added an explanation in the revised manuscript.

      On more minor notes:

      There is significant and relevant published data on sex differences and hypoxia in rodents (see Cuffe et al 2014, "Mid- to late-term hypoxia in the mouse alters placental morphology, glucocorticoid regulatory pathways, and nutrient transporters in a sex-specific manner" and review by Siragher and Sferuzzi-Perro 2021, "Placental hypoxia: What have we learnt from small animal models?"), and historical work reporting sex differences in placental traits associated with high elevation adaptation in Andeans (series of publications by Moira Jackson in the late 1980s, reviewed in Wilsterman and Cheviron 2021, "Fetal growth, high altitude, and evolutionary adaptation: A new perspective").

      We thank the reviewer for the constructive comments on literature review. We have cited and discussed them in the revised manuscript.

      Reviewer #3 (Public Review):

      More than 80 million people live at high altitude. This impacts health outcomes, including those related to pregnancy. Longer-lived populations at high altitudes, such as the Tibetan and Andean populations show partial protection against the negative health effects of high altitude. The paper by Yue sought to determine the mechanisms by which the placenta of Tibetans may have adapted to minimise the negative effect of high altitude on fetal growth outcomes. It compared placentas from pregnancies from Tibetans to those from the Han Chinese. It employed RNAseq profiling of different regions of the placenta and fetal membranes, with some follow-up of histological changes in umbilical cord structure and placental structure. The study also explored the contribution of fetal sex in these phenotypic outcomes.

      A key strength of the study is the large sample sizes for the RNAseq analysis, the analysis of different parts of the placenta and fetal membranes, and the assessment of fetal sex differences.

      A main weakness is that this study, and its conclusions, largely rely on transcriptomic changes informed by RNAseq. Changes in genes and pathways identified through bioinformatic analysis were not verified by alternate methods, such as by western blotting, which would add weight to the strength of the data and its interpretations. There is also a lack of description of patient characteristics, so the reader is unable to make their own judgments on how placental changes may link to pregnancy outcomes. Another weakness is that the histological analyses were performed on n=5 per group and were rudimentary in nature.

      For the weakness raised by the reviewer, here are our responses:

      (1) Considering that our conclusions largely rely on the transcriptomic data, we agree with reviewer that more experiments are needed to validate the results from our transcriptomic data. However, this study was mainly aimed to provide a transcriptomic landscape of high-altitude placenta, and to characterize the gene-expression difference between native Tibetans and Han migrants. The molecular mechanism exploration is not the main task of this study, and more validation experiments are warranted in the future.

      (2) For the lack of description of patient characteristics, actually, we provided three level results on the placental changes of Tibetans: macroscopic phenotypes (higher placental weight and volume), histological phenotypes (larger umbilical vein walls and umbilical artery intima and media; lower syncytial knots/villi ratios) and transcriptomic phenotypes (DEG and differential modules). Combined with the previous studies, these placenta changes suggest a better reproductive outcome. For example, the placenta volume shows a significantly positive correlation with birth weight (R = 0.31, p-value = 2.5e-16), therefore, the larger placenta volume of Tibetans is beneficial to fetal development at high altitude. In addition, the larger umbilical vein wall and umbilical artery intima and media of Tibetans can explain their adaptation in preventing preeclampsia.

      (3) For the sample size of histological analyses, we understand the reviewer’s concern that 5 vs. 5 samples are not large in histological analyses. This is because it was difficult to collect high-altitude Han placenta samples, and we only got 13 Han samples, from which we selected 5 infant sex matched samples.

      References

      Beall, C.M., Cavalleri, G.L., Deng, L.B., Elston, R.C., Gao, Y., Knight, J., Li, C.H., Li, J.C., Liang, Y., McCormack, M., et al. (2010). Natural selection on EPAS1 (HIF2 alpha) associated with low hemoglobin concentration in Tibetan highlanders. P Natl Acad Sci USA 107, 11459-11464.

      Cho, J.I., Basnyat, B., Jeong, C., Di Rienzo, A., Childs, G., Craig, S.R., Sun, J., and Beall, C.M. (2017). Ethnically Tibetan women in Nepal with low hemoglobin concentration have better reproductive outcomes. Evol Med Public Health 2017, 82-96. He, Y., Guo, Y., Zheng, W., Yue, T., Zhang, H., Wang, B., Feng, Z., Ouzhuluobu, Cui, C., Liu, K., et al. (2023). Polygenic adaptation leads to a higher reproductive fitness of native Tibetans at high altitude. Curr Biol.

      He, Y., Li, J., Yue, T., Zheng, W., Guo, Y., Zhang, H., Chen, L., Li, C., Li, H., Cui, C., et al. (2022). Seasonality and Sex-Biased Fluctuation of Birth Weight in Tibetan Populations. Phenomics 2, 64-71.

      Peng, Y., Cui, C., He, Y., Ouzhuluobu, Zhang, H., Yang, D., Zhang, Q., Bianbazhuoma, Yang, L., He, Y., et al. (2017). Down-Regulation of EPAS1 Transcription and Genetic Adaptation of Tibetans to High-Altitude Hypoxia. Mol Biol Evol 34, 818-830.

      Racimo, F., Berg, J.J., and Pickrell, J.K. (2018). Detecting Polygenic Adaptation in Admixture Graphs. Genetics 208, 1565-1584.

    1. Author Response

      We thank the reviewers and editorial team for their positive and thoughtful comments and recommendations for our paper. We will provide a detailed point-to-point response accompanying a revised version of our paper to carefully incorporate all the recommendations and clarify several confusing points. Here we provide a brief provisional response to summarize the key points.

      1) Are the two factors in the enslavement patterns after stroke, changes in shape (loss of complexity) and magnitude (intrusion of flexor bias), dissociable? Our results show both a loss of shape (Fig. 5) and an increase of magnitude (Fig. 7) in enslavement patterns in the paretic hand. We agree with the reviewers that the key measures for these two factors, Angular (Cosine) and Euclidean Distances, are not mathematically orthogonal because, while Angular Distance is indeed only influenced by shape, Euclidean Distance is influenced by both magnitude and shape changes of the enslavement patterns. However, our LME results show that increased flexor bias in the paretic hand strongly predicts Euclidean Distance but not Angular Distance (Fig. 9), thereby suggesting that pattern shape change cannot be fully accounted for by flexor intrusion. This analysis was also recommended by Reviewer 1. In the revised version, we will further clarify the dissociation of the two components.

      2) Can biomechanical factors be ruled out from the enslavement patterns in the paretic hand? We agree with the reviewers that resting hand posture measures alone cannot fully assess biomechanical factors, given that biomechanical constraints during action and abnormal postures due to neural loss after stroke were not captured in these measures. In the paper, however, we used three analyses to justify this point. In the first analysis, we showed that resting hand posture (Mount Distance and Mount Angle) could not account for the Biases in all groups (healthy, paretic, non-paretic). In the second analysis, we showed that resting hand posture could not account for Enslavement in all groups. In the third analysis, we showed that Biases in the non-paretic hand could not predict Biases or Enslavement in the paretic hand within the same patients. The third analysis was done based on the existing literature that secondary biomechanical change after stroke was likely not the major contributor in the hand impairment, where passive muscle stimulation could successfully evoke a similar level of fingertip forces in both stroke and control hands (Hoffmann et al. 2016) and median nerve stimulation could significantly reduce intrusion of finger flexion (Kamper et al. 2003). The resting hand posture and non-paretic hand biases would include both biomechanical and neural factors, but since none of these measures could predict enslaving patterns, we maintain that biomechanical factors would not be a contribution to the enslavement in the paretic hand.

      3) Neural correlates of behavioral changes were not tested, therefore claims such as "low-level," "subcortical," and "top-down cortical" contributions are not fully justified. We agree with the reviewers, and we will clear references to these neural correlates from the text of the Results section in the revised version of the paper. These neural correlates will only be discussed in the Discussion section.

      4) RDM construction for "by-Target Direction" was not clearly explained. We agree with the reviewer that the diagram in Fig. 4D was a little confusing. To construct these matrices, we analyzed differences in coactivation patterns of the non-instructed fingers when two fingers move in the same target direction. A cleaner pattern comparison should exclude both the two instructed fingers to be compared from the enslavement matrices. This will be clarified in the revised version.

      References

      Hoffmann, Gilles, Megan O. Conrad, Dan Qiu, and Derek G. Kamper. 2016. “Contributions of Voluntary Activation Deficits to Hand Weakness after Stroke.” Topics in Stroke Rehabilitation 23 (6): 384–92. https://doi.org/10.1179/1945511915Y.0000000023.

      Kamper, D G, R L Harvey, S Suresh, and W Z Rymer. 2003. “Relative Contributions of Neural Mechanisms versus Muscle Mechanics in Promoting Finger Extension Deficits Following Stroke.” Muscle & Nerve 28 (3): 309–18. https://doi.org/10.1002/mus.10443.

    1. Author Response

      The following is the authors’ response to the original reviews.

      Editorial comments:

      Comment 1 - Recommendations for the authors: please note that you control which revisions to undertake from the public reviews and recommendations for the authors.

      We appreciate the feedback from the 3 Reviewers and Editor. We have enumerated each Reviewer comment and provide a detailed response. We endeavoured to include each suggestion into the revised manuscript. All changes in the manuscript are indicated in red font. In instances in which we respectfully disagree with the Reviewer, we have provided a fair rebuttal. We feel the comments from the Reviewers has significantly improved the clarity and quality of the manuscript.

      Comment 2 - The revision process has demonstrated the value of your work, highlighting both its strengths and shortcomings. Importantly, it provides detailed and achievable suggestions for improving the current version of your contribution.

      We thank the Reviewers and Editor for their time and expert input on our manuscript. We feel the suggestions from the Reviewers to address the shortcomings has resulted in a significantly improved manuscript.

      Comment 3 - There is a general consensus among the reviewers on three key aspects. Firstly, the article would greatly benefit from a clearer layout of the experimental design and methodology, potentially including schematics to help readers comprehend the complexity and details of the study.

      We appreciate the feedback from Reviewer 2 in particular. We have added a new schematic for Experiment 3 (see PUBLIC REVIEWS Reviewer #2 Comment 2). We have also revised the Results section by including subheadings and additional text to help explain the methods.

      Comment 4 - Secondly, conducting a more comprehensive analysis of the available dataset, utilizing tools such as WGCNA to explore gene co-expression networks beyond specific genes, is recommended. Additionally, it is advised to exercise greater caution when discussing the limitations of the employed methods.

      The suggestion for the WGCNA is excellent and very much appreciated. The revised manuscript includes WGCNA for both the MBH and pituitary gland. See Figures S3 & Table S6 and lines 166-182; 497-505).

      Comment 5 - Thirdly, expanding the results section to create a more engaging narrative that guides readers through the numerous findings, and extending the discussion and conclusions to emphasize the ecological relevance of learning photoperiodic/seasonal responses and highlighting the presented model, would be valuable.

      These were excellent suggestions that significantly improved the clarity and quality of the manuscript. The results section included several subheadings to help break up of the transitions across experiments. We have also significantly revised the introduction and discussion to include the ecological relevance and importance to consider sex as a factor in the interpretations.

      Comment 6 - Finally, please pay close attention to the comment on the statistical analysis provided by Rev#2.

      It is unclear why the Benjamini-Hochberg’s FDR analyses was suggested. The statistical test is a version of the Bonferroni test but is less stringent. We prefer to use conservative tests (i.e., Bonferroni correction). Moreover, the Bonferroni correction is the commonly used statistical tests in the field. To be consistent with the field and to be careful in our statistical approach, the revised manuscript did not change the post-hoc correction.

      PUBLIC REVIEWS:

      Reviewer #1:

      Comment 1 - The authors investigated the molecular correlates in potential neural centers in the Japanese quail brain associated with photoperiod-induced life-history states. The authors simulated photoperiod to attain winter and summer-like physiology and samples of neural tissues at spring, and autumn life-history states, daily rhythms in transcripts in solstices and equinox, and lastly studies FSHb transcripts in the pituitary. The experiments are based on a series of changes in photoperiod and gave some interesting results. The experiment did not have a control for no change in photoperiod so it seems possible that endogenous rhythms could be another aspect of seasonal rhythms that lack in this study. The short-day group does not explain the endogenous seasonal response.

      We thank the Reviewer for the fair assessment of the manuscript. The statement ‘the experiment did not have a control for no change in photoperiod’ is not clear to us. We think the Reviewer is arguing that prolonged constant photoperiod was not conducted to examine circannual timing in avian reproduction. The constant short photoperiod in Exp3 does provide the ability to examine the initial stages of interval timing. A different endogenous mechanism used by animals. The revised manuscript has clarified the different physiological responses.

      Comment 2 - The manuscript would benefit from further clarity in synthesizing different sections. Additionally, there are some instances of unclear language and numerous typos throughout the manuscript. A thorough revision is recommended, including addressing sentence structure for improved clarity, reframing sentences where necessary, correcting typos, conducting a grammar check, and enhancing overall writing clarity.

      We have incorporated the suggestions from both Reviewer 1 and Reviewer 2 that aimed to increase the clarity of the manuscript. We have provided detailed responses to each comment below and state how each comment was incorporated in the revised manuscript. We also had the manuscript reviewed by a colleague to help identify issues associated with sentence structure, grammar, and spelling.

      Comment 3 - Data analysis needs more clarity particularly how transcriptome data explains different physiological measures across seasonal life-history states. It seems the discussion is built around a few genes that have been studied in other published literature on quail seasonal response. Extending results on the promotor of DEGs and building discussion is an extrapolating discussion on limited evidence and seems redundant.

      A new statistical analysis (ie., WGCNA) was conducted to identify relations between photoperiod, physiology and transcripts. The focus on the few photoperiodic gene was kept in the discussion as the transcript expression is important to highlight the differences from the prevailing hypotheses and novel patterns of expression across seasonal timescales. See Figures S3 & Table S6 and lines 166-182; 497-505).

      Comment 4 - Last, I wondered if it would be possible to add an ecological context for the frequent change in the photoperiod schedule and not take account of the endogenous annual response. Adding discussion on ecological relevance would make more sense.

      This is an excellent suggestion. The introduction and discussion were substantially revised to include the ecological relevance.

      Reviewer #2:

      Comment 1 - This study is carefully designed and well executed, including a comprehensive suite of endpoint measures and large sample sizes that give confidence in the results. I have a few general comments and suggestions that the authors might find helpful.

      We appreciate the Reviewers support for our manuscript. We have endeavoured to incorporate all suggestions in the revised manuscript.

      Comment 2 - I found it difficult to fully grasp the experimental design, including the length of light treatment in the three different experiments (which appears to extend from 2 weeks up to 8 weeks). A graphical description of the experimental design along a timeline would be very helpful to the reader. I suggest adding the respective sample sizes to such a graphic, because this information is currently also difficult to keep track of.

      We have created a new figure panel to address the Reviewer’s concern. See figure S4 panel ‘a’. The new schematic representation was designed to illustrate the similarity in experimental design used in Experiment 1 and Experiment 2. But clearly illustrates the extended short photoperiod manipulation (4 weeks and not 8 weeks). We added the sample sizes to initial drafts but felt the added text hindered the clarity of the schematic representation (particularly for Fig1a). The sample sizes for each experiment and treatment are provided in the raw data provided in the supplementary Table 1. For this reason, we have opted to not add the sample size to each diagram. We hope that the Reviewer will understand our perspective.

      Comment 3 - The authors use a lot of terminology that is second nature to a chronobiologist but may be difficult for the general reader to keep track of. For example, what is the difference between "photoinducibility" and "photosensitivity"? Similarly, "vernal" and "autumnal" should be briefly explained at the outset, or maybe simply say "spring equinox" and "fall equinox."

      This is a very helpful suggestion, and we thank the Reviewer. Two changes were made to the manuscript to address this comment. First, we revised the second introductory paragraph to describe the photoperiodic response and the terms used. Second, we have removed all reference to ‘vernal’ and replaced with ‘spring’. We opted to keep ‘autumn’ as the change to ‘fall’ did not provide the clarity of seasonal state in some statements (as fall is also used as a downward direction).

      Comment 4 What was the rationale for using only male birds in this study? The authors may want to include a brief discussion on whether the expected results for females might be similar to or different from what they found in males, and why.

      We agree with the Reviewer’s position that studies should include, or least describe, male and female biology. We have revised the text to address this comment. In the methods, we provide 2 sentences that state the photoperiodic response is the same for both male and females, and why males were selected. See lines (352-355). Then, in the discussion, we describe why females will be important to study how other supplementary environmental cues impact seasonal timing of reproduction. See lines (312-330; and 334-339).

      Comment 5 - The authors used the Bonferroni correction method to account for multiple hypothesis testing of measures of testes mass, body mass, fat score, vimentin immunoreactivity and qPCR analyses in Study 1. I don't think Bonferroni is ever appropriate for biological data: these methods assume that all variables are independent of each other, an assumption that is almost never warranted in biology. In fact, the data show clear relationships between these endpoint measures. Alternatively, one might use Benjamini-Hochberg's FDR correction or various methods for calculating the corrected alpha level.

      This concern is not clear to us. The Benjamini-Hochberg’s FDR is a slight modification of the Bonferroni correction. Moreover, the FDR is a less-stringent statistical test compared to the Bonferroni correction. We prefer to keep the Bonferroni approach to correct for multiple tests for two reasons. First, this test is commonly used in the field of chronobiology, and second, the Bonferroni correction is more conservative. We hope the Reviewer will appreciate our perspective to be consistent with the research field and higher stringency in our statistical approach.

      Comment 6 - The graphical interpretations of the results shown in Figure 1n and Figure 3e, along with the hypothesized working model shown in Figure S5, might best be combined into a single figure that becomes part of the Discussion. As is, I do not think these interpretative graphics (which are well done and super helpful!) are appropriate for the Results section.

      We appreciate the Reviewer’s suggestion. During the revision we developed a single figure to show the graphical representation for the respective experiments. Unfortunately, we found the single source to be very difficult to provide a clear description and overview of the findings. We feel that the interpretations, (admittedly unusual for Results section) are best placed in the respective figures that correspond to the different experiments.

      Reviewer #3:

      Comment 1a - It is well known that as seasonal day length increases, molecular cascades in the brain are triggered to ready an individual for reproduction. Some of these changes, however, can begin to occur before the day length threshold is reached, suggesting that short days similarly have the capacity to alter aspects of phenotype. This study seeks to understand the mechanisms by which short days can accomplish this task, which is an interesting and important question in the field of organismal biology and endocrinology.

      We thank the Reviewer for their positive feedback.

      Comment 1b - The set of studies that this manuscript presents is comprehensive and well-controlled. Many of the effects are also strong and thus offer tantalizing hints about the endo-molecular basis by which short days might stimulate major changes in body condition. Another strength is that the authors put together a compelling model for how different facets of an animal's reproductive state come "on line" as day length increases and spring approaches. In this way, I think the authors broadly fulfill their aims.

      We thank the Reviewer for the positive support of our research and manuscript.

      Comment 1c - I do, however, also think that there are a few weaknesses that the authors should consider, or that readers should consider when evaluating this manuscript. First, some of the molecular genetic analyses should be interpreted with greater caution. By bioinformatically showing that certain DNA motifs exist within a gene promoter (e.g., FSHbeta), one is not generating robust evidence that corresponding transcription factors actually regulate the expression of the gene in question. In fact, some may argue that this line of evidence only offers weak support for such a conclusion. I appreciate that actually running the laboratory experiments necessary to generate strong support for these types of conclusions is not trivial, and doing so may even be impossible. I would therefore suggest a clear admission of these limitations in the paper.

      We agree with the Reviewer’s position. The transcription binding protein analyses was used as a means to identify potential factors involved in the regulation of transcript expression. We have written a new paragraph to address this comment. In the discussion, we that highlight the links between the well characterised circadian regulation of photoperiodic transcripts (e.g, D- & E-box elements and the photoperiodic control of TSHβ. We also indicate that our bioinformatic approach identified potentially new transcription binding motifs, and provide a clear admission and state that functional analyses are required to determine necessity of these pathways (e.g., MEF2). See lines 293-295.

      Comment 2 - Second, I have another issue with the interpretation of data presented in Figure 3. The data show that FSHbeta increases in expression in the 8Lext group, suggesting that endogenous drivers likely act to increase the expression of this gene despite no change in day length. However, more robust effects are reported for FSHbeta expression in the 10v and 12v groups, even compared to the 8Lext group. Doesn't this suggest that both endogenous mechanisms and changes in day length work together to ramp up FSHbeta? The rest of the paper seemed to emphasize endogenous mechanisms and gloss over the fact that such mechanisms likely work additively with other factors. I felt like there was more nuance to these findings than the authors were getting into.

      We agree with the Reviewer and a similar concern was raised by Reviewer 1. Our aim was to highlight that FSH expression increased in constant short photoperiod. We have revised the manuscript to address the concern raised by the Reviewer. We have added 2 sentences in the results to highlight the additive role of endogenous timing and photoperiodic effects on FSH expression (see lines 223-226). We have kept the text that describes endogenous increases in expression (e.g., FSH/GnRH) in response to short photoperiod in the manuscript as this observation is not influenced by long photoperiod.

      Comment 3 - Third, studies 1 - 3 are well controlled; however, I'm left wondering how much of an effect the transitions in day length might have on the underlying molecular processes that mediate changes in body condition. While the changes in day length are themselves ecologically relevant, the transitions between day length states are not. How do we know, for example, that more gradual changes in day length that occur over long timespans do not produce different effects at the levels of the brain and body? This seemed especially relevant for study 3, where animals experience a rather sudden change in day length. I recognize that these experimental methods are well described in the literature, and they have been used by endocrinologists for a long time; nonetheless, I think questions remain.

      There are two points raised in this comment. First, the effect of transition in day length on body condition. We are investigating the impact of photoperiodic transitions on body condition. The ongoing project has examined the changes in tissue lipid content and conducted transcriptomic analyses of multiple peripheral tissues involved in energy balance. Although we made an initial attempt to combine all the findings into a single manuscript, the large datasets resulted in an overwhelming manuscript that lacked clarity. Instead, we have opted for two manuscripts that focus on the respective physiological systems. Those data should be published shortly. We did expand the discussion by developing a single paragraph that focused on the pattern of POMC expression and changes in quail body mass and adipose tissue. See lines 300-311.

      Second, the Reviewer raised the issue of more gradual changes in day length over longer timespans. The day length and duration of exposure selected was to replicate previously used photoperiod manipulations to ensure reproducibility in research programmes, and to reduce the impact of photoperiod history (see lines 367-369). The present manuscript is the first study in birds to examine multiple intervening (ie within the extreme long- and short-photoperiods) day length conditions and we feel this is a major and novel contribution to the field. We agree that other time points (e.g., 13L:11D), or quicker/longer timespans could provide additional insight into the molecular mechanisms that govern seasonal transitions in reproduction/energy balance. The question raised by the Reviewer requires the types of studies that use natural conditions from wild-caught animals (or semi-natural laboratory settings) and beyond the focus of the current manuscript.

      Recommendations For The Authors:

      Reviewer #1

      Comment 1 - Abstract: Overall abstract needs more clarity in rationale, hypothesis, and result outcomes. How this study advances our knowledge in seasonal/ photoperiodic regulation of reproduction in birds. Particularly what knowledge gap FSHb results fill in.

      We have substantially revised the abstract considering the Reviewer’s suggestions. The abstract has clarified the rationale, hypothesis and results outcomes. We have also added new introductory and concluding statements that place the work into a wider ecological context (as suggested below).

      Comment 2 - In general the introduction needs more clarity and doesn't seem to cover the ecological relevance of learning photoperiodic/seasonal response.

      We agree with the Reviewer the introduction could be improved. We have substantially revised the introduction with an aim to increase the clarity. This involved an addition on the ecological context, clarification of the photoperiodic states in birds, and a description of the general and specific objectives. Note we did not include an introduction to ‘learning’ of the photoperiodic response, as the term implies a cognitive component is involved which is incorrect. See lines (61-67, 71-74, 80-86, and 100-105).

      Comment 3 - Line 58: What does the author mean by "future seasonal environment" Is it to introduce change in climate or future seasonal events? This sentence needs rephrasing and more clarity.

      In response to Comment 2, we have revised the introductory paragraph and the sentence was removed from the text.

      Comment 4 - Line 63: I would recommend the use of circannual rhythms with caution for the kind of experiments authors have proposed. The approach used here is beyond the scope of addressing circannual endogenous rhythms, which can be tested only independent of photoperiod change.

      We agree with the Reviewer’s concern. The use of circannual rhythms was limited to the first paragraph (lines 56-63) only to introduce the concept of endogenous rhythmicity. We were careful to not use the term ‘circannual’ for the rest of the manuscript, as the Reviewer has indicated, would be inappropriate. We have retained the use of ‘endogenous program’ to refer to the molecular and physiological changes that can occur independent of photoperiod change (ie Experiment 3). In this case, the use of endogenous is appropriate as this form of timing adheres to an interval timer. We also provided a definition for interval timer and ecological examples to illustrate the difference between circannual rhythms and annual interval timer (see lines 71-74). We also reviewed the entire manuscript to ensure the distinction for the endogenous program was clear.

      Comment 5 - Another aspect authors missed is that Quail is not an absolute photorefractory (Robinson and Follett, 1982).

      We agree with the Reviewer that quail are not absolute photorefractory (but instead relative photorefractory). As our photoperiod manipulations do not address criterion 1, or criterion 2 of the avian photoperiodic response (MacDougall-Shackelton et al., 2009; see https://doi.org/10.1093/icb/icp048), we feel that adding the type of photorefractory response would be a distraction and reduce the clarity of the concepts/experimental design described in the manuscript.

      Comment 6 - Line 223-234: "Chicks were raised under constant light and constant heat lamp". Constant photoperiod experienced during development raises concern on how this pretreatment would shape the adult seasonal response, which could be different in the seasonal response of birds raised in natural photoperiod. If this is correct, the results shown are not tenable for birds inhabiting the natural environment.

      The light schedule used in our experiment is the most appropriate for laboratory reared chicks. The light schedule, use of an incubator and hatchery is commonly used in research laboratories. The procedure serves to increase the hatch rate and welfare of chicks. Undoubtedly there will be some early developmental programming effects on quail development. However, the gonadal response across all 3 experiments was consistent with the vast scientific literature on the avian photoperiodic response in both laboratory and wild birds. As the robust gonadal response clearly replicated previous studies, we are confident the results are tenable for birds inhabiting natural environments.

      Comment 7 - Numerous studies done in mammals suggest that photoperiod experienced in the early life stage affects the circadian and seasonal response in adults (Ciarleglio et al., 2011, Perinatal photoperiod imprints the circadian clock, Nat Neurosceince; Stetson M., et al., 1986, Maternal transfer of photoperiodic information influences the photoperiodic response of prepubertal Djungarian hamsters).

      We agree with the Reviewer that developmental programming in mammals is important for the photoperiodic response. However, there are vast differences between the avian and mammalian photoperiodic response. Critically, in mammals, the maternal transfer of information to the offspring is achieved via the melatonin hormone. Conversely, in birds, melatonin is not necessary, nor sufficient for photoperiodic time measurement (Juss et al., 1993; see https://doi.org/10.1098/rspb.1993.0121). It is not scientifically tenable to relate the mammalian and avian photoperiodic responses in adulthood based on early developmental programs. For this reason, we did not introduce or discuss developmental programming in our manuscript.

      Comment 8 - Please give details on the month in which these birds were exposed to different short and long photoperiods. It is not clear in the method section. The birds experience long to short day transition and then back to long day in 16 weeks (~ 4 months). The annual cycle is ~12 months long in nature. Again, what is the ecological relevance of such an experimental paradigm. This could give some idea on photoperiodic response, but not on how the endogenous annual cycle would respond.

      Birds were delivered in September 2019 and 2020. (We have added these details to the manuscript (see lines 351-352). We agree with the Reviewer that the ecological relevance of the experimental design is limited. Our focus was to use laboratory conditions and well characterised photoperiodic manipulations to examine the role of the environmental, initial predictive cue to time seasonal transitions in reproduction. The 2-week duration for each photoperiod state in Experiment 1 provides the ability to eliminate the impact of photoperiodic history (see lines 367-369; Stevenson et al., 2012a) and reduce the time necessary for the research project. As described above in Comment #4 – we did not examine the endogenous annual cycle – but instead focused on an endogenous interval timer. Experiment 3 was designed to best examine an endogenous interval timer.

      Comment 9 - Line 251: "A jugular blood sample" Please rephrase this sentence and add 50 ul heparinized tubes

      We thank the Reviewer for identifying this oversight. The text was changed accordingly.

      Comment 10 - Line 259: The scale.....fat pads" - The sentence doesn't read correctly.

      The sentence was revised accordingly.

      Comment 11 - Line 274: Male.....six weeks. It is not clear from this sentence; what photoperiod birds were exposed to before transferring to 2 long days. Is it 16 or 14 LD.

      The birds were held in 16L. The text has been revised accordingly.

      Comment 12 - Line 276: It is not clear what is Home Office approved schedule 1. This may be a commonly used term for animal sacrifice protocol in UK and Europe. But it is not familiar jargon for the rest of the globe.

      We apologise for the jargon. The text was revised to include the exact methods (decapitation followed by exsanguination).

      Comment 13 - Line 277-284: Birds under SD for 4 weeks (8 Lext) is a bit confusing and particularly in the context of studying endogenous rhythm. Needs more clarity.

      The text was revised to improve the clarity. The manuscript now states: ‘A subset of birds (n=6) was maintained in short day photoperiods for four more weeks (8Lext). This group of birds provided the ability to examine whether an endogenous increase in FSHβ expression would occur in constant short day photoperiod condition.’

      Comment 14 - Line 322-323: Give RIN number (RNA integrity number) here which is a very common parameter to determine RNA degradation in RNAseq experiments. I guess, the MiniON is a portable sequencer and sequences one sample at a time. If this is true authors should consider any batch effect in sequencing and use it as a covariate in the model.

      The RIN values from our extraction protocol reliably produce RIN values >9.0. The text now states: Isolated RNA reliably has RIN values >9.0 for both the mediobasal hypothalamus and pituitary gland. Our RIN values are well above the recommended 7.0 limit. The Reviewer is correct that MinION is portable, however, more than one sample can be run at a time. We stated in the text (lines 454-460) that birds were counterbalanced across Flow cells so that each sequencing run had 9 samples, one from each treatment group. Our counterbalancing approach and quality control steps prevented batch effects.

      Comment 15 - Line 397-398: Adding quail or chicken-specific vimentin peptide pre-incubation with primary Ab will serve more confirming control. Omitting primary Ab doesn't address cross-reactive/ nonspecific binding issues.

      We agree that a positive control (ie primary Ab) is the gold standard to support specificity of the antibody. Unfortunately, we have not found a supplier of the epitope for quail/chicken vimentin. We have conducted another in silico analysis an established that the sequences for the vimentin antibody is specific for vimentin. The next closest sequence alignment is only 68% for a protein that is not expressed in the brain. The immunoreactive pattern observed in our histology reproduces work from mammalian models in which the epitope is available. Therefore, we are confident that our immunoreactive signal for vimentin is specific. We have added the in silico analysis in the manuscript on lines 535-538.

      Comment 16 - Line 430: Was the GLM model used for testing all variables? Running a statistical model to explain Differentially expressed genes, photoperiod, and physiological variables together will give a more conclusive outcome to explain the photoperiod effect and seasonal state.

      A similar comment was raised by Reviewer 2. We have conducted a WGCNA analyses to examine the relationship between photoperiod, physiological variables and DEG. See Figures S3 & Table S6 and lines 166-182; 497-505).

      Comment 17 - It is a bit unclear why the author used cherry-picking approach by talking about only a few genes that have been studied as key regulators of photoperiodic response in quail. What was the purpose of transcriptome? A better approach would have been to use a model to reduce the data (PCA) and explain the physiological response by regression against different PCs.

      We agree with the Reviewer that other statistical approaches could be conducted, and other genes could be discussed. However, we focussed on the key regulators of the photoperiodic response in quail as these are the well characterised genes. It is important that our discussion focused on these transcripts as most do not conform to the predicted patterns of expression. We feel it is best that we keep the focus on these genes.

      Comment 18 - TSHb result is inconsistent with past studies, where TSHb is the first responder gene on photoinduction. The author did not pay attention to explaining it further in the discussion.

      We respectfully disagree with the Reviewer. Our results are consistent with past studies and show that TSHβ expression is a molecular marker of long day photoperiod. Our study does not examine photoinduction; which does not provide the ability to compare between our study and previous work (eg., Nakao et al., 2008; see doi: 10.1038/nature06738). We have revised the text in consideration of the concern raised by the Reviewer. The text now states ‘Previous reports established that TSHβ expression is significantly increased during the period of photoinducibility in quail (Nakao et al., 2008). Although the present study did not directly examine photoinduction, TSHβ expression was consistently elevated in long day photoperiod (i.e., 16L).’. (see lines 262-265).

      Comment 19 - PRL result seems interesting and there could be more discussion in relation to the rise in PRL transcripts levels termination of breeding. Elaborating on PRL expression and breeding termination can add more information to the discussion.

      This comment is not clear to us, and we would incorporate a clarified comment in a revised manuscript. The increased expression of prolactin does not occur during the termination of breeding. The increase in prolactin occurs during the vernal increase in photoperiod (ie 14L) but does not have a clear link with gonadal growth.

      Comment 20 - Line 217-219: Based......respectively. Sounds like a big claim with less evidence.

      We have removed the sentence from the discussion.

      Comment 21 - Line 220-223: The .....Bird. The sentence is not clear about how this study would add to ecological studies. Need more clarity on the importance of such data.

      The sentence was removed from the text.

      Comment 22 - I think that it would be helpful to add a couple of caveats to provide more ecological context. First, the model is only based on males, and responses in females could be different.

      We agree with the Reviewer there are undoubtedly sex differences in timing seasonal biology. However, the photoperiodic response (growth and regression) is similar in both males and females. Sex differences exist in response to supplementary environmental cues (e.g., temperature). Males were used in these studies as the gonadal response to changes in photoperiod manipulations are much larger compared to ovarian changes in females. The focus on males allows for fewer animals to be used in the experiments and greater statistical power. To address the Reviewers concern, we have added a paragraph in the discussion that describes the similarity in photoperiodic responses in males and females, and the importance of supplementary cues for full reproductive development in female birds. We also provide a couple sentences in the methods that describe the justification for only males in the present study. See lines (Methods 352-355; Discussion 312-330; and 334-339).

      Comment 23 - Last, I wondered if it would be possible to add an ecological context for the frequent change in the photoperiod schedule and not take account of the endogenous annual response. Would the procedure simulate a similar kind of underlined molecular response for a bird under natural conditions responding to changing daylight cycles on an annual time frame?

      The discussion was considerably revised to address the ecological relevance of the study, and findings. We have added a sentence at the beginning of the discussion to highlight that the laboratory-based approach and photoperiodic manipulations reliable replicate previous findings using semi-natural conditions (Robinson and Follett, 1982) (See lines 248-250). We have already reduced the focus on the endogenous annual response.

      Reviewer #2:

      Comment 1 - The writing is very terse and could benefit from a more narrating style, which would make it a lot easier for the reader to get through some of the very data-heavy text. Breaking up the Results with subheadings would also be helpful.

      We appreciate the suggestion to add subheadings to the Results. We added 3 descriptive headings for each other studies conducted in the manuscript. We feel the added revision (e.g., ecological) has improved the narrative and made the manuscript accessible to the wider readership.

      Comment 2 - The transcriptome analyses could be developed a bit more. First, using the limma package would allow the authors to apply a more complete model to the DEG analyses, which would likely be superior to EdgeR. Second, the authors may want to consider WGCNA or a similar approach to discover gene co-expression modules, and then examine whether any of the resulting module eigengenes co-vary with any morphological or physiological measures and/or vary rhythmically.

      This is an excellent suggestion, and the new analyses was incorporated into the revised manuscript. Using the Langfelder and Horvath 2008 WCGNA package we conducted module-trait analyses to examine co-variation in our findings. These data are presented in Figure S# and lines 476-484. We agree that other DEG analyses would be useful; our main objectives was to use BioDare2.0 to identify rhythmic transcription in the seasonal transcriptomes. EdgR provides an excellent approach to identify transcripts and commonly used.

      Comment 3 - In the Data and code availability statement (lines 226ff) the authors state that "all raw data are available in Extended data Table 1." However, they should be submitted to the GEO database or a similar public repository along with all relevant metadata. Also, and maybe I overlooked this, I did not see anywhere that the "R code used in Study 1 is freely available" (I was not sure what "the methods reference list" was supposed to refer to). Instead of stating that "the full R code used is available upon request" I suggest making all scripts available via GitHub or Dataverse, along with all non-omics data. The advantage of the latter platform is that a citable DOI is assigned to each upload.

      The data are now available in the GEO database and can be accessed see GSE241775. We have added this information to the text. The R code is now provided as a Table S11 so that the reader can directly access the script.

      Comment 4 - Line 191: Delete the extra "that"

      We thank the Reviewer for identifying the oversight. We have revised the text accordingly.

      Comment 5 - Line 24f: What does "pseudo-randomly" mean? Maybe "haphazardly" would be more appropriate here?

      The term pseudo-randomly is used to describe the organized manner in which subjects are assigned to each treatment group. The aim is to ensure that a particular physiological variable, such as body mass, is evenly distributed across treatment groups. (Note although the term derived from the field of psychology). The aim is to reduce bias in the experiment due to an initial bias established when assigning treatment group. We are reluctant to replace pseudorandomly with haphazardly as the latter does not imply a logical organization. We have added text to help clarify the reason. The text now state: At the end of each photoperiodic treatment a subset of quail (n=12) body mass was used as a measure to pseudo randomly select birds for tissue collection and served to reduce the potential for unintentional bias.

      Comment 6 - Figure 1e,j: The text indicates that 398 and 130 genes were "rhythmically expressed" in the MBH and pituitary, respectively, but considerably fewer genes are shown in the heatmaps in Figure 1e,j. How were these genes selected, and what was the rationale for doing so? Also, some autumnal and vernal expression patterns show some strong similarities (e.g., 16a and 16v in the MBH), which could be discussed. Consider showing the two heatmaps with the columns also hierarchically clustered in a supplementary figure.

      We agree with the Reviewer that the full heatmap for the transcripts should be provided. The heat maps in Figure 1 are based on the transcripts with the most significant change; and were selected to provide a graphical representation that would be easily digested by the wide readership. We have created a new figure (ie. Fig. S1) that provides all the transcripts in heat maps for both the MBH and pituitary gland.

      Reviewer #3:

      Comment 1 I do not have too much to add to this section of my review. Broadly speaking, I would suggest that the authors address some of the concerns I highlight above, and integrate their thoughts into the paper more than they currently do. I think this is particularly important with respect to the limitations of many of the bioinformatic analyses.

      We thank the reviewer for their input and time assessing the manuscript. We have revised the manuscript in many sections incorporating the suggestions by Reviewer 3 above, and Reviewers 1 and 2.

      Comment 2 Some of the methods are also a little scant. For example, the qPCR analyses are not described in sufficient detail to replicate the study. What are the efficiencies? Were samples run in duplicate? What was the housekeeping control gene used? Was there only one, or were multiple housekeeping genes used?

      We apologise for the oversight, the absence of information was a mistake that missed our previous early revisions. The revised manuscript includes all the requested information. Line 333 states that all samples were run in duplicate. The efficiency for each transcript was within the MIQE guidelines (indicated on line 342) and were within the 0.7 to 1.0 range. Actin and glyceraldehyde 3-phosphate dehydrogenase were used as the reference transcripts. The most stable reference transcript was used to calculate fold change in target gene expression (lines 343-345).

    1. Author Response

      The following is the authors’ response to the original reviews.

      eLife assessment

      In this important paper, the authors report a link between brumation and tissue size in frogs, summarizing convincing evidence that extended brumation is associated with smaller brain size and increased investment in reproduction-related tissues. The research will be of broad interest to ecologists, evolutionary biologists, and those interested in global change biology. While the dataset involves significant field work and advanced statistical analyses, the manuscript would benefit from more explanation of the models, including why frogs are a good model in which to address these questions, and from general improvement in the structure and conciseness.

      We highly appreciate your positive assessment and that you considered our paper important and convincing.

      Reviewer #1 (Public Review):

      The authors have conducted lots of field work, lab work and statistical analysis to explore the effect of brumation on individual tissue investments, the evolutionary links between the relative costly tissue sizes, and the complex non-dependent processes of brain and reproductive evolution in anuran. The topic fits well within the scope of the journal and the manuscript is generally written well. The different parameters used in the present study will attract a board readership across ecology, zoology, evolution biology, and global change biology.

      Thank you for your positive and supporting feedback.

      Reviewer #2 (Public Review):

      The authors set out to show how hibernation is linked to brain size in frogs. If there were broader aims it is hard to decipher them. The authors present an extremely impressive dataset and a thorough set of cutting-edge analyses. However not all details are well explained. The main result about hibernation and brain size is fairly convincing, but it is hard to think of broader implications for this study. Overall, the manuscript is very confusing and hard to follow.

      Thank you for your compliments on our paper. As for your concerns, we have greatly revised our paper and, as we hope, improved its clarity. We have also added a few sentences to the conclusions to draw attention to potentially broader implications. Specifically, we describe how the focal traits of our study may all be affected by climate change. Differential constraints in necessary investments could be one of several reasons for the varying resilience to climate change between species in the same habitat.

      Reviewer #1 (Recommendations For The Authors):

      There are no issues on the availability of data and code.

      Thank you.

      Line 15: in the author contribution section, it seems that C.L.M. and J.P.Y are not in the author list.

      These two authors are not part of this study. This was a mistake.

      Line 24: I don't think it is vital or logical to address or compare too much on birds or mammals, which are not the focused taxa of the present study. Instead, it is better to clarify the reason why frogs and toads are ideal model taxon to this study.

      The reason for comparisons with birds and mammals was that all hypotheses related to the various trade-offs tested here had been developed in these taxa. One of the points of our paper was that these needed validation beyond the two taxa, in addition to being tested against one another (each prediction had been developed in a specific group and typically in isolation of all other hypotheses).

      Line 25-26: as the authors are shooting for eLife, as a general journal, it is not essential to provide the detailed methods in the abstract. But I think the authors need to strengthen the novelty of the work in the field here.

      The strength of our study was that all traits were measured directly in our species, including estimates of hibernation duration. Prior studies used various proxies, categorial classification or datasets assembled from multiple sources. To us, this seemed like a sufficiently important advance in the field to mention it, but considering the reviewer’s comment, we have now removed it.

      Line 28: "protracted brumation reduces brain size and instead promotes reproductive investments", as a correlative study, it is much more precise to change this sentence to a similar description as "protracted brumation is negatively correlated with brain size but is positively correlated with reproductive investments" here and related statements throughout the whole text.

      We agree that, strictly speaking, a path analysis can only point toward possible causality and not provide hard evidence as experimental manipulation might. The wording may have been a bit too strong here in our attempt to minimize wordiness and because all our analyses combined very strongly pointed in this direction. However, we have now changed this as suggested even though it now reads almost as if we had done no more than conducting a simple correlation. We have further paid attention to the wording of our interpretations throughout the paper.

      Line 32-33: it needs a bigger ending linking your main findings with the implication in understanding species response to the sustained environment change.

      We have reworded the ending of the abstract to: “Our results provide novel insights into resource allocation strategies and possible constraints in trait diversification, which may have important implications for the adaptability of species under sustained environmental change.”

      Line 63-68: this sentence is too long to understand and please simplify it.

      We have split the sentence into two sentences.

      Line 125-130: it is known that there are various frog reproductive modes (Crump et al. 2015) such as trade-offs between clutch size and egg size, different number of breeding during one year, etc. These different reproductive forms may also influence the brain size evolution with food availability and seasonal variations. Please clarify it.

      Yes, anurans do have varying reproductive modes, but to us, there is no a priori reason to assume that such variation would have a direct effect on brain evolution. Rather, in our opinion, different reproductive modes would have indirect effects by affecting the environment in which reproduction occurs. For example, larvae developing under different environmental conditions (substrate, larval density, egg provisioning etc.) might affect developmental trajectories that could influence how resources are available and allocated to different organs, including the brain. Alternatively, reproductive modes could influence the choice of environment for reproduction, thereby possibly affecting mating strategies and ultimately trait investments associated with these strategies. Given we were asked to shorten our paper, we believe that ‘environmental effects’ remains broad enough to encompass such variation, thereby not necessitating disentangling the different, and likely primarily indirect, ways that reproductive modes could be linked to brain evolution. However, if the reviewer would find it important to go into such detail in the paper, we will be happy to do so.

      Line 186-187: it is necessary to mention here that the authors also conducted sensitivity analyses to apply 2{degree sign}C or 4{degree sign}C below their experimentally derived as thresholds to test the robustness of the results to data uncertainty.

      We have added “(details on methodology and various sensitivity analyses for validation in Material and Methods)” to indicate the different types of sensitivity analyses, which included more than simply 2 or 4°C difference.

      Line 188: please change "In phylogenetic regressions" to "after controlling for phylogenetic autocorrelation/pseudo-replication" or similar sentence here.

      Our focus here was the phylogenetically informed GLS model rather than phylogenetic control itself. In the latter case, it would still not be clear what type of model was conducted with such phylogenetic control. To avoid any shorthand, we have reworded for more precision: “We employed phylogenetic generalized least-squares (PGLS) models, …”

      Line 177-287: please provide the exact variance explained by different predictor variables in brumation duration, individual tissue investments, and brain evolution. I also suggest that the authors need consider conducting multi-model inference-based model averaging analysis to test the relative importance of different variables. In addition, the present analyses did not include the interaction terms among variables, which may be more important than the effect of each individual factor.

      There may be some misunderstanding as these models represent separate analyses for each predictor as indicated by the associated λ values (never more than one value per model). We conducted separate models to determine which variables might even play a role in explaining variation in the corresponding response variables. Based on relevant predictors, we then conducted path analyses rather than general multi-predictor analyses. The relative effect sizes are represented by the correlation coefficients (r values) in the tables.

      Reviewer #2 (Recommendations For The Authors):

      Why exactly are the pairwise comparisons positively correlated (fig. S5) and then negatively correlated (fig. 3). What is actually driving this difference? For the phylogenetic path analyses 26 candidate models are chosen without explanation. What theory or hypotheses are these based on?

      We assume the reviewer is referring to the brain-body fat association. The two ‘pairwise’ analyses they mention were not the same. The correlation in Fig. S5 was a standard (albeit phylogenetically informed) partial correlation between the two focal tissues, controlling for SVL. By contrast, as described when introducing the analyses, negative associations were derived when additionally controlling for testes and hindlimb muscles, all of which deviated from isometry against body size. Here, the total mass of the four main tissues was divided by their proportional contribution to that mass in each species, then standardized for comparison across species. Since the total mass of these four tissues scaled directly with body size, larger-bodied species did not invest a proportion of their body to these tissues than smaller-bodied species, thus essentially rendering body size irrelevant for this analysis. However, the relative representation of the four traits changed between species such that more resources devoted to body fat was associated with a smaller brain, hence a negative relationship. Similarly, the multivariate analysis as well as the PCA also suggested similar trends when all four tissues were considered rather than purely pairwise comparisons.

      Regarding the second comment: We indeed used 28 pre-defined predictions for our larger path analysis.

      The authors haven't really provided much additional context either, and the discussion is almost entirely a rehash of the results section. I can't see the analysis code but this may be of use to people performing similar analyses.

      It is true that the traits and core message of the Discussion relate directly to our results, but we believe that our Discussion provides the essential biological context to our findings and to how they are connected. We tried not to go on tangents or too much speculation as the many results provided enough material to discuss, with several different ways that we expanded the prior state-of-the-art in the field. However, we have now expanded the concluding paragraph to place our findings in the context of climate change, given that this could affect anurans and the different traits examined in many ways that are directly related to the current study. Yet, we decided to keep this short because such extrapolation of our findings

      We indeed held off making the code available to the public in case dramatic changes to the paper were requested by the reviewers. However, it will be published.

      Additional recommendations from the Reviewing Editor:

      • One of the reviewers and I found the text a little difficult to follow. I suggest simplifying the paper by being more concise. For example, the introduction could be shortened into a 3-4 paragraphs of relevant text without overwhelming the reader. One of the reviewers wanted a better explanation of statistical models and I agree. The discussion could benefit from some structure - consider adding subheadings that would guide the reader as to the topic. Finally, the figures are difficult to see and should be made larger. For example, the graphs in Figure 1c could be on a panel below A and B so that readers can interpret the graph. In Figure 3 - the legend is far too small - please put above or below the graphs. In summary - I hope you consider a major re-write that would strengthen the accessibility of your paper to a broad audience.

      We have substantially shortened the paper despite adding further details on models and a broader context to the Discussion. We also condensed the Introduction to about two thirds of the original word count. However, we did not think that shortening it even further or splitting it into 3-4 paragraphs would improve readability. We still considered it important to introduce with sufficient context all major hypotheses that were tested against one another, provide at least some information on what was or was not known about the evolution of the focal traits and their links to one another or the environmental variables. We also found it important to touch on the differences between our study organisms and those typically studied in the context of hibernation or brain evolution, as this could affect the predictions. Given the number of hypotheses and traits, cutting the number of paragraphs would have meant merging some of them into very long ones, which we did not consider helpful.

      We further added short subheadings to the Discussion and adjusted the figures as requested.

    1. Author Response

      The following is the authors’ response to the original reviews.

      We very much appreciate the constructive comments provided by the reviewers. We have incorporated many of their suggestions and believe the manuscript is much improved.

      In brief, we updated the text as suggested and have included three additional panels in supplementary fig. S2E-G. This additional data provides further support that the ectopically persisting neuroblasts are actively dividing and that cell cycle defects alone do not account for temporal patterning phenotypes.

      Reviewer #1 (Public Review):

      In this manuscript, the authors are building on their previous work showing Delta-Notch regulates the entrance and exit from embryo-larval quiescence of neural stem cells of the central brain (called CB neuroblasts (NB) (PMID: 35112131)). Here they show that continuous depletion of Notch in NBs from early embryogenesis leads to cycling NBs in the adult. This - cycling NBs in the adult - is not seen in controls. The assumption here is that these Notch-RNAi NBs in adults are those that did not undergo terminal differentiation in pupal development. The authors show that Notch is activated by its ligand Delta which is expressed on the GMC daughter cell and on cortex glia. They determine that the temporal requirement for Notch activity is 0-72 hours after larval hatching (ALH) (i.e., 1st instar through mid-3rd instar at 25C). In NBs/GMCs depleted for Notch, early temporal markers were still expressed at time points when they should be off and late markers were delayed in expression. These effects were observed in ~20-40% of NBs (Figures 5 and 6). Through mining existing data sets, they found that the early temporal factor Imp - an RNA binding protein - can bind Delta mRNA. They state that Delta transcripts decrease over time (without any reference to a Figure or to published work), leading to the hypothesis that Delta mRNA is repressed by the late temporal factors. Over-expressing late factors Syp or E93 earlier in development leads to downregulation of a Delta::GFP protein trap. These results lead to a model in which Notch regulates expression of early temporal factors and early temporal factors regulate Notch activity through translation of Delta mRNA.

      There are several strengths of this study. The authors report rigorous measurements and statistical analyses throughout the study. Their conclusions are appropriate for the results. Data mining revealed an important mechanism - that Imp binds Delta mRNA - supporting the model that early temporal factors promote Delta expression, which in turn promotes Notch signaling.

      There are also several weaknesses:

      1) The activation of Notch in NBs by Delta in GMCs was already shown by this group in their Dev 2022 paper, reducing some of the impact of this study.

      In our previous work, we reported that Delta-expressing GMCs transactivate Notch in neuroblasts during the embryonic to larval transition. In the current manuscript, we show that Delta is expressed in GMCs and cortex glia and both sources transactivate Notch in neuroblasts during later developmental stages. This is in agreement with work published by others and while not novel per se, is a necessary first step for understanding which neighboring cell types control Notch pathway activity. During the embryonic to larval transition, glia do not contribute likely because they have not yet grown to ensheath CB NBs and their recently born progeny.

      2) The authors do not explain their current results in context of their prior paper (2022 Dev) until the Discussion, but this would be useful to read in the Introduction. Similarly, it would be good to mention that in the 2022 paper, they find a significant number of wor>Notch RNAi NBs at 2 AHL that are cycling. Are the adult Notch RNAi in this study descended from those NBs at 2 hours ALH in the 2022 study? In other words, how does the early requirement for Notch between 0-72 hours ALH reported in the current study relate to the Notch-depleted NBs identified in the 2022 paper?

      We have now included the following text in the intro: “We recently reported that Notch signaling regulates CB NB quiescence during the embryonic to larval transition (Sood et al., 2022). When Notch is knocked down, some CB NBs continue dividing during this transition. We also reported that Notch activity becomes attenuated in quiescent CB NBs because CB NBs are no longer dividing and producing Delta-expressing GMC daughters for Notch pathway transactivation. Moreover, low Notch is necessary for CB NBs to reactivate from quiescence in response to dietary nutrients (Sood et al., 2022).

      Here we report that Notch signaling also regulates neurogenesis termination during pupal stages. When Notch is knocked down, CB NBs maintain early temporal factor expression longer resulting in a delay of late temporal factor expression with prolonged neurogenesis into late pupal stages and early adulthood. This defect in temporal patterning (switching from early to late) occurs after CB NB exit from quiescence suggesting that Notch is required at multiple times throughout development in controlling CB NB proliferation decisions.”

      We do not know whether the neuroblasts that fail to enter quiescence are the same that fail to terminate divisions during pupal stages, however there are many more that fail to terminate divisions during pupal stages.

      3) Most of the experiments rely upon continuous depletion of Notch from embryonic stage 8 until adulthood using the wor-GAL4 driver. There is no lineage tracing of this driver and there is no citation about the published expression pattern of this driver. The inclusion of these details is important for a broad audience journal.

      The reference for the driver is included in supplementary data, under the heading “Experimental model:Drosophila melanogaster”. This GAL4 driver is widely used and one of the most accepted in the field.

      4) Most of the experiments utilize a single RNAi transgene for Notch, Delta, Imp, Syp, E93. There are no experiments demonstrating the efficacy of the RNAi lines and no references to prior use and/or efficacy of these lines.

      All RNAi lines used in these studies have been published previously, by our group as well as others and sources for the lines are listed in supplementary data, under the heading “Experimental model:Drosophila melanogaster”. Efficiency of these lines have been verified using antibody labeling (data not shown) and by assaying activity of Notch activity reporters (shown in Fig. 2).

      An appraisal: The authors use temperature shifts with Gal80TS to show that Notch is required between 0-72 hours ALH. They show with the use of known markers of the temporal factors and Delta protein trap, that Imp promotes Delta protein expression and the later temporal factors reduce Delta, although the molecular mechanisms are not clearly delineated. Overall, these data support their model that the reduction of Delta expression during larval development leads to a loss of Notch activity.

      As noted in the Discussion, this study raises many questions about what Notch does in larval CB NBs. For example, does it inhibit Castor or Imp? Is Notch required in certain neural lineages and not others. These studies will be of interest in the community of developmental neurobiologists.

      Reviewer #2 (Public Review):

      Embryonic stem cells extensively proliferate to generate the necessary number of cells that are required for organogenesis, and their proliferation must be timely terminated to allow for proper patterning. Thus, timely termination of stem cell proliferation is critical for proper development. Numerous studies have suggested that cell-extrinsic changes in the surrounding niche environment drive the termination of stem cell proliferation. By contrast, cell-intrinsic mechanisms that terminate stem cell proliferation remain poorly understood. Fruit fly larval brain neuroblasts provide an excellent model for mechanistic investigation of intrinsic control of stem cell proliferation due to the wealth of information on molecular marks, gene functions and lineage hierarchy. Sood et al. conducted a genetic screen to identify genes that are required for the termination of neuroblast proliferation in metamorphosis and found that Notch and its ligand Delta contribute to their exit from cell cycle. They showed that knocking down Notch or delta function in larval neuroblasts allows them to persist into adulthood and remain proliferative when no neuroblasts can be detected in wild-type adult brains. By carrying out a well-designed temperature-shift experiment, the authors showed that Notch is required early during larval development to promote timely exit from cell cycle in metamorphosis. The authors went on to show that attenuating Notch signaling prolongs the expression of temporal identity genes castor and seven-up perturbing the switch from Imp to Syp/E93. Finally, they showed that knocking down Imp function or overexpressing E93 can restore the elimination of neuroblasts in Notch/delta mutant brains.

      Overall, the experiments are well conceived and executed, and the data are clear. However, the data reported in this study represent incremental progress in improving our mechanistic understanding of the termination of neuroblast proliferation.

      We respectfully disagree with this statement. Because Notch signaling is implicated in neurogenesis termination and Notch activity is regulated by GMCs and glia, it strongly suggests that NB proliferation and timing cues are controlled in a non-autonomous manner through direct interactions with NBs and their neighbors. This is in contrast to temporal patterning during embryogenesis which is largely believed to be controlled NB-autonomously. In addition, to our knowledge, no one has yet reported that CB NBs fail to terminate cell divisions on time when Notch activity is reduced during normal development. In fact, reported NB phenotypes associated with Notch loss of function have been surprisingly subtle until now.

      Some of the data seem to represent more careful analyses of previously published observations described in the Zacharioudaki et al., Development 2016 paper while others seem to contradict to the results in this study.

      The Zacharioudaki et al., Development 2016 paper is terrific. One key difference between our work and theirs, is that we look at Notch pathway knockdown and loss of function phenotypes, whereas in the Zacharioudaki 2016 paper, the authors report phenotypes associated with Notch constitutive activation. It has been known for some time that constitutively active Notch leads to tumorigenic phenotypes particularly in type II lineages. Zacharioudaki and colleagues further determined that some of the classically known temporal transcription factors were ectopically expressed in these stem cell tumors.Here we show that under normal developmental conditions, Notch pathway activity controls CB NB temporal patterning.

      Gaultier et al., Sci. Adv. 2022 suggested that Grainyhead is required for the termination of neuroblast proliferation in a neuroblast tumor model, and grainyhead is a direct target of Notch signaling. Thus, Grainyhead should be a key downstream effector of Notch signaling in terminating castor and seven-up expression. Identical to Notch signaling, Grainyhead is also expressed through larval development. Grainyhead can function as a classical transcription factor as well as a pioneer factor raising the possibility that temporal regulation of neurogenic enhancer accessibility might be at play in allowing Notch signaling in early larval development to set up termination of castor and seven-up expression in metamorphosis. Diving deeper into how dynamic changes in chromatin in neurogenic enhancers affect the termination of neuroblast proliferation will significantly improve our understanding of termination of stem cell proliferation in diverse developing tissue.

      Reviewer #3 (Public Review):

      In this study, the authors investigate the effects of Notch pathway inactivation on the termination of Drosophila neuroblasts at the end of development. They find that termination is delayed, while temporal patterning progression is slowed down. Forcing temporal patterning progression in a Notch pathway mutant restores the correct timing of neuroblast elimination. Finally, they show that Imp, an early temporal patterning factor promotes Delta expression in neuroblast lineages. This indicates that feedback loops between temporal patterning and lineage-intrinsic Notch activity fine tunes timing of early to late temporal transitions and is important to schedule NB termination at the end of development.

      The study adds another layer of regulation that finetunes temporal progression in Drosophila neural stem cells. This mechanism appears to be mainly lineage intrinsic - Delta being expressed from NBs and their progeny, but also partly niche-mediated - Delta being also expressed in glia but with a minor influence. Together with a recent study (PMID: 36040415), this work suggests that Notch signaling is a key player in promoting temporal progression in various temporal patterning system. As such it is of broad interest for the neuro-developmental community.

      Strengths

      The data are based on genetic experiments which are clearly described and mostly convincing. The study is interesting, adding another layer of regulation that finetunes temporal progression in Drosophila neural stem cells. This mechanism appears to be mainly lineage intrinsic - Delta being expressed from NBs and their progeny, but also partly niche-mediated - Delta being also expressed in glia but with a minor influence. A similar mechanism has been recently described, although in a different temporal patterning system (medulla neuroblasts of the optic lobe - PMID: 36040415). It is overall of broad interest for the neuro-developmental community.

      Weaknesses

      The mechanisms by which Notch signaling regulates temporal patterning progression are not investigated in details. For example, it is not clear whether Notch signaling directly regulates temporal patterning genes, or whether the phenotypes observed are indirect (for example through the regulation of the cell-cycle speed). The authors could have investigated whether temporal patterning genes are directly regulated by the Notch pathway via ChIP-seq of Su(H) or the identification of potential binding sites for Su(H) in enhancers.

      This is already known for svp and cas and we have now included this information in the discussion.Thank you.

      “Whether Notch pathway activity curtails both Cas and Svp or just Cas remains an open question, however it has been reported that both cas and svp are associated with at least one enhancer that is responsive to Notch activity (Zacharioudaki et al., 2016).”

      A similar approach has been recently undertaken by the lab of Dr Xin Li, to show that Notch signaling regulates sequential expression of temporal patterning factors in optic lobes neuroblasts (PMID: 36040415), which exhibit a different temporal patterning system than central brain neuroblasts in the present study. As such, the mechanistic insights of the study are limited.

      Reviewer #1 (Recommendations For The Authors):

      1) There are missing controls

      a) Fig. 1F and Fig. 6A - The authors should generate and show images of control clones (FRT19A) stained with the same markers as Notch clones.

      Fig. 1F is at 48 hours APF. In control clones, there are no Dpn positive cells present, as stated in the text and therefore no confocal images are shown. Same for Fig. 6A, there are no Dpn positive cells in control clones in the brain at this time, therefore nothing to double label.

      2) This result is incorrectly described in the Results

      a) P. 5 "Ectopically persisting N RNAi CB NBs expressed the NB transcription factor Deadpan (Dpn), the S-phase indicator pcnaGFP, and were small on average, similar in size to control CB NBs at earlier pupal stages (Fig. 1B,C,E)." The Notch RNAi NBs were larger (not smaller) than controls in Fig. 1E at 30, 48, 72 h APF and in adults.

      Thank you for this comment. We have changed the language in the main text as follows:

      “Ectopically persisting N RNAi CB NBs (CB NBs at 48 hours APF and beyond) expressed the NB transcription factor Deadpan (Dpn), the S-phase indicator pcnaGFP, and were small on average compared to control CB NBs during earlier developmental stages (L3 control, average diameter 10-15μms) (Fig. 1B,C,E). However, at 30 hours APF when control CB NBs are still present, N RNAi CB NBs were larger on average (Fig. 1B,C,E).”

      3) This sentence needs clarification/editing

      a) P. 4: " Independent of neurogenesis timing and the mechanism by which CB NB stop divisions, temporal patterning plays a key role". A key role in what?

      Thank you again. We have changed the text to the following:

      “Independent of neurogenesis timing and the mechanism by which CB NB stop divisions, temporal patterning plays a key role in controlling numbers and types of neurons made within each of the NB lineages (Maurange et al., 2008; Tsuji et al., 2008; Bahrampour et al., 2017; Yang et al., 2017; Pahl et al., 2019).”

      4) Some sentences need references or data to support them.

      a) P. 9 Please provide a reference to support the statement that Delta is a known Notch target

      We have included a reference.

      b) P. 9 - please provide a reference or data to support the statement that Delta transcripts decrease over time in larval CB NBs.

      This result is shown in Fig. 7B.

      5) Fig. 7A - it is difficult to appreciate the purple highlighting.

      We have changed the colors as suggested.

      Reviewer #2 (Recommendations For The Authors):

      1) In Fig. 4C, why does late knockdown of delta lead to ectopic persistence of NBs but late knockdown of Notch has no effect?

      This could be due to many things including differences in efficiency of UAS-RNAi lines. The point is that Delta/Notch is required early, but not late. Although some DeltaRNAi CB NBs are still present, the number compared to 48 hours APF is greatly reduced.

      2) It is surprising that Delta expression in NBs/GMCs appears to play a more important role in activating Notch signaling in neuroblasts than Delta expression in cortex glia. Please explain how Delta can cell autonomously activate Notch signaling.

      We are not proposing that Delta activates Notch cell autonomously, but are proposing that Delta in GMCs transactivates Notch in NBs. After NBs divide Delta is partitioned to GMCs. Quiescent NBs have low to no Notch pathway activity, likely because they are not producing Delta expressing GMC daughters (Sood, 2022).

      Please also reconcile the difference in gene expression induced by delta[RNAi] in this study and the delta-mutant allele used in the Zacharioudaki et al study.

      We are unsure what the reviewer is asking here and therefore can not reconcile any differences in gene expression between the dlRNAi line and the mutant allele. What gene expression needs to be reconciled? Zacharioudaki is listed as first author on four manuscripts. Which paper is being referred to?

      3) In Fig. 2J-L, why does knocking down delta in glia lead to loss of Scrib expression in neuroblasts and their surrounding progeny?

      We are not sure if it does or not. We only use Scrib as a membrane marker to identify and locate cells and neuropil regions of interest.

      4) The phrase "Notch is active early" is misleading when multiple labs have shown that Notch signaling is active in neuroblasts throughout larval development.

      Good point! We have rewritten the statement: “Somewhat paradoxically, we find that early Notch activity is required to terminate CB NB divisions late.”

      5) Neuroblasts that persist into adulthood are "smaller and Dpn-positive/PCNA-GFP-positive". Are they really neuroblasts? Can the authors verify the identity of these "persistent neuroblasts" with other molecular markers as well as functional assessment by inducing lineage clones?

      We have no doubt that these cells are NBs. Because we examine brains over time, these cells can be tracked using the markers, Scrib, Dpn, and pcna. These cells also undergo asymmetric cell division (Refer to Fig. S2F) and express other markers characteristic of CB NBs (mir and insc-not shown). We have made clones and see the same phenotype (ectopic persistence) in both MARCM clones and in “flip-out” clones.

      Reviewer #3 (Recommendations For The Authors):

      I have a few issues that need to be addressed to reinforce some of the conclusions:

      1) It is unclear whether NBs that persist in late pupal or adult stages have just failed to differentiate or whether they continue to divide, leading to supernumerary progeny (as shown for NBs that are stalled in temporal patterning like in svp mutant NBs (Maurange et al. 2008)). EdU or PH3 staining could be done in adults to clarify this point.

      In this manuscript, we make use of pcna:GFP, a reporter for E2F activity as an indicator of cell proliferation. We certainly observe Dpn positive cells that only weakly express the reporter, suggesting that these cells are not actively dividing or dividing at a reduced rate. However, by far most of the ectopically persisting CB NBs strongly express the reporter and generate pcnaGFP expressing progeny, indicating that these cells are dividing. We have also stained tissues with PH3 and have included an image of a telophase dlRNAi expressing CB NB at 48 hours APF (Fig. S2F).

      2) It is unclear whether Notch signaling directly or indirectly regulates temporal transitions. One possibility is that knockdown of Notch signaling decreases cell-cycle speed leading to delayed temporal transitions. The authors should test whether Notch KD affects cell cycle speed using EdU incorporation or PH3 staining. This could be done best using Notch mutant MARCM clones as wt NBs can be used as controls.

      We have quantified the number of PH3 positive CB NBs during wandering L3 stages in control and dlRNAi animals. We find that dlRNAi CB NBs are indeed proliferating at reduced rates compared to controls. To test whether reduced cell cycle times are causative for termination delay, we expressed a constitutively active form of PI3-kinase in dlRNAi animals to drive cell growth and proliferation. We found that CB NBs still ectopically persist (Fig. S2E-G).

      We have included the following in the text:

      “Defects in timing of temporal transitions could be due to defects in cell cycle progression, although embryonic NBs still transition independent of cell division (Grosskortenhaus et al., 2005). We used PH3 to assay CB NB mitotic activity. In Delta knock down animals, the percentage of PH3 positive CB NBs was reduced compared to control (Fig. S2E). At 48 h APF however, Delta knock down CB NBs were still dividing based on PH3 expression (Fig. S2F). To determine whether CB NBs ectopically persist due to defects in cell cycle rate, we co-expressed dp110 to constitutively activate PI3-kinase in Delta knock down animals. A significant number of pcnaGFP expressing, Dpn positive CB NBs were still observed, suggesting that defects in cell cycle timing and growth rates alone cannot account for ectopic persistence of CB NBs into later developmental stages and adulthood (Fig. S2G).”

      3) Cas is expressed in NBs either during quiescence and shortly after quiescence. It is possible that the maintenance of Cas in Figure 5D, E is due to NBs that have not re-entered the cell-cycle or have exited quiescence with a strong delay.

      Knockdown of Notch pathway has no effect on CB NB reactivation from developmental quiescence. In fact, low levels of Notch are required for CB NBs to reactivate in response to dietary nutrients (Sood, 2022).

      Indeed, the authors have previously shown that Notch signaling is important for NB cell cycle reentry during early larval stages (PMID: 35112131). Are Cas and Svp also maintained in late larval N-/MARCM clones (MARCM clonew are made after quiescence exit)?

      We have not assayed Cas or Svp expression past 48 hours ALH.

      4) The authors have revisited some previously published RNA-seq data showing that Delta is temporally regulated in NB lineages. This is not clearly shown by the authors that the same is true at the protein level.

      Moreover, they find that mis-expression of late temporal factors or Imp knockdown in early larval brains appear to decrease Delta expression. Such semi-quantitative analysis of gene expression by immunostainings in different conditions can be a bit complicated and not very convincing because variations on intensity levels can be due to slight variations in antibody concentration, or different parameters of image acquisition.

      We totally agree, but in this case the difference compared to controls was so readily apparent, that we felt it was not necessary to carry out experiments in clones. All images were acquired with the same confocal settings, experiments were repeated, and we consistently observed the same results. The data shown in Fig. 7D-G is representative.

      I suggest that the authors use clonal analysis rather than pan-neuroblast manipulation in order to have internal controls. For example, blocking temporal progression in Syp-RNAi clones (MARCM or Flp-out) and/or svp MARCM clones should lead to maintenance of Imp expression in late larval clones and maintenance of high levels of Delta, which would be easily assessed compared to surrounding NBs.

      Minor points:

      Fig 5: the sequential expression of Cas and Svp expression in larval NBs was first described by Maurange et al. 2008. Please cite appropriately.

      We have now added the requested citation to the following:

      “Over time, the percentage of Cas expressing CB NBs declined, while Svp expressing CB NBs modestly increased (Fig. 5B). Less than 1% of CB NBs co-expressed Cas and Svp at any stage and expression of both factors was absent by 48 hours ALH (Fig. 5B,C). This is consistent with work published previously (Isshiki et al., 2001; Tsuji et al., 2008; Chai et al., 2013; Maurange et al., 2008; Ren et al., 2017; Syed et al., 2017).”

      Fig 6A: Please indicate which immunostainings are shown in the overlay panels.

      Good catch! We have modified the figure.

      P9: "Delta co-immunoprecipitated with Imp.": Add "Delta mRNA co-immunoprecipitated with Imp in RIP-seq experiments" Otherwise, it suggests that you are talking about the protein.

      Done

      The scheme in Figure 7H is rather complicated to understand. In my opinion, it does not clearly convey the idea that Notch signaling favors the Imp-to-Syp transition.

      We have made a new model figure.

    1. Author Response

      The following is the authors’ response to the original reviews.

      Reviewer #1 (Public Review):

      Summary:

      The precise mechanism of how tetraspanin proteins engage in the generation of discs is still an open question in the field of photoreceptor biology. This question is of significance as the lack of photoreceptor discs or defects in disc morphogenesis due to mutations in tetraspanin proteins is a known cause of vision loss in humans. The authors of this study combine TEM and mouse models to tease out the role of tetraspanin proteins, peripherin, and Rom1 in the genesis of the photoreceptor discs. They show that the absence of Rom1 leads to an increase in peripherin and changes in disc morphology. Further rise in peripherin alleviates some of the defects observed in Rom1 knockout animals leading to the conclusion that peripherin can substitute for the absence of Rom1.

      Strengths:

      A mouse model of Rom1 generated by the McInnes group in 2000 predicted a role for Rom1 in rim closure. They also showed enlarged discs in the absence of Rom1. This study confirmed this finding and showed the compensatory changes in peripherin, maintaining the total levels of tetraspanin proteins. Lack of Rom1 leads to excessive open disks demonstrated by darkly stained tannic acid-accessible areas in TEM. Interestingly, increased peripherin expression can rescue some morphological defects, including maintaining normal disc diameters and incisures. Overall, these observations lead authors to propose a model that ROM1 can be replaced by peripherin.

      Thank you for your kind summary of our work.

      Weaknesses:

      The compensatory increase in peripherin and morphological rescue in the absence of ROM1 is expected, given the previous work from authors showing i) absence of peripherin showing increased ROM1 and ii) "Eliminating Rom1 also increased levels of Prph2/RRCT: mean Prph2/RRCT levels in P30 Prph2+/R retinas were 34% of WT, while levels in Prph2+/R/Rom1−/− retinas were 59% of WT" from Conley, 2019. The current study provides a comprehensive quantitative analysis. However, the mechanism behind the mechanism is unclear and warrants discussion.

      We referenced the result from the 2019 paper by Conley and colleagues in revision. As noted by the reviewer, new information in the current study consists of the precise quantification of the compensatory increase by a technique more accurate than semi-quantitative Western blotting. The nature of these compensatory increases is currently unknown and beyond the scope of experiments described in the current study. While this is an intriguing area for future investigation, we prefer not to speculate on the underlying mechanisms to avoid any appearance of data overinterpretation.

      Photoreceptor morphology appears better when peripherin is overexpressed. Is there a rescue of rod function (assessed by ERG or equivalent measures) in peripherin OE/Rom1-/- mice? Given the extensive work in this area and the implications the authors allude to at the end, it is important to investigate this aspect.

      It is indeed an interesting and potentially translationally relevant direction to address whether PRPH2 overexpression can rescue the long-term degeneration and functional defects of the loss of ROM1. Unfortunately, our work in this direction remains severely hindered by the fact that the current line of ROM1 knockout mice are notoriously poor breeders, allowing us to get only a handful of animals for each year of breeding. Therefore, we decided to limit our current study to addressing the structural roles of ROM1 and PRPH2 in supporting disc formation.

      Reviewer #1 (Recommendations For The Authors):

      Line 210: "ROM1 is able to form disc rims in the absence of PRPH2" is not demonstrated. The data shows that the tetraspanin domains are interchangeable similar to Conley, 2019. Similar concern for lines 225-226.

      We agree with the point regarding the interchangeable tetraspanin domains and clarified it in the text by referring to the tetraspanin body of PRPH2 where applicable. However, the 2019 paper by Conley and colleagues did not show any ultrastructural images of disc rims in a mouse without at least one copy of WT PRPH2 being expressed. The presence of normally looking disc rims in the complete absence of the tetraspanin body of PRPH2 is an original observation of the present study.

      Line 234: it is unclear what is meant by .."they are normally processed in the biosynthetic membranes" How does lack of ER localization lead to this conclusion?

      We clarified this point by replacing “normally processed” with “not trapped”.

      Lines 306-308: it is difficult to follow the rationale. How will a shift in the trafficking pathway affect disulfide bonds since these are formed in ER?

      The reviewer makes a good point that at least the bulk of S-S bridge formation takes place during protein maturation in the ER and the ability of additional intramolecular S-S bond formation in the Golgi is questionable. We, therefore, removed this speculation from Discussion.

      Given the poor development of OS, the authors could provide an estimate of how many OS-like structures were observed, with and without rims, in RRCT animals.

      The gross development of outer segment structures in RRCT homozygous mice was part of the 2019 paper by Conley and colleagues. We prefer to limit repeating experiments from the previous study, but instead wanted to focus specifically on disc rim formation, which was not analyzed in RRCT homozygous mice in the previous study.

      The term "function" is loosely defined throughout this manuscript. Specifically, the excess peripherin can resolve some of the morphological defects observed in Rom1 -/-, and these functional changes in morphology are the focus of this work.

      We removed the word “function” in three occasions where there may be an ambiguity in its meaning, as noted by the reviewer.

      Lines 115/116: Reference is missing for the statement that photoreceptor cell degeneration begins at P30.

      These lines reference Figures 1A,B, which include quantification of the number of photoreceptor nuclei. These results show that ROM1 knockout retinas exhibit a modest but statistically significant degeneration at P30. The text is modified to eliminate any ambiguity.

      Lines 143-144 are speculation and could be moved to the discussion section. "Prolonged delivery of disc membrane delivery to each disc" Any reference or experiments to support this statement?

      We respectfully disagree with moving this short speculative sentence to Discussion. We believe that it helps the reader to follow the flow of the data, while being clearly presented as a potential explanation rather than a conclusion.

      Line 245-246: Results explained in the following paragraph (247-254) do not answer the question "whether disc rim formation in PRPH2 2C150S/C150S knockin mice was driven by disulfide-linked ROM1 molecules", which is a valid and intriguing question. However, the results explained in 247-254 answer the question "if C150S PRPH2 can form discs in the absence of ROM1".

      We changed the text to replace “To address this question” with “To explore whether disc rims can be formed in the absence of any disulfide-linked tetraspanin molecules”, which precisely reflects what was addressed.

      Reviewer #2 (Public Review):

      In this study, Lewis et al seek to further define the role of ROM1. ROM1 is a tetraspanin protein that oligomerizes with another tetraspanin, PRPH2, to shape the rims of the membrane discs that comprise the light-sensitive outer segment of vertebrate photoreceptors. ROM1 knockout mice and several PRPH2 mutant mice are reexamined. The conclusion reached is that ROM1 is redundant to PRPH2 in regulating the size of newly forming discs, although excess PRPH2 is required to compensate for the loss of ROM1.

      This replicates earlier findings while adding rigor using a mass spectrometry-based approach to quantitate the ratio of ROM1 and PRPH2 to rhodopsin (the protein packed in the body of the disc membranes) and careful analysis of tannic acid labeled newly forming discs using transmission electron microscopy.

      In ROM1 knockout mice PRPH2 expression was found to be increased so that the level of PRPH2 in those mice matches the combined amount of PRPH2 and ROM1 in wildtype mice. Despite this, there are defects in disc formation that are resolved when the ROM1 knockout is crossed to a PRPH2 overexpressing line. A weakness of the study is that the molar ratios between ROM1, PRPH2 and rhodopsin were not measured in the PRPH2 overexpressing mice. This would have allowed the authors to be more precise in their conclusion that a 'sufficient' excess of PRPH2 can compensate for defects in ROM1.

      Thank you for these kind comments about our work. Regarding the stated weakness that we did not measure the molar ratios between PRPH2, ROM1 and rhodopsin in the ROM1 knockout line with PRPH2 overexpression: this is one experiment that we really hoped to do but were limited by the poor breeding of the ROM1 knockout line described above. With the current breeding rate, we estimate that we would need to wait for another year to get enough material to do this experiment, which we cannot do in the context of this manuscript revision. We hope, however, that eventually this may be a part of one of our future papers.

      Reviewer #2 (Recommendations For The Authors):

      The p-value for statistical significance is not listed, readers will assume the most commonly used 0.05 value was used but this should still be defined, especially since only asterisks summarizing the p-value range are provided in place of the actual p-values.

      The definitions of various numbers of asterisks of significance (including p<0.05 as a minimal measure of significance) are provided in the Methods section, whereas the exact p-values are stated in figure captions.

      There are 3 phrasing issues that are potentially misleading.

      1) While PRHP2 and ROM1 are the most abundant tetraspanins in photoreceptors they are not the only ones. It would be more precise if for example the Table 1 title was changed to 'molar ratio of outer segment tetraspanins and rhodopsin'.

      We have changed the title of Table 1 to “Quantification of molar ratios between PRPH2, ROM1 and rhodopsin in WT and Rom1-/- outer segments” to be more accurate.

      2) The protein expressed in RRCT mice is described as the 'tetraspanin core' while the cartoon (and original paper) shows the protein as simply being ROM1 with a different cytoplasmic C-terminus (from PRHP2). Tetraspanin core in other places is used to mean just the transmembrane bundle or that bundle with the EC loops.

      We agree that the term “tetraspanin core” may be confusing. We modified the text to not use this term and, when needed, refer to this main part of the tetraspanin molecule as a “body”.

      3) Line 203-205, the 'somewhat restored' qualifier should be removed. If the authors think there is an effect that is different from chance, they should use a different alpha and justify that choice.

      We removed this line, as suggested.

      Reviewer #3 (Public Review):

      In this manuscript, Lewis et al. investigate the role of tetraspanins in the formation of discs - the key structure of vertebrate photoreceptors essential for light reception. Two tetraspanin proteins play a role in this process: PRPH2 and ROM1. The critical contribution of PRPH2 has been well established and loss of its function is not tolerated and results in gross anatomical pathology and degeneration in both mice and humans. However, the role of ROM1 is much less understood and has been considered somewhat redundant. This paper provides a definitive answer about the long-standing uncertainty regarding the contribution of ROM1 firmly establishing its role in outer segment morphogenesis. First, using an ingenious quantitative proteomic technique the authors show PRPH2 compensatory increase in ROM1 knockout explaining the redundancy of its function. Second, they uncover that despite this compensation, ROM1 is still needed, and its loss delays disc enclosure and results in the failure to form incisures. Third, the authors used a transgenic mouse model and show that deficits seen in ROM1 KO could be completely compensated by the overexpression of PRPH2. Finally, they analyzed yet another mouse model based on double manipulation with both ROM1 loss and expression of PRPH2 mutant unable to form dimerizing disulfide bonds further arguing that PRPH2-ROM1 interactions are not required for disc enclosure. To top it off the authors complement their in vivo studies by a series of biochemical assays done upon reconstitution of tetraspanins in transfected cultured cells as well as fractionations of native retinas. This report is timely, addresses significant questions in cell biology of photoreceptors, and pushes the field forward in a classical area of photoreceptor biology and mechanics of membrane structure as well. The manuscript is executed at the top level of technical standard, exceptionally well written, and does not leave much more to desire. It also pushes standards of the field- one such domain is the quantitative approach to analysis of the EM images which is notoriously open to alternative interpretations - yet this study does an exceptional job unbiasing this approach.

      According to my expertise in photoreceptor biology, there is nothing wrong with this manuscript either technically or conceptually and I have no concerns to express.

      Thank you for these incredibly kind comments.

      Reviewer #3 (Recommendations For The Authors):

      I have no recommendations to make.

    1. Author Response

      We would like to thank you and the reviewers for evaluating this manuscript and providing constructive recommendations. Please see our provisional response to the major comments made by the reviewers.

      Reviewer #1 (Public Review):

      "…the authors never show that HFS of cortical inputs has no effect in the absence of thalamic stimulation. It appears that there is a citation showing this, but I think it would be important to show this in this study as well"

      We understand that the reviewer would like us to induce an HFS protocol on cortical input and then test if there is any change in synaptic strength in thalamic input. We agree this is an important experiment which we will do.

      Reviewer #2 (Public Review):

      “…The experimental schemes in Figs. 1 and 3 (and Fig. 4e and extended data 4a,b) show that one group of animals was subjected to retrieval in the test context at 24 h, then received HFS, which was then followed by a second retrieval session. With this design, it remains unclear what the HFS impacts when it is delivered between these two 24 h memory retrieval sessions."

      We understand that the reviewer has raised the concern that the increase in freezing we observed after the HFS protocol (ex. Fig. 1b, the bar labeled as Wth+24hHFSth) could be caused or modulated by the recall prior to the HFS (Fig. 1a, top branch).

      If our interpretation of the concern is correct, we think this is unlikely to be the case. The first test, and the following HFS protocol, and the second test, (Fig. 1a, top branch) were all performed in the same chamber. For both the first and the second tests, animals received two 30-second recall trials, separated by 2 minutes (the data presented as the average of the two trials). We did not see a difference in freezing between the first and the second recall trials within each session (data not shown). It was only after the HFS protocol that we observed an increase in freezing.

      This shows that in our paradigm the first recall does not impact the next recall in terms of the animals’ freezing levels. It must be noted that in cases where we did not do any testing prior to the HFS protocol, we still observed an increase in freezing after the HFS protocol (ex. Fig. 1a, middle branch and the corresponding data in Fig. 1b, the bar labeled as Wth+HFSth). Also, relevant is the data shown in Fig. 3c. Here, although animals were tested twice (Fig3. a, top branch), there was no increase in freezing in the second test (Fig. 3c, middle panel, Wth+24HFSCtx). That is, in the absence of an effective LTP, there is no significant difference between the two tests.

      To further confirm this, in a new group of mice, 24 hours after weak conditioning, we will induce the HFS protocol, followed by testing (that is, no testing prior to the HFS protocol).

      “The final experiment (Fig. 5a-c, extended data 5c) combines behavioral assessments with in vivo LFP recordings before and 24 h after hetero-HFS. While this experiment is demanding, it seems a bit underpowered”

      We agree with the reviewer that the number of mice used in this experiment is on the lower side. However, this is not unusual for such an experimental configuration. As the reviewer mentioned, this is a demanding experiment for multiple reasons. For example, to confidently demonstrate that our HFS protocol, in addition to long-lasting behavioral changes, produces long-lasting synaptic changes, we must see a significant increase in evoked LFP after the manipulation which is predicted to last at least 24 hours. That is, the change in evoked LFP is not caused by non-related fluctuations, such as movement of the recording probe. For this reason, 3-4 days prior to conditioning, each day we measured evoked LFP. Only those mice that had a stable evoked LFP during this time were used for further conditioning. We will provide exclusion criteria for this experiment in the revised manuscript.

      “ It would be critical to know if LFPs change over 24 h in animals in which memory is not altered by HFS,..”

      We will perform an experiment where mice undergo a weak conditioning protocol and will record the evoked LFP 1-2 hours following the conditioning protocol, as well as the next day.

      “…the slice experiments (Fig. 5d-f) are not well aligned with the in vivo experiments (juvenile animals, electrical vs. opto stimulation, different HFS protocols, timescale of hours).”

      Our aim in this part was to demonstrate that the pathways we chose for our study can undergo heteroLTP. For this purpose, we used an already established protocol, which uses electrical stimulation (Fonseca, 2013). For clarification, I have tried to induce optical LTP with a high-frequency stimulation protocol in slices, but I did not succeed. I am not aware of a work that successfully induced optical LTP with a high-frequency protocol.

    1. Author Response

      The following is the authors’ response to the current reviews.

      We thank Reviewer 1 for their time reviewing our revised manuscript and appreciate their thoughtful suggestions for further clarity. In regard to the public review statement, "However, parts of the methods (e.g. assessment of blanks and data filtering) and results (e.g. visualization of plant community data) could still be polished, and the figures should be improved to increase the clarity of the manuscript", we have made small modifications in the text and figures during production of the Version of Record to address these important suggestions.


      The following is the authors’ response to the original reviews.

      Reviewer #1 (Public Review):

      This manuscript compiles the colonization of shrubs during the Late Pleistocene in Northern America and Europe by comparing plant sedimentary ancient DNA (sedaDNA) records from different published lake sediment cores and also adds two new datasets from Island. The major findings of this work aim to illuminate the colonization patterns of woody shrubs (Salicaceae and Betulaceae) in these sediment archives to understand this process in the past and evaluate its importance under future deglaciation and warming of the Arctic.

      We greatly appreciate the time and detailed consideration of our manuscript by Reviewer 1. Our responses to individual comments are highlighted in blue, with the original comments provided by the reviewer in black.

      The strength of evidence is solid as methods (sedimentary DNA) and data analyses broadly support the claims because the authors use an established metabarcoding approach with PCR replicates (supporting the replicability of PCR and thereby proving the occurrence of Salicaeae and Betulaceae in the samples) and quantitative estimation of plant DNA with qPCR (which defines the number of cycles used for each PCR amplification to prevent overamplification). However, the extraction methods need more explanation and the bioinformatic pipeline is not well-known and needs also some further description in the main text (not only referring to other publications).

      Thank you for bringing this to our attention. We have now provided greater detail on our extraction methods and bioinformatic pipeline.

      The authors compare their own data with previously published data to indicate the different timing of shrubification in the selected sites and show that Salicaceae occurs always like a pioneer shrub after deglaciation, followed by Betaluaceae with a various time lag. The successive colonization of Salicaceae followed by Betulaceae is explained by its differences in environmental tolerance, the time lag of colonization in the compared records is e.g. explained by varying distance to source areas.

      However, there are some weaknesses in the strength of evidence because full sedaDNA plant DNA assessment, quality of the sedaDNA data (relative abundance and richness of sedaDNA plant composition) and results from Blank controls (for sedaDNA) are not fully provided. I think it is important to show how the plant metabarcoding in general worked out, because it is known that e.g. poor richness can be indicative of less preserved DNA and a full plant assessment (shown in the supplement) would be more comprehensive and would likely attract a larger readership.

      Thank you for bringing these important points to our attention. The DNA dataset including the full taxa assemblage will be included with the manuscript upon publication and apologize for not including it during the review process. This dataset will also include information on positive and negative blanks used for quality control. Following suggestions from Reviewer 2, we have now also calculated some recently proposed DNA quality metrics (Rijal et al., 2021), which collectively support our earlier conclusions that our record is of sufficient quality to draw the current conclusions. We hope that the inclusion of the complete DNA dataset will indeed draw a larger readership.

      Further, it would allow us to see the relative abundance in changes of plants and would make it easier to understand if the families Salicaeae and Betulaceae are a major component of the community signal. Further, the possibility to reach higher taxonomic resolution with sedaDNA compared to pollen or to facilitate a continuous record (which is different from macrofossils) is not discussed in the manuscript but should be added. Also, the taxonomic resolution within these families in the discussed datasets would be of interest, also on the sequence type level if tax. assignments are similar.

      Thank you for these suggestions. We have focused on these two families as it is known from numerous pollen records and floras that they are the major component of the vascular plant communities in the regions investigated. Betula (birch) and Salix (willow) are indeed the most dominant woodland shrubs of the tundra biome, which covers expansive areas of the Arctic. For example, in Iceland natural woodlands, which cover 1.5% of the total land area, are composed of 80% birch shrubs (Snorrason et al. 2016, Náttúrufræðingurinn 86). Salix mixes in with Betula, especially around wet sites. Species from both genera are common and wide-spread throughout Iceland, but dwarf and cold tolerant species thrive best on the highland or at glacial sites, while shrub-like species are more common on the lowland, coastal area and in sheltered valleys. Flora of Iceland (http://www.floraislands.is/PDF-skjol/Checklist-vascular.pdf) lists Betula as the only genus of Betulaceae native to Iceland (page 79/80) and Salix as the major genus of Salicaceae (page 82-85), although Populus tremula (Salicaceae) exists in the wild but is rare (perhaps just a countable number of trees/shrubs in the whole country). The point is that, for Iceland, Betulaceae is Betula and Salicaceae is Salix, meaning that our sedaDNA method has the taxonomic resolution at the genus level. And with the help of pollen analysis of the site near Stóra Viðarvatn (the novel sedaDNA work of the present paper), i.e., Ytri-Áland site (Karlsdóttir et al. 2014), it is possible to interpret our results even to the species level, which we have only mention in the discussion. It has been suggested that matching sedaDNA results with botanical knowledge about the study site and the vegetation history (local reference database) is one way to increase taxonomic resolution of the sedaDNA approach (e.g. Elliott et al. 2023, Quaternary 6,7). In the same way we find our sedaDNA analysis having sufficient resolution to answer the questions asked in the present study. For the future, although we do not include it in the discussion this time, it should be possible to increase the taxonomic resolution of plant metabarcoding by priming multiple genes simultaneously like that is described as a proof of concept by Foster et al. (2021, Front Ecol Evol 9: 735744). In the revised version of the manuscript, we have now expanded on the power of sedaDNA in terms of increased taxonomic resolution and application in continuous lake sediment records in the introduction of the manuscript. Following Reviewer 2’s suggestion, we have now included the sequences used for taxonomic assignment in the supplement information.

      Another important aspect is how the abundance/occurrence of Salicaceae is discussed. Many studies on sedaDNA confirm an overrepresentation of this family due to better preservation in the sediment, far-distance transport along rivers, or preferences of primers during amplification etc. As this family is the major objective of this study, such discussion should be added to the manuscript and data should be presented accordingly.

      Thank you for raising this point. The reviewer is indeed correct that Salicaceae is typically overrepresented in read abundance compared to other vascular plant taxa in sedaDNA studies. However, as we mention in the Results and Interpretation section for Stóra Viðarvatn “As PCR amplification results in sequence read abundances that may not reflect original relative abundances in a sample (Nichols et al., 2018), we focus our discussion on taxa presence/absence,” we do not place weight on the indeed greater relative abundance of Salicaceae in our own dataset. As such, this different relative abundance of plant taxa reads should not influence the conclusions drawn in the manuscript.

      I also miss more clarity about how the authors defined the source areas (refugia) of the shrubs. If these source areas are described in other literature I suggest to show them in a map or so. Further, it should be also discussed and explained more in detail which specific environmental preferences these families have, this is too short in the introduction and too unspecific. Also, it would be beneficial to show relative abundances rather than just highlighted areas in the Figures and it would allow us to see if Salicaeae will be replaced by Betulaceae after colonizing or if both families persist together, which might be important to understand future development of shrubs in these areas.

      Thank you for allowing us to clarify. As the regions studied with the lake sediment records shown in this manuscript were all covered by extensive ice sheets during the Last Glacial Maximum (LGM, Fig. 1), plant refugia and source areas must have been located somewhere south of the ice sheet margins. Thus, we calculate our distance to source as the minimum distance from a lake site to land beyond the extent of the ice sheet during the LGM. This has now been clarified in the text and highlighted in Fig. 1. We have also added in the discussion molecular results from Thórsson et al. (2010, J Biogeogr 37) on possible source origins of Betula in Iceland. Details on taxa environmental preferences have now been expanded upon in the Discussion section where we explore the various trait-based factors that may influence the relative differences in colonization timing between Salicaceae and Betulaceae. We have now also edited Figs. 3 and 4 to include PCR replicates instead of highlighted bars to better compare the DNA and pollen datasets from Iceland.

      The author started a discussion about shrubification in the future, but a more defined evaluation and discussion of how to use such paleo datasets to predict future shrubification and its consequences for the Arctic would give more significance to the work.

      Thank you for this suggestion and allowing us to expand on potential future changes. We have now edited this final section of the paper to provide a little more detail on how we envision these records being used to predict future shrubification and climate change.

      Reviewer #1 (Recommendations For The Authors):

      I list some more specific details here.

      You speak about "read counts", I guess you used relative abundance of read counts, you should state it like this.

      Thank you for allowing us to clarify. The data that we refer do in terms of read counts is from the previously published studies in the circum North Atlantic. The data provided from these studies is raw read counts, and not relative abundance.

      Line 100: What do you mean here: "temperature changes in prior warm periods"?

      Thank you for allowing us to clarify. We have rephrased to sentence to “higher temperature in prior warm periods”, which we hope is clearer for the reader.

      Line 134: How is DNA diluted by minerogenic sediment? Did the sedimentation rate increase? Typically minerogenic input should be beneficial for DNA preservation.

      Thank you for allowing us to clarify. These samples were primarily comprised of tephra glass with minimal organic content. While we agree that minerogenic sediment is generally beneficial for DNA preservation, the predominance of inorganics (tephra) that fell from the sky, rather than being washed into the lake from the landscape, would not carry organic sediment with it. We have rephrased the sentence to make this clearer.

      I would suggest adding more citations to the text (for example statements in lines 106, 110, 368)

      Thank you for the suggestion. The manuscript has been edited accordingly.

      Better divide your discussion part: discussion about dispersal mechanisms occur in both sections. Maybe you could divide it into environmental factors for colonization and traitbased factors (only an idea).

      Thank you for the suggestion. We have now edited the second dispersal section to “Environmental dispersal mechanisms” to be clearer about our focus on factors such as wind, sea ice, and birds that may transport the seeds across the North Atlantic. The previous section retains the trait-based factors that may influence relative timing in colonization between Salicaceae and Betulaceae.

      Which type of sequencing did you use, paired-end 76bp is unknown to me.

      Methods have now been edited to clarify this, along with details related to extraction methods as requested in the Public Review.

      Reviewer #2 (Public Review):

      Harding et al have analysed 75 sedaDNA samples from Store Vidarvatn in Iceland. They have also revised the age-depth model of earlier pollen, macrofossil, and sedaDNA studies from Torfdalsvatn (Iceland), and they review sedaDNA studies for first detection of Betulaceae and Salicaceae in Iceland and surrounding areas. Their Store Vidarvatn data are potentially very interesting, with 53 taxa detected in 73 of the samples, but only results on two taxa are presented. Their revised age-depth model cast new light on earlier studies from Torfdalsvatn, which allows a more precise comparison to the other studies. The main result from both sedaDNA and the review is that Salicaceae arrives before Betulaceae in Iceland and the surrounding area. This is a well-known fact from pollen, macrofossil, and sedaDNA studies (Fredskild 1991 Nordic J Bot, Birks & Birks QSR 2014, Alsos et al. 2009, 2016, 2022) and as expected as the northernmost Salix reach the Polar Desert zone (zone A, 1-3oC July temperature) whereas the northernmost Betula rarely goes beyond the Southern Tundra (zone D, 8-9 oC July temperature, Walker et al. 2005 J. Veg. Sci., Elven et al. 2011 http://panarcticflora.org/ ).

      We greatly appreciate the time and detailed consideration of our manuscript by Reviewer 2. Our responses to individual comments are highlighted in blue, with the original comments provided by the reviewer in black.

      While we agree that previous studies have indeed indicated a relative delay in Betula colonization relative to Salix, most of these have relied on pollen and macrofossil evidence, which are complicated to use as proxies for the first appearance of a given taxa (see our Introduction in the main manuscript). A few studies have shown this also with sedaDNA (e.g., Alsos et al., 2022), which is a more robust proxy for a plant taxa’s presence, but these have been limited geographically (e.g., northern Fennoscandia). In our study, we show that this pattern is reflected in 10 different lakes across the North Atlantic, emphasizing the broad nature of Betula’s delayed colonization relative to other woody shrubs, such as Salix.

      My major concern is their conclusion that lag in shrubification may be expected based on the observations that there is a time gap between deglaciation and the arrival of Salicaceae and between the arrival of Salicaceae and Betulaceae. A "lag" in biological terms is defined as the time from when a site becomes environmentally suitable for a species until the species establish at the site (Alexander et al. 2018 Glob. Change Biol.). The climate requirement for Salicaceae highly depends on species. In the three northernmost zones (A-C), it appears as a dwarf shrub, and it only appears as a shrub in the Southern Tundra (D) and Shrub Tundra (E) zone, and further south it is commonly trees. Thus, Salicaceae cannot be used to distinguish between the shrub tundra and more northern other zones, and therefore cannot be used as an indicator for arctic shrubification. Betulaceae, on the other hand, rarely reach zone C, and are common in zone D and further south. Thus, if we assume that the first Betulaceae to arrive in Iceland is Betula nana, this is a good indicator of the expansion of shrub tundra. Thus, if they could estimate when the climate became suitable for B. nana, they would have a good indicator of colonisation lags, which can provide some valuable information about time lags in shrub expansion (especially to islands). They could use either independent proxy or information from the other species recorded in sedaDNA to reconstruct minimum July temperature (see e.g. Parducci et al. 2012a+b Science, Alsos et al. 2020 QSR).

      We appreciate the reviewer’s insight into the implications of our use of the word “lag”. Indeed, as we do not have site-specific climate timeseries for each lake record, we have adjusted our wording to “delay”, which we believe is more general and descriptive of our observations. We recognize the importance of independent paleotemperature records for each lake, but these are not yet available for all records, so we prefer to keep our study focused on the delay instead. In addition, we prefer not to derive temperature records from the vegetation sedaDNA records, as these are not independent and will incorporate changes driven by additional factors, such as soil and light (e.g., Alsos et al., 2022). We have added some text to the final section on Future Outlook that elaborates on the need for complimentary records of past climate to pair with paleoecological records of colonization. We hope that this motivates the community to pursue these lines of research that we agree are needed.

      The study gives a nice summary of current knowledge and the new sedaDNA data generated are valuable for anyone interested in the post-glacial colonisation of Iceland. Unfortunately, neither raw nor final data are given. Providing the raw data would allow re-analysing with a more extensive reference library, and providing final data used in their publication will for sure interest many botanists and palaeoecologist, especially as 73 samples provide high time resolution compared to most other sedaDNA studies.

      Finally, the raw and final data, including blank controls, used in our study for Stóra Viðarvatn will ultimately be provided with the manuscript’s publication. We apologize for not including it with the original submission.

      Reviewer #2 (Recommendations For The Authors):

      Line 112-113: Difference in northward expansion rate is not the same as lag. Thus, your conclusion "As a result, the biospheres role in future high latitude temperature amplification may be delayed." does not derive directly from the data you present.

      Thank you for allowing us to clarify our wording. We have rephrased the sentence to align with our results more closely as stated in the Abstract of the manuscript.

      .Line 133: From Figure S3, it looks like three or possibly four samples failed.

      Thank you for pointing this out. First, we realized that the DNA reads originally included in Figure S3 were from after filtering. We have now updated the figure to include the total raw reads, which is a better indicator of DNA reliability (Rijal et al., 2021). Based on the total raw reads, only two samples failed with total reads of 2 and 5.

      Line 141: You say you focus on presence/absence, but you do show quantitative results for Salix and Betula (0-5 PCR repeats) in Figure 2.

      Thank you for allowing us to clarify. Fig 2 shows the number of replicates that meet our criteria for taxa presence, where a higher number of replicates corresponds to a higher likelihood of presence.

      Line 142: Where are the other 51 taxa shown?

      We are providing the full DNA record in the supplement, which will be published alongside the main manuscript. We have also now included a plot of species richness against sample depth in Fig. S2.

      Line 178-179: Note that the revised date of first detection is close to what has been previously published (Salix ~10300 vs. 10227, Betula ~9500 vs 9680), so it does not make any changes to previous interpretation.

      Yes, this is true. However, we still believe it is important to always consider improvements in age models to best correlate the timing of events between different paleo records.

      Line 191-194 and Figure S2: I leave the evaluation of revised age-depth model to the geologist.

      As this aspect was not commented on, we assume that both reviewers are satisfied.

      Line 197: "Delay" is a more correct word than "lag".

      Thank you, edited.

      Line 210: Where do 1700 and 2500 come from? If your revised age of ice retreat is 11 800, and your revised date of Salix and Betula arrival are ~10 300 and ~9500, I make this 1500 and 2300.

      Yes, this is correct. Thank you for pointing out this error.

      Line 215-217: To be more certain about any bias caused by low DNA quality, I suggest you explore your data using the tools presented in Rijal et al. 2021 Science Advances. As you do not provide your data, I cannot evaluate the quality of them.

      Thank you for the suggestion. We have now calculated the various DNA quality indices developed by Rijal et al. (2021). This has been added to the methods and results section for the Stóra Viðarvatn record, as well as in Fig. S3. The MTQ and MAQ scores are known to correlate with species richness when richness is low (n<30, Rijal et al., 2021), which is likely an artifact of the requirement that the 10 best represented barcode sequences are required to calculate these scores. As this correlation is observed in our dataset and given that our species richness is low (n<30, Fig. S2), the low MTQ and MAQ score are not likely indicative of low-quality DNA. We therefore judge the quality of our DNA on total raw reads and CT values, which remain relatively constant through time (Fig. S2).

      Line 226: Do you mean TDV?

      We intended to omit unnecessary abbreviations throughout the manuscript, such as lake names, in our original manuscript. We have now changed TORF, which we use as the lake’s abbreviation, to the full lake name, Torfdalsvatn.

      Line 282-283: Given that the basal sediments of Nordivatnet are marine (Brown et al. 2022 PNAS Nexus), even a low detection may be a strong indication of local presence.

      Thank you for this point. However, to standardize the records and compare across a wide range of geographical and depositional settings, we prefer to apply the same criteria for the taxa’s presence to each lake as outlined in our Methods.

      Line 289: See the definition of "lag"

      Changed to “delayed” per your earlier suggestion. Thank you.

      Line 298-303: I agree that the late appearance of Betula at Langfjordvatnet (10 000 cal BP) is anomalously long and a bit unexpected given that it is found at five other lakes in the region 13000-10200 cal BP (Alsos et al. 2022). However, a likely explanation is the lack of area with stable soil - B. nana requires a greater degree of soil development compared to other heath shrubs (Whittaker 1993) and Langfjordvatnet is surrounded by steep scree slopes (Otterå 2012 master thesis Univ. Bergen). At Jøkelvatnet, Salix appears in the four available samples from 10453 to 9811 whereas Betula arrives 9663. Here, the arrival of Betula is just at the drop of local glacier activity and at the temperature rise, suggesting that it arrives immediately after the climate becomes suitable (Elliott et al. 2023 Quaternary). Thus, based on N Fennoscandia where we have more data available, it does not show lags and does not support delayed shrubification (which contrasts with what we have shown for many other species including common dwarf shrubs, see Alsos et al. 2022). Would be very interesting to have similar data from Iceland, which has a large dispersal barrier.

      Thank you for these further considerations. We have incorporated those related to Langfjordvannet into the manuscript accordingly. We also appreciate the point regarding Jøkelvatnet. However, as stated in our Methods section for “Published sedaDNA datasets”, we do not include Jøkelvatnet in our comparison due to the impact of glacier activity as the reviewer notes: “Finally, both Jøkelvatnet and Kuutsjärvi were impacted by glacial meltwater during the Early Holocene when woody taxa are first identified (Wittmeier et al., 2015; Bogren, 2019), and thus the inferred timing of plant colonization is probably confounded in this unstable landscape by periodic pulses of terrestrial detritus.” Due to the glacier’s presence in the lake catchment, it is not possible to discern whether delay in Betulaceae would have occurred if the glacier were not present. Therefore, we prefer to keep this record excluded from our comparisons.

      Line 316-319 and 344: Based on contemporary genetic patterns, Alsos et al. analyse the relative importance of adaptation to dispersal compared to other factors.

      Thank for you bringing up this important point. We have now expanded our discussion to include these analyses from Alsos et al. (2022).

      Line 342+350: Original publication is Alsos et al. 2007 Science

      Thank you, edited.

      Line 343: Alsos et al. 2009 Salix study is the wrong citation here. Eidesen et al. 2015 Mol. Ecol. shows phylogeography of Greenland population but not Baffin - I am not aware of any contemporary genetic studies of Betula from Baffin.

      Thank you for pointing this out. We will also include the Eidesen et al. (2015) citation for reference to Greenland. However, there is one data point included for southern Baffin Island in Alsos et al. (2009), so we will retain this citation here as well.

      Line 351-353: See comment about Betula from Baffin above. Also, I am not sure I follow here - what do you mean by "these populations" - the Svalbard ones or Iceland? Eidesen et al. 2015 is the wrong citation for Salix - use Alsos et al. 2009. Alsos et al. 2009 suggest Iceland (and E Grenland) was colonized from north Scandinavia, although this was uncertain as no data were available from Faroe/Shetland. Svalbard was colonized from N Fennoscandia (Alsos et al. 2007).

      Regarding Baffin Island sources, we refer the reviewer to our response to their previous comment. We have clarified the wording of our sentence from “these populations” to “the modern populations from these locations [Baffin Island, Greenland, and Svalbard]”. We have removed reference to Eidesen et al. (2015), as this is for Betula rather than Salix. Finally, we have added a citation for Alsos et al. (2007) here for Svalbard.

      Line 354-355: AFLP suggest that Baffin and W Greenland were colonised from a refugia south of the Wisconsin Ice Sheet, see Alsos et al. 2009.

      Yes, we are aware, thank you. Our reference to “mid-latitude North America” in the sentence acknowledges this refugia, but we have now added “south of the Laurentide Ice Sheet” for further clarification.

      Line 363-381: See comment above; your Store Vidarvatn data do currently not demonstrate a lag between environmental suitability and climate, but using the rest of the DNA record, potentially it could. Would also be good to reflect on the distance to the source area for shrubs Late Glacial/Early Holocene compared to now.

      Thank you for these suggestions. We have edited this section of the manuscript to elaborate on the need for independent climate reconstructions as well as the fact that distances to plant refugia are shorter now than during the last postglacial period.

      Line 396-416: I am not an expert on tephra so I will not comment on this part.

      As this aspect was not commented on, we assume that both reviewers are satisfied.

      Line 459-457: Please provide results of how much data is lost at each step of filtering.

      We added the read loss following each filtering step as a table in the supplemental information (Table S4).

      Throughout the manuscript, you go only to species level although DNA in most cases is able to distinguish to genus level within Salicaceae and Betulaceae - which sequences did you identify?

      Sequences are now provided in the supplemental for Salicaceae and Betulaceae. Based on our bioinformatic pipeline, reference library and requirement for 100% match between sequence and taxonomy, we were only able to distinguish between species level.

      Figure 2: The detection of Betulaceae is very sporadic in Stóra Vidarvatn with occurrence in only seven samples and hardly ever in all 5 repeats, suggesting that if you apply a statistical model to estimate first arrival (see Alsos et al. 2022), you will have a large confidence interval. Thus, these uncertainties should be considered when estimating the delayed arrival of Betula compared to Salix. The data from Torfdalsvatn (which I assume are from Alsos et al. 2021 although not specified in the figure legend), shows detection in all samples from the first appearance and mostly in 8 of 8 repeats (shown in the original publication - you could to the same here), thus providing a more accurate estimate for the time gap between arrival of Salix and Betula.

      Thank you for bringing up this important point. The detection of Betulaceae is indeed sporadic, but we believe it reflects the genuine nature of its presence/absence during the Holocene in Northeast Iceland. This is supported by Betula pollen from a nearby peat record that shows a similar history (Fig. 4, Karlsdóttir et al., 2014), which we have now elaborated on in the Results and Interpretation section. As for the timing of Betulaceae colonization at this site, the first appearance in the DNA record should be a close minimum estimate as shown with modern DNA and plant survey comparisons (e.g., Sjögren et al., 2017; Alsos et al., 2018). The true first appearance could be biased by small amounts of plants being present in the early stages of colonization and not registering the sedimentary record until enough dead plant material is transported to the depocenter of the lake. However, this is likely less than age model uncertainties and therefore not likely relevant on geologic timescales as in this study. In this sense, our age models and those published for the other records indicate this is generally on the order of several hundred years. In addition, we have now added the Alsos et al. (2021) reference for Torfdalsvatn. Unfortunately, this Torfdalsvatn study does not provide number of PCR repeats so we will keep the figure as is as it best represents the available data.

      Figure 5: I suggest adding lake names to the figure. Is there a dot missing for lake 5 for Salicaceae?

      Thank you for the suggestion, we have added lake names to the figure. There is a dot marked for Salicaceae for lake 5, however, not for Betulaceae as this taxon was not identified. We refer the reviewer to the Discussion Section “Postglacial sedaDNA records from the circum North Atlantic” and the lake’s original publication (Volstad et al., 2020).

      Figure 6: I find it more relevant to plot colonization time versus distance to LGM sheetice margin - lake number is just an arbitrary number.

      We appreciate the suggestion and have modified the figure accordingly.

    1. Author Response

      The following is the authors’ response to the original reviews.

      Reviewer #1 (Public Review):

      In the present manuscript, Abele et al use Salmonella strains modified to robustly induce one of two different types of regulated cell death, pyroptosis or apoptosis in all growth phases and cell types to assess the role of pyroptosis versus apoptosis in systemic versus intestinal epithelial pathogen clearance. They demonstrate that in systemic spread, which requires growth in macrophages, pyroptosis is required to eliminate Salmonella, while in intestinal epithelial cells (IEC), extrusion of the infected cell into the intestinal lumen induced by apoptosis or pyroptosis is sufficient for early pathogen restriction. The methods used in these studies are thorough and well-controlled and lead to robust results, that mostly support the conclusions. The impact on the field is considered minor as the observations are somewhat redundant with previous observations and not generalizable due to cited evidence of different outcomes in other models of infection and a relatively artificial study system that does not permit the assessment of later time points in infection due to rapid clearance. This excludes the study of later effects of differences between pyroptosis and apoptosis in IEC such as i.e. IL-18 and eicosanoid release, which are only observed in the former and can have effects later in infection.” We thank the reviewer for their time and effort in assessing our manuscript.

      We agree with the reviewer’s overall assessment. One minor clarification is that the engineering used does not express the proteins in “all growth phases”, but rather only when the SPI2 T3SS is expressed; we used the sseJ promoter, which is a SPI2 effector.

      Reviewer #2 (Public Review):

      In this study, Abele et al. present evidence to suggest that two different forms of regulated cell death, pyroptosis and apoptosis, are not equivalent in their ability to clear infection with recombinant Salmonella strains engineered to express the pro-pyroptotic NLRC4 agonist, FliC ("FliC-ON"), or the pro-apoptotic protein, BID ("BID-ON"). In general, individual experiments are well-controlled, and most conclusions are justified. However, the cohesion between different types of experiments could be strengthened and the overall impact and significance of the study could be articulated better. ”

      We thank the reviewer for their time and effort in assessing our manuscript. We agree with the reviewer’s overall assessment.

      Reviewer #1 (Recommendations For The Authors):

      Abstract: While new terms are sometimes useful for the visualization of concepts and I appreciate the "bucket list" analogy, it is not yet an accepted term in cell death research, and using it twice in the abstract seems out of order. ”

      We opted to keep the term, but reduce its use to once in the abstract with a specific comment on the recent coining of the term: “We recently suggested that such diverse tasks can be considered as different cellular “bucket lists” to be accomplished before a cell dies.” We recently coined this term in a review in Trends in Cell Biology, where three reviewers had quite positive comments about the concept. Time will tell whether this is a useful term for the cell death field or not.

      “In figure 2C-F Caspase 1 and Gsdmd deficient animals have higher levels of vector control strain than WT or Nlrc4. Could this be due to the redundancy with Nlrp3 in systemic infection described by Broz et al? Please mention in the description of the results.”

      The reviewer correctly points out a trend in the data. However, our experiments are not powered to show that this difference is statistically significant. Nevertheless, we now make note of the trend, and cite prior papers that have observed NLRC4 and NLRP3 redundancy against non-engineered S. Typhimurium strains.

      “The observation that apoptosis does not affect Salmonella systemically would be strengthened if the experiments using the BIDon strain could be taken out to a later time point, i.e. 72 or 96 h.”

      Indeed, we wanted to extend our studies to these timepoints. However, although expression of the SspH1 translocation signal is benign for 48 h, by 72 h this causes mild attenuation (regardless of whether the BID-BH3 domain is attached as cargo). We think that the degree of difficulty for SPI2 effectors to reprogram the vacuole increases over time, and that only beyond 48 h does SPI2 need to function at peak efficiency. This observation will be reported in a second manuscript that is written and will be submitted within this month. We are happy to supply this manuscript to reviewers if they would like to see the results. We also added text to the discussion to alert the reader to the caveats of engineering S. Typhimurium at later timepoints.

      “Discussion: The authors claim that pyroptotic and apoptotic signaling in IEC have the same outcome and IEC only has extrusion as a task. However, upon pyroptosis, IEC also releases IL-18 and eicosanoids, which is not the case during apoptosis. While the initial extrusion makes all the difference in early infection, Mueller et al 2016 showed that lack of IL-18 has an effect on salmonella dissemination at a 72h time point. The FlicON model can not test later time points as the bacteria will be cleared by then, but this caveat should be discussed.”

      We revised the text in the discussion to make it clear that extrusion is not the only bucket list item for IECs, and that IL-18 and eicosanoids are included in the bucket list for IECs after caspase-1 activation, and add the citation to Muller et al.

      Reviewer #2 (Recommendations For The Authors):

      1) The manuscript is written in a rather colloquial style. Additional editing is recommended. ”

      We edited the abstract to limit the use of the bucket list term and to make more clear that this is a new term that our lab has proposed in a recent review in Trends in Cell Biology. The managing editor for the current manuscript at eLife commented that the prose was lively and thoughtful. We would be happy to make edits if the reviewer has more specific suggestions.

      2) It is not obvious from the Results section that all mouse infections were, in fact, mixed infections. This should be stated more clearly. Additionally, there is a minor concern regarding in vivo plasmid loss over time.

      We added text to the results to make this clearer at the beginning of each in vivo figure in the paper. Our experiments are intentionally blind to any Salmonella that have lost the plasmid. These bacteria essentially convert to a wild type phenotype, and thus are no longer representative of FliCON or BIDON bacteria. We also verify the long established equal competition between pWSK29 (amp) and pWSK129 (kan) in Supplemental Figure 2A-B. Prior experiments from the laboratory of Sam Miller and others in the 1990s showed that plasmid loss occurs at a rate of less than 1%.

      3) Results shown in Figure 4 are difficult to interpret. Essentially, the experiment is aimed at comparing the two engineered Salmonella strains (FliC-ON and BID-ON). However, these strains are very different from one another, which may have a confounding effect on the interpretation of the data.”

      The reviewer has interpreted the experiment correctly. We wanted to make clear to the reader that the two strains induce apoptosis under different kinetics. Indeed, it would be very surprising if two different engineering methods created strains that caused apoptosis with identical kinetics. We make two text edits to the results to make this clearer, concluding with “Overall, both ways of achieving apoptosis are successful in vitro, but with slightly different kinetics.”.

      4) What new insights into mechanisms of bacterial pathogenesis and host response are gained by using recombinant Salmonella (over)expressing a pro-apoptotic protein is not clearly stated.”

      We modify the introduction to make this more clear, stating: “Here, we investigate whether apoptotic pathways could be useful in clearing intracellular infection. Because S. Typhimurium likely evades apoptotic pathways, we again use engineering in order to create strains that will induce apoptosis. This allows us to study apoptosis in a controlled manner in vivo.”

      5) The Discussion section, while provocative, seems speculative and should be revised. Concepts of "backup apoptosis" and crosstalk between pyroptosis and apoptosis are intriguing, but it seems implausible to this reviewer that a cell might "know" that it will die, might "choose" how to die, and might aim to complete a "bucket list" before it loses all functional capacity. The usage of these types of terms does not help bolster the authors' central conclusions. ”

      We agree that cells do not “choose” pathways for regulated cell death. We had over-anthropomorphized the concepts surrounding these interconnected cell death pathways that are created by evolution. We edited the introduction and discussion to remove the “choose” term. However, we kept the second phrase using “know” in the discussion with an added clarifier: “Once a cell initiates cell death signaling, it “knows” that it will die (or rather evolution has created signaling cascades that are predicated upon the initiation of RCD).”. Sometimes anthropomorphizing scientific concepts can be a useful tool to facilitate understanding of complex scientific concepts. For example, the “Red Queen hypothesis” clearly anthropomorphizes the concept of continuous evolution to maintain an evolutionary equilibrium. We have found that scientists in the cell death field often think that modes of cell death are or should be interchangeable. We hope that the idea of the “bucket list” will help to crystalize the idea that distinct processes leading up to different types of regulated cell death can have very different consequences during infection.

      Additional Comments from the Reviewing Editor:

      1) The authors show that FliC-ON is not cleared from the spleen of Casp1 KO or Gsdmd KO mice. The conclusion is that the backup apoptosis pathways that should be present in these mice are insufficient to clear the bacteria from the spleen. However, although it is shown that bone marrow macrophages undergo apoptosis in vitro, I believe it is not shown that the apoptotic pathways are actually activated in the spleen. This seems like an important caveat. Could it be shown (or has it previously been shown) that the cells infected in the spleens of Casp1 KO or Gsdmd KO are activating apoptosis? If not, it seems possible that the reason the bacteria are not cleared is due to a lack of apoptosis activation rather than an ineffectiveness of apoptosis, and the authors could consider explicitly acknowledging this.”

      We agree, and added to the discussion “A final possibility is that our engineered strains are not successfully triggering apoptosis within splenic macrophages. This could be due to intrinsic differences between BMMs and splenic macrophages or could be due to bacterial virulence factors that fail to suppress apoptosis only in vitro. It is quite difficult to experimentally prove that apoptosis occurs in vivo due to rapid efferocytosis of the apoptotic cells.”

      2) Both reviewers were somewhat unhappy about some of the new terminology/metaphors that are introduced in the manuscript. I understand the reviewers' concerns but also feel that the writing is lively and thoughtful. It is up to the authors to decide whether to retain their new terminology, but the response of two expert reviewers might give the authors some pause. At a minimum, to address the concern about an unfamiliar term being used in the abstract, perhaps explicitly state that you are introducing "bucket list" as a new concept to help explain the results. The introduction of this concept may indeed be one of the novel contributions of the manuscript.”

      We opted to keep the term, but reduce its use to once in the abstract with a specific comment on the recent coining of the term: “We recently suggested that such diverse tasks can be considered as different cellular “bucket lists” to be accomplished before a cell dies.” We recently coined this term in a review in Trends in Cell Biology, where three reviewers had quite positive comments about the concept. Time will tell whether this is a useful term for the cell death field or not.

      3) Perhaps this is implied in the discussion already, but it might make sense to state the obvious difference between IECs and splenic macrophages which is that the death of the former results in the removal of the cell and its contents (i.e., Salmonella) from the tissue, whereas the death of the latter does not. This seems like the simplest explanation for why apoptosis restricts bacterial replication in IECs but not macrophages, and I am not sure if introducing the concept of a "bucket list" improves the explanation or not.”

      We agree that this narrative nicely distills the differences between these cell types. We edited the final paragraph of the discussion to include this narrative.

      4) Lastly, some minor comments

      -- p.2 "hyperactivate" instead of "hyperactive"?”

      Corrected.

      -- the authors may also want to mention Shigella, as it might provide another example that apoptotic C8dependent backup protects IECs”

      Yes, indeed, this is a good comparison to make. We added this to the discussion.

      -- p.8, in case readers are unfamiliar with the concept of a PIT, the authors should perhaps cite their own work when they first mention this concept (at the top of the page)”

      Indeed, citation added.

    1. Author Response

      The following is the authors’ response to the original reviews.

      We are very grateful to the reviewers for their thoughtful comments on the manuscript and to the editors for their assessment.

      We thank the reviewers for their positive feedback and appreciate that they consider our method a valid addition to previously established systems for generating recombinant RNA viruses.

      To strengthen this point, we have now included additional validation by the rescue of recombinant Chikungunya and Dengue virus from viral RNA directly, using the CLEVER protocol. This strengthens the potential of this method as a reverse genetics platform for positive-stranded viruses in general.

      The supportive data has been amended in the Results section, taken into account in Materials and Methods, and the corresponding supplementary figure (Figure S4) has been added.

      One key point raised by one of the reviewers, a comparison with different systems, could not be addressed in this manuscript as our lab does not at all perform BAC cloning. We currently do not have the necessary expertise to conduct an unbiased side-by-side comparison.

      All other comments were addressed in detail, either by including additional data or through specific clarification in the revised text. We are grateful for the careful review and constructive criticisms raised by the reviewers and feel that the corrections and additions have significantly improved the manuscript.

      We have revised the latest version posted May 30, 2023 on bioRxiv (https://doi.org/10.1101/2023.05.11.540343).

      Reviewer #1:

      Public Review:

      In this manuscript, Kipfer et al describe a method for a fast and accurate SARS-CoV2 rescue and mutagenesis. This work is based on a published method termed ISA (infectious subgenomic amplicons), in which partially overlapping DNA fragments covering the entire viral genome and additional 5' and 3' sequences are transfected into mammalian cell lines. These DNA fragments recombine in the cells, express the full length viral genomic RNA and launch replication and rescue of infectious virus.

      CLEVER, the method described here significantly improves on the ISA method to generate infectious SARS-CoV2, making it widely useful to the virology community.

      Specifically, the strengths of this method are:

      1) The successful use of various cell lines and transfection methods.

      2) Generation of a four-fragment system, which significantly improves the method efficiency due to lower number of required recombination events.

      3) Flexibility in choice of overlapping sequences, making this system more versatile.

      4) The authors demonstrated how this system can be used to introduce point mutations as well as insertion of a tag and deletion of a viral gene.

      5) Fast-tracking generation of infectious virus directly from RNA of clinical isolates by RT-PCR, without the need for cloning the fragments or using synthetic sequences.

      One weakness of the latter point, which is also pointed out by the authors, is that the direct rescue of clinical isolates was not tested for sequence fidelity.

      The manuscript clearly presents the findings, and the proof-of-concept experiments are well designed.

      Overall, this is a very useful method for SARS-CoV2 research. Importantly, it can be applicable to many other viruses, speeding up the response to newly emerging viruses than threaten the public health.

      We thank the reviewer for this positive feedback and the summary of the main points. Nevertheless, we would like to comment on point 5): “the direct rescue of clinical isolates was not tested for sequence fidelity”

      This impression by the reviewer suggests that the data was not sufficient on this point. However, the sequence fidelity after direct rescue from RNA was indeed tested in this study, even on a clonal level (please see: Table S2, or raw NGS data SRX20303605 - SRX20303607). For higher clarity, we added the following sentence to the manuscript:<br /> “Indeed, a slight increase of unintentional mutations was observed when sequencing clonal virus populations rescued from RNA directly”.

      Recommendations for the authors:

      Minor Points:

      1) On page 8, the authors write: "levels correlated very well with the viral phenotype". This sentence is not clear. Please clarify what you mean by "viral phenotype". Do you mean CPE on Vero cells?

      We corrected the sentence to: “(…) staining intensity and patterns correlated very well with the wild-type phenotype.”

      2) Page 9 "sequences were analyzed with a cut-off of 10%. Cutoff of what? please clarify.

      The sentence was rephrased to: “(…)mutations with a relative abundance of >10% in the entire virus population were analyzed”

      3) Page 15: The authors refer to the time required for completion of each step of the process. It would be helpful and informative for the readers to include a panel in figure 4, visualizing the timelines.

      We included a timeline in Figure 4, Panel A.

      4) Materials and methods, first paragraph: Please specify which human samples were collected. Do the authors refer to clinical virus isolates?

      We added the following information to the Materials and Methods section:<br /> “Human serum samples for neutralization assays were collected from SARS-CoV-2 vaccinated anonymous donors (…)”

      Clinical virus isolates (Material and Methods; Virus) were used for control experiments, neutralization assays, or as templates for RT-PCR.

      5) Supplementary figure 4A: The color scheme makes it hard to differentiate between the BA.1 and BA.5 fragments. Please choose colors that are not as similar to each other.

      Colors were adapted for better distinction.

      Reviewer #2:

      Public Review:

      The authors of the manuscript have developed and used cloning-free method. It is not entirely novel (rather it is based on previously described ISA method) but it is clearly efficient and useful complementation to the already existing methods. One of strong points of the approach use by authors is that it is very versatile, i.e. can be used in combination with already existing methods and tools. I find it important as many laboratories have already established their favorite methods to manipulate SARS-CoV-2 genome and are probably unwilling to change their approach entirely. Though authors highlight the benefits of their method these are probably not absolute - other methods may be as efficient or as fast. Still, I find myself thinking that for certain purposes I would like to complement my current approach with elements from authors CLEVER method.

      The work does not contain much novel biological data - which is expected for a paper dedicated to development of new method (or for improving the existing one). It may be kind of shortcoming as it is commonly expected that authors who have developed new methods apply it for discovery of something novel. The work stops on step of rescue the viruses and confirming their biological properties. This part is done very well and represents a strength of the study. The properties of rescued viruses were also studied using NSG methods that revealed high accuracy of the used method, which is very important as the method relies on use of PCR that is known to generate random mistakes and therefore not always method of choice.

      What I found missing is a real head-to-head comparison of the developed system with an existing alternatives, preferably some PCR-free standard methods such as use of BAC clones. There are a lot of comparisons but they are not direct, just data from different studies has been compared. Authors could also be more opened to discuss limitations of the method. One of these seems to be rather low rescue efficiency - 1 rescue event per 11,000 transfected cells. This is much lower compared to infectious plasmid (about 1 event per 100 cells or so) and infectious RNAs (often 1 event per 10 cells, for smaller genomes most of transfected cells become infected). This makes the CLEVER method poorly suitable for generation of large infectious virus libraries and excludes its usage for studies of mutant viruses that harbor strongly attenuating mutations. Many of such mutations may reduce virus genome infectivity by 3-4 orders of magnitude; with current efficiencies the use of CLEVER approach may result in false conclusions (mutant viruses will be classified as non-viable while in reality they are just strongly attenuated).

      We thank reviewer 2 for the careful review of our work and the valuable feedback. We agree that a direct comparison with other (PCR-free) methods such as BAC cloning, could be useful for demonstrating the unique benefits of the CLEVER method. However, as our laboratory does not use any BAC or YAC cloning methods, we could not ensure an unbiased side-byside comparison using different techniques.

      We would like to highlight the avoidance of any yeast/bacterial cloning steps that render the CLEVER protocol significantly faster and easier to handle. A visualization of the key steps that could be skipped using CLEVER in comparison to common reverse genetics methods is given in Figure 6.

      Further, we firmly believe that the benefits of the CLEVER method become especially apparent for large viral genomes such as the one of SARS-CoV-2, where assembly, genome amplification and sequence verification of plasmid DNA are highly inefficient and more timeconsuming than for small viruses like DENV, CHIKV or HIV.

      We agree with the reviewer that the overall transfection and recombination efficiencies observed with CLEVER seemed rather low. Although data on transfection/rescue efficiency is known for many techniques and viruses, we did not find any published data on the reconstitution of SARS-CoV-2 or viruses with similar genome sizes. Therefore, a useful comparator for our observations in relation to other techniques is currently simply missing. We therefore emphasize that the efficiencies of CLEVER were achieved with one of the largest plus-stranded RNA virus genomes, and our data can’t be directly compared to transfection efficiencies of short infectious RNAs.

      On the contrary, it was rather interesting to observe the very high rescue efficiency of infectious virus progeny. During the two years of establishing and validating the CLEVER protocol, we reached success rates for the genome reconstitution after transfection of >95 %. This was even obtained with highly attenuated mutants including rCoV2∆ORF3678 (joint deletion of ORF3a, ORF6, ORF7a, and ORF8) (Liu et al., 2022)(see Author response image 1). We amended this data in response to the reviewers’ comment and as an example of the successful rescue of an attenuated virus from five overlapping genome fragments (fragments A, B, C, D1, and D2∆ORF3678).

      The latter data were not added to the main manuscript since in this case the deletions were introduced using a different method: from the plasmid-based DNA fragment D2∆ORF3678 and not directly from PCR-based mutagenesis.

      Further, CLEVER was used for related substantial manipulations, including the complete deletion of the Envelope gene (E) which led to the creation of a single-cycle virus that may serve as a live, replication-incompetent vaccine candidate (Lett et al., 2023).

      Author response image 1.

      rCoV2∆ORF3678. Detection of intracellular SARS-CoV-2 nucleocapsid protein (N, green) and nuclei (Hoechst, blue) in Vero E6TMPRSS2 cells infected with rCoV2∆ORF3678 by immunocytochemistry. Scalebar is 200 µm in overview and 50 µm in ROI images.

      Recommendations for the authors:

      The work is nicely presented and the method authors has developed is clearly valuable. As indicated in Public review section the work would benefit from direct comparison of CLEVER with that of infectious plasmid (or RNA) based methods; direct comparison of data would be more convincing that indirect one. Authors should also discuss possible limitations of the method - this is helpful for a reader.

      We were not able to perform a direct comparison of CLEVER with other methods (see our statement above).

      We added the following section to the discussion: “Along with the advantages of the CLEVER protocol, limitations must be considered: Interestingly, virus was never rescued after transfecting Vero E6 cells, as has been observed previously (Mélade et al., 2022). Whether this is due to low transfection efficiency or the cell’s inability to recombine remains to be elucidated. Other cell lines not tested within this study will have to be tested for efficient recombination and virus production first. Further, the high sequence integrity of rescued virus is highly dependent on the fidelity of the DNA polymerase used for amplification. The use of other enzymes might negatively influence the sequence integrity of recombinant virus, as it has been observed for the direct rescue from viral RNA using a commercially available onestep RT-PCR kit. Another limitation when performing direct mutagenesis is the synthesis of long oligos to create an overlapping region. Repetitive sequences, for example, can impair synthesis, and self-annealing and hairpin formation increase with prolonged oligos.”

      Some technical corrections of the text would be beneficial. In all past of the text the use of terms applicable only for DNA or RNA is mixed and creates some confusion. For example, authors state that "the human cytomegalovirus promoter (CMV) was cloned upstream of 5' UTR and poly(A) tail, the hepatitis delta ribozyme (HDVr) and the simian virus 40 polyadenylation signal downstream of the 3' UTR". Strictly speaking it is impossible as such a construct would contain dsDNA sequence (CMV promoter) followed by ssRNA (5'UTR, polyA tail and HDV ribozyme) and then again dsDNA (SV40 terminator). So, better to be correct and add "sequences corresponding to", "dsDNA copies of" to the description of RNA elements

      We thank the reviewer for the advice but would like to state that in scientific language it is common to assume that nucleic acid cloning is based on DNA.

      We have corrected the description in the Methods section: “The human cytomegalovirus promoter (CMV) was cloned upstream of the DNA sequence of the viral 5’UTR; herein, the first five nucleotides (ATATT) correspond to the 5’UTR of SARS-CoV. Sequences corresponding to the poly(A) tail (n=35), the hepatitis delta virus ribozyme (HDVr), and the simian virus 40 polyadenylation signal (SV40pA) were cloned immediately downstream of the DNA sequence of the viral 3’UTR.”

      For ease of reading and for consistent terminology, we kept the original spelling in the rest of the manuscript.

      In description of neutralization assay authors have used temperature 34 C for incubation of virus with antibodies as well as for subsequent incubation of infected cells. Why this temperature was used?

      The following sentence was added (Materials and Methods; Cells): “A lower incubation temperature was chosen based on previous studies (V’kovski et al., 2021).”

      References

      Lett MJ, Otte F, Hauser D, Schön J, Kipfer ET, Hoffmann D, Halwe NJ, Ulrich L, Zhang Y, Cmiljanovic V, Wylezich C, Urda L, Lang C, Beer M, Mittelholzer C, Klimkait T. 2023. Single-cycle SARS-CoV-2 vaccine elicits high protection and sterilizing immunity in hamsters. doi:10.1101/2023.05.17.541127

      Liu Y, Zhang X, Liu J, Xia H, Zou J, Muruato AE, Periasamy S, Kurhade C, Plante JA, Bopp NE, Kalveram B, Bukreyev A, Ren P, Wang T, Menachery VD, Plante KS, Xie X, Weaver SC, Shi P-Y. 2022. A live-attenuated SARS-CoV-2 vaccine candidate with accessory protein deletions. Nat Commun 13:4337. doi:10.1038/s41467-022-31930-z

      V’kovski P, Gultom M, Kelly JN, Steiner S, Russeil J, Mangeat B, Cora E, Pezoldt J, Holwerda M, Kratzel A, Laloli L, Wider M, Portmann J, Tran T, Ebert N, Stalder H, Hartmann R, Gardeux V, Alpern D, Deplancke B, Thiel V, Dijkman R. 2021. Disparate temperaturedependent virus–host dynamics for SARS-CoV-2 and SARS-CoV in the human respiratory epithelium. PLoS Biol 19:e3001158. doi:10.1371/journal.pbio.3001158

    1. Author Response

      The following is the authors’ response to the original reviews.

      Note to reviewer and editor:

      In the previous version of the manuscript, we referred to ‘prevalent’ disease at baseline (e.g., prevalent cardiovascular disease). We have since changed this throughout the manuscript to ‘past or prevalent’ disease. This is a more accurate description as we ascertained diseases which occurred prior to baseline but may have been resolved by the time of the accelerometry study.

      Responses to reviewer 1:

      • I assume that not every participant provided data on all 7 nights. Did the authors exclude those who had fewer number of nights with accelerometer data (e.g., only 2-3 days), as the SRI based on fewer nights may not reliably reflect sleep regularity compared with SRI based all 7 consecutive nights?

      It is correct that not every participant provided complete accelerometry data. Most participants (88%) provided complete data. We only included participants who provided at least 2 valid measurements of the SRI (requiring valid data for at least 2 pairs of contiguous 24-hour periods). This is described in the appendix, but we have additionally now added this detail to the main text:

      “Most participants (88%) provided complete accelerometry data. Participants with fewer than two valid SRI measurements (i.e., less than 2 contiguous 24-hour wear periods; <1%) were excluded.”

      We would also like to note that our statistical analysis accounted, to some extent, for the lower reliability of SRI estimates in those with fewer nights of data. In those with sparse data, their estimated average SRI value would be pulled towards the overall sample average relatively more than for those with complete data. This is a consequence of the ‘partial pooling’ of the linear mixed effects model.

      • The primary analysis and results were based on restricted cubic spline models that allow assessment of nonlinearity. This is different from the usual strategy that starts with the simpler linear relationship and further explores potential nonlinear relationships. Did the authors have a strong rationale for a nonlinear dose-response relationship between sleep regularity and mortality, so that the assessment of linear relationships was skipped?

      We chose to model the SRI with a restricted cubic spline for two reasons. Firstly, we did expect non-linearity to be present a-priori. Partly this was because other sleep exposures (especially sleep time) have known non-linear relationships with health outcomes. We also thought that it is was plausible that a ‘plateau’ might be present, which we wanted to capture. Secondly, we decided that our primary model should be sufficiently flexible from the outset in order that we did not need to make data-driven adjustments to our model specification (e.g., adding non-linear terms depending on the results of hypothesis tests). This approach we believe to be generally safer as making data-driven changes can undermine the validity of standard errors and p-values.1

      • Was the proportional hazards assumption violated in the Cox modeling? Were discrete-time hazard models used to address the violation of the modeling assumption? Please clarify.

      Yes, the proportional hazards assumption was violated for all models except for the cardiovascular disease death model. This was the rationale for the use of the discrete time hazards model. They allowed for the inclusion of a flexible time by SRI interaction, allowing the hazard ratio to vary over the follow-up period. We have made this clearer in our revision. The following text has been added to the statistical methods:

      “In addition to Cox models, discrete-time hazards models, including an interaction between SRI and time (aggregated into 3-month intervals and modeled with a restricted cubic spline with knots at the 5th, 35th, 65th, and 95th percentiles), were fitted to relax the assumption of proportionality and allow hazard ratios (HRs) to vary over time. The SRI by time interaction in this model provided a test of proportionality (a small p value would indicate strong evidence against the proportional hazards assumption).”

      • Please provide correlations between different sleep regularity measures. Although different measures lead to the same conclusion, it is interesting that SRI appeared to provide stronger signals with mortality than the other two SD measures. In addition to what was discussed by the authors, another possibility is that SRI also captures the regularity of napping during the day which is common in older populations.

      Thank you for this helpful suggestion. We have added a correlation matrix for the different sleep regularity measures (Table S1). We have additionally added the following text to the Results:

      “The SRI was modestly negatively correlated with the sleep duration SD (-0.32) and sleep onset time SD ( 0.42; see correlation matrix in Table S1).”

      Regarding napping during the day, the algorithm we used to make determinations of sleep and wake unfortunately is not able to identify napping. This is because, in the absence of a sleep diary, it is very difficult to distinguish napping from inactivity in accelerometry data. The algorithm that we used requires the estimation of a ‘sleep period time window’, defining the period from the beginning to the end of the main sleep bout, in which sleep can be identified. Any sleep outside of this window is treated as inactivity. While some methods have been developed to estimate napping time from accelerometry without a sleep diary, we are not aware of any that are validated for adults using wrist worn accelerometers.

      This is something that was not sufficiently clear from the current manuscript. We have had added the following text to ensure this is clear in the revised version.

      Methods:

      “To distinguish sleep from sustained periods of inactivity without reference to a sleep diary (not available in the UKB), GGIR uses an algorithm to determine a daily ‘sleep period time window’ for each participant.11 This defines the time window between the onset and end of the main daily sleep period, during which periods of sustained inactivity are interpreted as sleep. The algorithm does not, by default, detect bouts of sleep outside of this window and hence is not able to identify naps.”

      Discussion:

      “In addition, sleep diaries in the UKB were not available. Consequently, the algorithm we used to determine sleep and wake relied on the identification of a main ‘sleep period time window’ and did not identify napping..”

      • Table 1 - I would suggest adding additional columns showing the variable distributions across quantiles of the SRI, which can help understand the confounding structure and the covariate associations with SRI.

      We agree that this is a good idea and we have adjusted Table 1 accordingly.

      • Figure 1 and related supplemental Figures: it would be good to label in the figure the specific HR estimate and 95% CI mentioned in the manuscript.

      Thank you for this suggestion. We agree that this would be helpful. After some consideration, we have decided to leave the figures as they are for one primary reason. This is that we want to avoid over-emphasising the 5th and 95th quantiles. As discussed above, we chose to present HRs for these quantiles as they would provide a complement to the Figures which would assist in communication (for some readers, the key results might be easier to glean from these numeric summaries than from the Figures). However, we don’t wish to overemphasise these quantiles when the full ‘dose-response’ function we believe to be of the greatest interest.

      • Additional stratified analyses by main sociodemographic factors (age, sex, SES, etc) and sleep variables (sleep duration and sleep quality) would be informative to understand the population heterogeneity in the association between sleep regularity and mortality

      Thank you for this suggestion. We have assessed effect modification across a range of key background variables (age, sex, household income, sleep duration, moderate to vigorous physical activity, prevalent CVD, and prevalent cancer). This has been added to the results. Where meaningful evidence of effect modification was noted, we have presented results within strata of the effect modifier.

      • Some brief discussion on socioeconomic aspects of sleep is needed (the authors focused on the biological mechanisms underlying the observed association), as emerging evidence suggests that sleep health is not only a biological but also a social construct. For example, a recent study in the US found that sleep regularity is the most important contributor to racial/ethnic disparities in sleep health (see PMID: 34498675).

      We agree that sleep health is both a biological and social construct. We have added the following text to the discussion to address this comment:

      Discussion:

      “Furthermore, identifying the determinants of poor sleep regularity may be of import, not only considering biological factors, but broader social determinants that impact circadian rhythmicity (e.g., racial/ethnic disparities32, neighbourhood factors33) and consequently overall health.”

      References

      1. Harrell FE. Regression modeling strategies: with applications to linear models, logistic regression, and survival analysis. vol 608. Springer; 2001.
    1. Author Response

      The following is the authors’ response to the original reviews.

      Reviewer #1 (Public Review):

      The manuscript by Hage et al. presents interesting results from a foraging behavior in Marmosets that explores the interactions of saccade and lick vigor with pupil dilation and performance as well as a marginal value theory and foraging theory-inspired value-based decision-making model thereof. The results are generally robust and carefully presented and analyses, particularly of vigor, are carefully executed.

      The authors constructed a model that makes two predictions: "In summary, this simple theory made two sets of predictions: in response to an increased cost of harvest, one should work longer, but move with reduced vigor. In response to an increased reward value, as in hunger, one should also work longer, but now move with increased vigor." Their behavioral data meets these predictions. It is not clear if the model was designed and tweaked in order to make those predictions and match the data, or derived from principles. Furthermore, it is not clear what other models would make similar predictions. It would help to assess what is predicted by other simple models, as well as different functional forms for the effort costs in their model.

      We chose this formulation of utility (Eq. 1) because it is a normative approach that ecologists have used to understand the decisions that animals make regarding how far to travel for food, what mode of travel to use, and how long to stay before moving on to another reward opportunity (Richardson and Verbeek 1986; Stephens and Krebs 1986; Bautista et al. 2001). In a typical formulation of the theory, the numerator represents the reward gained (in units of energy), minus the effort expended (also in units of energy). The denominator represents the amount of time spent during that behavior. We represented this idea in Eq. (1) with saccades that produced reward accumulation, and licks that produced reward consumption. Thus, the utility that we are trying to maximize is the rate of energy gained.

      The specific functions that we used to represent the energy acquired through reward acquisition, and the energy expended through effort expenditure, came a priori either from experiment design, or from the measurements we have made in other experiments. We modeled reward accumulation as a linear rise in energy stored because successful saccades produced a linear increase in the food cache. We modeled consumption of the food as a hyperbolic function of the number of licks to represent the fact that as the licking bout began, each successful lick depleted the food, and thus the first few licks produced a greater amount of food consumption than the last few licks. We modeled the effort cost of licking to grow linearly with the number of licks.

      A critical assumption that we made is that energy spent performing the saccade trials (which grew faster than linearly as a function of the number of trials attempted), grew faster than the time spent attempting those same trials (which grew linearly with the number of trials). This assumption is based on the heuristic that the average rate of energy lost following a large number of attempted trials is greater than the average rate of energy lost following a small number of attempted trials.

      Sensitivity to parameter values: The model’s simplicity provides closed-form solutions across all parameter values, allowing one to make predictions without having to fit the model to the measured data. For example, for all parameter values that produce a real solution (as opposed to imaginary), the optimal number of saccade trials increases with the square root of the cost of licking. Thus, the basic prediction of the model is that in order to maximize the capture rate, an increase in the effort that it takes to harvest the reward should produce a greater willingness to work longer, caching more food. The closed-form solutions are presented in the Mathematica supplementary document.

      Other models of utility: In composing our utility (Eq. 1), we chose to combine reward and effort additively. This is in contrast to other approaches in which effort discounts reward multiplicatively (47–49). Here, let us show that multiplicative interactions may have the limitation that they are incompatible with the observation that reward invigorates movements. To compare additive and multiplicative approaches, let us consider an arbitrary function 𝑈(𝑇) that specifies how effort varies with movement duration. Typically, this is a U-shaped function that describes energy expenditure as a function of movement duration, as in Shadmehr et al. (2016). In the case of multiplicative interaction between reward and effort, we can consider the following representation of utility:

      In the above formulation, reward 𝛼 is discounted hyperbolically with time, and an increase in reward increases the utility of the action. The optimum movement vigor has the duration 𝑇∗ that maximizes this utility. Notably, because increasing reward merely scales this utility, it has no effect on vigor. Thus, a utility in which reward is multiplied by a function of effort generally fails to predict dependence of movement vigor on reward.

      Line 37 page 6; the link of pupil to NE/LC is tenuous. Other modulators systems and circuits may be equally important and should be mentioned (e.g. Reimer, Jacob, Matthew J. McGinley, Yang Liu, Charles Rodenkirch, Qi Wang, David A. McCormick, and Andreas S. Tolias. "Pupil fluctuations track rapid changes in adrenergic and cholinergic activity in cortex." Nature communications 7, no. 1 (2016): 13289.)

      Reimer et al. (2016) used two-photon microscopy to measure activity of ACh and NE projections in layer 1 of mouse visual cortex while tracking pupil diameter fluctuations. During stillness, elevated pupil diameter was followed by cholinergic and noradrenergic axonal activity. Notably, NE activity levels were larger and with shorter latency than ACh. In primates, Joshi et al., (2016) recorded from LC during a fixation task. Using spike-triggered averaging, they found that following a spike in an LC neuron, there was pupil dilation at 200-300 ms latency. Moreover, microstimulation in LC produced pupil dilation at 500ms latency. More recently, Breton-Provencher and Sur (2019) provided causal evidence that LC activity drives pupil size. They optogenetically activated (1s) or silenced (5 sec) locus coeruleus noradrenergic neurons and found strong increase in pupil size or modest decrease: increase had a slow time scale of 1 second or more, similar slow timescale for decrease. The LC-NA neurons are surrounded by GABA-ergic neurons. Stimulation of the GABA-ergic neurons produced mild, slow constriction. They identified GABA-ergic and NA neurons by photo-tagging and then tried to identify them via spike shape and found that “spike shape of some GABA neurons were not well separated from NA neurons, demonstrating the difficulty of cell-type identification based on spike shape alone.” They noted that a subset of GABAergic neurons received coincident inputs with the NA neurons. When the GABA neurons were excited, the gain of the pupil response to an auditory tone was diminished, producing an increase as a function of tone intensity that had a lower gain. Thus, LC-NA neurons causally drive pupil size, and the GABA neurons that surround them control the gain of the response of LC-NA neurons to arousal stimuli.

      Line 35 page 6-page 7 line 10 emphasizes a cognitive interpretation of the pupil dilations that is emphasized, in relation to effort costs. But there are also more concomitant vigorous movements. Could all of their pupil results be explained by motor correlates? This should be tested and ruled out before making cognitive interpretations.

      Pupil dilation is a proxy for activity in the brainstem neuromodulatory system (Vazey et al., 2018) and is a measure of arousal (Mathot, 2018). Control of pupil size is dependent on spiking of norepinephrine neurons in locus coeruleus (LC-NE): an increase in the activity of these neurons produces pupil dilation (Joshi et al., 2016; Breton-Provencher and Sur, 2019). Some of these neurons show a transient change in their activity when acquisition of reward requires expenditure of physical effort (Bornert and Bouret, 2021). However, the link between effort costs and pupil size appears to go beyond motor control, as a recent paper found that pupil size increases during effortful speech perception (Contadini-Wright et al., 2023). Thus, although in our work increases in pupil size were always associated with increased movement vigor, the results from other studies suggest that economic variables such as cognitive effort in tasks in which there is no concomitant movement also drive an increase in pupil size.

      Page 7, line 37-42: How would the model need to be modified in order to account for this discrepancy with the data? Ideally, this would be tested.

      We comment on potential modifications that can be made to the model that may account for the discrepancy referred to by the reviewer in the discussion section: “Notably, some of the predictions of the theory did not agree with the experimental data. An increased effort cost did not accompany a reduction in the duration of harvest, and hunger did not increase saccade vigor robustly. Indeed, earlier experiments have shown that if the effort cost of harvest increases, animals who expend the effort will then linger longer to harvest more of the reward that they have earned (2). This mismatch between observed behavior and theory highlights some of the limitations of our formulation. For example, our capture rate reflected a single work-harvest period, rather than a long sequence. Moreover, the capture rate did not consider the fact that the food tube had finite capacity, beyond which the food would fall and be wasted. This constraint would discourage a policy of working more but harvesting less. Finally, if we assume that a reduced body weight is a proxy for increased subjective value of reward, it is notable that we observed a robust effect on vigor of licks, but not saccades. A more realistic capture rate formulation awaits simulations, possibly one that describes capture rate not as the ratio of two sums (sum of gains and losses with respect to sum of time), but rather the expected value of the ratio of each gain and loss with respect to time (Bateson et al., 1995 & 1996).”

      Page 9, line 2-11: In this section, it would help to also consider 'baseline' pupil size (in between trials). This would give a signal that is not 'contaminated' by movements, and may reflect control state. Relatedly, changes in control state may impact and confound the movement-related dilation magnitudes due to e.g. floor and ceiling effects on pupil size, which has a strong tendency for reversion to the mean.

      The experiment design included little or no between-trial periods because during the trials the subjects worked (performed saccades to accumulate reward), while after completing a few trials they stopped working and started harvesting through licking. Because primates make saccades during their entire wake state, it is probably not possible to find a significant period in which the subjects do not make any movements. We selected a window of 500 ms around each lick in the harvest period, and each saccade during the work period, and computed the average pupil size per movement, which includes data from both before and after movements. We then computed a within-session z-score by normalizing these measures by the average pupil size acquired for that day.

      The hunger-related and reward-size related analyses are both heavily confounded since they were not manipulated directly and could co-vary with many latent factors. For example, why might a given Marmoset be lower weight on a given day? Could it affect sleep, stress, activity, or other factors during the preceding 24 hours? If so, could these other variables be driving the results that are interpreted as 'hunger?' Relatedly, since the reward size is determined by the animals behavior on each trial (how much they worked), factors (internal brain state, external noises, etc.) that alter how much they worked will influence the subsequent reward size. Therefore interpretations about reward expectancy are confounded. Both of these issues should be discussed and manipulations of them (different feeding schedules and reward size-work functions proposed, respectively).

      Weight of the subjects was measured prior to the start of the experiment on each day. The natural fluctuations are typically the result of factors such as time of the experiment and corresponding weight measurement (AM vs PM) relative to the time of feeding on the previous day, day of the week of the experiment (following a weekend vs. during the week), and volume of food given during the previous day. Animals were maintained at 90% of their baseline weight during food restriction, and fluctuations typically occurred within that range (Sedaghat-Nejad et al., 2019). We used weight as a proxy for hunger, and thus value of reward, and the resulting analyses yielded results consistent with predictions made by our model, as seen in Fig. 5. Critically, other factors that may co-vary with lower weights, like those mentioned by the reviewer (sleep conditions, stress levels, and activity levels) often lead to very poor task performance by the subjects. In sharp contrast, the model predicted increased work period, and increased movement vigor for high reward value, both of which we observed when the subject’s weight was low. Thus, a low relative weight did not seem to impair performance, but rather act as a motivating factor. Subjects were closely monitored for well characterized stress-related behaviors and impaired attentive states by experimenters, veterinarian staff, and caretaker staff, and, in the event of abnormalities, were removed from food restriction and experimentation until behavior stabilized.

      Effect of reward size: As you noted, we did not manipulate reward size directly. Rather, because our emphasis was on quantifying the effect of effort, the subjects received the same increment of reward per each completed trial, but on some sessions this reward was easy to harvest, while in other sessions the reward required greater effort to harvest. Because the reward amount accumulated during the work period, some harvests encountered a small amount of reward, while other harvests encountered a large amount of reward. Indeed, the amount of reward available for harvest depended linearly on the number of successful saccade trials completed during the work period. We found that the vigor of licks grew with the reward magnitude.

      A major issue is a lack of alternative models. The authors seem to have constructed a particular model designed to capture the behavioral patterns they observed in the data. The model fails in some instances, as they point out. Even more importantly, there are no results or discussion about how other plausible models could or couldn't fit the data. The lack of model comparisons makes it difficult to interpret the conclusions or put the results in a broader context.

      To model behavior, we chose a formulation of utility that represented a normative approach that ecologists have used to understand the decisions that animals make regarding how far to travel for food, what mode of travel to use, and how long to stay before moving on to another patch. In the model, the objective of decisions and actions is to maximize the sum of reward acquired, minus the efforts expended, divided by time. This is termed the capture rate. However, there are other models to consider, and thus we added a new section titled Model formulation and Other models of utility.

      Reviewer #2 (Public Review):

      The model proposed in the paper takes a very specific functional form that is neither motivated by the previous literature nor particularly useful for indexing the behavioral tendencies of individual monkeys (or of the same monkey in different contexts). For example, while it is clear that the saccade effort cost will need to outgrow the increase in the utility of the accumulated food for the monkey to start feeding, it is unclear why this needs to be modeled with a fixed quadratic exponent on the number of saccades? Similarly, why do licks deplete the food stash with the specific rate hard-coded in the model?

      We added a section titled Model formulation and Other models of utility to better explain the rationale behind the model.

      We chose this formulation of utility (Eq. 1) because it is a normative approach that ecologists have used to understand the decisions that animals make regarding how far to travel for food, what mode of travel to use, and how long to stay before moving on to another reward opportunity (Richardson and Verbeek, 1986; Stephens and Krebs, 1986; Bautista et al., 2001). In a typical formulation of the theory, the numerator represents the reward gained (in units of energy), minus the effort expended (also in units of energy), while the denominator represents the amount of time spent during that behavior. We represented this idea in Eq. (1) with saccades that produced reward accumulation, and licks that produced reward consumption. Thus, the utility that we aim to maximize is the rate of energy gained.

      The specific functions that we used to represent the energy gained through reward acquisition, and the energy expended through effort expenditure, came either from experiment design, or from the measurements we have made in other experiments. We modeled reward accumulation as a linear rise in energy stored because successful saccades produced a linear increase in the food cache. We modeled consumption of the food as a hyperbolic function of the number of licks to represent the fact that as the licking bout began, each successful lick depleted the food, and thus the first few licks produced a greater amount of food consumption than the last few licks. We modeled the effort cost of licking to grow linearly with the number of licks.

      A critical assumption that we made is that energy expended performing the saccade trials (which grew faster than linearly as a function of the number of trials attempted), grew faster than the time spent attempting those same trials (which grew linearly with the number of trials). This assumption is based on the heuristic that the average rate of energy lost following a large number of attempted trials is greater than the average rate of energy lost following a small number of attempted trials. A quadratic function is one example of such a function, which has the advantage of providing closed form solutions for the optimal policy.

      The model’s simplicity provided closed-form solutions across all parameter values, allowing us to make predictions without having to fit the model to the measured data. Critically, for all parameter values that produce a real solution (as opposed to imaginary), the optimal number of saccade trials increases with the square root of the cost of licking. Thus, the basic prediction of the model is that to maximize the capture rate, regardless of parameter values, an increase in the effort required for harvest should be met with a greater willingness to work. The closed-form solutions are presented in the supplementary document (simulations.nb).

      Finally, the proportion of successful saccades and lick events is assumed to be fixed, even though it very likely to be directly influenced by movement speed (speed- accuracy trade-off), which is also contained in the model. It would strongly increase the plausibility and potential impact of the model if the authors could clearly state where these hard-coded model terms come from. Ideally, they would formulate the model in more general terms and also consider other functional forms, as briefly suggested in the discussion. This latter point would be particularly important since not all model predictions were actually borne out in the data.

      Thank you for this excellent suggestion. Regarding saccades, contrary to the speed accuracy trade-off hypothesis, we found that faster saccades were also more accurate (Fig. 3C). Thus, increased pupil size was not only associated with more vigorous saccades, but also more accurate saccades. Importantly, these vigor-related changes in accuracy were too small to affect the probability of reward: the reward area for the saccades was much larger (1.5 deg) than the endpoint accuracy changes that was produced due to changes in the food tube distance. For example, on average saccade vigor changed from 0.95 to 1.05 when the food tube distance changed from 12 mm to 8 mm. These changes in vigor would produce a fraction of degree reduction in endpoint error (Fig. 3C).

      Regarding licks, we added new data to the manuscript to assess the relationship between vigor of the licks and endpoint accuracy. We saw no consistent relationship, across subjects or effort conditions, between protraction speed and the outcome of a lick, that is, if the lick was successful in making it inside the tube. On average, in subject R we observed an improvement in lick accuracy with increased vigor, and in subject M we saw no change (Fig. 4F). Thus, we used the average success rate of licks, which was roughly 30% for both subjects.

      The authors derive qualitative predictions, by simulating their model with apparently arbitrary parameters. They then test these qualitative predictions with conventional statistics (e.g., t-tests of whether monkeys lick more for high vs low effort trials). The reader wonders why the authors chose this route, instead of formulating their model with flexible parameters and then fitting these to data. This would allow them (and future researchers) to test their model not just qualitatively but also quantitatively, and to compare the plausibility of different functional forms. The authors certainly have enough data and power to do this, given the vast number of sessions the monkey completed.

      The model’s simplicity provides closed-form solutions across all parameter values, allowing one to make predictions without having to fit the model to the measured data. For example, for all parameter values that produce a real solution (as opposed to imaginary), the optimal number of saccade trials increases with the square root of the cost of licking. Thus, the basic prediction of the model is that to maximize the capture rate, an increase in the effort that it takes to harvest the reward should produce a greater willingness to work longer, caching more food. The closed-form solutions are presented in the Mathematica supplementary document.

      The effort manipulation chosen by the authors (distance of food tube) goes hand in hand with a greater need for precision since the monkey's tongue needs to hit an opening of similar size, but now located at a greater distance. This raises the question of whether the monkeys moved slower to enhance its chance of collecting the food (in line with a speed-accuracy trade off). The manuscript would benefit from an explicit test of this possibility, for example by reporting whether for each of the two conditions, the speed of tongue movements on a trial-by-trial basis predicts the probability of food collection? At the very least, the manuscript should explicitly discuss this issue and how it affects the certainty with which effects of tube distance can be linked to anticipated effort cost alone.

      Thank you for the excellent point. We looked for but found no consistent relationship, across subjects or effort conditions, between protraction speed of the tongue and the success probability of a lick (probability of insertion into the tube). Regardless, we agree with you that it is an excellent alternate hypothesis that reductions in lick vigor that accompanied increased distance of the tube may be due to a desire to maintain accuracy, and not a reflection of increased effort cost of reward. To incorporate this idea into the model, we would need a measure of speed-accuracy for the licks, something that we do not have but hope to develop in the future.

      However, perhaps the most interesting aspect of our results is that when we increased tube distance, making reward more effortful, there was not only a reduction in lick vigor, but also a reduction in saccade vigor. That is, the decisions and actions during the work period responded to the increased effort cost of reward during the harvest period. These changes accompanied dilation of the pupil, both in the work period and in the harvest period. We now include a paragraph regarding this in the Discussion.

      The manuscript measures pupil dilation in a time period ranging from -250ms before to 250 ms after saccade onset. However, the pupil changes strongly during saccade execution relative to the preceding baseline, leaving doubts as to whether the aggregated measure blurs several interesting and potentially different effects. It would be more conclusive if the manuscript could report the analyses of pupil size separately for a period prior to saccade onset and during/after the saccade.

      Our goal was to test for general correlations between the state of the pupil and both movement vigor and decisions. We chose a window of 500 ms around saccade onset, as referred to by the reviewer, as it allowed us a large enough time window to measure pupil size outside of the movement itself (~30 ms duration), to accurately capture the state of the animal around initiation and end of a saccade. Critically, pupil tracking during a saccade itself, when using infrared eye tracking techniques, can be prone to slight measurement error in certain cases due to tracking jitter. Thus, averaging across this window, following processing of the signal, results in a more accurate measure of pupil size.

  3. Oct 2023
    1. Author Response

      The following is the authors’ response to the original reviews.

      We appreciate the critical review of our manuscript. We believe that we have addressed the questions and concerns raised by the reviewers to the best of our ability. As part of the revision, we conducted two new experiments to enhance the rigor of the conclusions and to provide more insights into the mechanism of STEAP proteins, and we reorganized the Results section, as suggested by the reviewers, following to a clearer logical thread. The new data are briefly summarized below.

      1) Reduction of L230G STEAP1 by reduced FAD. We made Leu230Gly STEAP1 mutant and measured the rate of heme reduction by reduced FAD. We found that the rate of heme reduction in L230G STEAP1 is slower than that in the wild type STEAP1. Since Leu230 is solvent accessible only from the intracellular side, this result supports the conclusion that reduced FAD binds to STEAP1 on the intracellular side and reduces the heme. This result also indicates that leucine, which is found at the equivalent position in STEAP1, 2 and 3, and Phe359 in STEAP4, has a significant role in mediating electron transfer from FAD to the bound heme.

      2) Reduction of STEAP2 by reduced FAD. We showed that STEAP2 can be reduced when supplied with reduced FAD, and that the rate of heme reduction is significantly slower than that of reduction of STEAP1 by reduced FAD. This result is consistent with presence of the oxidoreductase domain (OxRD)† in STEAP2, which hampers direct entrance of the isoalloxazine ring of FAD to its binding pocket in the transmembrane domain (TMD). On the other hand, the rate of heme reduction by reduced FAD is much faster than that of heme reduction in the presence of NADPH and FAD, indicating that reduction of FAD by NADPH is rate-limiting in the electron transfer chain in STEAP2.

      †: To be consistent with literature, we adopted the nomenclature “oxidoreductase domain (OxRD)” for the N-terminal soluble domain in STEAP proteins. We used the term “reductase domain (RED)” in the previous version of our manuscript.

      Reviewer #1 (Public Review):

      This important study reveals the structure of human STEAP2 for the first time and suggests the electron transport pathway, but some questions remain regarding the interpretation of the in vitro electron transport experiments, the lack of available redox couples, and potential alternative hypotheses that would if addressed, strengthen the claims in the manuscript.

      Strengths

      One of the clear strengths of the manuscript that stands out is the determination of the structure of human STEAP2. The structures of some other homologs are known, but STEAP2's structure was not, and STEAP2 seems to have an unusually low activity towards certain metal chelates. The approach of producing the human STEAP2 in insect cells with the supplementation of cofactor biogenesis components nicely results in cofactor-replete protein. The structure of STEAP2 reveals a domain-swapped trimer, with the NADPH-binding domain of the neighboring protomer within electron-transport distance of the FAD-heme axis. The FAD has an interesting and somewhat unusual extended conformation and abuts a Leu residue that may regulate electron transport. Another strength of the manuscript is the demonstration that STEAP1, which does not have the internal NADPH binding domain, can interact modestly and shuttle electrons to the heme in STEAP1 through FAD. These experiments nicely expand information on the function of STEAP1 and provide a structural basis for electron transport in STEAP2.

      Weaknesses

      A major weakness in the manuscript lies with the kinetics data and how the data, as presented, are unclear to the reader regarding their impact and their connection to the purported electron transport scheme. While multiple sets of data are reported, the analysis in all cases is simply the reduction of a hexacoordinate heme and its related spectra and kinetic parameters. In most cases, it's unclear to the reader which part of the electron pathway is being tested in which experiment. Simple diagrams would be helpful in each case. However, it's also unclear if all of the potential order of addition experiments were actually performed; i.e., flavin but no NADPH; NADPH but no flavin; flavin before NADPH; flavin after NADPH, etc. As there are multiple permutations that should be tested to demonstrate the electron transport pathway, presenting the data in a way that makes it clear to the reader is challenging. Particularly missing are the determined redox potentials of the hemes in both STEAP1 and STEAP2. Could differences in these heme redox potentials be drivers of the difference in metal reduction rates?

      We re-structured the manuscript to follow a clearer logical thread. We provided explanations for which electron transfer steps are being examined in each experiment.

      We cannot reliably determine EM due to insufficient amount of purified proteins. We are inclined to think that the bound heme on STEAP1 and STEAP2 have similar EM, based on their similar coordination geometry and nearly identical UV-Vis and MCD spectra. Thus, different rates of Fe3+-NTA reduction by STEAP1 and STEAP2 are likely due to differences in substrate binding site rather than different EM.

      Also, the text indicates that STEAP2 does not show a reduction rate dependence on the [Fe3+NTA], but Figure 1A shows a difference in rates dependent on [Fe3+-NTA], and the shape of the reduction curve also changes based on [Fe3+-NTA]. This discrepancy should be rectified.

      We fixed this error. The reduction of Fe3+-NTA by ferrous STEAP2 shows multiple phases and the reaction rates within the initial 2 seconds are weakly dependent on [Fe3+-NTA].

      A second major weakness is the lack of any verification of the relevance of the STEAP2 oligomerization to its in vivo function. Is the same domain-swapped trimer known to exist in vivo? If the protein were prepared in other detergents, is the oligomerization preserved? It is alluded to in the text that another STEAP protein is also a trimer. Was this oligomerization verified in vivo?

      The domain-swapped assembly is an interesting phenomenon, and it seems to provide a solution for bringing the FAD closer to heme. The same domain swapped trimeric assembly is also observed in the structure of STEAP4, which was purified in a different detergent (Nat Commun (2018), 9, page 4337). It is likely that this feature is shared by STEAP2, 3, and 4, and preserved during the purification process.

      Could this oligomerization be disrupted to impede or abrogate electron transport to underscore the oligomerization relevance? This point is germane, as it would further suggest that the domain-swapped trimer observed in the STEAP2 cryo-EM structure is physiologically relevant, especially given how far the distance between the NADPH and the FAD would otherwise be to support electron transport.

      We agree with the reviewer’s reasoning that the oligomeric assembly is required for proper function of STEAPs and thus could potentially be utilized for functional regulation. However, we are not aware of any physiologically relevant stimuli or treatment that would allow regulation of STEAP functions by inducing or forming different oligomeric states. Our experience with STEAP proteins is that the trimeric assembly is stable and well-preserved during the purification process and can only be disrupted under denaturing conditions such as SDS-PAGE.

      Beyond these two areas in which the manuscript could be improved there are a couple of minor considerations. First, the modest resolution of the STEAP2 structure prevents assigning the states of NADP+/NADPH and FAD/FADH2 with confidence. An orthogonal measure would be useful for modeling the accurate states in the structure.

      We agree. We clarified the ambiguity and stated in the main text that the cryo-EM structure of STEAP2 was determined in the presence of NADP+ and FAD.

      Finally, the BLI b5R/STEAP1 binding/unbinding fits seem somewhat poor, especially at high concentrations of b5R in the dissociation regime, which likely influences the derived value of Kd. A different fitting equilibrium might yield better agreement between the experimental and theoretical results. Moreover, whether this binding strength is influenced by the reduction state of the NADPH would be helpful in understanding and contextualizing the weak binding affinity.

      We think that non-specific binding likely causes deviations from the simple binding model at higher b5R concentrations. We made a comment on this in the main text. We agree with the reviewer that the interactions between b5R and STEAP1 could be redox dependent, for example, a reduced FAD on b5R may enhance the affinity. We could implement this by performing the binding experiments in an anaerobic chamber, but this is beyond the scope of the current study.

      Reviewer #2 (Public Review):

      The manuscript provides new insight into a family of human enzymes. It demonstrates that STEAP2 can reduce iron and STEAP1 can be promiscuous regarding the source of electron donors that it can use. The quality of the kinetics experiment and the structural analysis is excellent. I am less enthusiastic about the interpretation of data and the take-home message that the manuscript intends to deliver. Above all, the work combines data on STEAP2 and STEAP1 and it remains unclear which questions are ultimately addressed. A second critical point is about the interpretation of the experiment demonstrating that STEAP1 can be reduced by cytochrome b5 reductase. The abstract states that "We show that STEAP1 can form an electron transfer chain with cytochrome b5 reductase" whereas the main text discusses the data by suggesting that "we speculate that FAD on b5R may partially dissociate to straddle between the two proteins". The two statements seem to be partly contradictory. Cytochrome b5 reductases do not easily release FAD but rather directly donate electrons to heme-protein acceptors (PMID: 36441026). According to the methods section, no FAD was added to the reaction mix used for the cytochrome b5 reductase experiment. Overall, the data seem to indicate that the reductase might reduce the heme of STEAP1 directly. Would it be possible to check whether FAD addition affects the kinetics of the process?

      We agree with the reviewer on this point. We do not have evidence indicating that FAD fully or partially dissociates from b5R to interact with STEAP1. We removed the statement in the revision.

      We have not tried to add free reduced FAD to the mixture of STEAP1/b5R/NADH, because we feel that this would increase the complexity of the system and complicate data interpretation. We are working on determining the structure of b5R in complex with STEAP1 to visualize the electron transfer pathway, and we hope that such a structure would provide a framework for understanding electron transfer between the two proteins.

      And to perform a control experiment to check that NAD(P)H does not directly reduce the heme of STEAP1 (though unlikely)?

      We did the control experiment and included data in Fig. S3A. No reduction of heme by NADH alone.

      A final point concerns the "slow Fe3+-NTA reduction by STEAP2". The reaction is not that slow as the initial phase is 2 per second. The reaction does not show dependence on the substrate concentration suggesting "poor substrate binding". I am not convinced by this interpretation. Poor substrate binding would give rise to substrate dependency as saturation would not be achieved. A possible interpretation could be that substrate binding is instead tight and the enzyme is saturated by the substrate. Can it be that the reaction is limited by non-productive substrate-binding and/or by interconversions between active and non-active conformations? We re-analyzed the data and revised the Results and Discussion.

      We agree with the reviewer on this point. We re-analyzed the data and found that the reaction rates within the first 2 seconds are weakly dependent on [Fe3+-NTA] while the rates beyond 2 seconds do not show dependence on [Fe3+-NTA]. More studies are required to unravel the mechanism that leads to the complicated kinetic data.

      Reviewer #3 (Public Review):

      The six-transmembrane epithelial antigen of the prostate (STEAP) family comprises four members in metazoans. STEAP1 was identified as integral membrane protein highly upregulated on the plasma membrane of prostate cancer cells (PMID: 10588738), and it later became evident that other STEAP proteins are also over expressed in cancers, making STEAPs potential therapeutic targets (PMID: 22804687). Functionally, STEAP2-4 are ferric and cupric reductases that are important for maintaining cellular metal uptake (PMIDs: 16227996, 16609065). The cellular function of STEAP1 remains unknown, as it cannot function as an independent metalloreductase. In the last years, structural and functional data have revealed that STEAPs form trimeric assemblies and that they transport electrons from intracellular NADPH, through membrane bound FAD and heme cofactors, to extracellular metal ions (PMIDs: 23733181, 26205815, 30337524). In addition, numerous studies (including a previous study from the senior authors) have provided strong implications for a potential metalloreductase function of STEAP1 (PMIDs: 27792302, 32409586).

      This new study by Chen et al. aims to further characterize the previously established electron transport chain in STEAPs in high molecular detail through a variety of assays. This is a wellperformed, highly specialized study that provides some useful extra insights into the established mechanism of electron transport in STEAP proteins. The authors first perform a detailed spectroscopic analysis of Fe3+-NTA reduction by STEAP2 and STEAP1, confirming that both purified proteins are capable of reducing metal ions. A cryo-EM structure of STEAP2 is also presented. It is then established that STEAP1 can receive electrons from cytochrome b5 reductase, and the authors provide experimental evidence that the flavin in STEAP proteins becomes diffusible.

      The specific aims of the study are clear, but it is not always obvious why certain experiments are performed only on STEAP2, on STEAP1, or on both isoforms. A better justification of the performed experiments through connecting paragraphs and proper referencing of the literature would improve readability of the manuscript. Experimentally, the conclusions are appropriate and mostly consistent with the experimental data, although one important finding can benefit from further clarification. Namely, the observation that STEAP1 can form an electron transfer chain with cytochrome b5 reductase in vitro is an exciting finding, but its physiological relevance remains to be validated. The metalloreductase activity of STEAP1 in vitro has been described previously by the authors and by others (PMIDs: 27792302, 32409586). However, when over expressed in HEK cells, STEAP1 by itself does not display metal ion reductase activity (PMID: 16609065), and it was also found that STEAP1 over expression does not impact iron uptake and reduction in Ewing's sarcoma (cancer) cells (PMID: 22080479). Therefore, the physiological relevance of metal ion reduction by STEAP1 remains controversial. The current work establishes an electron transfer chain between STEAP1 and cytochrome b5 reductase in vitro with purified proteins. However, the conformation of this metalloreductase activity of the STEAP1-cytochrome b5 complex will be required in a cell line to prove that the two proteins indeed form a physiological relevant complex and that the results are not just an in vitro artefact from using high concentrations of purified proteins.

      The work will be interesting for scientists working within the STEAP field. However, some of the presented data are redundant with previous findings, moderating the study's impact. For instance, the new structural insights into STEAP2 are limited because the structure is virtually identical to the published structures of STEAP4 and STEAP1 (PMIDs: 30337524, 32409586), which is not surprising because of the high sequence similarity between the STEAP isoforms. Moreover, the authors provide experimental evidence to prove the previous hypothesis (PMID: 30337524) that the flavin in STEAP proteins becomes diffusible, but the molecular arrangement of a STEAP protein, in which the flavin interacts with NADPH, remains unknown. Based on the manuscript title, I would also expect the in-depth characterization of STEAP1/STEAP2 hetero trimers (first identified by the authors), but this is only briefly mentioned. When taken together, this study by Chen et al. strengthens and supports previously published biochemical and structural data on STEAP proteins, without revealing many prominent conceptual advances.

      We thank the reviewer for information and the broader context. We have revised the manuscript to have a clearer logical thread.

      Reviewer #1 (Recommendations For The Authors):

      Please see the "Public Review" for recommendations.

      Reviewer #2 (Recommendations For The Authors):

      Specific suggestions

      -The introduction should more clearly state which questions are being addressed and why STEAP1 and STEAP2 are investigated.

      We have revised the Introduction to make that clearer.

      -The manuscript should discuss more extensively and provide possible explanations for the substrate-independent kinetics of iron-reduction by STEAP2.

      We re-analyzed the data and found the rate constants of the reactions before 2 s are weakly [Fe3+NTA]-dependent. We ascribe the weak [Fe3+-NTA]-dependence to the partial rate-limiting by substrate binding. However, we do not have a good interpretation for the reaction kinetics after 2 s which does not show [Fe3+-NTA]-dependence.

      -"The rate of STEAP1(Fe(II)) oxidation by Fe3+-NTA is similar to those by Fe3+-EDTA or Fe3+-citrate, but the rates are significantly faster than STEAP2(Fe(II)) re-oxidation by Fe3+NTA (Fig. 1B)." The rates for STEAP1 should be given to substantiate this statement.

      We added Table S1 in the supplementary materials that includes the 2nd order association (kon) and the 1st order dissociation rate constants (koff) of iron substrates in STEAP1 and STEAP2. Data on Fe3+-EDTA or Fe3+-citrate by STEAP1 are from our previous study (Biochemistry, 2016). We also calculated the KDs of different iron substrates for STEAP1 and STEAP2.

      • "Our results indicate that STEAP2 can supply reduce FAD to initiate electron transfer in STEAP1." As discussed above, this statement should be discussed and analyzed

      We mixed 0.9 μM STEAP1, 1.1 μM STEAP2, and 2.2 μM FAD and added 60 μM NADPH to the system and found that the heme on both STEAP1 and STEAP2 are reduced. Since adding NADPH to STEAP1 plus FAD alone does not reduce the heme (Fig. S3B), we reasoned that reduction of the heme on STEAP1 is achieved by the reduced FAD produced on STEAP2. The reduced FAD likely dissociates from STEAP2 and then bind to STEAP1.

      -Experiments on "STEAP1 reduction by STEAP2" The experiments show that "STEAP2 can supply reduce FAD to initiate electron transfer in STEAP1." Could these results be explained by heterotrimer formation in agreement with the previous data published by the authors?

      In our experience, STEAP1 and STEAP2 homotrimers are stable and do not form heterotrimers when mixed. STEAP1/2 heterotrimers form only when the two proteins are co-expressed in cells (Biochemistry (2016) 55, 6673-6684).

      Reviewer #3 (Recommendations For The Authors):

      Major points:

      1) As a very general point: the order in which the results are presented could be greatly improved to increase the readability for non-experts. To elaborate: The manuscript starts with the spectroscopic characterization of STEAP2, then suddenly the reductase activities of STEAP1 and STEAP2 are compared; subsequently, experiments are described involving STEAP1 and cytochrome b5 reductase; then the cryo-EM structure of STEAP2 is presented etc. As a non-expert reader, this presentation of the results is confusing, especially because the paragraphs are not always connected well, and there is a lot of switching between STEAP1 and STEAP2 data. A more logical order would be to first present the STEAP2 spectroscopy and structural data, then write a connecting paragraph on why it is important to also study the electron transfer chain in STEAP1, followed by the comparison of the STEAP isoforms and the data on STEAP1 alone. The authors should include sentences on why they performed each experiment. For example, why did they determine the structure of STEAP2. What were they after that they could not retrieve from the homologous STEAP4 and STEAP1 structures? Justification of the performed experiments will make it easier for the reader, and will establish a better connection between the paragraphs.

      We reorganized the data presentation in Results per the reviewer’s suggestions.

      2) The physiological relevance of metal ion reduction by STEAP1 remains controversial. Because the current work establishes an electron transfer chain between STEAP1 and cytochrome b5 reductase, could the authors perform an easy experiment where they over express both STEAP1 and cytochrome b5 reductase in a cell line? If such an experiment would reveal STEAP1-dependent metal-ion reduction, it would greatly improve this part of the manuscript. If no activity is observed, the established electron transfer chain could just represent an in vitro artifact from using high concentrations of purified proteins.

      This is an excellent point. We are not set up to perform the proposed experiment but will do so in the future.

      3) The manuscript states that metal ion reduction of purified STEAP2 is slow, and the authors explain this by the absence of density for the extracellular region between helices 3 and 4 that are present in the structures of STEAP4 and STEAP1, resulting in a less-well defined substratebinding site. Can the authors exclude that the less-well defined substrate-binding site is a result of the detergent extraction of STEAP2? Would it be possible to measure the reductase activity of STEAP2 in purified membranes?

      Detergent mostly interacts with the transmembrane domains and since the TMD region of STEAP2 aligns well with those of STEAP1 and STEAP4, we do not think that the disordered substrate binding region in STEAP2 is a consequence of detergent solubilization. It is difficult to conduct pre-steady state kinetic experiments using STEAP2 in membrane fractions.

      4) The manuscript would greatly benefit from citing the literature more comprehensively to acknowledge insightful findings from authors in the field; for example, the important work by the Lawrence lab from 2015 (PMID: 26205815), which biochemically proved that STEAPs bind a single heme and that FAD bridges the TMD and RED, is not cited. The authors also mention that STEAP proteins belong to the same family as NOX proteins and cite some NOX structure papers. However, they fail to cite the first NOX structure paper (PMID: 28607049), as well the manuscript that structurally compares NOXs and STEAPs (PMID: 32815713). Similarly, the authors use SerialEM for their cryo-EM data collection but cite an old paper instead of the more recent (and relevant) SerialEM publication (PMID: 31086343).

      We agree and added the references.

      5) Generally, the data presented in the manuscript appear of good technical quality. However, a 'Table 1' with all relevant cryo-EM data collection and refinement statistics is completely missing as far as I can see. The authors should definitely add this to allow for the judgement of structural data quality. Without it, the manuscript is not suitable for publication.

      We added Table S2 that includes relevant cryo-EM statistics.

      Minor points:

      6) The authors write in the abstract: 'STEAP2 - 4, but not STEAP1, have an intracellular domain that binds to NADPH and FAD'. This is not correct, because it has clearly been established that FAD also majorly binds to the transmembrane domain (this is even shown by the authors in the current manuscript as well).

      Agree, we corrected that in the revision.

      7) Sentence from the abstract and introduction state: 'It is also unclear whether STEAP1 has metal ion reductase activity' and 'it is unclear whether STEAP1 can form a competent electron transfer chain from NADPH'. The authors should definitely add "physiologically relevant" to these sentences. Namely, the senior authors themselves concluded in their 2016 Biochemistry paper (PMID: 27792302) that STEAP1 is capable of reducing metal ion complexes. Further indications that the transmembrane domain of STEAP1 displays metalloreductase activity was published by the Gros lab (PMID: 32409586), and it was also shown that fusing the RED of STEAP4 to the TMD of STEAP1 yields a functional protein in cells that reduces metal ions.

      Good point and we revised the text and included the references.

      8) Why is scheme 1 not just a summarizing figure?

      We could change Scheme 1 to a Figure if required by the copy editor.

      9) What is the purpose of Fig. 6? A larger depiction of Fig. 5e would likely be more relevant and should be considered as a replacement. Alternatively, the structure of STEAP1 (pdb 6y9b) could be shown in combination with Fig. 7, as the mutation is performed in STEAP1.

      We agree and made changes to the structural figures to enhance clarity.

      10) The manuscript now contains many, single panel figures. Certain main figures could easily be combined, for example, Fig. 1 and 2 and/or Fig. 3 and 4.

      We agree and made changes to reduce single panel figures.

      11) In Fig. 2, 3 and 4, the spectra show changes in peak heights as a result of the ferric to ferrous heme transition. However, a time component is missing in the legend. How long do these transitions take?

      We added the reaction times to the figure legends.

      12) The last part of the discussion states: 'The assembly of an intracellular RED with a membrane-embedded TMD observed in NOX, DUOX, and STEAPs naturally led to the notion that NADPH, FAD, and heme form an uninterrupted rigid electron-transfer chain that shuttles electron from the intracellular cellular NADPH to the extracellular substrates. While this may be true for NOX and DUOX, in which rapid supply of electrons to their extracellular substrates are essential to their biological functions, it may not apply similarly to STEAPs since it has only one heme in the TMD, and their electron transfer relies on shuttling of FAD.' The authors should mention here that the activity of NOX and DUOX is tightly regulated by accessory proteins, Ca2+ etc. Similarly, do the authors expect that the large distance between NADPH and FAD in the structures could represent a way to regulate/dampen the metal ion reduction rates of STEAPs in vivo?

      We agree. We mentioned the regulation of NOX and DUOX in Discussion. We remain puzzled by the large distance between NADPH and FAD in STEAPs and are in pursuit of a structure in which the two cofactors are “in touch” for electron transfer.

    1. Author Response

      The following is the authors’ response to the original reviews.

      Reviewer #1 (Recommendations For The Authors):

      The conclusions of this paper are mostly well supported by data, but some aspects need to be corrected.

      1) Line 99. The title is not suitable for summarizing this part of the results. In this paragraph, the results mainly describe SRSF1 expression pattern and binding of spermatogonia-associated gene's transcripts in testes. There is no functional assay to conclude SRSF1 has an essential role in mouse testes. The data only indicate that SRSF1 may have a vital role in posttranscriptional regulation in the testes.

      Thank you for the professional suggestions. Following this advice, we have corrected the text in this revised version (Page 4, Line 98 and 112).

      2) Line 141. In the mating scheme, Vasa-Cre Srsf1Fl/del mice should be obtained instead of Vasa-Cre Srsf1Fl/Fl mice.

      Thank you for the professional suggestions. Following this advice, we have corrected the text in this revised version (Page 4, Line 118).

      3) Fig 2 C, "PZLF" should be corrected to "PLZF".

      Thank you very much for the helpful comments. We have corrected this in Figure 2C.

      4) Fig 5 B, "VASA" and "Merge" should be interchanged.

      Thank you very much for the helpful comments. We have interchanged "VASA" and "Merge" in Figure 5B.

      5) Fig 5 D, "Ctrl" should be added in the up panel.

      Thank you very much for the helpful suggestions. We have added "Ctrl" in Figure 5C.

      6) The legend for Figure 6 D should be revised.

      Thank you very much for the helpful suggestions. We have revised the legend for Figure 7D

      7) The legend for Figure 7 G should be revised.

      Thank you very much for the helpful suggestions. We have revised the legend for Figure 8D

      8) Immunoprecipitation mass spectrometry (IP-MS) data showed that t SRSF1 interacts with other RNA splicing-related proteins (e.g., SRSF10, SART1, RBM15, SRRM2, SF3B6, and SF3A2). The authors should verify the interactions in testis or cells.

      We thank the reviewer for the professional comments and suggestions. Following this advice, we performed co-transfection and co-IP to verify the protein-protein interactions in 293T cells, the results showed that the RRM1 domain of SRSF1 interacted with SART1, RBM15 and SRSF10 in 293T cells. In addition, the fluorescence results showed complete co-localization of mCherry-SRSF1 with eGFP-SART1, eGFP-RBM15 and eGFP-SRSF10 in 293T cells. Therefore, we have incorporated the data into the Figure 9G-J. Meanwhile, these have been incorporated into the text, given descriptions, and highlighted (Page 17, Lines 338-347).

      9) To avoid overstatement, the authors should pay attention to the use of adjectives and adverbs in the article, especially when drawing conclusions about the role of Tail1.

      We thank the reviewer for the professional comments and suggestions. To avoid overstatement, we have revised the entire text (Page 4, Lines 98, and 112; Page 16, Lines 308; Page 17, Lines 346-347; Page 20, Lines 413-414; Page 21, Lines 432-433).

      Reviewer #2 (Recommendations For The Authors):

      Major

      1) I find the use of "SSC homing" misleading/confusing because this "homing" or relocation of postnatal gonocytes/nascent spermatogonia to the basement membrane precedes the maturation of the nascent spermatogonia into SSCs. In addition, "SSC homing" is commonly used in the SSC transplantation field to describe a transplanted SSC's ability to find and colonize its niche within the seminiferous tubules. I appreciate that "postnatal gonocytes/nascent spermatogonia homing" is not easily grasped by a broader audience. Perhaps "homing of precursor SSCs" is more appropriate.

      Thank you very much for the helpful comments and suggestions. Following this advice, we have corrected the text in this revised version (Line 1-2, 39, 44, 49, 54-55, 68, 70, 72-73, 77, 84, 93-95, 191, 201, 240, 384-387, 397, 417-422, and 433)

      2) If I am misunderstanding the description of the Srsf1 cKO phenotype, and the authors truly believe SSCs have formed in the Srsf1 cKO testis, I strongly recommend immunostaining to show that the cKO germ cells robustly express SSC markers, not just markers of undifferentiated spermatogonia.

      We thank the reviewer for the professional suggestions. We fully agree with the reviewer. Immunohistochemical staining for FOXO1 and statistical results indicated a reduced number of prospermatogonia (Figure 6C-E). So, we have corrected the text in this revised version (Line 1-2, 39, 44, 49, 54-55, 68, 70, 72-73, 77, 84, 93-95, 191, 201, 240, 384-387, 397, 417-422, and 433).

      3) If the authors have the available resources, the significance of this report would be enhanced by additional characterization of the cKO phenotype at the transition from gonocyte to nascent spermatogonia. Do any cKO germ cells exhibit defects in maturing from gonocytes to nascent spermatogonia at the molecular level? I.e., by P5-7, do all cKO germ cells express PLZF and localize FOXO1 to cytoplasm, as expected of nascent spermatogonia? If the cKO germ cells are actually a heterogenous population of gonocytes and nascent spermatogonia, what is the distribution of each subpopulation in the lumen vs basement membrane?

      Thank you for the professional suggestions. Following this advice, immunohistochemical staining for FOXO1 was performed on 5 dpp mouse testis sections (Figure 6C). Further, germ cell statistics of FOXO1 expression in the nucleus showed a reduced number of prospermatogonia in cKO mice (Figure 6D). And germ cells in which FOXO1 is expressed in the nucleus similarly undergo abnormal homing (Figure 6E). Thus, all the above data indicated that SRSF1 has an essential role in the homing of precursor SSCs. we have incorporated the data into the Figure 6C-E. Meanwhile, these have been incorporated into the text, given descriptions, and highlighted (Page 9, Lines 191-201; Page 20, Lines 389-391).

      Minor

      1) Could the authors clarify why Tial1 exon exclusion in the cKO results in reduced protein expression? Is it creating a transcript isoform that undergoes nonsense-mediated decay?

      Thank you for the professional suggestions. Following this advice, we analyzed Tial1 transcripts again, and we found that Tial1 exon exclusion resulted in reduced expression of protein isoform X2 (Figure 8J). Since this region is not in the CDS, no clear evidence of nonsense-mediated decay was found in the analysis.

      2) Could the authors confirm that the TIAL1 antibody is not detecting the portion of the protein encoded by the alternatively spliced exon?

      Thank you for the helpful comments. The TIAL1 monoclonal antibody is produced by Proteintech Group under the product number 66907-1-Ig. Immunogen is TIAL1 fusion protein Ag11981. The sequence is as follows. MDARVVKDMATGKSKGYGFVSFYNKLDAENAIVHMGGQWLGGRQIRTNWATRKPPAPKSTQENNTKQLRFEDVVNQSSPKNCTVYCGGIASGLTDQLMRQTFSPFGQIMEIRVFPEKGYSFVRFSTHESAAHAIVSVNGTTIEGHVVKCYWGKESPDMTKNFQQVDYSQWGQWSQVYGNPQQYGQYMANGWQVPPYGVYGQPWNQQGFGVDQSPSAAWMGGFGAQPPQGQAPPPVIPPPNQAGYGMASYQTQ The homology was 99% in mice and all TIAL1 isoforms were detected. So, TIAL1 antibody is detecting the portion of the protein encoded by the alternatively spliced exon.

      3) Lines 143: should "cKO" actually be "control"?

      Thank you for the helpful suggestions. There is a real problem in the text description. we have corrected the text in this revised version (Page 6, Line 138-139).

      4) Lines 272-3 "visual analysis using IGV showed the peak of Tial1/Tiar was stabilized in 5 dpp cKO mouse testes (Figure 7H)": "peak stabilization" is not evident to me from the figure nor do I see Tial1 listed as differentially expressed in the supplemental. I would refrain from using IGV visualization as the basis for the differential abundance of a transcript.

      Thank you very much for the helpful comments and suggestions. Tial1/Tiar is one of 39 stabilizing genes that are bound by SRSF1 and undergo abnormal AS. Following this advice, we have substituted Tial1/Tiar's FPKM for his peaks (Figure 8H). Meanwhile, we have corrected the text in this revised version (Page 15, Line 296-300; Page 16, Line 303-304).

      5) Lines 468-473: please clarify the background list used for GO enrichment analyses. By default, the genes expressed in the testis are enriched for spermatogenesis-related genes. To control for this and test whether a gene list is enriched for spermatogenesis-related genes beyond what is already seen in the testis, I recommend using a list of all expressed genes (for example, defined by TPM>=1) as the background list.

      We thank the reviewer for the professional comments and suggestions. Following this advice, all expressed genes (TPM sum of all samples >=1) are listed background for GO enrichment analyses. The results of GO enrichment analysis of the AS gene turned out to be the same. The results of GO enrichment analysis of the SRSF1 peak-containing genes, differential genes, and IP proteins-associated genes have corrected in the figure (Figure 2A, 7E, and 9E)

      6) Figure 2B: Could the authors mark where the statistically significant peaks appear on the tracks? There are many small peaks and it's unclear if they are significant or not.

      Thank you for the helpful suggestions. Following this advice, we have marked the areas of higher peaks in the figure (Figure 2B). We generally believe that any region above the peaks of IgG is likely to be a binding region, and of course, the higher the peak value, the more pre-mRNA is bound by SRSF1 in that region.

      7) Figure 7A: I assume the SRSF1 CLIP-seq genes are all the genes from the adult testis experiments. I would suggest limiting the CLIP-seq gene set to only those expressed in the P5 RNA-seq data, as if the target is not expressed at P5, there's no way it will be differentially expressed or differentially spliced in at P5.

      Thank you very much for the helpful comments and suggestions. Following this advice, we found that 3543 of the 4824 genes bound by SRSF1 were expressed in testes at 5 dpp. we have corrected in the figure (Figure 8A). these have been incorporated into the text, given descriptions, and highlighted (Page 14, Lines 274-277).

      8) Figure 7F: Could the authors clarify where the alternatively spliced exon is relative to the total transcript, shown in 7H?

      Thank you for the helpful suggestions. Following this advice, we have labeled the number of exons where variable splicing occurs. (Figure 8F).

      9) Please include where the sequencing and mass spec data will be publicly available.

      Thank you very much for the helpful comments and suggestions. Following this advice, these have been incorporated into the text, given descriptions, and highlighted (Page 25, Lines 560-565).

      Reviewer #3 (Recommendations For The Authors):

      Suggestions for improving the data and analysis

      1) The claim that TIAL1 mediates SRSF1 effects is not well supported; this claim should be adjusted or additional supporting data should be provided. To support a claim that alternative splicing of Tial1 mediates the effects of SRSF1, at least two additional pieces of data are needed: first, a demonstration that the two alternative protein isoforms have different molecular functions, either in vitro or in vivo; and second, a better quantitation of the levels and ratios of expression of the two different isoforms in vivo.

      Thank you for the helpful comments and suggestions. Following this advice, we quantified the expression levels and ratios of two different isoforms in vivo, and we found that Tial1 exon exclusion resulted in reduced expression of protein isoform X2 (Figure 8J). However, it is not possible to prove that the two alternative protein isoforms have different molecular functions. So, this claim has been adjusted in the text. these have been incorporated into the text, given descriptions, and highlighted (Lines 1-2, 43-45, 95, 306, 323-325, 408, 413-414).

      2) Likewise, the claim that "SRSF1 is required for "homing and self-renewal" of SSCs should be adjusted or better supported. As of now, the data supports a claim that SRSF1 is required for the establishment of the SSC population in the testis after birth. This could be due to defects in homing, self-renewal, or survival. To support claims about homing and self-renewal, these phenotypes should be tested more directly, for example by quantitating numbers of spermatogonia at the basal membrane in juvenile testes (homing) and expression of SSC markers in addition to the pan-germ cell marker VASA across early postnatal time points.

      Thank you very much for the helpful comments and suggestions. Immunohistochemical staining for FOXO1 was performed on 5 dpp mouse testis sections (Figure 6C). Further, germ cell statistics of FOXO1 expression in the nucleus showed a reduced number of prospermatogonia in cKO mice (Figure 6D). And germ cells in which FOXO1 is expressed in the nucleus similarly undergo abnormal homing (Figure 6E). Thus, all the above data indicated that SRSF1 has an essential role in the homing of precursor SSCs. we have incorporated the data into the Figure 6C-E. These have been incorporated into the text, given descriptions, and highlighted (Page 9, Lines 191-201; Page 20, Lines 387-389). Meanwhile, "homing and self-renewal" of SSCs have corrected the text in this revised version (Line 1-2, 39, 44, 49, 54-55, 68, 70, 72-73, 77, 84, 93-95, 191, 201, 240, 384-387, 397, 417-422, and 433).

      3) Additional, more detailed analyses of CLIP-seq and RNA-seq data at least showing that the libraries are of good quality should be provided.

      Thank you very much for suggestions. Following this advice, detailed analyses of RNA-seq data have been incorporated the data into the figures (Figure S2). But detailed analyses of CLIP-seq have already been used in another paper (Sun et al., 2023), and we have not provided it in order to avoid multiple uses of one figure. Meanwhile, we made a citation in the article (Page 4, Lines 105; Page 25, Lines 564-565).

      4) Gene Ontology analyses should be redone with a more appropriate background gene set.

      Thank you for the helpful suggestions. All expressed genes (TPM sum of all samples >=1) are listed background for GO enrichment analyses. The results of GO enrichment analysis of the AS gene turned out to be the same. The results of GO enrichment analysis of the SRSF1 peak-containing genes, differential genes, and IP proteins-associated genes have been corrected in the figure (Figure 2A, 7E, and 9E)

      Minor points about the text and figures

      5) The species (mouse) should be stated earlier in the Introduction.

      Thank you for the professional suggestions. Following this advice, the mouse has been stated earlier in the Introduction (Page 3, Line 65).

      6) In Fig. 1C (Western blot), the results would be more convincing if quantitation of band intensities normalized to the loading control was added.

      Thank you very much for comments and suggestions. Following this advice, ACTB served as a loading control. The value in 16.5 dpc testes were set as 1.0, and the relative values of testes in other developmental periods are indicated. Therefore, we have incorporated the data into the figures (Figure 1C).

      7) In Fig 5D, TUNEL signal in the single-channel image is difficult to see; please adjust the contrast.

      Thank you for the professional suggestions. Following this advice, the images of the channels have been replaced by enlarged images for better visibility (Figure 5C).

      Major comments

      1) In Fig 1D, it appears that SRSF1 is expressed most strongly in spermatogonia by immunofluorescence, but this is inconsistent with the sharp rise in expression detected by RT-qPCR at 20 days post partum (dpp) (Fig. 1B), which is when round spermatids are first added; this discrepancy should be explained or addressed.

      We appreciate the important comments from the reviewer. In another of our studies, we showed that SRSF1 expression is higher in pachytene spermatocytes and round spermatids (Sun et al., 2023). So, it is normal for the sharp rise in expression detected by RT-qPCR at 20 days post partum (dpp).

      Author response image 1.

      Dynamic localization of SRSF1 in male mouse germ cells. (Sun et al., 2023)

      2) It is important to provide a more comprehensive basic description of the CLIP-seq datasets beyond what is shown in the tracks shown in Fig. 2B. This would allow a better assessment of the data quality and would also provide information about the transcriptome-wide patterns of SRSF1 binding. No information or quality metrics are provided about the libraries, and it is not stated how replicates are handled to maximize the robustness of the analysis. The distribution of peaks across exons, introns, and other genomic elements should also be shown.

      Thank you very much for the helpful comments and suggestions. In fact, detailed analyses of CLIP-seq have already been presented in another paper (Sun et al., 2023), and we have not provided it in order to avoid multiple uses of one figure. Meanwhile, we made a citation in the article (Page 4, Lines 105; Page 25, Lines 564-565). In addition, the distribution of peaks in exons, introns, and other genomic elements is shown in Figure 2B.

      3) The claim that SRSF1 is required for "homing and self-renewal" of SSCs is made in multiple places in the manuscript. However, neither homing nor self-renewal is ever directly tested. A single image is shown in Fig. 5E of a spermatogonium at 5dpp that does not appropriately sit on the basal membrane, potentially indicating a homing defect, but this is not quantified or followed up. There is good evidence for depletion of spermatogonia starting at 7 dpp, but no further explanation of how homing and/or self-renewal fit into the phenotype.

      Thank you very much for the helpful comments and suggestions. Following this advice, immunohistochemical staining for FOXO1 was performed on 5 dpp mouse testis sections (Figure 6C). Further, germ cell statistics of FOXO1 expression in the nucleus showed a reduced number of prospermatogonia in cKO mice (Figure 6D). And germ cells in which FOXO1 is expressed in the nucleus similarly undergo abnormal homing (Figure 6E). Thus, all the above data indicated that SRSF1 has an essential role in the homing of precursor SSCs. we have incorporated the data into the Figure 6C-E. These have been incorporated into the text, given descriptions, and highlighted (Page 9, Lines 191-201; Page 20, Lines 387-389). Meanwhile, "homing and self-renewal" of SSCs have corrected the text in this revised version (Line 1-2, 39, 44, 49, 54-55, 68, 70, 72-73, 77, 84, 93-95, 191, 201, 240, 384-387, 397, 417-422, and 433).

      4) In Fig. 6A (lines 258-260) very few genes downregulated in the cKO are bound by SRSF1 and undergo abnormal splicing. The small handful that falls into this overlap could simply be noise. A much larger fraction of differentially spliced genes are CLIP-seq targets (~33%), which is potentially interesting, but this set of genes is not explored.

      Thank you for the helpful comments. Following this advice, this was specifically indicated by the fact that 39 stabilizing genes were bound by SRSF1 and underwent abnormal AS. In our study, Tial1/Tiar is one of 39 stabilizing genes that are bound by SRSF1 and undergo abnormal AS. Therefore, we fully agree with the reviewers' comments. These have been added in this revised version (Page 14, Lines 279-280; Page 15, Lines 296-300).

      5) The background gene set for Gene Ontology analyses is not specified. If these were done with the whole transcriptome as background, one would expect enrichment of spermatogenesis genes simply because they are expressed in testes. The more appropriate set of genes to use as background in these analyses is the total set of genes that are expressed in testis.

      We thank the reviewer for the professional comments and suggestions. All expressed genes (TPM sum of all samples >=1) are listed background for GO enrichment analyses. The results of GO enrichment analysis of the AS gene turned out to be the same. The results of GO enrichment analysis of the SRSF1 peak-containing genes, differential genes, and IP proteins-associated genes have been corrected in the figure (Figure 2A, 7E, and 9E)

      6) In general, the model is over-claimed: aside from interactions by IP-MS, little is demonstrated in this study about how SRSF1 affects alternative splicing in spermatogenesis, or how alternative splicing of TIAL1 specifically would result in the phenotype shown. It is not clear why Tial1/Tiar is selected as a candidate mediator of SRSF1 function from among the nine genes that are downregulated in the cKO, are bound by SRSF1, and undergo abnormal splicing. Although TIAL1 levels are reduced in cKO testes by Western blot (Fig. 7J), this could be due just be due to a depletion of germ cells from whole testis. The reported splicing difference for Tial1 seems very subtle and the ratio of isoforms does not look different in the Western blot image.

      Thank you very much for the helpful comments and suggestions. In our study, Tial1/Tiar is one of 39 stabilizing genes that are bound by SRSF1 and undergo abnormal AS. However, Western blotting showed that expression levels of TIAL1/TIAR isoform X2 were significantly suppressed (Figure 8J). So, the data indicate that SRSF1 is required for TIAL1/TIAR expression and splicing.

      Sun, L., Chen, J., Ye, R., Lv, Z., Chen, X., Xie, X., Li, Y., Wang, C., Lv, P., Yan, L., et al. (2023). SRSF1 is crucial for male meiosis through alternative splicing during homologous pairing and synapsis in mice. Sci Bull 68, 1100-1104. 10.1016/j.scib.2023.04.030.

    1. Author Response

      The following is the authors’ response to the original reviews.

      Reviewer #1 (Public Review):

      This manuscript represents an elegant bioinformatics approach to addressing causal pathways in vascular and liver tissue related to atherosclerosis/coronary artery disease, including those shared by humans and mice and those that are specific to only one of these species. The authors constructed co-expression networks using bulk transcriptome data from human (aorta, coronary) and mouse (aorta) vascular and liver tissue. They mapped human CAD GWAS data onto these modules, mapped GWAS SNPs to putatively causal genes, identified pathways and modules enriched in CAD GWAS hits, assessed those shared between vascular and liver tissues and between humans and mice, determined key driver genes in CAD-associated supersets, and used mouse single-cell transcriptome data to infer the roles of specific vascular and liver cell types. The overall approach used by the authors is rigorous and provides new insights into potentially causal pathways in vascular tissue and liver involved in atherosclerosis/CAD that are shared between humans and mice as well as those that are species-specific. This approach could be applied to a variety of other common complex conditions.

      The conclusions are largely supported by the analyses. Some specific comments:

      1) It appears that GWAS SNPs were mapped to genes solely through the use of eQTLs. Current methods involve a number of other complementary approaches to map GWAS SNPs to effector genes/transcripts and there is the thought that eQTLs may not necessarily be the best way to map causal genes.

      We agree with the reviewer that multiple approaches can be used to map GWAS SNPs to genes, and eQTLs is only one way to do so. We focused on eQTLs mainly because we aim to address tissue-specificity of eQTLs and the relative higher abundance of eQTLs compared to other tissue-specific functional genomics data, such as pQTLs and epiQTLs. We now acknowledge this limitation in the discussion section in our revised manuscript and point to future studies utilizing other approaches to map GWAS signals to downstream effectors.

      2) Given the critical causal role of circulating apoB lipoproteins in atherosclerosis in both mice and humans and the central role of the liver in regulating their levels, perhaps the authors could use the 'metabolism of lipids and lipoproteins' network in Fig 3B as a kind of 'positive control' to illustrate the overlap between mice and humans and the driver genes for this network.

      We appreciate the reviewer’s excellent suggestion and now elaborate the findings in Fig 3B as a positive control in the results section.

      3) Is it possible to infer the directionality of effect of key driver genes and pathways from these analyses? For example, ACADM was found to be a KD gene for a human-specific liver CAD superset pathway involving BCAA degradation. Are the authors able to determine or predict the effect of genetically increased expression of ACADM on BCAA metabolism and on CAD? Or the directionality of the effect of the hepatic KD gene OIT3 on hepatic and plasma lipids and atherosclerosis.

      The Bayesian networks only have information on which genes likely regulate the others but not the up or down-regulation direction, and the network key driver analysis only considers the enrichment of GWAS candidate genes in the neighborhood of each key driver. Therefore, it is not possible to directly infer whether increasing or decreasing a key driver will lead to up or downregulation of the downstream pathways based on our current analysis. We could, however, examine correlations of key driver genes with downstream genes, or disease traits in relevant datasets. For instance, we checked the mouse atherosclerosis HMDP datasets for the correlations between select key drivers and clinical traits and found various key drivers shared and species-specific in aorta and liver significantly correlate with aortic lesion area and other traits of interest such as LDL levels, and inflammatory cytokines. We have added these new findings into the results section and supplemental tables.

      4) While likely beyond the scope of this manuscript, the substantial amount of publicly available plasma proteomic and metabolomic data could be incorporated into this multiomic bioinformatic analysis. Many of the pathways involve secreted proteins or metabolites that would further inform the biology and the understanding of how these pathways relate to atherosclerosis.

      We appreciate the reviewer’s valuable suggestion. Here we focused on liver and aorta gene regulatory networks to understand the tissue-specific mechanisms at the gene level. Indeed, plasma proteomic and metabolomic data could be further incorporated in future studies to understand the pathways captured in the circulation that can capture cross-tissue interactions mediated by secreted proteins and metabolites from different tissues. We have addressed this as a future direction in the discussion section.

      The findings here will motivate the community of atherosclerosis investigators to pursue additional potential causal genes and pathways through computational and experimental approaches. It will also influence the approach around the use of the mouse model to test specific pathways and therapeutic approaches in atherosclerosis. In addition, the computational approach is robust and could (and likely will) be applied to a variety of other common complex conditions.

      Reviewer #2 (Public Review):

      Summary:

      Mouse models are widely used to determine key molecular mechanisms of atherosclerosis, the underlying pathology that leads to coronary artery disease. The authors use various systems biology approaches, namely co-expression and Bayesian Network analysis, as well as key driver analysis, to identify co-regulated genes and pathways involved in human and mouse atherosclerosis in artery and liver tissues. They identify species-specific and tissue-specific pathways enriched for the genetic association signals obtained in genome-wide association studies of human and mouse cohorts.

      Strengths:

      The manuscript is well executed with appropriate analysis methods. It also provides a compelling series of results regarding mouse and human atherosclerosis.

      Weaknesses:

      The manuscript has several weaknesses that should be acknowledged in the discussion. First, there are numerous models of mouse atherosclerosis; however, the HMDP atherosclerosis study uses only one model of mouse atherosclerosis, namely hyperlipidemic mice, due to the transgenic expression of human apolipoprotein ELeiden (APOE-Leiden) and human cholesteryl ester transfer protein (CETP). Therefore, when drawing general conclusions about mouse pathways not being identified in humans, caution is warranted. Other models of mouse atherosclerosis may be able to capture different aspects of human atherosclerosis.

      We appreciate the reviewer’s valuable insight! Indeed, the specific HMDP atherosclerosis model may miss important mouse pathways that could have overlapped with the human pathways. We have added this important point to the limitations section under the discussion to caution the interpretation of the human-specific pathways, as they could be present in mice but are missed by the specific HMDP atherosclerosis dataset used.

      Second, the mouse aorta tissue is atherosclerotic, whereas the atherosclerosis status of the GTEX aorta tissues is not known. Therefore, it is possible that some of the human or mouse-specific gene modules/pathways may be due to the difference in the disease status of the tissues from which the gene expression is obtained.

      We agree with the reviewer that GTEx vascular tissues have unclear atherosclerosis status. However, in addition to GTEx, we also included the human STARNET dataset which contains vascular tissues from human patients with CAD. Therefore, we believe the comparability of the human and mouse vascular tissue datasets is reasonable.

      Third, it is unclear how the sex of the mice (all female in the HMDP atherosclerosis study and all male in the baseline HMDP study) and the sex of the human donors affected the results. Did the authors regress out the influence of sex on gene expression in the human data before performing the co-expression and preservation studies? If not, this should be acknowledged.

      We acknowledge that the effect of sex in the mouse and human datasets were not regressed out in our analysis. We have added this under the limitations section.

      Fourth, some of the results are unexpected, and these should be discussed. For example, the authors identify that the leukocyte transendothelial migration pathway and PDGF signaling pathway are human-specific in their vascular tissue analysis. These pathways have been extensively described in mouse studies. Why do the authors think they identified these pathways as human-specific? Similarly, the authors identified gluconeogenesis and branched-chain amino acid catabolism as human and mouseshared modules in the vascular tissue. Is there evidence of the involvement of these pathways in atherosclerosis in vascular cells?

      We agree with the reviewer that these unexpected findings warrant further discussion. As pointed out by this reviewer, it is possible that the mouse HMDP atherosclerosis dataset cannot fully represent all mouse atherosclerosis biology and therefore missed the leukocyte migration and PDGF pathways that were identified in the human datasets. Regarding the surprising findings of pathways such as BCAA catabolism in vascular tissues, we acknowledge that future studies will need to further investigate such pathway predictions but also highlight that these pathway terms have many shared genes with more commonly known pathways such as the TCA cycle, which may indicate the involvement of energy metabolism in vascular tissues in CAD development. We have added these points to the discussion section under limitations and concluding remarks.

      Overall, acknowledging these drawbacks and adding points to the discussion will strengthen the manuscript.

      Reviewer #1 (Recommendations For The Authors):

      1) Could the authors comment on why MEGENA produces so many more co-expression modules per tissue than WCGNA?

      As described in the methods section, MEGENA uses a multi-scale clustering structure to generate network modules at different scales, with each scale representing a different compactness level of the modules. At lower compactness scales larger modules are generated; at higher compactness scales, smaller modules are generated. By using all modules obtained from different scales, the total number of modules is much larger than WGCNA which only generates a network at one scale.

      2) Much of the results section involves repeating in the text lists of pathways, modules, and genes that are also listed in Figures 2 and 3. The text in this part of the results could be used more productively to focus on illustrative examples or potential new biology.

      We have revised the results section to reduce repeating long lists of pathways, modules, and genes as suggested.

      Reviewer #2 (Recommendations For The Authors):

      In addition to the weaknesses I mentioned in the public review comments, there are a few minor issues that I outline below:

      1) The authors should introduce atherosclerosis as the underlying cause of CAD in the Introduction. In fact, I believe there are many places in the manuscript where the authors mean atherosclerosis instead of coronary artery disease, especially when presenting and discussing mouse results since the HMDP study did not examine the coronary arteries of mice. I believe the authors should make the appropriate changes throughout the manuscript.

      We have made the changes as suggested.

      2) The authors state in the introduction, "For example, mice tend to develop atherosclerotic lesions in the aorta and carotids, while humans often develop lesions in coronary arteries (Ma et al., 2012)." This is not entirely correct, so this sentence should be revised. Several models of mice show coronary artery atherosclerosis development, but most researchers study lesions in larger aortas. Further, humans develop lesions throughout the arterial tree, but perhaps what the authors meant was the most consequential plaque development is in the coronary arteries. Please rephrase.

      We have rephrased the statement as suggested.

      3) Last line of page 5 should read "...which will drive modules and pathways that are more likely..." not "derive"

      Typo corrected.

    1. Author Response

      We appreciate the editor's and reviewers' time to review our manuscript. We will work on the suggestions and have provided an initial assessment of what we can do for our revised submission.

      Reviewer #1 (Public Review):

      Summary:

      This study aimed to investigate the effects of optically stimulating the A13 region in healthy mice and a unilateral 6-OHDA mouse model of Parkinson's disease (PD). The primary objectives were to assess changes in locomotion, motor behaviors, and the neural connectome. For this, the authors examined the dopaminergic loss induced by 6-OHDA lesioning. They found a significant loss of tyrosine hydroxylase (TH+) neurons in the substantia nigra pars compacta (SNc) while the dopaminergic cells in the A13 region were largely preserved. Then, they optically stimulated the A13 region using a viral vector to deliver the channelrhodopsine (CamKII promoter). In both sham and PD model mice, optogenetic stimulation of the A13 region induced pro-locomotor effects, including increased locomotion, more locomotion bouts, longer durations of locomotion, and higher movement speeds. Additionally, PD model mice exhibited increased ipsilesional turning during A13 region photoactivation. Lastly, the authors used whole-brain imaging to explore changes in the A13 region's connectome after 6-OHDA lesions. These alterations involved a complex rewiring of neural circuits, impacting both afferent and efferent projections. In summary, this study unveiled the pro-locomotor effects of A13 region photoactivation in both healthy and PD model mice. The study also indicates the preservation of A13 dopaminergic cells and the anatomical changes in neural circuitry following PD-like lesions that represent the anatomical substrate for a parallel motor pathway.

      Strengths:

      These findings hold significant relevance for the field of motor control, providing valuable insights into the organization of the motor system in mammals. Additionally, they offer potential avenues for addressing motor deficits in Parkinson's disease (PD). The study fills a crucial knowledge gap, underscoring its importance, and the results bolster its clinical relevance and overall strength.

      The authors adeptly set the stage for their research by framing the central questions in the introduction, and they provide thoughtful interpretations of the data in the discussion section. The results section, while straightforward, effectively supports the study's primary conclusion the pro-locomotor effects of A13 region stimulation, both in normal motor control and in the 6-OHDA model of brain damage.

      We thank the reviewer for their positive comments.

      Weaknesses:

      1) Anatomical investigation. I have a major concern regarding the anatomical investigation of plastic changes in the A13 connectome (Figures 4 and 5). While the methodology employed to assess the connectome is technically advanced and powerful, the results lack mechanistic insight at the cell or circuit level into the pro-locomotor effects of A13 region stimulation in both physiological and pathological conditions. This concern is exacerbated by a textual description of results that doesn't pinpoint precise brain areas or subareas but instead references large brain portions like the cortical plate, making it challenging to discern the implications for A13 stimulation. Lastly, the study is generally well-written with a smooth and straightforward style, but the connectome section presents challenges in readability and comprehension. The presentation of results, particularly the correlation matrices and correlation strength, doesn't facilitate biological understanding. It would be beneficial to explore specific pathways responsible for driving the locomotor effects of A13 stimulation, including examining the strength of connections to well-known locomotor-associated regions like the Pedunculopontine nucleus, Cuneiformis nucleus, LPGi, and others in the diencephalon, midbrain, pons, and medulla.

      We considered two approaches initially. The first approach was to look at specific projections to the motor regions, focusing on the MLR. The second approach was to utilize a whole-brain analysis that is presented here. Given what we know about the zona incerta, especially its integrative role, we felt that a reasonable starting point was to examine the full connectome. The value of the whole-brain approach is that it provides a high-level overview of the afferents and efferents to the region. The changes in the brain that occur following Parkinson-like lesions, such as those in the nigrostriatal pathway, are known to be complex and can affect neighbouring regions such as the A13. Therefore, we wished to highlight the A13, which we considered a therapeutic target, and examine changes in connectivity that could occur following acute lesions affecting the SNc. We acknowledge that this study does not provide a causal link, but it presents the fundamental background information for subsequent hypothesis-driven, focused, region-specific analysis.

      The terms provided were from the Allen Brain Atlas terminology and were presented as abbreviations. We have looked at other ways to present it, including a greater emphasis on raw numbers and highlighting motor-related subareas. We will rewrite the connectomics section to make it more accessible, reflecting the change in the figures.

      Additionally, identifying the primary inputs to A13 associated with motor function would enhance the study's clarity and relevance.

      This is a great point and could help simplify the whole-brain results. We can present the motor-related inputs and outputs as part of a new figure in the main paper and add accompanying text in the results section. This will help highlight possible therapeutic pathways. We can also enhance our discussion of these motor-related pathways. We will retain the entire dataset and present it in a supplementary table for those who are interested.

      The study raises intriguing questions about compensatory mechanisms in Parkinson's disease and a new perspective on the preservation of dopaminergic cells in A13, despite the SNc degeneration, and the plastic changes to input/output matrices. To gain inspiration for a more straightforward reanalysis and discussion of the results, I recommend the authors refer to the paper titled "Specific populations of basal ganglia output neurons target distinct brain stem areas while collateralizing throughout the diencephalon from the David Kleinfeld laboratory." This could guide the authors in investigating motor pathways across different brain regions.

      Thank you for the advice, and as pointed out, Kleinfeld’s group had a nice, focused presentation of their data. For the connectomic piece, we can certainly adopt their reporting style, which, as you point out, may highlight key motor-related regions. There are a few ideas here that we can explore further, as mentioned above.

      2) Description of locomotor performance. Figure 3 provides valuable data on the locomotor effects of A13 region photoactivation in both control and 6-OHDA mice. However, a more detailed analysis of the changes in locomotion during stimulation would enhance our understanding of the pro-locomotor effects, especially in the context of 6-OHDA lesions. For example, it would be informative to explore whether the probability of locomotion changes during stimulation in the control and 6-OHDA groups. Investigating reaction time, speed, total distance, and even kinematic aspects during stimulation could reveal how A13 is influencing locomotion, particularly after 6-OHDA lesions. The laboratory of Whelan has a deep knowledge of locomotion and the neural circuits driving it so these features may be instructive to infer insights on the neural circuits driving movement. On the same line, examining features like the frequency or power of stimulation related to walking patterns may help elucidate whether A13 is engaging with the Mesencephalic Locomotor Region (MLR) to drive the pro-locomotor effects. These insights would provide a more comprehensive understanding of the mechanisms underlying A13-mediated locomotor changes in both healthy and pathological conditions.

      Thank you for these suggestions. We will revise as suggested. We will provide additional and/or updated data in revised figures and text. We will also move Supplementary Figures S1 and S2, which present additional locomotor data, into the main text to partly address the reviewers' points.

      Reviewer #2 (Public Review):

      Summary:

      The paper by Kim et al. investigates the potential of stimulating the dopaminergic A13 region to promote locomotor restoration in a Parkinson's mouse model. Using wild-type mice, 6-OHDA injection depletes dopaminergic neurons in the substantia nigra pars compacta, without impairing those of the A13 region and the ventral tegmentum area, as previously reported in humans. Moreover, photostimulation of presumably excitatory (CAMKIIa) neurons in the vicinity of the A13 region improves bradykinesia and akinetic symptoms after 6-OHDA injection. Whole-brain imaging with retrograde and anterograde tracers reveals that the A13 region undergoes substantial changes in the distribution of its afferents and projections after 6-OHDA injection. The study suggests that if the remodeling of the A13 region connectome does not promote recovery following chronic dopaminergic depletion, photostimulation of the A13 region restores locomotor functions.

      Strengths:

      Photostimulation of presumably excitatory (CAMKIIa) neurons in the vicinity of the A13 region promotes locomotion and locomotor recovery of wild-type mice 1 month after 6-OHDA injection in the medial forebrain bundle, thus identifying a new potential target for restoring motor functions in Parkinson's disease patients.

      Weaknesses:

      Electrical stimulation of the medial Zona Incerta, in which the A13 region is located, has been previously reported to promote locomotion (Grossman et al., 1958). Recent mouse studies have shown that if optogenetic or chemogenetic stimulation of GABAergic neurons of the Zona Incerta promotes and restores locomotor functions after 6-OHDA injection (Chen et al., 2023), stimulation of glutamatergic ZI neurons worsens motor symptoms after 6-OHDA (Lie et al., 2022).

      Thank you - we will add this reference. It is useful as Grossman did stimulate the zona incerta in the cat and elicit locomotion, suggesting that stimulation of the area in normal mice has external validity. The area targeted by Chen et al. (2023) is in the lateral aspect of central/medial zona incerta, formed by dorsal and ventral zona incerta, which may account for the differing results. Our data were robust for stimulation of the medial aspect of the rostromedial zona incerta. The thigmotactic behaviour that we observed in our work that focused on CamKII neurons has not been observed with chemogenetic, optogenetic activation or with photoinhibition of GABAergic central/medial ZI (Chen et al. 2023).

      Although CAMKIIa is a marker of presumably excitatory neurons and can be used as an alternative marker of dopaminergic neurons, behavioral results of this study raise questions about the neuronal population targeted in the vicinity of the A13 region. Moreover, if YFP and CHR2-YFP neurons express dopamine (TH) within the A13 region (Fig. 2), there is also a large population of transduced neurons within and outside of the A13 region that do not, thus suggesting the recruitment of other neuronal cell types that could be GABAergic or glutamatergic.

      We found that CamKII transfection of the A13 region was extremely effective in promoting locomotor activity, which was critical for our work in exploring its possible therapeutic potential. We acknowledge that specific viral approaches that target the GABAergic, glutamatergic, and dopaminergic circuits would be very useful. The range of tools to target A13 dopaminergic circuits is more limited than the SNc, for example, because the A13 region lacks DAT, and TH-IRES-Cre approaches, while useful, are less specific than DAT-Cre mouse models. Intersectional approaches targeting multiple transmitters (glutamate & dopamine, for example) may be one solution as we do not expect that a single transmitter-specific pathway would work, as well as broad targeting of the A13 region. Recent work suggests that GABAergic neuron activation may have more general effects on behaviour rather than control of ongoing locomotor parameters. However, this is in contrast to recent work showing a positive valence effect of dopamine A13 activation on motivated food-seeking behavior, which differs from consummatory behavior observed with GABAergic modulation (Ye, Nunez, and Zhang 2023). Chemogenetic inactivation and ablation of dopaminergic A13 revealed that they contribute to grip strength and prehensile movements, uncoupling food-seeking grasping behavior from motivational factors (Garau et al. 2023). Overall, this suggests differing effects of GABA compared to DA and/or glutamatergic cell types, consistent with our effects of stimulating CamKII.

      Regarding the analysis of interregional connectivity of the A13 region, there is a lack of specificity (the viral approach did not specifically target the A13 region), the number of mice is low for such correlation analyses (2 sham and 3 6-OHDA mice), and there are no statistics comparing 6-OHDA versus sham (Fig. 4) or contra- versus ipsilesional sides (Fig. 5). Moreover, the data are too processed, and the color matrices (Fig. 4) are too packed in the current format to enable proper visualization of the data. The A13 afferents/efferents analysis is based on normalized relative values; absolute values should also be presented to support the claim about their upregulation or downregulation.

      Generally, papers using tissue-clearing imaging approaches have low sample sizes due to technical complexity and challenges. The technical challenges of obtaining these data were substantial in both collection and analysis. There are multiple technical complexities arising from dual injections (A13 and MFB coordinates) and targeting the area correctly. The A13 region is difficult to target as it spans only around 300 µm in the anterior-posterior axis. While clearing the brain takes weeks, and light-sheet imaging also takes time, the time necessary to analyze the tissue using whole-brain quantification is labor intensive, especially with a lack of a standardized analysis pipeline from atlas registrations, signal segmentations, and quantifications. The field is still relatively new, requiring additional time to refine pipelines.

      Correlation matrices are often used in analyzing connectivity patterns on a brain-wide scale, as they can identify any observable patterns within a large amount of data. We used correlation matrices to display estimated correlation coefficients between the afferent and efferent proportions from one brain subregion to another across 251 brain regions in total in a pairwise manner (not for hypothesis testing). We provided descriptive statistics (mean and error bars) in Figure 5C and G. As mentioned in comments for Reviewer 1, we will also present data in a revised Figure 5 and/or a new figure that focuses specifically on motor-related pathways to provide information on possible therapeutic pathways. As suggested, absolute values will be shared in a supplemental table.

      In the absence of changes in the number of dopaminergic A13 neurons after 6-OHDA injection, results from this correlation analysis are difficult to interpret as they might reflect changes from various impaired brain regions independently of the A13 region.

      We acknowledge that models of Parkinson’s disease, particularly those using 6-OHDA, induce plasticity in various regions, which may subsequently affect A13 connectivity. Our aim is to emphasize the residual, intact A13 pathways that could serve as therapeutic targets in future investigations. This emphasis is pertinent in the context of potential clinical applications, as the overall input and output to the region fundamentally dictate the significance of the A13 region in lesioned nigrostriatal models. We agree with the reviewer that the changes certainly can be independent of A13; however, the fact that there was a significant change in the connectome post-6-OHDA injection and striatonigral degeneration is in and of itself important and important to document.

      There is no causal link between anatomical and behavioral data, which raises questions about the relevance of the anatomical data.

      This point was also addressed earlier in response to a comment from Reviewer 1. Focusing on specific motor pathways is one avenue to explore. However, given that the zona incerta acts as an integrative hub, we believed it is prudent to initially examine both afferent and efferent pathways using a brain-wide approach. For instance, without employing this methodology, the potential significance of cortical interconnectivity to the A13 region might not have been fully appreciated. As mentioned previously, we will place additional emphasis on motor-related regions in our revised paper, thereby enhancing the relevance of the anatomical data presented. With these modifications, we anticipate that our data will underscore specific motor-related targets for future exploration, employing optogenetic targeting to assess necessity and sufficiency.

      Overall, the study does not take advantage of genetic tools accessible in the mouse to address the direct or indirect behavioral and anatomical contributions of the A13 region to motor control and recovery after 6-OHDA injection.

      We acknowledge that our study has not specifically targeted neurons that express dopaminergic, glutamatergic, or GABAergic properties (refer to earlier comment for more detail). However, like others, we find that targeting one neuronal population often does not result in a pure transmitter phenotype. For instance, evidence suggests co-localization of dopamine neurons with a subpopulation of GABA neurons in the A13/medial zona incerta (Negishi et al. 2020). In the hypothalamus, research by Deisseroth and colleagues (Romanov et al. 2017) indicates the presence of multiple classes of dopamine cells, each containing different ratios of co-localized peptides and/or fast neurotransmitters. Consequently, we believe our work lays the foundation for the investigations suggested by the reviewer. Furthermore, if one considers this work in the context of a preclinical study to determine whether the A13 might be a target in human Parkinson's disease, the existing technology that could be utilized is deep brain stimulation (DBS) or electrical modulation, which would also affect different neuronal populations in a non-specific manner. While optogenetic stimulation therapy is longer term, using CamKII combined with the DJ hybrid AAV could be a translatable strategy for targeting A13 neuronal populations in non-human primates (Watakabe et al. 2015; Watanabe et al. 2020).

      Reviewer #3 (Public Review):

      Kim, Lognon et al. present an important finding on pro-locomotor effects of optogenetic activation of the A13 region, which they identify as a dopamine-containing area of the medial zona incerta that undergoes profound remodeling in terms of afferent and efferent connectivity after administration of 6-OHDA to the MFB. The authors claim to address a model of PD-related gait dysfunction, a contentious problem that can be difficult to treat with dopaminergic medication or DBS in conventional targets. They make use of an impressive array of technologies to gain insight into the role of A13 remodeling in the 6-OHDA model of PD. The evidence provided is solid and the paper is well written, but there are several general issues that reduce the value of the paper in its current form, and a number of specific, more minor ones. Also, some suggestions, that may improve the paper compared to its recent form, come to mind.

      Thank you for the suggestions and careful consideration of our work - it is appreciated.

      The most fundamental issue that needs to be addressed is the relation of the structural to the behavioral findings. It would be very interesting to see whether the structural heterogeneity in afferent/effects projections induced by 6-OHDA is related to the degree of symptom severity and motor improvement during A13 stimulation.

      As mentioned in comments for Reviewer 1, we will be highlighting motor-related A13 pathways in a revised Figure 5 and/or a new figure. We hope that our work will provide a roadmap for future studies to disentangle divergent or convergent A13 pathways that are involved in different or all PD-related motor symptoms. Because we could not measure behavioural change in the same animals studied with the anatomic study (essentially because the optrode would have significantly disrupted the connectome we are measuring), we cannot directly compare behaviour to structure.

      The authors provide extensive interrogation of large-scale changes in the organization of the A13 region afferent and efferent distributions. It remains unclear how many animals were included to produce Fig 4 and 5. Fig S5 suggests that only 3 animals were used, is that correct? Please provide details about the heterogeneity between animals. Please provide a table detailing how many animals were used for which experiment. Were the same animals used for several experiments?

      The behavioral set and the anatomical set were necessarily distinct. In the anatomical experiments, we employed both anterograde and retrograde viral approaches to target the afferent and efferent A13 populations with fluorescent proteins. For the behavioral approach, a single ChR2 opsin was utilized to photostimulate the A13 region; hence combining the two populations was not feasible. We were also concerned that the optrode itself would interfere with connectomics. A lower number of animals were used for the whole-brain work due to technical limitations described earlier. We will provide more details regarding numbers we can identify as a table and text.

      While the authors provide evidence that photoactivation of the A13 is sufficient in driving locomotion in the OFT, this pro-locomotor effect seems to be independent of 6-OHDA-induced pathophysiology. Only in the pole test do they find that there seems to be a difference between Sham vs 6-OHDA concerning the effects of photoactivation of the A13. Because of these behavioral findings, optogenic activation of A13 may represent a gain of function rather than disease-specific rescue. This needs to be highlighted more explicitly in the title, abstract, and conclusion.

      We agree with the reviewer that this aspect needs to be highlighted more. Optogenetic activation of A13 may represent a gain of function in both healthy and 6-OHDA mice, highlighting a parallel descending motor pathway that remains intact. 6-OHDA lesions have multiple effects on motor and cognitive function. This makes a single pathway unlikely to rescue all deficits observed in 6-OHDA models. We can say that the lack of locomotion observed in 6-OHDA models can be reversed by A13 region stimulation. We have discussed some aspects of the gain of function possibility but will augment this in other areas of the paper as well, as suggested.

      The authors claim that A13 may be a possible target for DBS to treat gait dysfunction. However, the experimental evidence provided (in particular the lack of disease-specific changes in the OFT) seems insufficient to draw such conclusions. It needs to be highlighted that optogenetic activation does not necessarily have the same effects as DBS (see the recent review from Neumann et al. in Brain: https://pubmed.ncbi.nlm.nih.gov/37450573/). This is important because ZI-DBS so far had very mixed clinical effects. The authors should provide plausible reasons for these discrepancies. Is cell-specificity, which only optogenetic interventions can achieve, necessary? Can new forms of cyclic burst DBS achieve similar specificity (Spix et al, Science 2021)? Please comment.

      Thank you for the useful comments - we will update our discussion accordingly.

      Our study highlights a parallel motor pathway provided by the A13 region that remains intact in 6-OHDA mice and can be sufficiently driven to rescue the hypolocomotor pathology observed in the OFT and overcome bradykinesia and akinesia. The photoactivation of ipsilesional A13 also has an overall additive effect on ipsiversive circling, representing a gain of function on the intact side that contributes to the magnitude of overall motor asymmetry against the lesioned side. The effects of DBS are rather complex, ranging from micro-, meso-, to macro-scales, involving activation, inhibition, and informational lesioning, and network interactions. This could contribute to the mixed clinical effects observed with ZI-DBS, in addition to differences in targeting and DBS programming among the studies (see review (Ossowska 2019)). Also the DBS studies targeting ZI have never targeted the rostromedial ZI which extends towards the hypothalamus and contains the A13. Furthermore, DBS and electrical stimulation of neural tissue, in general, are always limited by current spread and lower thresholds of activation of axons (e.g., axons of passage), both of which can reduce the specificity of the true therapeutic target. Optogenetic studies have provided mechanistic insights that could be leveraged in overcoming some of the limitations in targeting with conventional DBS approaches. Spix et al. (2021) provided an interesting approach highlighting these advancements. They devised burst stimulation to facilitate population-specific neuromodulation within the external globus pallidus. Moreover, they found a complementary role for optogenetics in exploring the pathway-specific activation of neurons activated by DBS. To ascertain whether A13 DBS may be a viable therapy for PD gait, it will be necessary to perform many more preclinical experiments, and tuning of DBS parameters could be facilitated by optogenetic stimulation in these murine models.

      In a recent study, Jeon et al (Topographic connectivity and cellular profiling reveal detailed input pathways and functionally distinct cell types in the subthalamic nucleus, 2022, Cell Reports) provided evidence on the topographically graded organization of STN afferents and McElvain et al. (Specific populations of basal ganglia output neurons target distinct brain stem areas while collateralizing throughout the diencephalon, 2021, Neuron) have shown similar topographical resolution for SNr efferents. Can a similar topographical organization of efferents and afferents be derived for the A13/ ZI in total?

      The ZI can be subdivided into four subregions in the antero-posterior axis: rostral (ZIr), dorsal (ZId), ventral (ZIv), and caudal (ZIc) regions. The dorsal and ventral ZI is also referred together as central/medial/intermediate ZI. There are topographical gradients in different cell types and connectivity across these subregions (see reviews: (Mitrofanis 2005; Monosov et al. 2022; Ossowska 2019). Recent work by Yang and colleagues (2022) demonstrated a topographical organization among the inputs and outputs of GABAergic (VGAT) populations across four ZI subregions. Given that A13 region encompasses a smaller portion (the medial aspect) of both rostral and medial/central ZI (three of four ZI subregions) and coexpress VGAT, A13 region likely falls under rostral and intermediate medial ZI dataset found in Yang et al. (2022). With our data, we would not be able to capture the breadth of topographical organization shown in Yang et al (2022).

      In conclusion, this is an interesting study that can be improved by taking into consideration the points mentioned above.

      Reviewer #1 (Recommendations For The Authors):

      1) Figure 2 indeed presents valuable information regarding the effects of A13 region photoactivation. To enhance the comprehensiveness of this figure and gain a deeper understanding of the neurons driving the pro-locomotor effect of stimulation, it would be beneficial to include quantifications of various cell types:

      • cFos-Positive Cells/TH-Positive Cells: it can help determine the impact of A13 stimulation on dopaminergic neurons and the associated pro-locomotor effect in the healthy condition and especially in the context of Parkinson's disease (PD) modeling.

      • cFos-Positive Cells /TH-Negative Cells: Investigating the number of TH-negative cells activated by stimulation is also important, as it may reveal non-dopaminergic neurons that play a role in locomotor responses. Identifying the location and characteristics of these TH-negative cells can provide insights into their functional significance.

      Incorporating these quantifications into Figure 2 would enhance the figure's informativeness and provide a more comprehensive view of the neuronal populations involved in the locomotor effects of A13 stimulation.

      Agreed - we will add quantification and create graphs to present the data in Figure 2.

      2) Refer to Figure 3. In the main text (page 5) when describing the animal with 6-OHDA the wrong panels are indicated. It is indicated in Fgure 2A-E but it should be replaced with 3A-E. Please do that.

      Will be done

      Reviewer #2 (Recommendations For The Authors):

      Abstract

      Page 1: Inhibitory or lesion studies will be necessary to support the claim that the global remodeling of afferent and efferent projections of the A13 region highlights the Zona Incerta's role as a crucial hub for the rapid selection of motor function.

      We believe that overall, there is quite a bit of evidence that the zona incerta is a hub for afferent/efferents. Mitrofanis (2005) and, more recently, Wang et al. (2020) summarize some of the evidence. Yang (2022) illustrates that the zona incerta shows multiple inputs to GABAergic neurons and outputs to diverse regions. Recent work suggests that the zona incerta contributes to various motor functions such as hunting, exploratory locomotion, and integrating multiple modalities (Zhao et al. 2019; Wang et al. 2019; Monosov et al. 2022; Chometton et al. 2017). We will update our paper to reflect these references.

      Introduction

      Page 2, paragraph 2: "However, little attention has been placed on the medial zona incerta (mZI), particularly the A13, the only dopamine-containing region of the rostral ZI" Is the A13 region located in the rostral or medial ZI or both?

      It should have been written “rostromedial” ZI. The A13 is located in the medial aspect of rostromedial ZI. We will update the introduction.

      Page 2, para 3: Li et al (2021) used a mini-endoscope to record the GCaMP6 signal. Masini and Kiehn, 2022 transiently blocked the dopaminergic transmission; they never used 6-OHDA. Please correct through the text.

      We will correct this.

      Page 2, para 4: the A13 connectome encompasses the cerebral cortex,... MLR. The MLR is a functional region, correct this for the CNF and PPN.

      Thank you, we will correct this.

      Page 3, the last paragraph of the introduction could be clarified by presenting the behavioral data first, followed by the anatomy.

      We will correct this.

      Figure 1 is nice and clear, and well summarizes the experimental design.

      Thank you.

      Figure 2 shows an example of the extent of the ChR2-YFP expression and the position of an optical fiber tip above the dopaminergic A13 region from a mouse. Without any quantification, these images could be included in Figure 1. Despite a very small volume (36.8nL) of AAV, the extent of ChR2-YFP expression is quite large and includes dopaminergic and unidentified neurons within the A13 region but also a large population of unidentified neurons outside of it, thus raising questions about the volume and the types of neurons recruited.

      This is an important consideration. As mentioned previously, we will provide more information on viral spread and optrode location. The issue of viral spread is complex and depends on factors including tissue type, serotype, and promotor of the virus. Li et al. (2021), for example, used different virus serotypes and promotors, injecting 150 nL, whereas we used AAV DJ, injecting 36.8nL. AAV-DJ is a hybrid viral type consisting of multiple serotypes. It has a high transduction efficiency, which leads to greater gene delivery than single-serotype AAV viral constructs (Mao et al. 2016). A secondary consideration regarding translation was that AAV-DJ could effectively transduce non-primate neurons (Watanabe et al. 2020). We have addressed the issue of neurons recruited earlier and will provide c-Fos quantification to illustrate the extent of co-localization with TH.

      Anatomical reconstruction of the extent of the ChR2-YFP expression and the location of the tip of the optical fiber will be necessary to confirm that ChR2-YFP expression was restricted to the A13 region.

      We will provide additional information regarding viral spread, ferrule tip placement, and c-fos cell counts.

      Page 5, 1st para: Double-check the references, as not all of them are 6-OHDA injections in the MLF.

      Will correct.

      Page 5, 1st para, 4th line: Replace ferrule with optical canula or fiber.

      Will correct.

      Page 5, 1st para, 9th line: Replace Figure 2 with Figure 3.

      Will correct.

      Page 5, 2nd para: About the refractory decrease in traveled distance by sham-ChR2 mice: is this significant?

      It was not significant (Figure S1, 1-way RM ANOVA: F5,25 = 0.486, P = 0.783)). We will update this.

      Figure 3 showing behavioral assessments is nice, but the stats are not always clear. In Fig 3A, are each of the off and on boxes 1 minute long? The figure legend states the test lasts 1 min, but isn't it 4 minutes? In Figure 3B-E and 3J-M, what are the differences? Do the stats identify a significant difference only during the stimulation phase? Fig. 3F-I are nice and could have been presented as primary examples prior to data analysis in Fig. 3B-E. Group labels above the graph would help.

      Yes, the off-on boxes are 1 minute long. We will correct the error in the legend. Great suggestion for F-I - we will move them ahead of the summary figures.

      Fig. 3L-M, what do PreSur, Post, and Ferrule mean? I assume that Ferrule refers to mice tested with the optical fiber without stimulation, whereas Stim. refers to the stimulation. It would be helpful to standardize the format of stats in Fig. 3B-E and 3-J-M. What are time points a, b, and c referring to?

      We will do this.

      Figure S2A: the higher variability in 6-OHDA-YFP mice in comparison to 6-OHDA-ChR2 mice prior to stimulation suggests that 6-OHDA-YFP mice were less impaired. Why use boxplots only for these data? Would a pairwise comparison be more appropriate?

      Data did not follow a normal distribution and thus, were plotted as box and whiskers with the horizontal line through the box indicating the group median, interquartile range indicated by the limits of the box, and group minimum and maximum indicated by the whiskers. And indeed, a non-parametric equivalent of paired t-test (Wilcoxon signed-rank test) was used.

      Fig. S2B: add the statistical marker.

      Will do

      Page 7, para 1, line 8: to add "in comparison to 6-OHDA-YFP and YFP mice" to during photostimulation... (Figure 3E).

      Will do

      Page 7, para 3, line 5: about larger improvement, replace "sham ChR2" with "6-OHDA."

      Will do

      Page 8, para 1, line 4: Perier et al., 2000 reported that 6-OHDA injection increased the firing frequency of the ZI over a month.

      We will add that time frame. Agreed, it is shorter than the behavioral work, which was started 3 weeks after 6-OHDA injection.

      Page 8, para 2, line 1: Since the results were expected, add some references.

      Will do

      Page 8, para 3, line 4. Double-check the reference.

      Will correct and update

      Page 8: About large-scale changes in the A13 region, the relevance of correlation matrices is difficult to grasp. Analysis of local connectivity would have been more informative in the context of GABAergic and glutamatergic neurons of the ZI in the vicinity of the A13 region.

      We will explore alternative methods to present the data.

      Page 8, para 3, line: given Fig. 2, there is concern about the claim that only the A13 region was targeted. The time of the analysis after 6-OHDA should be mentioned. Some sections of the paragraph could be moved to methods.

      As mentioned earlier, we will provide additional information regarding viral spread, ferrule tip placement, and c-fos cell counts. We will mention analysis time after 6-OHDA and update Figure 1a to include this.

      Fig. 4: The color code helps the reader visualize distribution differences. However, statistical analyses comparing 6-OHDA versus sham should be included. Quantification per region would greatly help readers visualize the data and support the conclusion. The relationship between the type of correlation (positive or negative) and absolute change (increase or decrease) is unknown in the current format, which limits the interpretation of the data. Moreover, examples of raw images of axons and cells should be presented for several brain regions. The experimental design with a timeline, as in Fig. 1, would be helpful. The legend for Fig. 4 is a bit long. Some sections are very descriptive, whereas others are more interpretive.

      We will explore alternative methods of presenting the data, as suggested in a previous comment. Should we retain the correlation matrix, we will incorporate the reviewer’s suggestions.

      Page 10, para 1, line 1: add "afferent" to "changes in -afferent and- projection patterns."

      Will do

      Page 10, para 1, line 9: remove the 2nd "compared to sham" in the sentence.

      Will do

      10, para 1, line 10: remove "coordinated" in "several regions showed a coordinated reduction in afferent density." We cannot say anything about the timing of events, as there is only info at 1 month.

      Will do

      Page 10, para 2: the section should be written in the past tense.

      Will do

      Page 13, para 2, the last sentence is overstated. Please remove "cells" and refer to the A13 region instead.

      Will do

      About differential remodelling of the A13 region connectome: Figure 5C and 5G: The proportion of total afferents ipsi- and contralateral to 6-OHDA injection argues that the A13 region primarily receives inputs from the cortical plate and the striatum. Unfortunately, there are no statistics.

      Due to the small sample size, we provided descriptive statistics (mean and error bars) in Figure 5C and G. As mentioned in comments for Reviewers 1 and 2, we will revise Figure 5 to present data focusing on motor-related pathways to provide clarity. In addition, absolute values will be shared in a supplemental table.

      Figure 5 D and 5H: Changes in the proportion of total afferents/projections are relatively modest (less than 10% of the whole population for the highest changes). There is no standard deviation for these data and no statistics. Do they reflect real changes or variability from the injection site?

      The changes are relatively modest (less than 10%) since a small brain region usually provides a very small proportion of total input (McElvain et al. 2021; Yang et al. 2022). The changes in the proportions reflect real differences between average proportions observed in sham and 6-OHDA mice. The variability in the total labeling of neurons and fibers was minimized by normalizing individual regional counts against total counts found in each individual animal.

      Fig 5F and H: The example in F shows a huge decrease in the striatum, but H indicates only a 2% change, which makes the example not very representative. Absolute values would be helpful.

      While a 2% change may seem small, it represents a relatively large change in the A13 efferent connectome. To provide further clarity, we will provide absolute values as suggested in our new supplemental table.

      Figure 6 is inaccurate and unnecessary.

      Agree - it is too simplistic. We will remove it and replace it with one outlined in comments to Reviewer 1.

      Discussion

      Although interesting, the discussion is too long.

      We will make it more concise in the revised paper.

      Page 12: para 2. If the A13 region has a pro-locomotor effect and has therapeutical potential; the claim about its plasticity relies on Fig. 4 and 5, which have a limited scope in the current analysis and presentation (see comments above).

      We will revise the paper per the comments above and then update this accordingly.

      Methods

      Page 17, para 1: include the stereotaxic coordinates of the optical cannula above the A13 region.

      We will include this information.

      References

      Chen, Fenghua, Junliang Qian, Zhongkai Cao, Ang Li, Juntao Cui, Limin Shi, and Junxia Xie. 2023. “Chemogenetic and Optogenetic Stimulation of Zona Incerta GABAergic Neurons Ameliorates Motor Impairment in Parkinson’s Disease.” iScience 26 (7). https://doi.org/10.1016/j.isci.2023.107149.

      Chometton, S., K. Charrière, L. Bayer, C. Houdayer, G. Franchi, F. Poncet, D. Fellmann, and P. Y. Risold. 2017. “The Rostromedial Zona Incerta Is Involved in Attentional Processes While Adjacent LHA Responds to Arousal: C-Fos and Anatomical Evidence.” Brain Structure & Function 222 (6): 2507–25.

      Garau, Celia, Jessica Hayes, Giulia Chiacchierini, James E. McCutcheon, and John Apergis-Schoute. 2023. “Involvement of A13 Dopaminergic Neurons in Prehensile Movements but Not Reward in the Rat.” Current Biology: CB, October. https://doi.org/10.1016/j.cub.2023.09.044.

      Li, Zhuoliang, Giorgio Rizzi, and Kelly R. Tan. 2021. “Zona Incerta Subpopulations Differentially Encode and Modulate Anxiety.” Science Advances 7 (37): eabf6709.

      Mao, Yingying, Xuejun Wang, Renhe Yan, Wei Hu, Andrew Li, Shengqi Wang, and Hongwei Li. 2016. “Single Point Mutation in Adeno-Associated Viral Vectors -DJ Capsid Leads to Improvement for Gene Delivery in Vivo.” BMC Biotechnology 16 (January): 1.

      McElvain, Lauren E., Yuncong Chen, Jeffrey D. Moore, G. Stefano Brigidi, Brenda L. Bloodgood, Byung Kook Lim, Rui M. Costa, and David Kleinfeld. 2021. “Specific Populations of Basal Ganglia Output Neurons Target Distinct Brain Stem Areas While Collateralizing throughout the Diencephalon.” Neuron 109 (10): 1721–38.e4.

      Mitrofanis, J. 2005. “Some Certainty for the ‘Zone of Uncertainty’? Exploring the Function of the Zona Incerta.” Neuroscience 130 (1): 1–15.

      Monosov, Ilya E., Takaya Ogasawara, Suzanne N. Haber, J. Alexander Heimel, and Mehran Ahmadlou. 2022. “The Zona Incerta in Control of Novelty Seeking and Investigation across Species.” Current Opinion in Neurobiology 77 (December): 102650.

      Negishi, Kenichiro, Mikayla A. Payant, Kayla S. Schumacker, Gabor Wittmann, Rebecca M. Butler, Ronald M. Lechan, Harry W. M. Steinbusch, Arshad M. Khan, and Melissa J. Chee. 2020. “Distributions of Hypothalamic Neuron Populations Coexpressing Tyrosine Hydroxylase and the Vesicular GABA Transporter in the Mouse.” The Journal of Comparative Neurology 528 (11): 1833–55.

      Ossowska, Krystyna. 2019. “Zona Incerta as a Therapeutic Target in Parkinson’s Disease.” Journal of Neurology. https://doi.org/10.1007/s00415-019-09486-8.

      Romanov, Roman A., Amit Zeisel, Joanne Bakker, Fatima Girach, Arash Hellysaz, Raju Tomer, Alán Alpár, et al. 2017. “Molecular Interrogation of Hypothalamic Organization Reveals Distinct Dopamine Neuronal Subtypes.” Nature Neuroscience 20 (2): 176–88.

      Spix, Teresa A., Shruti Nanivadekar, Noelle Toong, Irene M. Kaplow, Brian R. Isett, Yazel Goksen, Andreas R. Pfenning, and Aryn H. Gittis. 2021. “Population-Specific Neuromodulation Prolongs Therapeutic Benefits of Deep Brain Stimulation.” Science 374 (6564): 201–6.

      Wang, Xiyue, Xiaolin Chou, Bo Peng, Li Shen, Junxiang J. Huang, Li I. Zhang, and Huizhong W. Tao. 2019. “A Cross-Modality Enhancement of Defensive Flight via Parvalbumin Neurons in Zona Incerta.” eLife 8 (April). https://doi.org/10.7554/eLife.42728.

      Wang, Xiyue, Xiao-Lin Chou, Li I. Zhang, and Huizhong Whit Tao. 2020. “Zona Incerta: An Integrative Node for Global Behavioral Modulation.” Trends in Neurosciences 43 (2): 82–87.

      Watakabe, Akiya, Masanari Ohtsuka, Masaharu Kinoshita, Masafumi Takaji, Kaoru Isa, Hiroaki Mizukami, Keiya Ozawa, Tadashi Isa, and Tetsuo Yamamori. 2015. “Comparative Analyses of Adeno-Associated Viral Vector Serotypes 1, 2, 5, 8 and 9 in Marmoset, Mouse and Macaque Cerebral Cortex.” Neuroscience Research 93 (April): 144–57.

      Watanabe, Hidenori, Hiromi Sano, Satomi Chiken, Kenta Kobayashi, Yuko Fukata, Masaki Fukata, Hajime Mushiake, and Atsushi Nambu. 2020. “Forelimb Movements Evoked by Optogenetic Stimulation of the Macaque Motor Cortex.” Nature Communications 11 (1): 3253.

      Yang, Yang, Tao Jiang, Xueyan Jia, Jing Yuan, Xiangning Li, and Hui Gong. 2022. “Whole-Brain Connectome of GABAergic Neurons in the Mouse Zona Incerta.” Neuroscience Bulletin 38 (11): 1315–29.

      Ye, Qiying, Jeremiah Nunez, and Xiaobing Zhang. 2023. “Zona Incerta Dopamine Neurons Encode Motivational Vigor in Food Seeking.” bioRxiv : The Preprint Server for Biology, June. https://doi.org/10.1101/2023.06.29.547060.

      Zhao, Zheng-Dong, Zongming Chen, Xinkuan Xiang, Mengna Hu, Hengchang Xie, Xiaoning Jia, Fang Cai, et al. 2019. “Zona Incerta GABAergic Neurons Integrate Prey-Related Sensory Signals and Induce an Appetitive Drive to Promote Hunting.” Nature Neuroscience 22 (6): 921–32.

    1. Author Response

      The following is the authors’ response to the original reviews.

      eLife assessment

      This important study provides a framework bearing on the role of Eph-Ephrin signaling mechanisms in the clinically condition of amyotrophic lateral sclerosis. It provides compelling evidence for the roles of glial cells in this condition. This novel astrocyte-mediated mechanism may help identify future therapeutic targets.

      Drs. Huang and Zaidi: Thank you for considering this revision of our manuscript for potential publication in eLife. We have addressed the excellent comments of the two reviewers, including the addition of new data. We have included detailed response-to-reviewer comments below to address each specific point, and we have highlighted all the changes in the manuscript text (using a red font color) made in response to these comments. Based on the reviewers’ critiques, we feel our re-working of the manuscript has made for a greatly improved study.

      Reviewer #1 (Public Review):

      In the manuscript by Urban et al., the authors attempt to further delineate the role which non-neuronal CNS cells play in the development of ALS. Toward this goal, the transmembrane signaling molecule ephrinB2 was studied. It was found that there is an increased expression of ephrinB2 in astrocytes within the cervical ventral horn of the spinal cord in a rodent model of ALS. Moreover, the reduction of ephrinB2 reduced motoneuron loss and prevented respiratory dysfunction at the NMJ. Further driving the importance of ephrinB2 is an increased expression in the spinal cords of human ALS individuals. Collectively, these findings present compelling evidence implicating ephrinB2 as a contributing factor towards the development of ALS.

      We thank Reviewer #1 for the very helpful critique. We address each of the specific comments below (in the “Recommendations for the Authors” section of this Response to Reviewer Comments document), and have made changes to the manuscript based on these excellent points.

      Reviewer #2 (Public Review):

      The contribution of glial cells to the pathogenesis of amyotrophic lateral sclerosis (ALS) is of substantial interest and the investigators have contributed significantly to this emerging field via prior publications. In the present study, authors use a SOD1G93A mouse model to elucidate the role of astrocyte ephrinB2 signaling in ALS disease progression. Erythropoietin-producing human hepatocellular receptors (Ephs) and the Eph receptor-interacting proteins (ephrins) signaling is an important mediator of signaling between neurons and non-neuronal cells in the nervous system. Recent evidence suggests that dysregulated Eph-ephrin signaling in the mature CNS is a feature of neurodegenerative diseases. In the ALS model, upregulated Eph4A expression in motor neurons has been linked to disease pathogenesis. In the present study, authors extend previous findings to a new class of ephrinB2 ligands. Urban et al. hypothesize that upregulated ephrinB2 signaling contributes to disease pathogenesis in ALS mice. The authors successfully test this hypothesis and their results generally support their conclusion.

      Major strengths of this work include a robust study design, a well-defined translational model, and complementary biochemical and experimental methods such that correlated findings are followed up by interventional studies. Authors show that ephrinB2 ligand expression is progressively upregulated in the ventral horn of the cervical and lumbar spinal cord through pre-symptomatic to end stages of the disease. This novel association was also observed in lumbar spinal cord samples from postmortem samples of human ALS donors with a SOD1 mutation. Further, they use a lentiviral approach to drive knock-down of ephrinB2 in the central cervical region of SOD1G93A mice at the presymptomatic stage. Interestingly, in spite of using a non-specific promoter, authors note that the lentiviral expression was preferentially driven in astrocytes.

      Since respiratory compromise is a leading cause of morbidity in the ALS population, the authors proceed to characterize the impact of ephrinB2 knockdown on diaphragm muscle output. In mice approaching the end stage of the disease, electrophysiological recordings from the diaphragm muscle show that animals in the knock-down group exhibited a ~60% larger amplitude. This functional preservation of diaphragm function was also accompanied by the preservation of diaphragm neuromuscular innervation. However, it must be noted that this cervical ephrinB2 knockdown approach had no impact on disease onset, disease duration, or animal survival. Furthermore, there was no impact of ephrinB2 knockdown on forelimb or hindlimb function.

      We thank Reviewer #2 for the very helpful critique. We address each of the specific comments below, and have made changes to the manuscript based on all of these excellent points.

      The major limitation of the manuscript as currently written is the conclusion that the preservation of diaphragm output following ephrinB2 knockdown in SOD1 mice is mediated primarily (if not entirely) by astrocytes. The authors present convincing evidence that a reduction in ephrinB2 is observed in local astrocytes (~56% transduction) following the intraspinal injection of the lentivirus. However, the proportion of cell types assessed for transduction with the lentivirus in the spinal cord was limited to neurons, astrocytes, and oligodendrocyte lineage cells. Microglia comprise a large proportion of the glial population in the spinal grey matter and have been shown to associate closely with respiratory motor pools. This cell type, amongst the many others that comprise the ventral gray matter, have not been investigated in this study. Thus, the primary conclusion that astrocytes drive ephrinB2-mediated pathogenesis in ALS mice is largely correlative.

      This is an excellent point. While the majority of transduced cells were astrocytes, we did not identify the lineage of a portion of the transduced cells, which could consist of cell types such as microglia, endothelial cells and others, some of which have been linked to ALS pathogenesis. Nevertheless, we find that the cells expressing high levels of ephrinB2 in ventral horn of SOD1G93A mice are all astrocytes (as seen in Figure 1O-Q), strongly suggesting – though not definitively demonstrating – that astrocyte ephrinB2 is the pathogenic source in this model (even if our viral transduction did not solely target astrocytes).

      In the revised version of the manuscript, we now include an extensive paragraph in the Discussion section dedicated to this point.

      Importantly, we have toned down our conclusion by modifying the title by removing “…in spinal cord astrocytes…”. We changed the title from “EphrinB2 knockdown in spinal cord astrocytes preserves diaphragm innervation in a mutant SOD1 mouse model of ALS" to “EphrinB2 knockdown in cervical spinal cord preserves diaphragm innervation in a mutant SOD1 mouse model of ALS”.

      Further, it is interesting to note that no other functional outcomes were improved in this study. The C3-C5 region of the spinal cord consists of many motor pools that innervate forelimb muscles. CMAP recordings conducted at the diaphragm are a reflection of intact motor pools. This type of assessment of neuromuscular health is hard to re-capitulate in the kind of forelimb task that is being employed to test motor function (grip strength). Thus, it would be interesting to see if CMAP recordings of forelimb muscles would capture the kind of motor function preservation observed in the diaphragm muscle.

      We did perform forelimb grip strength analysis on these animals and found no effect of focal ephrinB2 knockdown. However, this functional assay is impacted more by distal forelimb muscle groups controlled by motor neuron pools located at more caudal locations of the spinal cord (i.e. low cervical and high thoracic), likely explaining the lack of effect on grip strength.

      Unfortunately, we did not perform this CMAP recording on forelimb muscle, and these mice have all already been sacrificed. We have added discussion of this point to the revised manuscript.

      On a similar note, the functional impact of increased CMAP amplitude has not been presented. An increase in CMAP amplitude does not necessarily translate to improved breathing function or overall ventilation. Thus, the impact of this improvement in motor output should be clearly presented to the reader.

      This is a very important point. While CMAP recording is a powerful assay of functional innervation of diaphragm muscle by phrenic motor neurons, it does not directly measure respiratory function. There are assays to test outcomes such as ventilatory behavior and gas exchange (e.g. whole-body plethysmography; blood gas measurements, etc.). We did not however perform these analyses. Respiratory function involves contribution of a number of other muscle groups, and these muscles are innervated by various motor neuron pools located across a relatively-large expanse of the CNS neuraxis. As we focally targeted ephrinB2 knockdown to only a small area, we would not expect effects on these other functional assays, which is why we restricted our testing to CMAP recording since this can be used to specifically study the phrenic motor neuron pool (and can be combined with detailed histological analyses in the cervical enlargement and at the diaphragm NMJ).

      Importantly, this is why we chose to use “preserves diaphragm innervation” in the manuscript title, as opposed to wording such as “preserves diaphragm function” in the title. In addition, have added this point to the Discussion section in the revised manuscript.

      Further, to the best of my knowledge, expression of Eph (or EphB) receptors has not been explicitly shown at the phrenic motor pool. It is thus speculative at best that the mechanism that the authors suggest in preserving diaphragm function is in fact mediated through Eph-EphrinB2 signaling at the phrenic motor pool. This aspect of the study would warrant a deeper discussion.

      We address this important comment with multiple pieces of data showing that Eph receptors are expressed in the phrenic motor neuron pool. EphrinB2 binds and activates EphBs, as well as EphAs such as EphA4. Importantly, previous work has linked expression of EphA4 in motor neurons to the rate of ALS progression (Van Hoecke, et al. Nature Medicine. 2012). Consistent with these studies, single-nucleus RNAseq on mouse cervical spinal cord shows that alpha motor neurons of cervical spinal cord express various EphA and EphB receptors (http://spinalcordatlas.org/; Blum et al., Nature Neuroscience, 2021; Alkaslasi et al., Nature Communications, 2021). In addition, this dataset identifies a phrenic motor neuron-specific marker (ErbB4); when we specifically look at the expression profile of only the ErbB4-expressing alpha motor neurons, the data reveal that phrenic motor neurons express a number of EphA and EphB receptors, including EphA4.

      To validate expression specifically of EphA4, we performed IHC for phosphorylated EphA4 (a marker of activated EphA4) on C3-C5 spinal cord sections from SOD1G93A mice injected with shRNAephrinB2 or control vector. We find that large ventral horn neurons are positive for phosphorylated EphA4. The ventral horn at these cervical spinal cord levels includes motor neuron pools in addition to just phrenic motor neurons; therefore, this result by itself does not conclusively show that phrenic motor neurons express EphA4, though they likely do since we find EphA4 expression in most ventral horn neuron cell bodies in C3-C5. A representative image is included in Supplemental Figure 1.

      In the revised manuscript, we added a paragraph to the Discussion section to address this important comment from the reviewer, including describing these data on Eph receptor expression.

      Lastly, although authors include both male and female animals in this investigation, they do not have sufficient power to evaluate sex differences. Thus, this presents another exciting future of investigation, given that ALS has a slightly higher preponderance in males as compared to females.

      As the reviewer notes, our studies are under-powered with respect to examining possible sex-specific effects. We now include a brief discussion of this issue in the revised manuscript.

      In summary, this study by Urban et al. provides a valuable framework for Eph-Ephrin signaling mechanisms imposing pathological changes in an ALS mouse model. The role of glial cells in ALS pathology is a very exciting and upcoming field of investigation. The current study proposes a novel astrocyte-mediated mechanism for the propagation of disease that may eventually help to identify potential therapeutic targets.

      Recommendations for the authors: please note that you control which revisions to undertake from the public reviews and recommendations for the authors.

      Both reviewers were enthusiastic about your paper. Reviewer (1) had some technical queries (see his/her items 2 and 4). Reviewer (2) had some questions about principles (items 1 and 2) with the remaining points being technical queries.

      We have addressed all comments of both reviewers. We detail our responses in this Response to Reviewer Comments document and have made the associated modifications to the revised manuscript.

      Reviewer #1 (Recommendations For The Authors):

      Questions and/or Recommendations:

      There is convincing evidence that there is increased expression of ephrinB2 over time in the mouse model of ALS. Is there a corresponding increase in astrocytes in this animal model?

      We previously published data showing quantification of astrocyte numbers within the spinal cord of this same SOD1G93A mouse model. Specifically, we performed this quantification in the ventral horn of the lumbar spinal cord following disease onset. We found that there was a modest increase in the number of GFAP+ astrocytes at this location and disease time point.

      [ Lepore et al. Selective ablation of proliferating astrocytes does not affect disease outcome in either acute or chronic models of motor neuron degeneration. Experimental Neurology. 211 (2): 423-32, 2008. ]

      One could speculate that the increase in ephrinB2 expression we observe across the ventral horn in the mutant SOD1 mice was solely due to this modest increase in astrocyte number. However, this is highly unlikely to be the case, as in wild-type mice and in mutant SOD1 mice prior to disease onset astrocytes (and all other cell types) express very low levels of ephrinB2. Throughout disease course in these mutant SOD1 mice, the ephrinB2 expression level in individual astrocytes dramatically increases (including across most or all astrocytes), suggesting that the total increase in ephrinB2 expression across the ventral horn was not due to just this modest increase in astrocyte numbers but was instead due to the dramatically elevated eprhinB2 expression in most/all astrocytes. We have added this point to the Discussion section in the revised manuscript.

      It would help the reviewer and readers to show a lower magnification image of Figure 2, panels O and P to demonstrate the reduction of ephrin B2 in the ventral horns.

      We have added the lower magnification images to Figure 2.

      It is commended that not all data was "positive". Figure 4 especially shows some of the limitations of eprhinB2 knockdown. This provides a realistic image - strengths and limitations - of this approach. Very well done!

      Thank you! In future work, we could employ alternative vector-based strategies to restrict transduction/knockdown to only astrocytes. With such experiments, it’s possible that the impact of ephrinB2 knockdown would not be the same, if ephrinB2 actions in non-astrocytes also plays a role in disease pathogenesis. We have added discussion of this same point to the revised manuscript in response to a similar comment above from Reviewer #2.

      Reviewer comment 4: Fig 6 - if possible can you please add demographic (age/sex) with each band?

      We have added this information to the Legend. For aesthetic reasons, we chose not to add this information directly to the figure itself and instead included all of this information for each sample/band in the Legend.

      Reviewer #2 (Recommendations For The Authors):

      Overall, the manuscript addresses a novel aspect of the role of astrocytes in mediating ALS pathogenesis. I commend the authors for a well thought-out and clearly presented study. However, a few concerns limit the enthusiasm and deserve attention to improve the clarity of the report.

      The biggest limitation of this study is that microglia or other cell types (endothelial cells) have not been explored in this study. They constitute a big proportion of cell types in the spinal cord and to conclude that only astrocytes mediate ephrinB2 signaling in the ALS model would be a stretch without the proper stains.

      Please see our comments above to address this same point from Reviewer #2.

      A clear premise for the investigation of EphrinB2 ligands has not been presented in the introduction. The authors provide a good background on the emerging role of EphEphrin interactions in neurodegenerative diseases. But it is unclear how the authors landed on this sub-class of ephrins.

      We have added this premise to the Introduction section of the revised manuscript. In published work, ephrinB2 has been shown to be upregulated in reactive astrocytes and to be involved in disease pathogenesis in other neurological disease models (e.g. traumatic spinal cord injury).

      There are several acronyms that have not been defined in the manuscript, e.g. GPI.

      We now define “GPI” and all other abbreviations in the revised manuscript.

      While the authors state that males and females had been included in the study, their individual n's for various outcomes have not been presented in the results section. Further, n's are missing from the figure legends, which will aid the clarity of the presentation. Further, please clarify the ages of the mice in the methods section.

      (1) We now provide the n’s for males versus females for all analyses in the figure legends. (2) We also now include the total n for each experimental condition in all of the figure legends. (3) We also now state the ages of the mice for the various analyses in the Methods section.

      It appears that several statistical interactions have been summarized in the results section but inconsistently reported on figures.

      We now provide the exact n’s for each analysis in all figure legends. We include all of the details of the statistical analysis in the text of the Results section and do not include this text in the Legends; we do this for all figures to maintain consistency.

      I presume that when the authors write "the number of neurons with somal diameter greater than 200 μm and with an identifiable nucleolus was determined", the 200 was a typo. Mouse motor neurons do not have a diameter of 200 μm and perhaps the authors meant an area of 200μm2?

      We have corrected this: 200 μm2

      Authors should consider adding a quantification for the human tissue immunoblots.

      We have added the quantification of these human tissue data for ephrinB2.

    1. Author Response

      The following is the authors’ response to the original reviews.

      We would like to thank the editors and reviewers for their overall positive assessment of this work. We have carefully revised the manuscript and implemented near all reviewers’ public and confidential recommendations. We believe these modifications have strengthened the manuscript and hope it will further convince the editors and reviewers.

      We below provide a point-by-point response to the reviewers’ comments.

      Reviewer #1 (Public Review):

      To further understand the plasticity of vestibular compensation, Schenberg et al. sought to characterize the response of the vestibular system to short-term and partial impairment using gaze stabilization behaviors. A transient ototoxic protocol affected type I hair cells and produced gain changes in the vestibulo-ocular reflex and optokinetic response. Interestingly, decreases in vestibular function occurred in coordination with an increase in ocular reflex gain at frequencies where vestibular information is more highly weighted over visual. Moreover, computational approaches revealed unexpected detriment from low reproducibility on combined gaze responses. These results inform the current understanding of visual-vestibular integration especially in the face of dysfunction.

      Strengths

      The manuscript takes advantage of VOR measurements which can be activated by targeted organs, are used in many species including clinically, and indicate additional adverse effects of vestibular dysfunction. The authors use a variety of experimental procedures and analysis methods to verify results and consider individual performance effects on the population data. The conclusions are well-justified by current data and supported by previous research and theories of visuo-vestibular function and plasticity.

      The authors thank reviewer 1 for emphasizing these positive aspects of the work.

      Weaknesses

      The manuscript describes the methodology as inducing reversible changes (lines 44, 67,) but the data shows a reversible effect only in hair cell histology (Fig 3A-B) not in function as demonstrated by the persistent aVOR gain reduction in week 12 (Fig 1C) and increase of OKR gain in weeks 6-12 (Fig 4C/D).

      Rodents exposed to IDPN in the drinking water show from complete to null reversibility of the function loss depending on the IDPN concentration and duration of exposure, and the relationship between exposure and effect varies as a function of species, strain and sex of the exposed animals (Llorens and Rodríguez-Farré, Neurotoxicol. Teratol., 1997; Seoane et al., J. Comp. Neurol. 2001; Sedó-Cabezón et al., Dis. Model. Mech., 2015; Greguske et al., Arch. Toxicol., 2019). In addition, there is individual variability. The concentration of IDPN and time of exposure used in this study were selected to result in a loss followed by complete reversion but, as noted by the referee, the reversion was complete on Hair cells, while the gaze stabilizing reflexes show differential degrees of recovery depending on the functional tests (complete recovery on OCR; partial on aVOR and OKR). These make the IDPN subchronic protocol an interesting methodology to study the long term consequences of partial/reversible inner ear impairment. To be more accurate in the description of the reversibility, we have now introduced the following changes:

      Lines 43: Subchronic exposure to IDPN in drinking water at low doses allowed for progressive ototoxicity, leading to a partial and largely reversible loss of function.

      Lines 67-68: We demonstrate that despite the significant recovery in their vestibulo-ocular reflexes, the visuo-vestibular integration remains notably impaired in some IDPN-treated mice

      Lines 578: Previous experiments (Greguske et al., 2021) had demonstrated that at these concentrations, ototoxic lesions produced by IDPN are largely reversible.

      Reviewer 1: The manuscript begins with the mention of fluctuating vestibular function clinically, but does not connect this to any specific pathologies nor does it relate its conclusions back to this motivation.

      Thank you. We have now added a conclusion (lines 525-552) to discuss the results in a clinical perspective.

      Reviewer 1: The conclusions of frequency-specific changes in OKR would be stronger if frequency-specific aVOR effects were demonstrated similar to Figure 4D.

      We have presented the frequency-selective effects in Figure 1 supplement and related text; changes observed in aVOR are mostly (see below) comparable for all frequencies >0.2Hz. However, we have edited the text to better highlight when the IDPN differentially affect aVOR tested at different frequencies (see lines 97-99).

      Reviewer #2 (Public Review):

      This is a very nice study showing how partial loss of vestibular function leads to long term alterations in behavioural responses of mice. Specifically, the authors show that VOR involving both canal and otolith afferents are strongly attenuated following treatment and partially recover. The main result is that loss of VOR is partially "compensated" by increased OKR in treated animals. Finally, the authors show that treatment primarily affects type I hair cells as opposed to type II. Overall, these results have potentially important implications for our understanding of how the VOR Is generated using input from both type I and type II hair cells. As detailed below however, more controls as well as analyses are needed.

      The authors thank reviewer 2 for positive evaluation regarding the potential implication of the work.

      Major points:

      Reviewer 2: The authors analyze both canal and otolith contributions to the VOR which is great. There is however an asymmetry in the way that the results are presented in Figure 1. Please correct this and show time series of fixations for control and at W6 and W12. Moreover, the authors are plotting table and eye position traces in Fig. 1B but, based on the methods, gains are computed based on velocity. So please show eye velocity traces instead. Also, what was the goodness of fit of the model to the trace at W6? If lower than 0.5 then I think that it is misleading to show such a trace since there does not seem to be a significant VOR.

      Figure 1 was modified as suggested. Panel B now shows velocity traces, and goodness of fit is reported in figure legend. Panel E now shows raw OCR traces at W0, W6, W12.

      Reviewer 2: This is important to show that the loss is partial as opposed to total. It seems to me that the treatment was not effective at all for aVOR for at least some animals. What happens if these are not included in the analysis?

      The reviewer is correct, there is indeed variability in the alteration observed during the treatment, as previously described and expected from previous experiments (Llorens and Rodríguez-Farré, Neurotoxicol. Teratol., 1997; Seoane et al., J. Comp. Neurol. 2001; SedóCabezón et al., Dis. Model. Mech., 2015; Greguske et al., Arch. Toxicol., 2019). It was actually one of the goal of the study to compare hair cell loss and VOR responses in individuals. The individual aVOR gain and phase responses during the IDPN treatment are all presented in Figure 1 supplement. aVOR was reduced in all animals, although 2/21 only showed a decrease of less than 10% of their initial gain at W6. If these were excluded from the analysis, the statistical differences between the 2 groups would be reinforced.

      Reviewer 2: Figure 2A shows a parallel time course for gains of aVOR and OCR at the population level. Is this also seen at the individual level?

      Yes, this is seen in individuals. This result is presented in Figure 2C and 2D which illustrate the similar effect of IDPN on aVOR and OCR responses at week 6 and week 12 at the individual level (each symbol represents an individual mouse). The plotted delta gain of both aVOR and OCR represents the relative loss of vestibular function for each individual mouse at W6 and W12, respectively.

      Reviewer 2: Figure 3: please show individual datapoints in all conditions.

      Figure 3 was modified to show individual datapoints in all conditions (see Figure 3 A2, A3, C2 and C3).

      Reviewer 2: Figure 4: The authors show both gain and phase for OKR. Why not show gain and phase for aVOR and OCR in Figure 1. I realize that phase is shown in sup Figures but it is important to show in main figures. The authors show a significant increase in phase lead for aVOR but no further mention is made of this in the discussion. Moreover, how are the authors dealing with the fact that, as gain gets smaller, the error on the phase will increase. Specifically, what happens when the grey datapoints are not included?

      As pointed by the reviewer, we have included all aVOR phase results in Figure 1 supplement and also stated it in the main text (lines 100-102). There is however no phase calculated for the OCR which is a static test, as better illustrated in new Figure 1E. Error in phase calculations increases as gain gets smaller. To take this into account, the phase corresponding to the grey points (VAF<0,5; corresponding to Gains<0.10) were not included in the statistical analysis of the aVOR phase. This point is now made clearer in methods lines 639-640.

      Reviewer 2: Discussion: As mentioned above, the authors should discuss the mechanisms and implications of the observed phase lead following treatment. Moreover, recent literature showing that VN neurons that make the primary contribution to the VOR (i.e., PVP neurons) tend to show more regular resting discharges than other classes (i.e., EH cells), and that such regularity is needed for the VOR should be discussed (Mackrous et al. 2020 eLife). Specifically, how are type I and type II hair cells related to discharge regularity by central neurons in VN?

      We have now added discussion regarding mechanisms and implications of the phase changes in lines 363-371. The authors thank reviewer 1 for pointing at the Mackrous et al. 2020 eLife paper which is now included in the updated discussion. The relations between type I and type II and discharge regularity in afferents and central VN is further discussed 442-449.

      Below we provide answers to specific recommendations for the authors.

      Reviewer #1 (Recommendations For The Authors):

      Reviewer 1: Were hair cells counted for the whole organ? what was the control for epithelial size differences?

      The effect of the treatment on hair cells was estimated by counting numbers of cells in square area of the central and peripheral parts of the sensory epithelia. The text has been modified to better describe the method, lines 748-751.

      Reviewer 1: The title of the article leads readers to expect more emphasis on hair cell changes, while the content of the manuscript is more functional and encompassing the visual and vestibular systems.

      We have retained the original tittle.

      Reviewer 1: Please provide acronym definitions before they are used. Examples: HC (line 63), W6 etc (line 82-83)

      Done as suggested on lines 63, 82 and 107.

      Reviewer 1: Please describe the ages of animals used in the study.

      The animals used in the study were 6 weeks old at the beginning of the protocol and 20 weeks old at the end. The text has been modified accordingly, line 564.

      Reviewer 1: Consider changing "until" to "through" when describing time ranges (initially line 88), as the following time mentioned is included in the statement. E.g., line 216-217 sounds as if gain was insignificantly different at W12.

      Done as suggested, lines 88 and 219.

      Reviewer 1: Line 162: lower case for "immunostaining".

      Done, line 164.

      Reviewer 1: Consider regrouping or renumbering panels of Figure 3 for more clarity.

      Panels in Figure 3 were regrouped as suggested, with first the canal-related data in panels A-B followed by the utricule-related data in panels C-D.

      Reviewer 1: Lines 222-223: reword as gain increased not frequency.

      Thank you, the text has been reworded, line 224-225.

      Reviewer 1: It is unclear if the two subgroups revealed in CGR analysis (line 288) are relevant to the two groups described in VOR responses (line 137-138). Please clarify if these are the same mice or distinct clusters.

      The two subgroups found in the CGR analysis differ from the clusters revealed by the decrease of the aVOR gain; the text has been modified lines 300-301.

      Reviewer 1: Consider adding that irregular afferents + calyces are relevant specifically to type I HCs (lines 411-426).

      The text has been modified to clarify the contacts between the two types of vestibular afferents and hair cells, lines 431-435.

      Reviewer 1: Line 434: clarify which "scheme" given context before and after this phrase

      In order to clarify this part of the discussion, the text has been modified and this term no longer appears.

      Reviewer 1: Please indicate the time gap from surgery to treatment.

      The time gap from the surgery to treatment, at least 72h, has been updated in the methods, lines 575.

      Reviewer 1: Line 619-620: It is unclear if VOR and OKR sessions were randomized in order or if the authors have considered training or adaptive effects from the initial test session.

      VOR and OKR sessions were performed on different days to limit cross effects, lines 639-640.

      Reviewer 1: Line 688: typo-change ifG to IgG.

      modified, line 744.

      Reviewer 1: Line 692-693: were hair cells counted for the whole organ? what was the control for epithelial size differences?

      The effect of the treatment on hair cells was estimated by counting numbers of cells in square area of the central and peripheral parts of the sensory epithelia. The text has been modified to better explain the method, lines 748-751.

      Reviewer 1: Change decimal indicator to be consistent (commas used in lines 732, 759, 776, Figure 6C),

      Thank you; modified as suggested.

      Reviewer 1: Line 763: "stimulation at 0.5Hz &10{degree sign}/s" is unclear.

      The text has been modified, line 817.

      Reviewer 1: Line 765: bold (E)

      The police format has been updated, line 820.

      Reviewer 1: Line 770-771: A) insert OKR to be "mean delta aVOR and delta OKR gain", B) plot is OKR as a function of VOR.

      Thank you, done as suggested. The text has been modified, line 824. Reviewer 1: Describe Figure 6 delta at initial mention (line 784 instead of 786) Authors: thank you, done as suggested, line 839.

      Reviewer 1: It is unclear why the tables are included if never mentioned in the text.

      The tables are now mentioned, lines 90 and 218.

      Reviewer 1: Figure 1: is the observed gain for Sham group expected value rather than closer to 1?

      Yes, as the value reported on Figure 1 is a mean of the values obtained during aVOR test in the dark at frequencies in range 0.2-1Hz (see also Figure 1 Supplement).

      Reviewer 1: Figure 2: A) give enough space to see error bars at W2. Consider making test data more easily distinguishable. B) is OCR mean or specific stimulation? C/D) move 1Hz label from title to x-axis label as it does not describe OCR test. Figure 5: C) consider making color specific to frequency for better distinction on C+D as symbols previously indicated individual data. D) 1Hz specific to OKR? move to axis label instead of title

      The Figures 2 and 5 have been modified according to reviewer 1 suggestions.

      Reviewer 1: Figure 6: A/B) what time point are these, W12?

      Those points correspond to W6 and W12, the text has been updated to specify the time points, lines 834 and 835.

      Reviewer #2 (Recommendations For The Authors):

      The authors should perform additional analyses that will help strengthen their results.

      We are unsure about the exact implementation of this recommendation. However, we have strengthened our results by following all reviewers’ specific recommendations.

    1. Author Response

      Reviewer #1 (Public Review):

      Assessment:

      The manuscript titled 'Rab7 dependent regulation of goblet cell protein CLCA1 modulates gastrointestinal 1 homeostasis' by Gaur et al discusses the role of Rab7 in the development of ulcerative colitis by regulating the lysosomal degradation of Clca1, a mucin protease. The manuscript presents interesting data and provides a potential molecular mechanism for the pathological alterations observed in ulcerative colitis. Gaur et al demonstrate that Rab7 levels are lowered in UC and CD. However, a similar analysis of Rab7 levels in ulcerative colitis (UC) and Crohn's disease (CD) patient samples was conducted recently (Du et al, Dev Cell, 2020) which showed that Rab7 levels are found to be elevated under these conditions. While Gaur et al have briefly mentioned Du et al's paper in passing in the discussion, they need to discuss these contradictory results in their paper and clarify these differences. Additionally, Du et al are not included in the list of references.

      Strengths:

      The manuscript used a multi-pronged approach and compares patient samples, mouse models of DSS, and protocols that allow differentiation of goblet cells. They also use a nanogel-based delivery system for siRNAs, which is ideal for the knockdown of specific genes in the gut.

      Weaknesses:

      Du et al, Dev Cell 2020 (https://doi.org/10.1016/j.devcel.2020.03.002) have previously shown that Rab7 levels are elevated in a similar set of colonic samples (age group, number etc) from UC and CD patients. Gaur et al have not discussed this paper or its findings in detail, which directly contradicts their results. Clarification regarding this should be provided.

      We thank and appreciate the reviewer for bringing this point.

      The results shown by Du et al, Dev Cell, 2020 depict elevated expression of Rab7 in UC and CD patients compared to controls. In first occurrence, these results appear contradictory, but there may be a few possible explanations for this.

      Firstly, Rab7 expression levels may fluctuate in the tissue depending on the degree of the gut inflammation. This can be concluded from our observations in DSS-mice dynamics model and the human patient samples with mild and moderate UC. Furthermore, Du et al provide no information of the severity of the condition among the patients employed in the study. Our motive, in the current work, was to emphasise this aspect. This point was mentioned in the discussion section of the manuscript. However, in view of the reviewer’s concern, we now intend to add a detailed comment on this in the main text of the revised version of the manuscript.

      Secondly, the control biopsies in our investigation were acquired from non-IBD patients, and not what was done by Du et al., wherein biopsies from the normal para-carcinoma region of the colorectal cancer patients was used. One can not overlook the fact that physiological and molecular changes are apparent even in non-inflamed regions in the gut of an IBD or CRC patient. It is possible that the observed discrepancy arises due to the differences in the sample type used for comparing the Rab7 expression.

      Finally, the main sub-tissue region showing a decrease in Rab7 expression in UC samples, appeared to be the Goblet cells which was not covered by Du et al.

      Keeping these points in mind we do not think that there is a contradiction in our findings with that of Du et al., 2020. In the revised submission some of these explanations will be incorporated. Include Du et al in the reference list and add the comment in main text.

      This was an oversight from our side. We have actually mentioned Du et al., 2020 in the discussion (line number 338) but somehow the reference was missing in the main list. We will ensure that the reference is included in the revised version and that their findings are included both in main text and in the discussion.

      Reviewer #2 (Public Review):

      Summary:

      In this work, the authors report a role for the well-studied GTPase Rab7 in gut homeostasis. The study combines cell culture experiments with mouse models and human ulcerative colitis patient tissues to propose a model where, Rab7 by delivering a key mucous component CLCA1 to lysosomes, regulates its secretion in the goblet cells. This is important for the maintenance of mucous permeability and gut microbiota composition. In the absence of Rab7, CLCA1 protein levels are higher in tissues as well as the mucus layer, corroborating with the anticorrelation of Rab7 (reduced) and CLCA1 (increased) from ulcerative colitis patients. The authors conclude that Rab7 maintains CLCA1 level by controlling its lysosomal degradation, thereby playing a vital role in mucous composition, colon integrity, and gut homeostasis.

      Strengths:

      The biggest strength of this manuscript is the combination of cell culture, mouse model, and human tissues. The experiments are largely well done and in most cases, the results support their conclusions. The authors go to substantial lengths to find a link, such as alteration in microbiota, or mucus proteomics.

      Weaknesses:

      There are also some weaknesses that need to be addressed. The association of Rab7 with UC in both mice and humans is clear, however, claims on the underlying mechanisms are less clear. Does Rab7 regulate specifically CLCA1 delivery to lysosomes, or is it an outcome of a generic trafficking defect? CLCA1 is a secretory protein, how does it get routed to lysosomes, i.e. through Golgi-derived vesicles, or by endocytosis of mucous components? Mechanistic details on how CLCA1 is routed to lysosomes will add substantial value.

      We thank the reviewer for the insightful comment. We would like to bring forth the following explanation for each these concerns:

      (a) Our immunofluorescence imaging experiments revealed co-localization of Rab7 protein with CLCA1 and the lysosomes (Fig 7I). In addition, the absence of Rab7 affects the transport of CLCA1 to lysosomes (Fig 7J). This demonstrates that Rab7 may be involved in regulation of CLCA1 transport (presumably along with other cargo), to lysosomes selectively. However, we do recognise that the point raised by the reviewer about possible effect of a generic trafficking defect is valid. (b) As mentioned in the manuscript, the trafficking of CLCA1 protein or CLCA1-containing vesicles within the goblet cell is unknown, with no information on the proteins involved in its mobility. The switching of CLCA1 containing vesicles from the secretory route to lysosomes needs extensive investigation involving overall trafficking of the protein. Taken together, the complete answer to both these important questions will need a series of experiments and those may be interesting avenues for future research.

      (a) Why does the level of Rab7 fluctuate during DSS treatment (Fig 1B)? (b) Does the reduction seen in Rab7 levels (by WB) also reflect in reduced Rab7 endosome numbers?

      This is a very thoughtful point from the reviewer. We detected a distinct pattern of Rab7 expression fluctuation in intestinal epithelial cells after DSS-dynamics treatment in mice. Perhaps, these changes are the result of complex cellular signalling in response to the DSS treatment. Rab7, being a fundamental protein involved in protein sorting pathway, is expected to undergo alteration based on cells requirement. Presently there are no reports suggesting the regulatory mechanisms that govern Rab7 levels in the gut. (b) We observed reduction in Rab7 expression both at RNA and protein levels. To confirm whether this alteration will lead to reduced Rab7 positive endosome numbers may require detailed investigations.

      Are other late endosomal (and lysosomal) populations also reduced upon DSS treatment and UC? Is there a general defect in lysosomal function?

      There are no direct evidences showing reduction in the late endosomal and lysosomal population during gut inflammation, but few studies link lysosomal dysfunction with risk for colitis (doi: 10.1016/j.immuni.2016.05.007).

      The evidence for lysosomal delivery of CLCA1 (Fig 7 I, J) is weak. Although used sometimes in combination with antibodies, lysotracker red is not well compatible with permeabilization and immunofluorescence staining. The authors can substantiate this result further using lysosomal antibodies such as Lamp1 and Lamp2. For Fig 7J, it will be good to see a reduction in Rab7 levels upon KD in the same cell.

      We used Lysotracker red in live cells followed by fixation. So, permeabilization issues were resolved. Lamp1, as suggested by the reviewer, is definitely a better marker for lysosomes in immunofluorescence studies, but is also shown to mark late endosomes (doi: 10.1083/jcb.132.4.565). As Rab7 protein also marks the late endosomes, using Lamp1 may leave the ambiguity of CLCA1 in Rab7 positive late endosomes versus lysosomes. Nevertheless, we will be carrying out this experiment and the data will be shared in revised version of the work.

      In this connection, Fig S3D is somewhat confusing. While it is clear that the pattern of Muc2 in WT and Rab7-/- cells are different, how this corroborates with the in vivo data on alterations in mucus layer permeability -- as claimed -- is not clear.

      The data in Fig. S3D suggest the involvement of Rab7 in packaging of Muc2. The whole idea for doing this experiment was to support our observation in the Rab7KD-mice model where mucus layer was seen to be loose and more permeable in Rab7 deficient mice.

      Overall, the work shows a role for a well-studied GTPase, Rab7, in gut homeostasis. This is an important finding and could provide scope and testable hypotheses for future studies aimed at understanding in detail the mechanisms involved.

      We thank the reviewer for this comment.

    1. Author Response

      The following is the authors’ response to the original reviews.

      eLife assessment

      This study and associated data is compelling, novel, important, and well-carried out. The study demonstrates a novel finding that different chemotherapeutic agents can induce nucleolar stress, which manifests with varying cellular and molecular characteristics. The study also proposes a mechanism for how a novel type of nucleolar stress driven by CDK inhibitors may be regulated. The study sheds light on the importance of nucleolar stress in defining the on-target and offtarget effects of chemotherapy in normal and cancer cells.

      We are thankful to the reviewers and the editor for their feedback and thorough assessment of our work. Our responses to the comments and suggestions are below.

      Reviewer #1 (Public Review):

      The study titled "Distinct states of nucleolar stress induced by anti-cancer drugs" by Potapova and colleagues demonstrates that different chemotherapeutic agents can induce nucleolar stress, which manifests with varying cellular and molecular characteristics. The study also proposes a mechanism for how a novel type of nucleolar stress driven by CDK inhibitors may be regulated. As a reviewer, I appreciate the unbiased screening approach and I am enthusiastic about the novel insights into cell biology and the implications for cancer research and treatment. The study has several significant strengths: i) it highlights the understudied role of nucleolar stress in the on- and off-target effects of chemotherapy; ii) it defines novel molecular and cellular characteristics of the different types of nucleolar stress phenotypes; iii) it proposes novel modes of action for well-known drugs. However, there are several important points that should be addressed:

      • The rationale behind choosing RPE cells for the screen is unclear. It might be more informative to use cancer cells to study the effects of chemotherapeutic agents. Alternatively, were RPE cells selected to evaluate the side effects of these agents on normal cells? Clarifying these points in the introduction and discussion would guide the reader.

      RPE1, a non-cancer-derived cell line, was chosen for this study to evaluate the effects of anticancer drugs on normal nucleolar function, with the underlying premise that nucleolar stress in normal cells can contribute to non-specific toxicity. This clarification is added to the introduction. Another factor that played in selecting a normal cell line for the drug screen and subsequent experiments was the spectrum of known and unknown genetic and metabolic alterations present in various cancer cell lines. These variables are often unique to a particular cancer cell line and may or may not impact nucleolar proteome and function. Therefore, the nucleolar stress response can be influenced by the spectrum of alterations inherent to each cancer. Our primary focus was to determine the impact of these drugs under normal conditions.

      That said, the selected hits of main drug classes were validated in a panel of cell lines that included two other hTERT lines (BJ5TA and CHON-002) and two cancer lines (DLD1 and HCT116). In cancer cells starting nucleolar normality scores were lower than in hTERT cells, suggesting that genetic and metabolic changes in these cells may indeed affect nucleolar morphology. Nonetheless, all drugs from a panel of selected hits from different target classes validated in both cancer cell lines (Fig. 2F).

      • Figure 2F indicates that DLD1 and HCT116 cells are less sensitive to nucleolar changes induced by several inhibitors, including CDK inhibitors. It would be crucial to correlate these differences with cell viability. Are these differences due to cell-type sensitivity or variations in intracellular drug levels? Assessing cell viability and intracellular drug concentration for the same drugs and cells would provide valuable insights.

      One of the reasons for the reduced magnitude of the effects of selected drugs in DLD1 and HCT116 cells is their lower baseline normality scores compared to hTERT cells (now shown in Sup. Fig. 1B-C). Other potential factors include proteomic and metabolic shifts and alterations in signaling pathways that control ribosome production. The less-likely possibility of variations in intracellular drug levels cannot be excluded, but measuring this for every compound in every cell line was not feasible in this study. These limitations are now noted in the results section.

      Regarding the point about viability - our initial screen output, in addition to normality scores, included cell count (cumulative count of cells in all imaged fields), which serves as a proxy for viability. By this measure, all hit compounds in our screen were cytostatic or cytotoxic in RPE1 cells (Fig. 2C). The impact of these drugs on the viability of cancer cells that can have various degrees of addiction to ribosome biogenesis merits a separate study of a large cancer cell line panel.

      • Have the authors interpreted nucleolar stress as the primary cause of cell death induced by these drugs? When cells treated with CDK inhibitors exhibit the dissociated nucleoli phenotype, is this effect reversible? Is this phenotype indicative of cell death commitment? Conducting a washout experiment to measure the recovery of nucleolar function and cell viability would address these questions.

      Whether nucleolar toxicity is the primary cause of cytotoxicity for a given chemotherapy drug is an incisive and thought-provoking question. Our screen did not discern whether the cytotoxic effects of our hits were due to inhibition of their intended targets, their impact on the nucleolus, or a combined effect. This point is now mentioned in the results section. Regarding the reversibility of the nucleolar disassembly phenotype seen in CDK inhibitors –in the case of flavopiridol, which is a reversible CDK inhibitor, we demonstrated that nucleoli re-assembled within 4-6 hours after the drug was washed out. An example of this is shown in Sup. Figure 3 and in Video 5. For these experiments, cells were pretreated with the drug for 5 hours, not long enough to cause cell death.

      • The correlation between the loss of Treacle phosphorylation and nucleolar stress upon CDK inhibition is intriguing. However, it remains unclear how these two events are related. Would Treacle knockdown yield the same nucleolar phenotype as CDK inhibition? Moreover, would point mutations that abolish Treacle phosphorylation prevent its interaction with Pol-I? Experiments addressing these questions would enhance our understanding of the correlation/causation between Treacle phosphorylation and the effects of CDK inhibition on nucleolar stress.

      We agree that the Treacle finding is interesting and warrants further investigation. In our attempts to knock down Treacle with siRNA, its protein levels were reduced by no more than 50%, which was not sufficient to cause a strong nucleolar stress response. Therefore, these data were not incorporated into the manuscript. However, in our view, Treacle is unlikely to be the only nucleolar CDK substrate whose dephosphorylation is causing the “bare scaffold” phenotype caused by the transcriptional CDK inhibitors. Our phospho-proteomics studies identified multiple nucleolar CDK substrates with established roles in the formation of the nucleolus. For instance, the granular component protein Ki-67 was also dephosphorylated on multiple sites and dispersed throughout the nucleus (shown in Sup. Fig 4). Given that CDKs typically phosphorylate many substrates that can have multiple phosphorylation sites, identifying a sole protein or phosphorylation site responsible for nucleolar disassembly may be an unattainable target.

      Overall, this study is significant and novel as it sheds light on the importance of nucleolar stress in defining the on-target and off-target effects of chemotherapy in normal and cancer cells.

      Thank you, we appreciate the positive and constructive assessment of our study.

      Reviewer #2 (Public Review):

      This is an interesting study with high-quality imaging and quantitative data. The authors devise a robust quantitative parameter that is easily applicable to any experimental system. The drug screen data can potentially be helpful to the wider community studying nucleolar architecture and the effects of chemotherapy drugs. Additionally, the authors find Treacle phosphorylation as a potential link between CDK9 inhibition, rDNA transcription, and nucleolar stress. Therefore I think this would be of broad interest to researchers studying transcription, CDKs, nucleolus, and chemotherapy drug mechanisms. However, the study has several weaknesses in its current form as outlined below.

      1) Overall the study seems to suffer from a lack of focus. At first, it feels like a descriptive study aimed at characterizing the effect of chemotherapy drugs on the nucleolar state. But then the authors dive into the mechanism of CDK inhibition and then suddenly switch to studying biophysical properties of nucleolus using NPM1. Figure 6 does not enhance the story in any way; on the contrary, the findings from Fig. 6 are inconclusive and therefore could lead to some confusion.

      This study was specifically designed to examine a broad range of chemotherapy drugs. The newly created nucleolar normality score enabled us to measure nucleolar stress precisely and in high throughput. Our primary objective was to find drugs that disrupt the normal nucleolar morphology and then study in-depth the most interesting and novel hits. We have made revisions to emphasize that these are the primary focal points of the manuscript.

      As context, we were motivated to explore the biophysical properties of the nucleolus because they are thought to underlie its formation and function, which also suggested a potential predictive value for modeling nucleolar responses to drug treatments. For this, we edited the RPE1 cell line by endogenously tagging NPM1, a granular component protein that behaves in line with the phase-separation paradigm in vitro and when over-expressed. We fully expected to confirm that its behavior in vivo would be consistent with LLPS, but instead found that even in an untreated scenario, the dynamics of endogenous NPM1 could not be fully explained by the phase separation theory (Fig. 6 A-C). Our message is that accurately predicting drug responses using the nucleolar normality score as a readout, based on our current understanding of the biophysical forces governing nucleolar assembly, is unworkable. For instance, normality scores decrease and NPM1 dynamics increase radically when CDKs are inhibited, without changes in NPM1 concentration or concentrations of other protein components (Fig.6 E-H). These observations are important because they highlight our gaps in understanding the relative contribution of phase separation versus active assembly in nucleolar formation. We believe that these observations are worth sharing with the scientific community.

      2) The justification for pursuing CDK inhibitors is not clear. Some of the top hits in the screen were mTOR, PI3K, HSP90, Topoisomerases, but the authors fail to properly justify why they chose CDKi over other inhibitors.

      We decided to focus on CDK inhibitors for several reasons. First, their effects were completely new and unexpected, suggesting the existence of an unknown mechanism regulating nucleolar structure and function. In addition, CDK inhibitors caused a very strong and distinct nucleolar stress phenotype with the lowest normality scores that merited its own term, the “bare scaffold” phenotype. One more reason for pursuing CDK-inhibiting drugs was their high rate of failure in clinics because of the intense and hard-to-explain toxicity. We suspect that this toxicity may be due at least in part to their profound effect on nucleolar organization and ribosome production throughout the body. We stated this rationale more explicitly in the manuscript.

      3) In addition to poor justification, it seems like a very superficial attempt at deciphering the mechanism of CDK9imediated nucleolar stress. I think the most interesting part of the study is the link between CDK9, Pol I transcription, and nucleolar stress. But the data presented is not entirely convincing. There are several important controls missing as detailed below.

      We agree with the reviewer that follow-up studies of CDK9, Pol I, and nucleolar stress connection are important long-term goals. However, the primary objective of this study was to ascertain the scope of anticancer agents that can cause nucleolar stress and the establishment of nucleolar stress categories. This is an important advance and could serve as the foundation for a standalone in-depth study or multiple studies. We have included the complete screen, proteomics, and phospho-proteomics results (Sup. Tables 1, 2, and 3), which will enable other investigators to mine the screen information based on their specific interests. Furthermore, we have made multiple text revisions to clarify rationale and interpretation, and incorporated additional data that strengthen the manuscript.

      4) The authors did not test if inhibition of CDK7 and/or CDK12 also induces nucleolar stress. CDK7 and CDK12 are also major kinases of RNAPII CTD, just like CDK9. Importantly, there are well-established inhibitors against both these kinases. It is not clear from the text whether these inhibitors were included in the screen library.

      Our anticancer compound library contained CDK7 inhibitor THZ1⦁2HCL, and it was a hit at both 1 and 10 uM concentrations (Sup. Table 1). However, its nucleolar stress phenotype was morphologically distinct from CDK9 inhibitors, resembling the stress caps phenotype instead of the bare scaffold phenotype. We did not pursue CDK7 because of its two hard-to-separate functions: in addition to its role as an RNAPII CTD kinase, it also acts as a CDK-activating kinase (CAK) by promoting the associations of multiple CDKs with their cyclin partners. This dual role of CDK7 makes the interpretation of THZ1-induced nucleolar stress phenotype difficult because it could be attributed to either or both of these functions. Moreover, it was reported to cause DNA damage, which may explain why it causes stress caps. An image depicting nucleolar stress phenotype caused by THZ1⦁2HCL is provided in Author response image 1.

      Author response image 1.

      Control and THZ1 - treated RPE1 cells, images from screen plates.

      We are not aware of specific inhibitors of CDK12, as they also reportedly inhibit CDK13. None of the CDK12/CDK13 inhibitors were present in our library, therefore we can neither confirm nor exclude the possible involvement of these kinases in regulating nucleolar structure. Many other existing CDK inhibitors were absent from our library. Our work highlights the importance of assessing their potential to induce nucleolar stress and offers an approach for this assessment.

      5) In Figure 4E, the authors show that Pol I is reduced in nucleolus/on rDNA. The authors should include an orthogonal method like chromatin fractionation and/or ChIP

      We acknowledge the reviewer’s request for additional validation of reduced occupancy of rDNA by Pol I.<br /> Nucleolar chromatin fractionation in cells treated with CDK inhibitors is unlikely to work due to nearly complete nucleolar disassembly. Chromatin immunoprecipitation would require finding and validating a suitable ChIP-grade antibody. Moreover, the evaluation of repetitive regions by ChIP is non-trivial and error-prone. To help address this request and further confirm the POLR1A immunofluorescence results in 4E, we included additional immunofluorescence data obtained with a different POLR1A antibody (Sup. Fig. 3D), and the results were similar.

      6) In Fig. 5D, in vitro kinase lacks important controls. The authors should include S to A mutants of Treacle S1299A/S1301A to demonstrate that CDK9 phosphorylates these two residues specifically.

      7) To support their model, the authors should test if overexpression of Treacle mutants S1299A/S1301A can partially phenocopy the nucleolar stress seen upon CDK9 inhibition. This would considerably strengthen the author's claim that reduced Treacle phosphorylation leads to Pol I disassociation from rDNA and consequently leads to nucleolar stress.

      8) Additionally, it would be interesting if S1299D/S1301D mutants could partially rescue CDK9 inhibition.

      Points (6-8):

      We reiterate that transcriptional CDKs target multiple nucleolar proteins, and the observed phenotype might be due to the combined effects of de-phosphorylation of multiple substrates. We concur that deconstructing the role of Treacle phosphorylation sites is very interesting and warrants further in-depth studies. The phospho-proteomics enrichment method, while an effective first-pass strategy, might not capture 100% of the phosphorylated sites. Treacle is a phospho-protein with an abundance of serine and threonine residues. It could potentially have been selectively dephosphorylated on more sites than were detected by this method. Therefore, the suggested mutations may not be the exclusive contributors responsible for the functional phenotype. Additionally, overexpressing Treacle impairs the viability of RPE1 cells, complicating the interpretation of experiments involving overexpression of both wild-type and mutant proteins. A conceivable strategy would involve generating phosphomimetic and non-phosphorylatable mutants by gene editing, studying their interactions by biochemical approaches, and determining their impact on nucleolar function, but this may take years of additional work. We hope that our work will inspire further studies that explore Treacle phosphorylation and other functions of transcriptional CDKs in nucleolar formation.

      Thank you for the thoughtful review and suggestions.

      Reviewer #2 (Recommendations For The Authors):

      1) The manuscript could be re-organized to focus on 'CDK9-Treacle-Pol I-nucleolar stress' as the central part of the story.

      While we acknowledge this suggestion, it's important to emphasize that the primary focus of this manuscript is on the identification of anticancer drugs that induce nucleolar stress and the establishment of nucleolar stress categories.

      2) Include a "no ATP" control in the in vitro kinase assay and indicate molecular sizes.

      We provided an additional kinase assay (Sup. Fig. 4B) that includes no ATP control lanes and a fragment of a Coomassie blue stained gel showing molecular weight markers. No ATP control assays (lanes 4 and 5) were blank as expected. Molecular weight markers were added to all other kinase assays based on the known sizes of isolated Pol II holoenzyme subunits Rbp1 (191 kDa) and Rbp2 (138 kDa).

      3) For in vitro phosphorylation, please provide an explanation for using CDK9/cyclin K instead of Cyclin T1 which is the predominant cyclin for CDK9

      Recombinant CDK9/cyclin K complex was used for in vitro kinase assays for a technical reason: CDK9/cyclin T obtained from the same vendor appeared to be low quality, as it showed only minimal activity toward our positive control, the isolated Pol II complex. The kinase assays using recombinant CDK9/cyclin T in parallel with CDK9/cyclin K are now presented it Sup. Fig. 4B. The first two assays in this experiment contained Pol II as a substrate, and it is evident that Pol II was phosphorylated much stronger by CDK9/cyclin K than CDK9/cyclin T (comparing lane 1 vs lane 2). Therefore, the lack of detectable Treacle phosphorylation by CDK9/Cyclin T (lane 7), in contrast to strong phosphorylation by CDK9/cyclin K (lane 6), was likely attributable to poor reagent quality rather than physiological differences. We can conclude that CDK9/cyclin K reliably phosphorylates Treacle in vitro, but CDK9/cyclin T kinase assays were inconclusive.

    1. Author Response

      The following is the authors’ response to the original reviews.

      Reviewer #1 (Public Review):

      The manuscript by Muthana et al. describes the effect of injection of an antibody specific for human CTLA4 conjugated to a cytotoxic molecule (Ipi-DM1) in knock-in mice expressing human CTLA4. The authors show that Ipi-DM1 administration causes a partial decrease (about 50% in absolute number) of mature B cells in blood and bone marrow 9-14 days after the beginning of treatment. Ipi-DM1 also results in a partial decrease in Foxp3+ Tregs (about 40% in absolute number) and a slight increase in activation of conventional T cells (Tconvs) in the blood at D9. Tconv depletion, CTLA4-Ig or anti-TNF mAb partially prevents the effect of ipi-DM1 on B cells. This work is interesting but has the following major limitations:

      1) This work could have been of more interest if the Ipi-DM1 molecule would be used in the clinic. As this is not the case, the intimate mechanism of the effect of this molecule in mice is of reduced interest.

      The goal of the current study is to use Ipi-DM1 ADC as probe to study mechanism of B cell loss observed in Treg-deficient host.

      2) The fact that a partial deletion of Tregs is associated with activation of Tconvs and a decrease in B cells has been published several times and is therefore not new. According to the authors, their work would be the first to show that activation of Tconvs would lead to B cell depletion. However, this is shown in an indirect way and the mechanisms are not really elucidated. Indeed, this work shows a correlation between an increase in Tconv activation and a decrease in the number of B cells in the blood. The experiments to try to show a causal link are of 2 types: deletion of T cells (Fig 4) and blocking T cell activation with CTLA4-Ig (Fig 5) (neutralization of TNF addresses another question). Neither of these 2 experiments is totally convincing. Indeed, the absence of B cell depletion when T cells are deleted can be explained by other mechanisms than the preservation of B cell destruction by activated T cells. The phenomenon could be explained by B cell recirculation to lymphoid tissues or an effect of massive T cell death for example. The experiment shown in Fig. 5 with Belatacept is more convincing because this time the effect is targeted to activated T cells only. However, the prevention of B cell ablation is only partial. Again, since only blood is analyzed, other mechanisms could explain the B cell loss, such as their recirculation in lymphoid tissues.

      While the concept of treg depletion leads to activation of Tconv cells and reduced B cells has been previously published, B cell loss was explained on basis of defective B cell lymphopoiesis due to low production of stroma cell-derived IL-7 or destruction of stromal cells by effector T cells. Our new data established that loss of B cells in the context of Treg depletion was not due to defects in the number of pre-/pro-B cells. Rather it is the death of mature B cells in the bone marrow.

      To address the reviewer’s concern that the B cell loss was merely caused by a change in circulating pattern, we performed a new study on the effect of the ADC on B cells in bone marrow. Our new data reveal loss of mature bone marrow B cells, and that such loss is associated with increased apoptosis of mature B cells. Therefore, the loss of B cells in the peripheral blood is not due to a changed circulation. Furthermore, our data show that B cell progenitor, Pre-B, cells are not changed. Therefore, B cell lymphopoiesis is not the reason for B cell loss in our model system.

      3) It is disappointing that only the blood (and sometimes the bone marrow) was studied in this work. The interest of doing experiments in mice is to have access to many tissues such as the spleen, lymph nodes, colon, lung, and liver. To conclude that there is B cell deletion without showing lymphoid organs (where the majority of B cells reside) is insufficient. As discussed above, the drop in B cells in the blood could be due to their recirculation in lymphoid organs. In addition, there is no measurement of functional B cells activity. Do mice treated with Ipi-DM1 have a decreased ability to develop an antibody response following immunization?

      We have analyzed lymph nodes and spleen at the same time points. Unfortunately, Treg depletion was no longer observed at these time points. As expected, we did not see a clear depletion of B cells (Figure 1-figure supplement 6). In regards to functional B cell activity, we observed an increase of plasma immunoglobulins especially IgE which are now shown in Figure 3-figure supplement 1.

      4) Although it is difficult to study in vivo, there is not a single evidence of increased B cell death after injection of Ipi-DM1.

      Figure 2 & Figure 2-supplement 1 provides B cell death comparisons between IpiDM1 and hIgGFc group for bone marrow, blood, spleen, and lymph nodes. Statistically significant increase in B cell death is observed in mature B cells in bone marrow.

      5) In most of the experiments, B cells are quantified with the B220 marker alone, but this marker, in some cases, can be expressed by other cells. It would have been preferable to use a marker more specific to B cells such as CD19 for example.

      We have added data to support the death of mature B cells using other markers.

      Minor points.

      1) It should be indicated whether human CTLA4 binds normally to mouse CD80 CD86. We do not know if knock-in mice with human CTLA4 have a fully functional immune system.

      We have indicated this point as suggested and cited our previous work line 226-227 (ref 23 & 24)

      2) The manuscript is too long. Some of the data in the figures should be moved to supplemental figures. This is the case, for example, for some trivial stainings (Fig 1F, Fig 4B, 4F, Fig 5A, D, F, G). The figure legends and the Materials and Methods section are far too long. On the other hand, Fig 5-Fig Sup 1 could go into the main figures.

      The figure legends, materials, and methods may be too long, but our intention is to provide as much info as possible for others who may be interested in our model system.

      3) The anti-CTLA4 ADC reagent should be better explained and defined in the text.

      The anti-CTLA-4 ADC reagent synthesis described in materials/methods under “Antibody-drug conjugate preparation.”

      Reviewer #2 (Public Review):

      Despite the fact that CTLA-4 is a critical molecule for inhibiting the immune response, surprisingly individuals with heterozygous CTLA-4 mutations exhibit immunodeficiency, presenting with antibody deficiency secondary to B cell loss. Why the loss of a molecule that regulates T cell activation should lead to B cell loss has remained unclear. In this study, Muthana and colleagues use an anti-CTLA-4 antibody drug conjugate (aCTLA-4 ADC) to delete cells expressing high levels of CTLA-4, and show that this leads to a reduction in B cells. The aCTLA-4 ADC is found to delete a subset of Tregs, leading to hyperactivation of T cells that is associated with B cell depletion. Using blocking antibodies, the authors implicate TNFa in the observed B cell loss.

      The reciprocal regulation of T and B cell homeostasis is an important research area. While it has been shown that Treg defects are associated with B cell loss, the mechanisms at play are incompletely understood. CTLA-4 is not normally expressed in B cells so an indirect mechanism of action is assumed. The authors show that the decrease in Treg following aCTLA-4 ADC treatment is associated with activation of T cells, and that B cell loss is blunted if T cells are depleted. A role for both CD4 and CD8 T cells is identified by selective CD4/CD8 depletion. T cells appear to require CD28 costimulation in order to mediate B cell loss, since the response is partially inhibited in the presence of the costimulation blockade drug belatacept (CTLA-4-Ig). Finally, experiments using the anti-TNFa antibody adalimumab suggest a potential role for TNFa in the depletion of B cells.

      While the manuscript makes a useful contribution, a number of questions remain. Perhaps most important is the extent to which this model mimics the natural situation in individuals with CTLA-4 mutations (or following CTLA-4-based clinical interventions). aCTLA-4 ADC treatment permits acute deletion of Treg expressing high levels of CTLA-4, whereas in patients the Treg population remains but is specifically impaired in CTLA-4 function. Secondly, although the requirement for T cells to mediate B cell loss is convincingly demonstrated, the incomplete reversal by TNFa blockade suggests additional unidentified factors contribute to this effect. Finally, although the manuscript favours peripheral killing of mature B cells over alterations to B cell lymphopoiesis, one concern is that this may simply reflect the model employed: the shortterm (6 day) treatment used here may be too acute to alter B cell development, but this may nevertheless be a feature of prolonged immune dysregulation in humans.

      We appreciate reviewer’s comments and the difference between short-term depletion and permanent inactivation of Treg by genetic mutation is discussed. We would note that apart from mutation, dynamic Treg perturbation does occur under autoimmune conditions. Therefore, our data have significant implications for T-B cell interactions.

      TNF-alpha is implicated in B cell loss as evidenced by the partial rescue with Anti-TNF treatment. We did not try to exclude the possibility that other mechanisms are involved.

      Our data shows loss of circulating B cell in peripheral blood and mature bone marrow B cells. B cell progenitor, Pre-B, cells are not changed due Ipi-DM1 induced treg impairment, therefore B cell lymphopoiesis is not the reason for B cell loss in our model system. Evidence of increased cell death is only observed in mature B cells (Figure 2).

      1) Following aCTLA-4 ADC treatment, it is surprising how subtle the deletion of Treg is (from ~8% to ~7%, Fig 1G), compared to the marked deletion of CTLA-4-expressing CHO cells. Is this a feature of in vivo versus in vitro treatment? If Treg are treated in vitro is deletion more efficient? How does the expression level of CTLA-4 in the CHO cells compare with the Treg in these assays?

      We appreciate reviewer’s comments. The anti-CTLA-4 ADC targets CTLA-4 on cell surface. On average about 5% of Tregs express surface CTLA-4 at given moment while human CTLA-4 expressing CHO cell line stains > 90%. Nevertheless, Treg cell number in peripheral blood is reduced by >40%. Additionally, we have included bone marrow data, which shows a greater percentage of Treg depletion (Figure 1J).

      2) The decrease in CTLA-4 seen after ipi-DM1 is complicated by the fact that the control DM1 conjugate (IgG1-DM1) appears to significantly increase CTLA-4 expression (Fig 1 supplement 2). It would be useful to clarify when hIgGFc is used versus hIgGFc-DM1 given the additional complexity introduced here (comparisons lacking a payload differ in more than one variable, while the hIgGFc-DM1 is clearly not inert).

      We appreciate reviewer’s comments. We agree that the hIgGFc-DM1 control slightly increased CTLA-4 level; nevertheless, it did not alter B cells, T cells or their proliferation capacity when compared to hIgGFc. Our point here is that B cell depletion is not mediated by DM1 payload off target release (new-version Figure 1-Figure supplement 4, old version Figure 1-figure supplement 2). As for the clarification comment when hIgGFc is used versus hIgGFcDM1 is used, the information is clarified in the figure legend. Comparisons are made between (hIgGFc VS Ipi-DM1) or (hIgGFc VS hIgGFc-DM1).

      3) T cell-derived IFNg is another potential contender for influencing B cell homeostasis - have you considered testing whether this also contributes in your model?

      We appreciate reviewer’s suggestion. IFN was reported to induce apoptosis and cell arrest in Pre- B cells, however these studies are invitro studies Garvey et.al Immunology. 1994 Mar; 81(3): 381–388; Grawunder et.al Eur. J. Immunol. 23, 544–551. Since we did not observe any effect on Pre-B cells, we have not followed the literature to investigate the role of IFNy in B cell loss in our model.

      Reviewer #3 (Public Review):

      The co-suppressive molecule CTLA-4 has a critical role in the maintenance of peripheral tolerance, primarily by Treg mediated control of the co-stimulatory molecules CD80 and CD86. As stated by the authors, previous studies have found a variety of effects of anti-CTLA-4 antibody treatment or genetic loss of CTLA-4 on B-cells. These include increased B-cell activation and antibody production, autoantibody production, impairment of B-cell production in the bone marrow and loss of peripheral B-cells. In this article Muthana et al use a CTLA-4 humanized mouse model and examine the effects of drug conjugated CTLA-4 on the immune system. They observe a transient loss of B-cells in the blood of the treated mice. They then use a range of immune interventions such as T-cell depletion and blocking antibodies to demonstrate that this effect is dependent on T-cell activation.

      Since anti-CTLA-4 immunotherapy is in active clinical use exploration of its effects are welcome, this is helped by the use of a humanized CTLA-4 system which should be considered a strength of the paper. However, currently, the central premise of this paper, that B-cells are depleted, seems underexplored. Direct evidence of T-cell killing of B-cells is never presented, rather it is inferred from the reduced numbers of B-cells in the blood. The status of B-cells in sites that contain a large proportion of B-cells such as the spleen and lymph nodes is not examined. Additionally, no examination of B-cell antibody production is performed.

      We appreciate reviewer’s comments. To address the reviewer’s concerns we performed additional experiments to evaluate the impact on B cells in other organs, as detailed in our responses to specific questions.

      1) Examination of B-cell apoptosis/cell death and T-cell mediated cytotoxicity is needed. The authors repeatedly refer to auto destructive T-cells without ever demonstrating their presence or any direct evidence that B-cells are dying. This is particularly important in the context of the blood since an alternative hypothesis would be a change in B cell trafficking and infiltration into tissues.

      We appreciate reviewer’s comments. To address the reviewer’s concern that B cell loss in blood might be caused by a change in B cell trafficking pattern. We performed new study on the effect of the ADC on B cells in bone marrow. Our new data reveal loss of mature bone marrow B cells, and that such loss is associated with increased apoptosis of mature B cells (Figure 2). Therefore, the loss of B cells in the peripheral blood is not due to B cell trafficking and infiltration into tissues.

      2) The authors demonstrate that B-cells are mostly reduced in blood at around days 10 to 15, I believe it is critical to determine if this is also reflected in the lymphoid organs such as the spleen and lymph nodes.

      We appreciate reviewer’s comments. We have analyzed lymph node and spleen at the same time points. Unfortunately, Treg depletion was no longer observed at these time points. As expected, we did not see a clear depletion of B cells (Figure 1-figure supplement 6).

      3) Related to the above point do the authors see evidence of Splenomegaly or lymphadenopathy?

      We appreciate reviewer’s comment. Evidence of splenomegaly and lymphadenopathy is presented in Figure 3-figure supplement 2.

      4) Minimal examination of the status of the B-cells or antibody production is performed. Previous reports would suggest that plasma cell induction and antibody responses may be expected. Do serum antibody levels change in this system?

      We appreciate reviewer’s comment. Increases of plasma immunoglobulins especially IgE are now shown in Figure 3-figure supplement 1.

      5) Its unclear how the authors interpret their experiment with anti-TNFa (figure 6). Are they suggesting that TNFa itself depletes B-cells or that it is part of the inflammatory milieu that contributes to wider T-cell activation and, in turn, B-cell depletion?

      We have discussed these possibilities in the revised manuscript.

    1. Author Response

      The following is the authors’ response to the original reviews.

      Thank you for reviewing and assessing our paper. Reviewer2 had only posive comments. Reviewer 1 also had posive comments but included a list of suggesons. The revised version includes text edits to address the suggesons.

      Reviewer 1:

      … First, it is unclear whether the experiments and analyses were set up to be able to rule out more specific candidate funcons of the ZI.

      The list of possible funcons performed by the ZI is broad. Nevertheless, our study considers a rather long list of neural processes related to the behaviors listed below.

      Second, many important details of the experiments and their results are hard to decipher given the current descripons and presentaons of the data.

      The procedures used in the present study have all been used and described in our previous studies (cited). We used the same descripons and presentaons as in the prior studies. We have gone over the Methods and figures to ensure that all details required to understand the experiments are provided, but we also added further details following the suggesons noted below.

      The paper could be significantly strengthened by including more details from each experiment, stronger jusficaons for the limited behaviors and experimental analyses performed, and, finally, a broader analysis of how the recorded acvity in the ZI relates to behavioral parameters.

      The paper studied several behaviors including: 1) spontaneous movement of head-fixed mice on a spherical treadmill, 2) tacle (whisker, and body parts) and auditory (tones and white noise) smuli applied to head fixed mice, 3) spontaneous movement iniaon, change, and turns in freely moving mice, 4) auditory tone (frequency and SPL) mapping in freely behaving mice, 5) auditory-evoked orienng head movements (responses) in the context of several behavioral tasks, 6) signaled acve avoidance responses and escapes (AA1), 7) unsignaled/signaled passive avoidance responses (AA2ITI/AA3-CS2), 8) sensory discriminaon (AA3), 9) CS-US interval ming discriminaon (AA4), and 10) USevoked unsignaled escape responses.

      In freely moving experiments, the behavior is connuously tracked and decomposed into translaonal and rotaonal movement components. Discrete responses are also evaluated (e.g., acve avoids, escapes, passive avoids, errors, intertrial crossings, latencies, etc.). These behavioral procedures evaluate many neural processes, including decision making (Go/NoGo in AA1-3), response control/inhibion (unsignaled and signaled passive avoidance in AA2/3), and smulus discriminaon (AA3). The applied smuli, discrete responses, and tracked movement are always related to the recorded ZI acvity using a variety of techniques (e.g., cross-correlaons, PSTHs, event-triggered me extracons, etc.), which relate the discrete and me-series parameters to the neural acvity. We do not think all this qualifies as, “limited behaviors”.

      (1) Anatomical specificaon: The ZI contains many disnct subdivisions--each with its own topographically organized inputs/outputs and putave funcons. The current manuscript doesn't reference these known divisions or their behavioral disncons, and one cannot tell exactly which poron(s) of the ZI was included in the current study. Moreover, the elongated structure of the ZI makes it very difficult to specifically or completely infect virally. The data could be beter interpreted if the paper included basic informaon on the locaons of recordings, the extent of the AAV spread in the ZI in each viral experiment, and what fracon of infected neurons were inside versus outside ZI.

      Our experiments employed Vgat-Cre mice to target ZI neurons. In this line, GABAergic neurons from the enre ZI express Cre, including the dorsal and ventral subdivisions (see (Vong et al., 2011; Hormigo et al., 2020)). Consequently, AAV injecons in Vgat-Cre mice produce restricted expression in the ZI that can fully delineate the nucleus as shown in the papers referenced above (including ours). There is nil expression in structures above or below ZI because they do not express Cre in these mice (e.g., thalamus and subthalamic nucleus), which allows for selecve targeng of ZI. Our optogenec manipulaons and photometry recordings were not aimed at specific ZI subdivisions. We targeted the area of ZI indicated by the stereotaxic coordinates (see Methods), which are aimed at the center of the structure to maximize success in recording/manipulang neurons within ZI. While all the animals included in the study expressed opsins and GCaMP within ZI that in many animals fully delineated the nucleus, there was normal variability in the locaon of opcal fibers, but we did not detect any differences in the results related to these variaons.

      Fiber photometry and optogenecs experiments are performed with rather large diameter opcal probes, which record/manipulate relavely large areas of the targeted structure. This is useful because our goal was to idenfy funconal roles of the enre ZI, which could then be parsed. In the present study, we did not perform experiments to target specific ZI populaons (e.g., retrograde Cre expression from target areas), which may have revealed differences atributed to their projecon sites. However, in the last experiment, we selecvely excited ZI fibers targeng three different areas (midbrain tegmentum, superior colliculus, and posterior thalamus), which revealed clear differences on movement. Thus, future experiments should explore these different populaons (e.g., using retrograde/anterograde expression systems), which may be in different subdivisions.

      We have enhanced the Methods secon to clarify these points, including the addion of these references.

      (2) Electrophysiological recording on the treadmill: The authors are commended for this technically very difficult experiment. The authors do not specify, however, how they knew when they were recording in ZI rather than surrounding structures, parcularly given that recording site lesions were only performed during the last recording session. A map of the locaons of the different classes of units would be valuable data to relate to the literature.

      We have added details about this procedure in the Methods secon. These recordings are performed based on coordinates, and categorizing neurons as belonging to ZI is obviously an esmate based on the final histological verificaon. Nevertheless, the marking lesions revealed that the electrodes were on target, which likely resulted from the care taken during the surgical procedure to define reference points used later during the recording sessions (see Methods). Regarding a map of the unit locaons, we performed several analyses that did not reveal clear differences based on site. For example, we compared depth vs cell class, “There was no difference in recording depth between the four classes of neurons (ANOVA F(3,337)= 1.06 p=0.3676)”. Future experiments that employ addional methods (labelling, opto-tagging, etc.) would be more appropriate to address mapping quesons. Finally, as we state in the paper, “However, these recordings do not target GABAergic neurons and may sample some neurons in the tissue surrounding the zona incerta. Therefore, we used calcium imaging fiber photometry to target GABAergic neurons in the zona incerta”.

      (3) The raonale of the analysis of acvity with respect to “movement peak”: It is unclear why the authors did not assess how ZI acvity correlates with a broad set of movement parameters, but rather grouped heterogeneous behavioral epochs to analyze firing with respect to “movement peaks”.

      The reviewer is referring to movement peaks on the spherical treadmill. On the treadmill, we used the forward locomotor movement of the animal because this is the main acvity of the mice on the treadmill. We considered “all peaks” (or movements) and “>4 sec peaks”, which select for movement onsets. Compared to the treadmill, in freely movement condions during various behavioral tasks, there is a richer behavioral repertoire, which was analyzed in more detail (i.e., translaonal, and rotaonal components during spontaneous ongoing movement and movement onsets, movement related to various behaviors such as orienng, acve and passive avoidance, escape, sensory smulaon, discriminaon, etc.). Thus, we focused on a broader set of movement parameters in the Cre-defined ZI cells of freely behaving mice.

      (4) The display of mean categorical data in various figures is interesng, however, the reader cannot gather a very detailed view of ZI firing responses or potenal heterogeneity with so litle informaon about their distribuons.

      The PCA performs the heterogeneity classificaon in an unbiased manner, which we feel is a thoughul approach. The firing rates and correlaons with movement for each category of neurons are detailed in the results. Furthermore, the sensory responses for these neurons are also detailed. Together, we think this provides a detailed view of the units we recorded in awake/head-fixed mice. As already stated, further study would benefit from an addional level of cell site verificaon.

      (5) Somatosensory firing responses in ZI: It is unclear why the authors chose the specific smuli used in the study. How oen did they evoke reflexive motor responses? What was the latency of sensory-evoked responses in ZI acvity and the latency of the reflexive movement?

      These are broad quesons, and we assume that the reviewer is asking about somatosensory evoked responses on the spherical treadmill. We used air-puffs applied to the whiskers and on the back (le vs right) because the whiskers represent an important sensory representaon for mice, and the back is a part of the body (trunk), which we oen use to movate the animals to move forward on the treadmill. Regarding the latency of the somatosensory evoked responses, in this case, we did not correct them based on the me it takes the air-puff to travel to the whiskers or body part, and therefore we did not provide latencies. Moreover, air-puffs are not a very good method to quanfy whisker-evoked latencies, which are beter measured using other methods (whisker deflecons of single/mulple whiskers using piezo-devices or other mechanical devices, as we and others have done in many studies). We are not sure what the reviewer means by “reflexive behavior”; we did not measure any reflexive behavior under these condions. We have gone over the Methods and Results to ensure that sufficient details are provided about these experiments.

      (6) It would be valuable to see example traces in Figure 3 to get a beter sense of the me course and contexts under which Ca signals in ZI tracks movement. What is the typical latency? What is the typical range of magnitudes of responses? Does the Ca signal track both fast and slow movements? How are the authors sure that there are no movement arfacts contribung to the calcium imaging? It seems there is more informaon in the dataset that could be valuable.

      As is well known, fiber photometry calcium imaging is a slow populaon signal. We do not think it would be valuable to get into ming issues beyond what is already detailed in the study (i.e., magnitudes measured as areas or peaks, and ming as me-to-peaks). Regarding “movement arfacts”, these signals are absent (flat) in animals that do not express GCAMP. We agree that there must be addional valuable informaon in our datasets (as in most me-series). However, the current paper is already rather extensive. We will connue to peruse our datasets and report addional findings in new papers.

      (7) Figure 4: The raonale for quanfying the F/Fo responses over a 6-second window, rather than with respect to discrete movement parameters, is not well explained. What types of movement are binned in this approach and might this broad binning hinder the ability to detect more specific relaonships between acvity and movement?

      Figure 4 is focused on characterizing the relaonship between turns (ipsiversive and contraversive) during movement and ZI acvity. We tested different binning windows to find differences, including the 6 sec window in figure 4 for populaon measures (-3 to 3 sec around the turns). This binning approach is effecve at revealing differences where they exist (e.g., superior colliculus) as shown in our previous studies (e.g. (Zhou et al., 2023)). Moreover, the turns in the different direcons can be considered discrete responses at their peak, and the ming of the related acvaons (e.g., me to peaks), which we evaluated, are rather sensive and would have revealed differences, but we did not find them.

      (8) Separaon of sensory and motor responses in Figure 5: The current data do not adequately differenate whether the responses are sensory or motor given the high correlaon of the sensory inputs driving motor responses. Because isoflurane can diminish auditory responses early in the auditory pathway, this reviewer is not convinced the isoflurane experiments are interpretable.

      The reviewer is referring to Fig. 5C,D. Indeed, the point of this experiment was to show that it is difficult to differenate whether neural responses are sensory or motor in awake and freely moving condions. As we stated in the Results secon, “Although arousal and movement were not dissected in the present experiment (this would likely require paralyzing and ventilating the animal), the results indicate that activation of zona incerta neurons by sensory stimulation is primarily associated with states when sensory-evoked movement is also present”. This is followed in the Discussion by, “…as already noted, the suppression of sensory responses may be due to changes in arousal (Castro-Alamancos, 2004; Lee and Dan, 2012) and not caused by the abolishment of the movements per se”.

      (9) Given the broad duraon of the mean avoidance response (Fig. 6 C, botom), it would be useful to know to what extent this plot reflects a prolonged behavior or is the result of averaging different animals/trials with different latencies. Given that the shapes of the F/Fo responses in ZI appear similar across avoids and escapes (Fig. 6D), despite their apparent different speeds and movement duraons (Fig 6C), it would be valuable to know how the ming of the F/Fo relates to movement on a trial-by-trial basis.

      The duraon of the avoidance response cannot be ascertained from CS onset (panel 6C botom) and avoids are not wide but rather sharp. We have now made this clearer when Fig. 6C is first menoned (“note that since avoids occur at different latencies after CS onset they are best measured from their occurrence as in Fig. 6D”). Like other related condioned and uncondioned responses, avoids and escapes are similar, varying in the noted parameters. Regarding ming, as already menoned above, we think that the characteriscs of the populaon calcium signal make it unsuitable for further ming consideraons than what we included, parcularly for movements occurring at the fast speeds of avoids and escapes.

      (10) Lesion quanficaon: One cannot tell what rostral-caudal extent of ZI was lesioned and quanfied in this experiment. It would be easier to interpret if also ploted for each animal, so the reader can tell how reliable the method is. The mean ablaon would be beter shown as a normalized fracon of cells. Although the authors claim the lesions have litle impact on behavior, it appears the incompleteness of the lesions could warrant a more conservave interpretaon.

      The lesion experiment was a complement to the optogenecs inacvaon experiments we performed in our preceding ZI paper and in the present paper. Thus, the finding that the lesions had litle impact on behavior is supporve of the optogenecs findings. Regarding cell counts, we did not select any parts of the ZI to quanfy the number of neurons in either control or lesion mice. We considered the full rostrocaudal extent in our measurements. We are not sure what “fracon” the reviewer is suggesng, considering that these counts are from two different groups of mice (control vs lesion). Note that the red-marked neurons, as shown in Fig. 8A, reveal healthy non-Vgat-Cre neurons outside ZI that mark the extent of the AAV diffusion, which as shown spanned the full extent of the ZI in the coronal plane (and in other planes as the AAV spreads in all direcons).

      (11) Optogenecs: the locaon of infected neurons is poorly described, including the rostral-caudal extent and the fracon of neurons inside and outside of ZI. Moreover, it is unclear how strongly the optogenec manipulaons in this study are expected to affect neuronal acvity in ZI.

      We discussed the first point in (1) above. Regarding, how optogenec manipulaons are expected to affect neuronal acvity in ZI and its targets, we have conducted extensive electrophysiological recordings in slices and in vivo to detail the effects of our manipulaons on GABAergic neurons (e.g. (Hormigo et al., 2016; Hormigo et al., 2019; Hormigo et al., 2021a; Hormigo et al., 2021b), including ZI neurons (Hormigo et al., 2020). In fact, we never use an opsin we have not validated ourselves using electrophysiology. Moreover, our experiments employ a spectrum of optogenec light paterns (including trains/cont at different powers) that trate the optogenec effects within each session/animal. As shown in fig. 11 and 12, these paterns produce different behavioral effects related to the different levels of neural firing they induce. For ChR2-expressing neurons in ZI, firing is frequency dependent and maximal during Cont blue light (at the same power). For Arch-expressing neurons only Cont is used, and inhibion is a funcon of the green light power. When blue light is applied in ZI fibers targeng different areas, this relaonship changes. Blue light trains (1-ms pulses) at 40-66 Hz become the most effecve means of inducing sustained postsynapc inhibion compared to Cont or low frequencies.

      References

      Castro-Alamancos MA (2004) Dynamics of sensory thalamocorcal synapc networks during informaon processing states. Progress in Neurobiology 74:213-247.

      Hormigo S, Vega-Flores G, Castro-Alamancos MA (2016) Basal Ganglia Output Controls Acve Avoidance Behavior. J Neurosci 36:10274-10284.

      Hormigo S, Zhou J, Castro-Alamancos MA (2020) Zona Incerta GABAergic Output Controls a Signaled Locomotor Acon in the Midbrain Tegmentum. eNeuro 7.

      Hormigo S, Zhou J, Castro-Alamancos MA (2021a) Bidireconal control of orienng behavior by the substana nigra pars reculata: disnct significance of head and whisker movements. eNeuro. Hormigo S, Vega-Flores G, Rovira V, Castro-Alamancos MA (2019) Circuits That Mediate Expression of Signaled Acve Avoidance Converge in the Pedunculoponne Tegmentum. J Neurosci 39:45764594.

      Hormigo S, Zhou J, Chabbert D, Shanmugasundaram B, Castro-Alamancos MA (2021b) Basal Ganglia Output Has a Permissive Non-Driving Role in a Signaled Locomotor Acon Mediated by the Midbrain. J Neurosci 41:1529-1552.

      Lee SH, Dan Y (2012) Neuromodulaon of brain states. Neuron 76:209-222.

      Vong L, Ye C, Yang Z, Choi B, Chua S, Jr., Lowell BB (2011) Lepn acon on GABAergic neurons prevents obesity and reduces inhibitory tone to POMC neurons. Neuron 71:142-154.

      Zhou J, Hormigo S, Busel N, Castro-Alamancos MA (2023) The Orienng Reflex Reveals Behavioral States Set by Demanding Contexts: Role of the Superior Colliculus. J Neurosci 43:1778-1796.

    1. Author Response

      The following is the authors’ response to the original reviews.

      We thank the editor and the reviewers for their very useful and constructive comments. We went through the list and gladly received all their suggestions. The reviewers mostly pointed to minor revisions in the text, and we acted on all of those. The one suggestion that required major work was the one raised in point 13, about the processing pipeline being unconvincingly scattered between different tools (R → Python → Matlab). I agree that this was a major annoyance, and I am happy to say we have solved it integrating everything in a recent version of the ethoscopy software (available on biorxiv with DOI https://www.biorxiv.org/content/10.1101/2022.11.28.517675v2 and in press with Bioinformatics Advances). End users will now be able to perform coccinella analysis using ethoscopy only, thus relying on nothing else but Python as their data analysis tool. This revised version of the manuscript now includes two Jupyter Notebooks as supplementary material with a “pre-cooked” sample recipe of how to do that. This should really simplify adoption and provides more details on the pipeline used for phenotyping.

      Please find below a point-by-point description of how we incorporated all the reviewers’ excellent suggestions.

      Recommendations for the authors: please note that you control which, if any, revisions, to undertake

      1) Line 38: "collecting data simultaneously from a large number of individuals with no or limited human intervention" is a bit misleading, as the entire condition the individuals are put in are highly modified by humans and most times "unnatural". I understand the point that once the animals are placed in these environments, then recording takes place without intervention, but it would be nice to rephrase this so that it reflects more accurately what is happening.

      We have now rephrased this into the following (L39):

      Collecting data simultaneously from a large number of individuals, which can remain undisturbed throughout recording.

      2) Line 63: please add a reference to the Ethoscopes so that readers can easily find it.

      Done.

      2b) And also add how much they cost and the time needed to build them, as this will allow readers to better compare the proposed system against other commercially available ones.

      This information is available on the ethoscope manual website (http://lab.gilest.ro/ethoscope). The price of one ethoscope, provided all necessary tools are available, is around ~£75 and the building time very much depends on the skillset of the builder and whether they are building their first ethoscope or subsequent ones. In our experience, building and adopting ethoscopes for the first time is not any more time-expensive than building a (e.g.) deeplabcut setup for the first time. We have added this information to L81

      Ethoscopes are open source and can be manufactured by a skilled end-user at a cost of about £75 per machine, mostly building on two off-the-shelf component: a Raspberry Pi microcomputer and a Raspberry Pi NoIR camera overlooking a bespoke 3D printed arena hosting freely moving flies.

      3) Line 88: The authors describe that in the current setting, their system is capable of an acquisition rate of 2.2 frames per second (FPS). Would reducing the resolution of the PiCamera allow for higher FPS? I raise this point because the authors state that max velocity over a ten second window is a good feature for classifying behaviors. However, if animals move much faster than the current acquisition rate, they could, for instance, be in position X, move about and be close to the initial position when the next data point is acquired, leading to a measured low max velocity, when in fact the opposite happened. I think it would be good to add a statement addressing this (either data from the literature showing that the low FPS does not compromise data acquisition, or a test where increasing greatly FPS leads to the same results).

      We have previously performed a comparison of data analysed using videos captured at different FPSs, which is published in Quentin Geissman’s doctoral Thesis (2018, DOI: https://doi.org/10.25560/69514 ) in chapter 2, section 2.8.3, figure 2.9 ). We have now added this work as one of the references at L95 (reference 19).

      4) Still on the low FPS, would a Raspberry Pi 4 help with the sampling rate? Given that they are more powerful than the RPi3 used in the paper?

      It would, but it would be a minor increase, leading from 2.2 to probably 3-5 FPS. A significantly higher number of FPSs would be best achieved by lowering the camera’s resolution, as the reviewer’s suggested, or by operating offline. I think the interesting point being implied by the reviewers is that, for Drosophila, the current limits of resolution are more than sufficient. For other animals, perhaps moving more abruptly, they may not. The reviewer is right that we should add a line of caveat about this. We now do so in the discussion, lines 215-224.

      Coccinella is a reductionist tool, not meant to replace the behavioural categorization that other tools can offer but to complement it. It relies on raspberry PIs as main acquisition devices, with associated advantages and limitations. Ethoscopes are inexpensive and versatile but have limitations in terms of computing power and acquisition rates. Their online acquisition speed is fast enough to successfully capture the motor activity of different species of Drosophilae28, but may not be sufficient for other animals moving more swiftly, such as zebrafish larvae. Moreover, coccinella cannot apply labels to behaviour (“courting”, “lounging”, “sipping”, “jumping” etc.) but it can successfully identify large behavioural phenotypes and generate unbiased hypothesis on how behaviour – and a nervous system at large – can be influenced by chemicals, genetics, artificial manipulations in general.

      5) Along the same line of thought, would using a simple webcam (with similar specs to the PiCamera - ELP has cameras that operate on infrared and are quite affordable too) connected to a more powerful computer lead to higher FPS? - The reason for the question about using a simple webcam is that this would make your system more flexible (especially useful in the current shortage of RPi boards on the market) lowering the barrier for others to use it, increasing the chances for adoption.

      Completely bypassing ethoscopes would require the users to setup their own tracking solution, with a final result that may or may not match what we describe here. If a greater temporal resolution is necessary, the easiest way to achieve more FPSs would be to either decrease camera resolution or use the Pis to take videos offline and then process those videos at a later stage. The combination of these two would give FPS acquisition of 60 fps at 720p, which is the maximum the camera can achieve. We now made this clear at lines 83-92.

      The temporal and spatial resolution of the collected images depends on the working modality the user chooses. When operating in offline mode, ethoscopes are capable to acquire 720p videos at 60 fps, which is a convenient option with fast moving animals. In this study, we instead opted for the default ethoscope working settings, providing online tracking and realtime parametric extraction, meaning that images are analysed by each raspberry Pi at the very moment they were acquired (Figure 1b). This latter modality limits the temporal resolution of information being processed (one frame every 444 ms ± 127 ms, equivalent to 2.2 fps on a Raspberry Pi3 at a resolution of 1280x960 pixels with each animal being constricted in an ellipse measuring 25.8 ± 1.4 x 9.85 ±1.4 pixels - Figure 1a) but provides the most affordable and high-throughput solution, dispensing the researcher from organising video storage or asynchronous video processing for animals tracking.

      6) One last point about decreasing use barrier and increasing adoption: Would it be possible to use DeepLabCut (DLC) to simply annotate each animal (instead of each body part) and feed the extracted data into your current analysis with coccinella? This way different labs that already have pipelines in place that use DLC would have a much easier time in testing and eventually switching to coccinella? I understand that extracting simple maximal velocity this way would be an overkill, but the trade-off would again be a lowering of the adoption barrier.

      It would certainly be possible to calculate velocity from the whole animal pose measurement and then use this with HCTSA or Catch22, thus mimicking the coccinella pipeline, but it would be definitely overkilled, as the reviewers correctly points out. Given that we are trying to make an argument about high-throughput data acquisition I would rather not suggest this option in the manuscript.

      7) Line 96: The authors state that once data is collected, it is put through a computational frameworkthat uses 7700 tests described in the literature so that meaningful discriminative features are found. I think it would be interesting to expand a bit on the explanation of how this framework deals multiple comparison/multiple testing issues.

      We always use the full set of features on aggregate to train a classifier (e.g., TS_Classify in HCTSA) and that means no correction is necessary because the trained classifier only ever makes a single prediction (only one test is performed), so as long as it is done correctly (e.g., proper separation of training and test sets, etc.) then multiple hypothesis correction is not appropriate. This has been confirmed with the HCTSA/Catch22 author (Dr Ben Fulcher, personal communication). We have added a clarifying sentence about this to the methods (L315-318)

      8) It would be nice to have a couple of lines explaining the choice of compounds used for testing and also why in some tests, 17 compounds were used, while in others 40, and then 12? I understand how much work it must be in terms of experiment preparation and data collection for these many flies and compounds, but these changes in the compounds used for testing without a more detailed explanation is suboptimal.

      This is another good point. We have now added this information to the methods, in a section renamed “choice, handling and preparation of drugs” L280-285, which now reads like this:

      The initial preliminary analysis was conducted using a group of 12 compounds “proof of principle” compounds and a solvent control. These compounds were initially used to compare both the video method and ethoscope method. After testing these initial compounds, it was found that the ethoscope methodology was more successful, and then the compound list was expanded to 17 (including the control) only using the ethoscope method. As a final test, we included additional compounds for a single concentration, bringing up the total to 40 (including control), also for the ethoscope method.

      9) Line 119 states: "A similar drop in accuracy was observed using a smaller panel of 12 treatments (Supplementary Figure 2a)". It is actually Supplementary Figure 1c.

      Thank you for noticing that! Now corrected. The Supplementary figures have also been renamed to obey eLife’s expected nomenclature (both Figure 1 – Figure supplements)

      10) In some places the language seems a little outlandish and should either be removed or appropriately qualified. a- Lines 56-59 pose three questions that are either rhetorical or ill-posed. For example, "...minimal amount of information...behavior" implies there is a singular response but the response depends on many details such as to what degree do the authors want to "classify behavior".

      Yes, those were meant as rhetorical questions indeed, but we prefer to keep them in, because we are hoping to generate this type of thoughts with the readers. These are concepts that may not be so obvious to someone who is just looking to apply an existing tool and may spring some reflection about what kind of data do they really want/need to acquire.

      b) Some of the criticisms leveled at the state-of-the-art methods are probably unwarranted because the goals of the different approaches are different. The current method does not yield the type of rich information that DeepLabCut yields. So, depending on the application DeepLabCut may be the method of choice. The authors of the current manuscript should more clearly state that.

      In the introduction and discussion we do try to stress that coccinella is not meant to replace tools like DLC. We have now added more emphasis to this concept, for instance to L212:

      [tools like deeplabcut] are ideal – and irreplaceable – to identify behavioural patterns and study fine motor control but may be undue for many other uses.

      And L215:

      Coccinella is a reductionist tool not meant to replace the behavioural categorization that other tools can offer but to complement it

      11) The application to sleep data appears suddenly in the manuscript. The authors should attempt to make with text change a smoother transition from drug screen to investigation into sleep.

      I agree with this observation. We have now tried to add a couple of sentences to contextualise this experiment and hopefully make the connection appear more natural. Ultimately, this is a proof-ofprinciple example anyway so hopefully the reader will take it for what it is (L169).

      Finally, to push the system to its limit, we asked coccinella to find qualitative differences not in pharmacologically induced changes in activity, but in a type of spontaneous behaviour mostly characterised by lack of movement: sleep. In particular, we wondered whether coccinella could provide biological insights comparing conditions of sleep rebound observed after different regimes of sleep deprivation. Drosophila melanogaster is known to show a strong, conserved homeostatic regulation of sleep that forces flies to recover at least in part lost sleep, for instance after a night of forceful sleep deprivation.

      11b) Additionally, the beginning section of sleep experiments talks about sleep depth yet the conclusion drawn from sleep rebound says more about the validity of the current 5 min definition of sleep than about sleep depth. If this conclusion was misunderstood, it should be clarified. If it was not, the beginning text of the sleep section should be tailored to better fit the conclusion.

      I am afraid we did not a good job at explaining a critical aspect here: the data fed to coccinella are the “raw” activity data, in which we are not making any assumption on the state of the animal. In other words, we do not use the 5-minutes at this or any other point to classify sleep and wakening. Nevertheless, coccinella picks the 300 seconds threshold as the critical one for discerning the two groups. This is interesting because it provides a full agnostic confirmation of the five minutes rule in D. melanogaster. We recognise this was not necessarily obvious from the text and now added a clarification at L189-201:

      However, analysis of those same animals during rebound after sleep deprivation showed a clear clustering, segregating the samples in two subsets with separation around the 300 seconds inactivity trigger (Figure 3d). This result is important for two reasons: on one hand, it provides, for the third time, strong evidence that the system is not simply overfitting data of nought biological significance, given that it could not perform any better than a random classifier on the baseline control. On the other hand, coccinella could find biologically relevant differences on rebound data after different regimes of sleep deprivation. Interestingly enough, the 300 seconds threshold that coccinella independently identified has a deep intrinsic significance for the field, for it is considered to be the threshold beyond which flies lose arousal response to external stimuli, defining a “sleep quantum” (i.e.: the minimum amount of time required for transforming inactivity bouts into sleep bouts23,24,28). Coccinella’s analysis ran agnostic of the arbitrary 5-minutes threshold and yet identified the same value as the one able to segregate the two clusters, thus providing an independent confirmation of the fiveminutes rule in D. melanogaster.

      12) Line 227: (standard food) - please add a link to a protocol or a detailed description on what is "standard food". This way others can precisely replicate what you are using. This is not my field, but I have the impression that food content/composition for these animals makes big changes in behaviour?

      Yes, good point. We have now added the actual recipe to the methods L240:

      Fly lines were maintained on a 12-hour light: 12-hour dark (LD) cycle and raised on polenta and yeast-based fly media (agar 96 g, polenta 240 g, fructose 960 g and Brewer’s yeast 1,200 g in 12 litres of water).

      13) Data acquisition and processing: please add links to the code used.

      Both the code and the raw data used to generate all the figures have been uploaded on Zenodo and available through their repository. Zenodo has a limit of 50GB per uploaded dataset so we had to split everything into two files, with two DOIs, given in the methods (L356, section “code and availability” - DOIs: 10.5281/zenodo.7335575 and 10.5281/zenodo.7393689). We have now also created a landing page for the entire project at http://lab.gilest.ro/coccinella and linked that landing page in the introduction (L64).

      13b) Also your pipeline seems to use three different programming languages/environments... Any chance this could be reduced? Maybe there are R packages that can convert csv to matlab compatible formats, so you can avoid the Python step? (nothing against using the current pipeline per se, I am just thinking that for usability and adoption by other labs, the smaller amount of languages, the better?

      This is a very important suggestion that highlights a clear limitation of the pipeline. I am happy to say that we worked on this and solved the problem integrating the Python version of Catch22 into the ethoscopy software. This means the two now integrate, and the entire analysis can be run within the Python ecosystem. HCTSA does not have a Python package unfortunately but we still streamlined the process so that one only has to go from Python to Matlab without passing through R. To be honest, Catch22 is the evolution of HCTSA and performs really well so I think that is what most users will want to use. We provide two supplementary notebooks to guide the reader through the process. One explains how to go from ethoscope data to an HCTSA compatible mat file. The other explains how ethoscope data integrate with Catch22 and provides many more examples than the ones found in the paper figures.

      14) There are two sections named "References" (which are different from each other) on the manuscript I received and also on BioRxiv. Should one of them be a supplementary reference? Please correct it. I spent a bit of time trying to figure out why cited references in the paper had nothing to do with what was being described...

      The second list of references actually applied only to the list of compounds in the supplementary table 1. When generating a collated PDF this appeared at the end of the document and created confusion. We have now amended the heading of that list in the following way, to read more appropriately:

    1. Author Response

      The following is the authors’ response to the original reviews.

      Thank you for reviewing our manuscript. We do find that the reviews are constructive and meaningful. Accordingly, we incorporated most suggestions into our revision. We provided a point-by-point responses to the reviews below.

      Reviewer #1 (Public Review):

      The evolution of dioecy in angiosperms has significant implications for plant reproductive efficiency, adaptation, evolutionary potential, and resilience to environmental changes. Dioecy allows for the specialization and division of labor between male and female plants, where each sex can focus on specific aspects of reproduction and allocate resources accordingly. This division of labor creates an opportunity for sexual selection to act and can drive the evolution of sexual dimorphism.

      In the present study, the authors investigate sex-biased gene expression patterns in juvenile and mature dioecious flowers to gain insights into the molecular basis of sexual dimorphism. They find that a large proportion of the plant transcriptome is differentially regulated between males and females with the number of sex-biased genes in floral buds being approximately 15 times higher than in mature flowers. The functional analysis of sex-biased genes reveals that chemical defense pathways against herbivores are up-regulated in the female buds along with genes involved in the acquisition of resources such as carbon for fruit and seed production, whereas male buds are enriched in genes related to signaling, inflorescence development and senescence of male flowers. Furthermore, the authors implement sophisticated maximum likelihood methods to understand the forces driving the evolution of sexbiased genes. They highlight the influence of positive and relaxed purifying selection on the evolution of male-biased genes, which show significantly higher rates of nonsynonymous to synonymous substitutions than female or unbiased genes. This is the first report (to my knowledge) highlighting the occurrence of this pattern in plants. Overall, this study provides important insights into the genetic basis of sexual dimorphism and the evolution of reproductive genes in Cucurbitaceae.

      Thank you for your positive comments. Greatly appreciated.

      There are, however, parts of the manuscript that are not clearly described or could be otherwise improved.

      • The number of denovo-assembled unigenes seems large and I would like to know how it compares to the number of genes in other Cucurbitaceae species. The presence of alternatively assembled isoforms or assembly artifacts may be still high in the final assembly and inflate the numbers of identified sex-biased genes.

      The majority of unigenes were annotated by homologs in species of Cucurbitaceae (63%), including Momordica charantia (16.3%), Cucumis melo (11.9%), Cucurbita pepo (11.9%), Cucurbita moschata (11.5%), Cucurbita maxima (10.1%) and other species of Cucurbitaceae (Fig. S1C). We admit that in the final assembly, transcripts may be still overestimated due to the unavoidable presence of isoforms, although we have tried our best to filter it by several strategies of clustering methods. Additionally, we assessed the transcripts using BUSCOv5.4.5 and embryophyta_odb10 database with 1,614 plant orthologs assessment. Some 95.0% of these orthologs were covered by the unigenes, in which 1447 (89.7%) BUSCO genes were “Complete BUSCOs”, 85 (5.3%) were “Fragmented BUSCOs”, and only 82 (5.0%) were “Missing BUSCOs” (Table S2). Overall, our assessment suggested that we have generated high-quality reference transcriptomes in the absence of a reference genome. Subsequently, we revised the manuscript (lines 175-181).

      • It is interesting that the majority of sex-biased genes are present in the floral buds but not in the mature flowers. I think this pattern could be explored in more detail, by investigating the expression of male and female sex-biased genes throughout the flower development in the opposite sex. It is also not clear how the expression of the sex-biased genes found in the buds changes when buds and mature flowers are compared within each sex.

      Thank you for your advice for further understanding of this interesting pattern. In the near future, we would like to study these issues through more development stages of flowers in each sex, probably with the aid of single-cell techniques and a reference genome. We have revised the manuscript to reflect these in Results, in the section "Tissue-biased/stage-biased gene expression" (lines 202216).

      • The statistical analysis of evolutionary rates between male-biased, female-biased, and unbiased genes is performed on samples with very different numbers of observations, therefore, a permutation test seems more appropriate here.

      Thank you for your suggestion. However, all comparisons between sex-biased and unbiased genes were tested using Wilcoxon rank sum test in R software, which is more commonly used. Additionally, we tested some datasets, which were consistent with Wilcoxon rank sum test.

      • The impact of pleiotropy on the evolutionary rates of male-biased genes is speculative since only two tissue samples (buds and mature flowers) are used. More tissue types need to be included to draw any meaningful conclusions here.

      Thank you for your advice for further understanding of the impact of pleitropy. In the near future, we would like make further investigations through more development stages of flowers and new technologies in each sex to consolidate the conclusion.

      Reviewer #2 (Public Review):

      Summary:

      This study uses transcriptome sequence from a dioecious plant to compare evolutionary rates between genes with male- and female-biased expression and distinguish between relaxed selection and positive selection as causes for more rapid evolution. These questions have been explored in animals and algae, but few studies have investigated this in dioecious angiosperms, and none have so far identified faster rates of evolution in male-biased genes (though see Hough et al. 2014 https://doi.org/10.1073/pnas.1319227111).

      Strengths:

      The methods are appropriate to the questions asked. Both the sample size and the depth of sequencing are sufficient, and the methods used to estimate evolutionary rates and the strength of selection are appropriate. The data presented are consistent with faster evolution of genes with male-biased expression, due to both positive and relaxed selection.

      This is a useful contribution to understanding the effect of sex-biased expression in genetic evolution in plants. It demonstrates the range of variation in evolutionary rates and selective mechanisms, and provides further context to connect these patterns to potential explanatory factors in plant diversity such as the age of sex chromosomes and the developmental trajectories of male and female flowers.

      Weaknesses:

      The presence of sex chromosomes is a potential confounding factor, since there are different evolutionary expectations for X-linked, Y-linked, and autosomal genes. Attempting to distinguish transcripts on the sex chromosomes from autosomal transcripts could provide additional insight into the relative contributions of positive and relaxed selection.

      Thank you for your meanful suggestions. We agree that the identification of chromosome origins for transcripts would greatly improve the insights of selection, and we will investigate these issues, probably with a reference genome in the near future.

      Reviewer #3 (Public Review):

      The potential for sexual selection and the extent of sexual dimorphism in gene expression have been studied in great detail in animals, but hardly examined in plants so far. In this context, the study by Zhao, Zhou et al. al represents a welcome addition to the literature.

      Relative to the previous studies in Angiosperms, the dataset is interesting in that it focuses on reproductive rather than somatic tissues (which makes sense to investigate sexual selection), and includes more than a single developmental stage (buds + mature flowers).

      The main limitation of the study is the very low number of samples analyzed, with only three replicate individuals per sex (i.e. the whole study is built on six individuals only). This provides low power to detect differential expression. Along the same line, only three species were used to evaluate the rates of non-synonymous to synonymous substitutions, which also represents a very limited dataset, in particular when trying to fit parameter-rich models such as those implemented here.

      A third limitation relates to the absence of a reference genome for the species, making the use of a de novo transcriptome assembly necessary, which is likely to lead to a large number of incorrectly assembled transcripts. Of course, the production of a reference transcriptome in this non-model species is already a useful resource, but this point should at least be acknowledged somewhere in the manuscript.

      Each of these shortcomings is relatively important, and together they strongly limit the scope of the conclusions that can be made, and they should at least be acknowledged more prominently. The study is valuable in spite of these limitations and the topic remains grossly understudied, so I think the study will be of interest to researchers in the field, and hopefully inspire further, more comprehensive analyses.

      We acknowledged that our sample size was relatively small. We will investigate these issues at the population level, probably with a reference genome in the near future. We acknowledged in the revised manuscript that there may be some incorrectly assembled transcripts. We assessed the transcripts using BUSCOv5.4.5 and the latest embryophyta_odb10 database with 1,614 plant orthologs assessment. As mentioned, 95.0% of these orthologs were covered by the unigenes, which of 1447 (89.7%) BUSCO genes were “Complete BUSCOs”, 85 (5.3%) were “Fragmented BUSCOs”, and only 82 (5.0%) were “Missing BUSCOs” (Table S2). In short, the quality of transcriptome was high in the absence of a reference genome.

      Reviewer #1 (Recommendations For The Authors):

      My main criticism of this manuscript is that it refers to gene names and orthogroups throughout the text, however, the assembled transcripts are not accessible. The reference trascriptome, orthology data, and alignments used for evolutionary analysis should be made available through a public repository to support reproducibility and efficient use of produced resources in this study.

      We have uploaded these datasets in Researchgate (https://www.researchgate.net/publication/373194650_Trichosanthes_pilosa_datasets Positive_selection_and_relaxed_purifying_selection_contribute_to_rapid_evolution of_male-biased_genes_in_a_dioecious_flowering_plant).

      Comments to the authors:

      1) I have an issue with the tissue-biased gene expression analysis. Looking at Fig.3, it seems to me there are 3,204 male-biased genes that are expressed at the same level in male buds and mature flowers (same for 5,011 female-biased genes in female buds and flowers), however, only a handful of genes show sex bias between mature male and female flowers. Taking the male-biased genes as an example, if the 3,204 M1BGs experience the same expression levels in mature male flowers and are no longer male-biased when mature male vs female flowers are compared, why there are not found as female tissue biased (F2TGs)? I may be wrong, but one scenario would be that the M1BGs increase their expression in female flowers and become unbiased. However, that increase in expression (low expression in the female buds → higher expression in the female flowers) should classify them as female tissue-biased genes (F2TGs). Can you please clarify how are the M1BGs and F1BGs expressed in the flowers of the opposite sex?

      As to Fig. 3A, 3,204 male-biased genes expressed in male floral buds are part of all male-biased genes (3204+286+724=4214), as shown in Fig.2A. However, only 233 male-biased genes (88+1+144=233, Fig.2B and Fig.3B) expressed in male mature flowers. So, they are not expressed at the same level between male floral buds and mature flowers. Only 288 genes are sex-biased (M1BGs), as well as tissue/stage-biased (M1TGs) in male floral buds. M1BGs (4,214 male-biased genes) and F1BGs (5,096 female-biased genes) are 0 overlaps, except for 44,326 unbiasedgenes shown in Fig.2A. That is, F1BGs (5,096 female-biased genes) are low expression or no expression in M1BGs (4,214 male-biased genes). The expression levels of some genes have been shown in Table S14.

      2) Paragraph (407-416) describes the analysis of duplicated genes under relaxed selection but there is no mention of this in the results.

      In fact, these results have been shown in Table S13. It is not necessary for us to describe them in detail in the results.

      3) How did the authors conclude that the identified functions in male flowers make them more adapted to biotic and abiotic environments (line 347-350)? In the paragraph above (line 338-342) the authors describe that female buds are better equipped against herbivores, which are a biotic factor?

      Following your concerns, we have revised the manuscript as follows: For line 338-342, we revised the text as “Indeed, functional enrichment analysis in chemical pathways such as terpenoid backbone and diterpenoid biosynthesis indicated that relative to male floral buds, female floral buds had more expressed genes that were equipped to defend against herbivorous insects and pathogens, except for growth and development (Vaughan et al., 2013; Ren et al., 2022) (Fig. S7A and Table S11).” For line 347-350, we revised text as “We also found that male-biased genes with high evolutionary rates in male buds were associated with functions to abiotic stresses and immune responses (Tables S12 and S13), which suggest that male floral buds through rapidly evolving genes are adapted to mountain climate and the environment in Southwest China compared to female floral buds through high gene expression.”

      4) Line 417-418: decreasing codon usage bias is linked to decreasing synonymous substitution rates, should this be the opposite?

      No. Codon usage bias was positively related to synonymous substitution rates. That is, stronger codon usage bias may be related to higher synonymous substitution rates (Parvathy et al., 2022).

      5) Figures and Tables are not standalone and are missing details in the legends. - Fig.2C, which genes are plotted on the heatmap and what is the color scale corresponding to?

      • All Supplementary figures are missing the descriptions of individual panels (A, B, C,etc.) in the legends. In addition, please add the numbers of observations under boxplots.

      • Supplementary Fig.5 and 6: Panel B is not a Venn diagram, I suggest removing it from the figures.

      • Supplementary Fig.7: Should be 'sex-biased genes'. What is the x-axis on the plot?

      • Supplementary Fig.8: Please add the description of the abbreviations in the legend. - Supplementary Tables S4, S5, S6: Please add information about the foreground and background branches.

      • Supplementary Table S6, S7, S8, S9, S10: Please add more details about the column headers (what is Model-A, background ω 2a, Unconstrained_1.p, K, which was the foreground branch etc.).

      • Supplementary Table S11: Please add gene IDs for each KEGG category.

      We have revised/fixed these issues following your concerns and suggetions.

      Minor comments:

      Line 28: 'algae' in place of 'algas'

      Line 53-56: Please provide more recent references.

      Line65: 'most' instead of 'almost'

      Line 86-87: It is not clear from the sentence if the sex-biased expression was detected in flowers compared to leaves, or were the sex-biased genes detected between male and female leaves? Please clarify.

      Line 107-108: positive selection is referred to as adaptive evolution, please choose one or the other.

      Line 109: 'force' instead of 'forces'

      Line 110: 'algae' instead of 'alga'

      Line 132: '..mainly distributed from Southwest,' the country is missing.

      Line 202: 'protein sequence evolution'?

      Line 232: what does the 'number of evolutionary rates' refers to?

      Line 253: please provide a reference for the RELAX model.

      Line 274: 'relaxed selective male-biased genes' should be 'male-biased genes under relaxed purifying selection'?

      Line 318: Please add a sentence explaining why the Cucurbitaceae family is a great model to study the evolution of sexual systems.

      Line 321: 'genes' instead of 'gene'.

      Line 366: male-biased genes experience 'higher' or 'more rapid' evolutionary rates. line 377: in the present study and in the case of Ectocarpus alga, positive selection plays an important role in male-biased genes evolution, but does not account for the majority of evolutionary change. Therefore, I would not call it a 'primary' force.

      Line 477: missing reference for DESeq2 package.

      Line 480: 'used'.

      Line 498: 'coding sequences'.

      Line516: 'to' instead of 'by'.

      Line 553: 'the' is repeated twice.

      Sorry for the typos and grammatical issues. We have revised them accordingly.

      Reviewer #2 (Recommendations For The Authors):

      There are two areas for improvement, one empirical and one theoretical.

      Empirically, the analyses could be expanded by an attempt to distinguish between genes on the autosomes and the sex chromosomes. Genotypic patterns can be used to provisionally assign transcripts to XY or XX-like behavior when all males are heterozygous and all females are homozygous (fixed X-Y SNPs) and when all females are heterozygous and males are homozygous (lost or silenced Y genes). Comparing such genes to autosomal genes with sex-biased expression would sharpen the results because there are different expectations for the efficacy of selection on sex chromosomes. See this paper (Hough et al. 2014; https://www.pnas.org/doi/abs/10.1073/pnas.1319227111), which should be cited and does in fact identify faster substitution rates in Y-linked genes (and note that pollenexpressed genes, at least, are concentrated on the sex chromosome in this system: https://academic.oup.com/evlett/article/2/4/368/6697528, https://royalsocietypublishing.org/doi/10.1098/rstb.2021.0226).

      We have cited Hough et al. 2014 and noticed that several species have been observed to exhibit rapid evolutionary rates of sequences on sex chromosomes compared to autosomes, which has been related to the evolutionary theories of fast-X or fast-Z (lines 482-484).

      On the theoretical side, this study is making a very specific intervention, namely identifying more rapid evolutionary rates in genes with male-biased than femalebiased expression in a dioecious plant. The writing in the introduction and the discussion needs to be improved to differentiate between this comparison and similar comparisons, e.g. sex-biased expression in other dioecious plants (76-81), between Xlinked and Y-linked genes (Hough et al. 2014), sex chromosomes and autosome (several studies already cited), gametophytic and sporophytic tissue, and male and female reproductive tissue in hermaphroditic plants. Setting out this distinction early in the introduction will make the specific goals and novelty of this work clearer.

      Thank you for your constructive suggestions. We have revised the relevant part of the Introduction accordingly (lines 74-107).

      Specific comments by line:

      Sorry for the typos or wording issues. We have revised them.

      26 - driven not driving

      28 - check house style (algae vs algas)

      28-29 - consider clarifying the antecedent of "them" (evolutionary forces, not algas) 35 - maybe, but don't the signalling genes involved in stress responses function in many capacities, not just stress? Also, there's evidence that reproductive recognition machinery in plants may ultimately derive from immune function (e.g. https://doi.org/10.1111/j.1469-8137.2008.02403.x), so the GO category "biotic stress" may be too vague

      39 - maybe clarify that "for the first time" refers to male rather than female, since there have been other studies in dioecious plants

      66-68 - asserting that something is "essential" after describing how rare it is doesn't quite follow, since diecious plants - especially with sex chromosomes - are basically an exception. I agree that understanding the evolution of dioecious plants is important, but this isn't the most compelling way to make that case - perhaps try something else.

      137ff - this sentence can be consolidated and streamlined

      142 - "floral tissue" rather than "flowers tissue," here and elsewhere

      144 - divergence (singular)

      235 - "evidence for the contributions of" = "evidences" is unidiomatic 250 - efficiency or efficacy?

      300 - why is "inositol" capitalized here and elsewhere?

      300ff - are these typical patterns in male tissue in other species?

      308 - is that interesting? It seems like exactly what I'd expect. Perhaps start with the unsurprising but reassuring observation (anther and pollen development genes are indeed expressed in male buds) before moving on to the more surprising findings.

      319 - remove "the"

      321 - genes (plural)

      330 - replace "these differences" with "the differences" 336 - perhaps recap proportions / percents here?

      340 - unnecessary comma after diterpenoid

      341 - this seems like a big leap from the evidence, especially in the absence of supporting information about the chemical defenses of these species and how they differ by sex. Don't terpenoids have a diverse array of functions, not just defense? Here's a review: https://link.springer.com/chapter/10.1007/10_2014_295

      We have revised the text as “Indeed, functional enrichment analysis in chemical pathways such as terpenoid backbone and diterpenoid biosynthesis indicated that relative to male floral buds, female floral buds had more expressed genes that were equipped to defend against herbivorous insects and pathogens, except for growth and development (Vaughan et al., 2013; Ren et al., 2022) (Fig. S7A and Table S11)” (lines 373-378).

      349 - as mentioned in line 35, this is a big speculative leap. The discussion is the place for speculation, but consider other explanations too. How does the development of flowers work? Are male flowers suppressing or resorbing female primordial organs? Do male flowers in fact senesce faster? perhaps spell out the logic in more detail.

      We have revised the text as “In addition, the enrichment in regulation of autophagy pathways could be associated with gamete development and the senescence of male floral buds (Table S14) (Liu and Bassham, 2012; Li et al., 2020; Zhou et al., 2021). In fact, it was observed that male flowers senesced faster (Wu et al., 2011). We also found that homologous genes of two male-biased genes in floral buds (Table S14) that control the raceme inflorescence development (Teo et al., 2014) were highly expressed compared to female floral buds. Taken together, these results indicate that expression changes in sex-biased genes, rather than sex-specific genes play different roles in sexual dimorphic traits in physiology and morphology (Dawson and Geber, 1999).” (lines 390-402).

      351 - senescence of, not senescence for

      363 - but Hough et al. 2014 did show rapid evolution of Y-linked genes, and those are by definition sex biased ...

      391 - perhaps reiterate here that while some sex-BIASED genes did, sex-SPECIFIC genes did not, to avoid confusion

      We also revised them accordingly.

      Reviewer #3 (Recommendations For The Authors):

      1- lines 56-57 : « have facilitated » : this wording confounds correlation with causation. Consider rephrasing as « is associated with »

      2- lines 58-60 : vague wording : what are these variations ? e.g. which tissues and stages are generally enriched?

      3- line 63 : this sentence is a bit misleading: consider changing it to « Most dioecious plants possess homomorphic sex-chromosomes » [and explain what homomorphic means in this context].

      4- line 68 : a reference is missing here. Also perhaps, allude to the fact that sexual selection in plants has long been considered a contentious issue (e.g. https://doi.org/10.1016/j.cub.2010.12.035)

      5- lines 72-76 : beyond simply describing the pattern, say what evolutionary processes are revealed by these observations.

      6- line 92 : remind the reader what these 5 studies are.

      7- line 94-95 : explain why the comparison of vegetative vs vegetative and vegetative vs reproductive tissues is a problem.

      The published studies only compared gene expression in vegetative versus vegetative tissues and vegetative versus reproductive tissues. Because it limited our understanding of sexual selection at different floral development stages. Revised accordingly (lines 103-104). We are very interested in flower development stage for sex-biased genes. The datasets could investigate sexual selection using two developmental stage (buds + mature flowers).

      8- line 100 « Evolutionary dynamic analyses » : this wording is vague

      9- line 110 : brown algae are NOT plants

      10- line 137-140 or in M&M : needs to describe somewhere how the male flowers differ from the female flowers and vice-versa: are the whole morphological structures related to female (male) reproduction entirely missing, or is their development arrested later on and they are still present but simply not producing gametes? This has consequences for the interpretation of the genes they express.

      We have revised the typos or wording issues accordingly. However, because the sampled floral buds were equal or less than 3 mm in size, we did not observe much morphological structural difference. Indeed, the male and female flowers at antheses were markedly different in this dioecious plant as shown in Fig. 1. Additionally, we found that dioecy is the ancestral state of Trichosanthes, and transitions to monoecy (Guo et al., 2020) based on our analysis (not shown in this study), which suggest that in the early stages of flower development, female floral buds may tend to masculinize, and vice versa (Fig. 2C).

      11- line 152 : it is important to be very transparent on the sample sizes here: « from three females and three males of the dioecious ... »

      12- line 153 : along the same line, explain here why a de novo transcriptome had to be generated here: « In the absence of an assembled reference genome for this nonmodel species, we de novo assembled ... »

      13- line 164-165 : « we have generated high-quality reference trancriptomes » : I am not entirely convinced of the quality of the transcriptome obtained without a reference genome, so I suggest simply removing this subjective sentence.

      Our assessment suggested that we have generated high-quality reference transcriptomes in the absence of a reference genome, which will be the next step of our work.

      14- line 169 : briefly explain the criteria used to call differentially expressed genes. Given the threshold (log-fold change >=1.3 if I read the figure correctly, but the M&M says >=1), explain how it was chosen.

      Sorry, you may have misunderstood the X, Y coordinates. The value of y coordinate represents -log10(FDR), and the value of x coordinate represents log2 (Fold Change).

      15- line 174 : Not clear to me how Fig2C is « revealing strong sexual dimorphism », since genes cluster neither by sex nor by tissue. This should be explained more clearly.

      16- line 174-177 : The fact that more ex-biased genes were identified in early buds than in mature flowers is an interesting observation that could be given more prominence in the manuscript, but it is not really explained. Could it reflect the fact that more genes are expressed in early buds because meiotic processes happen early in flower development? Also, the genes involved in male and female organ cell fate determination might also be expected to be expressed early, with mostly organ growth genes being expressed in the mature flower.

      17- line 181 : a wrap-up sentence might be useful here to drive the point home that sex-bias is more prevalent in buds than mature flowers.

      18- line 184 : « tissue-biased » : a more appropriate wording here would be « stagebiased », no ? These are indeed the same tissues but at different developmental stages.

      19- line 183-195 : this section could benefit from setting clear expectations in a hypothesis testing framework laying out the reasons to expect a different bias between stages and between sexes. How does that fit with the level of morphological divergence between sexes (relates to my point 10 above).

      20- line 197-204. A number of essential pieces of information are missing here: how many species, how divergent, say that one other is dioecious, and precise their relative phylogenetic placement (which is important to understand the models used below). Maybe adding a phylogeny of these species in Figure 4 could be useful. Also, briefly explain the « two-ratio » and « free-ratio » models here.

      21- line 196 and following: In these analyses, I could not understand the rationale for keeping buds vs mature flowers as separate analyses throughout. Why not combine both and use the full set of genes showing sex-bias in any tissue? This would increase the power and make the presentation of the results a lot more straightforward.

      As you pointed earlier (in the public review, paragraphy 2), “the dataset is interesting in that it focuses on reproductive rather than somatic tissues (which makes sense to investigate sexual selection), and includes more than a single developmental stage (buds + mature flowers)”, we totally agree with your points and were very interested in floral development stages for sex-biased genes.

      22- line 216 : say explicitly that the reason for not detecting a significant difference in spite of a relatively large effect size is probably related to the low number of genes, conferring low statistical power to detect a difference. An important feature also not highlighted here is that the trend (though not significant) is in the opposite direction than in the buds, and that both the 2-ratio and the free-ratio models agree on these inverted trends. This could be the basis for an interesting comparison.

      Thank you for your suggestions.

      23- line 220 : needs to explain more clearly how this « free-ratio » differs from the « two-ratio » model.

      24- line 232-234 : I don't see why this is necessary. Why not combine both? See also my comment 21 above.

      25- line 237 : the «A-model » was not defined before.

      26- line 237 : « male-biased » is missing after 343.

      27- line 253-258 : briefly explain what these other models are based on and how they are not redundant and instead complement the previous analyses and each other. 28- line 266-268 : the use of a more precise set of codons for male-biased genes than the others (if I understood correctly) could also be interpreted as another sign of stronger selective constraint, no?

      Codon usage bias is influenced by many factors, such as levels of gene expression. Highly expressed genes have a stronger codon usage bias and could be encoded by optimal codons for more efficient translation (Frumkin et al., 2018; Parvathy et al., 2022).

      29- line 269-291 : removing genes on a post-hoc basis seems statistically suspicious to me. I don't think your analysis has enough power to hand-pick specific categories of genes, and it is not clear what this brings here. I suggest simply removing these analyses and paragraphs.

      30- line 325 : say whether this patterns parallels / or not those in animals.

      31- line 335 : yes, these biological pieces of information are important and should be given in the introduction already.

      32- the discussion should focus at some point on the observation that more femalebiased genes are found in general, but that male-biased genes seem to be under greater selection. How do you reconcile these two apparently contradictory observations?

      We found that male-biased genes with high evolutionary rates in male floral buds were associated with functions to abiotic stresses and immune responses (Tables S12 and S13), which suggests that male floral buds through rapidly evolving genes are adapted to mountain climate and the environment in Southwest China compared to female floral buds through high gene expression (lines 387-390).

      33- line 355 : not clear how this follows from the previous sentences.

      34- line 356-358 : vagiue. not clear what the message of this sentence is.

      35- line 378-383 : say that these conclusions rely on the quality of gene annotation in this non-model species, which is probably pretty low (just like any other non-model species).

      36- line 403 : this conclusion seems far-fetched. Explain how exactly you reached this conclusion.

      37- line 406-416: these speculations on the role of paralogs seem unnecessary, in particular since the de novo transcriptome onto which all analyses are based cannot distinguish orthologs from paralogs.

      38- line 417-424. The discussion should not contain new results.

      39- line 510 : why were genes with dN/dS >2 discarded here? This might strongly bias the comparison, no? This needs to be properly justified.

      40- lines 516-523 : references to the models are missing.

      41- line 527: « omega = 1.5 » : why/how was this arbitrary threshold chosen?

      42- Fig 2 : write out « buds » and « mature flowers » on top of the graphs

      43- Fig 4 : add a phylogeny of the species showing the branch being compared. Also, add the number of genes in each category on each plot.

      Thanks, we revised/fixed these issues accordingly.

    1. Author Response

      The following is the authors’ response to the original reviews.

      We thank the reviewers and editors for their thoughtful assessment and critiques. As detailed below in the point-by-point replies, we have modified the text and figures to clarify points of ambiguity and to document statistical significance in places where we had inadvertently neglected to do so. The manuscript is clearer and more rigorous as a result of the review process.

      Reviewer #1 (Public Review):

      This study addresses the fundamental question of how the nucleotide, associated with the beta-subunit of the tubulin dimer, dictates the tubulin-tubulin interaction strength in the microtubule polymer. This problem has been a topic of debate in the field for over a decade, and it is essential for understanding microtubule dynamics.

      McCormick and colleagues focus their attention on two hypotheses, which they call the "self-acting" model and the "interface-acting" model. Both models have been previously discussed in the literature and they are related to the specific way, in which the GTP hydrolysis in the beta-tubulin subunit exerts an effect on the microtubule lattice. The authors argue that the two considered models can be discriminated based on a quantitative analysis of the sensitivity of the growth rates at the plus- and minus-ends of microtubules to the concentration of GDP-tubulins in mixed nucleotide (GDP/GMPCPP) experiments. By combing computational simulations and in vitro observations, they conclude that the tubulin-tubulin interaction strength is determined by the interfacial nucleotide.

      The major strength of the paper is a systematic and thorough consideration of GDP as a modulator of microtubule dynamics, which brings novel insights about the structure of the stabilizing cap on the growing microtubule end.

      I think that the study is interesting and valuable for the field, but it could be improved by addressing the following critical points and suggestions. They concern (1) the statistical significance of the main experimental finding about the distinct sensitivity of the plus- and minus-ends of microtubules to the GTP-tubulin concentration in solution, and (2) the validity of the formulation of the "self-acting" model with an emphasis solely on the longitudinal bonds.

      We thank the reviewer for the comment about statistical significance, and we regret our oversight to have not included that analysis in the original manuscript. We have now included an analysis of statistical significance for the main experimental results supporting the interface-acting model (Fig. 2C and the replotting of those data against a different abscissa in Fig. 3C,D), and more broadly we have ensured that all figure legends contain information about the number of measurements and whether error bars indicate SD or SEM.

      The reviewers comment about the sole emphasis on longitudinal bonds helped us realize that a change to Fig. 1 (where we illustrate the two models) would improve clarity. We had originally chosen to illustrate Figure 1 using ‘pure’ longitudinal interactions (with no lateral contacts), and this may be what triggered the reviewer’s comment. We have now revised the figure to show ‘corner’ (longitudinal + lateral) interactions. There are two main reasons for this decision. First, the corner interactions are more long-lived and therefore more important for the phenomena under study. Second, because illustrating corner interactions provides a better basis for us to discuss what is a subtle aspect of our model – that the ‘GDP penalty’ affecting longitudinal or lateral interactions in a corner site is completely equivalent. Thus, our model is not quite as narrow/exclusive as the reviewer suggested. We appreciate having had the chance to clarify this.

      Reviewer #2 (Public Review):

      McCormick, Cleary et al., explore the question of how the nucleotide state of the tubulin heterodimer affects the interaction between adjacent tubulins.

      (1) The setup of the authors' model, which attributes the dynamic properties of the growing microtubule only to the differences in interface binding affinities, is unrealistic. They excluded the influence of the nucleotide-dependent global conformational changes even in the 'Self-Acting Nucleodide' model (Fig. 1A). As the authors have found earlier, tubulin in its unassembled state may be curved irrespective of the species of the bound nucleotide (Rice et al., 2008, doi: 10.1073/pnas.0801155105), but at the growing end of microtubules, the situation could be different. Considering the recently published papers from other laboratories, it may be more appropriate to include the nucleotide-dependent change in the tubulin conformation in the Self-Acting Nucleotide model.

      We understand the reviewer’s perspective, which may be summarized as: “We know conformational changes are happening and that they affect tubulin:tubulin interactions, so why isn’t your model trying to account for that?” In text added to the revised manuscript, we address this critique in the following ways. First, there is not a consensus in the field about how to parameterize the different conformations of tubulin and how they influence tubulin:tubulin interactions. Second, any attempt to explicitly account for different conformations of tubulin would substantially increase the number of adjustable model parameters, which in turn makes the fitting to growth rates more complicated. Third, compared to traditional ‘dynamics’ assays that use GTP, using mixtures of GMPCPP and GDP simplifies the biochemistry by eliminating GTPase. This results in a more uniform composition of nucleotide state in the body of the microtubule polymer, which diminishes the importance of explicitly modeling nucleotide-influenced changes in conformation. Fourth, it seems likely that different conformations of tubulin will modulate both longitudinal interactions (as tubulin becomes straighter the longitudinal contact area grows larger) and lateral interactions (as tubulin becomes straighter, the lateral contact areas on α- and β-tubulin come into better alignment). Our model treats longitudinal and corner (defined as longitudinal + lateral) interactions as independent, so in principle it could be implicitly capturing some of these conformational effects. By refining the strengths of the longitudinal and corner interactions independently, the model effectively allows the strength of longitudinal contacts to be different for pure longitudinal and corner interactions, which might implicitly capture some variations in longitudinal contacts for different tubulin conformations. Our model treats ‘bucket’-type sites (one longitudinal and two lateral interactions) as simply having an additional lateral interaction of equal strength as the first, but because bucket sites have such a high affinity, they rarely dissociate and this small oversimplification is unlikely to have a substantial effect. We have introduced text in several places (bottom of p. 7 and elsewhere) to cover these points.

      (2) The result that the minus end is insensitive to GDP (Fig. 2) was previously published in a paper by Tanaka-Takiguchi et al. (doi: 10.1006/jmbi.1998.1877). The exact experimental condition was different from the one used in Fig. 2, but the essential point of the finding is the same. The authors should cite the preceding work, and discuss the similarities and differences, as compared to their own results.

      Thank you for reminding us of this paper! We agree that it is an ‘on target’ citation, and have cited and discussed it in the revised manuscript (last paragraph of Introduction, third paragraph of Discussion).

      Reviewer #1 (Recommendations For The Authors):

      1) In my opinion, the way in which the authors have depicted their "self-acting" model in Fig. 1 and in Supplementary Figure 1, makes the model look intuitively implausible. The drawings seem to imply that at the plus-end the GTP hydrolysis in the beta-tubulin subunit somehow allosterically affects the alpha-tubulin subunit of the same dimer to weaken its longitudinal bond with adjacent tubulin dimer. Conversely, at the minus end, the same reaction now affects the very same beta-tubulin subunit, and modulates its longitudinal interaction with the next dimer.

      However, a more realistic formulation of the "self-acting" model would be that the exchangeable nucleotide affects the lateral bonds, formed by the same beta-tubulin with its lateral neighbors. Although the experimental data in this regard are controversial, at least some supporting evidence for this idea comes from structural arguments, e.g. [Manka, S.W., Moores, C.A. Nat Struct Mol Biol 25, 607-615 (2018).] This "lateral selfacting", but not the "longitudinal self-acting" hypothesis, seems more natural, and it was the one previously implemented in the seminal paper by [Vanburen et al, 2002 Proceedings of the National Academy of Sciences 99.9 (2002): 6035-6040.] and later by other some other models as well.

      This point has been addressed above, in part by modifying the cartoon in Fig. 1.

      2) To better clarify, which exact models are considered in this manuscript, it would be helpful if the authors provided a detailed table with all simulation parameters, including, k_off_loner, k_off_bucket and k_off_corner, for both nucleotide states, in both the selfacting and the interface-acting models.

      Thank you for the suggestion. We have added tables that show all simulation parameters, as well as the corresponding calculated on- and off-rates for each interaction.

      3) I am not sure that using some 'arbitrarily chosen' parameters is very helpful in Chapter 1 of Results. In fact, the results, obtained with an unconstrained set of parameters may be misleading or provide ambiguous answers. In other words, how reliable are the conclusions, based on the arbitrary parameter set? For example, could the dependences of the microtubule growth rate on the GDP-tubulin content be more or less pronounced with a different set of arbitrarily chosen parameters, compared to the graphs in Fig. 1BC?

      This is a fair criticism. In response, we have added three new sets of simulations that each test different choices of the biochemical parameters used in Figure 1. With respect to the original parameters, we tested a weaker and stronger choice for the longitudinal interaction (KDlong, a 100-fold range), the corner interaction (KDcorner, a 25-fold range), and the GDP weakening factor (a 100-fold range). The predicted supersensitivity of plus-end growth rates to GDP in the self-acting vs interface-acting mechanisms is robust across the range of different choices for the above parameters (Figure 1 Supplements 1 and 2). Parameters for these new simulations are shown in Tables 3 and 4.

      4) It took me some time to comprehend why the minus-end growth rate is assumed to be dependent only on the concentration of the GMPCPP-tubulin (in section 2 of Results). It would be great if the authors simply plotted the simulated dependence of the growth rate on the GMPCPP-tubulin concentration in the case when no GDP-tubulin was added. As I understand, that curve should almost exactly match the dependence observed in Fig 1B, correct? Otherwise, it does not seem obvious, why GDP-tubulin does not impede the minus-end growth. Again, is this conclusion model- and parameterdependent? This question is related to point 3 above.

      The minus-end growth rates decrease in proportion to the concentration of GMPCPPtubulin. We have added a note on minus-end growth rates in the Figure 1 legend.

      5) I was not quite convinced by the evidence for distinct sensitivities of the plus- and minus-end growth rates to GDP-tubulin concentration (Figure 2C and Fig 3C, D). These are the key experimental measurements in the paper. Therefore, I suggest that the authors try to strengthen this point by additional measurements to increase statistics. Or at least, please, explain the data points, the error bars, and provide some information on the number of independent measurements and the statistical significance between the curves. Maybe, they could be directly compared after normalizing by the "all GMPCPP growth rate"? How was the "1.5-fold" ratio obtained in Fig 2C? Does that number refer only to a certain GDP-tubulin concentration or does that value somehow characterize the whole range of the concentrations measured?

      This has been addressed above.

      Reviewer #2 (Recommendations For The Authors):

      These look identical to above and were addressed there.

      (1) The setup of the authors' model, which attributes the dynamic properties of the growing microtubule only to the differences in interface binding affinities, is unrealistic. They excluded the influence of the nucleotide-dependent global conformational changes even in the 'Self-Acting Nucleodide' model (Fig. 1A). As the authors have found earlier, tubulin in its unassembled state may be curved irrespective of the species of the bound nucleotide (Rice et al., 2008, doi: 10.1073/pnas.0801155105), but at the growing end of microtubules, the situation could be different. Considering the recently published papers from other laboratories, it may be more appropriate to include the nucleotide-dependent change in the tubulin conformation in the Self-Acting Nucleotide model.

      (2) The result that the minus end is insensitive to GDP (Fig. 2) was previously published in a paper by Tanaka-Takiguchi et al. (doi: 10.1006/jmbi.1998.1877). The exact experimental condition was different from the one used in Fig. 2, but the essential point of the finding is the same. The authors should cite the preceding work, and discuss the similarities and differences, as compared to their own results.

    1. Author Response

      The following is the authors’ response to the original reviews.

      Response to Public Reviews

      Reviewer #1:

      We thank this reviewer for their comments on our paper. We have adjusted the methods secon to ensure it is clear, including an updated descripon of the stascs and in some cases updated stascal methods to ensure uniformity in analyses across datasets. The discussion has been modified so that the message regarding our results is set appropriately in the literature.

      Reviewer #2:

      We are grateful to this reviewer for their insight. We have modified the text of the discussion to address the points of this reviewer, including providing a greater focus on the significance of our results without overgeneralizing. We have addionally reframed our argument regarding the detecon of pescides by Bombus terrestris to more carefully consider conflicng results from other papers.

      Response to Recommendaons For The Authors

      Response to Reviewer #1

      We thank this reviewer for their thoughul comments and ideas. We have made several changes to the text of the manuscript to improve the clarity of our wring, and we are grateful to the reviewer for raising several important points that we had not sufficiently discussed in the paper previously. We feel the paper has been improved with the inclusion of a more thorough discussion and clarified methods. Please see below our responses to the points they raised.

      A few general thoughts that I had when reading your manuscript: I assume you have only tested the acve pescide ingredients, but not the formula generally applied in the field. Given that these formulas contain addional compounds but the acve ingredients, might it not be possible that they could be perceived by bees?

      For this study, we were interested specifically with the taste of acve pescide compounds, although we agree it could be interesng to explore the taste of other formula compounds, it was not within the scope of this paper to test these.

      Is there an alternave to quinine as a negave control? As you state, quinine is generally used in studies and likely oen in concentraons which are beyond what can be seen in e.g. floral nectar, which might explain its aversive effect. I would like to see it tested in natural concentraons and ideally in combinaon with other potenally toxic plant secondary metabolites (PSMs).

      The purpose of including quinine in our study was to provide an in-depth characterizaon of “biter” taste responses using the sensilla on bumblebee labial palps and galea (i.e., through the atenuaon of GRN firing). This was not to show how bumblebees may interact with plants containing quinine in the field, or other PSMs. It would indeed be interesng to explore other plant secondary metabolites, however this was beyond the scope of our paper.

      L177-187 AND 233-238 Could you, please, provide a photo or schemac drawing to illustrate your assay? I have a very hard me picturing the actual set-up.

      We have provided a labeled diagram of the bumblebee mouthparts and sensillum types (Fig 1A), as well as an image of the bumblebee feeding from a capillary in the behavioural assay (Fig 1G). Further details about the feeding assay (including a JoVe video) can be found with the Ma 2016 paper that we cite throughout our methods secon.

      L219 Why did you choose 5 sec here?

      This feeding bout duraon was selected based on the criteria defined in Ma et al 2016. We have added a citaon to that sentence.

      L221-224 How precisely was the behavior scored? Just length of bouts or also repeated short contacts? Please, specify.

      We used the first bout duraon and the cumulave bout duraon in our analyses. A sentence has been added to specify this.

      L231/233 Please, provide some brief details here, as many readers may find it annoying to find and read another study for methods' details.

      We have added three sentences in the methods to further explain the electrophysiological method.

      L238-245 See also my general methods comment: concentraons used for pescides and quinine differ quite substanally, which may explain their different effects on the bees' percepon. Are the concentraons used for quinine realisc? If not that is totally fine for a negave control, but it would be interesng to see a comparison of effects conducted for similar concentraons.

      The concentraons used of quinine were selected so that they would elicit a known “biter response” – these concentraons are not meant to be field-realisc, and our data (and others, e.g., Tiedeken et al 2014) show that lower concentraons of quinine are not detected by bumblebees.

      L277-301 I assume that this is a standard stascal approach to analyze electrophysiological data. However, I am really struggling with fully understanding what you did here. It might be good to add some addional explanaon/detail, e.g. on why you constructed firing rate histograms or how you derived slopes (aren't smulus and bin categorical variables?).

      Firing rate histograms are indeed very commonly used for visualizing neuron spikes over me. We have changed the text somewhat in an effort to make it more clear. Likewise, the “slopes” were derived from the LMEs, and in this case “bin” is a connuous me variable – any me variable will involve some binning depending on the resoluon used but should not be considered categorical.

      L291-295 As you were averaging and normalizing your data, could you, please, provide some informaon on variaon within animals?

      We have now included informaon on the coefficient of variaon for spike rates across sensilla for a given animal/smulus (CV range, median, and IQR).

      L295 I assume t-SNE represent a mulvariate approach for ordinaon, correct? Can you explain why you chose to use this approach? Did you use Euclidean Distance?

      Yes, t-SNE is a mulvariate technique for dimensionality reducon. It is parcularly well-suited for the visualizaon of high-dimensional datasets, as it can reveal the underlying structure of the data by embedding it in a lower-dimensional space (e.g., 2D) while preserving the local structure of the data as much as possible. We used t-SNE because it has been shown to be effecve in visualizing clusters of similar data points in high-dimensional data. Euclidean distance was used as the distance metric for the t-SNE embedding. Euclidean distance is the default distance metric for most implementaons of t-SNE and is appropriate for connuous data like the spike counts in this study. We have adjusted the methods to clarify this.

      L304 Why did you not always use LMEs?

      We have adjusted the text to show that we used LME for all comparisons, and the stascs have been updated accordingly in the results secon. None of the outcomes changed with the implementaon of LME for all tests.

      L306 Would it not make sense to also include the interacon between smulus and concentraon in your models?

      We have now included a sentence to explain that the interacon term was removed due to it being nonsignificant, and the models without the interacon term having beter model fit (determined by having lower AIC and BIC values).

      Results:<br /> L337, 339 and more: I would prefer to see actual p-values, not just "p > 0.05".

      This has been adjusted on L337 and 339. As far as we are aware, there are no other instances where exact p-values were not given (except when p < 0.0001).

      Discussion:<br /> L470 This is true, but the bees' behavior changed significantly, indicang that they may respond to this small change in firing paterns already?

      It is true that the bees’ behaviour changed significantly with 0.1mM QUI, but this was not the case with the pescides. Bees drank less overall of 0.1mM QUI than OSR because of the rapid posngesve effects of this compound. It’s important that the duraon of the first bout was not affected (i.e., they didn’t directly avoid it by taste upon first encountering it, as they do with 1mM QUI), but just that they drank less of the 0.1mM QUI over 2 minutes. Post-ingesve effects may occur as quickly as 30s aer inial consumpon. For the pescides, the small changes in GRN firing were not associated with any effects on consumpon or our other measures of feeding behaviour, and we suggest this results from a lack of rapid negave posngesve consequences. We now include further discussion of these important points.

      L481 But they consumed significantly less of the 0.1 mM QUI!?

      This is true, but they did not reject it (i.e., not drink it at all), and there were no changes in the amount of me the bees spent in contact with the 0.1mM QUI soluon compared to OSR. We have adjusted the text for clarificaon.

      L504/505 AND 520/521 AND 533-536 I see your point, but I am wondering whether the bees may need some me but are generally able to learn the taste of pescides, which may explain why e.g. Arce et al. only saw an effect over me. For example, learning to 'focus' on the pescide taste may require some internal feedback (bees not feeling well) or larvae feedback. If I understood right, you tested workers only, which might be less sensive than queens or larvae. I think these aspects should be discussed.

      In our study, we invesgated the mechanism of taste detecon of pescides. We agree that bees likely use posngesve mechanisms to learn to associate the locaon (or another cue) of a food source with posive or negave posngesve cues. ‘Focus’ is a higher-order process that involves increased atenon to sensory smuli but does not affect sensaon at the level of the receptor. We show that bees are unable to taste pescides using the gustatory receptors on their mouthparts, so post-ingesve learning would not be able to associate the pescides with any taste cue. Indeed, there may be caste-specific differences with foraging queens, however a discussion of this would be beyond the scope of our paper.

      I also recommend broadening the scope of your discussion. For example, you only focus on nectar, while the story might be different for pollen, which is also contaminated with pescides but represents a different chemical matrix with potenally different taste properes. Also, unlike nectar, pollen is collected with tarsae and hence on contact with other bee body parts.<br /> I would also like to see a discussion of your study's implicaons for other bee species and other potenally toxic compounds (e.g. PSMs).

      We do not include any data in this paper regarding tarsal or antennal taste or other potenally toxic compounds. In this paper we present one mechanism of biter taste percepon (i.e., of quinine) and specifically show that the buff-tailed bumblebee is unable to taste certain pescides using their mouthparts. To avoid overgeneralizing, we have not included discussions about other species or compounds, which may or may not share similaries with our study.

      Response to Reviewer #2

      We thank this reviewer for their comments. We have adjusted the text to avoid overgeneralizaons with our conclusions, and atempted to soen language in the discussion that may have been construed as combave towards the Arce et al (2018) paper. We hope this reviewer finds these adjustments to be in line with their expectaons.

      1) In two parts of the manuscript, the authors made broad predicons and conclusions beyond what the evidence in the paper can support and wrote "Future studies will be necessary to confirm this." (Lines 508-509) and " Future studies that survey a greater variety of compounds will be necessary to confirm this." (563-564). Instead of making conclusions based on what experimental data in future studies may support, I would ask the authors instead to make conclusions that their current study can support based on experimental evidence in this paper.

      We have removed these predicons that extend beyond the scope of the paper.

      2) Line 315 "GRNs encode differences in sugar soluon composion". The logic of the tle is wrong.

      This has been fixed.

      3) Since this study is only performed in one bumblebee species, then I would suggest that the tle be more specific e.g., "Mouthparts of the bumblebee Bombus terrestris exhibit poor acuity for the detecon of pescides in nectar".

      We have made this change.

    1. Author Response

      The following is the authors’ response to the original reviews.

      We thank the reviewers for recognizing the importance of our work and for their insightful suggestions. A point-by-point response to their comments is listed underneath each reviewer’s section.

      Reviewer #1 (Recommendations For The Authors):

      Major comments

      1) Have the authors optimized the expression level of dCas9? I cannot find this information in this paper or in their 2021 paper. It is important to avoid the toxicity phenomenon that occurs when using guide RNAs that share specific five base seed sequences (referred to as 'bad seeds').

      Cui L., Vigouroux A., Rousset F., Varet H., Khanna V., Bikard D. A CRISPRi screen in E. coli reveals sequence-specific toxicity of dCas9. Nat. Commun. 2018; 9:1912.

      Rostain W., Grebert T., Vyhovskyi D., Thiel Pizarro P., Tshinsele-Van Bellingen G., Cui1 L., Bikard D. Cas9 off-target binding to the promoter of bacterial genes leads to silencing and toxicity. Nucleic Acids Research, 2023, gkad170.

      2) One guide per gene is highly unusual given that different guides block the RNA polymerase with different efficiency. This was even shown by the Machner lab in the Legionella context in Figure 1c of Ellis et al. 2021 for sidM and vipD. Typically, genes need three guides minimum to ensure that the gene of interest is knocked down fully unless it is not possible as the gene is too small and/or it is difficult to find an NGG sequence. The authors have used one guide per effector, how can they be sure that each gene is knocked down? The Machner lab themselves in Figure 3c of Ellis et al. 2021 shows not all genes targeted using multiplex CRISPRi are equally efficiently knocked down. Please justify why only one guide per gene was chosen and add controls to validate the results. The authors themselves state that the strategy of one guide may be problematic. Lines 315-316 it reads... A possible explanation was the incomplete knockdown of a seemingly important process.

      3) Given what the Machner lab observed about spacer location in Ellis et al. 2021 would it not make more sense to take one set of redundant effectors and make multiplex randomized CRISPRi with them in different locations? For Figure 1 at least.

      4) Following infection, it seems that the bacteria were not plated onto antibiotic media, so it is not known how well the plasmid harboring guides is kept through infection.

      Specific comments

      A) The first results paragraph describes the set-up of 10-plex synthesized CRISPR arrays, where 10 effector encoding genes of specific gene families are selected. The rationale of the choice of these genes is not given. Please explain.

      B) Please also add some biological data on what these genes code for, and what is their known or predicted function. It is not very informative and exciting to have tables of lpg numbers without any knowledge of what these genes code for and why they were selected, at least some.

      C) Figure 1 A Why are only some of the MC arrays shown? Please, at least include in supplementary the others. Again one array in detail would be more informative, showing true knockdown of all genes by qPCR and ideally by western blot.

      D) I am not convinced that the gene silencing efficiency qPCR comparison is done in the correct way. In my opinion, each of the genes to be knocked down should be tested against the expression of a control gene e.g. rpoS and then these results should be compared and not the results of empty plasmid or CRISPR array containing plasmid directly. L. pneumophila are very sensitive to growth conditions and inoculum, thus the two strains might not be completely at the same growth stage when being compared which can impact the results.

      E) Figure 1 B As stated in general comment number 4, the authors do not appear to plate onto antibiotic so we don't know how well the plasmid harboring the guides is kept through infection. The sustained presence of the guide is particularly important for CRISPRi.

      F) The authors found only a few growth phenotypes and mainly this was due to single genes and not combinations of genes. This might again be due to the fact that only one guide per gene was used. How do the authors know that all genes targeted were indeed knocked down?

      G) Line 119 Alternatively, the genes were not 100% all knocked down, escaping the knockdown effect expected. Could authors take three genes with three guides each and look at impact instead of only one?

      H) The authors then develop the randomized multiplexed arrays and chose to test 44 TME encoding genes. Line 141 Justify why these effectors were chosen in the text.

      I) Unfortunately, the method is not clearly described, and many parts are complicated and the text needs to be re-read several times to be understood (lines 150 - 166). Please re-write to better explain to the reader. In line 156 the authors point to a supplementary note 1. This information should be in the main text.

      J) What is the copy number of the CRISPR plasmid? Please add in the Material and Method section also the origin of this plasmid.

      Figure 2

      K) In the paper (line 154-160) and the extra notes, it states that authors attempt to size select CRISPR arrays. However, this is not apparent in Figure 2 schematic. Or are the authors stating that plasmids only containing one guide were selected out? However, line 312 would suggest not. Please clarify

      L) A limiting factor in making multiplex guide CRISPR, as the authors are trying to establish in this study, is cloning of multiple guides. In the pre-determined CRISPR arrays in this study, the guides were synthesized. For the randomized multiplex CRISPR in this study, the authors adapt a Golden Gate cloning method to generate multiple sgRNAs in the Cas9 vector. A similar protocol was established in the below paper. Please add this reference.

      Zuckermann, M.; Hlevnjak, M.; Yazdanparast, H.; Zapatka, M.; Jones, D.T.W.; Lichter, P.; Gronych, J. A novel cloning strategy for one-step assembly of multiplex CRISPR vectors. Sci. Rep. 2018

      M) As the authors note, Zuckermann et al. similarly note that plex of 3 or 4 is most common and above 5 is rare. This thus appears to still be the limiting step of multiplex CRISPR technology. Please discuss

      Figure 4

      N) The idea of multiplexed CRISPRi seq to address the biological phenomenon of redundancy is an interesting one, however, I am missing the in-depth functional characterization and discussion of at least one of the redundant functions discovered. Please add.

      Figure5/6

      O) As noted above, the strength of the experiments is undermined by how CRISPRi is set up. Having an average multiplex of 2 or three and again only using one guide per gene weakens the study and the results obtained. Furthermore, as stated in general comment number 4, the authors do not appear to plate onto antibiotic so again, we don't know how well the plasmid harboring the guides is kept through infection. The sustained presence of the guide is particularly important for CRISPRi. Please add a validation that the guides are all present.

      Response to Reviewer #1

      We are grateful to the reviewers for their insightful comments and suggestions on how to further improve the manuscript.

      Regarding the issue of ‘bad seed sequences’ (comment #1), we had previously evaluated the expression level of dcas9 (plotted in Figure 1b of the 2021 Communications Biol paper) and tuned our induction conditions accordingly (40 ng/mL as described in the Methods). Since all strains used in this study express dcas9 from the chromosome, not a plasmid, this eliminates the possibility of fluctuations in expression levels due to variabilities in plasmid copy numbers.

      In the rare event that toxicity by any given guide occurs, we would expect that guide to already be underrepresented or missing in the input pool following 24+ hours of CRISPRi induction during axenic growth. Our data, now discussed in the manuscript (Lines 211-216 and Figure S2), revealed that this was not the case and that all guide-encoding spacers were present in roughly equal amounts (median of >5000 occurrences). As with any knockdown study, the creation of true chromosome deletions was performed throughout as to alleviate the issue of false positives.

      Regarding comments #2, #3, and specific comments made under point F, G, and O, on the topic of using single vs. multiple guides, we agree that there are circumstances under which using more than one guide per target may be advantageous, for example when attempting to delete a gene from mammalian cells using conventional CRISPR engineering. In the study described here, this is not the case. In fact, we did create a second array library with alternative guides targeting the same group of genes at locations other than the “optimal location” identified in our 2021 paper and found that these “sub-optimal” guides were inefficient for identifying critical effectors as described in Supplemental Note S1 under the heading “Sub-optimal annealing sites” (Lines 919+). These data suggest that adding sub-optimal guides to the arrays of optimal guides might ‘poison’ the arrays and limit rather than enhance their ability to identify gene combinations.

      Regarding comment #2, #3, and specific comments made under point C, F, and G, on the topic of confirming efficient gene knockdown for the identification of critical genes, we remind Reviewer 1 that we did confirm knockdown of 60 of the target genes of the 10-plex screen to be at least 2-fold, with an average fold repression of one order of magnitude or more (Figure 1A). While knockdown of every gene in every 10-plex construct would be an unprecedented ask of any published CRISPR screen, we believe that these 60 genes provide a large enough sampling of all guides to elucidate the range of knockdown to be expected by our CRISPRi platform. As with other knockdown technologies, such as RNAi, there is no expectation of accomplishing complete knockdown for any given target. Hence, the data in Figure 1A suggest that the lack of identifying critical genes using pre-determined 10-plex arrays was not due to a lack of knockdown efficiency, but rather the difficulty to accurately predict redundancy within a cohort of uncharacterized genes, accentuating the need for array randomization with MuRCiS.

      On the topic of antibiotic use for plasmid selection (comments #4, E and O), we would like to clarify that the CRISPR plasmids were selected by thymidine prototrophy, not antibiotic resistance, and we apologize for not making this clearer. The laboratory strain Lp02 is a thymidine auxotroph (thyA-) L. pneumophila variant, and plasmid retention is routinely achieved by including the thymidine biosynthesis gene (thyA) on the plasmid backbone. Only with a plasmid bearing the thyA gene can L. pneumophila grow on CYE (thymidine-) plates. Our use of vectors bearing thyA and plating on CYE plates is described in the Methods section. Further, in Figure 7 of our 2021 paper, we show that CRISPR plasmids are efficiently retained by Lp02 for the duration of a 48-hour infection, resulting in efficient multi-gene knockdown even at the end of the intracellular growth experiment.

      Regarding comments A and B, on publishing the biological data used to classify genes in gene families for 10-plex silencing, we do not consider it critical to provide additional information beyond the broad classification (e.g. kinases, phosphatases, etc) described in Table S1. Structural predictions constantly change due to continuously evolving databases. Our initial analyses were made in 2015 using HHPRED Hidden-Markov models and, in all likelihood, those predictions have been refined since then. Moreover, with the recent advent of Alphafold, anyone interested in learning more about select effectors from our list is advised to simply access the most recent functional predictions directly on the Alphafold webpage (https://alphafold.ebi.ac.uk/). We clarify how predictions were made on Lines 97-101.

      Regarding specific comment D, on our method for qPCR normalization and comparison, we point Reviewer 1 to the Methods section (Lines 460+) where we describe that data obtained from each CRISPRi strain were in fact normalized to the levels of rpsL prior to comparing them to the normalized data from the strain with the empty control plasmid. This normalization to rpsL, a gene encoding a ribosomal protein, also corrects for growth differences between samples.

      Regarding specific comment H, the justification for studying 44 transmembrane effector-encoding genes was driven by the fact that activities mediated by transmembrane proteins are difficult (though not impossible) to be replaced by cytosolic proteins, for example the transport of metabolites across the LCV membrane. And since transmembrane regions can be predicted with high confidence, we decided to probe this group of TMEs for synthetic lethality with the randomized CRISPRi approach as proof-of-concept. To make this clearer, we have added more detail to the text (Lines 151-155).

      Regarding specific comment I, we have further simplified the description of the cloning technique to increase clarity (Lines 156+). The information listed under Supplemental Note S1, though informative, is not critical for the overall understanding of this highly technical section, and since the reviewer already considered this section to be difficult to follow, we would prefer to not further complicate the text by including these non-essential details.

      Regarding the origin of the CRISPRi plasmid (specific comment J), we point Reviewer 1 to the reference (Hammer BK and Swanson MS (Mol Microbiol 1999)) listed in Table S10: Strains and Plasmids Used in this Study.

      Regarding specific comment K and O, on the clarity of depicting the CRISPR array size selection process, we have updated the Figure 2 schematic. Reviewer 1 is correct in that despite our best efforts to exclude short CRISPR arrays, inevitably some 1-plex arrays remained in our input vector pool. Still, the average length of all arrays used in our pilot study exceeded three crRNA-encoding spacers. Further, having a population of 1- or 2-plex arrays in our libraries did allow us to pin-point the most critical effectors of a larger arrays within the same MuRCiS experiment (Table S5 and Table S7), a strength of MuRCiS as described in the discussion (Lines 378+).

      Regarding specific comment L, we appreciate Reviewer 1’s suggestion of an additional reference and we have added it to the manuscript as reference #23 (Line 71). While this reference does use a Golden Gate strategy to build a multiplex array, that array was not randomized but had a predefined order. Hence, our assembly method is unique due to its randomization.

      Regarding specific comment M, on array length cloning limitations, we agree with the conclusion of Zuckermann in Figure 1d of their article that longer inserts are generally harder to get into vector backbones. The challenge of cloning longer inserts is a common phenomenon of general biology and is not unique to cloning CRISPR arrays. We have altered the wording in our manuscript to better describe the intrinsic competition between short and long inserts during cloning (Lines 162-164).

      Regarding specific comment N, we second Reviewer 1’s desire to learn more about the critical effector pairs discovered here. With that said, the goal of this manuscript is to report the development of a novel MuRCiS pipeline to identify these critical pairs. Biochemical and molecular investigations of the encoded protein pairs are on-going and will be the topic of a future manuscript.

      Reviewer #2 (Recommendations For The Authors):

      Specific points

      1) The effector repertoire of L. pneumophila seems to have evolved in response to the plethora of potential protozoan hosts (PMID: 31988381). To further assess evolutionary aspects of the vast L. pneumophila effector arsenal, it would be interesting to test the single and double effector mutant strains (Fig. 5FG, Fig. 6EF) for growth in protozoa other than A. castellanii.

      2) Most CRISPR arrays comprising genes encoding functionally similar proteins or encoding evolutionarily conserved proteins did not substantially affect intracellular growth of L. pneumophila (Fig. 1B). This rather surprising result should be further discussed.

      3) l. 118/119: "Similar results ..., where none of the MC arrays ..." This statement should be phrased more precisely, since some CRISPR arrays did indeed have an effect on intracellular growth of L. pneumophila in U937 macrophages, while none affected intracellular growth in A. castellanii (Fig. 1B).

      4) Typos:

      • l. 852: ... (arbitrarily set to -100).

      • l. 862: ... Legionella-containing vacuole (LCV).

      • l. 895: ... and so we would recommend ...

      Regarding point 1, we thank Reviewer 2 for the suggestion of testing effector mutants in different hosts. While the primary purpose of the current manuscript was to optimize the MuRCiS platform, future studies using this technology to investigate specific biological questions related to Legionella infection would certainly benefit from including more than one amoebaean species.

      Regarding point 2, we agree that the lack of substantial growth defects seems surprising. Yet only two of the seven core effectors (found in all Legionella sp.), lpg2300 and mavN, individually attenuated Legionella intracellular growth when deleted (Burstein 2016 Nat Genetics; Isaac et al., 2015 PNAS). Thus, we hypothesize that the functions many effectors fulfil are of such importance for intracellular survival that that redundancy reaches beyond the boundary of conservation or like-function. We have added a statement emphasizing this at the end of the Figure 1 results section (Line 122-125).

      Regarding points 3 and 4, we thank Reviewer 2 for catching these errors and have corrected where needed in the text.

      -l. 852 (now Line 874): … (arbitrarily set to -100,000) is correct for Figure 6E.

    1. Author Response

      The following is the authors’ response to the previous reviews

      Comments from reviewer 1:

      Comment 1. Regarding SBSMMA, the authors may complement their discussion by mentioning recent work (PMID: 35738428) where SBSMMA was used to exemplify a potential fragment-based design approach for developing allosteric effectors for kinases.

      Thank you for the suggestion, we have added a short summary of the work where SBSMMA is used as a basis for developing small molecules to target kinases using fragment-based design approach

    1. Authorr Response

      The following is the authors’ response to the original reviews.

      Reviewer #1 (Public Review):

      The objective of this investigation was to determine whether experimental pain could induce alterations in cortical inhibitory/facilitatory activity observed in TMS-evoked potentials (TEPs). Previous TMS investigations of pain perception had focused on motor evoked potentials (MEPs), which reflect a combination of cortical, spinal, and peripheral activity, as well as restricting the focus to M1. The main strength of this investigation is the combined use of TMS and EEG in the context of experimental pain. More specifically, Experiment 1 investigated whether acute pain altered cortical excitability, reflected in the modulation of TEPs. The main outcome of this study is that relative to non-painful warm stimuli, painful thermal stimuli led to an increase on the amplitude of the TEP N45, with a larger increase associated with higher pain ratings. Because it has been argued that a significant portion of TEPs could reflect auditory potentials elicited by the sound (click) of the TMS, Experiment 2 constituted a control study that aimed to disentangle the cortical response related to TMS and auditory activity. Finally, Experiment 3 aimed to disentangle the cortical response to TMS and reafferent feedback from muscular activity elicited by suprathreshold TMS applied over M1. The fact that the authors accompanied their main experiment with two control experiments strengthens the conclusion that the N45 TEP peak could be implicated in the perception of painful stimuli.

      Perhaps, the addition of a highly salient but non-painful stimulus (i.e. from another modality) would have further ruled out that the effects on the N45 are not predominantly related to intensity/saliency of the stimulus rather than to pain per se.

      We thank the reviewer for their comment on the possibility of whether stimulus intensity influences the N45 as opposed to pain per se. We agree that the ideal experiment would have included multiple levels of stimulation. We would argue, however, that that in Experiment 1, despite the same level of stimulus intensity for all participants (46 degrees), individual differences in pain ratings were associated with the change in the N45 amplitude, suggesting that the results cannot be explained by stimulus intensity, but rather by pain intensity.

      Reviewer #2 (Public Review):

      The authors have used transcranial magnetic stimulation (TMS) and motor evoked potentials (MEPs) and TMS-electroencephalography (EEG) evoked potentials (TEPs) to determine how experimental heat pain could induce alterations in these metrics.
In Experiment 1 (n = 29), multiple sustained thermal stimuli were administered over the forearm, with the first, second, and third block of stimuli consisting of warm but non-painful (pre-pain block), painful heat (pain block) and warm but non-painful (post-pain block) temperatures respectively. Painful stimuli led to an increase in the amplitude of the fronto-central N45, with a larger increase associated with higher pain ratings. Experiments 2 and 3 studied the correlation between the increase in the N45 in pain and the effects of a sham stimulation protocol/higher stimulation intensity. They found that the centro-frontal N45 TEP was decreased in acute pain. The study comes from a very strong group in the pain fields with long experience in psychophysics, experimental pain, neuromodulation, and EEG in pain. They are among the first to report on changes in cortical excitability as measured by TMS-EEG over M1. While their results are in line with reductions seen in motor-evoked responses during pain and effort was made to address possible confounding factors (study 2 and 3), there are some points that need attention. In my view the most important are:

      1) The method used to calculate the rest motor threshold, which is likely to have overestimated its true value : calculating highly abnormal RMT may lead to suprathreshold stimulations in all instances (Experiment 3) and may lead to somatosensory "contamination" due to re-afferent loops in both "supra" and "infra" (aka. less supra) conditions.

      The method used to assess motor threshold was the TMS motor threshold Assessment Tool (MTAT) which estimates motor threshold using maximum likelihood parametric estimation by sequential testing (Awiszus et al., 2003; Awiszus and Borckardt, 2011). This was developed as a quicker alternative for calculating motor threshold compared to the traditional Rossini-Rothwell method which involves determining the lowest intensity that evokes at least 5/10 MEPs of at least 50 microvolts. The method has been shown to achieve the same accuracy of determining motor threshold as the traditional Rossini-Rothwell method, but with fewer pulses (Qi et al., 2011; Silbert et al., 2013).

      We have now made this clearer in the manuscript:

      “The RMT was determined using the TMS motor thresholding assessment tool, which estimates the TMS intensity required to induce an MEP of 50 microvolts with a 50% probability using maximum likelihood parametric estimation by sequential testing (Awiszus, 2003; Awiszus & Borckardt, 2011). This method has been shown to achieve the accuracy of methods such as the Rossini-Rothwell method (Rossini et al., 1994; Rothwell et al., 1999) but with fewer pulses (Qi, Wu, & Schweighofer, 2011; Silbert, Patterson, Pevcic, Windnagel, & Thickbroom, 2013). The test stimulus intensity was set at 110% RMT to concurrently measure MEPs and TEPs during pre-pain, pain and post-pain blocks.”

      Therefore, the high RMTs in our study cannot be explained by the threshold assessment method. Instead, they are likely explained by aspects of the experimental setup that increased the distance between the TMS coil and the scalp, including the layer of foam placed over the coil, the EEG cap and the fact that the electrodes we used had a relatively thick profile. This has been explained in the paper:

      “We note that the relatively high RMTs are likely due to aspects of the experimental setup that increased the distance between the TMS coil and the scalp, including the layer of foam placed over the coil, the EEG cap and relatively thick electrodes (6mm)”

      Awiszus, F. (2003). TMS and threshold hunting. In Supplements to Clinical neurophysiology (Vol. 56, pp. 13-23). Elsevier.

      Qi, F., Wu, A. D., & Schweighofer, N. (2011). Fast estimation of transcranial magnetic stimulation motor threshold. Brain stimulation, 4(1), 50-57.

      Silbert, B. I., Patterson, H. I., Pevcic, D. D., Windnagel, K. A., & Thickbroom, G. W. (2013). A comparison of relative-frequency and threshold-hunting methods to determine stimulus intensity in transcranial magnetic stimulation. Clinical Neurophysiology, 124(4), 708-712.

      2) The low number of pulses used for TEPs (close to ⅓ of the usual and recommended)

      We agree that increasing the number of pulses can increase the signal to noise ratio. During piloting, participants were unable to tolerate the painful stimulus for long periods of time and we were required to minimize the number of pulses per condition.

      We note that there is no set advised number of trials in TMS-EEG research. According to the recommendations paper, the number of trials should be based on the outcome measure e.g., TEP peaks vs. frequency domain measures vs. other measures and based on previous studies investigating test-retest reliability (Hernandez-Pavon et al., 2023). The choice of 66 pulses per condition was based on the study by Kerwin et al., (2018) showing that optimal concordance between TEP peaks can be found with 60-100 TMS pulses delivered in the same run (as in the present study). The concordance was particularly higher for the N40 peak at prefrontal electrodes, which was the key peak and electrode cluster in our study. We have made this clearer:

      “Current recommendations (Hernandez-Pavon et al., 2023) suggest basing the number of TMS trials per condition on the key outcome measure (e.g., TEP peaks vs. frequency measures) and based on previous test-retest reliability studies. In our study the number of trials was based on a test-retest reliability study by (Kerwin, Keller, Wu, Narayan, & Etkin, 2018) which showed that 60 TMS pulses (delivered in the same run) was sufficient to obtain reliable TEP peaks (i.e., sufficient within-individual concordance between the resultant TEP peaks of each trial).”

      Further supporting the reliability of the TEP data in our experiment, we note that the scalp topographies of the TEPs for active TMS at various timepoints (Figures 5, 7 and 9) were similar across all three experiments, especially at 45 ms post-TMS (frontal negative activity, parietal-occipital positive activity).

      In addition to this, the interclass correlation coefficient (Two-way fixed, single measure) for the N45 to active suprathreshold TMS across timepoints for each experiment was 0.90 for Experiment 1 (across pre-pain, pain, post-pain time points), 0.74 for Experiment 2 (across pre-pain and pain conditions), and 0.95 for Experiment 3 (across pre-pain conditions). This suggests that even with the fluctuations in the N45 induced by pain, the N45 for each participant was stable across time, further supporting the reliability of our data. These ICCs are now reported in the supplementary material (subheading: Test-retest reliability of N45 Peaks).

      Hernandez-Pavon, J. C., Veniero, D., Bergmann, T. O., Belardinelli, P., Bortoletto, M., Casarotto, S., ... & Ilmoniemi, R. J. (2023). TMS combined with EEG: Recommendations and open issues for data collection and analysis. Brain Stimulatio, 16(3), 567-593

      Kerwin, L. J., Keller, C. J., Wu, W., Narayan, M., & Etkin, A. (2018). Test-retest reliability of transcranial magnetic stimulation EEG evoked potentials. Brain stimulation, 11(3), 536-544.

      Lack of measures to mask auditory noise.

      In TMS-EEG research, various masking methods have been proposed to suppress the somatosensory and auditory artefacts resulting from TMS pulses, such as white noise played through headphones to mask the click sound (Ilmoniemi and Kičić, 2010), and a thin layer of foam placed between the TMS coil and EEG cap to minimize the scalp sensation (Massimini et al., 2005). However, recent studies have shown that even when these methods are used, sensory contamination of TEPs is still present, as shown by studies that show commonalities in the signal between active and sensory sham conditions that mimic the auditory/somatosensory aspects of real TMS (Biabani et al., 2019; Conde et al., 2019; Rocchi et al., 2021). This has led many authors (Biabani et al., 2019; Conde et al., 2019) to recommend the use of sham conditions to control for sensory contamination. To separate the direct cortical response to TMS from sensory evoked activity, Experiment 2 included a sham TMS condition that mimicked the auditory/somatosensory aspects of active TMS to determine whether any alterations in the TEP peaks in response to pain were due to changes in sensory evoked activity associated with TMS, as opposed to changes in cortical excitability. Therefore, the lack of auditory masking does not impact the main conclusions of the paper.

      We have made this clearer:

      “… masking methods have been used to suppress these sensory inputs, (Ilmoniemi and Kičić, 2010; Massimini et al., 2005). However recent studies have shown that even when these methods are used, sensory contamination of TEPs is still present, as shown by commonalities in the signal between active and sensory sham conditions that mimic the auditory/somatosensory aspects of real TMS (Biabani et al., 2019; Conde et al., 2019; Rocchi et al., 2021). This has led many leading authors (Biabani et al., 2019; Conde et al., 2019) to recommend the use of sham conditions to control for sensory contamination.”

      Ilmoniemi, R. J., & Kičić, D. (2010). Methodology for combined TMS and EEG. Brain topography, 22, 233-248.

      Massimini, M., Ferrarelli, F., Huber, R., Esser, S. K., Singh, H., & Tononi, G. (2005). Breakdown of cortical effective connectivity during sleep. Science, 309(5744), 2228-2232.

      Biabani, M., Fornito, A., Mutanen, T. P., Morrow, J., & Rogasch, N. C. (2019). Characterizing and minimizing the contribution of sensory inputs to TMS-evoked potentials. Brain stimulation, 12(6), 1537-1552.

      Conde, V., Tomasevic, L., Akopian, I., Stanek, K., Saturnino, G. B., Thielscher, A., ... & Siebner, H. R. (2019). The non-transcranial TMS-evoked potential is an inherent source of ambiguity in TMS-EEG studies. Neuroimage, 185, 300-312.

      Rocchi, L., Di Santo, A., Brown, K., Ibáñez, J., Casula, E., Rawji, V., ... & Rothwell, J. (2021). Disentangling EEG responses to TMS due to cortical and peripheral activations. Brain stimulation, 14(1), 4-18.

      3) A supra-stimulus heat stimulus not based on individual HPT, that oscillates during the experiment and that lead to large variations in pain intensity across participants is unfortunate.

      The choice of whether to calibrate or fix stimulus intensity is a contentious question in experimental pain research. A recent discussion by Adamczyk et al., (2022) explores the pros and cons of each approach and recommends situations where one method may be preferred over the other. That paper suggests that the choice of the methodology is related to the research question – when the main outcome of the research is objective (neurophysiological measures) and researchers are interested in the variability in pain ratings, the fixed approach is preferrable. Given we explored the relationship between MEP/N45 modulation by pain and pain intensity, this question is better explored by using the same stimulus intensity for all participants, as opposed to calibrating the intensity to achieve a similar level of pain across participants.

      We have made this clearer:

      “Given we were interested in the individual relationship between pain and excitability changes, the fixed temperature of 46ºC ensured larger variability in pain ratings as opposed to calibrating the temperature of the thermode for each participant (Adamczyk et al., 2022).”.

      Adamczyk, W. M., Szikszay, T. M., Nahman-Averbuch, H., Skalski, J., Nastaj, J., Gouverneur, P., & Luedtke, K. (2022). To calibrate or not to calibrate? A methodological dilemma in experimental pain research. The Journal of Pain, 23(11), 1823-1832.

      So is the lack of report on measures taken to correct for a fortuitous significance (multiple comparison correction) in such a huge number of serial paired tests.

      Note that we used a Bayesian approach for all analyses as opposed to the traditional frequentist approach. In contrast to the frequentist approach, the Bayesian approach does not require corrections for multiple comparisons (Gelman et al., 2000) given that they provide a ratio representing the strength of evidence for the null vs. alternative hypotheses as opposed to accepting or rejecting the null hypothesis based on p-values. As such, throughout the paper, we frame our interpretations and conclusions based on the strength of evidence (e.g. anecdotal/weak, moderate, strong, very strong) as opposed to referring to the significance of the effects.

      Gelman A, Tuerlinckx F. (2000). Type S error rates for classical and Bayesian single and multiple comparison procedures. Computational statistics, 15(3):373-90.

      Reviewer #3 (Public Review):

      The present study aims to investigate whether pain influences cortical excitability. To this end, heat pain stimuli are applied to healthy human participants. Simultaneously, TMS pulses are applied to M1 and TMS-evoked potentials (TEPs) and pain ratings are assessed after each TMS pulse. TEPs are used as measures of cortical excitability. The results show that TEP amplitudes at 45 msec (N45) after TMS pulses are higher during painful stimulation than during non-painful warm stimulation. Control experiments indicate that auditory, somatosensory, or proprioceptive effects cannot explain this effect. Considering that the N45 might reflect GABAergic activity, the results suggest that pain changes GABAergic activity. The authors conclude that TEP indices of GABAergic transmission might be useful as biomarkers of pain sensitivity.

      Pain-induced cortical excitability changes is an interesting, timely, and potentially clinically relevant topic. The paradigm and the analysis are sound, the results are mostly convincing, and the interpretation is adequate. The following clarifications and revisions might help to improve the manuscript further.

      1) Non-painful control condition. In this condition, stimuli are applied at warmth detection threshold. At this intensity, by definition, some stimuli are not perceived as different from the baseline. Thus, this condition might not be perfectly suited to control for the effects of painful vs. non-painful stimulation. This potential confound should be critically discussed.

      In Experiment 3, we also collected warmth ratings to confirm whether the pre-pain stimuli were perceived as different from baseline. This detail has been added to them methods:

      “In addition to the pain rating in between TMS pulses, we collected a second rating for warmth of the thermal stimulus (0 = neutral, 10 = very warm) to confirm that the participants felt some difference in sensation relative to baseline during the pre-pain block. This data is presented in the supplementary material”.

      We did not include these data in the initial submission but have now included it in the supplemental material. These data showed warmth ratings were close to 2/10 on average. This confirms that the non-painful control condition produced some level of non-painful sensation.

      2) MEP differences between conditions. The results do not show differences in MEP amplitudes between conditions (BF 1.015). The analysis nevertheless relates MEP differences between conditions to pain ratings. It would be more appropriate to state that in this study, pain did not affect MEP and to remove the correlation analysis and its interpretation from the manuscript.

      The interindividual relationship between changes in MEP amplitude and individual pain rating is statistically independent from the overall group level effect of pain on MEP amplitude. Therefore, conclusions for the individual and group level effects can be made independently.

      It is also important to note that in the pain literature, there is now increasing emphasis placed on investigating the individual level relationship between changes in cortical excitability and pain as opposed to the group level effect (Seminowicz et al., 2019; Summers et al., 2019). As such, it is important to make these results readily available for the scientific community.

      We have made this clearer:

      ‘As there is now increasing emphasis placed on investigating the individual level relationship between changes in cortical excitability and pain and not only the group level effect, (Chowdhury et al., 2022; Seminowicz et al., 2018; Seminowicz, Thapa, & Schabrun, 2019; Summers et al., 2019) we also investigated the correlations between pain ratings and changes in MEP (and TEP) amplitude”

      Chowdhury, N. S., Chang, W. J., Millard, S. K., Skippen, P., Bilska, K., Seminowicz, D. A., & Schabrun, S. M. (2022). The Effect of Acute and Sustained Pain on Corticomotor Excitability: A Systematic Review and Meta-Analysis of Group and Individual Level Data. The Journal of Pain, 23(10), 1680-1696.

      Summers, S. J., Chipchase, L. S., Hirata, R., Graven-Nielsen, T., Cavaleri, R., & Schabrun, S. M. (2019). Motor adaptation varies between individuals in the transition to sustained pain. Pain, 160(9), 2115-2125.

      Seminowicz, D. A., Thapa, T., & Schabrun, S. M. (2019). Corticomotor depression is associated with higher pain severity in the transition to sustained pain: a longitudinal exploratory study of individual differences. The Journal of Pain, 20(12), 1498-1506.

      3) Confounds by pain ratings. The ISI between TMS pulses is 4 sec and includes verbal pain ratings. Considering this relatively short ISI, would it be possible that verbal pain ratings confound the TEP? Moreover, could the pain ratings confound TEP differences between conditions, e.g., by providing earlier ratings when the stimulus is painful? This should be carefully considered, and the authors might perform control analyses.

      It is unlikely that the verbal ratings contaminated the TEP response as the subsequent TMS pulse was not delivered until the verbal rating was complete and given that each participant was cued by the experimenter to provide the pain rating after each pulse (rather than the participant giving the rating at any time). As such, it would not be possible for participants to provide earlier ratings to more painful stimuli.

      We have made this clearer:

      "To avoid contamination of TEPs by verbal ratings, the subsequent TMS pulse was not delivered until the verbal rating was complete, and the participant was cued by the experimenter to provide the pain rating after each pulse.”

      4) Confounds by time effects. Non-painful and painful conditions were performed in a fixed order. Potential confounds by time effects should be carefully considered.

      Previous research suggests that pain alters neural excitability even after pain has subsided. In a recent meta-analysis (Chowdhury et al., 2022) we found effect sizes of 0.55-0.9 for MEP reductions 0-30 minutes after pain had resolved. As such, we avoided intermixing pain and warm blocks given subsequent warm blocks would not serve as a valid baseline, as each subsequent warm block would have residual effects from the previous pain blocks.

      Chowdhury, N. S., Chang, W. J., Millard, S. K., Skippen, P., Bilska, K., Seminowicz, D. A., & Schabrun, S. M. (2022). The Effect of Acute and Sustained Pain on Corticomotor Excitability: A Systematic Review and Meta-Analysis of Group and Individual Level Data. The Journal of Pain, 23(10), 1680-1696.

      At the same time, given there was no conclusive evidence for a difference in N45 amplitude between pre-pain and post-pain conditions of Experiment 1 (Supplementary Figure 1), it is unlikely that the effect of pain was an artefact of time i.e., the explanation that successive thermal stimuli applied to the skin results an increase in the N45, regardless of whether the stimuli are painful or not. We will make this point in our next revision.

      We have discussed this issue:

      “Lastly, future research should consider replicating our experiment using intermixed pain and no pain blocks, as opposed to fixed pre-pain and pain blocks, to control for order effects i.e., the explanation that successive thermal stimuli applied to the skin results an increase in the N45 peak, regardless of whether the stimuli are painful or not. However, we note that there was no conclusive evidence for a difference in N45 peak amplitude between pre-pain and post-pain conditions of Experiment 1 (Supplementary Figure 1), suggesting it is unlikely that the observed effects were an artefact of time.”

      5) Data availability. The authors should state how they make the data openly available.

      We have uploaded the MEP, TEP and pain data on the Open science framework https://osf.io/k3psu/

      Reviewer #1 (Recommendations For The Authors):

      I think the study is quite solid and I only have very minor recommendations for the authors:

      • Introduction, p. 3: "Functional magnetic resonance imaging has helped us understand where in the brain pain is processed". This is an overstatement. fMRI provides us with potential biomarkers (e.g. "the pain signature"), but the specificity of these responses for pain is debated and we still do not know where in the brain pain is processed.

      We have amended to:

      “functional magnetic resonance imaging has assisted in the localization of brain structures implicated in pain processing”

      • Introduction, p. 5: "neural baseline" should be "neutral baseline"?

      We thank the reviewer for identifying this – this has now been amended.

      Reviewer #2 (Recommendations For The Authors):

      INTRODUCTION

      The introduction mentions how important extra-motor areas can be explored by TMS-EEG, then the effects of DLPFC rTMS on TEPs ... but you do not explore the DLPFC... Perhaps the introduction should be reframed.

      The current work explores cortical excitability throughout the brain (as shown in our cluster-based permutation and source localization analyses), so our investigations are in line with the introductions statement about the importance of studying non-motor areas.

      The reference to DLPFC rTMS was to highlight current existing research that has applied TMS-EEG to understand pain. It was not used as a methodological rationale to investigate the DLPFC in the present study. To make the research gap clearer, we state:

      “While these studies assist us in understanding whether TEPs might mediate rTMS-induced pain reductions, no study has investigated whether TEPs are altered in direct response to pain”

      Lignes 63-65 the term "TMS" is used to refer to motor corticospinal excitability measures, in contrast to TMS-EEG measures of TEPs. Then the authors come back to TMS-EEG and then again back to MEPs. This is rather confusing: TMS means TMS... the concept of MEP/ motor corticospinal excitability measures is not intuitive when using the term "TMS". I suggest using motor corticospinal excitability measures when referring to MEP/MEP-based measures of cortical excitability...) and M1TMS-EEG-evoked potentials (usually abbreviated to TEPs) to refer to TMS-EEG responses as measured here.

      Throughout the manuscript, we now use the term TEPs when referring to TMS-EEG measures, and MEPs when referring to TMS-EMG measure. The use of TEPs vs. MEPs will make it easier for readers to follow which measures we are referring to.

      Line 83: "As such, the precise origin of the pain mechanism cannot be localized." Please rephrase, the sentence conveys the idea that it is indeed possible to localize the origin of a pain mechanism with a different approach, and we know this is not currently possible, irrespective of the methodological setup.

      We have replaced this with:

      “This makes it unclear as to whether pain processes occur at the cortical, spinal or peripheral level.”

      How can one predetermine the temperature that will be perceived as painful by someone else, and not base it on individual HPT? This is against principles of psychophysics. Please comment. Attesting all participants had HPT below 46 is important, but then being stimulated at 46C when our HPT is 45C is different from when our HPT is 39C. Please explain why the pain intensity was not standardised based on individual HPT.

      Please refer to our response to the public review related to the issue

      Line 38: "if we had used an alternative design with blocks of warm stimuli intermixed with blocks of painful stimuli, the warm stimuli blocks would not serve as a valid non-painful baseline". I do not understand why it is not possible to have a pain-free baseline, followed by a pain/warm sequence.

      In our study, we had the choice of either intermixing blocks or to use a fixed sequence. Previous research suggests that pain alters neural excitability even after pain has subsided. In a recent meta-analysis (Chowdhury et al., 2022) we found effect sizes of 0.55-0.9 for MEP reductions 0-30 minutes after pain had resolved. As such, we avoided intermixing pain and warm blocks given subsequent warm blocks would not serve as a valid baseline, as each subsequent warm block would have residual effects from the previous pain blocks.

      We have updated the manuscript to be clearer about why we used a fixed sequence:

      “The pre-pain/pain/post-pain design has been commonly used in the TMS-MEP pain literature, as many studies have demonstrated strong changes in corticomotor excitability that persist beyond the painful period. Indeed, in a systematic review, we showed effect sizes of 0.55-0.9 for MEP reductions 0-30 minutes after pain had resolved (Chowdhury et al., 2022). As such, if we had used an alternative design with blocks of warm stimuli intermixed with blocks of painful stimuli, the warm stimuli blocks would not serve as a valid non-painful baseline”

      Chowdhury, N. S., Chang, W. J., Millard, S. K., Skippen, P., Bilska, K., Seminowicz, D. A., & Schabrun, S. M. (2022). The Effect of Acute and Sustained Pain on Corticomotor Excitability: A Systematic Review and Meta-Analysis of Group and Individual Level Data. The Journal of Pain, 23(10), 1680-1696.

      Please explain, and provide evidence that stimulation of people with predetermined temperatures is able to create warm/pain/warm sensations, without entraining pain in the last warm stimulation.

      A previous study by Dube et al. (2011) used sequences of warm (36°C), painful and neutral (32° C) and found that participants did not experience pain at any time when the temperature was at a warm temperature of 36°C. We have now cited this study:

      “Based on a previous study (Dubé & Mercier, 2011) which also used sequences of painful (50ºC) and warm (36°C) thermal stimuli, we did not anticipate that the stimulus in the pain block would entrain pain in the post-pain block”

      Dubé, J. A., & Mercier, C. (2011). Effect of pain and pain expectation on primary motor cortex excitability. Clinical neurophysiology, 122(11), 2318-2323.

      METHODS

      It is not clear if participants with chronic pain, present in 20% of the general population, were excluded. If they were, please provide "how" in methods.

      We excluded participants with a history or presence of acute/chronic pain. This has now been clarified:

      “Participants were excluded if they had a history of chronic pain condition or any current acute pain”

      Line 489: the definition of warm detection threshold is unusual, please provide a reference.

      We used an identical method to Furman et al., (2020). We have made the reference to this clearer: “Warmth, cold and pain thresholds were assessed in line with a previous study (Furman et al., 2020)”

      Furman, A. J., Prokhorenko, M., Keaser, M. L., Zhang, J., Chen, S., Mazaheri, A., & Seminowicz, D. A. (2020). Sensorimotor peak alpha frequency is a reliable biomarker of prolonged pain sensitivity. Cerebral Cortex, 30(12), 6069-6082.

      In Experiment 2, please explain how the lack of randomisation between "pre-pain" and "pain" may have influenced results.

      Given we tried to replicate Experiment 1’s methodology as close as possible (to isolate the source of the effect from Experiment 1) we chose to repeat the same sequence of blocks as Experiment 1: pre-pain followed by pain.

      Given there was no conclusive evidence for a difference in N45 amplitude between pre-pain and post-pain conditions of Experiment 1 (Supplementary Figure 1), it is unlikely that the effect of pain was an order effect i.e., the explanation that successive thermal stimuli applied to the skin results an increase in the N45, regardless of whether the stimuli are painful or not.

      We now discuss the issue of randomization:

      “Lastly, future research should consider replicating our experiment using intermixed pain and no pain blocks, as opposed to fixed pre-pain and pain blocks, to control for order effects i.e. the explanation that successive thermal stimuli applied to the skin results an increase in the N45 peak, regardless of whether the stimuli are painful or not. However, we note that there was no conclusive evidence for a difference in N45 peak amplitude between pre-pain and post-pain conditions of Experiment 1 (Supplementary Figure 1), suggesting it is unlikely that the observed effects were an artefact of time”

      Also, in Methods in general, disclose how pain intensity was assessed, and how.

      Pain intensity was assessed using a verbal rating scale (0 = no pain, and 10 = most pain imaginable). We have provided more detail:

      “During each 40 second thermal stimulus, TMS pulses were manually delivered, with a verbal pain rating score (0 = no pain, and 10 = worst pain imaginable) obtained between pulses. To avoid contamination of TEPs by verbal ratings, the subsequent TMS pulse was not delivered until the verbal rating was complete, and the participant was cued by the experimenter to provide the pain rating after each pulse”

      Please explain how auditory masking was made during data collection.

      Auditory masking noise was not played through the headphones, given that Experiment 2 controlled for auditory evoked potentials. We have made this clearer:

      “Auditory masking was not used. Instead, auditory evoked potentials resulting from the TMS click sound were controlled for in Experiment 2”

      Please explain if online TEP monitoring was used during data collection

      Online TEP monitoring was not available with our EEG software. We have made this clearer in the manuscript:

      “Online TEP monitoring was not available with the EEG software”

      Line 499: what is subthreshold TMS here? You are measuring TEPs, and not MEPs initially, so you may have a threshold for MEPs and TEPs, which are not the same.

      The intensity was calibrated relative to the MEP response (rather than TEP response) - this has now been clarified:

      “… and the inclusion of a subthreshold TMS (90% of resting motor threshold) condition intermixed within both the pre-pain and pain blocks.”

      Please provide a reference and a figure to illustrate the electric stimulation used in the sham procedure in Study 2

      The apparatus for the electrical stimulation is shown in Figure 7A, and was based on previous papers using electrical stimulation over motor cortex to simulate the somatosensory aspect of real TMS (Chowdhury et al., 2022; Gordon et al., 2022; Rocchi et al., 2021). We have made this clearer:

      “Electrical stimulation was based on previous studies attempting to simulate the somatosensory component of active TMS (Chowdhury et al., 2022; Gordon et al., 2022; Rocchi et al., 2021)”

      Gordon, P. C., Jovellar, D. B., Song, Y., Zrenner, C., Belardinelli, P., Siebner, H. R., & Ziemann, U. (2021). Recording brain responses to TMS of primary motor cortex by EEG–utility of an optimized sham procedure. Neuroimage, 245, 118708.

      Chowdhury, N. S., Rogasch, N. C., Chiang, A. K., Millard, S. K., Skippen, P., Chang, W. J., ... & Schabrun, S. M. (2022). The influence of sensory potentials on transcranial magnetic stimulation–Electroencephalography recordings. Clinical Neurophysiology, 140, 98-109.

      Rocchi, L., Di Santo, A., Brown, K., Ibánez, J., Casula, E., Rawji, V., ... & Rothwell, J. (2021). Disentangling EEG responses to TMS due to cortical and peripheral activations. Brain stimulation, 14(1), 4-18.

      It is not so common to use active electrodes for TMS-EEG. Please confirm the electrodes used and if they are c-ring TMS compatible and provide reference if otherwise (or actual papers recommending active ones)

      To be more specific about the electrode type we have indicated:

      “Signals were recorded from 63 TMS-compatible active electrodes (6mm height, 13mm width), embedded in an elastic cap (ActiCap, Brain Products, Germany), in line with the international 10-10 system”

      A paper directly comparing TEPs between active and passive electrodes found no difference between the two and concluded TEPs can be reliably obtained using active electrodes (Mancuso et al., 2021). There is also evidence that active electrodes have better signal quality than passive electrodes at higher impedance levels (Laszlo et al., 2014).

      This information has now been added to the paper:

      “Active electrodes result in similar TEPs (both magnitude and peaks) to more commonly used passive electrodes (Mancuso et al., 2021). There is also evidence that active electrodes have higher signal quality than passive electrodes at higher impedance levels (Laszlo, Ruiz-Blondet, Khalifian, Chu, & Jin, 2014).”

      There is a growing literature showing that monophonic pulses are not reliable for TEPs when compared to biphasic ones, please provide references. https://doi.org/10.1016/j.brs.2023.02.009

      The reference provided by the reviewer states that biphasic and monophasic pulses both have advantages and disadvantages, rather than stating “monophonic pulses are not reliable for TEPs”. While there is some evidence that the artefacts resulting from monophasic pulses are larger than biphasic pulses, the EEG signal still returns to baseline levels within 5ms of the TMS pulse (Rogasch et al., 2013). Moreover, one paper (Casula et al. 2018) found that the resultant TEPs evoked by monophasic pulses are larger than those resulting from biphasic pulses. The authors postulated that monophasic pulses are more effective at activating widespread cortical areas than biphasic pulses. Ultimately the reference provided by the reviewer concludes that “effect of pulse shape on TEPs has not been systematically investigated and more studies are needed”.

      Rogasch, N. C., Thomson, R. H., Daskalakis, Z. J., & Fitzgerald, P. B. (2013). Short-latency artifacts associated with concurrent TMS–EEG. Brain stimulation, 6(6), 868-876.

      Casula, E. P., Rocchi, L., Hannah, R., & Rothwell, J. C. (2018). Effects of pulse width, waveform and current direction in the cortex: A combined cTMS-EEG study. Brain stimulation, 11(5), 1063-1070.

      In most heads, a pulse in the PA direction is not obtained by a coil oriented 45o to the midline. The later induced later-medial pulses, good to obtain MEPs

      We followed previous studies measuring MEPs from the ECRB elbow muscle (Schabrun et al., 2016; de Martino et al., 2019) whereby the TMS coil handle was angled at 45 degrees relative to the midline in order to induce a posterior-anterior current. We are not aware of literature that shows that the 45 degrees orientation does not induce a posterior anterior current in most heads.

      Schabrun, S. M., Christensen, S. W., Mrachacz-Kersting, N., & Graven-Nielsen, T. (2016). Motor cortex reorganization and impaired function in the transition to sustained muscle pain. Cerebral Cortex, 26(5), 1878-1890.

      De Martino, E., Seminowicz, D. A., Schabrun, S. M., Petrini, L., & Graven-Nielsen, T. (2019). High frequency repetitive transcranial magnetic stimulation to the left dorsolateral prefrontal cortex modulates sensorimotor cortex function in the transition to sustained muscle pain. Neuroimage, 186, 93-102.

      The definition of RMT is (very) unusual. RMT provides small 50microV MEPs in 50% of times. If you obtain MEPs at 50microV you are supra threshold!

      The TMS motor threshold assessment tool calculates threshold in the same manner as other threshold tools – it calculates the intensity that elicits an MEP of 50 microvolts, 50% of the time. We have made this clearer:

      “The RMT was determined using the TMS motor thresholding assessment tool, which estimates the TMS intensity required to induce an MEP of 50 microvolts with a 50% probability using maximum likelihood parametric estimation by sequential testing (Awiszus and Borckardt, 2011). This method has been shown to achieve the accuracy of methods such as the Rossini-Rothwell method (Rossini et al., 1994; Rothwell et al., 1999) but with fewer pulses (Qi et al., 2011; Silbert et al., 2013).”

      Please inform the inter TMS pulse interval used of TEPs and whether they were randomly generated.

      The pulses were delivered manually – the interval was not randomly generated – as stated:

      “As TMS was delivered manually, there was no set interpulse interval. However, the 40 second stimulus duration allowed for 11 pulses for each heat stimulus …. (~ 4 seconds in between …)”

      Why have you stimulated suprathreshold on M1 when assessing TEP´s? The whole idea is that large TEPs can be obtained at lower intensities below real RMT and that prevents re-entering loops of somatosensory and joint movement inputs that insert "noise" to the TEPs.

      The suprathreshold intensity was used to concurrently measure MEPs during pre-pain, pain and post-pain blocks.

      We have made this clearer:

      “The test stimulus intensity was set at 110% RMT to concurrently measure MEPs and TEPs during pre-pain, pain and post-pain blocks.”

      The influence of re-afferent muscle activity was controlled for in Experiment 3.

      Did you assess pain intensity after each of the TEP pulses? Please discuss how such a cognitive task may have influenced results

      Pain intensity was assessed after each TMS pulse, as stated:

      “TMS pulses were manually delivered, with a verbal pain rating score (0 = no pain, and 10 = most pain imaginable) obtained between pulses”

      Reviewer 3 also brought up a concern of whether the verbal rating task might have influenced the TEPs. However, it is unlikely that the task contaminated the TEP response as the subsequent TMS pulse was not delivered until the verbal rating was complete and given that each participant was cued by the experimenter to provide the pain rating after each pulse (rather than the participant giving the rating at any time). We have made this clearer where we state:

      “To avoid contamination of TEPs by verbal ratings, the subsequent TMS pulse was not delivered until the verbal rating was complete, and the participant was cued by the experimenter to provide the pain rating after each pulse”

      The QST approach is unusual. Please confirm the sequence of CDT, WDT and HPT were not randomised and that no interval beyond 6sec were used. Proper references are welcome.

      In line with a previous study (Furman et al., 2020), the sequence of the CPT, WDT and HPT were not randomized, and the interval was not more than 6 seconds.

      We have made this clearer:

      “A total of three trials was conducted for each test to obtain an average, with an interstimulus interval of six seconds. The sequence of cold, warmth and pain threshold was the same for all participants (Furman et al. 2020)”

      Performing 60 pulses for TEPs is unusual, and against the minimum number in recommendations

      Please explain and comment.https://doi.org/10.1016/j.brs.2023.02.009

      Please refer to our previous response to this concern in the public reviews.

      Line 578: when you refer to "heat" the reader may confound warm/heat with heat meaning suprathreshold. Please revise the wording.

      We have now replaced the word heat stimulus with thermal stimulus.

      Why were Bayesian statistics used instead as frequentist ones?

      We have made this clearer:

      “Given we were interested in determining the evidence for pain altering TEP peaks in certain conditions (e.g., active TMS) and pain not altering TEP peaks in other conditions (sham TMS), we used a Bayesian approach as opposed to a frequentist approach, which considers the strength of the evidence for the alternative vs. null hypothesis”

      RESULTS

      There is a huge response with high power after 100ms- Please discuss if you believe auditory potentials may have influenced it.

      It is indeed possible that auditory potentials were present at 100ms. We now state:

      “Indeed, the signal at ~100ms post-TMS from Experiment 1 may reflect an auditory N100 response”

      The presence of auditory contamination does not impact the main conclusions of the paper given this was controlled for in Experiment 2.

      Please discuss how pain ranging from 3-10 may have influenced results in the "PAIN" situation,

      It is anticipated that the fixed thermal stimulus intensity approach would lead to large variations in pain ratings (Adamczyk et al., 2022). This is a recommended approach when the aim of the research is to determine relationships between neurophysiological measures and individual differences in pain sensitivity (Adamczyk et al., 2022). Indeed, we were interested in whether alterations in neurophysiological measures were associated with pain intensity, and we found that higher pain ratings were associated with smaller reductions in MEP amplitude and larger increases in N45 amplitude.

      Adamczyk, W. M., Szikszay, T. M., Nahman-Averbuch, H., Skalski, J., Nastaj, J., Gouverneur, P., & Luedtke, K. (2022). To calibrate or not to calibrate? A methodological dilemma in experimental pain research. The Journal of Pain, 23(11), 1823-1832.

      Please indicate if any participants offered pain after warm stimulation ( possible given secondary hyperalgesia after so many plateaux of heat stimulation).

      As stated in the results “All participants reported 0/10 pain during the pre-pain and post-pain blocks”.

      Please discuss the potential effects of having around 10% of "bad channels) In average per experiment per participants, its impacts in source localisation and in TEP measurement. Same for >5 epochs excluded by participant.

      The number of bad channels has been incorrectly stated by the reviewer as being 10% on average per experiment per participant, whereas the correct number of reported bad channels was 3%, 4.7% and 9.8% for Experiment 1, 2 and 3 respectively (see supplementary material). These numbers are below the accepted number of bad channels to interpolate (10%) in EEG pipelines (e.g., Debnath et al., 2020; Kayhan et al., 2022), so it is unlikely that our channel exclusions significantly influenced the quality of our source localization an TEP data.

      Debnath, R., Buzzell, G. A., Morales, S., Bowers, M. E., Leach, S. C., & Fox, N. A. (2020). The Maryland analysis of developmental EEG (MADE) pipeline. Psychophysiology, 57(6), e13580.

      Kayhan, E., Matthes, D., Haresign, I. M., Bánki, A., Michel, C., Langeloh, M., ... & Hoehl, S. (2022). DEEP: A dual EEG pipeline for developmental hyperscanning studies. Developmental cognitive neuroscience, 54, 101104.

      The number of excluded epochs is unlikely to have influenced the results given there was evidence for no difference in the number of rejected epochs between conditions (E1 BF10 = 0.145, E2 BF10 = 0.27, E3 BF10 = 0.169 – these BFs have now been reported in the supplementary material), and given the reliability of the N45 was high (see response to previous comment on the number of trials per condition).

      HPT of 42.9 {plus minus} 2.5{degree sign}C means many participants had HPT close to 46oC. Please discuss

      While some participants did indeed have pain thresholds close to 46 degrees, they nonetheless reported pain during the test blocks. While such participants may have reported less pain compared to others, we aimed for larger variations in pain ratings, given one of the research questions was to determine why pain intensity differs between individuals (given the same noxious stimulus). Indeed, we showed that this variation was meaningful (pain intensity was related to alterations in N45 and MEP amplitude).

      Please explain the sentence : line 139 "As such, if we had used an alternative design with blocks of warm stimuli intermixed with blocks of painful stimuli, the warm stimuli blocks would not serve as a valid non-painful baseline." I cannot see why.

      Please refer to our previous point on why the fixed sequence was included.

      And on the top of that heat was not individualised according to HPT.

      Please refer to our previous point on why we used a fixed stimulus approach.

      Sequences of warm/heat were not randomised. Please refer to our previous point on the why the sequence of blocks was not randomized.

      Line 197: "However, as this is the first study investigating the effects of experimental pain on TEPsamplitude, there were no a priori regions or timepoints of interest to compare betweenconditions". This is not clear. It means you have not measured the activity (size of the N45) under the electrode closest to the TMS coil? The TEP is supposed to by higher under the stimulated target/respective corresponding electrode…

      We are not aware of any current recommendations that state that the region of interest should be based on the site of stimulation. The advantage of TMS-EEG is that it allows characterisation of cortical excitability changes throughout the brain, not just the site of stimulation. We based our region of interest on a cluster-based permutation analysis, as recommended by Frömer, Maier, & Abdel Rahman, (2018)

      Frömer, R., Maier, M., & Abdel Rahman, R. (2018). Group-level EEG-processing pipeline for flexible single trial-based analyses including linear mixed models. Frontiers in neuroscience, 12, 48.

      Please explain where N45 values came from.

      The N45 was calculated using the TESA peak function (Rogasch et al., 2017) which identifies a data point which is larger/smaller than +/- 5 data points within a specified time window (e,g, 40-70ms post-TMS as in the present study). Where multiple peaks are found, the amplitude of the largest peak is returned. Where no peak is found, the amplitude at the specified latency is returned.

      Rogasch, N. C., Sullivan, C., Thomson, R. H., Rose, N. S., Bailey, N. W., Fitzgerald, P. B., ... & Hernandez-Pavon, J. C. (2017). Analysing concurrent transcranial magnetic stimulation and electroencephalographic data: A review and introduction to the open-source TESA software. Neuroimage, 147, 934-951.

      If only the cluster assessment was made please provide the comparison between P45 from the target TMS channel location in pre pain vs pain.

      We assume the reviewer is referring to the N45 rather than P45, and that by “target” TMS channel they are referring to the stimulated region.

      We first clarify that there is no “target” channel given the motor hotspot differs between individuals and so the channel that is closest to the site of stimulation will always differ.

      Secondly, as stated above, we are not aware of any current recommendations in TMS-EEG research that states that the region of interest for TEP analysis should be based on the site of stimulation. The advantage of TMS-EEG is that it allows characterisation of cortical excitability throughout the brain, not just the site of stimulation. If we based our ROI on the target channel only, we would lose valuable information about excitability changes occurring in other brain regions.

      Lastly, the N45 was localized at frontocentral electrodes, which is also where the cluster differences emerged. As such, we do not believe it would be informative to compare N45 peak amplitude at the region of stimulation.

      Also explain how correction for multiple comparisons was made

      Please refer to our response to the public review related to this issue.

      And report data from pain vs post-pain.

      The pain vs. post-pain comparisons are now reported in the Supplementary material.

      There is a strong possibility the response at N85 is an auditory /muscle signal. Please provide the location of this response.

      We have opted not to include the topography at 85ms in the main paper as it would introduce too much clutter into the figures (which are already very dense), and because the topography was very similar to the topography at 100ms. As an example, for the reviewer, in Author response image 1 we have shown the topography for the pre-pain condition of Experiment 1.

      Author response image 1.

      Experiment 2: I have a strong impression both active TEPs and sham TEPs were contaminated by auditory (and muscle) noise. Please explain.

      While it possible that auditory noise may have influenced TEPs in the active and sham groups, it does not impact the main conclusions of the paper, given that the purpose of the sham condition was to control for auditory and somatosensory stimulation resulting from TMS.

      While muscle activity may also affect have influenced the TEPs in active and sham conditions, we used fastICA in all conditions to suppress muscle activity. The fastICA algorithm (Rogasch et al., 2017) runs an independent component analysis on the data, and classifies components as neural, TMS-evoked muscle, eye movements and electrode noise, based on a set of heuristic thresholding rules (e.g., amplitude, frequency and topography of the components). Components classified as TMS-evoked muscle/other muscle artefacts are then removed. In the supplementary material, we further report that the number of components removed did not differ between conditions, suggesting the impact of muscle artefacts are not larger in some conditions vs. others.

      Rogasch, N. C., Sullivan, C., Thomson, R. H., Rose, N. S., Bailey, N. W., Fitzgerald, P. B., ... & Hernandez-Pavon, J. C. (2017). Analysing concurrent transcranial magnetic stimulation and electroencephalographic data: A review and introduction to the open-source TESA software. Neuroimage, 147, 934-951.

      Experiment 3: One interpretation can be that both supra and sub-threshold TMS were leading to somatosensory re-afferent responses, based on the way RMT was calculated, which hyper estimate the RMT and delivers in reality 2 types of supra-threshold stimulations. Please discuss

      Please refer to our response to the public review related to this issue.

      Please provide correlation between N45 size and MEPs amplitudes.

      This has now been included:

      “There was no conclusive evidence of any relationship between alterations in MEP amplitude during pain, and alterations in N100, N45 and P60 amplitude during pain (see supplementary material).”<br /> The supporting statistics for these analyses have been included in the supplementary material.

      DISCUSSION

      Line 303: " The present study determined whether acute experimental pain induces alterations in cortical inhibitory and/or facilitatory activity observed in TMS-evoked potentials".

      Well, no. The study assessed the N45, and was based on it. It did not really explore other metrics in a systematic fashion. P60 and N100 changes were not replicated in experiments 2 and 3..

      We assume the reviewer is stating that we did not assess other TEP peaks (such as the N15, P30 and P180). However, we did indeed assess these peaks in a systematic fashion. First, we identified the ROI by using a cluster-based analysis. This is a recommended approach when the ROI is unclear (Frömer, Maier, & Abdel Rahman, 2018). We then analysed the TEP representing the mean voltage across the electrodes within the cluster, and then identified any differences in all peaks between conditions (not just the N45). This has been made clearer in the manuscript.

      This has now been included:

      “For all experiments, the mean TEP waveform of any identified clusters from Experiment 1 were plotted, and peaks (e.g., N15, P30, N45, P60, N100) were identified using the TESA peak function (Rogasch et al., 2017)”

      Frömer, R., Maier, M., & Abdel Rahman, R. (2018). Group-level EEG-processing pipeline for flexible single trial-based analyses including linear mixed models. Frontiers in neuroscience, 12, 48.

      And the N45 is not related to facilitatory or inhibitory activity, it is a measure of an evoked response indicating excitability

      Evidence suggests the N45 is mediated by GABAAergic neurotransmission (inhibitory activity), as drugs which increase GABAA receptor activity increase the amplitude of the N45 (Premoli et al., 2014) and drugs which decrease GABAA receptor activity decrease the amplitude of the N45 (Darmani et al., 2016). As such, we and various other empirical papers (e.g., Bellardinelli et al., 2021; Noda et al., 2021; Opie at 2019 ) and review papers (Farzan & Bortoletto, 2022; Tremblay et al., 2019) have interpreted changes in the N45 peak as reflecting changes in cortical inhibitory/GABAA mediated activity.

      Premoli, I., Castellanos, N., Rivolta, D., Belardinelli, P., Bajo, R., Zipser, C., ... & Ziemann, U. (2014). TMS-EEG signatures of GABAergic neurotransmission in the human cortex. Journal of Neuroscience, 34(16), 5603-5612.

      Belardinelli, P., König, F., Liang, C., Premoli, I., Desideri, D., Müller-Dahlhaus, F., ... & Ziemann, U. (2021). TMS-EEG signatures of glutamatergic neurotransmission in human cortex. Scientific reports, 11(1), 8159.

      Darmani, G., Zipser, C. M., Böhmer, G. M., Deschet, K., Müller-Dahlhaus, F., Belardinelli, P., ... & Ziemann, U. (2016). Effects of the selective α5-GABAAR antagonist S44819 on excitability in the human brain: a TMS–EMG and TMS–EEG phase I study. Journal of Neuroscience, 36(49), 12312-12320.

      Noda, Y., Barr, M. S., Zomorrodi, R., Cash, R. F., Lioumis, P., Chen, R., ... & Blumberger, D. M. (2021). Single-pulse transcranial magnetic stimulation-evoked potential amplitudes and latencies in the motor and dorsolateral prefrontal cortex among young, older healthy participants, and schizophrenia patients. Journal of Personalized Medicine, 11(1), 54.

      Farzan, F., & Bortoletto, M. (2022). Identification and verification of a'true'TMS evoked potential in TMS-EEG. Journal of neuroscience methods, 378, 109651.

      Opie, G. M., Foo, N., Killington, M., Ridding, M. C., & Semmler, J. G. (2019). Transcranial magnetic stimulation-electroencephalography measures of cortical neuroplasticity are altered after mild traumatic brain injury. Journal of Neurotrauma, 36(19), 2774-2784.

      Tremblay, S., Rogasch, N. C., Premoli, I., Blumberger, D. M., Casarotto, S., Chen, R., ... & Daskalakis, Z. J. (2019). Clinical utility and prospective of TMS–EEG. Clinical Neurophysiology, 130(5), 802-844.

      Line 321: why have you not measured SEPs in experiment 3?

      It is not possible to directly measure the somatosensory evoked potentials resulting from a TMS pulse, given that the TMS pulse produces a range of signals including cortical activity, muscle/eye blink responses, auditory responses, somatosensory responses and other artefacts. While some researchers attempt to isolate the SEP from TMS using pre-processing methods such as ICA, others use control conditions such as sensory sham conditions (to control for the “tapping” artefact) or subthreshold intensity conditions (to control for reafferent muscle activity), as we have done in Experiment 2 and 3 of our study.

      We have now stated this in the manuscript:

      “As it is extremely challenging to isolate and filter these auditory and somatosensory evoked potentials using pre-processing pipelines, masking methods have been used to suppress these sensory inputs, (Ilmoniemi and Kičić, 2010; Massimini et al., 2005). However recent studies have shown that even when these methods are used, sensory contamination of TEPs is still present, as shown by commonalities in the signal between active and sensory sham conditions that mimic the auditory/somatosensory aspects of real TMS (Biabani et al., 2019; Conde et al., 2019; Rocchi et al., 2021). This has led many leading authors (Biabani et al., 2019; Conde et al., 2019) to recommend the use of sham conditions to control for sensory contamination”

      Line 365: SICI is dependent on GABAa activity. But the way the text is written if conveys the idea that TMS pulses "activate" GABA receptors, which is weird...Please rephrase.

      This has now been reworded.

      “SICI refers to the reduction in MEP amplitude to a TMS pulse that is preceded 1-5ms by a subthreshold pulse, with this reduction believed to be mediated by GABAA neurotransmission (Chowdhury et al., 2022)”

      Reviewer #3 (Recommendations For The Authors):

      -Key references Ye et al., 2022 and Che et al., 2019 need to be included in the reference list.

      These references have now been included in the reference list.

      -Heat pain stimuli and TMS stimuli are applied simultaneously. Sometimes the term "stimulus" is used without specifying whether it refers to TMS pulses or heat pain stimuli. Clarifying this whenever the word "stimulus" is used would enhance clarity for the reader.

      We have now clarified the use of the word “stimulus” throughout the paper.

      -Panels A-D in Figure 6 should be correctly labeled in the text and the figure legend.

      Figure 6 Panel labels have now been amended.

    1. Author Response

      We thank the reviewers and the editorial team for their assessment and valuable feedback on our manuscript. Their supporting comments reinforce the significance of our findings.

      Regarding the specific point raised about the partial effects observed in the TGN46 KO cell line, we acknowledge the importance of addressing this issue in more detail in the revised version of our manuscript. The partial effects observed when using the TGN46 KO cell line are likely caused by several factors:

      1) It is important to consider the phenomenon of cell adaptation/compensation, which is documented to occur in gene knockout cell lines. Cells often respond to genetic perturbations by adapting to compensate the loss of a specific gene. These compensatory effects could potentially mitigate the full impact of TGN46 depletion and might explain the partial effects observed.

      2) Our data indicate that the absence of TGN46 reduces PAUF secretion, but does not completely block its export. These results align with our proposed role TGN46 in cargo sorting. In its absence, the secretory proteins likely exit the TGN via alternative routes/mechanisms, such as "bulk flow" or by entering other transport carriers in an uncontrolled manner. The partial redistribution of the TGN46-∆lum mutant into VSVG carriers (Figure 4D) supports this likelihood. Importantly, similar situations are observed when unrelated sorting factors are depleted from the Golgi membranes. For example, when the cofilin/SPCA1/Cab45 sorting pathway is genetically disrupted, the secretion of this pathway's clients is inhibited but not completely halted (e.g., von Blume et al. Dev. Cell 2011; J. Cell Biol. 2012).

      3) As suggested by the reviewers, it remains possible that TGN46 is not the sole player for cargo sorting. The existence of redundant or alternative mechanisms cannot be ruled out.

      In our revised manuscript, we will provide a more in-depth discussion of these factors and their potential contributions to the observed partial effects in TGN46 KO cells. We believe that a comprehensive exploration of these possibilities will improve our understanding of the role(s) of TGN46 in cargo sorting and TGN export.