6,150 Matching Annotations
  1. Feb 2021
    1. Note: This rebuttal was posted by the corresponding author to Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Reply to the reviewers

      Below is our point-by-point response:


      Reviewer #2 (Evidence, reproducibility and clarity (Required)):

      The manuscript of Lalanne and coworkers address the cellular responses to varied translation termination factor expression in Bacillus subtilis. The authors set-up a system to fine-tune the expression of release factor RF1, RF2 as well as PrmC that post-translationally modifies RF1/RF2 to maximize their catalytic hydrolysis activity. They then monitor the fitness costs associated with overexpression or depletion of the factor by following the changes in growth rate. The set-up is nicely illustrated in Figure 1. The results in Figure 2 show that overexpression of RF1 and RF2 has relatively modest effect on the growth rate compared to overexpression of PrmC that leads to dramatic growth rate reduction. By contrast, depletion of RF1 has a strong negative influence on fitness, whereas a similar level of depletion of RF2 had little influence on fitness. PrmC overexpression appears to be correlated with the induction of the sigmaB regulon, however, the authors do not manage to ascertain why this is. By contrast, RF2 depletion also results in the induction of the sigmaB regulon and the authors demonstrate convincingly that this is due to a termination defect within the rsbQ-rsbV operon that contains an overlapping start-stop AUGA

      A few points that the authors might consider discussing

      1. The natural abundance of each RF in bacteria in relation to the usage of different stop codons in different organisms.

      Response: We thank the reviewer for their suggestion. A correlation between RF abundance and stop codon usage across bacterial species has been previously reported (Korkmaz et al., 2014; Wei et al., 2016), which is corroborated by our quantification (see below). This correlation provides further evidence that the RF expression may be optimized to meet their demands in translation termination. We now include a new discussion in the main text (p. 9, lines 410-415): "Our data thus corroborate several previous lines of evidence suggesting that RF expression might be precisely tuned. First, it was found that the relative expression between RF1 and RF2 correlates with stop codon usage between different species (Korkmaz et al., 2014; Wei et al., 2016). For instance, B. subtilis has a higher abundance of RF1 and more frequent UAG usage compared to E. coli, suggesting that RF1’s expression setpoint meets translational demand (Methods).”

      Below we include additional analyses that may be of interests to the Reviewer.

      From our ribosome profiling quantification in E. coli, B. subtilis, C. crescentus, and V. natriegens (Lalanne et al., 2018), we can compare the relative usage of the three stop codons (frequency of stop codons weighted by expression) with abundances of RF1 and RF2:

      Despite the limited sample size, we find reasonable agreement with the expected correlation between codon usage and cognate RF abundance. In species with substantial differences between RF1 and RF2 abundances (E. coli and B. subtilis), the most heavily used non-UAA stop corresponds to the most highly expressed RF. This argues in favor of expression tuning of these important enzymes and is consistent with the growth optimization we directly observe.

      As a word of caution, although the low usage of UAG in E. coli and low expression of RF1 (reported long ago, e.g., (Adamski et al., 1994)) is well established, it should be noted that strain MG1655’s RF2 factor harbors a debilitating missense A246T mutation near its active site (Dinçbas-Renqvist et al., 2000), which potentially complicates interpretation of the expression of E. coli’s release factors [interestingly, we do not see any difference in RF1 and RF2 expression from ribosome profiling data in strain NCM3722, which contains the RF2 variant without the A246T mutation (JBL, unpublished data)].

      The role of the frameshifting mechanism in RF2 and how then RF1 levels are regulated.

      Response: We thank the reviewer to raising the interesting topic of release factor expression regulation. We have added a section in our discussion to comment on RF2 regulation (p. 9, lines 415-420).

      “Second, the gene encoding RF2 has a broadly conserved UGA-based frameshift event that autoregulates the expression based on its own activity (Baranov et al., 2002; Craigen and Caskey, 1986; Craigen et al., 1985). Interestingly, there are no reports of RF1 autoregulation to our knowledge, and we found that ectopic over- or under-expression does not affect its own promoter activity (Fig. S7). Therefore, a lack of autoregulation does not necessarily indicate that cells are less sensitive to small perturbations on its expression.”

      The statement above includes an additional analysis on RF1 regulation that was motivated by the Reviewer’s comment. In contrast to RF2, no definitive evidence exists on autoregulatory mechanisms for RF1. Following the Reviewer’s comment, we realized that our dataset allowed us to search for evidence of endogenous regulation in B. subtilis: our RF1 expression strain has a markerless deletion of prfA and prmC genes, leaving the surrounding regions, and notably the promoter, intact. As such, possible unbeknownst regulatory mechanisms at the promoter level could be identified in our RNA-seq data under steady-state perturbation of RF1 levels. Quantifying the expression of the 5’ untranslated region and operonic gene ywkF at the ablated prfAlocus (presented in Fig. S7, reproduced below), we find no significant changes in expression across over 30-fold range in RF1 expression, arguing against such transcriptional regulatory mechanisms. Although this does not rule out other regulatory mechanisms at the post-transcriptional level, no such mechanisms have been documented for RF1 to our knowledge.

      The authors observe queuing in front of the relevant stop codons upon RF depletion, however, do not discuss about readthrough events, which are usually competing with termination. Surprisingly, in this context the authors don't discuss the work from Mankin and coworkers showing sequestration of RFs from termination by peptides such as apideacin leads to translational readthrough.

      Response: We concur with the Reviewer about the importance of the recent work from Mankin et al. This paper was referenced in our original submission, but our literature management software improperly formatted its citation. The corrected reference to (Mangano et al., 2020) is now included in the revised manuscript.

      Translational readthrough is indeed clearly visible in our ribosome profiling data from acute CRISPRi knockdown of RF1/PrmC and RF2. Using an approach analogous to Mangano and Florin et al, we quantified readthrough as the ribosome footprint density downstream of the stop codon (+5 to +45 bp) to the density in the gene body for isolated genes (no codirectional genes within 55 bp). We find five-fold increase in the median readthrough for genes that are terminated by the RF under perturbation (shown in a new panel in the main text, Fig. 4b, reproduced below). This new analysis is included in the section regarding translational phenotypes identified from ribosome profiling under RF depletion, p. 7, lines 309-312.

      “The stop-codon-specific queuing is associated with translational readthrough downstream (Fig. 4b), consistent with a recent observation based on inhibition of peptide release by the antimicrobial apidaecin in E. coli (Mangano et al., 2020).”

      This additional analysis, in conjunction with (Mangano et al., 2020), also allows us to calibrate the depletion of RFs in our non steady-state CRISPRi perturbation. Given that apidaecin treatment (shown to lead to a nearly complete depletion of free RF in the cell) causes a >100-fold increase in readthrough, this suggests that our CRISPRi perturbation experiments only led to partial RF depletion at the moment of cell harvesting.

      The efficiency of translation termination is well-known to be dependent on the context of the stop codon. Do the authors also observe such a trend. Especially, UGAC for RF2, one would expect to observe high levels of readthrough upon RF2 depletion.

      Response: Further assessment of the sequence determinants that dictate susceptibility of certain genes and regulatory elements to RF perturbation is of great interest. We now include additional analyses for the effect of stop codon context on readthrough.

      In our RF2 CRISPRi knockdown data, stratifying the translational readthrough (data from Fig. 4b) by stop codon and its next nucleotide, we observe only a modest (≈2×, p“We also observed a trend of tetranucleotide-dependent (UGAN) readthrough for RF2 knockdowns (Methods, Appendix Fig. 2) consistent with previous characterizations (Poole et al., 1995).”

      As an additional point of interest, the importance of the 4th nucleotide in termination has not been studied outside of E. coli. Although indirect, one way to assess the influence of the 4th nucleotide is to determine the aggregated usage of each tetranucleotide stop signal by ribosome profiling. Interestingly, and as pointed out by the Reviewer, whereas E. coli (MG1655) displays a 16× increase in usage between the maximum UGAU (tetranucleotide usage 0.064) and minimum UGAC (tetranucleotide usage 0.004), no such difference is observed in B. subtilis (usage for UGAU and UGAC both at 0.015), suggesting that the immediate sequence context surrounding stop codons could have different consequences in different species.

      Reviewer #2 (Significance (Required)):

      Overall, the experiments are clearly performed and beautifully illustrated. Clearly, a lot of work has gone into this study but the end message that the cell regulates carefully RF concentrations is not surprising. Especially given that RF2 carefully regulates its own levels using an autoregulatory frameshifting mechanism. The major finding that the rsbQ-rsbV operon with the RF2 dependence leading to induction of the sigmaB regulon is in the end rather trivial since these regulators depend on RF2 for termination. Therefore, this manuscript is unlikely to have general interest to people in the translation field (such as myself) but rather those working in the field of synthetic biology.

      Response: We thank the Reviewer for their positive assessment of our presentation and experimental methods, and for their judgment that our work will be of interest to synthetic biologists.

      In our study, we used translation as a well-characterized system to interrogate the cellular response when enzyme concentrations are perturbed. Because the system is so well characterized, it allowed to ask whether the fitness effects are due to perturbations to the translation flux itself, or rather driven by spurious distal connections in the regulatory network. The end message we wish to convey is that enzyme expression is entrenched by spurious regulatory connections, suggesting that predictive bottom-up models of expression-fitness landscapes will require near-exhaustive characterization of parts.

      Although our focus is on the cellular response, there are several interesting findings related to translation. First, we show that even though RF1 and PrmC are not subject to the strict autoregulation as RF2 is, cell growth is similarly or even more sensitive to RF1 and PrmC abundance. Second, among the numerous regulators that depend on RF2 for termination, RbsV/RbsW is exceptionally sensitive to RF2 depletion (Fig. 4e). This result not only points to our incomplete understanding of translation regarding what makes this pair particularly susceptible, and further underscores the spurious nature of the cellular response to perturbations. We have expanded the discussions on the implication of these findings in the revised manuscript.


      Reviewer #3 (Evidence, reproducibility and clarity (Required)):

      In this paper, the authors use a combination of RNA sequencing, ribosome profiling and measurements of cellular composition and growth rate to gain insight into the multi-scale affects that perturbations to translation termination factors have on general physiological states and reproductive fitness using Bacillus subtilis as their model organism. Specifically, they find that perturbing the expression levels of peptide chain release factors in any direction has a negative effect on growth-rate. This negative effect was not due to a direct impact of the gene on the cell, but instead due to a chain of regulatory interactions that cause the activation of the general stress regulon. This leads to upregulation of a large chunk of the genome and an indirect impact on the expression of all other genes. Critically, the knock-on effects observed for the specific perturbations studied suggest that it may be difficult to predict expression-fitness landscapes of a cell, without carrying out a detailed mapping of all genes and the cell's physiological state.

      Overall, the core findings in the paper are well justified by the data presented and the experiments appear to have been rigorously carried out.

      Response: We thank the reviewer for their positive assessment.

      My only concern is that it is unclear if biological replicates of the ribosome profiling were performed. Also, biological replicates are mentioned for the RNA-seq data, but no data is shown. Even a simple graph demonstrating the expression levels across these would be useful to be assured of no issues in reproducibility given the complex processing of the data involved.

      Response: We now include additional analyses for biological replicates of RNA-seq and ribosome profiling experiments, which show the same high degree of reproducibility as we have demonstrated in previous studies (Johnson et al., 2020; Lalanne et al., 2018; Li et al., 2014).

      With respect to RNA-seq quantification, we compared our 6 wild-type datasets (biological replicates except for different inert inducer concentrations, using the same batch of conditioned MCC medium) against each other in all possible pairs. The data is now included as Appendix Fig. 1a (referred to in the main text, p. 4, line 138), and is reproduced below. Across pairs, the mRNA level quantification shows a median FC1090 (10th and 90th percentile in fold-change) between 0.86 to 1.16, and median R2 of log-transformed data at 0.99. These statistics showcasing reproducibility of our RNA-seq methodology are now included in our description of our RNA-seq approach in the Methods, p. S8, lines 313-320.

      Regarding ribosome profiling quantification, we now include comparisons between pairs of two replicates for wild type cells, and pairs of replicates wild-type with inert fluorescent protein expression, each pair of samples with their own batch of conditioned MCC medium. These samples were taken under different inducer concentrations, which are expected to affect the expression of two genes and not others. As indicated in Appendix Fig. 1b and reproduced below, the Pearson correlation of log-transformed footprint density is respectively of R2=0.98 and 0.99 (genes with >100 reads mapped), with a 10th to 90th percentile of fold-changes between 0.83 to 1.17, and 0.91 to 1.12. These results are described in the Methods, p. S9, lines 339-345.

      Related to this, I see no mention of data availability in the paper. For this study to be useful to others, providing the raw data (unprocessed) would be essential (ideally in a public repository).

      Response: We are sorry that the statement on data availability was buried in the original Methods section that was not a part of the merged PDF file. The raw sequencing data were submitted to Gene Expression Omnibus under the accession number GSE162169. The processed data, including fitness scores, mRNA levels, protein synthesis rates, were included as Supplementary Data Tables 1-9. We now moved the data availability statement to the main document at p. 12, lines 512-516.

      The presentation of the work is excellent, with very clear figures and text that helped guide the reader through the results. There were a few minor comments:

      1. Abstract: "in bacterium Bacillus subtilis" should read "in the bacterium Bacillus subtilis".

      Response: This typo is now corrected.

      Page 4: "found that under numerous ways" should read "found that under the numerous ways".

      Response: This typo is now corrected.

      The authors mention that changes in the expression level of RF1 impacted motility and biofilm genes, but not how this impacts fitness. Would they be able to experimentally identify origin of RF1 growth defects in the same way they did for PrmC? This is not essential for the main findings but would help strengthen the work.

      Response: The cause of the growth defect under RF1 knockdown is indeed interesting. We now present evidence ruling out the hypothesis that the growth defect is caused by the expression decrease for motility and biofilm genes.

      This hypothesis is driven by our result that ablation of SigB regulon rescues the fitness defect during PrmC overexpression (Fig. 3g) and by the observed downregulation of motility and lyt operons and upregulation of the eps operon during RF1 knockdown. To test this hypothesis, we used a strain without sigD (the motility sigma factor), which displays similar expression changes to what we observed in RF1 knockdown (Chai et al., 2009). Comparing the growth rates of wild-type to DsigD, we found only a slight difference (30% growth defect measured upon RF1 knockdown, it appears that transcriptional changes to the motility regulon can only partially explain of the RF1 growth defect. These results are discussed on p. 10, lines 459-463. Further assessment will constitute interesting future research avenues.

      It is difficult to know how generalisable the findings of this work are due to the very limited scope. It could be helpful for the authors in the discussion to consider and comment on how such approaches might be scaled-up to enable broader and more general studies of expression-fitness landscapes and where they will find most use.

      Response: Indeed, the spurious nature of the expression-fitness landscape makes it difficult to generalize the exact mechanisms that we described here to other proteins. However, what is generalizable is our conclusion that such spurious connections limit the feasibility of bottom-up models for predicting fitness landscapes unless one has near-exhaustive characterization of all parts.

      Our approach of mechanistic profiling of cell states under perturbations therefore provides a path forward that can be scaled up by recent developments in multiscale measurements. We now include a discussion for broader and more general studies on p. 11, lines 473-480.

      “Various strategies can now generate expression-fitness landscapes for a large number of genes in parallel, for example using suites of promoters (Keren et al., 2016), genome-scale library of inducible gene expression (Arita et al., 2021), or tunable CRISPR perturbations (Hawkins et al., 2020; Jost et al., 2020; Mathis et al., 2021). Together with the advent of single-cell transcriptomics in bacteria (Blattman et al., 2020; Imdahl et al., 2020; Kuchina et al., 2020), these methods open the possibility of dissecting the molecular underpinnings of expression-fitness landscapes genome-wide, and to comprehensively identify instances of regulatory entrenchment.”

      Reviewer #3 (Significance (Required)):

      This work has a number of contributions. Firstly, it demonstrates how to combine several complementary sequencing approaches to characterize in detail the transcriptional and translational state of a cell, as well as its overall growth rate to generate comprehensive expression-fitness maps. Secondly, it shows how the interwoven nature of cellular regulatory networks and the molecular interactions encoded within the genome can lead to cryptic responses in cellular behavior and fitness at a system-level that can only be understood by taking a detailed "bottom-up" approach. Finally, it suggests that some of these regulatory interactions may in fact "entrench" an organism's evolutionary path, by causing small genetic perturbations to propagate and potentially amplify their negative effect. While the results are compelling and well supported by experiments, the limited scope of the work makes it difficult to know whether this is in fact a rare or common occurrence. However, I do believe there is significance to these findings and that it will likely spur further studies to assess the generality of these findings.

      Overall, I believe the work will have a wide appeal covering areas such as Systems Biology, Gene Regulation, Evolution, Quantitative Biology, Sequencing, High-throughput Technologies.

      Response: We thank the reviewer for their assessment that our work will be of appeal to a broad audience.

      My field of expertise is in the quantitative measurement of core cellular processes (e.g. transcription and translation) using novel sequencing techniques and the application of this knowledge to biological design. As such, I believe I have sufficient expertise to review this paper in detail.

      Response references

      Adamski, F.M., McCaughan, K.K., Jørgensen, F., Kurland, C.G., and Tate, W.P. (1994). The concentration of polypeptide chain release factors 1 and 2 at different growth rates of Escherichia coli. J. Mol. Biol. 238, 302–308.

      Arita, Y., Kim, G., Li, Z., Friesen, H., Turco, G., Wang, R.Y., Climie, D., Usaj, M., Hotz, M., Stoops, E., et al. (2021). A genome-scale yeast library with inducible expression of individual genes. BioRxiv 2020.12.30.424776.

      Baranov, P. V, Gesteland, R.F., and Atkins, J.F. (2002). Release factor 2 frameshifting sites in different bacteria. 3, 373–377.

      Blattman, S.B., Jiang, W., Oikonomou, P., and Tavazoie, S. (2020). Prokaryotic single-cell RNA sequencing by in situ combinatorial indexing. Nat. Microbiol. 5, 1192–1201.

      Chai, Y., Normam, T., Kolter, R., and Losick, R. (2009). An epigenetic switch governing daughter cell separation in Bacillus subtilis. Genes Dev. 7824, 754–765.

      Craigen, W.J., and Caskey, C.T. (1986). Expression of peptide chain release factor 2 requires high-efficiency frameshift. Nature 322, 273–275.

      Craigen, W.J., Cook, R.G., Tate, W.P., and Caskey, C.T. (1985). Bacterial peptide chain release factors: Conserved primary structure and possible frameshift regulation of release factor 2. Proc. Natl. Acad. Sci. U. S. A. 82, 3616–3620.

      Dinçbas-Renqvist, V., Engström, Å., Mora, L., Heurgué-Hamard, V., Buckingham, R., and Ehrenberg, M. (2000). A post-translational modification in the GGQ motif of RF2 from Escherichia coli stimulates termination of translation. EMBO J. 19, 6900–6907.

      Hawkins, J.S., Silvis, M.R., Koo, B.M., Peters, J.M., Osadnik, H., Jost, M., Hearne, C.C., Weissman, J.S., Todor, H., and Gross, C.A. (2020). Mismatch-CRISPRi Reveals the Co-varying Expression-Fitness Relationships of Essential Genes in Escherichia coli and Bacillus subtilis. Cell Syst. 11, 523-535.e9.

      Imdahl, F., Vafadarnejad, E., Homberger, C., Saliba, A.E., and Vogel, J. (2020). Single-cell RNA-sequencing reports growth-condition-specific global transcriptomes of individual bacteria. Nat. Microbiol. 5, 1202–1206.

      Johnson, G.E., Lalanne, J.B., Peters, M.L., and Li, G.W. (2020). Functionally uncoupled transcription–translation in Bacillus subtilis. Nature 585, 124–128.

      Jost, M., Santos, D.A., Saunders, R.A., Horlbeck, M.A., Hawkins, J.S., Scaria, S.M., Norman, T.M., Hussmann, J.A., Liem, C.R., Gross, C.A., et al. (2020). Titrating gene expression using libraries of systematically attenuated CRISPR guide RNAs. Nat. Biotechnol. 38, 355–364.

      Keren, L., Hausser, J., Lotan-Pompan, M., Vainberg Slutskin, I., Alisar, H., Kaminski, S., Weinberger, A., Alon, U., Milo, R., and Segal, E. (2016). Massively Parallel Interrogation of the Effects of Gene Expression Levels on Fitness. Cell 166, 1282-1294.e18.

      Korkmaz, G., Holm, M., Wiens, T., and Sanyal, S. (2014). Comprehensive analysis of stop codon usage in bacteria and its correlation with release factor abundance. J. Biol. Chem. 289, 30334–30342.

      Kuchina, A., Brettner, L.M., Paleologu, L., Roco, C.M., Rosenberg, A.B., Carignano, A., Kibler, R., Hirano, M., William DePaolo, R., and Seelig, G. (2020). Microbial single-cell RNA sequencing by split-pool barcoding. Science (80-. ).

      Lalanne, J.B., Taggart, J.C., Guo, M.S., Herzel, L., Schieler, A., and Li, G.W. (2018). Evolutionary Convergence of Pathway-Specific Enzyme Expression Stoichiometry. Cell 749–761.

      Li, G.W., Burkhardt, D., Gross, C., and Weissman, J.S. (2014). Quantifying absolute protein synthesis rates reveals principles underlying allocation of cellular resources. Cell 157, 624–635.

      Mangano, K., Florin, T., Shao, X., Klepacki, D., Chelysheva, I., Ignatova, Z., Gao, Y., Mankin, A.S., and Vázquez-Laslop, N. (2020). Genome-wide effects of the antimicrobial peptide apidaecin on translation termination in bacteria. Elife 9, 1–24.

      Mathis, A.D., Otto, R.M., and Reynolds, K.A. (2021). A simplified strategy for titrating gene expression reveals new relationships between genotype, environment, and bacterial growth. Nucleic Acids Res. 49, e6.

      Poole, E.S., Brown, C.M., and Tate, W.P. (1995). The identity of the base following the stop codon determines the efficiency of in vivo translational termination in Escherichia coli. EMBO J. 14, 151–158.

      Wei, Y., Wang, J., and Xia, X. (2016). Coevolution between Stop Codon Usage and Release Factors in Bacterial Species. Mol. Biol. Evol. 33, 2357–2367.

    2. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #3

      Evidence, reproducibility and clarity

      In this paper, the authors use a combination of RNA sequencing, ribosome profiling and measurements of cellular composition and growth rate to gain insight into the multi-scale affects that perturbations to translation termination factors have on general physiological states and reproductive fitness using Bacillus subtilis as their model organism. Specifically, they find that perturbing the expression levels of peptide chain release factors in any direction has a negative effect on growth-rate. This negative effect was not due to a direct impact of the gene on the cell, but instead due to a chain of regulatory interactions that cause the activation of the general stress regulon. This leads to upregulation of a large chunk of the genome and an indirect impact on the expression of all other genes. Critically, the knock-on effects observed for the specific perturbations studied suggest that it may be difficult to predict expression-fitness landscapes of a cell, without carrying out a detailed mapping of all genes and the cell's physiological state.

      Overall, the core findings in the paper are well justified by the data presented and the experiments appear to have been rigorously carried out. My only concern is that it is unclear if biological replicates of the ribosome profiling were performed. Also, biological replicates are mentioned for the RNA-seq data, but no data is shown. Even a simple graph demonstrating the expression levels across these would be useful to be assured of no issues in reproducibility given the complex processing of the data involved. Related to this, I see no mention of data availability in the paper. For this study to be useful to others, providing the raw data (unprocessed) would be essential (ideally in a public repository).

      The presentation of the work is excellent, with very clear figures and text that helped guide the reader through the results. There were a few minor comments:

      1. Abstract: "in bacterium Bacillus subtilis" should read "in the bacterium Bacillus subtilis".
      2. Page 4: "found that under numerous ways" should read "found that under the numerous ways".
      3. The authors mention that changes in the expression level of RF1 impacted motility and biofilm genes, but not how this impacts fitness. Would they be able to experimentally identify origin of RF1 growth defects in the same way they did for PrmC? This is not essential for the main findings but would help strengthen the work.
      4. It is difficult to know how generalisable the findings of this work are due to the very limited scope. It could be helpful for the authors in the discussion to consider and comment on how such approaches might be scaled-up to enable broader and more general studies of expression-fitness landscapes and where they will find most use.

      Significance

      This work has a number of contributions. Firstly, it demonstrates how to combine several complementary sequencing approaches to characterize in detail the transcriptional and translational state of a cell, as well as its overall growth rate to generate comprehensive expression-fitness maps. Secondly, it shows how the interwoven nature of cellular regulatory networks and the molecular interactions encoded within the genome can lead to cryptic responses in cellular behavior and fitness at a system-level that can only be understood by taking a detailed "bottom-up" approach. Finally, it suggests that some of these regulatory interactions may in fact "entrench" an organism's evolutionary path, by causing small genetic perturbations to propagate and potentially amplify their negative effect. While the results are compelling and well supported by experiments, the limited scope of the work makes it difficult to know whether this is in fact a rare or common occurrence. However, I do believe there is significance to these findings and that it will likely spur further studies to assess the generality of these findings.

      Overall, I believe the work will have a wide appeal covering areas such as Systems Biology, Gene Regulation, Evolution, Quantitative Biology, Sequencing, High-throughput Technologies.

      My field of expertise is in the quantitative measurement of core cellular processes (e.g. transcription and translation) using novel sequencing techniques and the application of this knowledge to biological design. As such, I believe I have sufficient expertise to review this paper in detail.

    3. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #2

      Evidence, reproducibility and clarity

      The manuscript of Lalanne and coworkers address the cellular responses to varied translation termination factor expression in Bacillus subtilis. The authors set-up a system to fine-tune the expression of release factor RF1, RF2 as well as PrmC that post-translationally modifies RF1/RF2 to maximize their catalytic hydrolysis activity. They then monitor the fitness costs associated with overexpression or depletion of the factor by following the changes in growth rate. The set-up is nicely illustrated in Figure 1. The results in Figure 2 show that overexpression of RF1 and RF2 has relatively modest effect on the growth rate compared to overexpression of PrmC that leads to dramatic growth rate reduction. By contrast, depletion of RF1 has a strong negative influence on fitness, whereas a similar level of depletion of RF2 had little influence on fitness. PrmC overexpression appears to be correlated with the induction of the sigmaB regulon, however, the authors do not manage to ascertain why this is. By contrast, RF2 depletion also results in the induction of the sigmaB regulon and the authors demonstrate convincingly that this is due to a termination defect within the rsbQ-rsbV operon that contains an overlapping start-stop AUGA

      A few points that the authors might consider discussing

      1. The natural abundance of each RF in bacteria in relation to the usage of different stop codons in different organisms.
      2. The role of the frameshifting mechanism in RF2 and how then RF1 levels are regulated.
      3. The authors observe queuing in front of the relevant stop codons upon RF depletion, however, do not discuss about readthrough events, which are usually competing with termination. Surprisingly, in this context the authors don't discuss the work from Mankin and coworkers showing sequestration of RFs from termination by peptides such as apideacin leads to translational readthrough.
      4. The efficiency of translation termination is well-known to be dependent on the context of the stop codon. Do the authors also observe such a trend. Especially, UGAC for RF2, one would expect to observe high levels of readthrough upon RF2 depletion.

      Significance

      Overall, the experiments are clearly performed and beautifully illustrated. Clearly, a lot of work has gone into this study but the end message that the cell regulates carefully RF concentrations is not surprising. Especially given that RF2 carefully regulates its own levels using an autoregulatory frameshifting mechanism. The major finding that the rsbQ-rsbV operon with the RF2 dependence leading to induction of the sigmaB regulon is in the end rather trivial since these regulators depend on RF2 for termination. Therefore, this manuscript is unlikely to have general interest to people in the translation field (such as myself) but rather those working in the field of synthetic biology.

    4. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #1

      This reviewer did not leave any comments

    1. Note: This rebuttal was posted by the corresponding author to Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Reply to the reviewers

      Reviewer response

      We thank the reviews for the careful reviews, and were delighted to see that they assessed both the quality and significance of the work so highlty.

      Reviewer #1 (Evidence, reproducibility and clarity (Required)):

      The authors investigated the cross-neutralization capacity of serum antibodies to past and future 229E coronaviruses using 229E spikes isolated from five time points and sera from two different periods (1985-1995 and 2020). They demonstrated a general pattern of asymmetric cross-neutralization, with sera cross-reactive to historical but not future strains. Using chimeras, the authors showed this pattern was mostly driven by antibodies to the evolving RBD. The rate of change in the neutralization titer, a possible measure of antigenic evolution, was estimated to be on par with that of flu B viruses. Interesting differences in individuals' cross-neutralization capacity were observed. The main take-away is that reinfection with 229E is enabled by antigenic escape, not "weak" immunity after infection (as proposed by others).

      Thanks for the excellent summary of the paper. We agree with it, although we would note that our work does not exclude “weak immunity” as a possible compounding explanation for re-infection in addition to the antigenic evolution we demonstrate.

      **Major comments:**

      The key conclusions are convincing and justified by the data. The work is clearly presented and presented with sufficient detail for reproducibility. Characteristically and laudably, the authors have made all the code and data publicly available on GitHub.

      Thanks for the favorable summary.

      **Minor comments:**

      p 3: Perhaps it is clearer to write that 229E has been identified/isolated in humans for >50 y? Or do you really mean to imply (by contrast with "circulated") that NL63 emerged very recently?

      This is a good suggestion. We really do not know how long either CoV-229E or CoV-NL63 have been circulating humans, only that CoV-229E was first isolated >50 years ago whereas CoV-NL63 was first identified only in 2003. It is possible both viruses have been circulating for longer than that. We have made the suggested change to clarify.

      p 3: An important citation for the antigenic implications of the ladder-like phylogeny AND phylogenetic clustering by date is the classic paper introducing phylodynamics by Grenfell et al. (2004, Science).

      Thanks for pointing out this citation; we have added it.

      p 4: I might not be like all readers, but I prefer to see a bit in the main text about the source of sera for this kind of study. (I wonder about age, if donors are healthy, etc.)

      This is a good question, and we have expanded on it in both the main text and the methods. Briefly, the sera were all from apparently healthy individuals, and no information about recent respiratory virus infections were available. We have provided the age of the serum donor (at the time of serum collection) above the title of each plot showing person-specific neutralization data.

      p 4: "Our reason for focusing..." stops short. Is the idea that these are probably people who were recently infected?

      This is a good question, and we have elaborated in the revised text. We don’t have any direct information on whether the individuals had recent infections, although that seems plausible. More pragmatically, we reasoned that sera that had reasonably high initial titers would provide better dynamic range to see how titers changed as the virus evolved given our assay has a lower limit of detection.

      p 5: Probably my biggest suggestion for the paper is that it mention another relevant study. In 1980, Anne Underwood demonstrated similar asymmetric cross-immunity among early strains of H3N2 (but using rabbits, not human sera), finding that antibodies raised to one strain reacted more strongly by HAI to past strains than to later strains (doi: 10.1128/IAI.27.2.397-404.1980). This relates to the significance of the paper (next section).

      Thanks, this is a good and relevant citation, and we have added it when we discuss the possible asymmetry of antigenic change with respect to time.

      Obviously, there are citations to update throughout due to the booming SARS-CoV-2 literature.

      We have updated the other citations to keep pace with the fast-changing literature!

      Reviewer #1 (Significance (Required)):

      This study, if anything, undersells itself. Obviously it is a huge contribution to our understanding of how a seasonal coronavirus that bears important phenotypic resemblance to SARS-CoV-2 evolves, but I think it is also providing a foundational piece of evidence--a mechanism--of how rapid viral turnover (by antigenic evolution) occurs. There is no reason to think this should be limited to the coronaviruses, and I suspect the evidence here will go a long way to unifying the evolutionary and epidemiological dynamics of fast-evolving viruses.

      Thanks for the praise of the manuscript. Indeed, we were surprised to find that no similarly designed studies have been done even for influenza virus, and so are now interested in expanding our future work to do that as we fully agree it could provide insight more broadly.

      Asymmetric competition is nearly an ecological requirement for one strain to successfully invade and displace another. It is thought (unsure how widely?) that flu evolves antigenically, with new strains eventually displacing old ones, by mutating at key epitopes in ways that the immune system does not immediately pick up. That is, immune memory is biased to recall responses to conserved epitopes, which on average are probably less neutralizing. This will induce competition between mutant and resident viruses, but it would be symmetric, since infection with either would induce responses to conserved epitopes on the other. But if on infection with the mutant, immune memory sometimes reuses (boosts) antibody responses to target the mutated epitopes, those recycled antibodies might be less effective against the mutant, making the competition asymmetric.

      What this paper and Underwood (1980) suggest is that we can get this asymmetric, antibody-mediated competition fairly easily and without extensive memory. Underwood showed this more powerfully in rabbits, but in this paper too we see an indirect suggestion of asymmetry in relatively inexperienced children (Fig. 3). Mutants (future strains) successfully invade when they can trigger presumably recalled antibodies that are more harmful to the resident (soon historical) strain than the mutant. If this is so easy to do, as judged by the extensive data here, then it could be common.

      I've gone off on a theoretical limb here, but the paper is still important without these considerations. This work will be of interest to evolutionary biologists, epidemiologists, vaccinologists, and everyone else wondering what SARS-CoV-2 will do next and how immunity to antigenically variable pathogens works.

      We completely agree with the ideas mentioned above, and appreciate having it put in this nice context, particularly alongside the Underwood paper (with which we were not previously familiar). That said, we believe that the small number of recent children sera samples in the current study preclude us from drawing strong conclusions about the asymmetry--as the reviewer says, our data provides an indirect suggestion too. So overall we have not tried to expand this angle here because as the reviewer says, the paper is still important without these considerations. However, we are actively working to see if we can design a similar study with more children sera in the future to separately address the questions about asymmetry.

      Reviewer #2 (Evidence, reproducibility and clarity (Required)):

      An important question in coronavirology is what governs their ability to seemingly reinfect people regularly (within 2 or 3 years). While waning protective immunity has been proposed and is of current concern for SARS CoV-2, the role of antigenic drift driven by escape from neutralizing antibodies has not been well characterized. The authors have attempted to look at this through examining historical Spike proteins from HCoV-229E over a period of 30-odd years. The authors show that 229E evolves along a linear trajectory consistent with yearly selection by pre-existing immunity. Taking representative spike proteins from different time points into pseudovirus neut assays, they find that older spike proteins are less sensitive to neut by more recent sera. Conversely, spike proteins from prior to the birth of an individual display markedly less sensitivity to neut that those prevalent during the persons lifetime. Sequence analysis of the spike shows variation accruing in both N-termina regions and the RBD, parts of spike predominantly targeted by nABs. Lastly producing early spikes with chimeric RBDs from late viruses enhances the sensitivity to more recent sera.

      This is a potentially important MS that addresses a pertinent question that is of wide interest for the CoV2 pandemic. While it is limited in addressing the relative contribution of antigenic escape vs waning Ab titers because of the nature of the sample, the MS makes a strong case for Spike evolution being driven by antigenic escape.

      Thanks for the summary. We agree that our paper does not really address waning immunity because we don’t have sequential serum samples from the same individual. However, it does clearly show that antigenic evolution is important independent of waning immunity, because all of the experiments (e.g., Figure 2 and 3) show the same serum sample tested against newer spikes, and neutralization titers definitely decrease as the spike evolves. The reviewer is correct that this doesn’t rule out the possibility of waning immunity as a separate phenomenon, and we have been sure to emphasize that in the revised text.

      Reviewer #2 (Significance (Required)):

      While the Figs 1-3 are clear, the data in Fig 4 is somewhat preliminary. In all likelihood many people are making neutralizing antibodies both against RBD and the N-terminal region and the relative proportion probably underlies the variability in the data in Fig 4B. I think the MS would benefit from the following:

      A comparison of NTD vs RBD vs NTD/RBD chimeras in Fig 4B to give a fuller picture of antigenic escape with statistical support.

      The reviewer is correct that our manuscript does not provide a decisive answer on the relative role of NTD versus RBD targeting antibodies, although the data in Fig. 4B clearly show that RBD antibodies are important for many individuals as simply changing the RBD to that of newer viruses recapitulates the full spike antigenic evolution without any changes in the NTD or elsewhere (e.g., subject SD87_2 or SD85_3 in Fig 4B). However, for some other individuals NTD antibodies may play a role.

      In general, full dissection of the role of RBD versus NTD antibodies is beyond the scope of our study (and in some cases not even possible with the available volumes of the older serum). In any case, the major point of our study—the first experimental demonstration that seasonal coronaviruses undergo antigenic evolution—does not depend on dissecting the relative roles of RBD and NTD antibodies. We have therefore added new text explaining that we cannot fully parse the relative role of antibodies to these domains beyond knowing that RBD antibodies play n important role. We have added text to emphasize that antibodies to other regions including the NTD could also be important.

      A figure to map the polymorphic residues in Fig 4A onto the 229E spike structure to visualise their position and special relatedness, with perhaps a comparison with the latest knowledge of SASR CoV-2 epitopes.

      We agree that visualizing the variable sites on the structure is useful and have added such a visualization as a new panel in Figure 4. This allows us to more clearly show the clustering of variability in the RBD and NTD. This clustering of mutations in those regions is consistent with what is currently being seen with the emergence of SARS-CoV-2 variants with mutations in those regions of spike. However, given the divergence between SARS-CoV-2 and CoV-229E, we are not able to do a more fine-grained comparison of epitope sites as many important sites in the RBD and NTD do not have a clear one-to-one alignment (for instance, the RBD’s don’t even bind the same receptor).

      Additional discussion to reflect the new SARS CoV-2 variants and their potential selection by escape in the light of the authors data.

      We have updated the manuscript to describe the new SARS-CoV-2 variants (which mostly emerged after submission of our original manuscript) and how this emerging antigenic evolution of SARS-CoV-2 is consistent with what we saw in CoV-229E.

    2. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #2

      Evidence, reproducibility and clarity

      An important question in coronavirology is what governs their ability to seemingly reinfect people regularly (within 2 or 3 years). While waning protective immunity has been proposed and is of current concern for SARS CoV-2, the role of antigenic drift driven by escape from neutralizing antibodies has not been well characterized. The authors have attempted to look at this through examining historical Spike proteins from HCoV-229E over a period of 30-odd years. The authors show that 229E evolves along a linear trajectory consistent with yearly selection by pre-existing immunity. Taking representative spike proteins from different time points into pseudovirus neut assays, they find that older spike proteins are less sensitive to neut by more recent sera. Conversely, spike proteins from prior to the birth of an individual display markedly less sensitivity to neut that those prevalent during the persons lifetime. Sequence analysis of the spike shows variation accruing in both N-termina regions and the RBD, parts of spike predominantly targeted by nABs. Lastly producing early spikes with chimeric RBDs from late viruses enhances the sensitivity to more recent sera.

      This is a potentially important MS that addresses a pertinent question that is of wide interest for the CoV2 pandemic. While it is limited in addressing the relative contribution of antigenic escape vs waning Ab titers because of the nature of the sample, the MS makes a strong case for Spike evolution being driven by antigenic escape.

      Significance

      While the Figs 1-3 are clear, the data in Fig 4 is somewhat preliminary. In all likelihood many people are making neutralizing antibodies both against RBD and the N-terminal region and the relative proportion probably underlies the variability in the data in Fig 4B. I think the MS would benefit from the following:

      • A comparison of NTD vs RBD vs NTD/RBD chimeras in Fig 4B to give a fuller picture of antigenic escape with statistical support.

      • A figure to map the polymorphic residues in Fig 4A onto the 229E spike structure to visualise their position and special relatedness, with perhaps a comparison with the latest knowledge of SASR CoV-2 epitopes.

      • Additional discussion to reflect the new SARS CoV-2 variants and their potential selection by escape in the light of the authors data.

    3. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #1

      Evidence, reproducibility and clarity

      The authors investigated the cross-neutralization capacity of serum antibodies to past and future 229E coronaviruses using 229E spikes isolated from five time points and sera from two different periods (1985-1995 and 2020). They demonstrated a general pattern of asymmetric cross-neutralization, with sera cross-reactive to historical but not future strains. Using chimeras, the authors showed this pattern was mostly driven by antibodies to the evolving RBD. The rate of change in the neutralization titer, a possible measure of antigenic evolution, was estimated to be on par with that of flu B viruses. Interesting differences in individuals' cross-neutralization capacity were observed. The main take-away is that reinfection with 229E is enabled by antigenic escape, not "weak" immunity after infection (as proposed by others).

      Major comments:

      The key conclusions are convincing and justified by the data. The work is clearly presented and presented with sufficient detail for reproducibility. Characteristically and laudably, the authors have made all the code and data publicly available on GitHub.

      Minor comments:

      p. 3: Perhaps it is clearer to write that 229E has been identified/isolated in humans for >50 y? Or do you really mean to imply (by contrast with "circulated") that NL63 emerged very recently?

      p. 3: An important citation for the antigenic implications of the ladder-like phylogeny AND phylogenetic clustering by date is the classic paper introducing phylodynamics by Grenfell et al. (2004, Science).

      p. 4: I might not be like all readers, but I prefer to see a bit in the main text about the source of sera for this kind of study. (I wonder about age, if donors are healthy, etc.)

      p. 4: "Our reason for focusing..." stops short. Is the idea that these are probably people who were recently infected?

      p. 5: Probably my biggest suggestion for the paper is that it mention another relevant study. In 1980, Anne Underwood demonstrated similar asymmetric cross-immunity among early strains of H3N2 (but using rabbits, not human sera), finding that antibodies raised to one strain reacted more strongly by HAI to past strains than to later strains (doi: 10.1128/IAI.27.2.397-404.1980). This relates to the significance of the paper (next section).

      Obviously, there are citations to update throughout due to the booming SARS-CoV-2 literature.

      Significance

      This study, if anything, undersells itself. Obviously it is a huge contribution to our understanding of how a seasonal coronavirus that bears important phenotypic resemblance to SARS-CoV-2 evolves, but I think it is also providing a foundational piece of evidence--a mechanism--of how rapid viral turnover (by antigenic evolution) occurs. There is no reason to think this should be limited to the coronaviruses, and I suspect the evidence here will go a long way to unifying the evolutionary and epidemiological dynamics of fast-evolving viruses.

      Asymmetric competition is nearly an ecological requirement for one strain to successfully invade and displace another. It is thought (unsure how widely?) that flu evolves antigenically, with new strains eventually displacing old ones, by mutating at key epitopes in ways that the immune system does not immediately pick up. That is, immune memory is biased to recall responses to conserved epitopes, which on average are probably less neutralizing. This will induce competition between mutant and resident viruses, but it would be symmetric, since infection with either would induce responses to conserved epitopes on the other. But if on infection with the mutant, immune memory sometimes reuses (boosts) antibody responses to target the mutated epitopes, those recycled antibodies might be less effective against the mutant, making the competition asymmetric.

      What this paper and Underwood (1980) suggest is that we can get this asymmetric, antibody-mediated competition fairly easily and without extensive memory. Underwood showed this more powerfully in rabbits, but in this paper too we see an indirect suggestion of asymmetry in relatively inexperienced children (Fig. 3). Mutants (future strains) successfully invade when they can trigger presumably recalled antibodies that are more harmful to the resident (soon historical) strain than the mutant. If this is so easy to do, as judged by the extensive data here, then it could be common.

      I've gone off on a theoretical limb here, but the paper is still important without these considerations. This work will be of interest to evolutionary biologists, epidemiologists, vaccinologists, and everyone else wondering what SARS-CoV-2 will do next and how immunity to antigenically variable pathogens works.

    1. Note: This rebuttal was posted by the corresponding author to Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Reply to the reviewers

      Reviewer #1 (Evidence, reproducibility and clarity (Required)):

      **Summary:**

      This study of Nils Halberg and colleagues aims to characterize tumor-associated immune cell

      infiltrates in a mouse model of diet-induced obesity. Authors compared different syngeneic

      tumor cell lines for mammary adenocarcinoma and pancreatic ductal adenocarcinoma. Tumor

      infiltrating leukocytes were analyzed by a 36-parametric mass cytometry protocol. The authors

      put a lot of efforts in the generation of high-quality data by applying state-of-the-art methods for

      sample barcoding and batch analyses, removal of batch-specific variations and in the

      subsequent pipeline of data analysis. The clinical relevance of the topic addressed is well

      documented in several studies, showing a clear association between obesity and the

      development of several tumors, including those tumors investigated in this study.

      Main findings of this study can be summarized that in the model system used tumor-dependent

      differences in the qualitative and quantitative composition of immune cell infiltrates were

      observed. Unfortunately, the mouse model system used obviously did not reveal convincing

      data whether obesity may modulate the process of tumor infiltration.

      The manuscript is well written, quantity of figures is appropriately and of excellent quality and

      prior studies were referenced appropriately.

      In conclusion, authors made tremendous methodological and technical efforts to generate

      robust and high-quality mass cytometry data, but the overall outcome of the study remains

      limited in respect to shedding some new light how obesity is possibly involved in the qualitative

      and quantitative modulation of tumor-related immune cell infiltration.

      Authors’ Response: We thank the reviewer for their constructive and positive feedback as well

      as appreciation of our rigorous approach. We would however argue that our data significantly

      contributes to the understanding of how obesity affects tumor immunity. We believe that our

      systemic approach across multiple tumor systems highlights that i) it matters what model you

      choose, as each model have a separate response to the obesity challenge ii) for one model, the

      E0771 model, our data reflect obesity-dependent alterations to the CD8+ T-cells population.

      This was corroborated by a parallel publication by Rigel et al., 2020 as highlighted by the 2nd

      reviewer. That being said, we too, were surprised that the pro-inflammatory obese environment

      did not have more pronounced effects on the tumor immune infiltrates across the five models.

      **Major comments:**

      Due to the limited data really showing an association between obesity and immune cell

      infiltration of tumors investigated I would suggest that authors should change emphasis of their

      results more closely related to the findings of tumor-dependent immune cell infiltrations than

      obesity-related associations. So, the title of the study should be appropriately changed since

      "High dimensional immunotyping of the obese tumor micro-environment" rather implies

      analyses of spatial relationships of immune, tumor and fat cells by immunohistological analyses,

      which would indeed help to strengthen the outcome of this mass cytometry study.

      Authors’ Response: We appreciate the constructive suggestion. We did not intend the title to

      infer immunohistochemical analysis and apologize that was the case. We have therefore

      changed the title to “High dimensional immunotyping of tumors grown in obese and non-obese

      mice” in the revised version (line 1).

      Although all the efforts made in mass cytometry data generation are quite commendable in this

      study, basic statistical issues are not clearly addressed regarding the number of biological

      replicates. How many mice were treated per tumor cell line? According to figure 1B nine chow

      and eight HFD animals were used: does this mean that only one or two mice were analyzed per

      cell line, respectively? Please explain how many animals belong to each of the seven mouse

      cohorts.

      Authors’ Response: We agree that this was not clearly defined in the manuscript. We have

      updated Figure 1A and the corresponding legend to make it clearer. The mouse numbers,

      referred to as tumors, are also located in Table 3. In total 69 mice were used, distributed as:

      E0771_1 consists of 4 chow fed mice and 4 HFD mice (N=4/4, where N=chow/HFD, for a total

      of 8 mice)

      E0771_2 is N=5/4. Wnt1 is N=6/6. TeLi is N=5/5. C11_1 is N=5/4. C11_2 is N=5/5. UN-KC is N=5/6.

      Figure 1B shows representative mouse weights only. The female mice are from breast cancer

      cohort E0771_1 and the male mice are from pancreatic cancer cohort C11_1. We chose to only

      show representative data since diet-induced obesity is well established in the C57Bl/6 strain.

      Obviously, cell lines E07771 and C11 were analyzed as duplicates only. Regarding E0771,

      tumor growth was 31 and 23 days, respectively. So, large inter-individual differences in tumor

      growth were obvious and how this is reflected at the level of tumor infiltration? Therefore, please

      explain which criteria were used to decide when the tumors had to be removed. Furthermore,

      please indicate weight, viability and absolute cell number of each tumor sample in a

      supplementary table to get an impression about variability in tumor growth.

      Authors’ Response: The reviewer brings up an important point. The E0771 and C11 cohorts are

      included in the paper as combined cohorts. The individual C11 cohorts had too few tumors

      remaining after removal of samples with too low viability (as discussed below) to analyze

      separately. The E0771 cohorts are presented together as a representation of that tumor model.

      Data analysis for the E0771 cohorts separately shows comparable population abundance

      differences and obesity-dependent changes between chow and HFD tumors. The metacluster

      fold change for non-obese and obese tumors between E0771_1 and E0771_2 correlated with a

      R2 = 0.8586. Presenting the data combined provides a more concise view of the model.

      Removal of E0771 and C11 tumors in each individual cohort were time matched. E0771 tumors

      were continuously measured by caliper and removed before they reached 1 cm3 according to the

      local ethical guidelines. The E0771_2 cohort tumors had to be removed sooner as one tumor

      reached 1 cm3 earlier. We have reported the tumor mass in Figure 1C as that is a more accurate

      measurement of final tumor burden. Pancreatic tumors were removed based on optical imaging

      of luciferase expressing cancer cells and careful monitoring of mouse distress based on the

      grimace scale. The material and methods section has been updated to reflect this (line 556-558).

      Only pancreatic tumors had viability poor enough that they had to be excluded from analysis. A

      cutoff of CD45+ 5000 cells was set and applied to cells remaining following the gating strategy

      shown in Figure 1D. Therefore, CyTOF data for tumors with fewer than 5000 CD45+/Cisplatin

      negative cells were excluded from analysis as indicated with an X in Figure1C. As requested, we

      have included tumor weights and available viability measurements in new Table 5.

      **Minor comments:**

      The generation of orthotopic pancreatic cancer mouse models is technically challenging, and

      needs more complex imaging methods to monitor the growth of the implanted tumor cells.

      Furthermore, orthotopic implantation of tumor cells into the pancreas by surgery can also inflict

      significant physical trauma to the recipient animals. How authors have monitored tumor cell

      implantation?

      Authors’ Response: We agree that tracking tumor growth in the orthotopic pancreas cancer

      model is challenging. As mentioned above, these cells were engineered to express luciferase

      and optical imaging was used to monitor growth of the implanted cells. We did not report these

      numbers as we were unable to convincingly correct for possible light absorption by the

      enhanced adipose tissue mass in the high fat group. As such, these scans were used to

      estimate the end point.

      The number of CD45-positive cells per tumor sample is not given in the manuscript, but this

      information would be important to know, because it can be expected that most of the samples

      showed less than 20.000 cells. This relatively low number of total leukocytes would not allow a

      statistically significant profiling of rare cell subsets, such as DC's or MDSC's. This limitation

      should at least clearly addressed in the discussion section.

      Authors’ Response: The reviewer raises a great point. Since the cells were live cryopreserved

      and thawed before measuring CD45, we did not determine the total immune cell infiltrate. After

      thawing, the CD45+ cells accounted for roughly 1-12% of the total events collected across all

      batches leading to a total number of CD45+ cells ranging between 54,317 and 1,102,767 per

      batch. Numbers for each batch can be found in Table 3. After gating and exclusion of tumors

      with less than 5000 CD45+ cells, the remaining tumor data were equally sampled and 5206

      CD45+ cells were included in further analysis from each tumor. Overall, we were focused on

      broad phenotyping of the immune infiltrate and not on rare subsets. Some subsets had low

      abundance in some tumors and high abundance in others. Because the analysis was performed

      altogether, the overall phenotyping and clustering did not find any truly rare subsets. DCs and

      MDSC were not rare when assessed across the datasets. While we cannot characterize the

      subsets that are small in a specific tumor type, we can be confident in the characterization

      provided by the streamlined analysis of the data as a whole.

      According to table 2 authors have used 36 immune cell-related antigens including casp3, which

      was only used to exclude apoptotic cells from downstream analyses. But as written in the

      results section only 26 phenotyping markers were used to generate the viSNE map shown in

      Figure 3. In Figure 3C-F 30 markers were shown. Please explain this obvious inconsistency of

      markers used.

      Authors’ Response: Thank you for this question. Our goal here was to generate a viSNE map

      that best separated out immune cells by phenotype. Lineage markers and well-established

      phenotyping markers were therefore included to create the well separated viSNE map. It follows

      that some markers were not included: i) Markers that were used to gate the population of

      interest (CD45 and c-Cas3) were excluded from the viSNE input parameters.; ii) Markers that

      had relatively low signal were also excluded such as MHC-1 and CD117. Including negative

      markers is computationally costly, provides limited biological insight, and can produce a worse

      viSNE map by reducing cell separation due to shared lack of signal (Diggins et al., 2015); iii)

      Activation/ exhaustion markers were excluded from the viSNE analysis because the focus of the

      phenotyping was on major cell subsets and not on activation states. The hope was to observe

      differences in exhaustion marker expression between chow and HFD; and iv) CD5 was

      excluded because having two bright T cell markers skewed the map towards a more T cell

      dominant view. Markers with meaningful expression were reintroduced in the MEM analysis

      after the viSNE map was made. Exclusion of markers from viSNE analysis is a generally

      accepted practice and has been applied previously (Wogsland et al., 2017, Cheng et al., 2016,

      Huse et al., 2019, Leelatian et al., 2020, Doxie et al., 2018, Okamato et al., 2021, Henderson et

      al., 2020). The reasoning behind using the 26 phenotyping markers have been included in the

      revised manuscript (line 754 – 757)

      How viability of tumor samples was determined?

      Authors’ Response: Viability was measured at three points using membrane exclusion assays.

      Viability was first measured upon tumor dissociation using trypan blue and a Countess cell

      counter on the single cell suspension before freezing. Values were used to guide cell aliquoting

      for cryopreservation. Viability was again measured with trypan blue upon thaw in order to

      barcode and stain 3 million live cells per sample. Before fixation, cells were again stained for

      viability, this time with cisplatin, to exclude dead cells after data collection with gating. This has

      been added to the methods section (line 559-562)

      Cells were additionally stained for cleaved-Cas3 as an indicator of cells undergoing apoptosis.

      Only pancreatic tumors had viability poor enough that they had to be excluded form analysis.

      Tumors with fewer than 5000 CD45+ Cisplatin negative cells were excluded from analysis as

      indicated with an open X in Figure1C. The tumor count in parentheses in Table 3 indicates the

      tumors that were not excluded.

      Please indicate cell loss caused by cryopreservation of dispersed tumor tissue samples.

      Authors state that mainly neutrophilic granulocytes will be lost during cryopreservation, and that

      this would help to the "definitive identification and characterization of G-MDSC". But there are

      several reports showing that MDSC-subsets also behave very sensitive during cryopreservation

      and that it is recommended to analyze fresh samples if MDSC's are of particular interest (DOI:

      10.1177/1753425912463618; DOI: 10.1177/1753425912463618). This possible limitation

      should be discussed in the manuscript and not only highlighted as advantage on the way to

      identify MDSC-subsets.

      Authors’ Response: We thank the reviewer for this insightful comment. We agree that we likely

      lost some MDSC during the cryopreservation process as shown in the reference above. But

      since no neutrophils survive standard cryopreservation (Graham-Pole et al., 1977), the Ly6G

      positive cells in our analysis are G-MDSC and not neutrophils. We assume that any cell death

      related to cryopreservation would be consistent across samples, so although cell totals may be

      lower than in the tumor, abundance differences and phenotype can still be evaluated. We have

      included a discussion of this in the revised manuscript

      (line 408 – 410).

      In the Figure 1D X-axis named by "193Ir-NA" should be replaced by "193Ir-DNA".

      Authors’ Response: NA is shorthand for nucleic acid since the iridium intercalates into DNA

      and RNA. The figure legend has been updated to make this clear.

      Furthermore, please explain "(T)" in the figure legend. Percentages in the last two dot plots

      related to "all previous gates" are confusing: 20,44% of all DNA-containing single cells were

      finally intact, living CD45+ cells, i.e. almost 80% of cells were excluded because they were dead

      or apoptotic and this corresponds to 57,06% of intact, living CD45-positive cells related to all

      CD45-positive cells? How these percentages are related to the "Percent of CD45/total raw

      events" in the last column of Table 3?

      Authors’ Response: These are great points. Thank you for bringing them to our attention. This

      confusing notation has been removed since Figure 1D is a representative gating strategy. “All

      previous gates” means that the previous gates were all applied to the population showing in that

      plot. CyTOF data requires thorough gating to remove the events that are not representative of

      actual cells so yes, many events were removed before analysis. Even more cells were excluded

      here since our focus was on the CD45+ cells and not the cancer cells. The CD45+ cells

      indicated in Table 3 and visualized in Figure 1E can be calculated by summing the total gated

      CD45+ cells per Figure 1D for each batch and dividing that by the total number of events

      collected per batch. The summed CD45+ values and the total collected events are also in Table

      3.

      Authors claimed that "155Gd_IRF4" was changed to "155Gd", but it is not clear why to mention

      that IRF4 has been NOT used throughout the study? Please provide only those technical

      details, which are necessary to understand what has been done.

      Authors’ Response: We apologize for any confusion. This change was mentioned because

      most cohorts included the IRF4 channel while a two (C11_2 and Wnt_1) did not. The FCS files

      were changed to allow for simultaneous analysis. The IRF4 antibody did not work so there

      shouldn’t be any bleed into other channels in the samples that were stained with IRF4.

      According to general practice, we believe that it is important to make note of any manipulation to

      the FCS files.

      Re Figure 6: please explain the abbreviation "TNBC".

      Authors’ Response: We apologize for not explaining this abbreviation. TNBC is short for triple

      negative breast cancer. This has been corrected in the resubmitted version.

      Experiments done with TKO mice are not described in the Materials and Methods section. In

      particular, it would be important to know the number of replicates and the number of tumors

      grown in this model. It should be also discussed that the growth kinetics of tumors in chow and

      HFD TKO mice seem to be much faster as compared to wild type mice. Principally, the TKO

      model used here is only of limited value to clarify especially the role of CD8 cells since all other

      T- and B- cell subsets including NK cells are also absent in this knockout model and indirect

      effects caused by these cells cannot be excluded.

      Authors’ Response: We deeply apologize that the TKO experiments were not included in the

      Triple knockout (Rag2-/-::CD47-/-::Il2rg-/-; TKO) mice were purchased from Jackson Laboratories (Stock No: 025730).

      We agree with the reviewer it is an important point that the E0771 tumors overall grew faster in the TKO model. Ringel et al. 2020 saw similar results when depleting CD8 T cells in their MC38 model. Comparably, the most striking difference observed was that the tumor growth between obese and non-obese mice disappeared in the TKO mice.

      We have modified the results section to include these points (line 309-310). Reviewer #1 (Significance (Required)):

      material and methods section.

      experiment was performed with N=5/5. The description of the TKO model has been added to

      Orthotopic implantation and

      monitoring of E0771 and C11 cells were performed as with the wild type C57BL/6 mice. Each

      the methods section (line 520- 533) and number of mice used has been added to the figure

      legend.

      did not observe any major growth changes (overall growth rate and growth differences between

      obese and non-obese mice) in the TKO mice compared to the wild type mice.

      In the C11 model, interestingly, we

      We agree that the combined lack of B- and NK- cells in combination to the lack of T-cells

      exclude a direct conclusion on the effect of obesity-dependent alteration in T-cell phenotypes.

      Altogether, this study is a paragon that a single technology-based study alone, even when well-

      designed, is not sufficient to explore complex tumor microenvironment-immune cell interactions

      and that additional information on spatial relationships of cells and possibly single cell-based

      RNAseq techniques are necessary to shed new light on this ambitious topic. But there is no

      doubt that the potential of mass cytometry has been not fully exploited in this study and that a

      more focused view on particular cell types identified so far, such as macrophages or CD8 cells,

      by using as many immunophenotypic and functionally-related parameters as necessary would

      allow a more in depth-phenotyping of particular immune cell compartments.

      The significance of this subject would have been tremendously increased if human samples will

      be analyzed in a future confirmative study.

      Authors’ Response: Again, these are important insights. To what extend we have taken full

      advantage of the suspension mass cytometry technology is of course debatable. When we set

      out to perform these studies, we were compelled to take a broad approach rather than focusing

      on a single cell type for the following reasons: i) we had noticed extreme variability in immune

      targeted analysis through FACS of murine cancer models. Since we set out to demonstrate

      systemic effects of the obese environment rather than model-specific effects, the broad antibody

      panel made the most sense and ii) tumor immune infiltrates are known to be composed of

      multiple cell types and the effect of the obese state would likely affect multiple of these. To not

      bias ourselves this prompted us to design a rather broad immune panel. With the knowledge

      derived from this study and others (For example Rigel et al, Cell 2020 and Chung et all, Cell

      2020), new and more focused panels could be developed and implemented for future studies.

      We agree that the inclusion of human data would be of great value. We were, however, unable

      to obtain suitable human material that could be used for this suspension mass cytometry

      analysis. This was largely due to large inconsistencies in reported patient BMI and inadequate

      tumor freezing conditions.

      Even when I'm not a specialist in tumor biology, based on my expertise in the fields of chronic

      inflammation and cytometry, I'm convinced that the outlined way of generating

      immunophentypic data by single cell-based mass cytometry is of major interest not only for

      tumor biologists, but will be for sure recognized by a broad scientific community interested in the

      generation of single cell-based immunophenotypic data.

      Authors’ Response: Thank you for your helpful and supportive feedback. It is indeed our hope

      and motivation that the immunophenotyping platform presented herein will be broadly applicable

      to other cancer immunologists and fields.

      Reviewer #2

      (Evidence, reproducibility and clarity (Required)):

      Wogsland et al. apply herein mass cytometry (CyTOF) to investigate how obesity affects tumor

      immune infiltrates. They use several models of murine breast and pancreatic cancers and

      analyse their immune landscape thanks to an extended panel of 36 markers. They notably

      describe a decrease in CD8 T cells in one breast cancer model fed with high fat diet inducing

      obesity which favors tumor development.

      Overall, the report is clearly written and follows a very logical plan. Figures are also clear and

      nicely support the text. The mass cytometry approach appears quite original and could be

      relevant for many readers.

      Authors’ Response: We thank the referee for their constructive and positive comments on our work.

      The referee raises the general criticism that our study is descriptive.

      Nevertheless, some concerns have to be made and would need to be acknowledged by

      authors:

      -First of all, the paper appears very descriptive. Except at the end of the last figures, authors

      only establish of catalog of immune cells in different tumors. Even if the trueness of such

      observations is undisputable, their relevance to improve our understanding of tumor biology is

      clearly questionable.

      Authors’ Response:

      While we agree that the majority of the manuscript is focused on establishing a robust immune

      atlas in multiple tumor models grown in obese and non-obese mice, we believe that such work

      has important merit: i) our immune cell atlas of 5 transplant models will be a valuable resource

      for other cancer researchers interested in the immune-oncology field (as also highlighted by the

      first referee); ii) our findings clearly underscore the critical need to apply multiple cell lines in

      experimental setups when studying the interaction between tumors and immune cells –

      particularly in the obese setting; iii) we have implemented an analysis pipeline that is broadly

      applicable for high dimensional mass cytometry data that will be useful for future high-

      dimensional immunotyping efforts, iv) through our unbiased analysis pipeline we did identify

      obesity-dependent alterations to the CD8 cell population in the E0771 model. This finding was

      corroborated by the studies by Ringel et al., 2020. Collectively, we strongly believe that our

      studies will contribute to the advancement of our understanding of tumor biology.

      -Moreover, the major finding claimed in this study (CD8 T cells decrease in tumors from HFD

      mice) has been very recently published paper also providing mechanistic insights (Ringel et al.,

      Cell 2020). Authors could legitimately be disappointed but the interest of their study is sadly

      severely impacted by this prior publication. This key paper should be at least discussed and

      included in references.

      Authors’ Response: The paper by Ringel et al., was published after we originally submitted our

      manuscript for review and was therefore not referenced or discussed (Ringel et al., 2020). In the

      resubmitted version of the manuscript, we have included a thorough discussion of the paper’s

      findings in terms of consistencies and inconsistencies with our conclusions (line 545-463).

      -Finally, even if the initial strategy of integration of breast and pancreatic cancers was

      indubitably a good one, results reported in figures 5 & 6 clearly show a quite specific

      observation in the E0771 model. So in this context, integrating all these datasets do not improve

      the understanding of this phenotype

      Authors’ Response: We thank the referee for bringing up this point. Regardless of the outcome, we would strongly argue that the integrated approach to be advantageous to individual analysis. The integrated approach did not hinder new discoveries in any of the datasets – if anything, the integrated analysis pipeline developed herein would facilitate new discoveries that would be missed by repeating individual analysis. By integrating the datasets, we enabled the robust identification of more cell subsets. In particular cell types that displayed low abundance in some models. Those cells would have likely been hidden or even missed in a larger subset had the models been analyzed separately. As such, we maintain that the integrated approach is the correct and most biological meaningful to follow when given the possibility.

      Besides these quite general comments, few more specific points:

      -In Fig 2, the F4/80 signal appears very weak in all datasets except one (TeLi) with an almost

      flat curve for all the other ones. It asks the question of the reproducibility of the staining that

      could be only partially corrected with batch correction algorithms.

      Authors’ Response: The F4/80 peak in the TeLi cohort is indicative of a large F4/80

      population rather than a sign of signal intensity differences. TeLi tumors had much higher

      abundance of F4/80+ cells than did the other tumor types as can be seen in Figure 4B. For

      each mass cytometry run, we included a control sample to ensure equal staining patterns

      between the antibodies in each run.

      -Obesity is clearly known to be sex/hormone dependent as confirmed by authors themselves in

      their Fig 1B so again the global integration (both sex and 2 organs) strategy is disputable here.

      It is hard to know if there is no effect in the pancreas because of tissue or sex specificities.

      Authors’ Response: Thank you for the feedback. We specifically tried to show the different

      tumors side by side without making too many comparisons across tumor types because of the

      sex and tissue differences (as was noted in the results section of the manuscript, line 267). Both

      breast and pancreatic tumor models are relevant for studying the obesity cancer connection

      which is why we have worked to develop these models with different cancer types. Even with

      the sex and tissue differences, male and female mice became obese on a high fat diet, and

      tumors from both tissues grew larger on a high fat diet

      . It is our hope that this work will pave the

      way for future studies to interrogate these differences.

      -On Fig 1C, red dots are closed or open but explanation of this is lacking.

      Authors’ Response: Thank you for pointing this out. The figure legend has been updated. The

      X indicates a tumor that had too few live CD45+ cells to be included in the data CyTOF

      analysis. We apologize this was not clear.

      -Authors use 36 markers in their CyTOF panel but use only 26 for the dimension reduction

      without clearly explaining this choice. Should be amended. For example, why excluding CD5?

      Authors’ Response: Thank you for bringing this up. We have addressed these concerns in

      response to Reviewer #1 above.

      Reviewer #2 (Significance (Required)):

      Severly impaired by Ringel et al., Cell 2020

      Authors’ Response:

      It is clear that the study by Ringel et al., demonstrate new and important mechanistic insights

      into the connection between obesity, T-cell biology and tumor behavior. Our studies share many

      of the same conclusions on tumor immune cell infiltrate in obesity – particularly the T-cell finding

      in our E0771 model. However, we stipulate that our experimental approach and scientific

      questions differ. Our approach was to generate high-dimensional immune phenotyping atlas

      across multiple models to identify overarching obesity-dependent effects. The manuscript by

      Ringel et al., has a more mechanistic focus. The field would benefit from the additive insights

      from the two papers combined.

      Rebuttal References:

      CHENG, Y., WONG, M. T., VAN DER MAATEN, L. & NEWELL, E. W. 2016. Categorical Analysis of Human T Cell Heterogeneity with One-Dimensional Soli-Expression by Nonlinear Stochastic Embedding. The Journal of Immunology, 196, 924-932.

      DIGGINS, K. E., FERRELL, P. B., JR. & IRISH, J. M. 2015. Methods for discovery and characterization of cell subsets in high dimensional mass cytometry data. Methods, 82, 55-63.

      DOXIE, D. B., GREENPLATE, A. R., GANDELMAN, J. S., DIGGINS, K. E., ROE, C. E., DAHLMAN, K. B., SOSMAN, J. A., KELLEY, M. C. & IRISH, J. M. 2018. BRAF and MEK inhibitor therapy eliminates Nestin-expressing melanoma cells in human tumors. Pigment Cell & Melanoma Research, 31, 708-719.

      GRAHAM-POLE, J., DAVIE, M. & WILLOUGHBY, M. L. 1977. Cryopreservation of human granulocytes in liquid nitrogen. Journal of Clinical Pathology, 30, 758.

      HENDERSON, L. A., HOYT, K. J., LEE, P. Y., RAO, D. A., JONSSON, A. H., NGUYEN, J. P., RUTHERFORD, K., JULÉ, A. M., CHARBONNIER, L.-M., CASE, S., CHANG, M. H., COHEN, E. M., DEDEOGLU, F., FUHLBRIGGE, R. C., HALYABAR, O., HAZEN, M. M., JANSSEN, E., KIM, S., LO, J., LO, M. S., MEIDAN, E., SON, M. B. F., SUNDEL, R. P., STOLL, M. L., NUSBAUM, C., LEDERER, J. A., CHATILA, T. A. & NIGROVIC, P. A. 2020. Th17 reprogramming of T cells in systemic juvenile idiopathic arthritis. JCI Insight, 5.

      HUSE, K., WOGSLAND, C. E., POLIKOWSKY, H. G., DIGGINS, K. E., SMELAND, E. B., MYKLEBUST, J. H. & IRISH, J. M. 2019. Human Germinal Center B Cells Differ from Naïve and Memory B Cells in CD40 Expression and CD40L-Induced Signaling Response. Cytometry Part A, 95, 442-449.

      LEELATIAN, N., SINNAEVE, J., MISTRY, A. M., BARONE, S. M., BROCKMAN, A. A., DIGGINS, K. E., GREENPLATE, A. R., WEAVER, K. D., THOMPSON, R. C., CHAMBLESS, L. B., MOBLEY, B. C., IHRIE, R. A. & IRISH, J. M. 2020. Unsupervised machine learning reveals risk stratifying glioblastoma tumor cells. eLife, 9.

      OKAMATO, Y., GHOSH, T., OKAMOTO, T., SCHUYLER, R. P., SEIFERT, J., CHARRY, L. L., VISSER, A., FESER, M., FLEISCHER, C., PEDRICK, C., AUGUST, J., MOSS, L., BEMIS, E. A., NORRIS, J. M., KUHN, K. A., DEMORUELLE, M. K., DEANE, K. D., GHOSH, D., HOLERS, V. M. & HSIEH, E. W. Y. 2021. Subjects at-risk for future development of rheumatoid arthritis demonstrate a PAD4-and TLR-dependent enhanced histone H3 citrullination and proinflammatory cytokine production in CD14hi monocytes. Journal of Autoimmunity, 117, 102581.

      RINGEL, A. E., DRIJVERS, J. M., BAKER, G. J., CATOZZI, A., GARCÍA-CAÑAVERAS, J. C., GASSAWAY, B. M., MILLER, B. C., JUNEJA, V. R., NGUYEN, T. H., JOSHI, S., YAO, C.-H., YOON, H., SAGE, P. T., LAFLEUR, M. W., TROMBLEY, J. D., JACOBSON, C. A., MALIGA, Z., GYGI, S. P., SORGER, P. K., RABINOWITZ, J. D., SHARPE, A. H. & HAIGIS, M. C. 2020. Obesity Shapes Metabolism in the Tumor Microenvironment to Suppress Anti-Tumor Immunity. Cell, 183, 1848-1866.e26.

      WOGSLAND, C. E., GREENPLATE, A. R., KOLSTAD, A., MYKLEBUST, J. H., IRISH, J. M. & HUSE, K. 2017. Mass Cytometry of Follicular Lymphoma Tumors Reveals Intrinsic Heterogeneity in Proteins Including HLA-DR and a Deficit in Nonmalignant Plasmablast and Germinal Center B-Cell Populations. Cytometry B Clin Cytom, 92, 79-87.

    2. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #2

      Evidence, reproducibility and clarity

      Wogsland et al. apply herein mass cytometry (CyTOF) to investigate how obesity affects tumor immune infiltrates. They use several models of murine breast and pancreatic cancers and analyse their immune landscape thanks to an extended panel of 36 markers. They notably describe a decrease in CD8 T cells in one breast cancer model fed with high fat diet inducing obesity which favors tumor development.

      Overall, the report is clearly written and follows a very logical plan. Figures are also clear and nicely support the text. The mass cytometry approach appears quite original and could be relevant for many readers.

      Nevertheless, some concerns have to be made and would need to be acknowledged by authors:

      -First of all, the paper appears very descriptive. Except at the end of the last figures, authors only establish of catalog of immune cells in different tumors. Even if the trueness of such observations is undisputable, their relevance to improve our understanding of tumor biology is clearly questionable.

      -Moreover, the major finding claimed in this study (CD8 T cells decrease in tumors from HFD mice) has been very recently published paper also providing mechanistic insights (Ringel et al., Cell 2020). Authors could legitimately be disappointed but the interest of their study is sadly severely impacted by this prior publication. This key paper should be at least discussed and included in references.

      -Finally, even if the initial strategy of integration of breast and pancreatic cancers was indubitably a good one, results reported in figures 5 & 6 clearly show a quite specific observation in the E0771 model. So in this context, integrating all these datasets do not improve the understanding of this phenotype

      Besides these quite general comments, few more specific points: -In Fig 2, the F4/80 signal appears very weak in all datasets except one (TeLi) with an almost flat curve for all the other ones. It asks the question of the reproducibility of the staining that could be only partially corrected with batch correction algorithms.

      -Obesity is clearly known to be sex/hormone dependent as confirmed by authors themselves in their Fig 1B so again the global integration (both sex and 2 organs) strategy is disputable here. It is hard to know if there is no effect in the pancreas because of tissue or sex specificities.

      -On Fig 1C, red dots are closed or open but explanation of this is lacking.

      -Authors use 36 markers in their CyTOF panel but use only 26 for the dimension reduction without clearly explaining this choice. Should be amended. For example, why excluding CD5?

      Significance

      Severly impaired by Ringel et al., Cell 2020

    3. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #1

      Evidence, reproducibility and clarity

      Summary:

      This study of Nils Halberg and colleagues aims to characterize tumor-associated immune cell infiltrates in a mouse model of diet-induced obesity. Authors compared different syngeneic tumor cell lines for mammary adenocarcinoma and pancreatic ductal adenocarcinoma. Tumor infiltrating leukocytes were analyzed by a 36-parametric mass cytometry protocol. The authors put a lot of efforts in the generation of high-quality data by applying state-of-the-art methods for sample barcoding and batch analyses, removal of batch‐specific variations and in the subsequent pipeline of data analysis. The clinical relevance of the topic addressed is well documented in several studies, showing a clear association between obesity and the development of several tumors, including those tumors investigated in this study.

      Main findings of this study can be summarized that in the model system used tumor-dependent differences in the qualitative and quantitative composition of immune cell infiltrates were observed. Unfortunately, the mouse model system used obviously did not reveal convincing data whether obesity may modulate the process of tumor infiltration. The manuscript is well written, quantity of figures is appropriately and of excellent quality and prior studies were referenced appropriately. In conclusion, authors made tremendous methodological and technical efforts to generate robust and high-quality mass cytometry data, but the overall outcome of the study remains limited in respect to shedding some new light how obesity is possibly involved in the qualitative and quantitative modulation of tumor-related immune cell infiltration.

      Major comments:

      Due to the limited data really showing an association between obesity and immune cell infiltration of tumors investigated I would suggest that authors should change emphasis of their results more closely related to the findings of tumor-dependent immune cell infiltrations than obesity-related associations. So, the title of the study should be appropriately changed since "High dimensional immunotyping of the obese tumor micro-environment" rather implies analyses of spatial relationships of immune, tumor and fat cells by immunohistological analyses, which would indeed help to strengthen the outcome of this mass cytometry study. Although all the efforts made in mass cytometry data generation are quite commendable in this study, basic statistical issues are not clearly addressed regarding the number of biological replicates. How many mice were treated per tumor cell line? According to figure 1B nine chow and eight HFD animals were used: does this mean that only one or two mice were analyzed per cell line, respectively? Please explain how many animals belong to each of the seven mouse cohorts. Obviously, cell lines E07771 and C11 were analyzed as duplicates only. Regarding E0771, tumor growth was 31 and 23 days, respectively. So, large inter-individual differences in tumor growth were obvious and how this is reflected at the level of tumor infiltration? Therefore, please explain which criteria were used to decide when the tumors had to be removed. Furthermore, please indicate weight, viability and absolute cell number of each tumor sample in a supplementary table to get an impression about variability in tumor growth.

      Minor comments:

      The generation of orthotopic pancreatic cancer mouse models is technically challenging, and needs more complex imaging methods to monitor the growth of the implanted tumor cells. Furthermore, orthotopic implantation of tumor cells into the pancreas by surgery can also inflict significant physical trauma to the recipient animals. How authors have monitored tumor cell implantation? The number of CD45-positive cells per tumor sample is not given in the manuscript, but this information would be important to know, because it can be expected that most of the samples showed less than 20.000 cells. This relatively low number of total leukocytes would not allow a statistically significant profiling of rare cell subsets, such as DC's or MDSC's. This limitation should at least clearly addressed in the discussion section. According to table 2 authors have used 36 immune cell-related antigens including casp3, which was only used to exclude apoptotic cells from downstream analyses. But as written in the results section only 26 phenotyping markers were used to generate the viSNE map shown in Figure 3. In Figure 3C-F 30 markers were shown. Please explain this obvious inconsistency of markers used. How viability of tumor samples was determined? Please indicate cell loss caused by cryopreservation of dispersed tumor tissue samples. Authors state that mainly neutrophilic granulocytes will be lost during cryopreservation, and that this would help to the "definitive identification and characterization of G-MDSC". But there are several reports showing that MDSC-subsets also behave very sensitive during cryopreservation and that it is recommended to analyze fresh samples if MDSC's are of particular interest (DOI: 10.1177/1753425912463618; DOI: 10.1177/1753425912463618). This possible limitation should be discussed in the manuscript and not only highlighted as advantage on the way to identify MDSC-subsets. In the Figure 1D X-axis named by "193Ir-NA" should be replaced by "193Ir-DNA". Furthermore, please explain "(T)" in the figure legend. Percentages in the last two dotplots related to "all previous gates" are confusing: 20,44% of all DNA-containing single cells were finally intact, living CD45+ cells, i.e. almost 80% of cells were excluded because they were dead or apoptotic and this corresponds to 57,06% of intact, living CD45-positive cells related to all CD45-positive cells? How these percentages are related to the "Percent of CD45/total raw events" in the last column of Table 3 ?

      Authors claimed that "155Gd_IRF4" was changed to "155Gd", but it is not clear why to mention that IRF4 has been NOT used throughout the study? Please provide only those technical details, which are necessary to understand what has been done.

      Re Figure 6: please explain the abbreviation "TNBC". Experiments done with TKO mice are not described in the Materials and Methods section. In particular, it would be important to know the number of replicates and the number of tumors grown in this model. It should be also discussed that the growth kinetics of tumors in chow and HFD TKO mice seem to be much faster as compared to wild type mice. Principally, the TKO model used here is only of limited value to clarify especially the role of CD8 cells since all other T- and B- cell subsets including NK cells are also absent in this knockout model and indirect effects caused by these cells cannot be excluded.

      Significance

      Altogether, this study is a paragon that a single technology-based study alone, even when well-designed, is not sufficient to explore complex tumor microenvironment-immune cell interactions and that additional information on spatial relationships of cells and possibly single cell-based RNAseq techniques are necessary to shed new light on this ambitious topic. But there is no doubt that the potential of mass cytometry has been not fully exploited in this study and that a more focused view on particular cell types identified so far, such as macrophages or CD8 cells, by using as many immunophenotypic and functionally-related parameters as necessary would allow a more in depth-phenotyping of particular immune cell compartments. The significance of this subject would have been tremendously increased if human samples will be analyzed in a future confirmative study.

      Even when I'm not a specialist in tumor biology, based on my expertise in the fields of chronic inflammation and cytometry, I'm convinced that the outlined way of generating immunophentypic data by single cell-based mass cytometry is of major interest not only for tumor biologists, but will be for sure recognized by a broad scientific community interested in the generation of single cell-based immunophenotypic data.

    1. Note: This rebuttal was posted by the corresponding author to Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Reply to the reviewers

      We thank all three reviewers for their very useful and constructive comments. Below is our point-by-point response.

      Reviewer #1 (Evidence, reproducibility and clarity (Required)):

      The manuscript by Viais R et al describes a novel role for augmin complex in apoptosis prevention during brain development. Augmin complex recruits g TuRC to microtubule lattices to nucleate microtubule branches. The authors show how -in its absence- neural progenitors have elevated p53 activity and apoptotic rate, with severe consequences on overall brain development. In particular, augmin-deleted neural progenitors display spindle abnormalities and mitotic delay, which induce DNA damage accountable for p53-induced apoptosis.

      One point that I personally found very interesting is the role of augmin-dependent MT nucleation depletion in interphase. The authors mention (line 152) that at stage E13.5, besides the number of neurons being reduced, a few neurons were misplaced in the apical region, indicating a role for augmin-driven MT nucleation in cell migration. Moreover, the authors showed that p53 genetic deletion in the Haus6 cKO rescues the apoptosis phenotype but not the tissue disorganisation, suggesting that augmin-dependent microtubule might play a role in tissue polarity. While this is well presented in the discussion, the title in line 268 narrowly refers to mitotic augmin roles. I would like here to see the authors referring to putative roles for augmin-mediated MT nucleation in interphase, by toning down the title in line 268.

      We note that severe loss of tissue integrity is evident in the p53 KO background. In this background cells are allowed to repeatedly undergo defective cell divisions with aberrant chromosome segregation, producing increasingly abnormal daughter cells that may eventually fail to support epithelial integrity. Regarding possible neuronal migration defects, this has been previously observed in a study by the Hoogenraad group (Cunha-Ferreira et al., Cell Reports, 2018, 24, 791–800) and this is mentioned in our discussion. To account for the possibility that augmin may have roles beyond mitosis, we have changed the heading to a more neutral statement, not specifically referring to proliferation/mitosis:Loss of augmin in p53 KO brains disrupts neuroepithelium integrity”.

      Overall, the text is well written and flows easily. Figures are clear and legends provide sufficient information on experimental conditions, number of replicates and scale bars. I noticed that, although the number of repeats is specified, the number of cells scored per experiment is not always included. In my comments below I highlight cases where this missing information should be added.

      **Specific points:**

      1. In the Cep63 KO (Marjanovic et al, 2015) and the CenpJ KO mice (Insolera et al, 2014), as well as other recently published papers (e.g. Phan TP et al, EMBO Journal, 2020) part of the phenotypical characterisation of the KO mice displays pictures of the overall brain dissected from the mice. Could the author show these images?

      The main difference between the cited studies (including our own on the role of CEP63 in brain development) and our current study is that in the previous studies brains are microcephalic but essentially intact, whereas in our current study brain development was aborted and accompanied by cell death and severe tissue disruption. As a result, these brains are very fragile and difficult/impossible to isolate. An additional challenge is the fact that brain disruption occurs at a very early developmental stage (before E13.5), where dissection is more difficult than at later stages. Indeed, we note that all the brains presented in the above cited studies were from later embryonic stages or newborn/adult mice. Therefore, instead of dissecting brains, we decided to present encephalic coronal and sagittal sections as shown in Fig. 1c, d, e, Fig. S1c, and Fig. 3b, e to show the overall impact of Haus6 cKO and Haus6 cKO p53 KO on embryonic brain morphology at E13.5 and E17.5.

      Fig2d: do the insets correspond to higher magnification images? What is the zoom factor? I could not find it in the legend.

      The zoom factor is 1.4 - we have added this information to the figure legend.

      Fig2E,I and K graphs: how many cells were quantified here over how many experiments? I could not find information in the figure legend.

      We have added the information regarding the number of embryos and counted cells to the figure legends.

      The impact of Haus6 on mitotic spindle needs further clarification:

      o Fig2F: here, the authors show quantification for abnormal and multipolar spindle together. Later on, the abnormal spindle phenotype is no longer discussed (Fig4). I was wondering what is the individual contribution of abnormal and multipolar spindle, separately. Which one of the two is more frequent? Could the authors explain in the text how they define an abnormal spindle? Is it the lack of MT with the condensed chromosome area?

      We agree that our previous classification was somewhat confusing. The spindle defects in Haus6 cKO cells are directly linked to the spindle pole fragmentation phenotype shown in Fig. 2d, e. Association of spindle microtubules with these scattered PCM fragments causes spindles to appear overall disorganized. In some cases, multiple smaller asters are present, which is what we had termed “multipolar”. However, this does not always involve multipolar DNA configurations, which we separately quantify in Fig. 4. To avoid confusion, we now classify spindle morphologies based on tubulin staining simply as “normal” (bipolar configuration, two robust and focused asters) or “disorganized” (lack of bipolar configuration, in some cases multiple smaller asters). We have included a better description of this classification (lines 202-205).

      o Could it be that augmin deletion induce an instability in MTs within the mitotic spindle, leading to the "empty" or with very few MTs spindles? Or could it be that more cold-sensitive MTs are affected by fixation? What is the percentage of the spindle with no MT in control?

      It is possible that augmin-deficient spindles are less well-preserved during fixation due to compromised spindle microtubule stability. Indeed, in tissue culture cells augmin deficient spindle microtubules are more cold-sensitive than controls (Zhu et al., 2008, JCB, 183, 835-848). To address this we will determine the percentage of mitotic control and Haus6 cKO cells lacking microtubule staining.

      o Did the authors quantify anaphase/telophase phenotypes as they did in Fig4f?

      Yes, this quantification was already included in Fig. 4j, where we compared abnormal chromosome configurations between Haus6 cKO and Haus6 cKO p53 KO.

      o How do authors explain PCM fragmentation here? Could this phenotype be due to an initial cytokinesis defect which led the cells to accumulate extra centrosomes? Or could this maybe be a product of aberrant PCM maturation/centrosome duplication? Could the authors add here a line to discuss the possible origin of pole fragmentation?

      The PCM fragmentation phenotype has previously been described after augmin RNAi in cultured cells (Lawo et al., 2009, Curr Biol, 19, 816-826). We refer to this result in the discussion and we have added the above reference, to emphasize this point. The authors showed that this phenotype does not involve amplification of centriole number, but is caused by an imbalance in microtubule-dependent forces acting on the PCM and leading to its fragmentation. Thus, the extra poles were formed by acentriolar PCM fragments. We will clarify this issue by quantifying centriole numbers in mitotic cells (when centriole duplication is complete) in control and Haus6 cKO brains. We expect that this will confirm the data previously obtained in cell lines showing that in most cells the fragmented poles are not due to extra centrioles (see also below).

      Apart from the PCM fragmentation phenotype that does not alter centriole number, previous work in cultured cells also described cytokinesis defects. Failed cytokinesis would indeed lead to increased centriole number. However, it would also increase DNA content, which would be visible by an increase in the size of interphase nuclei (which we observed in Haus6 cKO p53 KO cells and quantified in Fig. 4J) and a larger size of mitotic figures. We now refer to the possibility of cytokinesis defects and cite previous work in lines 272-274. In case we observe cells with increased centriole number, which we will quantify for the revised version of the manuscript (see above), we will also determine if this corelates with an increased size of the corresponding mitotic figures. If so, this would be consistent with failed cytokinesis as cause of extra centrosomes.

      Fig 4 Did the authors quantify centrosome fragmentation and abnormal spindle here? As they characterised them for the Haus6 cKO mouse, it would be preferable to maintain the same characterisation for the Haus6 cKO p53KO.

      We will quantify pole fragmentation and spindle defects also in Haus6 cKO p53 KO as shown for Haus6 cKO in Fig. 2.

      Fig4c and d: how many replicates were done to obtain these graphs? I think the authors forgot to add this information in the figure legend.

      This information has been included in the figure legend.

      Fig4f,g, I and J: how many cells were counted per experiment? I appreciate the authors writing the n of experiments performed.

      We have added this information to the figure legend.

      Fig5d: how many cells were counted per experiment?

      We have added this information to the figure legend.

      Reviewer #1 (Significance (Required)):

      While it was already known that mitotic delay affects the neuronal progenitor pool through activation of p53-dependent apoptosis (Pilaz L-J, Neuron 2016; Mitchell-Dick A, Dev Neurosci 2020), and that this can be triggered by depletion of centrosomal proteins as Cenpj and Cep63, the role of surface-dependent microtubule nucleation was not identified so far. Some insights come from a Haus6-KO mouse model which dies during blastocyst stage after several aberrant mitosis (Watanabe S, Cell Reports, 2016). In parallel, McKinley KL et al showed that Haus8 depletion in human cells (RPE1cells) triggered p53-dependent G1 arrest following mitotic defects (McKinley KL, Developmental Cell, 2017). Building on the Hause6 KO mouse and human cell line data, here Viais R et al discover a novel role for the augmin-mediated MT nucleation in neural progenitor growth and brain development in vivo, through prevention of p53-induced apoptosis.

      Specifically, Viais R et al show that:

      1. Surface-dependent microtubule nucleation depletion severely impacts brain development, disrupting partly or completely forebrain domains and cerebellum;
      2. Surface-dependent microtubule nucleation depletion induce spindle abnormalities, resulting in mitotic delay in apical progenitors;
      3. Mitotic delay results in DNA breaks, p53 activation and p53-induced apoptosis.

        This is a tidy, well-executed study with good quality data. These findings propose a novel mechanism that results essential for neural progenitor and overall brain development.

        In my opinion, a large audience will benefit from these discoveries: from developmental biologists to cell biologists focused on microtubule dynamics, cell cycle, differentiation, stem cells and cell polarity.

      Key works describing my area of expertise: microtubule dynamics, centrosome function, cell cycle regulation and cell polarity.

      Reviewer #2 (Evidence, reproducibility and clarity (Required)):

      Viais, Lüders and colleagues here present an analysis of augmin's roles in neural stem cell development. They describe a dramatic impact of the conditional ablation of Haus6 on embryonic brain development in the mouse, with mitotic problems that lead to greatly-increased levels of apoptosis. The rescue of this apoptosis by mutation of the gene that encodes p53 did not restore brain development, which was still aberrant, due to mitotic errors.

      The paper is clearly written, with well-designed and controlled experiments. Its conclusions are well supported by the data presented. I have few comments on the technical aspects of the work- it appears very solid to me.

      **Specific comments**

      1. Clearer explanation of the mouse strains used should be provided. The section describing the generation of the Haus6 conditional on p.5 should specify that this is the same as was already published in the 2016 Watanabe paper (this is in the Materials and Methods, but this should be more clearly specified. More specific details of the p53 knockout mice from Jackson should be included in the Materials and Methods.

      We have included additional information describing the generation of the Haus6 cKO mice in the main text (line 137-140). It is not exactly the same as described in the Watanabe et al. paper. The previously published strain (Watanabe et al., 2016, Cell Reports, 15, 54-60) contained a floxed Haus6 cKO allele with a flanking neomycin cassette. For the current study the neomycin cassette was removed. Details are described in the method section and also shown in Fig. S1a. Specific information regarding the p53 KO strain has been added to the method section.

      Figure 1a contains minimal information on the Haus6 locus. More detail should be included for information, if this Figure is to remain (although reference to the targeting details in the original description would be sufficient). It is unclear what the timeline diagram is to convey and it should be improved or deleted. A similar comment applies for the details in Figure 3a, although the colour scheme for the different genotypes is useful.

      More detailed information on the Haus6 locus is shown in the schematic of Fig. S1a and in the referenced study (Watanabe et al., 2016, Cell Reports, 15, 54-60). Since the targeting of Haus6 exon1 was previously described, we feel that including this information as a supplementary figure and referring to the previous study is appropriate.

      Regarding the schematics in Fig. 1a and Fig. 3a, we have improved these. The timeline shows the time points of Cre expression and of obtaining embryos for analysis.

      The important PCR controls in Figure S1b have an unexplained 1000 bp band that appears only in the floxed heterozygote. It would be helpful if the authors explained this in the relevant Figure legend.

      This band is an artifact and represents heteroduplexes of floxed (1080 bp) and wild type (530 bp) DNA strands due to extended regions of complementary. We have explained this in the figure legend.

      Assuming the putative centrosome 'clusters' in Figure 6c are similar to the fragmented structures seen in thalamus in Figure 2d, a different description should be used to avoid confusion with multiple centrosomes, which is not a phenotype here. It is not clear how the loss of centrosomes from the ventricular surface was scored, whether it was based on total gamma-tubulin signal or individual centrosomes; how fragmented poles would affect that is unclear, so the legend and relevant details should clarify this point.

      The fragmented spindle poles shown in Fig. 2d are different from the centrosome clusters in Fig. 6c. The fragmented poles are fragments of PCM rather than extra centrosomes. Fragmentation is specific to mitosis, involving forces exerted by spindle microtubules (Lawo et al., 2009, Curr Biol, 19, 816-826). In contrast, the centrosome clusters that we observed in Haus6 cKO p53 KO apical progenitors represent centrosomes from multiple cells in interphase, most likely as part of apical membrane patches that have delaminated form the ventricular surface. In the intact epithelium of controls these centrosomes line the ventricular surface. To avoid confusion, we now indicate in the text and legend that these centrosome clusters involve interphase cells.

      Phospho-histone H2AX should be referred to as a marker of activation of the DNA damage response, rather than DNA repair.

      We have changed the text accordingly.

      **Minor points**

      i. Figure 1b should include a scale bar.

      We have added the scale bar.

      ii. The labelling of Figure 1f should be revised.

      The labels have been fixed.

      iii. Figure 2k is not labelled in this Figure.

      This has been fixed.

      iv. Scale bars should be included in the blow-ups in Figure 6c.

      We have added the scale bars.

      Reviewer #2 (Significance (Required)):

      While it is striking that they see complete disruption of brain development, rather than microcephaly, arguably the mechanistic novelty of the findings is moderate, in that the impacts of Haus6 deficiency on mitotic spindle assembly are well established. The authors only allude to potential additional and novel activities of augmin (in neural progenitors, potentially) that might explain this possibly-unexpected outcome of this study. The topic is likely to be of interest to people in the field of mitosis, genome stability and brain development.

      My expertise is cell biology/ mitosis, less so on murine brain development.

      Reviewer #3 (Evidence, reproducibility and clarity (Required)):

      Jens Lüders &Co demonstrates the essential role of Augmin-mediated MT is critical for proper brain development in mice. The most striking point is that even p53 is eliminated, the microcephaly phenotypes of Haus6 KOs were not rescued. This could mean that the Augmin-mediated MT process is critical to cellular functions that are independent of p53. The authors claim that there are increased DNA damage and excessive mitotic errors. In these aspects, the current work is fascinating. Nevertheless, what causes massive damage to the neural epithelial tissues in the double mutant is not well explained or examined. Few questions appear in mind before I go into the detail. Are these animals still harbor functional centrosomes and their numerical status?

      This is an important point that was also raised by the other reviewers. Based on previous work in cells lines (Lawo et al., 2009, Curr Biol, 19, 816-826), we do not expect that loss of augmin directly impairs centrosomes. Indeed, the authors showed that centriole number was unaffected. The only centrosome defect that the authors observed was fragmentation of the PCM during mitosis, but this was shown to be due to imbalanced forces exerted by spindle microtubules: fragmentation could be rescued by microtubule depolymerization or depletion of the cortical microtubule tethering factor NUMA (Lawo et al., 2009, Curr Biol, 19, 816-826). That being said, we will examine this issue also in our mouse model by staining and counting of centrioles in mitotic apical progenitors of control and Haus6 cKO embryos.

      The microcephaly part of the introduction needs some more work. In particular, the authors need to explain apical progenitors' depletion, possibly the correct mechanisms in causing microcephaly. By saying cortical progenitors, it becomes vague. Indeed, there would also be cortical progenitors depleted. But, the fundamental mechanisms are the depletion of apical progenitors lined up at VZ's lumen. Two works in this connection generated brain tissues from microcephaly patients carrying mutations in CenpJ and CDK5RAP2 (Gabriel and Lancaster et al). Authors should cite their work and relate their findings to mouse brain data.

      We have introduced text changes in the introduction to indicate the specific role of apical progenitor depletion in microcephaly and the differences in the underlying mechanism between mouse and human organoid models (line 63; lines 86-92). In this context we also cite the Gabriel et al. and Lancaster et al. studies.

      -What makes me worry is, looking at figure 1E, there is pretty much no brain, and of course, authors have analyzed what is left over. How could one distinguish reduced PAX6 area and TUJ1 area is due to the gross defects in brain development. Clearly, Haus6 KO causes a severe defect in brain development. Thus, deriving a conclusion from the damaged brain can be misleading. One way to circumvent this problem is to perform 2D experiments with isolated cell types (let us say NPCs and testing if they can spontaneous differentiate).

      We note that overall brain structures are only lost by E17.5, but brain structures (albeit defective) are still present at E13.5. Indeed, all of our quantifications were done at E13.5 or earlier stages. That being said, we understand the concern that quantifications in defective brain structures may be misleading. However, 2D cultures, for which cells are removed from their tissue context, may have similar issues. For this reason, we plan to provide two different type of analyses. We will measure PAX6 and TUJ1 layers in brains from embryos at E.11.5, since the relevant tissues will be less damaged at this earlier stage. In addition, we will use BrdU injection prior to fixation of embryos. Proliferating apical progenitors will incorporate the label during S phase and subsequently we will determine the relative amounts of BrdU-positive cell types (apical progenitors vs neurons) in control and Haus6 cKO brains. Tissue damage will have less impact in this short-term labelling experiment.

      Figure 2: A nice illustration that Hau6 KO animals harbor many mitotic figures. The quantifications lack how many slices and how many cells were analyzed. Simply n=4 does not say much. 4 animals were considered but how many cells/slices would help identify mitotic cells/animals' distribution. A simple bar diagram does not tell a lot.

      We have added this information to the figure legend.

      As a minor point, how did the authors unambiguously scored prometaphase cells and other mitotic figures? Representative figures will help. Besides, what is the meaning of many prometaphase cells? At least a discussion would help.

      This is a good suggestion and we will provide examples of the mitotic figures that we scored. We now explain the meaning of the increase in prometaphase cells in the description of this result (lines 178-180).

      Can the authors probe centrosomes (not by using gamma-tubulin) and relate their presence or absence to p53 upregulation? This is an important point because a complete loss of centrosome is known to trigger p53 upregulation. This may be different in Haus6 KO. This could mean (i.e, centrosomes are normal in numbers or increase in numbers), p53 upregulation is regardless of centrosomes loss.

      Indeed, we believe that p53 upregulation in Haus6-deficient brains is not caused by loss of centrosomes. Instead, our data suggest, as explained in the discussion, that mitotic delay caused by augmin deficiency is sufficient for p53 upregulation. We will further support this conclusion by counting centrioles in mitotic cells. At this point of the cell cycle centriole duplication is complete and we expect to observe largely normal centriole numbers. In some cells we may observe increased numbers due to cytokinesis failure (see response to reviewer #1).

      I have a hard time to ascertain how the authors scored interphase cells that enriched with p53. Some representative images with identity markers will help.

      Scoring p53-positive interphase cells is relatively straightforward since the p53 signal is nuclear and not observed in mitotic apical progenitors. We have included a magnified region of the tissue shown in Fig. 2j, displaying PAX6/p53-positive nuclei of individual cells.

      Looking at the p53 status in Haus6 KO animals, it is intriguing that p53 upregulation is not unique to centrosome loss. At this point, it becomes essential to thoroughly analyze the centrosome status to cross-check if Haus6 loss abrogates centrosomes; if so, how much.

      Since centrosome number is linked to centriole number, we will address this point by quantifying centriole numbers in mitotic apical progenitors (see above).

      Double KO could subside the cell death, but not tissue growth is impressive. So what is going on there? Is there a premature differentiation that leads to NPCs depletion? I believe the authors should generate 2D experiments with cells derived from these double KO animals compared to Haus6 KO and test if there is a premature differentiation that can lead to malformation of the forebrain. Here staining for the forebrain progenitor markers will additionally help (Perhaps FOXG1).

      As explained in response to reviewer #1, we prefer to analyse this issue in vivo rather than in cells that are removed from their native tissue context, which may affect cell fate decisions. To address whether cells prematurely differentiate, we will use injection of BrdU (incorporated by proliferating apical progenitors) prior to fixation, followed by staining for cell type-specific markers. If there is premature differentiation, this should be visible as an increase in BrdU-positive post-mitotic cells.

      Looking at Figure 6, it becomes clear that the double KOs have severe issues in maintaining the apical progenitors suggesting that they undergo premature differentiation before attaining a sufficient pool of NPCs. Testing this will bridge the paper between descriptive findings to mechanisms.

      This point relates to the reviewer’s previous point: do Haus6 cKO p53 KO apical progenitors prematurely differentiate? We believe that cell loss, tissue disruption, and aborted development may also be explained without premature differentiation. In the absence of p53, repeated abnormal mitoses and the resulting increasingly severe chromosomal aberrations including DNA damage (Fig. 5) may produce cells that eventually won’t be able to proliferate and function properly. However, we will test premature differentiation by BrdU injection and staining with appropriate markers as explained above.

      The discussion section is excellent, but it should add some human relevance. In particular, are there p53 dependent cell deaths that have been described in human tissues. In my opinion, it seems specific in the mouse brain. The discussion can also have statements about why the human brain is so sensitive even for mild mutations. I am not sure if those human mutations can cause similar defects in the mouse brain. Most of the mice based studies have been focusing on eliminating complete genes of interest.

      We have included a section in the discussion to relate our findings to human brain development and the differences with results obtained in mouse models regarding the role of apoptosis (lines 386-391).

      Reviewer #3 (Significance (Required)):

      Overall, this is a very well done work but requires some more experiments for mechanisms understanding. Addressing those will make the paper fit to get published.

    2. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #3

      Evidence, reproducibility and clarity

      Jens Lüders &Co demonstrates the essential role of Augmin-mediated MT is critical for proper brain development in mice. The most striking point is that even p53 is eliminated, the microcephaly phenotypes of Haus6 KOs were not rescued. This could mean that the Augmin-mediated MT process is critical to cellular functions that are independent of p53. The authors claim that there are increased DNA damage and excessive mitotic errors. In these aspects, the current work is fascinating. Nevertheless, what causes massive damage to the neural epithelial tissues in the double mutant is not well explained or examined. Few questions appear in mind before I go into the detail. Are these animals still harbor functional centrosomes and their numerical status? The microcephaly part of the introduction needs some more work. In particular, the authors need to explain apical progenitors' depletion, possibly the correct mechanisms in causing microcephaly. By saying cortical progenitors, it becomes vague. Indeed, there would also be cortical progenitors depleted. But, the fundamental mechanisms are the depletion of apical progenitors lined up at VZ's lumen. Two works in this connection generated brain tissues from microcephaly patients carrying mutations in CenpJ and CDK5RAP2 (Gabriel and Lancaster et al). Authors should cite their work and relate their findings to mouse brain data.

      -What makes me worry is, looking at figure 1E, there is pretty much no brain, and of course, authors have analyzed what is left over. How could one distinguish reduced PAX6 area and TUJ1 area is due to the gross defects in brain development. Clearly, Haus6 KO causes a severe defect in brain development. Thus, deriving a conclusion from the damaged brain can be misleading. One way to circumvent this problem is to perform 2D experiments with isolated cell types (let us say NPCs and testing if they can spontaneous differentiate)

      Figure 2: A nice illustration that Hau6 KO animals harbor many mitotic figures. The quantifications lack how many slices and how many cells were analyzed. Simply n=4 does not say much. 4 animals were considered but how many cells/slices would help identify mitotic cells/animals' distribution. A simple bar diagram does not tell a lot.

      As a minor point, how did the authors unambiguously scored prometaphase cells and other mitotic figures? Representative figures will help. Besides, what is the meaning of many prometaphase cells? At least a discussion would help.

      Can the authors probe centrosomes (not by using gamma-tubulin) and relate their presence or absence to p53 upregulation? This is an important point because a complete loss of centrosome is known to trigger p53 upregulation. This may be different in Haus6 KO. This could mean (i.e, centrosomes are normal in numbers or increase in numbers), p53 upregulation is regardless of centrosomes loss.

      I have a hard time to ascertain how the authors scored interphase cells that enriched with p53. Some representative images with identity markers will help.

      Looking at the p53 status in Haus6 KO animals, it is intriguing that p53 upregulation is not unique to centrosome loss. At this point, it becomes essential to thoroughly analyze the centrosome status to cross-check if Haus6 loss abrogates centrosomes; if so, how much.

      Double KO could subside the cell death, but not tissue growth is impressive. So what is going on there? Is there a premature differentiation that leads to NPCs depletion? I believe the authors should generate 2D experiments with cells derived from these double KO animals compared to Haus6 KO and test if there is a premature differentiation that can lead to malformation of the forebrain. Here staining for the forebrain progenitor markers will additionally help (Perhaps FOXG1).

      Looking at Figure 6, it becomes clear that the double KOs have severe issues in maintaining the apical progenitors suggesting that they undergo premature differentiation before attaining a sufficient pool of NPCs. Testing this will bridge the paper between descriptive findings to mechanisms.

      The discussion section is excellent, but it should add some human relevance. In particular, are there p53 dependent cell deaths that have been described in human tissues. In my opinion, it seems specific in the mouse brain. The discussion can also have statements about why the human brain is so sensitive even for mild mutations. I am not sure if those human mutations can cause similar defects in the mouse brain. Most of the mice based studies have been focusing on eliminating complete genes of interest.

      Significance

      Overall, this is a very well done work but requires some more experiments for mechanisms understanding. Addressing those will make the paper fit to get published.

    3. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #2

      Evidence, reproducibility and clarity

      Viais, Lüders and colleagues here present an analysis of augmin's roles in neural stem cell development. They describe a dramatic impact of the conditional ablation of Haus6 on embryonic brain development in the mouse, with mitotic problems that lead to greatly-increased levels of apoptosis. The rescue of this apoptosis by mutation of the gene that encodes p53 did not restore brain development, which was still aberrant, due to mitotic errors.

      The paper is clearly written, with well-designed and controlled experiments. Its conclusions are well supported by the data presented. I have few comments on the technical aspects of the work- it appears very solid to me.

      Specific comments

      1. Clearer explanation of the mouse strains used should be provided. The section describing the generation of the Haus6 conditional on p.5 should specify that this is the same as was already published in the 2016 Watanabe paper (this is in the Materials and Methods, but this should be more clearly specified. More specific details of the p53 knockout mice from Jackson should be included in the Materials and Methods.
      2. Figure 1a contains minimal information on the Haus6 locus. More detail should be included for information, if this Figure is to remain (although reference to the targeting details in the original description would be sufficient). It is unclear what the timeline diagram is to convey and it should be improved or deleted. A similar comment applies for the details in Figure 3a, although the colour scheme for the different genotypes is useful.
      3. The important PCR controls in Figure S1b have an unexplained 1000 bp band that appears only in the floxed heterozygote. It would be helpful if the authors explained this in the relevant Figure legend.
      4. Assuming the putative centrosome 'clusters' in Figure 6c are similar to the fragmented structures seen in thalamus in Figure 2d, a different description should be used to avoid confusion with multiple centrosomes, which is not a phenotype here. It is not clear how the loss of centrosomes from the ventricular surface was scored, whether it was based on total gamma-tubulin signal or individual centrosomes; how fragmented poles would affect that is unclear, so the legend and relevant details should clarify this point.
      5. Phospho-histone H2AX should be referred to as a marker of activation of the DNA damage response, rather than DNA repair.

      Minor points

      i. Figure 1b should include a scale bar.<br> ii. The labelling of Figure 1f should be revised. iii. Figure 2k is not labelled in this Figure. iv. Scale bars should be included in the blow-ups in Figure 6c.

      Significance

      While it is striking that they see complete disruption of brain development, rather than microcephaly, arguably the mechanistic novelty of the findings is moderate, in that the impacts of Haus6 deficiency on mitotic spindle assembly are well established. The authors only allude to potential additional and novel activities of augmin (in neural progenitors, potentially) that might explain this possibly-unexpected outcome of this study.

      The topic is likely to be of interest to people in the field of mitosis, genome stability and brain development.

      My expertise is cell biology/ mitosis, less so on murine brain development.

    4. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #1

      Evidence, reproducibility and clarity

      The manuscript by Viais R et al describes a novel role for augmin complex in apoptosis prevention during brain development. Augmin complex recruits g TuRC to microtubule lattices to nucleate microtubule branches. The authors show how -in its absence- neural progenitors have elevated p53 activity and apoptotic rate, with severe consequences on overall brain development. In particular, augmin-deleted neural progenitors display spindle abnormalities and mitotic delay, which induce DNA damage accountable for p53-induced apoptosis.

      One point that I personally found very interesting is the role of augmin-dependent MT nucleation depletion in interphase. The authors mention (line 152) that at stage E13.5, besides the number of neurons being reduced, a few neurons were misplaced in the apical region, indicating a role for augmin-driven MT nucleation in cell migration. Moreover, the authors showed that p53 genetic deletion in the Haus6 cKO rescues the apoptosis phenotype but not the tissue disorganisation, suggesting that augmin-dependent microtubule might play a role in tissue polarity. While this is well presented in the discussion, the title in line 268 narrowly refers to mitotic augmin roles. I would like here to see the authors referring to putative roles for augmin-mediated MT nucleation in interphase, by toning down the title in line 268.

      Overall, the text is well written and flows easily. Figures are clear and legends provide sufficient information on experimental conditions, number of replicates and scale bars. I noticed that, although the number of repeats is specified, the number of cells scored per experiment is not always included. In my comments below I highlight cases where this missing information should be added.

      Specific points:

      1. In the Cep63 KO (Marjanovic et al, 2015) and the CenpJ KO mice (Insolera et al, 2014), as well as other recently published papers (e.g. Phan TP et al, EMBO Journal, 2020) part of the phenotypical characterisation of the KO mice displays pictures of the overall brain dissected from the mice. Could the author show these images?
      2. Fig2d: do the insets correspond to higher magnification images? What is the zoom factor? I could not find it in the legend.
      3. Fig2E,I and K graphs: how many cells were quantified here over how many experiments? I could not find information in the figure legend.
      4. The impact of Haus6 on mitotic spindle needs further clarification:

      o Fig2F: here, the authors show quantification for abnormal and multipolar spindle together. Later on, the abnormal spindle phenotype is no longer discussed (Fig4). I was wondering what is the individual contribution of abnormal and multipolar spindle, separately. Which one of the two is more frequent? Could the authors explain in the text how they define an abnormal spindle? Is it the lack of MT with the condensed chromosome area?

      o Could it be that augmin deletion induce an instability in MTs within the mitotic spindle, leading to the "empty" or with very few MTs spindles? Or could it be that more cold-sensitive MTs are affected by fixation? What is the percentage of the spindle with no MT in control?

      o Did the authors quantify anaphase/telophase phenotypes as they did in Fig4f?

      o How do authors explain PCM fragmentation here? Could this phenotype be due to an initial cytokinesis defect which led the cells to accumulate extra centrosomes? Or could this maybe be a product of aberrant PCM maturation/centrosome duplication? Could the authors add here a line to discuss the possible origin of pole fragmentation?

      1. Fig 4 Did the authors quantify centrosome fragmentation and abnormal spindle here? As they characterised them for the Haus6 cKO mouse, it would be preferable to maintain the same characterisation for the Haus6 cKO p53KO.
      2. Fig4c and d: how many replicates were done to obtain these graphs? I think the authors forgot to add this information in the figure legend.
      3. Fig4f,g, I and J: how many cells were counted per experiment? I appreciate the authors writing the n of experiments performed.
      4. Fig5d: how many cells were counted per experiment?

      Significance

      While it was already known that mitotic delay affects the neuronal progenitor pool through activation of p53-dependent apoptosis (Pilaz L-J, Neuron 2016; Mitchell-Dick A, Dev Neurosci 2020), and that this can be triggered by depletion of centrosomal proteins as Cenpj and Cep63, the role of surface-dependent microtubule nucleation was not identified so far. Some insights come from a Haus6-KO mouse model which dies during blastocyst stage after several aberrant mitosis (Watanabe S, Cell Reports, 2016). In parallel, McKinley KL et al showed that Haus8 depletion in human cells (RPE1cells) triggered p53-dependent G1 arrest following mitotic defects (McKinley KL, Developmental Cell, 2017). Building on the Hause6 KO mouse and human cell line data, here Viais R et al discover a novel role for the augmin-mediated MT nucleation in neural progenitor growth and brain development in vivo, through prevention of p53-induced apoptosis.

      Specifically, Viais R et al show that:

      1. Surface-dependent microtubule nucleation depletion severely impacts brain development, disrupting partly or completely forebrain domains and cerebellum;
      2. Surface-dependent microtubule nucleation depletion induce spindle abnormalities, resulting in mitotic delay in apical progenitors;
      3. Mitotic delay results in DNA breaks, p53 activation and p53-induced apoptosis.

      This is a tidy, well-executed study with good quality data. These findings propose a novel mechanism that results essential for neural progenitor and overall brain development.

      In my opinion, a large audience will benefit from these discoveries: from developmental biologists to cell biologists focused on microtubule dynamics, cell cycle, differentiation, stem cells and cell polarity.

      Key works describing my area of expertise: microtubule dynamics, centrosome function, cell cycle regulation and cell polarity.

    1. Note: This rebuttal was posted by the corresponding author to Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Reply to the reviewers

      Response to reviewers: Woodcock et al. 2021

      Reviewer 1 (Evidence, reproducibility, and clarity):

      Summary The authors resolved the biosynthesis of trehalose and alpha-glucan in Pseudomonas aeruginosa and the role of these two compounds in osmotic and desiccation stress.

      We thank the reviewer for their positive review of our manuscript. Our responses to their specific queries are interspersed below.

      Major comments:

      • Are the key conclusions convincing? Yes

      • Should the authors qualify some of their claims as preliminary or speculative, or remove them altogether? No

      • Would additional experiments be essential to support the claims of the paper? Request additional experiments only where necessary for the paper as it is, and do not ask authors to open new lines of experimentation. Not necessary, comprehensive coverage of research topic.

        • Are the suggested experiments realistic in terms of time and resources? It would help if you could add an estimated cost and time investment for substantial experiments. * Not applicable
      • Are the data and the methods presented in such a way that they can be reproduced? Yes

        • Are the experiments adequately replicated and statistical analysis adequate? * Yes, everything is adequate but just one subtle concern: check the significance of the number of digits in the entries listed in Table S3. Revise Table S3.

      Table S3 has been revised as requested. The data in this table is now presented correct to one decimal place.

      Minor comments:

      • Specific experimental issues that are easily addressable. Not applicable (Table S3: see above)

        • Are prior studies referenced appropriately? No. Refs. 18- 32: The subjects of 'trehalose' and 'osmotic stress' have already been addressed in the Pseudomonas field and should be referenced. The authors cite work carried out on trehalose and osmotic stress on phylogenetically distant microorganisms, but do not cite related work from the Pseudomonas field which I consider to be inappropriate. Similarly, trehalose biosynthesis in Pseudomonas* has not only been covered by refs. 47 and 48.

      This is a fair comment. The focus of our introduction came from a desire to concentrate specifically on the metabolism and intracellular function of trehalose/α-glucan in Pseudomonas. In hindsight, we acknowledge that our introduction is a little too narrowly focussed. We have expanded the introduction and discussion sections to include additional discussion of trehalose in Pseudomonas and its regulation in the CF lung.

      • Are the text and figures clear and accurate? Extremely well written manuscript and prepared figures

        • Do you have suggestions that would help the authors improve the presentation of their data and conclusions? Revise the list of references and discuss more thoroughly your novel findings in the light of existing knowledge in the Pseudomonas* field.

          Please see previous comment relating to the literature.

      Reviewer 1 (Significance):

      Significance

        • Describe the nature and significance of the advance (e.g. conceptual, technical, clinical) for the field. Conceptual advance: The authors identified and characterized the enzymatic pathway of trehalose and alpha-glucan biosynthesis in Pseudomonas aeruginosa and its role to cope with osmotic and desiccation stress. The authors' conclusions do not correspond with recently published peers' work; hence they should discuss in more detail why they consider their data to be more accurate to discern the role of trehalose to contain desiccation and osmotic stress in P. aeruginosa*.

          Please see previous comment relating to the literature. In general, the published work to date on trehalose in Pseudomonas spp. does not consider GlgE pathway-mediated link to α-glucan that we characterise in this paper. Our work demonstrates that synthesis and metabolism of the two molecules are implicitly linked in species where the GlgE pathway is present, and they cannot be considered in isolation. For this reason we are very confident that our study represents the most accurate model to date for trehalose and α-glucan metabolism and their associated phenotypes in P. aeruginosa. We have therefore emphasised that the role of trehalose in Pseudomonas spp. should be re-evaluated in light of our findings.

        • Place the work in the context of the existing literature (provide references, where appropriate). Existing literature focusing on trehalose, osmotic stress, desiccation stress in the Pseudomonas *field not cited by the authors:
      • These papers are of variable scientific quality, but the conceptual work by Hallsworth and the work by Behrens on the PA metabolome in CF lungs are worth discussing. All other work provides pieces of information on function and biosynthesis of trehalose up to now known by the Pseudomonas community. The authors resolved the function of the GlgA operon which will be definitely appreciated.

        We thank the reviewer for these helpful suggestions. We have reviewed these papers carefully and have incorporated several, including the papers from Hallsworth and Behrens into the revised manuscript.

      Strengths of the manuscript:

      • Meticulously planned and carefully executed experiments, not a single experimental flaw
      • Very high technical quality of experiments and primary data
      • Comprehensive coverage of the research topic
      • Excellent presentation in text and illustrations Only weakness:

      • Insufficient consideration of peers' published work on trehalose and its role in stress response in P. aeruginosa

        Please see previous comment relating to the literature.

        • State what audience might be interested in and influenced by the reported findings. Scientists working in the fields of glycoconjugate and carbohydrate research, biochemists, microbiologists with interest in metabolic pathways, stress response and/or Pseudomonas. __Reviewer #2 (Evidence, reproducibility, and clarity):*__

      It will be difficult for me to write a review of this paper and for the authors to make sense of my review because the manuscript's pages / lines are not numbered…

      We apologise to the reviewer for this oversight.

      Summary The authors carried out a comprehensive characterization of the metabolism of trehalose in Pseudomonas aeruginosa PA01, using techniques of biochemistry, reverse genetics, and bioinformatics. The main findings include that the disaccharide trehalose is synthesized in this organism from branched chain α-glucans and that the catabolism of trehalose proceeds via another disaccharide, maltose and is fed back into the synthesis of α-glucans. Trehalose and α-glucans have been implicated in conferring resistance to abiotic stresses in other organisms. The authors show that mutants that are blocked in the synthesis of trehalose are sensitive to high salinity but are normal with respect to their sensitivity to desiccation, whereas mutants impaired in the accumulation of α-glucans are sensitive to desiccation without being unduly sensitive to osmotic stress. These results indicate that trehalose and α-glucans have different roles in abiotic stress-tolerance.

      Major points

      This manuscript describes an impressive amount of careful work and presents new insights into the metabolism of trehalose, maltose, and α-glucans. However, the authors should address the following major comments before the paper is accepted.

      We thank the reviewer for their thorough and positive assessment of the manuscript. We address their specific points below.

      • Discussion: the authors state that "trehalose protects Pseudomonas ssp. against osmotic stress, most likely due to its role as a compatible solute." According to Table 2, P. aeruginosa grown in the medium of low osmolarity accumulated 0.13% trehalose per gram dry weight, i.e. ~4 μmol / g dry weight. Assuming that the dry weight / wet weight ratio of P. aeruginosa is the same as that of P. putida, which is ~1/3 (PMID: 6508285), the concentration of trehalose in the cells calculates to be ~2 mM. It is not plausible that trehalose could be significant as compatible solute at this low concentration.
      • One way out could be if the accumulation of this disaccharide were increased by osmotic stress. The authors should also measure the trehalose content of cells grown in medium containing 0.85 M NaCl. In case of positive results in this experiment, it would be interesting to determine the effects of osmotic stress on the levels of trehalose biosynthetic and catabolic enzymes, but this would not be necessary for the acceptance of the paper.

        This is a fair point. To address this, we measured the trehalose and maltose-1-phosphate levels for PA01 grown in the presence of 0.85 M NaCl. We saw a highly significant increase in the abundance of trehalose, compared to growth on standard M9 media. This strongly suggests that trehalose accumulates under conditions of osmotic stress as suggested by the reviewer. These new results have been added to the relevant sections of the manuscript (M&M, results, table 2 and discussion). The student (Danny Ward) who conducted these new experiments has been added to the author list.

      • However, there is also an extensive literature suggesting that trehalose has antioxidant functions e.g. PMID: 29241092 (the first paper that came up in Google search for "trehalose as antioxidant"). The authors should discuss this possible alternate role of trehalose.

        The reviewer is correct that trehalose has well-documented antioxidant functions in various species. We have modified the introduction to address this. To maintain the focus of our manuscript on bacteria we have used a different example to that suggested by the reviewer.

      • It is not described adequately in the Materials and Methods how the cellular contents of trehalose and maltose-1-phosphate (M1P) were determined.

        The Materials and Methods section has been revised to include more details of this method.

      • I found the growth curves in Figure 8, especially in panel B, to be uninterpretable. The authors should spread these data into more panels or use some other method to make them clearer.

        We have expanded the legend for Figure 8 to describe more fully what is going on in this figure. The results in Figure 8 are grouped according to the operons in which each set of genes is located. As such, the graphs contain unequal numbers of curves, with 8B containing the most and 8C only showing data for WT and ΔglgP.

      • The statement "The GlgA and GlgE proteins . . . enable two alternate mechanisms for linear α-glucan biosynthesis", which is echoed a number of times in the manuscript, seems to create the impression that there are two de novo pathways of synthesis of these polysaccharides. However, as shown in Figure 1, the GlgA pathway is the only route to the net synthesis of α-glucans, and GlgE is only part of a recycling pathway. Therefore, it cannot be true that "the vast majority of α-glucan accumulated by P. aeruginosa will be produced by GlgE".

        We have revised this section to further clarify what we mean when we state that the majority of α-glucan accumulated by P. aeruginosa will be produced by GlgE. Our data suggest that there is a big difference between the generation of α-glucan (conducted by both GlgA and GlgE) and its accumulation (flux through GlgA generated α-glucan is high, so only GlgE generated α-glucan can accumulate to generate large polymers).

      • The authors state that "MalQ disproportionates (sic) α-glucan with glucose to produce maltose." Figure 1 shows that GlgE uses an "acceptor", which I assume could be glucose. How is free glucose synthesized? Could cells grown on a non-carbohydrate as sole carbon source make free glucose?

        P. aeruginosa is able to carry out gluconeogenesis, so it can produce glucose from non-carbohydrate carbon sources if necessary.

      Our data show that GlgE acceptor preference gets lower as the acceptor molecule gets shorter. It is possible to detect GlgE activity without an acceptor. In this case we see a lag, implying M1P hydrolyses slowly at first and priming with glucose is also slow. Eventually however, the products get long enough for the reaction to take off. MalQ will work with DP2 or longer as the donor and DP1 or longer as the acceptor, moving one glucose unit at a time.

      • Pedantic point, but "disproportionation" means an oxidation-reduction reaction in which two identical molecules are used to produce two different molecules (https://en.wikipedia.org/wiki/Disproportionation). The reaction catalysed by MalQ does not involve electron transfer. Don't the authors mean that this enzyme is a glycosyl transferase?

        We have checked this, and our use of disproportionation in the manuscript is correct. The definition of disproportionation is any desymmetrizing reaction of the following type: 2 A → A' + A", and is not limited to redox reactions. MalQ carries out a reaction of this type when presented with a maltooligosaccharide.

      • The authors state that TreS had "a very high Km for trehalose (>100 mM)". In view of the low concentration of trehalose (Point 1, above), the physiological relevance of this suggested activity is questionable.

        See response to question 1 above. As trehalose levels are elevated under osmostress conditions this concern becomes less critical. It is of course true that conditions in vitro may not fully reflect cellular conditions and that this activity may be higher in vivo, but this is a general limitation of all protein biochemistry studies. The important point here is that trehalose synthase activity is detected for PA01 TreS.

      • Explain better what "predicted mean log10(CFU) means.

        The predicted mean refers to the value of log10(CFU) predicted by the statistical model we use. We have clarified this in the relevant sections of the manuscript.

      • Can the authors suggest how "α-glucan protects PA01 against desiccation"?

        Without further investigation we can only speculate as to how α-glucan confers desiccation tolerance in PA01. One possibility is that α-glucan functions as a hydrogel, like the exopolysaccharide alginate, trapping water molecules and slowing their evaporation. Alternatively, it may confer a structural role akin to that of trehalose, preventing the loss of cell integrity as water levels decrease. We now address these possibilities in the discussion.

      • Can P. aeruginosa metabolize exogenous trehalose or maltose? If the authors know either way, they should mention it. If they don't know, I am not suggesting that they should test this for this paper, but it would be interesting to know whether these compounds would induce the expression of the trehalose or maltose catabolic enzymes or repress the relevant biosynthetic enzymes. >P. aeruginosa is able to metabolise exogenous maltose and trehalose. While the experiments that the reviewer suggests are certainly interesting, in our view tre/glg gene regulation is beyond the scope of the current manuscript. This field is certainly worth investigating in the future, however.

      Minor points

      • First page under "Results": "phosphomutase" should be "phosphoglucomutase"?

        Changed as requested.

      • Discussion: insert "P. syringae" before "Pto".

        Changed as requested.

      • Materials and Methods: describe how ADP was quantified in the maltokinase assay.

        The materials and methods section has been updated as requested.

      Reviewer 2 (Significance):

      Significance

      Until this work, the biosynthesis of trehalose has been most extensively characterized in Escherichia coli, in which it has been shown that this disaccharide is made by the reaction of glucose-6-phosphate and UDP-glucose to give trehalose-6-phosphate and dephosphorylation to trehalose, catalysed by OtsA and OtsB. The authors discovered a very different pathway in P. aeruginosa in which the synthesis of trehalose goes through α-glucans as intermediates.

      Because trehalose and α-glucans are needed for osmotic stress- and desiccation-tolerance, respectively, this work is of significance to researchers studying abiotic stress resistance.

    2. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #2

      Evidence, reproducibility and clarity

      Review of manuscript "Trehalose and α-glucan mediate distinct abiotic responses in Pseudomonas aeruginosa" by S. D. Woodcock et al.

      It will be difficult for me to write a review of this paper and for the authors to make sense of my review because the manuscript's pages / lines are not numbered. I will do my best write a review, but for the future, I urge this Journal to print the text on pages in which the lines are numbered or require this of the authors.

      Summary.

      The authors carried out a comprehensive characterization of the metabolism of trehalose in Pseudomonas aeruginosa PA01, using techniques of biochemistry, reverse genetics, and bioinformatics. The main findings include that the disaccharide trehalose is synthesized in this organism from branched chain α-glucans and that the catabolism of trehalose proceeds via another disaccharide, maltose and is fed back into the synthesis of α-glucans. Trehalose and α-glucans have been implicated in conferring resistance to abiotic stresses in other organisms. The authors show that mutants that are blocked in the synthesis of trehalose are sensitive to high salinity but are normal with respect to their sensitivity to desiccation, whereas mutants impaired in the accumulation of α-glucans are sensitive to desiccation without being unduly sensitive to osmotic stress. These results indicate that trehalose and α-glucans have different roles in abiotic stress-tolerance.

      Major points.

      This manuscript describes an impressive amount of careful work and presents new insights into the metabolism of trehalose, maltose, and α-glucans. However, the authors should address the following major comments before the paper is accepted.

      1. Discussion: the authors state that "trehalose protects Pseudomonas ssp. against osmotic stress, most likely due to its role as a compatible solute." According to Table 2, P. aeruginosa grown in the medium of low osmolarity accumulated 0.13% trehalose per gram dry weight, i.e. ~4 μmol / g dry weight. Assuming that the dry weight / wet weight ratio of P. aeruginosa is the same as that of P. putida, which is ~1/3 (PMID: 6508285), the concentration of trehalose in the cells calculates to be ~2 mM. It is not plausible that trehalose could be significant as compatible solute at this low concentration.<br> One way out could be if the accumulation of this disaccharide were increased by osmotic stress. The authors should also measure the trehalose content of cells grown in medium containing 0.85 M NaCl. In case of positive results in this experiment, it would be interesting to determine the effects of osmotic stress on the levels of trehalose biosynthetic and catabolic enzymes, but this would not be necessary for the acceptance of the paper.<br> However, there is also an extensive literature suggesting that trehalose has antioxidant functions e.g. PMID: 29241092 (the first paper that came up in Google search for "trehalose as antioxidant"). The authors should discuss this possible alternate role of trehalose.<br> It is not described adequately in the Materials and Methods how the cellular contents of trehalose and maltose-1-phosphate (M1P) were determined.
      2. I found the growth curves in Figure 8, especially in panel B, to be uniterpretable. The authors should spread these data into more panels or use some other method to make them clearer.
      3. The statement "The GlgA and GlgE proteins . . . enable two alternate mechanisms for linear α-glucan biosynthesis", which is echoed a number of times in the manuscript, seems to create the impression that there are two de novo pathways of synthesis of these polysaccharides. However, as shown in Figure 1, the GlgA pathway is the only route to the net synthesis of α-glucans, and GlgE is only part of a recycling pathway. Therefore, it cannot be true that "the vast majority of α-glucan accumulated by P. aeruginosa will be produced by GlgE".
      4. The authors state that "MalQ disproportionates (sic) α-glucan with glucose to produce maltose." Figure 1 shows that GlgE uses an "acceptor", which I assume could be glucose.<br> How is free glucose synthesized? Could cells grown on a non-carbohydrate as sole carbon source make free glucose? Pedantic point, but "disproportionation" means an oxidation-reduction reaction in which two identical molecules are used to produce two different molecules (https://en.wikipedia.org/wiki/Disproportionation). The reaction catalyzed by MalQ does not involve electron transfer. Don't the authors mean that this enzyme is a glycosyl transferase?
      5. The authors state that TreS had "a very high Km for trehalose (>100 mM)". In view of the low concentration of trehalose (Point 1, above), the physiological relevance of this suggested activity is questionable.
      6. Explain better what "predicted mean log10(CFU) means.
      7. Can the authors suggest how "α-glucan protects PA01 against desiccation"?
      8. Can P. aeruginosa metabolize exogenous trehalose or maltose? If the authors know either way, they should mention it. If they don't know, I am not suggesting that they should test this for this paper, but it would be interesting to know whether these compounds would induce the expression of the trehalose or maltose catabolic enzymes or repress the relevant biosynthetic enzymes.

      Minor points.

      1. First page under "Results": "phosphomutase" should be "phosphoglucomutase"?
      2. Discussion: insert "P. syringae" before "Pto".
      3. Materials and Methods: describe how ADP was quantified in the maltokinase assay.

      Significance

      Significance.

      Until this work, the biosynthesis of trehalose has been most extensively characterized in Escherichia coli, in which it has been shown that this disaccharide is made by the reaction of glucose-6-phosphate and UDP-glucose to give trehalose-6-phosphate and dephosphorylation to trehalose, catalyzed by OtsA and OtsB. The authors discovered a very different pathway in P. aeruginosa in which the synthesis of trehalose goes through α-glucans as intermediates.<br> Because trehalose and α-glucans are needed for osmotic stress- and desiccation-tolerance, respectively, this work is of significance to researchers studying abiotic stress resistance.

      The Reviewers' guidelines stipulate that Reviewers should define their fields of expertise.

      My credentials are: a) I have been solicited to review this paper, and b) I have publications in osmotic stress adaptation and trehalose biosynthesis in Enterobacteriaceae.

    3. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #1

      Evidence, reproducibility and clarity

      Summary:

      Provide a short summary of the findings and key conclusions (including methodology and model system(s) where appropriate). Please place your comments about significance in section 2.

      The authors resolved the biosynthesis of trehalose and alpha-glucan in Pseudomonas aeruginosa and the role of these two compounds in osmotic and desiccation stress.

      Major comments:

      • Are the key conclusions convincing?

      yes

      • Should the authors qualify some of their claims as preliminary or speculative, or remove them altogether?

      no

      • Would additional experiments be essential to support the claims of the paper? Request additional experiments only where necessary for the paper as it is, and do not ask authors to open new lines of experimentation.

      Not necessary, comprehensive coverage of research Topic

      • Are the suggested experiments realistic in terms of time and resources? It would help if you could add an estimated cost and time investment for substantial experiments.

      Not applicable

      • Are the data and the methods presented in such a way that they can be reproduced?

      yes

      • Are the experiments adequately replicated and statistical analysis adequate?

      Yes, everything is adequate but just one subtle concern: check the significance of the number of digits in the entries listed in Table S3. Revise Table S3.

      Minor comments:

      • Specific experimental issues that are easily addressable.

      not applicable (Table S3: see above)

      • Are prior studies referenced appropriately?

      No. Refs. 18- 32: The subjects of 'trehalose' and 'osmotic stress' have already been addressed in the Pseudomonas field and should be referenced. The authors cite work carried out on trehalose and osmotic stress on phylogenetically distant microorganisms, but do not cite related work from the Pseudomonas field which I consider to be inappropriate. Similarly, trehalose biosynthesis in Pseudomonas has not only been covered by refs. 47 and 48.

      • Are the text and figures clear and accurate?

      Extremely well written manuscript and prepared figures

      • Do you have suggestions that would help the authors improve the presentation of their data and conclusions?

      Revise the list of references and discuss more thoroughly your novel findings in the light of existing knowledge in the Pseudomonas field

      Significance

      2. Significance

      • Describe the nature and significance of the advance (e.g. conceptual, technical, clinical) for the field.

      Conceptual advance: The authors identified and characterized the enzymatic pathway of trehalose and alpha-glucan biosynthesis in Pseudomonas aeruginosa and its role to cope with osmotic and desiccation stress. The authors' conclusions do not correspond with recently published peers' work, hence they should discuss in more detail why they consider their data to be more accurate to discern the role of trehalose to contain desiccation and osmotic strass in P. aeruginosa.

      • Place the work in the context of the existing literature (provide references, where appropriate).

      Existing literature focusing on trehalose, osmotic stress, desiccation stress in the Pseudomonas field not cited by the authors

      Pazos-Rojas LA, Muñoz-Arenas LC, Rodríguez-Andrade O, López-Cruz LE, López- Ortega O, Lopes-Olivares F, Luna-Suarez S, Baez A, Morales-García YE, Quintero- Hernández V, Villalobos-López MA, De la Torre J, Muñoz-Rojas J. Desiccation- induced viable but nonculturable state in Pseudomonas putida KT2440, a survival strategy. PLoS One. 2019 Jul 19;14(7):e0219554. doi:10.1371/journal.pone.0219554.

      Wang T, Jia S, Dai K, Liu H, Wang R. Cloning and expression of a trehalose synthase from Pseudomonas putida KT2440 for the scale-up production of trehalose from maltose. Can J Microbiol. 2014 Sep;60(9):599-604. doi: 10.1139/cjm-2014-0330.

      Harty CE, Martins D, Doing G, Mould DL, Clay ME, Occhipinti P, Nguyen D, Hogan DA. Ethanol Stimulates Trehalose Production through a SpoT-DksA-AlgU-Dependent Pathway in Pseudomonas aeruginosa. J Bacteriol. 2019 May 22;201(12):e00794-18. doi: 10.1128/JB.00794-18.

      Cross M, Biberacher S, Park SY, Rajan S, Korhonen P, Gasser RB, Kim JS, Coster MJ, Hofmann A. Trehalose 6-phosphate phosphatases of Pseudomonas aeruginosa. FASEB J. 2018 Oct;32(10):5470-5482. doi: 10.1096/fj.201800500R.

      Wang T, Jia S, Dai K, Liu H, Wang R. Cloning and expression of a trehalose synthase from Pseudomonas putida KT2440 for the scale-up production of trehalose from maltose. Can J Microbiol. 2014 Sep;60(9):599-604. doi: 10.1139/cjm-2014-0330.

      Behrends V, Ryall B, Zlosnik JE, Speert DP, Bundy JG, Williams HD. Metabolic adaptations of Pseudomonas aeruginosa during cystic fibrosis chronic lung infections. Environ Microbiol. 2013 Feb;15(2):398-408. doi: 10.1111/j.1462-2920.2012.02840.x

      Behrends V, Ryall B, Wang X, Bundy JG, Williams HD. Metabolic profiling of Pseudomonas aeruginosa demonstrates that the anti-sigma factor MucA modulates osmotic stress tolerance. Mol Biosyst. 2010 Mar;6(3):562-9. doi: 10.1039/b918710c.

      Matthijs S, Koedam N, Cornelis P, De Greve H. The trehalose operon of Pseudomonas fluorescens ATCC 17400. Res Microbiol. 2000 Dec;151(10):845-51. doi: 10.1016/s0923-2508(00)01151-7.

      van der Werf MJ, Overkamp KM, Muilwijk B, Koek MM, van der Werff-van der Vat BJ, Jellema RH, Coulier L, Hankemeier T. Comprehensive analysis of the metabolome of Pseudomonas putida S12 grown on different carbon sources. Mol Biosyst. 2008 Apr;4(4):315-27. doi: 10.1039/b717340g.

      Hallsworth JE, Heim S, Timmis KN. Chaotropic solutes cause water stress in Pseudomonas putida. Environ Microbiol. 2003 Dec;5(12):1270-80. doi: 10.1111/j.1462-2920.2003.00478.x.

      Ball P, Hallsworth JE. Water structure and chaotropicity: their uses, abuses and biological implications. Phys Chem Chem Phys. 2015 Apr 7;17(13):8297-305. doi: 10.1039/c4cp04564e

      Cray JA, Russell JT, Timson DJ, Singhal RS, Hallsworth JE. A universal measure of chaotropicity and kosmotropicity. Environ Microbiol. 2013 Jan;15(1):287-96. doi: 10.1111/1462-2920.12018.

      Chin JP, Megaw J, Magill CL, Nowotarski K, Williams JP, Bhaganna P, Linton M, Patterson MF, Underwood GJ, Mswaka AY, Hallsworth JE. Solutes determine the temperature windows for microbial survival and growth. Proc Natl Acad Sci U S A. 2010 Apr 27;107(17):7835-40. doi: 10.1073/pnas.1000557107.

      These papers are of variable scientific quality, but the conceptual work by Hallsworth and the work by Behrens on the PA metabolome in CF lungs are worth discussing. All other work provides pieces of information on function and biosynthesis of trehalose up to now known by the Pseudomonas community. The authors resolved the function of the GlgA operon which will be definitely appreciated.

      Strengths of the manuscript:

      • Meticulously planned and carefully executed experiments, not a single experimental flaw • very high technical quality of experiments and primary data • comprehensive coverage of the research topic • excellent presentation in text and illustrations

      only weakness: • insufficient consideration of peers' published work on trehalose and its role in stress response in P. aeruginosa

      • State what audience might be interested in and influenced by the reported findings.

      Scientists working in the fields of glycoconjugate and carbohydrate research, biochemists, microbiologists with interest in metabolic pathways, stress response and/or Pseudomonas

      • Define your field of expertise with a few keywords to help the authors contextualize your point of view. Indicate if there are any parts of the paper that you do not have sufficient expertise to evaluate.

      Reviewer's expertise: Pseudomonas genomics and physiology, respiratory tract infections, solid background in biochemistry and molecular biology

    1. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Reviewer #4

      Evidence, reproducibility and clarity

      We have reviewed "A specific regulator of neuronal V-ATPase in Drosophila melanogaster." by Dulac et al. The authors have identified VhaAC45L as a regulator of neuronal V-ATPase in Drosophila melanogaster. The authors have utilized multiple techniques to determine the localization of VhaAC45L in neurons and specifically in the synapse. The use of multiple approaches including determining RNA levels in different regions of the fly, and using CRISPR-Cas9 technique to insert V5 tag, makes a very convincing argument about the synapse-specific expression of VhaAC45L.

      The combined use of co-immunoprecipitation technique and LC/MS to show that VhaAC45L co-precipitated with V-ATPase complex subunits is convincing that VhaAC45L is a subunit of V-ATPase. To determine the role of VhaAC45L in acidification of synaptic vesicles the authors have utilized pHluorins in combination with multiple RNAi lines. The authors have used a well-designed experiment to prove that VhaAC45L regulates acidification of the synaptic vesicles. Further, larval locomotion and quantal size determination using VhaAC45LRNAi which is known to be altered due to pH gradient of synaptic vesicles shows the functional role of VhaAC45L in synaptic vesicle acidification.

      Minor comments:

      1. For all graphs, please remove gridlines to make data points more visible.
      2. Line 120-123: Authors indicate the VhaAC45LRNAi induced lethal phenotype when expressed in glutamatergic and cholinergic drivers but the figure is missing. Please indicate as "data not shown" if not included in Figure.
      3. A diagram summarizing the role of VhaAC45L in V-ATPase enzymatic complex and specific role is recommended.

      Significance

      V-ATPase play a crucial role at the synapse by being responsible for acidification of the synaptic vesicles and identification of a synaptic vesicle specific regulator of V-APTase is important to understand the complex regulation of synapse function. The authors have used well-designed experiments to convince the localization and function of VhaAC45L in synaptic vesicle acidification.

      Referees cross commenting

      The summary of Reviewer#2 looks good!

    2. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Reviewer #3

      Evidence, reproducibility and clarity

      In this study, Dulac and colleagues investigated roles of VhaAC45-like gene, which codes one of the V-ATPase accessory proteins in Drosophila, in synaptic transmission. First, they demonstrated that VhaZC45L transcripts are expressed selectively in neurons and that the gene products are addressed to synaptic areas. Second, they showed that VhaAC45L is co-immunoprecipitated with some subunits of V-ATPases, which is consistent with bio-informatics predictions. They further demonstrated that VhaAC45L-knockdown (KD) resulted in defects in synaptic vesicle acidification as well as a reduction in quantal size of glutamate, indicating that VhaAC45L play a key role in regulating neurotransmitter release by modulating the driving force for transmitter uptake. Last, not least, they demonstrated that VhaAC45L-KD in motoneurons attenuated larvae locomotor performance, indicating its physiological relevance. Overall, this study is rigorously executed and nicely presented, and adds one more component of the V-ATPase that is responsible for neurotransmitter uptake into synaptic vesicles. However, since this study simply confirmed an established notion from other species such as yeast and mammals that AC45 is one of the accessory proteins of the V-ATPase complex, a conceptual novelty beyond the previous knowledge is relatively poor in its present form. Thus, this reviewer would suggest several issues as following to improve the comprehensiveness as well as novelty of the current manuscript.

      1. The reason why the authors focused on VhaAC45-'like' is somewhat obscure, and therefore should be explained. How different VhaAC45 and VhaAC45L are in terms of amino acid sequences, tissue distributions, and KO phenotypes. It seems more comprehensive if the authors provide some experimental evidence on VhaAC45; e.g. whether it is also expressed in neurons or not (Fig. 1), and, if VhaAC45 is neuronal, whether it can rescue the phenotypes of VhaAC45L-KD to certain degree (Figs 4 & 5).
      2. What is the mechanism of Ac45 in regulating V-ATPase activity? In mammals, it has been suggested that Ac45 is essential for proper sorting of the V-ATPase to the destined organelles (e.g. Jansen et al., Mol. Biol. Cell., 2010; Jansen et al., BBA, 2008). In this context, it should be examined whether VhaAC45L-KD would affect the synaptic localization of other V-ATPase subunits.
      3. Given that a rodent brain SV contains a few copies of the V-ATPase on average (Takamori et al., 2006, and some newer papers by others), it is interesting that >80% reduction of Ac45 showed moderate effects on quantal size. If SVs under study also contains 1 or 2 V-ATPase per SV, there must be some SVs lacking VhAC45L upon KD. In this context, it is interesting to see how VhaAC-KD (RNAi1~3) affect the frequencies of minis.
      4. In general, decrease in mini amplitudes is accounted for by changes in postsynaptic sensitivity for neurotransmitters. Although acidification deficits would support that decrease in quantal size is due to the decrease in the driving force for glutamate uptake, it should be examined whether the postsynaptic receptor fields are not affected by VhaAC45L-KD by recording postsynaptic response upon application of non-saturable concentrations of glutamate.
      5. Related to 4, it is also interesting to see if evoked responses are also attenuated as a result of VhaAC45L-KD, which is more physiologically relevant for locomotor activity phenotype than minis.

      Minor points

      1. Quantal size of glutamate is not affected by reduced expression of DVGLUT (Daniels et al., Neuron, 2006), which highly contrasts with VhaAC45L, expression of which defines quantal size. Distinct regulation of quantal size by the transporter and the V-ATPase subunit should be discussed.
      2. For electrophysiological experiments, respective sample traces should be shown in Figure 5.
      3. Only RNAi1 and RNAi2 lines were examined for SV pH estimation and mini analysis. The results from RNAi3 should be presented, or at least mentioned in the text.

      Significance

      As mentioned above, as it stands, the authors merely confirmed the pre-existing bioinformatic knowledge on one of the AC45 homologues in Drosophila. The audience of The EMBO Journal might be interested in how different/similar VhaAC45 and VhaAC45-like are, and their functional relevance. In particular, is VhaAC45 also mandatory for the V-ATPase functioning in neurons? Adding some basic information of VhaAC45, e.g. tissue distribution, KO phenotypes, and ability to rescue the VhaAC45-like-KD phenotypes, will certainly improve the comprehensiveness of this study, and capture audience's attention.

      Referees cross commenting

      I am fine with the summary of Reviewer#2

    3. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Reviewer #2

      Evidence, reproducibility and clarity

      In this study and using Drosophila melanogaster as a model system, Dulac et al report the very interesting discovery of a previously characterized neuronal specific regulator of the V-ATPase called VhaAC45L. They combine genetics, IHC, Mass spec and ephys to unravel the expression pattern and function of this protein. They find that it is required to acidify synaptic vesicles in glutamatergic neurons of the Drosophila larval neuromuscular junction, for appropriate synaptic transmission and for larval locomotion. The experiments are very well performed, the data presented very convincing and the paper is well written. Nonetheless, a few additional pieces of evidence and some level of expanded analysis would strengthen the conclusions and increase the depth of the work.

      Major comments:

      1. Figure 1F: the while the localization to the presynaptic terminal is convincing, where exactly the protein is localized to is not studied. The imaging in these experiments could use increased resolution and concomitantly colocalization studies with more specific synaptic vesicle markers.
      2. Figure 3B-G: these experiments should be complemented by a rescue experiment, ideally of the null mutant using a UAS construct and a pan neuronal driver, or - if such animals are viable to the third larval instar stage - a glutamatergic driver. If possible, it would also be good to study the NMJ phenotype of the null mutant rescued to viability using a neuronal driver that does not express in motor neurons (e.g. Chat-G4).
      3. Figure 5: the authors focus on quantal size which measures the postsynaptic response to spontaneous release from the presynaptic terminal. However, it is unclear how this directly relates to the locomotor deficit beyond signaling potential deficits in vesicle loading or fusion. It would be more convincing to also study evoked release, and expand the analysis of presynaptic properties (number of events, amplitude, frequency).
      4. General: showing some level of genetic interaction with V-ATPase subunits in at least some of the assays would be welcome.

      Minor comments:

      Some of the images, especially those in Figure 3, should be larger for ease of visualization.

      Significance

      The discovery of a neuronal specific regulator of the V-ATPase is very interesting. To my knowledge it is the first description of a neuronal specific V-ATPase related protein since the description of Vha100-1 by Hiesinger and colleagues in 2005. The work is therefore of great interest to researchers working on synaptic function in general and on synaptic vesicle biology in particular.

      I note that I do not have in depth expertise in electrophysiology, although I am sufficiently familiar with basic NMJ physiology experiments to render the opinions stated above.

      Referees cross commenting

      There seems to be overall consensus among the reviewers on 3 issues:

      1. A somewhat more precise understanding of the role of vhaAC45L in the synaptic vesicle cycle through better localization studies and some classic assays (like FM dye uptake).
      2. A little more characterization of the transmission defects (e.g. studying evoked responses) would be welcome.
      3. Ascertaining the validity of the alleles with rescue experiments, perhaps in the V5 mutant background to allow localization analysis in a rescued background.

      I think further biochemical analysis is interesting but probably beyond the scope of this initial description and would take too much time.

      The minor issues are easy to address

    4. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Reviewer #1

      Evidence, reproducibility and clarity

      Dulac et al. present a first in vivo characterization of the 'accessory' v-ATPase subunit vhaAC45L in Drosophila. The key findings are localization and association of the protein with v-ATPase complexes at synapses and a functional requirement based on lethality and reduced synaptic function. This is certainly a useful contribution to our understanding of neuronal v-ATPase functions in vivo. The main weakness of the study is a lack of depth. The study focuses on localization, co-IP of associated proteins, an analysis of acidification and reduced synaptic function in fly larvae, thus providing a baseline for mechanistic study. However, the mechanism of vhaAC45L is not addressed in this short report. How does is vhaAC45L function different from its homolog vhaAC45? Is it required for v-ATPase assembly? Is it required to localize the full v-ATPase complex (or just V0) to the synapse? Is the defect really due to partial loading of synaptic vesicles or does loss of vhaSC45L also affect endosomal and lysosomal function at synapses? The work as is certainly represents a publishable contribution without answering any of these questions - more as an invite for the community to study the role of vhaAC45L; however, I feel this is a bit of a missed opportunity to put the function of a new potential regulator of specific synaptic v-ATPase functions in the context of the most basic functions obvious in this field.

      My main concerns are:

      1. clearly, vhaAC45L is required for SOME function of v-ATPase in neurons - but it remains entirely unclear which one. It is not even clear what compartments are affected. Reduced quantal size of single vesicle exocytosis events can be a direct or indirect consequence of problems in SV biogenesis and recycling. Is exo- /endocytosis unaffected? (FM1-43 uptake!). What compartments are affects? (markers for synaptic vesicles versus lysosomal compartments!).
      2. molecular function: is vhaAC45L required for v-ATPase assembly? (IP/Pull-downs of v-ATPase complexes in the presence or absence of vhaAC45L with other subunits!).
      3. vha100 was proposed in Drosophila to function on synaptic vesicles and the lysosomal pathway, but, if I remember correctly, here quantal size was normal. I am missing a comparison between the two.
      4. The V5 knock-in is used both as a mutant as well as a tool to analyze protein localization. This is likely okay, but a little concern of course has to be that by creating a mutant protein through stop codon deletion its subcellular localization, turnover, etc. are not normal. Similarly, anti-V5 co-IPs will isolate proteins bound to the mutant variant of vhaAC45L. Minimally, IPs or pull-downs using other members of the V0 complex should be done to understand the role of vhaAC45L in direct comparison with vhaAC45 on complex assembly and possibly targeting to the synapse (or ideally targeting to specific compartments).

      Significance

      There is significance to the reporting of an accessory v-ATPase subunit required for SOME function of the v-ATPase in neurons. There is some lack of significance in the absence of basic mechanistic insight as to what vhaAC45L does to the v-ATPase in neurons.

      Referees cross commenting

      I'm fine with this summary!

    5. Note: This rebuttal was posted by the corresponding author to Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Reply to the reviewers

      We would like to thank the editors and the four reviewers for their careful consideration of our manuscript. We are very grateful for their positive appreciation of our work and we believe that their suggestions, which have been included in the preliminary revised version of the manuscript whenever possible, have greatly improved the quality of the paper and have helped us deepen our understanding of the results.

      We were happy to note that all the reviewers found value in our work, as stated in their general comments: “This is certainly a useful contribution to our understanding of neuronal V-ATPase functions in vivo” (…)” (Reviewer 1) – “Dulac et al report the very interesting discovery of a previously uncharacterized neuronal specific regulator of the V-ATPase. (…) The experiments are very well performed, the data presented very convincing and the paper is well written.” (Reviewer 2) – “The discovery of a neuronal specific regulator of the V-ATPase is very interesting (…) The work is therefore of great interest to researchers working on synaptic function in general and on synaptic vesicle biology in particular.” (Reviewer 3) – “The authors have used well-designed experiments to convince the localization and function of VhaAC45L in synaptic vesicle acidification.” (Reviewer 4).

      In their remarks, the reviewers suggested additional experiments that could be done to improve our understanding of the role of this new V-ATPase regulator, as well as several minor issues. We have addressed all their comments in our answers below, in which the full text of the reviews is included in blue type, and the responses in black. The line numbers refer to the revised version of the manuscript.

      Reviewer #1

      Dulac et al. present a first in vivo characterization of the 'accessory' v-ATPase subunit vhaAC45L in Drosophila. The key findings are localization and association of the protein with v-ATPase complexes at synapses and a functional requirement based on lethality and reduced synaptic function. This is certainly a useful contribution to our understanding of neuronal v-ATPase functions in vivo. The main weakness of the study is a lack of depth. The study focuses on localization, co-IP of associated proteins, an analysis of acidification and reduced synaptic function in fly larvae, thus providing a baseline for mechanistic study. However, the mechanism of vhaAC45L is not addressed in this short report. How does is vhaAC45L function different from its homolog vhaAC45? Is it required for v-ATPase assembly? Is it required to localize the full v-ATPase complex (or just V0) to the synapse? Is the defect really due to partial loading of synaptic vesicles or does loss of vhaAC45L also affect endosomal and lysosomal function at synapses? The work as is certainly represents a publishable contribution without answering any of these questions - more as an invite for the community to study the role of vhaAC45L; however, I feel this is a bit of a missed opportunity to put the function of a new potential regulator of specific synaptic v-ATPase functions in the context of the most basic functions obvious in this field.

      My main concerns are:

      1. clearly, vhaAC45L is required for SOME function of v-ATPase in neurons - but it remains entirely unclear which one. It is not even clear what compartments are affected. Reduced quantal size of single vesicle exocytosis events can be a direct or indirect consequence of problems in SV biogenesis and recycling.

      Is exo- /endocytosis unaffected? (FM1-43 uptake!).

      We agree that alterations in the synaptic vesicle release/recycling cycle could indeed contribute to the locomotion defect, in addition to the acidification impairment observed in VhaAC45L knockdown larvae. As suggested by the reviewer, we plan to carry out FM-dye assays to measure endocytosis and exocytosis at the neuromuscular junction of control versus VhaAC45L-KD animals. If successful, a new figure will be added to the final version of the paper.

      What compartments are affected? (markers for synaptic vesicles versus lysosomal compartments!).

      Finding out whether VhaAC45L is specifically involved in the acidification of synaptic vesicles, or if it also plays a similar role in other synaptic organelles, in particular lysosomes, would be very interesting indeed. However, we found that it was technically difficult to address this issue in the Drosophila nervous system. A good way would be to check whether the lysosomal pH is affected by VhaAC45L knockdown, as it is the case for synaptic vesicles.

      Unfortunately, because lysosomes are not abundant in neurons, lysosome-specific pH-sensitive probes such as Lysotracker do not yield detectable signals at Drosophila larval synapses. So, whether VhaAC45L is specific for synaptic vesicles or involved in the regulation of V-ATPase activity in all neuronal compartments reminas an open question for now.

      1. molecular function: is vhaAC45L required for v-ATPase assembly? (IP/Pull-downs of v- ATPase complexes in the presence or absence of vhaAC45L with other subunits!).

      In accordance with the reviewer, we are also very much eager to learn more about the precise molecular function of VhaAC45L, and in particular whether it is required or not for assembly of the V-ATPase complex. Pull-downs of V-ATPase proteins in controls versus VhaAC45L-KD could be used to address this question, but this would require a large quantity of antibodies directed against subunits of the V0 and V1 domains, respectively. Unfortunately, there are no such antibodies commercially available against Drosophila V-ATPase proteins. We have tried several antibodies that recognize V-ATPase subunits from other species and were predicted to react against Drosophila homologs, but with no success. The only V-ATPase antibodies currently at our disposal were samples generously sent to us by other laboratories in insufficient quantities for carrying out such experiments. To our regret, therefore, we were not able to answer this question until now because of the lack of appropriate tools.

      1. vha100 was proposed in Drosophila to function on synaptic vesicles and the lysosomal pathway, but, if I remember correctly, here quantal size was normal. I am missing a comparison between the two.

      We thank the reviewer for this comment. A comparison with previously published results on subunit Vha100-1 has now been added (lines 458-469) in the discussion related to this topic in the revised manuscript.

      1. The V5 knock-in is used both as a mutant as well as a tool to analyze protein localization. This is likely okay, but a little concern of course has to be that by creating a mutant protein through stop codon deletion its subcellular localization, turnover, etc. are not normal. Similarly, anti-V5 co-IPs will isolate proteins bound to the mutant variant of vhaAC45L. Minimally, IPs or pull- downs using other members of the V0 complex should be done to understand the role of vhaAC45L in direct comparison with vhaAC45 on complex assembly and possibly targeting to the synapse (or ideally targeting to specific compartments).

      It is indeed a legitimate concern to question the physiological relevance of results obtained by studying V5-tagged VhaAC45L. However, the V5 tag is very small (14 amino acids) and we fused it in place of the stop codon to keep intact the whole sequence of the protein. In addition, we found that the V5 knock-in flies are viable and fertile as homozygous. Given that the null mutants, as well as strong RNAi knockdowns, are lethal at early developmental stage, this suggests that the V5 knock-in has limited negative effects, if any, on VhaAC45L function. This led us to believe that at least a good portion of the V5-tagged protein might be targeted to the right subcellular compartment, and associate to its physiological partners.

      Significance:

      There is significance to the reporting of an accessory v-ATPase subunit required for SOME function of the v-ATPase in neurons. There is some lack of significance in the absence of basic mechanistic insight as to what vhaAC45L does to the v-ATPase in neurons.

      We agree that we did not elucidate here the precise molecular mechanisms by which VhaAC45L contributes to synaptic vesicle acidification. It is rather an initial description of a novel neuronal protein that appears to be essential for proper synaptic functioning, and we provide consistent evidence that its function requires specific interaction with the V-ATPase complex, and in particular with three subunits that reproducibly co-immunoprecipitated with VhaAC45L (namely Vha1C39-1, Vha100-1 and ATP6AP2). Please note that it took many years and many papers before the molecular mechanisms of action of comparable accessory subunits, such as ATP6AP1/AC45 or ATP6AP2, was better understood, and it is still nowadays a matter of investigation. It is therefore very demanding to expect that we describe the exact function of the previously uncharacterized VhaAC45L at all levels in a single first paper.

      Reviewer #2

      In this study and using Drosophila melanogaster as a model system, Dulac et al report the very interesting discovery of a previously uncharacterized neuronal specific regulator of the V-ATPase called VhaAC45L. They combine genetics, IHC, Mass spec and ephys to unravel the expression pattern and function of this protein. They find that it is required to acidify synaptic vesicles in glutamatergic neurons of the Drosophila larval neuromuscular junction, for appropriate synaptic transmission and for larval locomotion. The experiments are very well performed, the data presented very convincing and the paper is well written. Nonetheless, a few additional pieces of evidence and some level of expanded analysis would strengthen the conclusions and increase the depth of the work.

      Major comments:

      1. Figure 1F: the while the localization to the presynaptic terminal is convincing, where exactly the protein is localized to is not studied. The imaging in these experiments could use increased resolution and concomitantly colocalization studies with more specific synaptic vesicle markers.

      We agree that it would be very good to show this additional result. However, confocal microscopy does not provide sufficient resolution to localize the protein at the membrane of individual synaptic vesicles. Another way would be to see if VhaAC45L immunostaining co- localizes with domains enriched in synaptic vesicle markers, but these organelles are rather ubiquitously distributed in the synaptic boutons at the Drosophila neuromuscular junction. To correctly perform this experiment, we would have to do immuno-electron microscopy, a technique we do not master in our laboratory and that we did not plan to implement for the present work.

      1. Figure 3B-G: these experiments should be complemented by a rescue experiment, ideally of the null mutant using a UAS construct and a pan neuronal driver, or - if such animals are viable to the third larval instar stage - a glutamatergic driver. If possible, it would also be good to study the NMJ phenotype of the null mutant rescued to viability using a neuronal driver that does not express in motor neurons (e.g. Chat-G4).

      Although a rescue experiment could potentially add a further evidence that Vha45ACL deficiency is responsible for the synaptic vesicle acidification defect described in Figure 3, we don’t think that it is a requisite here because we obtained similar results by knocking down the gene using two different RNAis. As described in the manuscript, the pan-neuronal expression of Vha45ACL could rescue the embryonic lethality of the null mutant, so it would be theoretically possible to check the acidity level of synaptic vesicles at the neuromuscular junction of the recued larvae. However, this would involve making rather complex genetic constructions to express VMAT-pHluorin in motor neurons in rescued mutant background. In addition, the conclusions we could draw from such experiment would be limited by the lack of comparison. Indeed, in Figure 3 the defect was observed in knockdown context, and the same experiment could not be performed in knockout larvae due to the early lethality. If we could measure the acidity level of rescued null mutants, we would not have any comparison point besides the knockdown experiments. As knockout and knockdown are not likely to produce identical phenotype (especially in terms of magnitude of effect), the ideal would be to compare the rescued phenotype to the null mutant expressing VhaAC45L in all neurons except motoneurons, as suggested by the reviewer. However, such genotype would certainly not be viable, since we observed that expression of VhaAC45L RNAis with a stronger motoneurons driver (D42-Gal4) was sufficient to induce lethality at early developmental stage.

      1. Figure 5: the authors focus on quantal size which measures the postsynaptic response to spontaneous release from the presynaptic terminal. However, it is unclear how this directly relates to the locomotor deficit beyond signaling potential deficits in vesicle loading or fusion. It would be more convincing to also study evoked release, and expand the analysis of presynaptic properties (number of events, amplitude, frequency).

      We fully agree with this comment shared by Reviewers 2 and 3 related to the electrophysiology experiments. Note that these experiments have been carried out in collaboration with another laboratory located in another city. The Covid-19 situation during the past year has prevented, and is still complicating, movements between labs, preventing us from going further with the electrophysiology analyses of VhaAC45L KD. If the situation in the near future allows it, we would very much like to add a more extensive electrophysiological analysis, including in particular the study of evoked release. In the revised manuscript, we have nevertheless completed Figure 5 by adding representative distributions of spontaneous mEPSP amplitudes in control and VhaAC45L knockdown larvae, as well as the results of new analyses showing lack of effects the KD on the mean EPSP frequency.

      1. General: showing some level of genetic interaction with V-ATPase subunits in at least some of the assays would be welcome.

      We are definitely in accordance with the reviewer on that point, but we think that this would involve a lot of work and be beyond the scope of the present initial description. Here we show by proteomic analyses that at least 12 proteins co-precipitate and so potentially interact with VhaAC45L, three of them being previously identified constitutive or accessory V-ATPase subunits. In our opinion, studying the interactions between VhaAC45L and these proteins through genetic and molecular studies will be the subject of future works. As stated by Reviewer 2 in the Referees cross commenting below: “further biochemical analysis is interesting but probably beyond the scope of this initial description and would take too much time”. We fully agree with this statement.

      Minor comments:

      Some of the images, especially those in Figure 3, should be larger for ease of visualization.

      As requested, the images of Figure 3 have been enlarged.

      Significance

      The discovery of a neuronal specific regulator of the V-ATPase is very interesting. To my knowledge it is the first description of a neuronal specific V-ATPase related protein since the description of Vha100-1 by Hiesinger and colleagues in 2005. The work is therefore of great interest to researchers working on synaptic function in general and on synaptic vesicle biology in particular.

      We are grateful to the reviewer for his very positive assessment of our work.

      I note that I do not have in depth expertise in electrophysiology, although I am sufficiently familiar with basic NMJ physiology experiments to render the opinions stated above.

      Reviewer #3

      In this study, Dulac and colleagues investigated roles of VhaAC45-like gene, which codes one of the V-ATPase accessory proteins in Drosophila, in synaptic transmission. First, they demonstrated that VhaZC45L transcripts are expressed selectively in neurons and that the gene products are addressed to synaptic areas. Second, they showed that VhaAC45L is co- immunoprecipitated with some subunits of V-ATPases, which is consistent with bio-informatics predictions. They further demonstrated that VhaAC45L-knockdown (KD) resulted in defects in synaptic vesicle acidification as well as a reduction in quantal size of glutamate, indicating that VhaAC45L play a key role in regulating neurotransmitter release by modulating the driving force for transmitter uptake. Last, not least, they demonstrated that VhaAC45L-KD in motoneurons attenuated larvae locomotor performance, indicating its physiological relevance. Overall, this study is rigorously executed and nicely presented, and adds one more component of the V- ATPase that is responsible for neurotransmitter uptake into synaptic vesicles. However, since this study simply confirmed an established notion from other species such as yeast and mammals that AC45 is one of the accessory proteins of the V-ATPase complex, a conceptual novelty beyond the previous knowledge is relatively poor in its present form. Thus, this reviewer would suggest several issues as following to improve the comprehensiveness as well as novelty of the current manuscript.

      1. The reason why the authors focused on VhaAC45-'like' is somewhat obscure, and therefore should be explained. How different VhaAC45 and VhaAC45L are in terms of amino acid sequences, tissue distributions, and KO phenotypes. It seems more comprehensive if the authors provide some experimental evidence on VhaAC45; e.g. whether it is also expressed in neurons or not (Fig. 1), and, if VhaAC45 is neuronal, whether it can rescue the phenotypes of VhaAC45L- KD to certain degree (Figs 4 & 5).

      Following the reviewer’s request, we have added a sequence alignment of VhaAC45 and VhaAC45L, as well as a graph showing tissue distributions of both genes in Supplementary Figure 1 of the revised manuscript. To our knowledge, there is no published functional study of VhaAC45 in Drosophila, so we can only make assumptions derived from studies on predicted homologs in evolutionarily distant species. For that reason, it is difficult to compare VhaAC45 to VhaAC45L, as it would first require an entire new study of VhaAC45 function in flies. Since our interest is to study neuronal physiology, we focused on VhaAC45L because compelling evidence indicates that this subunit is specific to the nervous system, as described in our manuscript, rather than on VhaAC45 which seems to be expressed in all tissues. In addition, homologs of VhaAC45L have never been functionally characterized to date in any species, making it very interesting to study this new protein in a genetically tractable organism.

      1. What is the mechanism of Ac45 in regulating V-ATPase activity? In mammals, it has been suggested that Ac45 is essential for proper sorting of the V-ATPase to the destined organelles (e.g. Jansen et al., Mol. Biol. Cell., 2010; Jansen et al., BBA, 2008). In this context, it should be examined whether VhaAC45L-KD would affect the synaptic localization of other V-ATPase subunits.

      We thank the reviewer for pointing out these very interesting references. We have indeed tried to determine the relative abundance of two other V-ATPase subunits at the larval neuromuscular junction in control and VhaAC45L knockdown contexts. However, because the tested subunits are not specific to neurons, and are expressed at relatively low levels in synapses, it was not possible for us to properly separate the synaptic signal from the background immunostaining in surrounding muscles. This unfortunately prevented us from performing an accurate and reliable quantification.

      1. Given that a rodent brain SV contains a few copies of the V-ATPase on average (Takamori et al., 2006, and some newer papers by others), it is interesting that >80% reduction of Ac45 showed moderate effects on quantal size. If SVs under study also contains 1 or 2 V-ATPase per SV, there must be some SVs lacking VhAC45L upon KD. In this context, it is interesting to see how VhaAC-KD (RNAi1~3) affect the frequencies of minis.

      The reviewer’s valuable comment prompted us to undertake new analyses on our electrophysiological recordings. We have now added in Figure 5E graphs showing the mean EPSP frequency for larvae expressing VhAC45L RNAi1 and RNAi2, which are the ones that were used in the quantal analysis. Both of these RNAi apparently decreased the frequency compared to controls, but this difference was not statistically significant. As detailed in the Discussion (line 458-469), this may suggest that VhaAC45L does not influence the abundance of the V-ATPase complex at nerve terminals, but rather its efficiency.

      1. In general, decrease in mini amplitudes is accounted for by changes in postsynaptic sensitivity for neurotransmitters. Although acidification deficits would support that decrease in quantal size is due to the decrease in the driving force for glutamate uptake, it should be examined whether the postsynaptic receptor fields are not affected by VhaAC45L-KD by recording postsynaptic response upon application of non-saturable concentrations of glutamate.

      Testing for potential postsynaptic receptor field alteration by glutamate application would be an interesting experiment indeed, but, as we believe, not a critical control for the present manuscript. Because we expressed RNAis presynaptically, any modification in the postsynaptic receptor field would have to be an indirect consequence of VhaAC45L downregulation in motoneurons, and so, likely to be related to the synaptic vesicle acidification defect. It would not change, therefore, our conclusion that VhaAC45L deficiency in motoneurons induces a decrease in quantal size. Because electrophysiology experiments were carried out in collaboration with another laboratory located in another city, the current sanitary context has so far prevented us from performing this test (please refer to our answer to comment 3 of Reviewer 2 for more details).

      1. Related to 4, it is also interesting to see if evoked responses are also attenuated as a result of VhaAC45L-KD, which is more physiologically relevant for locomotor activity phenotype than minis.

      We also agree with this comment, shared by Reviewer 2, to which we already responded above in our answer to comment 3 of Reviewer 2.

      Minor points:

      1. Quantal size of glutamate is not affected by reduced expression of DVGLUT (Daniels et al., Neuron, 2006), which highly contrasts with VhaAC45L, expression of which defines quantal size. Distinct regulation of quantal size by the transporter and the V-ATPase subunit should be discussed.

      As suggested by the reviewer, a discussion of this point has been added (lines 458-469). and Daniels et al. 2006 is now cited in the revised manuscript.

      1. For electrophysiological experiments, respective sample traces should be shown in Figure 5.

      Quantal size is not directly visible in sample traces, so we added instead representative distributions of spontaneous mEPSP amplitudes in control and VhaAC45L knockdown larvae in the new Figure 5C.

      1. <![endif]>Only RNAi1 and RNAi2 lines were examined for SV pH estimation and mini analysis. The results from RNAi3 should be presented, or at least mentioned in the text.

      These experiments were performed using two different RNAi constructs to ensure that similar effects were observed and to exclude the possibility of potential off-targets. Knocking down VhaAC45L in neurons with RNAi1 and 2 was lethal at pupal stages, suggesting that they give similar levels of inactivation. RNAi3 systematically induced lighter phenotypes, producing viable adults, which led us to believe it had a lower efficiency. Because the results on synaptic vesicle acidification and electrophysiology were very consistent with RNAi1 and RNAi2, we considered that it was not necessary to repeat the experiment with RNAi3.

      Significance

      As mentioned above, as it stands, the authors merely confirmed the pre-existing bioinformatic knowledge on one of the AC45 homologues in Drosophila. The audience of The EMBO Journal might be interested in how different/similar VhaAC45 and VhaAC45-like are, and their functional relevance. In particular, is VhaAC45 also mandatory for the V-ATPase functioning in neurons? Adding some basic information of VhaAC45, e.g. tissue distribution, KO phenotypes, and ability to rescue the VhaAC45-like-KD phenotypes, will certainly improve the comprehensiveness of this study, and capture audience's attention.

      As mentioned in our response to point 1 of the reviewer above, we have added more data comparing the structure and distribution of VhaAC45 and VhaAC45L in the revised manuscript. VhaAC45 appears to be ubiquitously expressed whereas VhaAC45L is neuron-specific.

      Comparing VhaAC45 to VhaAC45L would require a completely new study of VhaAC45 function, because it has never been done before in Drosophila to our knowledge. This would require repeating all the experiments with this other gene, probably involving two more years of work, and would make for a much longer and very different manuscript. It is understandable that this cannot be envisaged. Because homologs of VhaAC45L have never been functionally characterized to date in any species, we considered that it was worth studying this new protein on its own.

      Reviewer #4

      We have reviewed "A specific regulator of neuronal V-ATPase in Drosophila melanogaster." by Dulac et al. The authors have identified VhaAC45L as a regulator of neuronal V-ATPase in Drosophila melanogaster. The authors have utilized multiple techniques to determine the localization of VhaAC45L in neurons and specifically in the synapse. The use of multiple approaches including determining RNA levels in different regions of the fly, and using CRISPR- Cas9 technique to insert V5 tag, makes a very convincing argument about the synapse-specific expression of VhaAC45L.

      The combined use of co-immunoprecipitation technique and LC/MS to show that VhaAC45L co- precipitated with V-ATPase complex subunits is convincing that VhaAC45L is a subunit of V- ATPase. To determine the role of VhaAC45L in acidification of synaptic vesicles the authors have utilized pHluorins in combination with multiple RNAi lines. The authors have used a well- designed experiment to prove that VhaAC45L regulates acidification of the synaptic vesicles.

      Further, larval locomotion and quantal size determination using VhaAC45LRNAi which is known to be altered due to pH gradient of synaptic vesicles shows the functional role of VhaAC45L in synaptic vesicle acidification.

      Minor comments:

      1. For all graphs, please remove gridlines to make data points more visible.

      We found that gridlines can be helpful for the readers to assess approximate values on the graphs. So, we have not removed them but rather changed the colour to a light grey so it does not affect any more visibility. We have also placed the points over the error bars in all the graphs, so they become more apparent.

      1. Line 120-123: Authors indicate the VhaAC45LRNAi induced lethal phenotype when expressed in glutamatergic and cholinergic drivers but the figure is missing. Please indicate as "data not shown" if not included in Figure.

      This mention has been added in the manuscript (line 125).

      1. A diagram summarizing the role of VhaAC45L in V-ATPase enzymatic complex and specific role is recommended.

      We believe that it is too early in this first report to draw an accurate diagram summarizing the role of this new protein in the V-ATPase complex.

      Significance

      V-ATPase play a crucial role at the synapse by being responsible for acidification of the synaptic vesicles and identification of a synaptic vesicle specific regulator of V-ATPase is important to understand the complex regulation of synapse function. The authors have used well-designed experiments to convince the localization and function of VhaAC45L in synaptic vesicle acidification.

      We thank the reviewer for his very positive appreciation of our work.

      Referees cross commenting

      (Written by Reviewer 2)

      There seems to be overall consensus among the reviewers on 3 issues:

      1. A somewhat more precise understanding of the role of vhaAC45L in the synaptic vesicle cycle through better localization studies and some classic assays (like FM dye uptake).

      —See our answers to comments 1 of Reviewer 1 and Reviewer 2.

      1. A little more characterization of the transmission defects (e.g. studying evoked responses) would be welcome.

      —See our answers comment 3 of Reviewer 2.

      1. Ascertaining the validity of the alleles with rescue experiments, perhaps in the V5 mutant background to allow localization analysis in a rescued background.

      —See our answers to comment 2 of Reviewer 2.

      I think further biochemical analysis is interesting but probably beyond the scope of this initial description and would take too much time.

      We fully agree with this statement.

      The minor issues are easy to address

      We have addressed all of them in the preliminary revised version of the manuscript.

    1. Note: This rebuttal was posted by the corresponding author to Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Reply to the reviewers

      Reviewer 1

      We would like to thank you for the comments concerning our manuscript. We responded to each question, as described below. All the authors feel that our manuscript has been much improved by your comments.

      Minor comments:

      Q1. Fig 1 any male vs female mice differences in ATF6b expression?

      Response. We performed qPCR using several tissues from male and felame WT mice, and confirmed no significant differences in Atf6b mRNA levels between male and female mice. We put this result in Figure S1 C.

      Q2. Fig 2C. Please show molecular weight markers on blots

      Response. We put molecular weight markers in Fig.2C, as you suggested.

      Q3. Fig 2C. what are the doublet bands on calnexin?

      Response. Calnexin is sometimes shown as double bands in tissues such as kidney, liver and heart by western blotting (Zeng et al., PLoS One. 2009 Aug 26;4(8):e6787). Although the mechanism is unknown, it could be due to the post-translational modification such as phosphorylation (Wong et al, J Biol Chem. 1998 Jul 3;273(27):17227-35) or partial degradation although proteinase inhibitors are added in the lysis buffer. To my knowledge, alternative splicing is not likely to be the case.

      Q4. Fig 3. what are the ERSE sequences? several different binding sites are reported in literature.

      Response. We put the ERSE sequence in Materials and Methods and in the Figure legends for Figure 3 as “CCAATN9CCACG (Yoshida et al., 1998)”.,

      Q5. p8. What is meant by 5' Atf6b lacks 10 and 11?

      Response We corrected to “Atf6b transcript, which lacks exon 10 and 11, in these mice”.

      Discussion: Please clarify if anti-ATF6-beta antibodies were available for these studies.

      Response. We tried different anti-ATF6β antibodies to detect endogenous ATF6β in culture neurons by western blot. We successfully observed both full-length and N-terminal fragment (the active form) using the one from Biolegend (#853202) (Figure 1E in the new version). We replaced the result with FLAG antibody in HEK293T cells in the old version.

      Discussion: It is puzzling that ATF6a induces calreticulin more potently than ATF6b, but the calreticulin defect is selectively dependent on ATF6b. Could authors speculate on this paradox? It would be interesting to expand on differences between ATF6a and ATF6b function and phenotypes in Discussion in mouse and in people.

      Response. In Discussion, we added sentences regarding a bit puzzling role for ATF6β in CRT expression in the CNS, as below. “All the data from RNA-sequence to the promoter analysis suggested that CRT expression was ATF6β-dependent in primary hippocampal neurons. However, overexpression of ATF6α and ATF6β both enhanced CRT promoter activity…”

      And we proposed a new scenario as below,

      “These results may raise a scenario that, in the CNS, expression of molecular chaperones in the ER is generally governed by ATF6α as previously described (Yamamoto et al., 2007) and that ATF6β functions as a booster if their levels are too low. However, expression of CRT is somewhat governed by ATF6β, and ATF6α functions as a booster. The underlying mechanism for this scenario is not clear yet, but neurons may require a high level of CRT expression even under normal condition, as described in Table S2, which may lead to the development of a unique biological system to constitutively produce CRT in neurons. Further studies are required to clarify the molecular basis how this unique system is constructed and regulated.”

      Reviewer 2

      We would like to thank you for the comments concerning our manuscript. We responded to each question, as described below. All the authors feel that our manuscript has been much improved by your comments.

      Major comments:

      Q1. The post-translational processing of ATF6beta must be demonstrated in hippocampal neurons and not in HEK293T cells in Figure 1E. The authors conclude on Page 6, line 18 that "these results suggest that ATF6beta functions in neurons" but it is not obvious how expression in HEK293T cells contributes to this conclusion in any way.

      Response. We performed western blot with different anti-ATF6β antibodies to detect endogenous ATF6β in culture neurons. We successfully observed both full-length and N-terminal fragment (the active form) from the one from Biolegend (#853202). We therefore replaced the result in HEK293T cells with the one in the hippocampal neurons (Figure 1E in new version).

      Q2. The hippocampal neurons are affected by the loss of ATF6β, even though the mice are not exposed to tunicamycin. Could the authors present evidence that there is physiological ER stress in hippocampal neurons? If not, why is ATF6beta required.

      Response Evidence suggests that neuronal activities including excitatory signals can cause physiological ER stress and induce the UPR at the distal dendrites in the hippocampal neurons (Murakami et al., Neuroscience. 2007 Apr 25;146(1):1-8, Saito et al., J Neurochem. 2018 Jan;144(1):35-49). Among the UPR branches, Ire1-XBP1 pathway has been reported to play an important role in this dendritic UPR and expression of BDNF in cell soma (Saito et al., 2018). Although the present study focuses on the role of ATF6β in the pathological ER stress which causes neuronal death, we believe that it will be intriguing to analyze its role of ATF6β in the physiological ER stress and in the local UPR machinery in neurons.

      Q3. In Figure 3, is there a specific reason why the authors do not mutate the ERSEs in the mouse CRT reporter, pCC1 and instead opt to analyze the huCRT reporter? Given that all the other observations in the manuscript are in mouse calreticulin, it is important to show that the ERSEs in the mouse calreticulin promoter are also regulated in an ATF6beta-dependent manner. Similar to the huCRT reporter, it is also crucial to examine if ATF6beta can regulate the mouse CRT promoter. This would provide an explanation for why calreticulin expression is not completely abolished in ATF6beta mutants.

      Response We added the data of the deletion mutant of mouse CRT promoter, pCC3, which has only 415bp, but still keeps both ERSE1 and 2 in it. pCC3 showed similar promoter activity to pCC1 (Figure 3 B) and huCRT (wt) (Figure 3 C) in both of WT and Atf6b-/- neurons. Because pCC5, which has 260bp but does not have ERSEs in it, lost completely CRT promoter activity (Waser et al., 1997), it is most likely that mouse and human CRT promoters are regulated in a similar manner via ERSEs.

      Q4. In Figure 5A and B, the density of Tubulin staining varies from panel to panel, and is much lower in ATF6beta mutants treated with Tg/Tm. Presumably this is because of cell death but this should be clarified in the main text. Additionally, it is unclear if the EthD-1 staining is nuclear localized. It would help if single channel images for Hoechst and EthD-1 were provided to visualize this.

      Response In Figure 5A and B, we added the statement for the reduction of Calcein-AM (A) and βIII tubulin (B) in the main text. We also added single channel images for Hoechst and EthD-1 in Figure S4 to confirm the nuclear localization of EthD-1.

      Q5. The literature reports that BAPTA-AM treatment itself could cause ER stress (e.g. PMID: 12531184). Here, the authors report the opposite effect. How could the authors reconcile the difference? The effects of BAPTA-AM and 2-APB must individually be examined in Figure 6C and not just in combination with Tm.

      Response. We added the data that BAPTA-AM and 2-APB alone did not cause neuronal death at the concentrations used in this study in Figure S6 B and in the main text.

      Q6. The authors allude to "impairment of Ca2+ homeostasis in ATF6beta mutants" in Page 13 Line 2, but do not show any direct evidence in support of it. While treatment with BAPTA-AM and 2-APB is a start in that direction, it certainly does not demonstrate that under homeostatic conditions in vivo or in vitro there is any change in calcium flux in ATF6beta hippocampal neurons. To make the case that there is indeed perturbation of Ca2+ in ATF6beta mutant hippocampal neurons, the authors need to examine calcium flux and measure calcium indicators and how they are affected when ER stress is induced in these mutant cells.

      Response We added the data that the Ca2+ store in the ER was reduced and Ca2+ concentration in the cytosol increased in Atf6b-/- neurons both under normal and ER stress conditions in Figure 4C.

      Q7. The effect of 2-APB and salubrinal alone on hippocampal neurons need to be examined in Figure 9B-D to eliminate the possibility that these drugs are not enhancing cell survival under normal conditions in a parallel manner.

      Response We added the data that 2-APB and salubrinal alone did not cause neuronal death in the hippocampus in our model in Figure S8 C.

      Q8. The rationale for the examination of Fos, Fosb and Bdnf is poorly described (page 14, line 13) and the conclusions from this line of experimentation are rather weak. The results from Figure 9 to some extent serve to confirm in vivo the data seen in Figure 6C but by no means provide a mechanism for why ATF6beta mutants have perturbed calcium homeostasis (page 14, line 22).

      Response We agreed with your comments that the examination of Fos, Fosb and Bdnf is relatively weak. We, therefore, moved these data to supplementary information (Figure S8 A and B).

      Minor comments:

      Q1. Page 8, line 3: Their rationale for why ATF6beta 5'UTR sequences are seen in their RNA seq data is not clearly explained. This must be rewritten for clarity.

      Response In Atf6b-/- mice, exon 10 and 11 were deleted by homologous recombination. Therefore, 5’ part of Atf6b gene including exon 1-9 can be transcribed. We added the statement in Results, as below.

      “this may be due to the presence of the 5’ Atf6b transcript with exon 1-9 in these mice, in which exon 10 and 11 were deleted by homologous recombination.”

      Q2. Page 8, line 5, the authors write that besides Atf6β , CRT was the only UPR-regulated gene downregulated in Atf6β mutant mice. The authors need to state how they defined "UPR-regulated genes". There must be a list, which the authors do not cite.**

      Response. To avoid the possible confusion, we changed the term “UPR-regulated genes” to “ER stress-responsive genes”.

      Q3. Page 9, line 10: A reference is required for ERSEs.

      Response We added the reference for ERSEs, as you suggested.

      Q4. Page 10, line 6: The authors say "ATF6beta specifically induces CRT promoter activity". This is a confusing statement because "induction" is in response to stress, but the context here is homeostatic regulation since there is ostensibly no stress being induced. This distinction should be made and corrected here and throughout the manuscript.

      Response To avoid the confusion, we changed the sentence to “ATF6β specifically enhances CRT promoter activity”.

      Q5. Page 10, line 16: The use of "latter" here is confusing and it would help to restructure this sentence for clarity.

      Response To avoid the confusion, we changed the phrase to “under control condition and after stimulation with Tg (Figure 4A upper row) or Tm (Figure 4A lower row)

      Q6. Figure 9A is missing Y-axis labels.

      Response We changed Figure 9A (Figure S8 A in new version) and Figure Legends to clarify what each axis indicates.

      Reviewer 3

      We would like to thank you for the comments concerning our manuscript. We responded to each question, as described below. All the authors feel that our manuscript has been much improved by your comments.

      Major comments

      Comment #1. The authors show that overexpression of either Atf6a or Atf6b both increase Crt expression in Atf6b knockout cells. While it is clear that deletion of Atf6a does not basally reduce Crt levels, the overexpression experiment does lead to a question as to how Atf6b can specifically be involved in regulating Crt expression. In the discussion, the authors seem to propose that homo- and hetero-dimerization of ATf6a and Atf6b are required for the basal expression of Crt and that Atf6b serves as a 'booster' of ER chaperone expression. They explicitly state that "Atf6a and Atf6b are required to induce CRT expression". However, it remains unclear to me why in this case would Atf6a deletion not impair Crt expression? The authors address this by invoking a mechanism whereby hippocampal neurons are more reliant on Atf6b for Crt expression, but this doesn't really make sense to me. Ultimately, this point underscores the lack of clear mechanistic basis to explain how Atf6b selectively regulates Crt in the hippocampus. This needs to be better resolved through more experimentation. For example, a ChIP experiment monitoring the binding of ATF6b and ATF6a to the Crt promoter in hippocampal and control cells would go a long way towards addressing this issue.**

      Response. In Discussion, we first made the point clearer that CRT expression is ATF6β-dependent, while those of other molecular chaperones in the ER are ATF6α-dependent. Then, we raised a scenario that, in the CNS, expression of molecular chaperones in the ER is generally governed by ATF6α as previously described (Yamamoto et al., 2007) and ATF6β functions as a booster if their levels are too low. However, expression of CRT is somewhat governed by ATF6β, and ATF6α functions as a booster. We also wrote the limitation of the current study and requirement of the further study to clarify the molecular basis of the unique system to ensure CRT expression in neurons.

      Comment #2. The importance of ATF6b for protecting against insults needs to be better described. For example, the authors should show that overexpression of ATF6b protects against ER stress induced neuronal toxicity in cell culture and in vivo kainate induced neuronal toxicity. Similarly, the authors should evaluate how overexpression of ATF6a protects against these insults to better define the specific dependence of hippocampal neurons on ATF6b. The authors do show that overexpression of ATF6b can rescue the reduced Crt observed in Atf6b-deleted neurons, but the protection should similarly be demonstrated.**

      Response. We performed rescuing experiments to see both of ATF6β and ATF6α overexpression improve cell viability of Atf6b-/- neurons under ER stress. Interesting. ATF6β, but not ATF6α, rescued Atf6b-/- neurons. In Discussion, we raised the possible reasons as below.

      “The lack of rescuing effect of ATF6α may be due to the fact that this molecule enhances the expression of different genes including cell death-related molecule CHOP in addition to molecular chaperons in the ER (Yoshida et al., 2000).”

      Comment #3. Similar to #2, the authors should show that the potential for ATF6b (and ATF6a) overexpression to protect against different insults is impaired in Crt+/- neurons. The authors demonstrate that Crt-depletion increases sensitivity to toxic insults. This would go a long way to demonstrate the importance of the proposed ATF6b-CRT signaling axis in regulating neuronal survival in response to pathologic insults.**

      Response. Unfortunately, right now, the breeding of Calr+/- mice is not in good condition. Although we are increasing the number of mice used for breeding, we have to wait pregnancies to get embryos for isolating neurons from hippocampus. Once we get enough number of mice, we would try the rescuing experiment of Calr+/- hippocampal neurons with ATF6β and ATF6α. However, we also think rescuing experiments of Atf6b-/- neurons by ATF6β, ATF6α, and CRT may be enough in this paper.

      Comment #4. When reporting the RNAseq data, the authors should use the q-value (i.e., FDR) instead of the p-value. This will likely affect the number of genes reported in Table 1, but it is the appropriate statistical test for this type of data.**

      Response. As you suggested, we replace Table1 with a new list which was filtered with the q-value. However, some important and consistent information were obtained from the list filtered with the p-value, we keep it as Table S1 in the supplementary information.

    2. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #3

      Evidence, reproducibility and clarity

      In this manuscript, the authors define the functional importance of ATF6b in the hippocampus. They show that ATF6b is highly expressed in the hippocampus relative to other tissues. They demonstrate that deletion or depletion of ATF6b in cultured hippocampal neurons enhances ER stress induced death. Similarly, Atf6b-/- mice show increased sensitivity to kainate induced neuronal death. These results reveal an important role for ATF6b in regulating hippocampal survival in response to pathologic insults. To define a molecular basis for this protection, the authors utilized RNAseq to identify the lectin chaperone calreticulin (Crt) as a gene whose expression is basally reduced in cultured hippocampal neurons where Atf6b is deleted. They show the re-overexpression of Atf6b (or Atf6a) both restore Crt levels in these neurons, underscoring the importance of Atf6 in regulating basal Crt levels. They go on to demonstrate that loss of Atf6b impairs ER stress-dependent increases in Crt, while minimally impacting other Atf6 target genes, again highlighting the importance of Atf6b for Crtregulation. Importantly, overexpression of Crt rescues the increased ER stress-induced toxicity observed in Atf6b knockout neurons, indicating that a primary mechanism by which Atf6b regulates neuronal survival in response to ER stress is through increased Crt expression. Consistent with this, mimicking the 50% reduction in Crt observed in Atf6b knockout neurons using Crt+/- mice showed similar sensitivity to kainate induced neuronal death. Collectively, these results describe an Atf6-Crt axis that is important for regulating neuronal survival in response to pathologic insults.

      Overall the experiments are interesting and provide new insights into the importance of Atf6b in neuronal survival. Notably, the evidence showing that loss of Atf6b increases hippocampal neuron sensitivity to ER stress and kainate induced toxicity are compelling. Any results describing the biological function of Atf6b are interesting, considering how little we know about this ER stress sensing protein. That being said, I have some concerns about the work described that require addressing before publication. Notably, I think more work needs to be done to define the molecular basis for the specific dependence of Crt expression on ATF6b in hippocampal neurons. Further, the authors need to do more experiments to demonstrate the specific importance of ATF6b signaling in the context of ER stress and in vivo neuronal death. I outline these various concerns below:

      Comment #1. The authors show that overexpression of either Atf6a or Atf6b both increase Crt expression in Atf6b knockout cells. While it is clear that deletion of Atf6a does not basally reduce Crt levels, the overexpression experiment does lead to a question as to how Atf6b can specifically be involved in regulating Crt expression. In the discussion, the authors seem to propose that homo- and hetero-dimerization of ATf6a and Atf6b are required for the basal expression of Crt and that Atf6b serves as a 'booster' of ER chaperone expression. They explicitly state that "Atf6a and Atf6b are required to induce CRT expression". However, it remains unclear to me why in this case would Atf6a deletion not impair Crt expression? The authors address this by invoking a mechanism whereby hippocampal neurons are more reliant on Atf6b for Crt expression, but this doesn't really make sense to me. Ultimately, this point underscores the lack of clear mechanistic basis to explain how Atf6b selectively regulates Crt in the hippocampus. This needs to be better resolved through more experimentation. For example, a ChIP experiment monitoring the binding of ATF6b and ATF6a to the Crt promoter in hippocampal and control cells would go a long way towards addressing this issue.

      Comment #2. The importance of ATF6b for protecting against insults needs to be better described. For example, the authors should show that overexpression of ATF6b protects against ER stress induced neuronal toxicity in cell culture and in vivo kainate induced neuronal toxicity. Similarly, the authors should evaluate how overexpression of ATF6a protects against these insults to better define the specific dependence of hippocampal neurons on ATF6b. The authors do show that overexpression of ATF6b can rescue the reduced Crt observed in Atf6b-deleted neurons, but the protection should similarly be demonstrated.

      Comment #3. Similar to #2, the authors should show that the potential for ATF6b (and ATF6a) overexpression to protect against different insults is impaired in Crt+/- neurons. The authors demonstrate that Crt-depletion increases sensitivity to toxic insults. This would go a long way to demonstrate the importance of the proposed ATF6b-CRT signaling axis in regulating neuronal survival in response to pathologic insults.

      Comment #4. When reporting the RNAseq data, the authors should use the q-value (i.e., FDR) instead of the p-value. This will likely affect the number of genes reported in Table 1, but it is the appropriate statistical test for this type of data.

      Significance

      This manuscript provides new context for understanding the functional relationship between Atf6a and the less-studied Atf6b in regulating neuronal survival. As with other studies focused on the relationship between these two ATF6 isoforms, this study demonstrates that these transcriptional programs integrate to coordinate a tissue-specific response to ER stress. Intriguingly, these studies indicate that ATF6b has a specific role in regulating the ER lectin chaperone CRT and that this ATF6b-CRT axis uniquely regulates neuronal survival in response to ER stress. While additional experiments are required to support this claim, the work described herein is a nice addition to our evolving understanding of the importance of ATF6b in regulating ER and cellular physiology during pathologic insults.

    3. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #1

      Evidence, reproducibility and clarity

      Summary

      Unfolded Protein Response (UPR) refers to homeostatic signaling pathways that play protective roles in various cell types. This work by Nguyen et al focuses on the UPR-mediator ATF6. In mammals, there are two isoforms of ATF6, alpha and beta. Nguyen et al show that the expression of the ATF6beta isoform is higher in hippocampal neurons whereas the ATF6alpha isoform is more evenly distributed across various neuronal subtypes. By performing gene expression profiling in mouse brain samples, they identify the ER chaperone calreticulin (CRT) as being significantly downregulated in ATF6beta null mutants. They further validate this observation by comparing hippocampi from ATF6alpha and ATF6beta null mice, where CRT is lowered in the latter but not the former. They identify and mutate putative ER stress response elements (ERSE) in the CRT promoter region to show that expression of CRT can be regulated by both ATF6alpha and beta. They demonstrate that treatment of hippocampal neurons with ER stress inducing chemicals leads to induction of CRT, which is suppressed in ATF6beta mutants. Such treatment also leads to cell death, which is exacerbated in ATF6beta mutants but rescued by ectopic expression of CRT. They also extend these observations to cell death induced by treatment with the glutamate receptor agonist, kainate, which was also exacerbated in ATF6beta mutants, but was rescued by counter treatment with ER stress inhibitors. Together, their data suggest a protective role for ATF6beta in hippocampal neurons in the context of ER stress.

      Major comments

      The primary advantage of this work is that much of it was done in vivo in mice, providing immediate context for the role of ATF6β under physiological conditions. They identify a specific region of the brain that requires ATF6beta. On the other hand, the ATF6-CRT signaling axis reported here had been established previously, and therefore, this study brings limited conceptual advances regarding the signaling mechanism itself (see Significance section below).

      Overall, the authors' data support their primary claim that ATF6β has a neuroprotective role in the context of ER stress. The data presented are clear and convincing, and their methods appear rigorous. The manuscript could be further improved if the authors could provide sufficient rationale for some of their experiments, which are discussed below.

      1. The post-translational processing of ATF6beta must be demonstrated in hippocampal neurons and not in HEK293T cells in Figure 1E. The authors conclude on Page 6, line 18 that "these results suggest that ATF6beta functions in neurons" but it is not obvious how expression in HEK293T cells contributes to this conclusion in any way.
      2. The hippocampal neurons are affected by the loss of ATF6β, even though the mice are not exposed to tunicamycin. Could the authors present evidence that there is physiological ER stress in hippocampal neurons? If not, why is ATF6beta required.
      3. In Figure 3, is there a specific reason why the authors do not mutate the ERSEs in the mouse CRT reporter, pCC1 and instead opt to analyze the huCRT reporter? Given that all the other observations in the manuscript are in mouse calreticulin, it is important to show that the ERSEs in the mouse calreticulin promoter are also regulated in an ATF6beta-dependent manner. Similar to the huCRT reporter, it is also crucial to examine if ATF6beta can regulate the mouse CRT promoter. This would provide an explanation for why calreticulin expression is not completely abolished in ATF6beta mutants.
      4. In Figure 5A and B, the density of Tubulin staining varies from panel to panel, and is much lower in ATF6beta mutants treated with Tg/Tm. Presumably this is because of cell death but this should be clarified in the main text. Additionally, it is unclear if the EthD-1 staining is nuclear localized. It would help if single channel images for Hoechst and EthD-1 were provided to visualize this.
      5. The literature reports that BAPTA-AM treatment itself could cause ER stress (e.g. PMID: 12531184). Here, the authors report the opposite effect. How could the authors reconcile the difference? The effects of BAPTA-AM and 2-APB must individually be examined in Figure 6C and not just in combination with Tm.
      6. The authors allude to "impairment of Ca2+ homeostasis in ATF6beta mutants" in Page 13 Line 2, but do not show any direct evidence in support of it. While treatment with BAPTA-AM and 2-APB is a start in that direction, it certainly does not demonstrate that under homeostatic conditions in vivo or in vitro there is any change in calcium flux in ATF6beta hippocampal neurons. To make the case that there is indeed perturbation of Ca2+ in ATF6beta mutant hippocampal neurons, the authors need to examine calcium flux and measure calcium indicators and how they are affected when ER stress is induced in these mutant cells.
      7. The effect of 2-APB and salubrinal alone on hippocampal neurons need to be examined in Figure 9B-D to eliminate the possibility that these drugs are not enhancing cell survival under normal conditions in a parallel manner.
      8. The rationale for the examination of Fos, Fosb and Bdnf is poorly described (page 14, line 13) and the conclusions from this line of experimentation are rather weak. The results from Figure 9 to some extent serve to confirm in vivo the data seen in Figure 6C but by no means provide a mechanism for why ATF6beta mutants have perturbed calcium homeostasis (page 14, line 22).

      Minor comments

      1. Page 8, line 3: Their rationale for why ATF6beta 5'UTR sequences are seen in their RNA seq data is not clearly explained. This must be rewritten for clarity.
      2. Page 8, line 5, the authors write that besides Atf6β , CRT was the only UPR-regulated gene downregulated in Atf6β mutant mice. The authors need to state how they defined "UPR-regulated genes". There must be a list, which the authors do not cite.
      3. Page 9, line 10: A reference is required for ERSEs.
      4. Page 10, line 6: The authors say "ATF6beta specifically induces CRT promoter activity". This is a confusing statement because "induction" is in response to stress, but the context here is homeostatic regulation since there is ostensibly no stress being induced. This distinction should be made and corrected here and throughout the manuscript.
      5. Page 10, line 16: The use of "latter" here is confusing and it would help to restructure this sentence for clarity.
      6. Figure 9A is missing Y-axis labels.

      Significance

      The authors summarize their major findings of the study (at the beginning of the Discussion) as ATF6β being required for CRT induction in the hippocampus, and that this ATF6β -CRT axis is important for the survival of hippocampal neurons. The idea that ATF6 induces CRT had been previously shown by others (PMID 9837962), and therefore, this is not the major new discovery of this study. In addition, the ATF6-calreticulin axis having a cell protective role had been reported in other biological contexts (e.g. PMID: 32905769), so that concept is also not a novel concept presented in this work. Similarly, the role of UPR in glutamate receptor agonist-induced neuronal cell death had been shown previously (the authors cite Kitao e tal., 2001; Sokka et al., 2007; Kezuka et al., 2016), so this link is not the major novel discovery revealed by this study. Instead, this study reports that ATF6β KO mice have specific phenotypes in hippocampal neurons, which had not been reported previously. Furthermore, this manuscript reports detailed information regarding Atf6β's downstream target genes in this tissue. In summary, this study's finding that ATF6 regulates CRT is confirmatory, rather than bringing new conceptual advances. The merit of this study is in the identification of the hippocampus as the organ that specifically requires ATF6beta. While the findings here may not appeal to a broader audience interested in UPR signaling mechanisms, it may draw interest from those who study hippocampal neuron physiology.

      For the editor's reference, this reviewer's field of expertise is in UPR signaling mechanisms in animal models

    4. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #2

      Evidence, reproducibility and clarity

      Nguyen and colleagues provide evidence that ATF6-beta selectively induces calreticulin expression in mouse hippocampal neurons to protect these neurons from ER stress-inducing toxins. This is a well-written and well-organized report that provides functional information about ATF6-beta, a poorly studied homolog of the ATF6-alpha Unfolded Protein Response regulator. The report suggests that ATF6-beta has a previously unknown and important function in helping brain neurons survive ER stress by regulating calreticulin.

      The study shows that addition of BAPTA, 2-APB, or salubrinal significantly improves neuronal survival in ATF6-/- explants and mice brains in response to ER toxins. But, prior study (PMID: 15705855) used salubrinal at much higher concentration 75uM with little effect at the 5uM dose used in the current study. Evidence should be provided that these drugs are specifically inhibiting ER stress or off-target mechanisms should be discussed in their experimental models.

      Minor comments:

      Fig 1 any male vs female mice differences in ATF6b expression?

      Fig 2C. Please show molecular weight markers on blots

      Fig 2C. what are the doublet bands on calnexin?

      Fig 3. what are the ERSE sequences? several different binding sites are reported in literature.

      p8. What is meant by 5' Atf6b lacks 10 and 11?

      Discussion: Please clarify if anti-ATF6-beta antibodies were available for these studies.

      Discussion: It is puzzling that ATF6a induces calreticulin more potently than ATF6b, but the calreticulin defect is selectively dependent on ATF6b. Could authors speculate on this paradox? It would be interesting to expand on differences between ATF6a and ATF6b function and phenotypes in Discussion in mouse and in people.

      Significance

      ATF6-beta is homolog of ATF6-alpha and assumed to function like ATF6-alpha. This report describes a selective function of ATF6-beta in inducing calreticulin in mouse neurons during ER stress. This suggests ATF6-beta has some different functions than ATF6-alpha in the mouse hippocampal neurons.

    1. Note: This rebuttal was posted by the corresponding author to Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Reply to the reviewers

      RESPONSE TO REVIEWERS

      We thank Review Commons and its three reviewers. Reviewers 2 and 3 provide detailed comments, which we address individually. Reviewer 1, however, gives a general critique of how we have approached asking how genome architecture affects the extent of evolution and the details of evolutionary trajectories. Our interpretation of their comments is that our approach and the one that they advocate represent two philosophically different, but complementary, views about how to study evolution in the laboratory. We begin by discussing this difference and then proceed to a point by point response to the three reviews.

      Reviewer 1

      Philosophical differences with Reviewer 1

      We interpret Reviewer 1’s comments as endorsing a formal, quantitative study of evolution that aims to explain the factors that control the rate at which fitness increases during experimental evolution. This approach derives from classical population genetics and aims to use a mixture of theory and experiment to uncover general principles that would allow rates of evolution and evolutionary trajectories, expressed as population fitness over time, to be predicted from quantitative parameters, such population sizes, mutation rates, distributions of the fitness effects of mutations (including their degree of dominance in diploids), and global descriptions of either general (e.g. diminishing returns) or allele-specific epistasis.

      This approach aims to predict how the average fitness trajectory should be affected by variations in these parameters and describe the variation, at the level of fitness, in the outcomes in a set of parallel experiments. This is an important approach and have previously used it to investigate how the strength of selection influences the advantage of mutators (Thompson, Desai, & Murray, 2006) and to produce and test theory that predicts how mutation rate and population size control the rate of evolution (Desai, Fisher, & Murray, 2007). Like every approach to evolution, this one has limitations: 1) if it doesn’t identify mutations or investigate phenotype other than fitness, it cannot reveal the biological and biochemical basis of adaptation or report on how variations in population genetic parameters (population size, haploids versus diploids, etc.) influence which genes acquire adaptive mutations, and 2) if the details of experiments (e.g. whether populations are clonal or contain standing variation, or which phenotypes are being selected for) have strong effects on the population genetic parameters, these must be measured before theoretical or empirical relationships could be used to predict the mean and variance of fitness trajectories produced by a given selection. A variety of evidence suggests that the second limitation is real. Examples include the absence of a universal finding that diploid populations evolve more slowly than haploids (discussed on Lines 437-442), even within the same experimental organism, and the finding that diminishing returns epistasis applies well to domesticated yeast evolving in a variety of laboratory environments (e. g. papers from the Desai lab, starting with (Kryazhimskiy, Rice, Jerison, & Desai, 2014) but not to the evolutionary repair experiments that we have conducted (Fumasoni & Murray, 2020; Hsieh, Makrantoni, Robertson, Marston, & Murray, 2020; Laan, Koschwanez, & Murray, 2015).

      The second approach to experimental evolution, which we, as molecular geneticists and cell biologists, predominantly take, is to follow the molecular and cell biological details of how organisms adapt to selective pressure. We subject organisms to defined selective forces, identify candidate causative mutations, test them by reconstructing the evolved mutations, individually and in combination, and perform additional experiments to ask how these mutations are increasing fitness. Because these experiments are performed on model organisms and often address phenotypes that have been studied by classical and molecular genetics, we can often say a good deal about the cell biological and biochemical mechanisms that increase fitness and this work can complement and extend what we know from classical and molecular genetics.

      The current manuscript and its predecessor are examples of finding causative mutations and asking how they improve fitness, with the first paper (Fumasoni & Murray, 2020) demonstrating how mutations in three functional modules could overcome most of the fitness cost of removing an important but non-essential protein and the current paper asking how alterations in genome architecture and dynamics (diploidy and eliminating double-strand break-dependent recombination) affect the extent to which populations increase in fitness and which genes and functional modules acquire mutations as they do so.

      By definition, such experiments are anecdotal: they report on how particular genotypes and genome architectures respond to particular selection pressures. Any individual set of experiments can produce conclusions about the effects of variables, such a population size, mutation rate, and genome architecture, on the mutations that increased fitness in response to the specific selection, but they can do more than lead to speculation and inference about what would happen in other experiments: speculation from the results of a single project and inferences from the combined results of multiple projects. Our interpretation is that the evolutionary repair experiments that we have performed, which have perturbed budding, DNA replication, and the linkage between sister chromatids do indeed lead to a common set of inferences: most of the selected mutations reduce or eliminate the function of genes, the interactions between the selected mutations are primarily additive, and the mutations cluster in a few functional modules.

      We believe that the population and molecular genetic approaches to experimental evolution are complementary and that a full understanding of evolution will require combining both of them. We think this will be especially true as we try to use the findings from laboratory studies to improve our understanding of evolution outside the lab, which takes place over longer periods, in more temporally and spatially variable environments, and is subject to variation in multiple population genetic and biological parameters.

      Reviewer #1 (Evidence, reproducibility and clarity (Required)): In their previous work the authors examined adaptation in response to replication stress in haploid yeast, via experimental evolution of batch cultures followed by sequencing. Here they extend this approach to include diploid and recombination-deficient strains to explore the role of genome architecture in evolution under replication stress. On the whole, a common set of functional modules are found to evolve under all genetic architectures. The authors discuss the molecular details of adaptation and use their findings to speculate on the determinants of adaptation rate.

      **SECTION A - Evidence, reproducibility and clarity** Experimental evolution can reveal adaptive pathways, but there are some challenges when applying this approach to compare genetic backgrounds or environments. They key challenge is that adaptation potentially depends on both the rate of mutation and the nature of selection. Distinct adaptation patterns between groups could therefore reflect differential mutation, selection, or both. The authors allude to this dichotomy but have very limited data to address it. The closest effort is engineering putatively-adaptive variants into all genetic background including those where they did not arise; the fact that such variants remain beneficial suggests they did not arise in certain backgrounds because of a lower mutation rate, but this is a difficult issue to tackle quantitatively.

      We agree, wholeheartedly, that adaptation depends on the combination of mutation rates and the nature of selection and our goal was to ask how the molecular nature of adaptation depends on genome architecture when three different architectures are subjected to the same selection: constitutive replication stress caused by removing an important component of replisome. We used a haploid strain as a baseline and compared it to two other strains chosen to influence either the effect of mutations (a diploid, where fully recessive mutations that were beneficial in the haploid would become neutral) or the rate of mutations (a recombination-defective strain that would be unable to use ectopic recombination to amplify segments of the genome). In both cases, we expected to see effects that are closer to qualitative than quantitative: the absence of fully recessive mutations in evolved diploids and absence of segmental amplification in the recombination-deficient haploid. We see both effects and they then allow us to ask two other questions: 1) does influencing the effect of a class of mutation (diploids) or preventing a class of mutation (recombination defect) have a major effect on the rate of evolution, and 2) do these differences affect which modules adaptive mutations occur in. As far as we can tell, the answer is no to both questions. We use “as far as we can tell” because our experiments do have limitations. First, the recombination-defective strain has a higher point mutation rate making it impossible to tell how much this elevation, rather than any other factor, accounts for it showing a greater fitness increase than the recombination-proficient haploid. Unfortunately, to our knowledge, it’s impossible to abolish recombination without affecting mutation rates. Second, we only experimentally tested a subset of the inferred causative mutations meaning that for many genes, our assertion that they are adaptive is a statistical inference and their assignment to a particular functional module is based on prior literature rather than our own experiments. In response to this criticism, we have now rephrased some of our sentences (see below).

      From mutation accumulation experiments, where the influence of selection is minimized, there is evidence that genetic architecture affects the rate and spectrum of spontaneous mutations. In this experiment, the allele used to eliminate recombination, rad52, will also increase the mutation rate generally. The diploid strain is also likely to have a distinct mutational profile--as a null expectation diploids should have twice the mutation rate of haploids. Recent evidence indicates the mutation rate difference between haploid and diploid yeast might be less than two-fold, but that there are additional differences in the mutation spectrum, including rates of structural change. The context for this study is therefore three genetic architectures likely to differ in multiple dimensions of their mutation profiles, but mutation rates are not measured directly.

      The reviewer is correct that we did not explicitly measure mutation rates, although the frequency of synonymous mutations (Figure 3-S1B) is a proxy for the point mutation rate as long as the majority of these mutations are assumed to be neutral. By this measure, the mutation rates for ctf4∆ haploids and ct4∆/ctf4∆ diploids, expressed per haploid genome, are close to each other (1.94 for haploids and 1.37 for diploids) but different enough to return p = 0.044 by Welch’s test, whereas the mutation rate for the recombination-deficient, ctf4∆ rad52∆ haploid is 4 to 5-fold higher (7.03). In contrast, we can infer that the ctf4∆ rad52∆ strain has much lower rates of segmental aneuploidy produced by recombination: we see only one such event in this strain in contrast to 16 in the ctf4∆ haploid and 44 in the ctf4∆/ctf4∆ diploid (Supplementary table 4), even though the amplification of the cohesin loader gene, SCC2, confers similar benefits in all three strains.

      The nature of selection on haploids and diploids is expected to differ because of dominance, but ploidy-specific selection is also possible. The authors discuss how recessive beneficial alleles may be less available to diploids, though this can be offset by relatively rapid loss of heterozygosity. However, diploids should also incur more mutations, all else being equal. The rate of beneficial mutation, as opposed to the rate of mutation generally, will depend on the mutational "target size" of fitness, and the authors findings recapitulate other literature (particularly regarding "compensatory" adaptation) that points to faster adaptation in genotypes with lower starting fitness.

      We agree with the reviewer and tried to make the point that which mutations are fixed is primarily determined by the product of the rate at which they occur and the benefit which they confer (lines 193-196). Evidence in budding yeast suggests that in diploid cells, removing one copy of most genes fails to produce a measurable fitness benefit (Deutschbauer et al., 2005), suggesting that losing one copy of many genesis purely recessive. If this was always the case, it would be very hard for such heterozygous, loss-of-function mutations to contribute to evolution in diploids: a mutation that inactivates one copy of a gene would have to rise to high enough frequency by genetic drift that homozygosis of this mutation mitotic recombination would have a significant probability. Instead we find that heterozygous mutations in some genes (inactivation of RAD9, what are likely to be hypomorphic mutations in SLD5) but not others (inactivation of IXR1) confer benefits in diploids that allow their frequency to rise much more rapidly by selection than they would by drift, allowing them to reach frequencies at which mitotic recombination becomes probable.

      There is ample literature on the above topics, particularly discussions of the evolutionary advantages of haploidy versus diploidy. While adaptation to replication stress provides a novel starting point for this investigation, much of the manuscript is devoted to long-standing questions that are not specific to replication stress. Unfortunately, the data the authors collected is not sufficient to shed light on these questions, because mutation and selection cannot be effectively distinguished. The Discussion states that "We find that the genes that acquire adaptive mutations, the frequency at which they are mutated, and the frequency at which these mutations are selected all differ between architectures but that mutations that confer strong benefits always lie in the same three modules" (line 379), but it is not clear that these statements are all supported by the data.

      The reviewer makes two points: we fail to make a significant contribution to long-standing questions about the evolutionary genetics of adaptation and the we make statements that are not supported by our data. On the first we disagree: unlike much of the previous work which compares the effects of mutation rates and population sizes on the rates of evolution, we sequence genomes, identify putative causative mutations, verify that they increase fitness, and test, by reconstruction, how their contribution to fitness is affected by fully characterized genome architectures. We know of no comparable work and we believe that this is a useful contribution to understanding evolution. In addition, some of the literature, for example the discussion of haploidy versus diploidy, has failed to reach a universal conclusion. On the second point, we realized that the statement that the reviewer quotes is stronger than it should be since we do not show “that mutations that confer strong benefits always lie in the same three modules”. What we do show is that mutations in all three modules are found in all three genome architectures (Figure 5), and that combining one mutation from each module (using mutations in genes that are found in that architecture) can reproduce the observed fitness increase in each architecture (Figure 6 B), but the reviewer is correct that we have not demonstrated that every clone from every population has an adaptive mutation in all three modules. We have therefore modified the quoted sentence as follows (altered wording underlined)

      "We find that the genes that acquire adaptive mutations, the frequency at which they are mutated, and the frequency at which these mutations are selected all differ between architectures but that mutations conferring strong benefits can occur in all three modules in each architecture" (Lines 405-408)

      Focusing on the more novel aspect of their experiment-the presence of replication stress-would arguably be a better approach. On this topic the authors have some interesting observations and speculation, but clear predictions are lacking. The introduction section could be redesigned to explicitly state why genome architecture might affect adaptation in response to replication stress in particular, rather than (or in addition to) adaptation generally. If there were no differences in mutation, does the nature of Ctf4 lead to predictions that the molecular basis of compensatory adaptation should differ among genome architectures? Without such predictions it will be difficult for readers to know whether the observation that different genome architectures follow similar adaptive paths is surprising or not.

      We believe that following this suggestion would diminish the paper. We set out to ask how genome architecture affected adaptation to the strong fitness defect produced by removing an important component of an essential process, DNA replication. We chose replication stress as an example of cell biological damage that cells would have to repair with the hope that the results would give general clues about evolutionary repair, rather than hoping that the experiment would inform us about how replication stress altered the types of mutation (e. g. point mutations versus segmental amplification) that were selected As we point out at the beginning of our response, we recognize that the result of any one such experiment must be anecdotal and any attempt to generalize must be described as speculation if it refers only to this one experiment, or inference if it refers to this experiment and other published work. In those cases where we discuss the effect of genome architecture on evolutionary trajectories, we can draw conclusions that apply to our own experiments, but can only speculate on adaptation to different selections. In others, where we see commonalities between our experiments and previous work on evolutionary repair (cite Review), we can make inferences about evolution to adapt to removing important proteins and speculate about other forms of selection. We have revised the discussion to make it clear where we conclude, where we speculate, and where we infer. We suspect that our finding that genome architecture has a larger effect on which genes acquire adaptive mutations than it does on which modules these mutations alter will generalize to other evolutionary repair experiments and may be true even more broadly.

      We deliberately did not make predictions about the effect of genome architecture on the rate at which population fitness increased or the mechanism of adaptation to replication stress because we believed that our ignorance and the diverging results of previous experiments was sufficient to make both exercises worthless. After the fact, we interpret our results to suggest that mutations that reduce the activity of components, such as Sld5, that are stably associated with replication forks should be semi-dominant, but we were not nearly smart enough to make such a specific prediction before the experiment began!

      **Minor comments:** Shifts in ploidy from diploid to haploid are less common than the reverse change, so the observation of such a shift (Fig. 1) should be discussed in more detail.

      We now mention that haploids becoming diploids is more common than the reverse transformation and point out that genome sequencing reveals that these strains are true haploids rather than aneuploids.

      “One diploid population (EVO14) gave rise to a population with a haploid genome content, suggesting a possible haploidization event during evolution. Sequencing revealed no aneuploidies as a potential explanation of this phenomenon. While diploidization has been recurrently observed during experimental evolution with budding yeast (Aleeza C. Gerstein & Otto, 2011; Aleeza C Gerstein, Chun, Grant, & Otto, 2006; Harari, Ram, Rappoport, Hadany, & Kupiec, 2018; Venkataram et al., 2016), reports of spontaneous haploidization events have been instead scarce. Given the difficulties introduced by the change of ploidy over the 1000 generations, we have excluded EVO14 from all our analyses.” (Lines 122-128)

      We believe that the most likely mechanism is that the strain sporulated to produce haploids that were fitter than their diploid parent, but because this event occurred in only one out of eight populations and the proposed explanation is pure speculation we have not included in the revised manuscript.

      Line 88 typo 'stains'.

      Fixed. Thank you.

      Reviewer #1 (Significance (Required)): **SECTION B - Significance** The novel aspect of this study is the combination of replication stress and genome architecture, but here the significance is limited by a lack of clear predictions on how these factors might interact. On the other hand, much of the manuscript is devoted to why adaptation might vary among genome architectures in general, but this long-standing and important question is not particularly well resolved by this experimental approach, which can't disentangle mutation and selection.

      Our belief is that quantitatively predicting how selection will change fitness is nearly impossible because we lack the detailed knowledge of population genetic parameters that apply to our experiments. Prediction is even harder if the goal is to identify which genes will fix adaptive mutations and understand how these mutations alter cellular phenotypes to increase fitness. Thus our approach is almost entirely empirical: we do experiments that alter interesting variables, collect data, and do our best to interpret them and suggest how the conclusions of individual experiments might generalize.

      The authors highlight the dichotomy when discussing the evolution of ploidy: "We suggest that... genome architecture affects two aspects of the mutations that produce adaptation: the frequency at which they occur and the selective advantage they confer" (line 399), but presenting this as a novel inference does not appropriately acknowledge prior research and discussion of these ideas; several relevant papers are cited by the authors in other contexts. It may be possible to recast these findings as a test of the role of genome architecture in adaptation generally, but the authors should clarify the limitations of experimental evolution and more fully consider the theory and data outlined in previous research. In particular, few studies can claim to directly compare mutation rates between genome architectures, and it is not obvious that the present study is an example of such.

      We have the disadvantage that the reviewer doesn’t identify the literature we fail to cite. To us the argument the reviewer quotes is self-evident. As we mention above, our goal was not to test either general or detailed predictions and the level at which we analyzed our experiment, especially demonstrating that mutations were causal and reconstructing them individually and in combination, is missing from previous work. Finally measuring mutation rates is supremely difficult: you either need good ways of following all possible forms of mutation, quantitatively and without selection, or you resort to selecting mutations with a particular phenotype and molecularly characterizing them, knowing that these assays may well give different ratios of the rates of different types of mutation at different loci. We do make and report one measure of mutation rate, the rate of synonymous mutation in protein coding genes, which we discuss above.

      Reviewer expertise: Evoutionary genetics; experimental evolution; mutation.

      Reviewer #2 (Evidence, reproducibility and clarity (Required)): **Summary** This manuscript investigates the effect of an organism's genotype (or, as the authors call it, an organism's 'genome architecture') on evolutionary trajectories. For this, the authors use Saccharomyces cerevisiae strains that experience some form of replication stress due to specific gene deletions, and that further differ in ploidy and/or the type of gene(s) deleted. They find the same three functional modules (DNA replication, DNA damage checkpoint, sister chromatid cohesion) are affected across the 3 different genotypes tested; although the specific genes that are mutated varies. **Major comments** This is a solid and exceptionally eloquent paper, comprising a large body of work that is in general well presented. That said, I do have some suggestions and questions. At several points in the manuscript, the authors should perhaps be more careful in their wording and avoid to overgeneralize data without providing additional evidence for these claims.

      We thank the reviewer for their constructive review and address their request for more careful wording below.

      • Some key points of the study are not entirely clear to me; possibly because the study builds upon a previous study that was recently published in eLife. Anyhow, I think it would be useful to clarify the following points a bit more:

        • Why exactly was ctf4∆ chosen as a model for replication stress? What is the evidence that ctf4∆ is a good model for replication stress? Without including some evidence for this, it is unclear how well the findings in this study really can be generalized to replication stress (which is what the authors do now).

      We described the reasons for choosing CTF4 deletion to mimic DNA replication stress in our previous eLife paper, to which we refer at. Nevertheless, the reviewer is right in asking us not to assume that the reader will have read our previous work. Briefly: DNA replication stress is a term that is loosely defined as the combination of the defects in DNA metabolism and the cellular response to these defects in cells whose replication has been substantially perturbed (Macheret & Halazonetis, 2015). Established methods in the field to induce DNA replication stress consist of either pharmacological treatments or genetic perturbation. Pharmacological treatments include hydroxyurea, which target the ribonucleotide reductase and hence stalls forks as a result of dNTP depletion (Crabbé et al., 2010), or aphidicolin, which directly inhibits polymerases α, ε and δ (Vesela, Chroma, Turi, & Mistrik, 2017b; Wilhelm et al., 2019). For genetic perturbation, the conditional depletion of replicative polymerases (Zheng, Zhang, Wu, Mieczkowski, & Petes, 2016) is frequently used. These methods are incompatible with experimental evolution, as cells can mutate the targets of replication inhibitors or alter the expression of genes that have been reduced in expression or activity. Removing an important but non-essential component of the replication machinery avoids these problems. We chose CTF4 deletion as a manipulation that affected the coordination of events at the replication fork: in the absence of Ctf4, the polα-primase complex is no longer physically bound to the replicative helicase, and thus the polymerase’s abundance at the replisome decreases (Tanaka et al., 2009). This manipulation achieves the same effects as polymerase depletion and replisome stalling, producing a constitutive DNA replication stress that can only be overcome by mutations in other genes. Multiple studies have shown that ctf4**D cells display replication intermediates commonly associated to DNA replication stress, such as the accumulation of ssDNA gaps and reversed forks (Abe et al., 2018; Fumasoni, Zwicky, Vanoli, Lopes, & Branzei, 2015), fork stalling (Fumasoni & Murray, 2020), checkpoint activation (Poli et al., 2012; Tanaka et al., 2009) and altered chromosome metabolism (Kouprina et al., 1992).

      We now justify our choice of deleting CTF4 at line 74:

      “DNA replication stress is often induced with drugs or by reducing the level of DNA polymerases (Crabbé et al., 2010; Vesela, Chroma, Turi, & Mistrik, 2017a; Wilhelm et al., 2019; Zheng et al., 2016). To avoid evolving drug resistance or increased polymerase expression, which would rapidly overcome DNA replication stress,** we deleted the CTF4 gene, which encodes a non-essential subunit of the DNA replication machinery (the replisome) (Kouprina NYu, Pashina, Nikolaishwili, Tsouladze, & Larionov, 1988). Ctf4 is a homo-trimer that functions as a structural hub within the replisome (Villa et al., 2016; Yuan et al., 2019) by binding to the replicative DNA helicase, primase (the enzyme that makes the RNA primers that initiate DNA replication), and other accessory factors (Gambus et al., 2009; Samora et al., 2016; Simon et al., 2014; Villa et al., 2016). In the absence of Ctf4, the Pol**a-primase and other lagging strand processing factors are poorly recruited to the replisome (Samora et al., 2016; Tanaka et al., 2009; Villa et al., 2016), causing several characteristic features of DNA replication stress, such as accumulation of single strand DNA (ssDNA) gaps (Abe et al., 2018; Fumasoni et al., 2015), reversed and stalled forks (Fumasoni & Murray, 2020; Fumasoni et al., 2015), cell cycle checkpoint activation (Poli et al., 2012; Tanaka et al., 2009) and altered chromosome metabolism (Hanna, Kroll, Lundblad, & Spencer, 2001; Kouprina et al., 1992). As a consequence of these defects, ctf4**D cells have substantially reduced reproductive fitness (Fumasoni & Murray, 2020).**”

      Would the authors expect to see similar routes of adaptation if a 'genomic architecture' with a less severe/other replication defect would have been used? I realize the last question is perhaps difficult to address without actually doing the experiment (which I am not suggesting the authors should do); I just want to point out that perhaps some data should not be over-generalized.

      We share the reviewer’s interest in asking whether different forms of DNA replication stress would lead to the same results described, and we plan to rigorously investigate this question in a separate paper. We note that the careful comparison between different forms of DNA replication stress has never been made and that authors studying this phenomenon often rely on a single perturbation to induce DNA replication stress (Crabbé et al., 2010; Wilhelm et al., 2019; Zheng et al., 2016). We agree that such a comparison will be useful, but we believe (as indicated by the reviewer) it will require an amount of work that goes beyond the scope of our study. To avoid over-generalization, we are using now using “a form of DNA replication stress” in lines 33, 244, 401, 414 and 461, to make it clear that our conclusions (as opposed to inferences and speculations) are restricted to the response to a single example of replication stress.

      Likewise, why was RAD52 selected as the gene to delete to affect homologous recombination? I understand that it is a key gene, but on the flipside, absence of RAD52 affects multiple cellular pathways and (as the authors also observe in their populations) also results in increased mutation rates which might confound some of the results.

      We aimed to observe the largest deficiency in DNA recombination possible and therefore chose to delete RAD52 because of its many roles in different forms of homologous recombination (Pâques & Haber, 1999) . The choice of other genes, such as RAD51, would have inhibited canonical double strand break (DSB) repair, but allowed other mechanisms that can rescue stalled replication forks (Ait Saada, Lambert, & Carr, 2018), such as break induced replication (BIR) or single strand annealing (SSA) (Ira & Haber, 2002).

      Our position regarding the inevitable increase in mutations rates obtained while working with genome maintenance process has been instead elaborated in response to reviewer #1 above.

      A sentence describing our choice to delete RAD52 has now been included at line 86:

      “…as well as from haploids impaired in homologous recombination due to the deletion of RAD52 (Figure 1A), which encodes a conserved enzyme required for pairing homologous DNA sequences during recombination (Pâques & Haber, 1999). Because Rad52 is involved in different forms of homologous recombination, it’s absence produces the most severe recombination defects and thus allows us to achieve the largest recombination defect achievable with a single gene deletion (Symington, 2002)..”

      Related to the first comment, it is also unclear to me how well the system chosen by the authors is representative of the replication stress experienced by tumor cells (as briefly touched upon in the final section of the discussion). Are some of the homologs key oncogenes that drive carcinogenesis?

      We should have been clearer. Our goal was to argue that the lesions and responses produced by replication stress in tumor cells, such as stalled replication forks and checkpoint activation, were similar to those seen in yeast cells lacking Ctf4. We did not mean to imply removing Ctf4 from yeast cells had the same effects on cell proliferation and survival as inactivating tumor suppressors and activating proto-oncogenes have in mammalian cells. Despite the difference between direct (removing Ctf4) and indirect effects on DNA replication (tumor cells), the replication intermediates (ssDNA, stalled and reversed forks), the cell cycle defects (G2/M delay), the genetic instability (increased mutagenesis and chromosome loss) and chromosome dynamics (late replication zones and chromosome bridges) generated by the absence of Ctf4 are similar to those observed in oncogene-induced DNA replication stress in mammalian cells (Kotsantis, Petermann, & Boulton, 2018). We therefore believe our experiments reveal evolutionary responses to a constitutive DNA replication stress that resembles the replication stress seen in cancer cells. Nevertheless, we agree that the comparison with cancer evolution remains speculative and we therefore avoided mentioning cancer in the title our paper or our conclusions, and only discuss it in a speculative section of the discussion.

      We have modified this section of the discussion as follows (line 554):

      “While generated through a different mechanism (unrestrained proliferation, rather than replisome perturbation), oncogene induced DNA replication stress produces cellular consequences (Kotsantis et al., 2018) which are remarkably similar to those seen in the absence of Ctf4, such as the accumulation of ssDNA, stalled and reversed forks (Abe et al., 2018; Fumasoni & Murray, 2020; Fumasoni et al., 2015), genetic instability (Fumasoni et al., 2015; Hanna et al., 2001; Kouprina et al., 1992) and DNA damage response activation (Poli et al., 2012; Tanaka et al., 2009). Based on these similarities we speculate that evolutionary adaptation to DNA replication stress could reduce its negative effects on cellular fitness and thus assist tumor evolution.”

      The authors should consider rephrasing some sentences regarding the occurrence of adaptive mutations. Sentences such as 'which genes are mutated depends on the selective advantage' (p1; lines 15-16); 'genome architecture controls the frequency at which mutations occur' (p15), "genome architecture controls which genes are mutated" (p1, line 20) makes it sound like the initial occurrence of mutations is not random, whereas in reality, the mutational landscape is the result of the combined effect of occurrence and fitness effect of the mutations, with the later rather than the former likely being the main driver behind the observed patterns.

      We thank the reviewer for asking for more precision in the above sentences, whose proposed changes we now list:

      “Mutations in individual genes are selected at different frequencies in different architectures, but the benefits these mutations confer are similar in all three architectures, and combinations of these mutations reproduce the fitness gains of evolved populations.” (Lines 13-15)

      “Genome architecture influences the distribution of adaptive mutants” (Line 277)

      "genome architecture influences the frequency at which mutations occur, the fitness benefit they confer, and the extent of overall adaptation." (Lines 462-463)

      Some important methodological information is missing or unclear in the manuscript:

      The authors should provide more details on how they decided which clones to select for sequencing. Did they select the biggest colonies; were colonies picked randomly, ...

      This following sentence is now reported in the materials and methods section (Line 603)

      “To capture the within-population genetic variability we selected the clones displaying the largest divergence of phenotypes in terms of resistance to genotoxic agents (methyl-methanesulfonate, hydroxyurea and camptothecin).”

      What is the population size during the evolution experiment?

      We now added the following sentence at line 599:

      “In this regime, the effective population size is calculated as N0 x g where N0 is the size of the population bottleneck at transfer and g is the number of generations achieved during a batch growth cycle and corresponds to approximately to 107 cells.”

      Sequencing of populations and clones: coverage should be mentioned

      The following sentence has now been added at line 616:

      “Clones and populations were sequenced at approximately the following depths: 25-30X for haploid clones, 50-60X for diploid clones, 50-60X for haploid populations and 120-130X for diploid populations.”

      Identification of mutations (p19, line 573): Is this really how the authors defined whether a variant is a mutation? Based on the definition given here, DNA mutations that lead to a synonymous mutation in the protein are not considered as mutations?

      We apologize for this typo. We do identify and consider synonymous mutations as evidenced by Figure 3-S1B. Now the sentence at line 626 correctly reports:

      “A variant that occurs between the ancestor and an evolved strain is labeled as a mutation if it either (1) causes a substitution in a coding sequence or (2) occurs in a regulatory region, defined as the 500 bp upstream and downstream of the coding sequence.”

      Perhaps the information can be found elsewhere, but the source data excel files for mutations is incomplete and should at the very least contain information on the type of mutation (eg. T->A), as well as the location of this mutation in the respective gene.

      Perhaps the reviewer is referring to Supplementary table 2, where we list the number of times a gene has been mutated in different populations (and thus summaries different types of mutations affecting the same gene). The information they request is reported in Supplementary table 1 for all the variants detected in populations and clones sequencing.

      **Minor comments** • While the author already cite several significant papers relevant for their manuscript, some other studies could also be included:

      We thank the reviewer for highlighting these references, which are now cited at line 28

      From the text in the abstract, it is unclear what the three genomic architectures (line 13) exactly are, the authors should consider spelling this out.

      In repose o the reviewer request for clarity we now propose the following change in line 13:

      “We asked how these trajectories depend on a population’s genome architecture by comparing the adaptation of haploids to that diploids and recombination deficient haploids.” (Lines 9-11)

      Can the authors speculate on why a homozygous ctf4D/ctf4D rad52D/rad52D would be lethal, and a haploid not?

      See below

      The authors note that a diploid ctf4D/ctf4D strain is less fit than its haploid counterpart. Why do the authors think this is the case?

      In response to the two previous questions, we now propose the following speculations that we include in the text (Line 97):

      “Diploid cells require twice as many forks as haploids and Ctf4-deficient diploids are thus more likely to have forks that cause severe cell-cycle delays or cell lethality. We speculate that this increased probability explains the more prominent fitness defect displayed by diploid cells. Interestingly, homologs of Ctf4 are absent in prokaryotes, where the primase is physically linked to the replicative helicase (Lu, Ratnakar, Mohanty, & Bastia, 1996) and Ctf4 is essential in the cells of eukaryotes with larger genomes such as chickens (Abe et al., 2018) and humans (Yoshizawa-Sugata & Masai, 2009). Rad52 is likely involved in rescuing stalled replication forks by recombination-dependent mechanisms (Fumasoni et al., 2015; Yeeles, Poli, Marians, & Pasero, 2013). We speculate that the absence of Rad52 increases the duration of these stalls and leads some of them to become double-stranded breaks resulting in cell lethality and explaining the decreased fitness of ctf4D rad52D haploid double mutants. In diploids ctf4D rad52D cells, which have twice as many chromosomes, the number of irreparably stalled fork may be sufficient to kill most of the cells in a population, thus explaining the unviability of the strain.”

      The authors passage their cells for 100 cycles and assume that this corresponds to around 1000 generations for each population. However, the fitness differences between the different starting strains (see also Figure 1B) are likely to cause considerable differences in number of generations between the different strains. Do the authors have more precise measurements of number of generations per population? If not, perhaps it should be noted that some lineages may have undergone more doublings than others, and perhaps also discuss if and how this could influence the results?

      In a batch culture regime, where populations are allowed to reach saturation after each dilution, the number of generations at each passage are dictated by the dilution factor (Van den Bergh, Swings, Fauvart, & Michiels, 2018). A dilution of 1:1000 from a saturated culture will allow for approximately 10 generations before populations reach a new saturated phase. As long as saturation is allowed to occur, this number is independent of the fitness of the cultured strains: Slower-dividing strains will simply employ more time to reach saturation after each dilution. At the beginning of the experiment, we had to dilute the ctf4D rad52**D strains being passaged every 48hrs instead of 24hrs. After generation 50, ctf4D rad52**D strains reached saturation within 24hrs and were then diluted daily. The total count considers the number of passages a culture has undergone, and not the number of days of culture, and thus should guarantee approximately the same number of generations in all three genome architectures.

      Panel A of figure 1A is somewhat confusing; as this seems to indicate that the ctf4∆ was introduced after strains were made, for example, haploid recombination deficient (which is not how these strains were constructed). Perhaps a better way of representing would be to have the indication of DNA replication stress pictured inside the yeast cells.

      We have modified Figure 1A to better represent the way the strains were constructed. For space reasons we have not represented a perturbed fork within each cell, but rather above all of them.

      Legend to Figure 1: is fitness expressed relative to haploid or diploid WT cells for the diploid strains?

      We apologize for having missed this detail in the figure legends. Throughout the figures, haploid and diploid cells were competed against reference strains with the same ploidy. We now add this sentence in Figure 1 and in the materials and methods (line 686).

      Figure 3: to improve readability of this figure, the authors could consider placing the legend of the different symbols (#, *,..) in the figure as well and not just in the figure legend.

      We now include the symbols legend in Figure 3.

      Figure 5 shows Indels, but if I am correct, these mutations are not discussed in the text; nor is it mentioned what the authors used as a cut-off to determine indels (the authors use the term 'small indels' without defining it)? For example, the data shown in Figure 3 and Figure 4 only includes SNPs and not indels (correct?) - but the indels should also be taken into account when investigating which modules are hit.

      Gapped alignments of the relatively long 150 paired-end reads in our data set permits the identification of small indels ranging in size from 1–55 bp using VarScan pileup2indels tool (Koboldt et al., 2012). All small indels (and the respective sequence affected) are listed together with SNPs in Supplementary table 1. Figure 3A, Figure 4 and Figure 5B are representation of ‘gene mutations’ which include both SNPs and small InDels. Large chromosomal Insertion and deletions, not detectable by short read gap alignment are instead identified using the VarScan pileup2copynumber tool (Koboldt et al., 2012), and are represented as amplifications or deletions in Figure 3B and 5C.

      The following sentence has been added to the material and methods at line 629:

      “Gapped alignments of the 150 paired-end reads in our data set permits the identification of small indels ranging in size from 1–55 bp using VarScan pileup2indels tool (Koboldt et al., 2012). All small indels (and the respective sequence affected) are listed together with SNPs in Supplementary table 1.”

      The following definition has been added in Figure legends 3A, 4 and 5A and B.

      “Gene mutations (SNPs and small InDels 1-55bp)”

      Figure 5 mentions: # gene mutations. So these are only the mutations in genes, and not in their up- or downstream regulatory regions?

      We use a broader definition of a gene, not restricted to the open reading frame, and including its regulatory regions. The following definition has been added to figure 5’s legend.

      “Frequency of SNPs and small InDels (1-55bp) affecting genes (Open reading frames and associated regulatory regions).”

      Figure 3-S1: labels of C panels are missing.

      Labels are now included in Figure 3-S1

      Figure 3-S1, panel B: why did the authors focus on synonymous mutations?

      The panel B is commented upon in line 186 and contrasted with panel A to argue that the increased number of mutations detected in ctf4∆ rad52∆ strains is due to a higher mutation rate(which is expected to increase synonymous mutations) instead of an higher number of adaptive mutations (which are less likely to be synonymous) being selected.

      Reviewer #2 (Significance (Required)): This is a solid and clearly written study, comprising a large body of work that is generally well presented and that will be of interest to scientists active in the field of (experimental) evolution and replication. However, many aspects studied in this manuscript have already been studied and reported before; including the recent eLife paper by the same group, as well as studies by other labs that have investigated how genome architecture / genotype affects evolutionary trajectories, the effect of ploidy on evolution, .... Because of this, I do feel that the authors should put their findings more in the context of existing literature context, including a general description of which results are truly novel, which confirm previous findings and which results seem to go against previous reports. This is already so at some points in the text, but I feel this could be done even more.

      We now rephrase the following paragraphs in our discussion to better highlight the main conclusions in contrast to the existing literature:

      “Engineering one mutation in each module into an ancestral strain lacking Ctf4 is enough to produce the evolved fitness increase in all three genomic architectures. Furthermore, engineering mutations in individual genes confer benefits in all three architectures (Fig. 6A) ,even in those where the mutations in these genes was rare, and combining these mutations recapitulated the evolved fitness increase in all three architectures (Fig. 6B). Altogether our results demonstrate the existence of a common pathway for yeast cells to adapt to a form of constitutive DNA replication stress.” (Lines 409-414)

      “Our results thus go against the trend of slower adaptation in diploids as compared to haploids reported by the majority other studies (A. C. Gerstein, Cleathero, Mandegar, & Otto, 2011; Marad, Buskirk, & Lang, 2018; Zeyl, Vanderford, & Carter, 2003). This effect is not limited to populations experiencing DNA replication stress (Figure 2A) but is also present in control wild-type populations (Figure 2B). Our results support the idea that the details of genotypes, selections, and experimental protocols can determine the effect of ploidy on adaptation.” (Lines 437-442)

      “Our results therefore agree with previous reports observing declining adaptability across strains with different initial fitness but largely fail to observe diminishing return epistasis as a potential justification of this phenomenon. Our experiments and two previous evolutionary repair experiments (Hsieh et al., 2020; Laan et al., 2015) both show interactions that are approximately additive between different selected mutations. The reasons for this difference are currently unknown.” (Lines 450-455)

      Additionally, I think the authors should be more careful not to over-generalize their findings, which come from only a few specific genetic manipulations that might not be representative for general replication stress. For example (p15), can the authors really claim that they have unraveled general principles of adaptation to constitutive DNA replication stress? Perhaps a better motivation of the choice of ctf4 as a model mutation for DNA replication stress could also help (see also my earlier comments). A similar comment applies to the molecular mechanisms affecting adaptation in diploid cells - what evidence do the authors have that their findings are not specific to the one specific type of diploid strain they used in their study? Adding a bit more background information or nuance for some of the claims would help tackle this issue.

      We now followed the suggestions made previously by the reviewer to justify our experimental choices better and to use a language that avoids over-generalizations.

      Field of expertise of this reviewer: genetics, evolution, genomics

      Reviewer #3 (Evidence, reproducibility and clarity (Required)): **Summary:** Here the authors carry out an evolution experiment, propagating replicate populations of the budding yeast with the CTF 4 gene deleted in three different genetic backgrounds: haploid , diploid and recombination deficient (RAD52 deletion). The authors find that the rate of evolution depends on the initial fitness of the different genetic backgrounds which is consistent with a repeated finding of evolution experiments: that beneficial mutations tend to have a smaller fitness effect in high fitness genetic backgrounds. Curiously even though the targets of selection tended to be specific to each of the three different genetic backgrounds, genetic reconstruction experiments showed beneficial mutations convert a fitness increase in all genetics backgrounds. The authors go on to provide a plausible explanation for why each of the three genetic backgrounds are predisposed to certain types of beneficial mutations. Overall, these results provide important context and caveats for an emerging consensus that genetic background determines the rate of evolution, a comprehensive molecular breakdown of adaptation to DNA replication stress and a mechanistic explanation for why different beneficial mutations are favoured in diploids, haploids and recombination deficient strains. This is a well-executed study that is beautifully presented and easy to follow. This will be of great interest to those in the experimental evolution community and the data an excellent resource.

      We thank reviewer #3 for emphasizing that reconstructed mutations are beneficial even in architectures where they were not ultimately detected at the end of the experiment. We have now highlighted this point in our conclusions as a response to the reviewer’s #1 and #2 request for more clarity regarding our novel findings.

      “We find that the genes that acquire adaptive mutations, the frequency at which they are mutated, and the frequency at which these mutations are selected all differ between architectures but that mutations that confer strong benefits can occur in all three modules in each architecture. Engineering one mutation in each module into an ancestral strain lacking Ctf4 is enough to produce the evolved fitness increase in all three genomic architectures. Furthermore, reconstruction of a panel of mutations into all three architectures proved they are adaptive even in architectures where the affected genes were not found significantly mutated by the end of the experiment. Altogether our results demonstrate the existence of a common pathway for yeast cells to adapt to a form of constitutive DNA replication stress.” (Lines 405-414)

      **Major comments:**

      • Are the key conclusions convincing? Yes, the convergent evolution analysis, fitness assays, and genetic reconstructions are sufficient to characterise the genetic causes of adaptation in this experiment, and are of the highest standard. The authors do particularly well to fully recover the fitness increases that evolved with their genetic reconstructions, which imparts a completeness to their understanding of what happened in their evolution experiment.
      • Should the authors qualify some of their claims as preliminary or speculative, or remove them altogether? No, in nearly all cases the authors make reasonable claims. One exception is on L419 in the discussion, where the authors speculate why some mutations do not follow diminishing returns epistasis, but this idea does not really have any basis (no citation or reasons to suggest that DNA repair genes are less connected with other genes in the genome). If the authors cannot support this statement, it should be removed, and instead write that is currently unknown why some individual mutations do not follow the pattern of diminishing returns.

      On reflection, we agree with the reviewer and now state,

      “Our results confirm previous reports observing declining adaptability across strains with different initial fitness but largely fail to observe diminishing return epistasis as a potential justification of this phenomenon. Our experiments and two previous evolutionary repair experiments (Hsieh et al., 2020; Laan et al., 2015) both show interactions that are approximately additive between different selected mutations. The reasons for this difference are currently unknown.

      A hypothesis, which would need experimental validation, could be that the different mutations have different degrees of epistatic interactions with the rest of the genome. Ixr1, whose mutation follows diminishing return epistasis, is a transcription factor that could in principle affect the expression of many other genes implicated in different cellular modules. Sld5, Scc2 and Rad9 instead, whose mutations have the same effect across different genome architectures, having more mechanistic roles in genome maintenance may have strong epistatic interactions only with a restricted number of cellular modules implicated with DNA metabolism.

      • Would additional experiments be essential to support the claims of the paper? No.
        • Are the data and the methods presented in such a way that they can be reproduced? Yes, but some more details are needed for the convergent evolution analysis, see minor comments.
        • Are the experiments adequately replicated and statistical analysis adequate? Yes, but some more statistic reporting in the main text or figure legends would be helpful, for example. L159: Please report the statistical test, test statistic and p value in the text or in the figure legend. Currently significance is indicated, but the methods do not specify the test.

      We apologize for the lack of clarity in the main text. The test used for all fitness analysis was only reported in the materials and methods as follow:

      “The P-values reported in figures are the result of t-tests assuming unequal variances (Welch’s test)”

      We now include the test and the associated p-value in line 184, and write the above sentence in all the relevant figures.

      This should also be done for the GO analysis shown in figure 3A.

      We thank reviewer #3 pointing out this omission. We now include the following section:

      “Gene ontology (GO) enrichment analysis:

      The list of genes with putatively selected mutations (Figure 3A) or homozygous mutations in diploids (Figure 4) were input as ‘multiple proteins’ in the STRING database, which reports on the network of interactions between the input genes (https://string-db.org). The GO term enrichment analysis provided by STRING are reported in Supplementary Table 3 and Supplementary Table 6 respectively. Briefly, the strength of the enrichment is calculated as Log10(O/E), where O is the number of ‘observed’ genes in the provided list (of length N) which belong to the GO-term, and E is the number of ‘expected’ genes we would expect to find matching the GO-term providing a list of the same length N made of randomly picked genes. P-values are computed using a Hypergeometric test and corrected for multiple testing using the Benjamini-Hochberg procedure. The resulting P-values are represented as ‘False discovery rate’ in the supplementary tables and describe the significance of the GO terms enrichment (Franceschini et al., 2013).”

      **Minor comments:**

      • Specific experimental issues that are easily addressable. Not a new experiment, but extra details are required. The authors carried out both clone and whole population sequencing. For their convergent evolution analysis, what is the criteria for a mutation to be included- ie, does it need to be fixed, have attained a certain frequency? This is important- if the criteria were low (say 5%), it would be important to know whether gene A had fixed in 4 populations, while gene B had attained a frequency of 10% in 5 populations. As it stands both would be described as examples of convergent evolution. This can be handled by providing these details in the methods.

      For the population sequencing we disregarded variants found at less than 25% and 35% of the reads in haploid and diploid populations respectively as we observed they were largely the product of alignment errors. All the variants found at frequencies higher than the thresholds indicated were used for the parallel evolution analysis. The frequency at which each individual variant was detected in each population is reported in Supplementary table 1, while the average frequency at which a gene has been found mutated across different populations is reported in Supplementary table 2. The reason why we didn’t solely focus on fixed mutations for our convergent evolution analysis was that from previous work we knew of the existence of clonal interference which kept the frequency of verified adaptive mutations that coexisted in the same population (e.g. ixr1 and sld5) well below 90% (Fumasoni & Murray, 2020).

      For clarity we now add the following sentence in the material and methods:

      “Variants found in less than 25% and 35% of the reads in haploid and diploid populations respectively were discarded, since many of these corresponded to misalignment of repeated regions. For clone sequencing, only variants found in more than 75% of the reads in haploids and 35% of the reads in diploids (to account for heterozygosity) were considered mutations. The frequency of the reads associated with all the variants detected are reported in Supplementary table 1”

      • Are prior studies referenced appropriately? I note that the authors use the term declining adaptability where as other papers use the term diminishing returns epistasis- I am sure the authors have good reasons for their choice of nomenclature but I think it would be helpful for their readers to connect this work to other work by mentioning that declining adaptability is also referred to as diminishing returns.

      We use both terms (for instance in line 446 and line 448) with a different meaning : By ‘declining adaptability’ we refer the phenomenon where more fit strains display lower adaptation rates than less fit ones. By ‘diminishing returns epistasis’ we refer to a possible explanation of such a phenomenon, where adaptive mutations have different fitness effects due to their ‘global’ epistatic interactions with other alleles. It has to be noted that ‘diminishing returns epistasis’ is not the only proposed explanation of the phenomenon of declining adaptability (Couce & Tenaillon, 2015). In our case, we do find evidence of declining adaptability but very limited evidence for diminishing return epistasis (only 1 mutation in 5 has a different fitness effect in different architectures).

      A reference the authors have missed: L419, as well as citing the Desai Lab bioxive paper, they should cite another theory paper that obtained similar conclusions. Lyons, D.M., et al. https://doi.org/10.1038/s41559-020-01286-y.

      We thank the reviewer for the suggested reference, which is now cited at line 450.

      • Are the text and figures clear and accurate? This paper is beautifully written and easy to follow, a lot of thought has gone into the figures which are aesthetically pleasing and easy to navigate.

        • Do you have suggestions that would help the authors improve the presentation of their data and conclusions? No.

        **Typos**

        L32 "do" should be "to" L95 analyzed L219 are the authors referring to ref 15 here? I think so, but please specify

      We thank the reviewer for carefully finding the typos, which are now all corrected.

      Reviewer #3 (Significance (Required)):

      • Describe the nature and significance of the advance (e.g. conceptual, technical, clinical) for the field. This paper is an important conceptual result and an immediate advance for basic research. The authors have done an outstanding job of showing the potential for the clinical translation of this research, especially regarding cancer biology.
      • Place the work in the context of the existing literature (provide references, where appropriate). This study follows up on and builds upon an earlier paper by these same authors published in E-life in 2020. Conceptually this work is most closely related to work in Michael Desai's, Sergey Kryazhimskiy's, Tim Coopers and Chris Marx's labs work looking at diminishing returns epistasis in yeast, and studies contrasting evolution of haploids and diploids led by Greg Lang's and Sarah Otto's labs.
      • State what audience might be interested in and influenced by the reported findings. This work will be of great interest to the Experimental evolution and molecular evolution communities and also of interest to those who study cancer genomics and DNA replication and repair.
      • Define your field of expertise with a few keywords to help the authors contextualize your point of view. Indicate if there are any parts of the paper that you do not have sufficient expertise to evaluate. Microbial experimental evolution.

      REFERENCES CITED IN THE REVIEW RESPONSE

      Abe, T., Kawasumi, R., Giannattasio, M., Dusi, S., Yoshimoto, Y., Miyata, K., … Branzei, D. (2018). AND-1 fork protection function prevents fork resection and is essential for proliferation. Nature Communications, 9(1), 3091. https://doi.org/10.1038/s41467-018-05586-7

      Ait Saada, A., Lambert, S. A. E., & Carr, A. M. (2018, November 1). Preserving replication fork integrity and competence via the homologous recombination pathway. DNA Repair. Elsevier B.V. https://doi.org/10.1016/j.dnarep.2018.08.017

      Couce, A., & Tenaillon, O. A. (2015). The rule of declining adaptability in microbial evolution experiments. Frontiers in Genetics, 6(MAR), 99. https://doi.org/10.3389/fgene.2015.00099

      Crabbé, L., Thomas, A., Pantesco, V., De Vos, J., Pasero, P., & Lengronne, A. (2010). Analysis of replication profiles reveals key role of RFC-Ctf18 in yeast replication stress response. Nature Structural & Molecular Biology, 17(11), 1391–1397. https://doi.org/10.1038/nsmb.1932

      Desai, M. M., Fisher, D. S., & Murray, A. W. (2007). The speed of evolution and maintenance of variation in asexual populations. Current Biology : CB, 17(5), 385–394. https://doi.org/10.1016/j.cub.2007.01.072

      Deutschbauer, A. M., Jaramillo, D. F., Proctor, M., Kumm, J., Hillenmeyer, M. E., Davis, R. W., … Giaever, G. (2005). Mechanisms of Haploinsufficiency Revealed by Genome-Wide Profiling in Yeast. Genetics, 169(4), 1915–1925. https://doi.org/10.1534/GENETICS.104.036871

      Franceschini, A., Szklarczyk, D., Frankild, S., Kuhn, M., Simonovic, M., Roth, A., … Jensen, L. J. (2013). STRING v9.1: Protein-protein interaction networks, with increased coverage and integration. Nucleic Acids Research, 41(D1), D808. https://doi.org/10.1093/nar/gks1094

      Fumasoni, M., & Murray, A. W. (2020). The evolutionary plasticity of chromosome metabolism allows adaptation to constitutive DNA replication stress. ELife, 9. https://doi.org/10.7554/eLife.51963

      Fumasoni, M., Zwicky, K., Vanoli, F., Lopes, M., & Branzei, D. (2015). Error-Free DNA Damage Tolerance and Sister Chromatid Proximity during DNA Replication Rely on the Polα/Primase/Ctf4 Complex. Molecular Cell, 57(5), 812–823. https://doi.org/10.1016/j.molcel.2014.12.038

      Gambus, A., van Deursen, F., Polychronopoulos, D., Foltman, M., Jones, R. C., Edmondson, R. D., … Labib, K. (2009). A key role for Ctf4 in coupling the MCM2-7 helicase to DNA polymerase alpha within the eukaryotic replisome. EMBO J., 28(19), 2992–3004. https://doi.org/10.1038/emboj.2009.226

      Gerstein, A. C., Cleathero, L. A., Mandegar, M. A., & Otto, S. P. (2011). Haploids adapt faster than diploids across a range of environments. Journal of Evolutionary Biology, 24(3), 531–540. https://doi.org/10.1111/j.1420-9101.2010.02188.x

      Gerstein, Aleeza C., & Otto, S. P. (2011). Cryptic fitness advantage: Diploids invade haploid populations despite lacking any apparent advantage as measured by standard fitness assays. PLoS ONE, 6(12), 26599. https://doi.org/10.1371/journal.pone.0026599

      Gerstein, Aleeza C, Chun, H.-J. E., Grant, A., & Otto, S. P. (2006). Genomic Convergence toward Diploidy in Saccharomyces cerevisiae. PLoS Genetics, 2(9), e145. https://doi.org/10.1371/journal.pgen.0020145

      Hanna, J. S., Kroll, E. S., Lundblad, V., & Spencer, F. a. (2001). Saccharomyces cerevisiae CTF18 and CTF4 are required for sister chromatid cohesion. Mol Cell Biol., 21(9), 3144–3158. https://doi.org/10.1128/MCB.21.9.3144-3158.2001

      Harari, Y., Ram, Y., Rappoport, N., Hadany, L., & Kupiec, M. (2018). Spontaneous Changes in Ploidy Are Common in Yeast. Current Biology, 28(6), 825-835.e4. https://doi.org/10.1016/j.cub.2018.01.062

      Hsieh, Y. Y. P., Makrantoni, V., Robertson, D., Marston, A. L., & Murray, A. W. (2020). Evolutionary repair: Changes in multiple functional modules allow meiotic cohesin to support mitosis. PLoS Biology, 18(3), e3000635. https://doi.org/10.1371/journal.pbio.3000635

      Ira, G., & Haber, J. E. (2002). Characterization of RAD51-independent break-induced replication that acts preferentially with short homologous sequences. Molecular and Cellular Biology, 22(18), 6384–6392. Retrieved from http://www.ncbi.nlm.nih.gov/pubmed/12192038

      Koboldt, D. C., Zhang, Q., Larson, D. E., Shen, D., McLellan, M. D., Lin, L., … Wilson, R. K. (2012). VarScan 2: somatic mutation and copy number alteration discovery in cancer by exome sequencing. Genome Research, 22(3), 568–576. https://doi.org/10.1101/gr.129684.111

      Kotsantis, P., Petermann, E., & Boulton, S. J. (2018, May 1). Mechanisms of oncogene-induced replication stress: Jigsaw falling into place. Cancer Discovery. American Association for Cancer Research Inc. https://doi.org/10.1158/2159-8290.CD-17-1461

      Kouprina, N., Kroll, E., Bannikov, V., Bliskovsky, V., Gizatullin, R., Kirillov, A., … et al. (1992). CTF4 (CHL15) mutants exhibit defective DNA metabolism in the yeast Saccharomyces cerevisiae. Mol Cell Biol., 12(12), 5736–5747. Retrieved from http://www.ncbi.nlm.nih.gov/pubmed/1341195

      Kouprina NYu, Pashina, O. B., Nikolaishwili, N. T., Tsouladze, A. M., & Larionov, V. L. (1988). Genetic control of chromosome stability in the yeast Saccharomyces cerevisiae. Yeast (Chichester, England), 4(4), 257–269. https://doi.org/10.1002/yea.320040404

      Kryazhimskiy, S., Rice, D. P., Jerison, E. R., & Desai, M. M. (2014). Microbial evolution. Global epistasis makes adaptation predictable despite sequence-level stochasticity. Science (New York, N.Y.), 344(6191), 1519–1522. https://doi.org/10.1126/science.1250939

      Laan, L., Koschwanez, J. H., & Murray, A. W. (2015). Evolutionary adaptation after crippling cell polarization follows reproducible trajectories. ELife, 4, e09638. https://doi.org/10.7554/eLife.09638

      Lu, Y. B., Ratnakar, P. V, Mohanty, B. K., & Bastia, D. (1996). Direct physical interaction between DnaG primase and DnaB helicase of Escherichia coli is necessary for optimal synthesis of primer RNA. Proc. Natl. Acad. Sci. USA, 93(23), 12902–12907. https://doi.org/10.1073/pnas.93.23.12902

      Macheret, M., & Halazonetis, T. D. (2015). DNA replication stress as a hallmark of cancer. Annu. Rev. Pathol. Mech. Dis., 10, 425–448. https://doi.org/10.1146/annurev-pathol-012414-040424

      Marad, D. A., Buskirk, S. W., & Lang, G. I. (2018). Altered access to beneficial mutations slows adaptation and biases fixed mutations in diploids. Nature Ecology & Evolution, 2(5), 882–889. https://doi.org/10.1038/s41559-018-0503-9

      Pâques, F., & Haber, J. E. (1999). Multiple pathways of recombination induced by double-strand breaks in Saccharomyces cerevisiae. Microbiology and Molecular Biology Reviews : MMBR, 63(2), 349–404. https://doi.org/

      Poli, J., Tsaponina, O., Crabbé, L., Keszthelyi, A., Pantesco, V., Chabes, A., … Rothstein, R. (2012). dNTP pools determine fork progression and origin usage under replication stress. EMBO J., 31(4), 883–894. https://doi.org/10.1038/emboj.2011.470

      Samora, C. P., Saksouk, J., Goswami, P., Wade, B. O., Singleton, M. R., Bates, P. A., … Masai, H. (2016). Ctf4 Links DNA Replication with Sister Chromatid Cohesion Establishment by Recruiting the Chl1 Helicase to the Replisome. Molecular Cell, 63(3), 371–384. https://doi.org/10.1016/j.molcel.2016.05.036

      Simon, A. C., Zhou, J. C., Perera, R. L., van Deursen, F., Evrin, C., Ivanova, M. E., … Pellegrini, L. (2014). A Ctf4 trimer couples the CMG helicase to DNA polymerase alpha in the eukaryotic replisome. Nature, 510(7504), 293–297. https://doi.org/10.1038/nature13234

      Symington, L. S. (2002). Role of RAD52 Epistasis Group Genes in Homologous Recombination and Double-Strand Break Repair. Microbiology and Molecular Biology Reviews, 66(4), 630–670. https://doi.org/10.1128/mmbr.66.4.630-670.2002

      Tanaka, H., Katou, Y., Yagura, M., Saitoh, K., Itoh, T., Araki, H., … Shirahige, K. (2009). Ctf4 coordinates the progression of helicase and DNA polymerase alpha. Genes to Cells, 14(7), 807–820. https://doi.org/10.1111/j.1365-2443.2009.01310.x

      Thompson, D. A., Desai, M. M., & Murray, A. W. (2006). Ploidy controls the success of mutators and nature of mutations during budding yeast evolution. Current Biology : CB, 16(16), 1581–1590. https://doi.org/10.1016/j.cub.2006.06.070

      Van den Bergh, B., Swings, T., Fauvart, M., & Michiels, J. (2018). Experimental Design, Population Dynamics, and Diversity in Microbial Experimental Evolution. Microbiol Mol Biol Rev., 82(3), e00008-18. https://doi.org/10.1128/MMBR.00008-18

      Venkataram, S., Dunn, B., Li, Y., Agarwala, A., Chang, J., Ebel, E. R., … Petrov, D. A. (2016). Development of a Comprehensive Genotype-to-Fitness Map of Adaptation-Driving Mutations in Yeast. Cell, 166(6), 1585-1596.e22. https://doi.org/10.1016/J.CELL.2016.08.002

      Vesela, E., Chroma, K., Turi, Z., & Mistrik, M. (2017a). Common Chemical Inductors of Replication Stress: Focus on Cell‐Based Studies. Biomolecules, 7(1), 19. https://doi.org/10.3390/biom7010019

      Vesela, E., Chroma, K., Turi, Z., & Mistrik, M. (2017b, February 21). Common chemical inductors of replication stress: Focus on cell-based studies. Biomolecules. MDPI AG. https://doi.org/10.3390/biom7010019

      Villa, F., Simon, A. C., Ortiz Bazan, M. A., Kilkenny, M. L., Wirthensohn, D., Wightman, M., … Dutta, A. (2016). Ctf4 Is a Hub in the Eukaryotic Replisome that Links Multiple CIP-Box Proteins to the CMG Helicase. Molecular Cell, 63(3), 385–396. https://doi.org/10.1016/j.molcel.2016.06.009

      Wilhelm, T., Olziersky, A. M., Harry, D., De Sousa, F., Vassal, H., Eskat, A., & Meraldi, P. (2019). Mild replication stress causes chromosome mis-segregation via premature centriole disengagement. Nature Communications, 10(1), 1–14. https://doi.org/10.1038/s41467-019-11584-0

      Yeeles, J. T., Poli, J., Marians, K. J., & Pasero, P. (2013). Rescuing stalled or damaged replication forks. Cold Spring Harbor Perspectives in Biology, 5(5), a012815. https://doi.org/10.1101/cshperspect.a012815

      Yoshizawa-Sugata, N., & Masai, H. (2009). Roles of human AND-1 in chromosome transactions in S phase. J Biol Chem., 284(31), 20718–20728. https://doi.org/10.1074/jbc.M806711200

      Yuan, Z., Georgescu, R., Santos, R. de L. A., Zhang, D., Bai, L., Yao, N. Y., … Li, H. (2019). Ctf4 organizes sister replisomes and Pol α into a replication factory. ELife, 8, e47405. https://doi.org/10.7554/eLife.47405

      Zeyl, C., Vanderford, T., & Carter, M. (2003). An Evolutionary Advantage of Haploidy in Large Yeast Populations. Science, 299(5606), 555–558. https://doi.org/10.1126/SCIENCE.1078417

      Zheng, D.-Q., Zhang, K., Wu, X.-C., Mieczkowski, P. A., & Petes, T. D. (2016). Global analysis of genomic instability caused by DNA replication stress in Saccharomyces cerevisiae. Proc Natl Acad Sci U S A., 113(50), E8114–E8121. https://doi.org/10.1073/pnas.1618129113

    2. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #4

      This reviewer did not leave any comments

    3. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #3

      Evidence, reproducibility and clarity

      Summary:

      Here the authors carry out an evolution experiment, propagating replicate populations of the budding yeast with the CTF 4 gene deleted in three different genetic backgrounds: haploid , diploid and recombination deficient (RAD52 deletion). The authors find that the rate of evolution depends on the initial fitness of the different genetic backgrounds which is consistent with a repeated finding of evolution experiments: that beneficial mutations tend to have a smaller fitness effect in high fitness genetic backgrounds. Curiously even though the targets of selection tended to be specific to each of the three different genetic backgrounds, genetic reconstruction experiments showed beneficial mutations convert a fitness increase in all genetics backgrounds. The authors go on to provide a plausible explanation for why each of the three genetic backgrounds are predisposed to certain types of beneficial mutations. Overall, these results provide important context and caveats for an emerging consensus that genetic background determines the rate of evolution, a comprehensive molecular breakdown of adaptation to DNA replication stress and a mechanistic explanation for why different beneficial mutations are favoured in diploids, haploids and recombination deficient strains. This is a well-executed study that is beautifully presented and easy to follow. This will be of great interest to those in the experimental evolution community and the data an excellent resource.

      Major comments:

      • Are the key conclusions convincing? Yes, the convergent evolution analysis, fitness assays, and genetic reconstructions are sufficient to characterise the genetic causes of adaptation in this experiment, and are of the highest standard. The authors do particularly well to fully recover the fitness increases that evolved with their genetic reconstructions, which imparts a completeness to their understanding of what happened in their evolution experiment.
      • Should the authors qualify some of their claims as preliminary or speculative, or remove them altogether? No, in nearly all cases the authors make reasonable claims. One exception is on L419 in the discussion, where the authors speculate why some mutations do not follow diminishing returns epistasis, but this idea does not really have any basis (no citation or reasons to suggest that DNA repair genes are less connected with other genes in the genome). If the authors cannot support this statement, it should be removed, and instead write that is currently unknown why some individual mutations do not follow the pattern of diminishing returns.
      • Would additional experiments be essential to support the claims of the paper? No.
      • Are the data and the methods presented in such a way that they can be reproduced? Yes, but some more details are needed for the convergent evolution analysis, see minor comments.
      • Are the experiments adequately replicated and statistical analysis adequate? Yes, but some more statistic reporting in the main text or figure legends would be helpful, for example. L159: Please report the statistical test, test statistic and p value in the text or in the figure legend. Currently significance is indicated, but the methods do not specify the test. This should also be done for the GO analysis shown in figure 3A.

      Minor comments:

      • Specific experimental issues that are easily addressable. Not a new experiment, but extra details are required. The authors carried out both clone and whole population sequencing. For their convergent evolution analysis, what is the criteria for a mutation to be included- ie, does it need to be fixed, have attained a certain frequency? This is important- if the criteria were low (say 5%), it would be important to know whether gene A had fixed in 4 populations, while gene B had attained a frequency of 10% in 5 populations. As it stands both would be described as examples of convergent evolution. This can be handled by providing these details in the methods.
      • Are prior studies referenced appropriately? I note that the authors use the term declining adaptability where as other papers use the term diminishing returns epistasis- I am sure the authors have good reasons for their choice of nomenclature but I think it would be helpful for their readers to connect this work to other work by mentioning that declining adaptability is also referred to as diminishing returns.

      A reference the authors have missed: L419, as well as citing the Desai Lab bioxive paper, they should cite another theory paper that obtained similar conclusions. Lyons, D.M., et al. https://doi.org/10.1038/s41559-020-01286-y. .

      • Are the text and figures clear and accurate? This paper is beautifully written and easy to follow, a lot of thought has gone into the figures which are aesthetically pleasing and easy to navigate.
      • Do you have suggestions that would help the authors improve the presentation of their data and conclusions? No.

      Typos

      L32 "do" should be "to" L95 analyzed<br> L219 are the authors referring to ref 15 here? I think so, but please specify

      Significance

      • Describe the nature and significance of the advance (e.g. conceptual, technical, clinical) for the field. This paper is an important conceptual result and an immediate advance for basic research. The authors have done an outstanding job of showing the potential for the clinical translation of this research, especially regarding cancer biology.
        • Place the work in the context of the existing literature (provide references, where appropriate). This study follows up on and builds upon an earlier paper by these same authors published in E-life in 2020. Conceptually this work is most closely related to work in Michael Desai's, Sergey Kryazhimskiy's, Tim Coopers and Chris Marx's labs work looking at diminishing returns epistasis in yeast, and studies contrasting evolution of haploids and diploids led by Greg Lang's and Sarah Otto's labs.
        • State what audience might be interested in and influenced by the reported findings. This work will be of great interest to the Experimental evolution and molecular evolution communities and also of interest to those who study cancer genomics and DNA replication and repair.
        • Define your field of expertise with a few keywords to help the authors contextualize your point of view. Indicate if there are any parts of the paper that you do not have sufficient expertise to evaluate. Microbial experimental evolution.
    4. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #2

      Evidence, reproducibility and clarity

      Summary

      This manuscript investigates the effect of an organism's genotype (or, as the authors call it, an organism's 'genome architecture') on evolutionary trajectories. For this, the authors use Saccharomyces cerevisiae strains that experience some form of replication stress due to specific gene deletions, and that further differ in ploidy and/or the type of gene(s) deleted. They find the same three functional modules (DNA replication, DNA damage checkpoint, sister chromatid cohesion) are affected across the 3 different genotypes tested; although the specific genes that are mutated varies.

      Major comments

      This is a solid and exceptionally eloquent paper, comprising a large body of work that is in general well presented. That said, I do have some suggestions and questions. At several points in the manuscript, the authors should perhaps be more careful in their wording and avoid to overgeneralize data without providing additional evidence for these claims.

      • Some key points of the study are not entirely clear to me; possibly because the study builds upon a previous study that was recently published in eLife. Anyhow, I think it would be useful to clarify the following points a bit more:

      • Why exactly was ctf4∆ chosen as a model for replication stress? What is the evidence that ctf4∆ is a good model for replication stress? Without including some evidence for this, it is unclear how well the findings in this study really can be generalized to replication stress (which is what the authors do now). Would the authors expect to see similar routes of adaptation if a 'genomic architecture' with a less severe/other replication defect would have been used? I realize the last question is perhaps difficult to address without actually doing the experiment (which I am not suggesting the authors should do); I just want to point out that perhaps some data should not be over-generalized.

      • Likewise, why was RAD52 selected as the gene to delete to affect homologous recombination? I understand that it is a key gene, but on the flipside, absence of RAD52 affects multiple cellular pathways and (as the authors also observe in their populations) also results in increased mutation rates which might confound some of the results.

      • Related to the first comment, it is also unclear to me how well the system chosen by the authors is representative of the replication stress experienced by tumor cells (as briefly touched upon in the final section of the discussion). Are some of the homologs key oncogenes that drive carcinogenesis?

      • The authors should consider rephrasing some sentences regarding the occurrence of adaptive mutations. Sentences such as 'which genes are mutated depends on the selective advantage' (p1; lines 15-16); 'genome architecture controls the frequency at which mutations occur' (p15), "genome architecture controls which genes are mutated" (p1, line 20) makes it sound like the initial occurrence of mutations is not random, whereas in reality, the mutational landscape is the result of the combined effect of occurrence and fitness effect of the mutations, with the later rather than the former likely being the main driver behind the observed patterns.
      • Some important methodological information is missing or unclear in the manuscript:

      • The authors should provide more details on how they decided which clones to select for sequencing. Did they select the biggest colonies; were colonies picked randomly, ...

      • What is the population size during the evolution experiment?

      • Sequencing of populations and clones: coverage should be mentioned

      • Identification of mutations (p19, line 573): Is this really how the authors defined whether a variant is a mutation? Based on the definition given here, DNA mutations that lead to a synonymous mutation in the protein are not considered as mutations?

      • Perhaps the information can be found elsewhere, but the source data excel files for mutations is incomplete and should at the very least contain information on the type of mutation (eg. T->A), as well as the location of this mutation in the respective gene.

      Minor comments

      • While the author already cite several significant papers relevant for their manuscript, some other studies could also be included:

      • From the text in the abstract, it is unclear what the three genomic architectures (line 13) exactly are, the authors should consider spelling this out.

      • Can the authors speculate on why a homozygous ctf4/ctf4 rad52/rad52 would be lethal, and a haploid not?

      • The authors note that a diploid ctf4/ctf4 strain is less fit than its haploid counterpart. Why do the authors think this is the case?

      • The authors passage their cells for 100 cycles and assume that this corresponds to around 1000 generations for each population. However, the fitness differences between the different starting strains (see also Figure 1B) are likely to cause considerable differences in number of generations between the different strains. Do the authors have more precise measurements of number of generations per population? If not, perhaps it should be noted that some lineages may have undergone more doublings than others, and perhaps also discuss if and how this could influence the results?

      • Panel A of figure 1A is somewhat confusing; as this seems to indicate that the ctf4∆ was introduced after strains were made, for example, haploid recombination deficient (which is not how these strains were constructed). Perhaps a better way of representing would be to have the indication of DNA replication stress pictured inside the yeast cells.

      • Legend to Figure 1: is fitness expressed relative to haploid or diploid WT cells for the diploid strains?

      • Figure 3: to improve readability of this figure, the authors could consider placing the legend of the different symbols (#, *,..) in the figure as well and not just in the figure legend.

      • Figure 5 shows Indels, but if I am correct, these mutations are not discussed in the text; nor is it mentioned what the authors used as a cut-off to determine indels (the authors use the term 'small indels' without defining it)? For example, the data shown in Figure 3 and Figure 4 only includes SNPs and not indels (correct?) - but the indels should also be taken into account when investigating which modules are hit.

      • Figure 5 mentions: # gene mutations. So these are only the mutations in genes, and not in their up- or downstream regulatory regions?

      • Figure 3-S1: labels of C panels are missing.

      • Figure 3-S1, panel B: why did the authors focus on synonymous mutations?

      Significance

      This is a solid and clearly written study, comprising a large body of work that is generally well presented and that will be of interest to scientists active in the field of (experimental) evolution and replication.

      However, many aspects studied in this manuscript have already been studied and reported before; including the recent eLife paper by the same group, as well as studies by other labs that have investigated how genome architecture / genotype affects evolutionary trajectories, the effect of ploidy on evolution, .... Because of this, I do feel that the authors should put their findings more in the context of existing literature context, including a general description of which results are truly novel, which confirm previous findings and which results seem to go against previous reports. This is already so at some points in the text, but I feel this could be done even more.

      Additionally, I think the authors should be more careful not to over-generalize their findings, which come from only a few specific genetic manipulations that might not be representative for general replication stress. For example (p15), can the authors really claim that they have unraveled general principles of adaptation to constitutive DNA replication stress? Perhaps a better motivation of the choice of ctf4 as a model mutation for DNA replication stress could also help (see also my earlier comments). A similar comment applies to the molecular mechanisms affecting adaptation in diploid cells - what evidence do the authors have that their findings are not specific to the one specific type of diploid strain they used in their study? Adding a bit more background information or nuance for some of the claims would help tackle this issue.

      Field of expertise of this reviewer: genetics, evolution, genomics

    5. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #1

      Evidence, reproducibility and clarity

      In their previous work the authors examined adaptation in response to replication stress in haploid yeast, via experimental evolution of batch cultures followed by sequencing. Here they extend this approach to include diploid and recombination-deficient strains to explore the role of genome architecture in evolution under replication stress. On the whole, a common set of functional modules are found to evolve under all genetic architectures. The authors discuss the molecular details of adaptation and use their findings to speculate on the determinants of adaptation rate.

      SECTION A - Evidence, reproducibility and clarity

      Experimental evolution can reveal adaptive pathways, but there are some challenges when applying this approach to compare genetic backgrounds or environments. They key challenge is that adaptation potentially depends on both the rate of mutation and the nature of selection. Distinct adaptation patterns between groups could therefore reflect differential mutation, selection, or both. The authors allude to this dichotomy but have very limited data to address it. The closest effort is engineering putatively-adaptive variants into all genetic background including those where they did not arise; the fact that such variants remain beneficial suggests they did not arise in certain backgrounds because of a lower mutation rate, but this is a difficult issue to tackle quantitatively.

      From mutation accumulation experiments, where the influence of selection is minimized, there is evidence that genetic architecture affects the rate and spectrum of spontaneous mutations. In this experiment, the allele used to eliminate recombination, rad52, will also increase the mutation rate generally. The diploid strain is also likely to have a distinct mutational profile--as a null expectation diploids should have twice the mutation rate of haploids. Recent evidence indicates the mutation rate difference between haploid and diploid yeast might be less than two-fold, but that there are additional differences in the mutation spectrum, including rates of structural change. The context for this study is therefore three genetic architectures likely to differ in multiple dimensions of their mutation profiles, but mutation rates are not measured directly.

      The nature of selection on haploids and diploids is expected to differ because of dominance, but ploidy-specific selection is also possible. The authors discuss how recessive beneficial alleles may be less available to diploids, though this can be offset by relatively rapid loss of heterozygosity. However, diploids should also incur more mutations, all else being equal. The rate of beneficial mutation, as opposed to the rate of mutation generally, will depend on the mutational "target size" of fitness, and the authors findings recapitulate other literature (particularly regarding "compensatory" adaptation) that points to faster adaptation in genotypes with lower starting fitness.

      There is ample literature on the above topics, particularly discussions of the evolutionary advantages of haploidy versus diploidy. While adaptation to replication stress provides a novel starting point for this investigation, much of the manuscript is devoted to long-standing questions that are not specific to replication stress. Unfortunately, the data the authors collected is not sufficient to shed light on these questions, because mutation and selection cannot be effectively distinguished. The Discussion states that "We find that the genes that acquire adaptive mutations, the frequency at which they are mutated, and the frequency at which these mutations are selected all differ between architectures but that mutations that confer strong benefits always lie in the same three modules" (line 379), but it is not clear that these statements are all supported by the data.

      Focusing on the more novel aspect of their experiment-the presence of replication stress-would arguably be a better approach. On this topic the authors have some interesting observations and speculation, but clear predictions are lacking. The introduction section could be redesigned to explicitly state why genome architecture might affect adaptation in response to replication stress in particular, rather than (or in addition to) adaptation generally. If there were no differences in mutation, does the nature of Ctf4 lead to predictions that the molecular basis of compensatory adaptation should differ among genome architectures? Without such predictions it will be difficult for readers to know whether the observation that different genome architectures follow similar adaptive paths is surprising or not.

      Minor comments:

      Shifts in ploidy from diploid to haploid are less common than the reverse change, so the observation of such a shift (Fig. 1) should be discussed in more detail.

      Line 88 typo 'stains'.

      Significance

      SECTION B - Significance

      The novel aspect of this study is the combination of replication stress and genome architecture, but here the significance is limited by a lack of clear predictions on how these factors might interact. On the other hand, much of the manuscript is devoted to why adaptation might vary among genome architectures in general, but this long-standing and important question is not particularly well resolved by this experimental approach, which can't disentangle mutation and selection.

      The authors highlight the dichotomy when discussing the evolution of ploidy: "We suggest that... genome architecture affects two aspects of the mutations that produce adaptation: the frequency at which they occur and the selective advantage they confer" (line 399), but presenting this as a novel inference does not appropriately acknowledge prior research and discussion of these ideas; several relevant papers are cited by the authors in other contexts. It may be possible to recast these findings as a test of the role of genome architecture in adaptation generally, but the authors should clarify the limitations of experimental evolution and more fully consider the theory and data outlined in previous research. In particular, few studies can claim to directly compare mutation rates between genome architectures, and it is not obvious that the present study is an example of such.

      Reviewer expertise: Evoutionary genetics; experimental evolution; mutation.

    1. Note: This rebuttal was posted by the corresponding author to Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Reply to the reviewers

      Response to Reviewers

      We thank the reviewers for their careful reading of our manuscript and their valuable suggestions and comments. To address the reviewers’ concerns and improve our manuscript, we will complete the additional experiments and further revise the text as described below.


      Reviewer #1 (Evidence, reproducibility and clarity (Required)):

      **Summary:**

      Provide a short summary of the findings and key conclusions (including methodology and model system(s) where appropriate). Please place your comments about significance in section 2. The authors present an in vivo analysis of pdzd8 (CG10362) and a synthetic ER-mitochondria tether in the regulation of locomotor activity, lifespan, and mitochondrial turnover of Drosophila melanogaster, using basic bioinformatics, RNAi, SPLICS, imaging and microscopies observations (i. e. TEM, SIM), fly lines, and a representative AD fly disease model, etc. The research methodologies were detailed in good order. The model system employed was suitable to address the research topic. The manuscript was written in a clear language and statistical analysis were correctly applied.

      **Major comments:**

      *-Are the key conclusions convincing?*

      Yes. The results/conclusions are logical and provide an overview of Pdzd8 in the regulation of mitochondrial quality control and neuronal homeostasis.

      *-Would additional experiments be essential to support the claims of the paper? Request additional experiments only where necessary for the paper as it is, and do not ask authors to open new lines of experimentation.*

      No. Experiments were generally well performed, and all the data support the conclusions.

      *-Are the suggested experiments realistic in terms of time and resources? It would help if you could add an estimated cost and time investment for substantial experiments.*

      No suggested experiments needed.

      *-Are the data and the methods presented in such a way that they can be reproduced?*

      Yes. The authors have followed proper experimental design and methods have been described in sufficient detail.

      *-Are the experiments adequately replicated and statistical analysis adequate?*

      Yes, they are.

      **Minor comments:**

      *-Specific experimental issues that are easily addressable.*

      No comment.

      *-Are prior studies referenced appropriately?*

      Yes. The relevant literatures have been cited appropriately.

      *-Are the text and figures clear and accurate?*

      1.Please pay attention to the correct spelling of the described protein name (Pdzd8) and gene name (should be in 'italic') throughout the manuscript, i. e. line 36, 98, and 556, etc.

      As this is the first published characterization of the fly homolog of the mammalian Pdzd8 We have decided to name the fly protein pdzd8, using the lower case “p” to distinguish it from the mammalian protein. We have checked and corrected our use of italics for the gene name as noted in track changes.

      2.In figure 1C and its figure legend, please state what the numbers "201" and "195" stand for.

      We have added the text “numbers on bars indicate number of mitochondria analysed” to the figure legend.

      3.Your data needs to be converted the lowercase letter "x" to math symbol "×" when representing times sign, i. e. line 523, 5x, etc.

      Corrected

      *-Do you have suggestions that would help the authors improve the presentation of their data and conclusions?*

      No comment.

      Reviewer #1 (Significance (Required)):

      *-Describe the nature and significance of the advance (e.g. conceptual, technical, clinical) for the field.*

      Discoveries from this study include 1) characterization of the tethering protein Pdzd8 in Drosophila melanogaster, and 2) shed light on a possible way on how to enhance mitochondrial quality control and to help promote healthy aging of neurons by manipulating MERCs.

      *-Place the work in the context of the existing literature (provide references, where appropriate).*

      With this manuscript, the authors present a straightforward but sound piece of scientific research, with the intent to illustrate the consequences of neuronal depletion of pdzd8 in Drosophila melanogaster. Since Pdzd8 plays specific functions in ER-mitochondrial tethering complexes and dysregulations of MERCs are damaging to neurons, this protein represents a good potential target. In this context the characterization of Pdzd8 should represent an interesting starting point. To this purpose, the gene was knockdown and the tether construct was recombinantly produced. The fly lines were then subjected to analysis both at the organismal and at the cellular level.

      *-State what audience might be interested in and influenced by the reported findings.* Audience might include those who are in the field of neuroscience and pharmaceutical, and benefit from an awareness of this research.

      *-Define your field of expertise with a few keywords to help the authors contextualize your point of view. Indicate if there are any parts of the paper that you do not have sufficient expertise to evaluate.*

      Key words in my field of expertise: Ageing, neurodegenerative diseases, Alzheimer's disease, mitophagy, NAD+, neuroprotection. My group is investigating the molecular mechanisms of ageing and age-related neurodegeneration (especially AD) using cross-species model systems, ranging from human brain samples, iPSCs, C. elegans, Drosophila melanogaster, and mice, therefore I have sufficient expertise to evaluate this paper.

      **Referees Cross-commenting**

      To this reviewer the key novelty of this paper was the study of the regulation of the mitochondrial-ER contact sites (MERCs) in life and health. The data indicate that MERCs mediated by the tethering protein pdzd8 play a critical role in the regulation of mitochondrial homeostasis, neuronal function, and lifespan. In a transitional perspective, this reviewer would ask to check whether this mechanism conserves in rodents or not (e.g. to to memory in the AD mice and to run lifespan in mitochondrial toxin condition). This may be to much. But will depend on the standard of the journal. We thank the reviewer for their input, evaluation and interest. We too are keen to know whether this mechanism is conserved and hope to investigate this in our ongoing work including characterizing a mouse mutant, but the current work already represents a substantial investment of resources and a worthy study in its own right as the first description of the in vivo role of pdzd8, so we feel it is beyond the scope of the current work.

      Reviewer #2

      (Evidence, reproducibility and clarity (Required)):

      Hewitt et al. describe and characterize for the first time the ortholog of pdzd8 in Drosophila melanogaster. In accordance with pdzd8's previously described function as a member of mitochondrial-ER contact sites (MERCs) the authors show reduced MERCs upon RNAi mediated depletion of pdzd8 via TEM, SIM and a split-GFP based contact site sensor. Pdzd8 depletion results in the increased life span as well as improved locomotor activity in aging flies while increase of MERCs with a synthetic tether accelerates the age-related declines in survival and locomotion. Moreover, pdzd8 depleted flies are more resistant against mitochondrial toxins. The authors correlate these protective effects of pdzd8 knockdown with an increase in mitophagy using a mitophagy sensor and describe a rescue of locomotor defects in an Alzheimer disease fly model by pdzd8 depletion.

      **Major comments:**

      1.The authors quantify the number of MERCs in thin sections of TEM (Fig 1B and C). It would add to the paper if the authors would show a representative reconstruction of the quantified somata, as a 3D reconstruction would visualize ER-Mito contacts more reliable than thin sections.

      We agree that the 3D reconstruction of TEM images would provide a satisfying addition to the current analyses, however such advanced techniques are not readily available. The current samples used to collect these data cannot be used to generate 3D reconstructions. To counter this, we have used three independent methods to analyse the changes in MERCs, all of which show a decrease in MERCs in the flies with less pdzd8 supporting that these observations are reproducible and robust.

      2.The authors quantify MERCs in pdzd8 KD also by SIM (Fig1F, G). However, they quantify the number of MERCs in epidermal cells while they also show SIM images of larval neurons (Fig S1D). For consistency and to support their claim of MERC reduction in neurons, we ask the authors to include the quantification based on larval neurons especially as the authors show that pdzd8 is predominantly expressed in the CNS.

      Unfortunately, the soma of larval neurons have extremely limited cytosol (see fig. S1D) which creates very challenging conditions to discern the spatial separation of ER and mitochondria by light microscopy. While co-localisation of organelle markers in such cells has been reported in the literature, we are extremely concerned that the lack of space within the cytosol renders such analysis unreliable. However, we will attempt to quantify the extent of co-localisation of the ER and mitochondria in these cells. In contrast, epidermal cells are much larger providing greater spatial separation of ER and mitochondria. Notably, we complement the co-localisation analysis of epidermal cells with two additional approaches, TEM analysis and the SPLICS reporter construct, to demonstrate pdzd8-RNAi results in decreased MERCs specifically in neurons.

      3.The authors describe a decreased NMJ volume in Fig 4G. It would improve and complete the functional characterization of pdzd8 in flies if the authors can provide further data whether pdzd8 KD causes a general synaptic defect. Can the authors show morphological synaptic defects in the existing TEM data of the adult brain or provide additional ERG recordings, which would elucidate the functional consequences of pdzd8 depletion in the CNS?

      Our TEM data are not suitable for us to properly analyse defects in synaptic morphology as our images centered around the cell bodies where the organelle morphology was easiest to distinguish and there are very few synapses. While it is not surprising that the knockdown of pdzd8 has some detrimental effects, we chose to focus our efforts on trying to determine the cause of the protective effect on locomotor activity in aged flies rather than to exhaustively characterise the myriad phenomena which may be impacted as a knock-on effect of the disrupted cell biology that we have demonstrated. We hope to further explore the detrimental functional consequences of pdzd8 depletion on such phenomena as neurotransmission in future work.

      1. Hewitt et al. suggest a beneficial effect of increased turnover of mitochondria for healthy aging. To convince readers we would like to ask the following:

      a) This claim is based on their observation of increased mitophagy in pdzd8 depleted flies using one reporter (Fig 5). Can the authors support their data with an alternative method as this is one of the key claims of the manuscript?

      The mitoQC tool is well established in the field and we have found it to perform better but consistent with mito-Keima (Lee et al. 2018 JCB doi: 10.1083/jcb.201801044). We would be happy to consider other assays if the reviewer can suggest an unbiased and established alternative.

      b) An increased turnover of Mitochondria would also suggest that there are more "young" mitochondria present in the pdzd8 KD neurons. Can the authors experimentally address that?

      We understand the reviewer’s point here but due to the continual fission and fusion, as well as piecemeal turnover of mitochondria (see Vincow et al. 2019 Autophagy doi: 10.1080/15548627.2019.1586258), the concept of ‘young’ versus ‘old’ mitochondria is misplaced. The mitochondrial network essentially exists as a milieu of components which are produced and degraded at different rates.

      c)Furthermore, we would like to ask the authors to use also the MERC tether as control in the mitophagy assay. This would allow further conclusions about the role of the mitophagy, its protective effect during aging and the role of MERCs in this process.

      We remind the reviewer that this MERC tether is constructed from an RFP with N- and C-terminal tethering peptides. The presence of this RFP prevents the proper analysis of the mitoQC mCherry signal. However, given the dramatic phenotypes we think that it is unlikely that a decrease in mitophagy alone can explain the detrimental effects of increased tethering.

      1. In Fig6 A,B the authors should include also the pdzd8 KD to support their claim that the rescue of climbing defects correlates with an reduction of MERCs.

      We thank the reviewer for this suggestion and we will perform this experiment.

      Moreover, it would be beneficial for their final conclusion, if the authors could show that increases mitophagy in the background of Ab42 expressing flies.

      We thank the reviewer for this suggestion and we will perform this experiment.

      **Minor comments:**

      1.Can the authors add to the figure legend of Fig 1F how the ER and Mitochondria were labeled?

      We have added the constructs to the figure legend (full genotypes for all figures are given in Table S2).

      2.Error bars should be added in the quantification of MERCs in Fig1C.

      The MERCs are quantified in three brains per genotype but as there were variable numbers of sections suitable for imaging from each brain the total values are combined to give a single percentage.

      3.A reference to Supplementary Fig S1D is missing in the main text.

      This figure is referenced in line 135

      4.Can the authors label the individual genotypes in Fig S3C and 4F?

      Figure labels and legends have been modified to clarify this.

      5.Can the author specify which brain region they imaged in Fig 5C?

      The regions imaged and quantified were chosen for their clear organelle morphology rather than targeting a specific brain region. All images were from the protocerebrum and the methods and figure legends have been updated to note this.

      6.Are the ATP levels normalized to ADP in Fig S3D? Can the authors specify in the figure and figure legend to what ATP was normalized?

      Figure labels and legends have been modified to clarify the ATP levels are normalised to total protein quantification of the samples.

      7.Please sort the supplementary figures in accordance to their reference order in the text.

      We thank the reviewer for checking this. This figure order will be rechecked in the final version as addressing reviewer comments is likely to lead to further changes.

      Reviewer #2 (Significance (Required)):

      The authors present here novel insights about the functional role of a new member of the MERCs, pdzd8, using RNAi mediated depletion and Drosophila melanogaster as a model system. As MERCs receive more attention especially in the context of their potential role in neurological diseases, the author's manuscript will be of high interest to the scientific community. The in vivo model combined with multiple different technical approaches add to the significance of the paper. There are some controls and additional experiments that are required to support the author's main claims and complete the functional characterization of pdzd8 (see major comments).

      Field of expertise: neuroscience, fly genetics, neurodegeneration.

      Reviewer #3

      (Evidence, reproducibility and clarity (Required)):

      This manuscript entitled "Decreasing pdzd8-mediated mitochondrial-ER contacts in neurons improves fitness by increasing mitophagy" by Hewitt and collaborators describes the role of the Drosophila ortholog of PDZD8 in ER-mitochondria contacts in neurons and the physiological consequence of pdzd8 loss. The authors show that ER-mitochondria contacts are reduced in fly neurons expressing a pdzd8-RNAi construct. Decreasing pdzd8 expression in neurons was accompanied by a slowed age-associated decline in locomotor activity, and an increased lifespan. In presence of mitochondrial toxins, neurons deficient for pdzd8 were protected. Finally, the authors showed that pdzd8 silencing increased mitophagy in aged neurons, and protected against neurodegeneration in a model of Alzheimer's disease.

      **Major points:**

      1)There are important controls that are missing. RNAi expression often affects off-target genes which could unfortunately modify the observed phenotypes. The authors should verify that a) the phenotypes observed by RNAi-mediated pdzd8 silencing can be rescued by the expression of an RNAi-insensitive pdzd8 construct (the authors should verify the rescue of the most crucial phenotypes described in the manuscript); b) the RNAi-LacZ-line that they use as control in the paper does not behave differently from a WT line, which could be induced by an off-target effect of the RNAi-LacZ (again with the most crucial phenotypes).

      While the Drosophila community is fortunate to have a plethora of readily available tools for interrogating the function of nearly all genes in the genome – tools which form the foundation of most work in Drosophila labs worldwide – the availability is not limitless. In this instance, the transgenic RNAi line generated as a resource for the community comprises a 500 bp hairpin, computed to be the most selective target for that gene. Being a 500 bp sequence it is unrealistic to be able to establish an RNAi-resistant variant that still faithfully functions as normal. Nevertheless, although imperfect we show in Figure S3B that pdzd8-RNAi rescues the climbing defect produced by overexpressing pdzd8, providing evidence the construct is specifically acting on this sequence.

      Similarly, the availability of ‘control’ RNAi reagents is generous but still limited. This LacZ-RNAi line is one of a few well-established controls that has provided a cornerstone reference for a wealth of studies. Nevertheless, we will provide experimental data that aged climbing of nSyb>LacZ-RNAi is highly comparable to several other well-established control genotypes.

      2) Did the author analyzed their EM data in a blinded-way to minimize subjective bias? This type of analysis is complicated by the manual annotation of ultrastructures, which is by nature subjective. For instance, this reviewer would have annotated the two mitochondria in the middle of Fig 1B, right as "Mitochondria with ER contact", as there is a membrane tube present at the interface of these two organelles.

      The EM data were analysed blinded to the genotypes. This is noted in the methods section.

      3) There is a controversy in the field on the role of PDZD8: some papers show its involvement in ER-mitochondria contacts, others in ER-lysosome contacts. The authors should discuss this point in more details. Moreover, the authors should localize the protein in Drosophila neurons; is the protein associated with mitochondria or endo/lysosomes?

      We recognize that there is some debate in the field over the localization and role of PDZD8. However, since there is currently no antibody against the Drosophila protein and the sequence is sufficiently divergent such that antibodies against the mammalian protein will not recognize the fly protein, we are not well-positioned to determine the localization of Drosophila pdzd8. Consequently, we will expand our discussion to reflect the differing views.

      We can offer instead to quantify the localization of mouse PDZD8 in our newly generated NIH-3T3 Pdzd8-Halo knock in line to help resolve the controversy regarding the location(s) and function(s) of mammalian Pdzd8.

      4) The authors should specify in more details how the different quantifications were performed. For instance Fig 1G: how many samples were quantified (i.e. how many flies, and how many neurons); what is compared? Fields-of-view, neurons, flies...?

      Further details have been added to the figure legends 1G (now H), 4I, 5 and Fig S2.

      **Minor point:**

      1)Could the authors show the SIM images Fig1F together with the binarized images.

      These images have been added to Figure 1 and the legend and text updated accordingly.

      2) It is surprising to see that data otherwise similar are represented with so many different types of graph (For instance Fig 5, bar graph, box-plot, violin plot). Why individual data points are not always present on the graphs?

      The graphs will be redrawn using more consistent representations once the data for the revisions has been gathered.

      3) The way that data are presented is sometimes odd: for instance, line 101, the authors wrote "To establish that MERCs were decreased...". This would imply that they knew the result before performing the experiment. And later, line 103 "Accordingly...".

      These sentences have been rephrased “To determine whether MERCs were decreased..” and “These results showed the…”

      Reviewer #3 (Significance (Required)):

      This study about the role of pdzd8 is timely. The functional description of inter-organelle contacts is a hot topic in cell biology. There are several recent reports describing the identification of pdzd8 role in inter-organelle contact formation. This manuscript provides data on the role of pdzd8 in a whole organism and expands our understanding of this protein.

      My expertise: inter-organelle contacts (human cells)

    2. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #3

      Evidence, reproducibility and clarity

      This manuscript entitled "Decreasing pdzd8-mediated mitochondrial-ER contacts in neurons improves fitness by increasing mitophagy" by Hewitt and collaborators describes the role of the Drosophila ortholog of PDZD8 in ER-mitochondria contacts in neurons and the physiological consequence of pdzd8 loss. The authors show that ER-mitochondria contacts are reduced in fly neurons expressing a pdzd8-RNAi construct. Decreasing pdzd8 expression in neurons was accompanied by a slowed age-associated decline in locomotor activity, and an increased lifespan. In presence of mitochondrial toxins, neurons deficient for pdzd8 were protected. Finally, the authors showed that pdzd8 silencing increased mitophagy in aged neurons, and protected against neurodegeneration in a model of Alzheimer's disease.

      Major points:

      1)There are important controls that are missing. RNAi expression often affects off-target genes which could unfortunately modify the observed phenotypes. The authors should verify that a) the phenotypes observed by RNAi-mediated pdzd8 silencing can be rescued by the expression of an RNAi-insensitive pdzd8 construct (the authors should verify the rescue of the most crucial phenotypes described in the manuscript); b) the RNAi-LacZ-line that they use as control in the paper does not behave differently from a WT line, which could be induced by an off-target effect of the RNAi-LacZ (again with the most crucial phenotypes).

      2)Did the author analyzed their EM data in a blinded-way to minimize subjective bias? This type of analysis is complicated by the manual annotation of ultrastructures, which is by nature subjective. For instance, this reviewer would have annotated the two mitochondria in the middle of Fig 1B, right as "Mitochondria with ER contact", as there is a membrane tube present at the interface of these two organelles.

      3)There is a controversy in the field on the role of PDZD8: some papers show its involvement in ER-mitochondria contacts, others in ER-lysosome contacts. The authors should discuss this point in more details. Moreover, the authors should localize the protein in Drosophila neurons; is the protein associated with mitochondria or endo/lysosomes?

      4)The authors should specify in more details how the different quantifications were performed. For instance Fig 1G: how many samples were quantified (i.e. how many flies, and how many neurons); what is compared? Fields-of-view, neurons, flies...?

      Minor point:

      1)Could the authors show the SIM images Fig1F together with the binarized images.

      2)It is surprising to see that data otherwise similar are represented with so many different types of graph (For instance Fig 5, bar graph, box-plot, violin plot). Why individual data points are not always present on the graphs?

      3)The way that data are presented is sometimes odd: for instance, line 101, the authors wrote "To establish that MERCs were decreased...". This would imply that they knew the result before performing the experiment. And later, line 103 "Accordingly...".

      Significance

      This study about the role of pdzd8 is timely. The functional description of inter-organelle contacts is a hot topic in cell biology. There are several recent reports describing the identification of pdzd8 role in inter-organelle contact formation. This manuscript provides data on the role of pdzd8 in a whole organism and expands our understanding of this protein.

      My expertise: inter-organelle contacts (human cells)

    3. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #2

      Evidence, reproducibility and clarity

      Hewitt et al. describe and characterize for the first time the ortholog of pdzd8 in Drosophila melanogaster. In accordance with pdzd8's previously described function as a member of mitochondrial-ER contact sites (MERCs) the authors show reduced MERCs upon RNAi mediated depletion of pdzd8 via TEM, SIM and a split-GFP based contact site sensor. Pdzd8 depletion results in the increased life span as well as improved locomotor activity in aging flies while increase of MERCs with a synthetic tether accelerates the age-related declines in survival and locomotion. Moreover, pdzd8 depleted flies are more resistant against mitochondrial toxins. The authors correlate these protective effects of pdzd8 knockdown with an increase in mitophagy using a mitophagy sensor and describe a rescue of locomotor defects in an Alzheimer disease fly model by pdzd8 depletion.

      Major comments:

      1.The authors quantify the number of MERCs in thin sections of TEM (Fig 1B and C). It would add to the paper if the authors would show a representative reconstruction of the quantified somata, as a 3D reconstruction would visualize ER-Mito contacts more reliable than thin sections.

      2.The authors quantify MERCs in pdzd8 KD also by SIM (Fig1F, G). However, they quantify the number of MERCs in epidermal cells while they also show SIM images of larval neurons (Fig S1D). For consistency and to support their claim of MERC reduction in neurons, we ask the authors to include the quantification based on larval neurons especially as the authors show that pdzd8 is predominantly expressed in the CNS.

      3.The authors describe a decreased NMJ volume in Fig 4G. It would improve and complete the functional characterization of pdzd8 in flies if the authors can provide further data whether pdzd8 KD causes a general synaptic defect. Can the authors show morphological synaptic defects in the existing TEM data of the adult brain or provide additional ERG recordings, which would elucidate the functional consequences of pdzd8 depletion in the CNS?

      4.Hewitt et al. suggest a beneficial effect of increased turnover of mitochondria for healthy aging. To convince readers we would like to ask the following:

      a)This claim is based on their observation of increased mitophagy in pdzd8 depleted flies using one reporter (Fig 5). Can the authors support their data with an alternative method as this is one of the key claims of the manuscript?

      b)An increased turnover of Mitochondria would also suggest that there are more "young" mitochondria present in the pdzd8 KD neurons. Can the authors experimentally address that?

      c)Furthermore, we would like to ask the authors to use also the MERC tether as control in the mitophagy assay. This would allow further conclusions about the role of the mitophagy, its protective effect during aging and the role of MERCs in this process.

      5.In Fig6 A,B the authors should include also the pdzd8 KD to support their claim that the rescue of climbing defects correlates with an reduction of MERCs. Moreover, it would be beneficial for their final conclusion, if the authors could show that increases mitophagy in the background of Ab42 expressing flies.

      Minor comments:

      1.Can the authors add to the figure legend of Fig 1F how the ER and Mitochondria were labeled?

      2.Error bars should be added in the quantification of MERCs in Fig1C.

      3.A reference to Supplementary Fig S1D is missing in the main text.

      4.Can the authors label the individual genotypes in Fig S3C and 4F?

      5.Can the author specify which brain region they imaged in Fig 5C?

      6.Are the ATP levels normalized to ADP in Fig S3D? Can the authors specify in the figure and figure legend to what ATP was normalized?

      7.Please sort the supplementary figures in accordance to their reference order in the text.

      Significance

      The authors present here novel insights about the functional role of a new member of the MERCs, pdzd8, using RNAi mediated depletion and Drosophila melanogaster as a model system. As MERCs receive more attention especially in the context of their potential role in neurological diseases, the author's manuscript will be of high interest to the scientific community. The in vivo model combined with multiple different technical approaches add to the significance of the paper. There are some controls and additional experiments that are required to support the author's main claims and complete the functional characterization of pdzd8 (see major comments).

      Field of expertise: neuroscience, fly genetics, neurodegeneration.

    4. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #1

      Evidence, reproducibility and clarity

      Summary:

      Provide a short summary of the findings and key conclusions (including methodology and model system(s) where appropriate). Please place your comments about significance in section 2. The authors present an in vivo analysis of pdzd8 (CG10362) and a synthetic ER-mitochondria tether in the regulation of locomotor activity, lifespan, and mitochondrial turnover of Drosophila melanogaster, using basic bioinformatics, RNAi, SPLICS, imaging and microscopies observations (i. e. TEM, SIM), fly lines, and a representative AD fly disease model, etc. The research methodologies were detailed in good order. The model system employed was suitable to address the research topic. The manuscript was written in a clear language and statistical analysis were correctly applied.

      Major comments:

      -Are the key conclusions convincing?

      Yes. The results/conclusions are logical and provide an overview of Pdzd8 in the regulation of mitochondrial quality control and neuronal homeostasis.

      -Would additional experiments be essential to support the claims of the paper? Request additional experiments only where necessary for the paper as it is, and do not ask authors to open new lines of experimentation.

      No. Experiments were generally well performed, and all the data support the conclusions.

      -Are the suggested experiments realistic in terms of time and resources? It would help if you could add an estimated cost and time investment for substantial experiments.

      No suggested experiments needed.

      -Are the data and the methods presented in such a way that they can be reproduced?

      Yes. The authors have followed proper experimental design and methods have been described in sufficient detail.

      -Are the experiments adequately replicated and statistical analysis adequate?

      Yes, they are.

      Minor comments:

      -Specific experimental issues that are easily addressable.

      No comment.

      -Are prior studies referenced appropriately?

      Yes. The relevant literatures have been cited appropriately.

      -Are the text and figures clear and accurate?

      1.Please pay attention to the correct spelling of the described protein name (Pdzd8) and gene name (should be in 'italic') throughout the manuscript, i. e. line 36, 98, and 556, etc.

      2.In figure 1C and its figure legend, please state what the numbers "201" and "195" stand for.

      3.Your data needs to be converted the lowercase letter "x" to math symbol "×" when representing times sign, i. e. line 523, 5x, etc.

      -Do you have suggestions that would help the authors improve the presentation of their data and conclusions?

      No comment.

      Significance

      -Describe the nature and significance of the advance (e.g. conceptual, technical, clinical) for the field.

      Discoveries from this study include 1) characterization of the tethering protein Pdzd8 in Drosophila melanogaster, and 2) shed light on a possible way on how to enhance mitochondrial quality control and to help promote healthy aging of neurons by manipulating MERCs.

      -Place the work in the context of the existing literature (provide references, where appropriate).

      With this manuscript, the authors present a straightforward but sound piece of scientific research, with the intent to illustrate the consequences of neuronal depletion of pdzd8 in Drosophila melanogaster. Since Pdzd8 plays specific functions in ER-mitochondrial tethering complexes and dysregulations of MERCs are damaging to neurons, this protein represents a good potential target. In this context the characterization of Pdzd8 should represent an interesting starting point. To this purpose, the gene was knockdown and the tether construct was recombinantly produced. The fly lines were then subjected to analysis both at the organismal and at the cellular level.

      -State what audience might be interested in and influenced by the reported findings. Audience might include those who are in the field of neuroscience and pharmaceutical, and benefit from an awareness of this research.

      -Define your field of expertise with a few keywords to help the authors contextualize your point of view. Indicate if there are any parts of the paper that you do not have sufficient expertise to evaluate.

      Key words in my field of expertise: Ageing, neurodegenerative diseases, Alzheimer's disease, mitophagy, NAD+, neuroprotection. My group is investigating the molecular mechanisms of ageing and age-related neurodegeneration (especially AD) using cross-species model systems, ranging from human brain samples, iPSCs, C. elegans, Drosophila melanogaster, and mice, therefore I have sufficient expertise to evaluate this paper.

      Referees Cross-commenting

      To this reviewer the key novelty of this paper was the study of the regulation of the mitochondrial-ER contact sites (MERCs) in life and health. The data indicate that MERCs mediated by the tethering protein pdzd8 play a critical role in the regulation of mitochondrial homeostasis, neuronal function, and lifespan. In a transitional perspective, this reviewer would ask to check whether this mechanism conserves in rodents or not (e.g. to to memory in the AD mice and to run lifespan in mitochondrial toxin condition). This may be to much. But will depend on the standard of the journal.

    1. Reviewer #3:

      General assessment:

      The authors arrive at a plausible model of DNA replication kinetics that reasonably fits six types of plots from fiber-combing data on Xenopus cell-free extracts, for normal and challenged cases. However, although the mechanisms postulated and the parameters inferred all seem reasonable, they rely on untested hypotheses and a single type of data (combing). To truly convince, the authors need further experiments to test specific hypothesized mechanisms. Techniques such as Repli-Seq or perhaps FORK-seq (recently developed by one of the authors here) might give direct information on the variation of initiation efficiency across the genome.

      Substantive Concerns:

      1) The authors refer to each case (MM1-5) as a unique model, but each has more complexity and defines a class of models. For example, in fitting MM1, the simplest of all the cases (and with, by far, the worst fit), the fork velocity was fixed at 0.5 kb/min. And yet the real fork velocity is described as having v ~ 0.5 kb/min. Shouldn't this also be a parameter in the fit?

      2) Under replication stress, forks can stall, giving an effectively two populations of forks, as proposed by the authors in an earlier work (Ciardo et al., Genes 2019; cf. Fig. 1). Strangely, that paper is not referred to or discussed in this manuscript. Why not?

      3) Continuous vs. discrete potential origins: The density was fixed to be random at 1 potential origin per 2.3 kb (or 1 kb in part of the paper). How robust are findings to these assumed densities? In general, there does not seem to be a huge difference between the two cases, for the type of data explored. Perhaps it is not worth looking at the discrete case here?

      4) The definition of goodness of the fit (GoF) should be made more explicitly. How is the norm calculated? There is an implicit sum - the elements should be defined explicitly. Also, the ensemble average < yexp > is not defined. More broadly, it is not clear why we need a custom GoF statistic when it would seem that standard ones (chi square, or - ln likelihood) could serve equally well. Note that those statistics (when proper normalization is used) can also work for global fits where each local fit is to a quantity with different units.

  2. Jan 2021
    1. Note: This rebuttal was posted by the corresponding author to Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Reply to the reviewers

      Overall:

      We thank the reviewers for their thoughtful comments and suggestions on how to improve the manuscript. We also thank the reviewers for describing the study as “highly significant,” “rigorous and reliable as described and can be reproduced by others,” and as “relevant to investigators working in the field of rickettsial diseases and to a broader audience studying mechanisms of intracellular parasitism and host responses.”

      In this revised manuscript we have addressed all the minor points raised by the reviewers. In regard to additional experiments, all three reviewers suggested that we perform histology of skin lesions, and in a revised manuscript we propose to thoroughly address this by performing histology at multiple time points in infected wild type and in interferon receptor-deficient mice. We will also attempt to use immunohistochemistry to identify the infected cell types in the skin and in internal organs. We will compare these findings to histology of human eschars. We feel that the reviewer comments support our contention that a manuscript containing these proposed additional experiments will be of strong significance in the field.

      Reviewer #1 (Evidence, reproducibility and clarity (Required)):

      “Rickettsial eschars are hallmarks of less severe spotted fever diseases. The underlying mechanisms involved in the formation of the eschar caused by pathogenic rickettsiae remains unknown. The authors of this manuscript studied this interesting research question by using Ifnar-/-Ifngr-/- mice and Sca2 or OmpB mutant of R. parkeri. R. parkeri probably is the best rickettsial species to study rickettsial eschar due to the clinical features of R. parkeri rickettsioses and the biosafety level required to work with it. The data presented in the manuscript are very promising. The conclusions are supported by the presented results. For the first time, this study recapitulated human eschar-like skin lesion observed in patients with R. parkeri rickettsioses in the mouse models. More interestingly, mice inoculated with Sca2 mutant of R. parkeri i.d. had less disseminated rickettsiae in tissues, which helps us to understand the mechanisms by which pathogenic rickettsiae cause systemic infection after the arthropod bite.”

      **Minor comments: **

      “1) Figure 2D, it looks likely the lethality of mice i.d. infection with R. parkeri is not dose dependent. For example, mice inoculated with 10^4 showed greater lethality compared to 10^7. The authors might want to explain it in the Discussion.”

      The reviewer is correct in observing that the lethality between different doses of R. parkeri in Ifnar-/-Ifngr-/-mice after intradermal infection is not dose dependent with the current number of mice used per group. We do not understand the reason for this, and more broadly we don’t understand the mechanism of lethality. We speculate that there could be a bottleneck; however, answering this question will require future investigations into the mechanisms of lethality that are beyond the scope of this study. To address the reviewer’s point, we now include this statement: “Degrees of lethality between different doses in Ifnar-/-Ifngr-/- mice were not significantly different from one another, and the cause of lethality in this model remains unclear.”

      “2) Line 202, innate immunity in vitro might need to be revised.”

      We agree that the previous description was vague. We changed the description to be more specific and it now reads: “…Sca2 does not significantly enhance the ability of R. parkeri to evade interferon-stimulated genes or inflammasomes in vitro.

      “3) It is unclear what is the unit of the inoculum in animal experiments, PFU?”

      Yes, it is PFU. We have now indicated this in the figure legends.

      “4) Line 36, in the study of "Reference 16", C3H/HeN mice, not B6 mice, were used.”

      We thank the reviewer for noticing this error and we have changed the text to C3H/HeN.

      “5) The conclusion on eschar will be greatly strengthened if histological analysis is included, particularly whether dermis necrosis is present or not.”

      In the revised manuscript we will perform histology on eschars in wild type and Ifnar-/-Ifngr-/- mice over time. We will also use immunohistochemistry to analyze the infected cell types and will compare this to data on human eschars. We agree that this will greatly strengthen our conclusions regarding the similarities between the mouse and human eschars.

      “6) Line 357, it is not clear what "spinfection" means.”

      We have changed this to “infection” for clarity.

      “Reviewer #1 (Significance (Required)): Several approaches employed in the study are new to the field of animal models of the rickettsioses. For example, fluorescent dextran was used to investigating the vascular damage in skin at the inoculation site; body temperature for mice infected with R. parkeri. Overall, the study is highly significant since it has answered the important questions in the research area of spotted fever rickettsioses and employed appropriate approaches. No major concerns were noticed.”

      We thank the reviewer for appreciating the significance of this work.

      **Referees cross commenting** I agree with other reviewers' comments. Thanks for the invite.”

      Reviewer #2 (Evidence, reproducibility and clarity (Required)):

      “The manuscript utilizes a new model of spotted fever rickettsiosis. Using this model, the authors have determined that knockout of the sca2 or ompB gene attenuates Rickettsia parkeri, and vaccination with the attenuated rickettsiae provides protection against virulent challenge. However, the model is far less than ideal as it has eliminated important effectors of immunity.”

      We thank the reviewer for their comments and we hope to thoroughly address their concerns. In regard to the effects of interferons on long-lasting immunity to R. parkeri, we note to the reviewer that we observed that immunized Ifnar-/-Ifngr-/- mice were completely and robustly protected from rechallenge. No lethality and no loss of body weight or temperature was observed after a rechallenge dose of 10x the LD-50. These data reveal that interferons are dispensable for long-lasting immunity to R. parkeri in inbred mice and are not important effectors of adaptive immunity to R. parkeri. This is thus the first model that can be used to investigate the factors required for adaptive immunity to R. parkeri in mice.

      If the reviewer’s comment is not referring to long-lasting adaptive immunity to R. parkeri but is instead referring to the general concept of using immunocompromised mice as models, we note that immunocompromised mice are used as models for a variety of pathogens, including many Rickettsia species (reviewed in Osterloh, Med Microbiol Immunol 2017), and Ifnar-/-Ifngr-/- mice specifically are used as models for Zika and Dengue virus infections. Unlike many other immunocompromised mice, Ifnar-/-Ifngr-/- mice do not require maintenance on antibiotics and they have no noticeable differences to wild type mice in regard to breeding or growth.

      “Manuscript also fails to recognize that there is a Amblyomma maculatum tick transmitted model of Rickettsia parkeri infection that causes an eschar and disseminated pathology”

      In the previous version of the manuscript in lines 266-269 we cited and acknowledged the reported tick transmission model in non-human primates (Banajee et al., 2015). As also noted by Reviewer 3, our model with needle inoculation is significantly less time consuming and expensive than a tick transmission model. Moreover, needle inoculation makes it feasible to precisely measure the number of bacteria that are administered, which is not true with ticks. Lastly, the tick model was described in non-human primates, which are significantly more expensive than inbred mice and are not amenable to genetic manipulation. Thus, our model provides many significant advantages over the tick model in non-human primates, including cost, time, availability of genetic mutants, and reproducibility.

      “The model that they have used is inadequately characterized. The cutaneous lesion was not evaluated histologically to determine if it features the actual characteristics of an eschar.”

      We thank the reviewer for the suggestion and as a part of our revision plan, we propose to thoroughly analyze the lesion histologically.

      “Although bacteria were found in the liver and spleen, in which macrophages are significant target, there was no evaluation of the vital organs including lung and brain nor demonstration of the target cells or pathologic lesions.”

      In previous work from our lab (Engström et al., 2019), we found that lungs of wild type mice contained similar number of infectious R. parkeri as the spleen and liver after intravenous infection. Thus, in order to be able to process more samples quickly, we did not include lungs in the experiments described here. In unreported data, we also found that organs including the brain, kidneys, and heart had no/little recoverable PFUs. As a part of our revision plan, we propose to perform immunohistochemistry in the spleen, liver, lung, and skin to identify the infected cell types. Identifying the infected cell types will reveal if the same cell types are infected in our mouse model as in humans.

      “Unfortunately, the assay of vascular permeability was applied only to the inoculation site and not to the disseminated visceral organs such as lung and brain.”

      We have performed the vascular permeability assay using internal organs alongside the skin; however, little/no fluorescence was observed in any sample. We were unable to distinguish differences between control groups or between control and experimental groups in organs from mice that were treated and untreated with the fluorescent dextran. Thus, we were unfortunately not able to apply the described vascular damage assay to organs other than the skin. We now indicate this in the revised text.

      Reviewer #2 (Significance (Required)):

      “The authors all have misrepresented the eschar as a critically important lesion whereas the patients usually do not even know i's presence until they began to develop systemic symptoms and it is a detected by a physician examining the patient.”

      We did not intend to suggest that the eschar is either more or less critically important than other features of rickettsial disease. We simply described the eschar as a “hallmark feature” of eschar-associated rickettsiosis. Additionally, as the reviewer notes, patients report systemic symptoms, and our model elicits systemic disease by R. parkeri in mice. Thus, the model we describe recapitulates both an eschar and disseminated disease and is the first mouse model for R. parkeri that exhibits both of the disease manifestations mentioned by the reviewer.

      “On line 30 the authors state that mice are the natural reservoir of Rickettsia parkeri. The references cited describe the failure of acquisition by feeding ticks, meaning that it is not a true reservoir. The reference describing animals with antibodies merely indicates exposure to a spotted fever group Rickettsia not sufficient evidence of a role as a reservoir.”

      We thank the reviewer for making this important distinction and we have altered the text to read: “…small rodents including mice have been found as seropositive for R. parkeri in the wild.”

      “In response to the request for my expertise, I have contributed a large amount of data to understanding mechanisms of immunity to rickettsiae and have developed several useful animal models of Rickettsial diseases. I also have expertise on clinical aspects of spotted fever group rickettsioses, including the eschar.”

      **Referees cross commenting**

      “This is not the first Mouse model of rickettsiosis to contain an eschar. There is a model of Rickettsia parkeri transmitted by Amblyomma maculatum ticks in which eschars occur.”

      As noted above by us and also by Reviewer 3, we cited and discussed the tick transmission model in non-human primates (Banajee et al., 2015) in the Discussion. We also note to the reviewer the many advantages of our i.d. infection model, including how it will make these experiments more widely accessible, more reproducible, less expensive, faster, and enable the infection of mice with various genetic modifications.

      Reviewer #3 (Evidence, reproducibility and clarity (Required)):

      “This manuscript reports novel observations pertinent to development in inbred mice of an eschar lesion and generalized lethal infection following intradermal infection with Rickettsia parkeri, the mice are deficient in two types of interferon receptors. This is a new observation for the murine system and expands the existing repertoire of model infections for tick-borne rickettsiae. This study also reports that Sca2-mediated actin-based motility is required for R. parkeri dissemination and provides indirect evidence that OmpB protein is involved in eschar formation, thus corroborating previous knowledge about these major surface exposed antigens of rickettsiae and host cell interactions and host responses to these organisms.”

      “The study is rigorous and reliable as described and can be reproduced by others given availability of adequate funding, access to similar facilities, strains of mice and rickettsial mutants, and technical personnel with similar skills and training. There are no ethical or technical concerns.”

      We thank the reviewer for their thoughtful comments and for appreciating the advantages of this model.

      “The main limitation of the manuscript is due to the fact that histological and immunohistochemical analysis of the eschar was not performed; therefore, it is not clear if pathological processes and features of this lesion formation are the same or related to the human pathology.”

      We thank the reviewer for this suggestion. As a part of the revision plan, we propose to perform histological and immunohistochemical analysis of the eschar and will compare these findings to reported data from humans. We will also identify the cell types infected in the skin and internal organs in wild type and Ifnar-/-Ifngr-/- mice.

      “Similarly, in an attempt to generalize (as the authors try very hard), it is not clear how these observations will be relevant to rickettsial pathogens which are responsible for more severe forms of rickettsioses (such as R. rickettsii and R. prowazekii) but are not known to cause eschar formation as a part of their clinical manifestations.”

      Our findings with Sca2 are in agreement with findings on R. rickettsii Sca2 in guinea pigs (Kleba et al., 2010), which showed that Sca2 was required for eliciting fever and an antibody response. Our work also expands on these findings by showing that sca2 mutants immunize against rechallenge and by finding reduced bacterial burdens in internal organs after intradermal infection with sca2 mutant bacteria. Thus, we believe that studying R. parkeri genes in Ifnar-/-Ifngr-/- mice can serve as a model to better understand conserved virulence genes in diverse rickettsial pathogens.

      Beyond virulence genes, we note that our model also recapitulates systemic disease including dissemination to internal organs. Thus, it provides a platform to study disease manifestations beyond the eschar that may be relevant to other rickettsial pathogens including R. rickettsii and R. prowazekii.

      Some other virulent rickettsial pathogens cause limited/no disease in WT C57Bl/6 mice, including R. akari, R. conorii, R. typhi, and O. tsutsugamushi (reviewed in Osterloh, Med Microbiol Immunol 2017). Thus, Ifnar-/-Ifngr-/- mice may potentially serve as models for these pathogens. We now include this point in the Discussion.

      “The other deficiency is due to a limited description of the Sca2 and OmpB mutants used in this study. It was necessary to locate and review previous publications by this group in order to understand the experiments conducted here and their interpretation. It would be useful to the readers if this information (a better more complete description of the mutants and their properties) is summarized in this manuscript.”

      We have now provided a more complete description of the mutants in the Introduction and Results.

      Reviewer #3 (Significance (Required)):

      *“The study is relevant to investigators working in the field of rickettsial diseases and to a broader audience studying mechanisms of intracellular parasitism and host responses.

      The study argues that difference(s) in dermal IFN signaling mechanism(s) distinguish human and murine susceptibility to R. parkeri infection. This is a very useful speculation; however, a better and deeper discussion would be helpful to demonstrate the relevance of these observations and their connection(s) to events occurring during the course of human infections. Regrettably, there are almost no citations of classic or current literature addressing these aspects of rickettsial pathogenesis and the role of IFN-dependent mechanisms beyond self-citations. Overall, the discussion includes four relatively short paragraphs, each addressing different directions of possible research, which indicates ample possible utility of this murine model; however, a more coherent and convincing discussion is desirable.”*

      We thank the reviewer for the suggestion, and we have now expanded the Discussion to address the role for IFN-dependent mechanisms in humans and mice during rickettsial infections, including classic and current literature citations.

      **Referees cross commenting**

      “I agree with the Reviewer #2 that per se this is not the first murine model reproducing eschar upon A. maculatum transmission; however, this is the first model that allows to monitor eschar formation using needle inoculation. This model can be widely used; while many labs maybe limited by their facility setup and can't afford/conduct tick transmission experiments. The authors acknowledged existing of the tick transmission model and discuss inclusion of this option in their future experiments.”

      We thank the reviewer for recognizing the many advantages of this model.

    2. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #3

      Evidence, reproducibility and clarity

      This manuscript reports novel observations pertinent to development in inbred mice of an eschar lesion and generalized lethal infection following intradermal infection with Rickettsia parkeri, the mice are deficient in two types of interferon receptors. This is a new observation for the murine system and expands the existing repertoire of model infections for tick-borne rickettsiae. This study also reports that Sca2-mediated actin-based motility is required for R. parkeri dissemination, and provides indirect evidence that OmpB protein is involved in eschar formation, thus corroborating previous knowledge about these major surface exposed antigens of rickettsiae and host cell interactions and host responses to these organisms.

      The study is rigorous and reliable as described, and can be reproduced by others given availability of adequate funding, access to similar facilities, strains of mice and rickettsial mutants, and technical personnel with similar skills and training. There are no ethical or technical concerns.

      The main limitation of the manuscript is due to the fact that histological and immunohistochemical analysis of the eschar was not performed; therefore, it is not clear if pathological processes and features of this lesion formation are the same or related to the human pathology. Similarly, in an attempt to generalize (as the authors try very hard), it is not clear how these observations will be relevant to rickettsial pathogens which are responsible for more severe forms of rickettsioses (such as R. rickettsii and R. prowazekii) but are not known to cause eschar formation as a part of their clinical manifestations.

      The other deficiency is due to a limited description of the Sca2 and OmpB mutants used in this study. It was necessary to locate and review previous publications by this group in order to understand the experiments conducted here and their interpretation. It would be useful to the readers if this information (a better more complete description of the mutants and their properties) is summarized in this manuscript.

      Significance

      The study is relevant to investigators working in the field of rickettsial diseases, and to a broader audience studying mechanisms of intracellular parasitism and host responses.

      The study argues that difference(s) in dermal IFN signaling mechanism(s) distinguish human and murine susceptibility to R. parkeri infection. This is a very useful speculation; however, a better and deeper discussion would be helpful to demonstrate the relevance of these observations and their connection(s) to events occurring during the course of human infections. Regrettably, there are almost no citations of classic or current literature addressing these aspects of rickettsial pathogenesis and the role of IFN-dependent mechanisms beyond self-citations. Overall the discussion includes four relatively short paragraphs, each addressing different directions of possible research, which indicates ample possible utility of this murine model; however, a more coherent and convincing discussion is desirable.

      Referees cross commenting

      I agree with the Reviewer #2 that per se this is not the first murine model reproducing eschar upon A. maculatum transmission; however, this is the first model that allows to monitor eschar formation using needle inoculation. This model can be widely used; while many labs maybe limited by their facility setup and can't afford/conduct tick transmission experiments. The authors acknowledged existing of the tick transmission model and discuss inclusion of this option in their future experiments.

    3. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #2

      Evidence, reproducibility and clarity

      The manuscript utilizes a new model of spotted fever rickettsiosis. Using this model, the authors have determined that knockout of the sca2 or ompB gene attenuates Rickettsia parkeri, and vaccination with the attenuated rickettsiae provides protection against virulent challenge. However, the model is far less than ideal as it has eliminated important effectors of immunity. Manuscript also fails to recognize that there is a Amblyomma maculatum tick transmitted model of Rickettsia parkeri infection that causes an eschar and disseminated pathology. The model that they have used is inadequately characterized. The cutaneous lesion was not evaluated histologically to determine if it features the actual characteristics of an eschar. Although bacteria were found in the liver and spleen, in which macrophages are significant target, there was no evaluation of the vital organs including lung and brain nor demonstration of the target cells or pathologic lesions. Unfortunately the assay of vascular permeability was applied only to the inoculation site and not to the disseminated visceral organs such as lung and brain.

      Significance

      The authors all have misrepresented the eschar as a critically important lesion whereas the patients usually do not even know i's presence until they began to develop systemic symptoms and it is a detected by a physician examining the patient.

      On line 30 the authors state that mice are the natural reservoir of Rickettsia parkeri. The references cited describe the failure of acquisition by feeding ticks, meaning that it is not a true reservoir. The reference describing animals with antibodies merely indicates exposure to a spotted fever group Rickettsia not sufficient evidence of a role as a reservoir.

      In response to the request for my expertise, I have contributed a large amount of data to understanding mechanisms of immunity to rickettsiae and have developed several useful animal models of Rickettsial diseases. I also have expertise on clinical aspects of spotted fever group rickettsioses, including the eschar.

      Referees cross commenting

      This is not the first Mouse model of rickettsiosis to contain an eschar.There is a model of Rickettsia parkeri transmitted by Amblyomma maculatum ticks in which eschars occur.

    4. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #1

      Evidence, reproducibility and clarity

      Rickettsial eschars are hallmarks of less severe spotted fever diseases. The underlying mechanisms involved in the formation of the eschar caused by pathogenic rickettsiae remains unknown. The authors of this manuscript studied this interesting research question by using Ifnar-/-Ifngr-/- mice and Sca 2 or OmpB mutant of R. parkeri. R. parkeri probably is the best rickettsial species to study rickettsial eschar due to the clinical features of R. parkeri rickettsioses and the biosafety level required to work with it. The data presented in the manuscript are very promising. The conclusions are supported by the presented results. For the first time, this study recapitulated human eschar-like skin lesion observed in patients with R. parkeri rickettsioses in the mouse models. More interestingly, mice inoculated with Sca2 mutant of R. parkeri i.d. had less disseminated rickettsiae in tissues, which helps us to understand the mechanisms by which pathogenic rickettsiae cause systemic infection after the arthropod bite.

      Minor comments:

      1)Figure 2D, it looks likely the lethality of mice i.d. infection with R. parkeri is not dose-dependent. For example, mice inoculated with 10^4 showed greater lethality compared to 10^7. The authors might want to explain it in the "Discussion".

      2)Line 202, innate immunity in vitro might need to be revised.

      3)It is unclear what is the unit of the inoculum in animal experiments, PFU?

      4)Line 36, in the study of "Reference 16", C3H/HeN mice, not B6 mice, were used.

      5)The conclusion on eschar will be greatly strengthened if histological analysis is included, particularly whether dermis necrosis is present or not.

      6)Line 357, it is not clear what "spinfection" means.

      Significance

      Several approaches employed in the study are new to the field of animal models of the rickettsioses. For example, fluorescent dextran was used to investigating the vascular damage in skin at the inoculation site; body temperature for mice infected with R. parkeri. Overall, the study is highly significant since it has answered the important questions in the research area of spotted fever rickettsioses and employed appropriate approaches. No major concerns was noticed.

      Referees cross commenting

      I agree with other reviewers' comments. Thanks for the invite.

    1. Note: This rebuttal was posted by the corresponding author to Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Reply to the reviewers

      We would like to thank the reviewers for taking the time to carefully evaluate our manuscript. The paper will be significantly improved by their suggestions, and we are grateful for their perspectives.

      To address the reviewers’ concerns, we will complete additional control experiments and revise the manuscript as detailed below.

      Reviewer #1 (Evidence, reproducibility and clarity (Required)):

      In the present work Stumpff, Reinholdt and co-workers investigate the mechanism by which micronuclei contribute to tumorigenesis. Micronuclei are classic markers of genomic instability widely used in the diagnosis of cancer, but whether they work as drivers of the process has recently attracted significant attention due to their link with chromothripsis. Here, the Stumpff/Reinhold labs have explored an interesting model to test some ideas about the role of micronuclei as drivers of tumorigenesis, based on Kif18A/p53 double KO mice. They confirm the formation of micronuclei in these animals, but find no substantial increase in survival and tumor incidence relative to p53 KO animals, despite higher incidence of micronuclei in Kif18A/p53 KO tumors. They conclude that, per se, micronuclei do not have the capacity to form tumors, regardless of p53 status. This was surprising, given the well-established role of p53 in preventing the proliferation of micronucleated cells. To shed light into this apparent paradox, they compared micronuclei from Kif18A KO cells with micronuclei generated by a number of other experimental conditions that promote formation of anaphase lagging chromosomes or generates acentric fragments. They found that micronuclei derived from Kif18A are intrinsically different from micronuclei generated by those other means and essentially showed increased accumulation of lamin B, were more resistant to rupture and preserved the capacity to expand as cells exited mitosis. Of note, they find a correlation between chromosome proximity to the poles/main chromosome mass and the different features that characterize micronuclei from Kif18A KO cells, compared with the other experimental conditions in which late lagging chromosomes are more frequent. Overall, I find this study extremely interesting, well designed and executed in a rigorous way that characterizes the consistent solid work from these laboratories over the years. I have just few minor points that I recommend to be addressed prior to publication. 1-Abstract and main text lines 70 and 100: the authors indicate that Kif18A mutant mice produce micronuclei due to unaligned chromosomes. This is correct, but at the same time misleading. The authors should clarify that although micronuclei derive from compromised congression, I was convinced from previous works (Fonseca et al., JCB, 2019) that it was their asynchronous segregation in anaphase that led to micronuclei formation. As is, a less familiar reader may conceive that misaligned chromosomes directly result in micronuclei, for example by being detached from the main chromosome mass.

      We thank the reviewer for raising this point. We agree that micronuclei form in the absence of KIF18A due to chromosome alignment defects, which reduces interchromosomal compaction and leads to asynchronous arrival of chromosomes at spindle poles during anaphase. As the reviewer suggests, micronuclei form around chromosomes that travel longer distances and arrive late to the poles. We have revised the manuscript to clarify this (Lines 12-13, 72-73, 102).

      2-Page 2, line 59: "cells entering cell division...become fragmented". It is not the cells, but the chromosomes that fragment. Please correct.

      We have revised this wording to indicate it is the chromosomes within micronuclei which fragment (Line 60-63).

      3-Page 4, line 149: "reduced survival in the Kif18A null, p53 mice". P53 what? KO, WT? Please clarify.

      We have revised this wording as suggested, to read: “reduced survival in the Kif18agcd2/gcd2, p53-/- mice,” (Line 158).

      4-Page 5, line 212: the authors refer that micronuclei were scored for absence of lamin A/C, but previously they scored it as "continuous/discontinuous". Please clarify.

      Thank you for raising this question. When we scored lamin A/C, we noted cases where lamin A/C signal was incompletely present (not fully co-localizing with the micronuclear area, as indicated by DAPI). In these infrequent cases, micronuclei were identified as having “discontinuous” lamin A/C signal and were binned with those micronuclei lacking lamin A/C, for purposes of creating a binary readout of the micronuclear envelope: either 1) “intact” (having full, completely continuous lamin A/C signatures) or 2) “ruptured” (lacking a complete micronuclear signal of lamin A/C). We will update the text and the methods to more clearly reflect this categorization (Lines 221-225; 603-607).

      5-Page 6, line 243: "Kif18A is not required for micronuclear envelope rupture". Shouldn't it be micronuclear envelope "integrity"?

      We apologize for the confusion here. The experiment performed was designed to distinguish whether micronuclear envelopes are more stable in KIF18A KO cells or if KIF18A itself is somehow required for the rupture of all micronuclear envelopes to occur. Since nocodazole-induced micronuclei were able to rupture in KIF18A KO cells at similar frequencies to those seen in control cells, the data indicate that KIF18A is not required for the process of micronuclear envelope rupture. We modified the text to improve clarity (lines 252-253).

      6-One of the most interesting results of the paper is the correlation between envelope formation in micronuclei with their respective position relative to the poles/midzone. Could the authors try to investigate causality? For instance, the authors refer to works from other labs in which MT bundles and a midzone Aurora B activity gradient might play a role in the different features associated with micronuclei envelope formation, depending on their origin. Could the authors manipulate this gradient and investigate whether it changes the outcome in terms of nuclear envelope assembly properties on micronuclei? Are there any detectable features in midzone MT organization in Kif18A KO cells that would justify the observed differences?

      We agree that this result is very interesting. However, we feel the proposed experiments would repeat previous work and are somewhat outside the purview of the present study. Elegant experiments to address Aurora’s role in preventing micronucleus formation have already been performed using genetic approaches in Drosophila neuroblasts and small molecule inhibitors in mammalian cells and Drosophila S2 cells (PMIDs: 24925910, 25877868, and 29986897). Interpreting effects of Aurora B inhibition are complicated by the many critical roles Aurora B plays in ensuring proper and faithful chromosome segregation. Thus, experiments to precisely test Aurora’s effect on micronuclear envelope stability require addition of Aurora B inhibitors on a cell-by-cell basis, administered within a narrow window of minutes during anaphase. It would require significant effort to obtain enough cells from different experimental conditions to make a meaningful comparison.

      The suggestion to investigate detectable differences or features in midzone MT organization in KIF18A KO cells is also appreciated. We have not observed gross differences in midzone microtubules in KIF18A KO cells, but we will quantitatively evaluate this and add these results to the revised manuscript.

      Reviewer #1 (Significance (Required)):

      Kif18A plays a key role in chromosome alignment, without apparently affecting kinetochore-microtubule attachments in non-transformed cells. Because they cannot establish a proper metaphase plate Kif18A KO cells enter anaphase with highly asynchronous segregation due to non-uniform chromosome distribution along the spindle axis. Consequently, some "delayed" chromosomes form micronuclei, in cell culture and in vivo. Interestingly, prior art has failed to detect any increased signs of genomic instability in Kif18A KO cells and mice, and, contrary to what would be expected based on current trends, these mice do now show any signs of increased incidence of tumors, in fact they even show some protective effect to induced colitis-associated colorectal cancer. Noteworthy, all previous experimental works pointing to a role of micronuclei as key intermediates of genomic instability in cancer relied on models in which the tumor suppressor protein p53 had been inactivated. In the present work, the authors explore the relationship between micronuclei formation and p53 inactivation by investigating tumor formation in Kif18A/p53 double KO animals (1 or 2 alleles of p53 inactivated).The reported results are timely and will attract the interest of a broad readership, while decisively contributing to shed light into an ongoing debate. I am therefore all in favor for the publication of this work in any journal affiliated with review commons, pending some minor revisions.

      Reviewer #2 (Evidence, reproducibility and clarity (Required)):

      Sepaniac and colleagues use in vivo and in vitro approaches to examine why micronuclei generated by lack of KIF18A activity do not promote tumorigenesis. The authors conclude that micronuclei in KIF18A depleted cells form stable micronuclear envelopes, which may be a result from lagging chromosomes being closer to the spindle pole when the micronuclear envelope forms. The authors further conclude that the stability of the micronuclei arising from lack of KIF18A can explain why Kif18a mutant mice do not develop tumors. These results also suggest that the consequences of micronuclei and their possible contribution to tumorigenesis depend on the context of their genesis. While the mouse model data and characterization of the stability of micronuclei generated by different insults support the conclusions, the lagging chromosome positioning data could be improved. Moreover, a number of other issues should be addressed prior to publication.

      **Major issues:**

      1.Line 153-155. The authors conclude that the slight reduction in overall survival is "due to a reduced ability of Kif18a mutants to cope with rapid tumorigenesis," but it is unclear why this would be the case. There is also an increase in micronucleated cells in thymic lymphomas from Kif18a/p53 homozygous mice (Fig. 2B)-could this not contribute? In Fig. 3C, the authors show that micronuclear rupture is similar in both Kif18a WT and mutant mice, so it seems possible that the increase in the frequency of micronuclei (Fig. 2B) coupled with a similar frequency of micronuclear rupture (Fig. 3C) could lead to the reduced survival. Then, in the discussion, the authors downplay this finding by saying (line 371) "loss of Kif18a had modest or no effect on survival of Trp53 homozygotes and heterozygotes." Why then speculate earlier in the text that loss of Kif18a reduces the ability to cope with tumorigenesis?

      We thank the reviewer for pointing out this issue. Our goal here was to try and explain why the Kif18a/p53 mutant homozygotes display a small but significant reduction in survival compared to p53 mutants, while the Kif18a mutation does not impact survival of p53 heterozygotes, which could be considered a more sensitive model for detecting decreased survival. Kif18a homozygous mutants do display a small reduction in survival shortly after birth compared to heterozygote and wild type littermates (PMID: 25824710). Thus, we can’t exclude the possibility that incompletely penetrant, postnatal lethality might be coincident with reduced fitness in surviving mutants, thus naming them more sensitive to loss of p53 loss of function. We have removed this statement form the revised text.

      However, the reviewer’s point that the combination of increased micronuclei in Kif18a/p53 homozygous mutants combined with a similar rupture rate seen in p53 mutants could also underlie or at least contribute to reduced survival is a good one. We have softened our conclusion in the Results section regarding the reduced survival of double homozygous mice (lines 158-164). We also agree that the way in which this point is addressed in the results and discussion sound contradictory. Thus, we have edited the language in the Discussion to improve consistency (lines 393-399).

      2.Related to the point above, the authors show in figure 3 that the micronuclei found in healthy tissues display infrequent membrane rupture (panel B). However, micronuclear membrane rupture in tumor tissues is much more frequent (panel C). How do the authors explain this? Do they hypothesize that the micronuclei in the tumors originate by mechanisms other than the misalignment caused by lack of KIF18A? Does KIF18A depletion cause aneuploidy due to segregation of two sisters to the same pole? If so, one could expect the tumors to be aneuploid (is this the case?) and aneuploidy has been shown by numerous groups to cause genomic instability. Such genomic instability could then explain the difference in membrane rupture.

      We agree that this is an interesting question. We plan to investigate several possible contributors to increased rupture in tumor cells in a separate study. As outlined in the Discussion (lines 443-458), we hypothesize that rupture could increase in tumor tissue due to changes in lamin expression or cytoskeletal forces in these cells. However, as the reviewer notes, differences in aneuploidy could also potentially explain the differences in membrane rupture observed in healthy (non-tumorous) and thymic lymphoma tissues. For example, an increase in chromosome number could lead to lagging chromosomes being positioned closer to the midzone in Kif18a mutant cells or, as the reviewer suggests, the micronuclei could occur in aneuploid tumors due mitotic defects other than misalignment. This may be difficult to determine unequivocally in primary cell or tissue samples. However, we do have a limited quantity of primary thymic lymphoma-derived cells and we will use these to initially investigate aneuploidy in the two genotypes. The results of these studies will be added to the final revised manuscript. In addition, we will incorporate a discussion of how aneuploidy may increase rupture frequency in tumors into the revised manuscript.

      3.The authors conclude that lagging chromosomes in KIF18A KO cells are found closer to the main chromatin mass. The Stumpff lab showed in a 2019 JCB paper that KIF18 KO cells have a chromosome alignment defect and as a result during anaphase the chromosomes can be scattered rather than forming the tight, uniform mass that is observed in WT cells. The scattering of kinetochores resulting from this phenotype could affect the value of "Avg Chromosomes Distances" in Fig 7B and the normalized distance in the KIF18A KO cells. Therefore, live-cell imaging experiments would be helpful to resolve this and possibly strengthen this conclusion. RPE1 cells with fluorescently tagged CENP-A and centrin could be used to ensure that the lagging chromosomes will not rejoin the main nucleus. Moreover, these cells could be used for correlative live-fixed cell experiments in which fixed cell analysis following micronucleus formation could be used to show that chromosomes that lag farther away from the spindle pole are more likely to have defective micronuclear envelopes.

      The reviewer’s concern that the unalignment phenotype, characteristic of KIF18A KO cells, may impact the value of average chromosome distances used to set a threshold for chromosomes meeting our definition of lagging is valid. To address this, we analyzed the standard deviations for chromosome-to-pole distances within half spindles of KIF18A KO and nocodazole-washout treated anaphase cells as a way to compare chromosome scattering in these two conditions. This analysis revealed no significant difference between the standard deviations of chromosome positions in the two groups, suggesting that scattering is similar in nocodazole treated and KIF18A KO cells. We have included these data in the manuscript (Line 351-356, and additional data added to Figure S2C).

      In order to further strengthen this conclusion, we are certainly willing to attempt the live cell imaging experiments suggested by the reviewer. We would like to point out that the frequency of micronucleus formation in the KIF18A KO cells is relatively low compared to the frequency seen after other experimental treatments (~7% of divisions result in a micronucleus). Thus, a large number of individual cells would need to be imaged with relatively high temporal resolution to make conclusions about the effects of chromosome position on micronuclear envelope formation (such analyses are not possible with the live data sets we currently have, where cells were imaged every 2 minutes). This difficulty led us to perform these measurements in synchronized and fixed cells to begin with.

      4.Based on the Fonseca et al. 2019 JCB paper (video 2), micronuclei from KIF18A KO do not exclusively arise from lagging chromosomes. Instead, chromosomes can also escape the main chromatin mass after segregation and subsequently be excluded from the main nucleus. It would be important to know what fraction of the micronuclei in KIF18A KO cells arise via lagging chromosomes. Since Aurora B and/or bundled microtubules at the spindle midzone are believed to prevent proper nuclear envelope formation, chromosomes that properly segregate but later become separated from the main nucleus would be more likely to form proper micronuclear envelopes than those arising from lagging chromosomes. The correlative microscopy experiment suggested in the previous point could allow differentiation between these two routes to micronucleus formation.

      The reviewer is correct that we did occasionally see chromosomes escape the main chromatin mass after segregation in the Fonseca et al., 2019 study referenced. We did not quantify the frequency of these events in that study, but they were rare. To address this quantitatively, we have measured the incidence of micronuclear formation around lagging chromosomes and chromosomes that escape the main chromatin mass after segregation in videos of KIF18A KO cells. We find that when micronuclei form in these cells, they form around lagging chromosomes 98% (46 out of 47 events) of the time. These data were derived from 4 live cell imaging experiments. This information has been added to the Results section (line 328-330).

      **Minor issues:**

      1.Some parts of the manuscript are excessively wordy and some sentences are unclear or convoluted (e.g., lines 148-153 and 238-239).

      Thank you for this feedback. We have revised the text in these two locations to improve clarity (lines 159-162 and 247-248 in the revised manuscript).

      2.Lines 59-61. This sentence is formulated incorrectly. First of all, the subject of the sentence is "cells" and the verb is "can become fragmented." However, the authors mean that the DNA in the micronucleus can become fragmented (not the cells). Moreover, the way the sentence is currently formulated seems to suggested that the fragmentation occurs during cell division. However, this is not the case. Please, revise the text to make it more accurate.

      We appreciate this point and have revised this text to reflect more precise language to describe this model. It is certainly the micronucleated chromatin which may become fragmented, and this fragmentation occurs as a result of replication stress, including replication fork collapse, after an existing micronucleated cell enters a subsequent round of S or G2 phase (PMIDs: 22258507, 26017310).

      3.Lines 114-115. Please, provide references in support of this statement.

      The statement in question: “This arrest was at least partially dependent on p53, consistent with other reports of cell cycle arrest following micronucleation,” shares the same references as the sentence that follows it (Sablina 1998, Thompson and Compton, 2010; Fonseca et al., 2019). We have updated the references to appear after the first statement to make this clear.

      4.Line 153. The authors refer to Fig. 1C, but I think they mean Fig. 1B.

      Thank you, we have updated the text to read Fig 1B.

      5.Line 324. the authors find that RPE1 KIF18A KO cells have lagging chromosomes in ana/telophase 9% of the time, then say that this shows that lagging chromosomes are rare in KIF18A KO cells. However, this is a large increase compared to normal RPE1 cells, which only have 1-2% frequency of lagging chromosomes. So, they should revise the text here to say that the rates of lagging chromosomes from KIF18A KO are lower compared to the rates induced by nocodazole washout.

      This is an important distinction. We have removed this confusing statement from the revised text (lines 336-338).

      6.Line 383. The references listed here should be moved earlier and specifically after the statement summarizing the results of the studies instead of being listed after the authors' conclusion/interpretation of the data. The same issue was noted in other parts of the manuscript.

      We have corrected this error (Lines 402-408). Before final submission, we will further amend the style of the manuscript throughout to cite relevant papers after the statement summarizing the results of those studies, rather than after our interpretation of the studies.

      7.Figure 1A. In the text, the authors say they cross a Kif18a heterozygous mutant mouse with a p53 heterozygous mutant mouse, but the two mice in this figure are already heterozygous for both. Please, revise the text or depict the previous additional cross necessary to obtain the double heterozygous.

      We thank the reviewer for catching this discrepancy. We have revised the text to describe the crosses necessary to obtain the double heterozygous mice shown in the figure (lines 121-123). The gcd2 mutation in Kif18a was named due to the “germ cell depleted” phenotype it causes. These homozygous mice are therefore infertile (Czechanski et al., 2015). For this reason, heterozygous mice for each gene were crossed to achieve the necessary homozygous progeny.

      8.Figure 3A. Arrows or dotted circles outlining the micronuclei in the insets of the middle and bottom rows would be helpful since the DAPI signal in the micronuclei is low and somewhat difficult to see.

      We have updated these figures as suggested to more clearly indicate the micronuclear area.

      9.Figure 3B. Error bars should be added to the graph. Moreover, the authors noted that the differences are not significant. However, this seems surprising, given that in some cases there is a three- to five-fold difference between certain pairs. Indeed, a chi-square test using the numbers from table S1 indicated p values We appreciate this feedback on the statistical tests and comparisons among these data. The main point of these analyses is to demonstrate that tissues other than blood form micronuclei in vivo in the absence of Kif18a function and that the majority of these micronuclear envelopes are completely surrounded by Lamin A/C. The data presented in Figure 3B were obtained by counting several tissue types from a single mouse of each genotype. Thus, we do not believe that error bars are appropriate in this context. To avoid confusion, we have also removed the statistical bars which had indicated no significant differences in rupture frequency among the genotypes in each sampled tissue, as these are also probably inappropriate.

      We understand the reviewer’s point that some pairwise comparisons of the data in Table S1 indicate that they are significantly different. We originally used a Chi-square test to compare the data from all three genotypes for each tissue. Because these data did not rise to the threshold of significance necessary to reject the null hypothesis across all three genotypes within each individual tissue type, we did not think performing pairwise comparisons between only two of those genotypes was appropriate (Whitlock and Schluter, The Analysis of Biological Data, 2009). Specifically, analyses of rupture frequency for spleen, liver, and thymus tissue gave p-values above 0.05 (spleen, p = 0.35; liver, p = 0.056; thymus, p = 0.052). Thus, we did not proceed with pairwise comparisons. In contrast, the analyses of p53 effects on micronucleus levels in peripheral blood in Fig 1D utilized samples from 8 individual mice for each genotype, and are therefore more amenable to statistical comparisons. If the reviewer believes any of the details of this approach are incorrect, we are happy to revise the analyses.

      10.Figure 5G. When referring to this figure (lines 292-294), the authors talk about correlation. However, the points in this graph seem to be scattered a bit randomly.

      To address this concern, we performed a Pearson’s correlation test on the data in Figure 5G. As suspected by the reviewer, this analysis did not indicate a significant correlation, and we have removed this plot from the manuscript.

      11.Figure 6B-D. The Y-axis titles of the three graphs are a bit confusing. Please, consider revising.

      We have updated the Y-axis titles for these graphs to more accurately represent what is displayed on each plot.

      12.In Figure 7 and the text, the authors use the terms "late-lagging" and "lagging" chromosomes interchangeably, which is somewhat confusing in this context because lagging chromosome distance from the main chromosome mass is thought to contribute to defective assembly of micronuclear envelopes. It is not clear whether the authors intend to indicate, with this term, that the lagging chromosome is farther away from the main chromosome mass or that the lagging chromosome is in a "late" anaphase cell. Because this is confusing, I suggest just using the term "lagging chromosome" consistently. It could be useful to include representative images of lagging chromosomes located at different distances from the main chromosome mass. And certainly, the authors should include an example of a lagging chromosome in the KIF18A KO cells.

      We agree with the reviewer’s concern regarding confusion of these terms. We have updated the text to use the term “lagging chromosome” consistently, as the reviewer suggests. We have also updated Figure 7A to include a representative image of a lagging chromosome in a KIF18A KO cell.

      13.Figure S2A. The example in the bottom right image looks more like a chromosome bridge than a lagging chromosomes. Kinetochore staining is necessary to unequivocally identify lagging chromosomes.

      We agree with the reviewer that kinetochore staining is necessary to precisely identify lagging chromosomes. We had used these images to quickly and crudely assess the presence and frequency of potentially lagging chromosomes, observed in late-anaphase cells by eye, and for subsequent experiments where lagging chromosomes were measured, repeated these experiments with proper staining of poles and kinetochores to make precise, quantifiable assessments. Reviewer #2 (Significance (Required)):

      Based on the previous knowledge on the factors that cause abnormal assembly of the micronuclear membrane, the results presented in this study were somewhat predictable. However, these findings will add to the knowledge of how micronuclei form and the potential factors that lead to micronuclear membrane rupture. Previous studies investigating micronucleus behavior have focused on micronuclei arising via merotelic kinetochore mis-attachments. These mis-attachments lead to formation of micronuclei close to the spindle midzone. In the present study, instead, the micronuclei arising from lack of KIF18A activity form farther away from the spindle midzone. The results presented here suggest that the positioning of these micronuclei farther away from the midzone enables assembly of a more stable micronuclear membrane that will be less likely to rupture during the following cell cycle. A recent study showed that the microtubule bundles in the spindle midzone interfere with micronuclear membrane assembly. Based on this, it is not surprising that micronuclei forming away from the spindle midzone (like those resulting from lack of KIF18A activity) assemble more normal membranes. Although somewhat expected, this study provides the actual data in support of this phenomenon. This study will be of interest to cell biologists interested in cell division and genomic instability. My research has focused on cell division, aneuploidy, and chromosomal instability for nearly thirty years. Therefore, I believe I am fully qualified to evaluate this manuscript.

      **Referees cross-commenting**

      My areas of expertise do not include nuclear membrane structure and function. Therefore, I encourage the authors to consider the comments of reviewer #3 for issues related to reliable quantification of micronuclear membrane rupture.

      Reviewer #3 (Evidence, reproducibility and clarity (Required)):

      **Summary** Sepaniac et al demonstrate that loss of KIF18a, a motor protein required for proper chromosome congression and chromatin compaction during mitosis, is insufficient to drive tumor development in mice although it does increase the frequency of micronuclei (MN), nuclear compartments that form around broken or missegregated chromosomes, in both normal and tumor tissue. MN are thought to increase genome instability and metastasis by undergoing DNA damage and activating innate immune signaling after irreparable nuclear membrane rupture. The authors use a non-transformed human cell line, hTERT-RPE-1, with KIF18a knocked out to demonstrate that MN formed as a result of KIF18a loss have more stable nuclear membranes than MN generated by other methods. They go on to correlate this increased stability with increased chromosome proximity to the main chromatin mass during nuclear envelope assembly and increased chromatin decompaction by a combination of fixed and live cell imaging.

      **Major Comments**

      1.This study relies heavily on the use of lamin A loss or discontinuity to identify ruptured micronuclei. Although the authors validate this marker against "leakage" of the soluble nuclear protein mCherry-NLS, there are several lines of evidence suggesting that lamin A loss or disruption is not a reliable reporter. In figure S3C, the top two panels of intact MN in the KIF18KO appear ruptured based on the gH2AX labeling, yet have significant levels of lamin A and are labeled as intact. In figure 4D, the rate of MN rupture after nocodazole release (60% ruptured in 2 hours) is much faster than that reported in other papers (40-60% in 16-18 hours, Liu et al; 60% in 16 hours; Hatch et al). In addition, images in Hatch et al, 2013 show lamin A localizing to both intact and ruptured MN and anecdotal information in the field suggests that lamin A localization is not a reliable reporter.

      These discrepancies may be due to how the authors' define "mCherry-NLS leakage", which needs to be defined in the methods as previous studies have demonstrated that MN frequently have delayed or reduced nuclear import even though the membrane is intact. Regardless, the authors need to provide compelling independent evidence that lamin A loss and disruption faithfully recognize ruptured MN by either validating this marker against additional rupture reporters, such as Lap2, LBR, or emerin accumulation, or by repeating key experiments in cells expressing mCherry-NLS.

      Our decision to use lamin A/C as a reporter was based on its use as a marker for micronuclear envelope presence in prior studies (Hatch, 2013; Liu, 2018). We were unaware of anecdotal information in the field that suggests that lamin A localization may not be a reliable reporter.

      However, we think we understand the reviewer’s point to be that although it is clear from prior studies that gaps in the nuclear lamina are a known predictor of micronuclear rupture, these gaps can persist for some time before rupture has actually occurred. We agree that this is an important distinction and thank the reviewer for raising these questions.

      As the reviewer notes, we performed control experiments to address this issue and validate the use of lamin A/C as a marker of micronuclear envelope rupture. Our approach involved correlating lamin staining with the localization of mCherry-NLS signal to the micronucleus (Figure S1). We found that these signals correlated well. As the reviewer points out, this analysis in fixed cells could be misleading in cases where nuclear import is reduced, but the micronuclear envelope is intact. If this were a significant contributor, we may have expected to see greater instances of micronuclei that exhibit continuous lamin A/C signal but lack nuclear localization of mCherry-NLS. However, we found this combination was rare among the KIF18A and RPE1 nocodazole washout treated cells (2%, or 1 of 46 micronuclei had continuous lamin A/C while lacking mCherry-NLS). We admit that this assumption may be oversimplified though.

      The reviewer’s point about the timing of nocodazole treatment and washout something we have definitely considered. We note that prior studies have used differing time points after nocodazole treatment and release. For Hatch et al., 2013: U2OS cells were treated for 6 hours with nocodazole and then subjected to mitotic shakeoff, 48% of micronuclei were ruptured after 6 hours and ~60% were ruptured after 16 hours. Similarly, in Liu et al., 2018 60% of micronuclei were ruptured 16 hours post mitotic shake off and nocodazole release. While these results suggest that rupture increases with time after mitosis, it isn’t clear how early rupture may occur. In other words, does it take several hours in G2 before nearly half of micronuclei rupture or do many of these rupture shortly after cell division?

      We note that other explanations could also potentially contribute to the differences in rupture rates reported in our study compared to those in previous publications. For example, we used a short nocodazole treatment (2 hrs) compared to the longer treatments (6 hrs) used in previous studies. We did this originally in order to produce a similar percentage of micronucleated cells as is seen in KIF18A KO cell populations. However, the difference in nocadozole treatment length could potentially influence the types and frequencies of kinetochore microtubule attachments formed. For example, if centrosomes stay closer together in mitotic cells after short nocodazole treatments, this could increase the number of abnormal attachments (e.g. PMID: 22130796). Such an effect would be expected to increase the frequency of lagging chromosomes and/or potentially produce more lagging chromosomes within the anaphase midzone.

      The best way to address this issue would be to repeat our analyses of mcherry-NLS in live cells to track the formation and rupture of micronuclei. We did attempt these live imaging experiments previously and have found this experiment challenging due to: 1) the low frequency of micronuclear formation in KIF18A KO cell population; 2) a low transfection/expression efficiency for the mCherry-NLS plasmid in RPE1 cells, and 3) photobleaching of the mCherry-NLS plasmid. For these reasons, we transitioned into fixed cell experiments for the mCherry-NLS reporter. However, we propose to troubleshoot this assay and attempt to obtain the data necessary to determine when rupture is occurring. In addition, we will use additional markers to investigate micronuclear envelope stability, as the reviewer has suggested.

      Regardless of the outcome of these experiments, we have measured a clear difference between the lamin deposition within micronuclear envelopes of KIF18A KO cells compared to those formed following other insults. Lamin recruitment is well established as a predictor of nuclear envelope stability. If necessary, we could alter the text to indicate that the presence of lamin A/C and B within micronuclear envelopes of KIF18A KO cells are indicative of nuclear envelope stability, and that this is distinct from the lamin profiles of micronuclei in cells subjected to nocodazole-washout.

      2.Micronuclei in tumor sections and other dense tissues can appear very similar to other types of chromatin, including blebs from adjacent nuclei and dead cells. To verify that the quantified structures are bona fide micronuclei, the authors need to include a marker for the cell boundary. This is especially critical in the lamin a stained tumor sections with heterogenous lamin A protein expression.

      We appreciate the point this reviewer raises and we carefully considered accurate identification of micronuclei in tissues. Three optical sections were collected from each sample. During analyses, we scrolled through the ~2-micron thick sections to exclude chromatin bodies connected to an out-of-plane nucleus or nuclear bleb. We have a limited number of sectioned and preserved thymic lymphoma tissues remaining. We will use these samples to reassess micronuclear frequency in the presence of a cell boundary marker.

      3.Figure 4 compares MN rupture frequency between cells treated with different inducers of micronuclei - KIF18A KO, nocodazole release, and irradiation. These treatments have different effects on the cell cycle: KIF18A causes minor delays, nocodazole arrests cells in mitosis, and g-IR likely causes delays in S and G2. Since MN rupture frequency increases with the duration of interphase, the authors need to assess rupture frequency at similar time points after mitosis for all three conditions. One way to accomplish this would be to repeat this experiment and analyze cells collected by mitotic cells by shake-off prior to fixation and labeling.

      We appreciate this point regarding differences in mitotic timing. Since micronuclear rupture frequency increases with time in interphase, we would expect the MN in KIF18A KO cells to exhibit the highest level of rupture if cell cycle timing were the primary variable affecting stability in our experiments. KIF18A KO cells are asynchronously dividing, and the micronuclei examined in populations of those cells could have been generated at any time. We do not have the same type of temporal control of these events as we do with drug treatment. In contrast, the vast majority of the MN in nocodazole washout cells would not have been in interphase for more than 1.5 hours in our experiments, yet showed increased lamin A/C defects. RPE1 cells treated with MAD2 siRNA knockdown, which do not experience mitotic delays (PMID: 9606211; 15239953), also showed greater frequencies of micronuclear envelopes which lacked lamin A/C compared to those arising in KIF18A KO cells.

      To further address this question, we could attempt a mitotic shake-off assay, however, we believe that the formation of micronuclei, as a percentage in the population of KIF18A KO cells, will be limiting in these experiments.

      As an alternative, we propose to use live cell imaging to follow micronuclear formation and rupture, as described above in reference to point 1.

      **Minor Comments**

      1.In figure 6A, it is unclear when the videos start and how micronuclei are selected for analysis. Do the micronuclei have to be continuously visible from the time they missegregate? Do the videos all start at the same time point during mitosis or is it contingent on when the MN appears separated from the main nucleus? One concern is that a consistent delay in micronucleus appearance in the nocodazole treated cells could artificially decrease the amount of MN expansion observed.

      We thank the reviewer for these questions. The individual micronuclei did not need to be continuously visible from the time that they missegregated, though the majority were. When a micronucleus was not sufficiently in the plane of focus for an accurate area measurement, the individual measurement at that time point was not collected. In cases where one or more frames which were not measurable, a micronucleus was only included in the final data set if it was 1) the only micronucleus present in the daughter cell or 2) easily identifiable to be the same micronucleus. Measurements were taken until the micronuclear area reached an equilibrium for several frames. Final fold change in area was established by dividing final area measurements by initial measurements.

      The initial measurement for each micronucleus taken from the videos all start at the same relative point during mitosis, which is just after chromosome segregation has occurred.

      2.In figure 7A, it is difficult to identify the "lagging" chromosome in the top panel. It would be helpful to label the chromosome that becomes the MN, or ideally, to include a video or still images to demonstrate how micronuclei form in the KIF18A KO cells.

      We have updated the images in Figure 7A to include an example of a lagging chromosome in a KIF18A KO cell. We will also include a more explicit reference to our previous study (Fonseca et al., 2019), which described how micronuclei form around lagging chromosomes in KIF18A KO RPE1 cells.

      3.The two image panels in figure 7A are imaged at significantly different times during anaphase (early anaphase on bottom versus late anaphase/telophase on top). A better comparison would be between two cells at the same time point in anaphase.

      We have updated the images in Figure 7A to compare cells at similar stages of anaphase. In our quantification of lagging chromosomes, we also accounted for anaphase-timing differences by normalizing all measurements within each half-spindle.

      Reviewer #3 (Significance (Required)):

      In this study, the authors identify chromatin decondensation in micronuclei as a new predictor of membrane stability. Although these results are correlative, if their micronucleus rupture results can be validated as described in major comment 1, this study would advance our understanding of the micronucleus rupture mechanism by linking mitotic spindle location, chromatin decondensation, and lamin B1 protein recruitment. This would provide needed support to a current model in the field that micronucleus stability is largely determined during nuclear envelope assembly. In addition, if KIF18a loss generates stable micronuclei at high frequency, it will become a critical system for testing MN rupture hypotheses in the field. Thus, this work would be of significant interest to cell biologists working on nuclear envelope structure and function, chromosome organization, and mitosis. I include myself in this group as a cell biologist studying nuclear envelope structure and function with an expertise in membrane dynamics. The authors also find that mice mutant for KIF18a have increased micronucleation in normal tissues but not increased tumor initiation. They hypothesize that this is due to the low rupture frequency of KIF18a-induced MN, however their data cannot reject the null hypothesis that the small increase in MN they see in KIF18a mutant mice would be insufficient to induce tumorigenesis even if rupture frequency was high. Thus the significance of their finding that micronucleation is not sufficient for cancer progression is unclear. However, the thorough analysis of micronucleation and rupture in several healthy tissues as well as a tumor model in KIF18 mutant mice would be of interest to both pathologists and cancer researchers focused on mechanisms of genome instability. These types of experiments are critical to determine how micronuclei contribute to cancer progression and the quantifications presented in this paper are truly impressive.

      We appreciate this reviewer’s enthusiasm for our work and acknowledge that we cannot definitively conclude that micronuclear envelope stability explains why Kif18a mutant mice do not form tumors. However, it is interesting to note that the micronuclear loads measured using a peripheral erythrocyte assay are similar in Kif18agcd2/gcd2 mutant mice (0.6% micronucleated erythrocytes, of total erythrocytes) and ATMtm1 Awb/tm1 Awb mutant mice (0.6% of micronucleated erythrocytes, of total) (Fonseca et al., 2019). Yet, the tumor frequency in these two models is dramatically different: Kif18agcd2/gcd2 mutant mice do not spontaneously form tumors – while the majority of ATMtm1 Awb/tm1 Awb mutant mice do develop thymic lymphoma tumors between 2 and 4 months (Barlow, 1996). It is not clear how much micronuclei contribute to tumorigenesis in the ATM mutant model, but this comparison does suggest that the increase in MN seen in Kif18a mutants may be physiologically relevant. We have added this information to the revised text (lines 125-130).

      **Referees cross-commenting**

      I agree with the concerns raised by the other 2 reviewers, especially their comments about the need to clarify the mechanism of chromosome lagging versus chromosome congression and compaction. I think that all of these suggestions, though, are contingent on them being able to reproduce their micronucleus rupture results with a better marker of nucleus integrity. I strongly believe that additional validation of lamin A as a micronucleus rupture marker will demonstrate that it is unreliable, based both on our own observations in RPE-1 cells and the images they show

    2. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #3

      Evidence, reproducibility and clarity

      Summary

      Sepaniac et al demonstrate that loss of KIF18a, a motor protein required for proper chromosome congression and chromatin compaction during mitosis, is insufficient to drive tumor development in mice although it does increase the frequency of micronuclei (MN), nuclear compartments that form around broken or missegregated chromosomes, in both normal and tumor tissue. MN are thought to increase genome instability and metastasis by undergoing DNA damage and activating innate immune signaling after irreparable nuclear membrane rupture. The authors use a non-transformed human cell line, hTERT-RPE-1, with KIF18a knocked out to demonstrate that MN formed as a result of KIF18a loss have more stable nuclear membranes than MN generated by other methods. They go on to correlate this increased stability with increased chromosome proximity to the main chromatin mass during nuclear envelope assembly and increased chromatin decompaction by a combination of fixed and live cell imaging.

      Major Comments

      1.This study relies heavily on the use of lamin A loss or discontinuity to identify ruptured micronuclei. Although the authors validate this marker against "leakage" of the soluble nuclear protein mCherry-NLS, there are several lines of evidence suggesting that lamin A loss or disruption is not a reliable reporter. In figure S3C, the top two panels of intact MN in the KIF18KO appear ruptured based on the gH2AX labeling, yet have significant levels of lamin A and are labeled as intact. In figure 4D, the rate of MN rupture after nocodazole release (60% ruptured in 2 hours) is much faster than that reported in other papers (40-60% in 16-18 hours, Liu et al; 60% in 16 hours; Hatch et al). In addition, images in Hatch et al, 2013 show lamin A localizing to both intact and ruptured MN and anecdotal information in the field suggests that lamin A localization is not a reliable reporter.

      These discrepancies may be due to how the authors' define "mCherry-NLS leakage", which needs to be defined in the methods as previous studies have demonstrated that MN frequently have delayed or reduced nuclear import even though the membrane is intact. Regardless, the authors need to provide compelling independent evidence that lamin A loss and disruption faithfully recognize ruptured MN by either validating this marker against additional rupture reporters, such as Lap2, LBR, or emerin accumulation, or by repeating key experiments in cells expressing mCherry-NLS.

      2.Micronuclei in tumor sections and other dense tissues can appear very similar to other types of chromatin, including blebs from adjacent nuclei and dead cells. To verify that the quantified structures are bona fide micronuclei, the authors need to include a marker for the cell boundary. This is especially critical in the lamin a stained tumor sections with heterogenous lamin A protein expression.

      3.Figure 4 compares MN rupture frequency between cells treated with different inducers of micronuclei - KIF18A KO, nocodazole release, and irradiation. These treatments have different effects on the cell cycle: KIF18A causes minor delays, nocodazole arrests cells in mitosis, and g-IR likely causes delays in S and G2. Since MN rupture frequency increases with the duration of interphase, the authors need to assess rupture frequency at similar time points after mitosis for all three conditions. One way to accomplish this would be to repeat this experiment and analyze cells collected by mitotic cells by shake-off prior to fixation and labeling.

      Minor Comments

      1.In figure 6A, it is unclear when the videos start and how micronuclei are selected for analysis. Do the micronuclei have to be continuously visible from the time they missegregate? Do the videos all start at the same time point during mitosis or is it contingent on when the MN appears separated from the main nucleus? One concern is that a consistent delay in micronucleus appearance in the nocodazole treated cells could artificially decrease the amount of MN expansion observed.

      2.In figure 7A, it is difficult to identify the "lagging" chromosome in the top panel. It would be helpful to label the chromosome that becomes the MN, or ideally, to include a video or still images to demonstrate how micronuclei form in the KIF18A KO cells.

      3.The two image panels in figure 7A are imaged at significantly different times during anaphase (early anaphase on bottom versus late anaphase/telophase on top). A better comparison would be between two cells at the same time point in anaphase.

      Significance

      In this study, the authors identify chromatin decondensation in micronuclei as a new predictor of membrane stability. Although these results are correlative, if their micronucleus rupture results can be validated as described in major comment 1, this study would advance our understanding of the micronucleus rupture mechanism by linking mitotic spindle location, chromatin decondensation, and lamin B1 protein recruitment. This would provide needed support to a current model in the field that micronucleus stability is largely determined during nuclear envelope assembly. In addition, if KIF18a loss generates stable micronuclei at high frequency, it will become a critical system for testing MN rupture hypotheses in the field. Thus, this work would be of significant interest to cell biologists working on nuclear envelope structure and function, chromosome organization, and mitosis. I include myself in this group as a cell biologist studying nuclear envelope structure and function with an expertise in membrane dynamics.

      The authors also find that mice mutant for KIF18a have increased micronucleation in normal tissues but not increased tumor initiation. They hypothesize that this is due to the low rupture frequency of KIF18a-induced MN, however their data cannot reject the null hypothesis that the small increase in MN they see in KIF18a mutant mice would be insufficient to induce tumorigenesis even if rupture frequency was high. Thus the significance of their finding that micronucleation is not sufficient for cancer progression is unclear. However, the thorough analysis of micronucleation and rupture in several healthy tissues as well as a tumor model in KIF18 mutant mice would be of interest to both pathologists and cancer researchers focused on mechanisms of genome instability. These types of experiments are critical to determine how micronuclei contribute to cancer progression and the quantifications presented in this paper are truly impressive.

      Referees cross-commenting

      I agree with the concerns raised by the other 2 reviewers, especially their comments about the need to clarify the mechanism of chromosome lagging versus chromosome congression and compaction.

      I think that all of these suggestions, though, are contingent on them being able to reproduce their micronucleus rupture results with a better marker of nucleus integrity. I strongly believe that additional validation of lamin A as a micronucleus rupture marker will demonstrate that it is unreliable, based both on our own observations in RPE-1 cells and the images they show

    3. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #2

      Evidence, reproducibility and clarity

      Sepaniac and colleagues use in vivo and in vitro approaches to examine why micronuclei generated by lack of KIF18A activity do not promote tumorigenesis. The authors conclude that micronuclei in KIF18A depleted cells form stable micronuclear envelopes, which may be a result from lagging chromosomes being closer to the spindle pole when the micronuclear envelope forms. The authors further conclude that the stability of the micronuclei arising from lack of KIF18A can explain why Kif18a mutant mice do not develop tumors. These results also suggest that the consequences of micronuclei and their possible contribution to tumorigenesis depend on the context of their genesis. While the mouse model data and characterization of the stability of micronuclei generated by different insults support the conclusions, the lagging chromosome positioning data could be improved. Moreover, a number of other issues should be addressed prior to publication.

      Major issues:

      1.Line 153-155. The authors conclude that the slight reduction in overall survival is "due to a reduced ability of Kif18a mutants to cope with rapid tumorigenesis," but it is unclear why this would be the case. There is also an increase in micronucleated cells in thymic lymphomas from Kif18a/p53 homozygous mice (Fig. 2B)-could this not contribute? In Fig. 3C, the authors show that micronuclear rupture is similar in both Kif18a WT and mutant mice, so it seems possible that the increase in the frequency of micronuclei (Fig. 2B) coupled with a similar frequency of micronuclear rupture (Fig. 3C) could lead to the reduced survival. Then, in the discussion, the authors downplay this finding by saying (line 371) "loss of Kif18a had modest or no effect on survival of Trp53 homozygotes and heterozygotes." Why then speculate earlier in the text that loss of Kif18a reduces the ability to cope with tumorigenesis?

      2.Related to the point above, the authors show in figure 3 that the micronuclei found in healthy tissues display infrequent membrane rupture (panel B). However, micronuclear membrane rupture in tumor tissues is much more frequent (panel C). How do the authors explain this? Do they hypothesize that the micronuclei in the tumors originate by mechanisms other than the misalignment caused by lack of KIF18A? Does KIF18A depletion cause aneuploidy due to segregation of two sisters to the same pole? If so, one could expect the tumors to be aneuploid (is this the case?) and aneuploidy has been shown by numerous groups to cause genomic instability. Such genomic instability could then explain the difference in membrane rupture.

      3.The authors conclude that lagging chromosomes in KIF18A KO cells are found closer to the main chromatin mass. The Stumpff lab showed in a 2019 JCB paper that KIF18 KO cells have a chromosome alignment defect and as a result during anaphase the chromosomes can be scattered rather than forming the tight, uniform mass that is observed in WT cells. The scattering of kinetochores resulting from this phenotype could affect the value of "Avg Chromosomes Distances" in Fig 7B and the normalized distance in the KIF18A KO cells. Therefore, live-cell imaging experiments would be helpful to resolve this and possibly strengthen this conclusion. RPE1 cells with fluorescently tagged CENP-A and centrin could be used to ensure that the lagging chromosomes will not rejoin the main nucleus. Moreover, these cells could be used for correlative live-fixed cell experiments in which fixed cell analysis following micronucleus formation could be used to show that chromosomes that lag farther away from the spindle pole are more likely to have defective micronuclear envelopes.

      4.Based on the Fonseca et al. 2019 JCB paper (video 2), micronuclei from KIF18A KO do not exclusively arise from lagging chromosomes. Instead, chromosomes can also escape the main chromatin mass after segregation and subsequently be excluded from the main nucleus. It would be important to know what fraction of the micronuclei in KIF18A KO cells arise via lagging chromosomes. Since Aurora B and/or bundled microtubules at the spindle midzone are believed to prevent proper nuclear envelope formation, chromosomes that properly segregate but later become separated from the main nucleus would be more likely to form proper micronuclear envelopes than those arising from lagging chromosomes. The correlative microscopy experiment suggested in the previous point could allow differentiation between these two routes to micronucleus formation.

      Minor issues:

      1.Some parts of the manuscript are excessively wordy and some sentences are unclear or convoluted (e.g., lines 148-153 and 238-239).

      2.Lines 59-61. This sentence is formulated incorrectly. First of all, the subject of the sentence is "cells" and the verb is "can become fragmented." However, the authors mean that the DNA in the micronucleus can become fragmented (not the cells). Moreover, the way the sentence is currently formulated seems to suggested that the fragmentation occurs during cell division. However, this is not the case. Please, revise the text to make it more accurate.

      3.Lines 114-115. Please, provide references in support of this statement.

      4.Line 153. The authors refer to Fig. 1C, but I think they mean Fig. 1B.

      5.Line 324. the authors find that RPE1 KIF18A KO cells have lagging chromosomes in ana/telophase 9% of the time, then say that this shows that lagging chromosomes are rare in KIF18A KO cells. However, this is a large increase compared to normal RPE1 cells, which only have 1-2% frequency of lagging chromosomes. So, they should revise the text here to say that the rates of lagging chromosomes from KIF18A KO are lower compared to the rates induced by nocodazole washout.

      6.Line 383. The references listed here should be moved earlier and specifically after the statement summarizing the results of the studies instead of being listed after the authors' conclusion/interpretation of the data. The same issue was noted in other parts of the manuscript.

      7.Figure 1A. In the text, the authors say they cross a Kif18a heterozygous mutant mouse with a p53 heterozygous mutant mouse, but the two mice in this figure are already heterozygous for both. Please, revise the text or depict the previous additional cross necessary to obtain the double heterozygous.

      8.Figure 3A. Arrows or dotted circles outlining the micronuclei in the insets of the middle and bottom rows would be helpful since the DAPI signal in the micronuclei is low and somewhat difficult to see.

      9.Figure 3B. Error bars should be added to the graph. Moreover, the authors noted that the differences are not significant. However, this seems surprising, given that in some cases there is a three- to five-fold difference between certain pairs. Indeed, a chi-square test using the numbers from table S1 indicated p values <0.05 for several pairwise comparisons.

      10.Figure 5G. When referring to this figure (lines 292-294), the authors talk about correlation. However, the points in this graph seem to be scattered a bit randomly.

      11.Figure 6B-D. The Y-axis titles of the three graphs are a bit confusing. Please, consider revising.

      12.In Figure 7 and the text, the authors use the terms "late-lagging" and "lagging" chromosomes interchangeably, which is somewhat confusing in this context because lagging chromosome distance from the main chromosome mass is thought to contribute to defective assembly of micronuclear envelopes. It is not clear whether the authors intend to indicate, with this term, that the lagging chromosome is farther away from the main chromosome mass or that the lagging chromosome is in a "late" anaphase cell. Because this is confusing, I suggest just using the term "lagging chromosome" consistently. It could be useful to include representative images of lagging chromosomes located at different distances from the main chromosome mass. And certainly, the authors should include an example of a lagging chromosome in the KIF18A KO cells.

      13.Figure S2A. The example in the bottom right image looks more like a chromosome bridge than a lagging chromosomes. Kinetochore staining is necessary to unequivocally identify lagging chromosomes.

      Significance

      Based on the previous knowledge on the factors that cause abnormal assembly of the micronuclear membrane, the results presented in this study were somewhat predictable. However, these findings will add to the knowledge of how micronuclei form and the potential factors that lead to micronuclear membrane rupture. Previous studies investigating micronucleus behavior have focused on micronuclei arising via merotelic kinetochore mis-attachments. These mis-attachments lead to formation of micronuclei close to the spindle midzone. In the present study, instead, the micronuclei arising from lack of KIF18A activity form farther away from the spindle midzone. The results presented here suggest that the positioning of these micronuclei farther away from the midzone enables assembly of a more stable micronuclear membrane that will be less likely to rupture during the following cell cycle. A recent study showed that the microtubule bundles in the spindle midzone interfere with micronuclear membrane assembly. Based on this, it is not surprising that micronuclei forming away from the spindle midzone (like those resulting from lack of KIF18A activity) assemble more normal membranes. Although somewhat expected, this study provides the actual data in support of this phenomenon. This study will be of interest to cell biologists interested in cell division and genomic instability. My research has focused on cell division, aneuploidy, and chromosomal instability for nearly thirty years. Therefore, I believe I am fully qualified to evaluate this manuscript.

      Referees cross-commenting

      My areas of expertise do not include nuclear membrane structure and function. Therefore, I encourage the authors to consider the comments of reviewer #3 for issues related to reliable quantification of micronuclear membrane rupture.

    4. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #1

      Evidence, reproducibility and clarity

      In the present work Stumpff, Reinholdt and co-workers investigate the mechanism by which micronuclei contribute to tumorigenesis. Micronuclei are classic markers of genomic instability widely used in the diagnosis of cancer, but whether they work as drivers of the process has recently attracted significant attention due to their link with chromothripsis. Here, the Stumpff/Reinhold labs have explored an interesting model to test some ideas about the role of micronuclei as drivers of tumorigenesis, based on Kif18A/p53 double KO mice. They confirm the formation of micronuclei in these animals, but find no substantial increase in survival and tumor incidence relative to p53 KO animals, despite higher incidence of micronuclei in Kif18A/p53 KO tumors. They conclude that, per se, micronuclei do not have the capacity to form tumors, regardless of p53 status. This was surprising, given the well-established role of p53 in preventing the proliferation of micronucleated cells. To shed light into this apparent paradox, they compared micronuclei from Kif18A KO cells with micronuclei generated by a number of other experimental conditions that promote formation of anaphase lagging chromosomes or generates acentric fragments. They found that micronuclei derived from Kif18A are intrinsically different from micronuclei generated by those other means and essentially showed increased accumulation of lamin B, were more resistant to rupture and preserved the capacity to expand as cells exited mitosis. Of note, they find a correlation between chromosome proximity to the poles/main chromosome mass and the different features that characterize micronuclei from Kif18A KO cells, compared with the other experimental conditions in which late lagging chromosomes are more frequent. Overall, I find this study extremely interesting, well designed and executed in a rigorous way that characterizes the consistent solid work from these laboratories over the years. I have just few minor points that I recommend to be addressed prior to publication.

      1-Abstract and main text lines 70 and 100: the authors indicate that Kif18A mutant mice produce micronuclei due to unaligned chromosomes. This is correct, but at the same time misleading. The authors should clarify that although micronuclei derive from compromised congression, I was convinced from previous works (Fonseca et al., JCB, 2019) that it was their asynchronous segregation in anaphase that led to micronuclei formation. As is, a less familiar reader may conceive that misaligned chromosomes directly result in micronuclei, for example by being detached from the main chromosome mass.

      2-Page 2, line 59: "cells entering cell division...become fragmented". It is not the cells, but the chromosomes that fragment. Please correct.

      3-Page 4, line 149: "reduced survival in the Kif18A null, p53 mice". P53 what? KO, WT? Please clarify.

      4-Page 5, line 212: the authors refer that micronuclei were scored for absence of lamin A/C, but previously they scored it as "continuous/discontinuous". Please clarify.

      5-Page 6, line 243: "Kif18A is not required for micronuclear envelope rupture". Shouldn't it be micronuclear envelope "integrity"?

      6-One of the most interesting results of the paper is the correlation between envelope formation in micronuclei with their respective position relative to the poles/midzone. Could the authors try to investigate causality? For instance, the authors refer to works from other labs in which MT bundles and a midzone Aurora B activity gradient might play a role in the different features associated with micronuclei envelope formation, depending on their origin. Could the authors manipulate this gradient and investigate whether it changes the outcome in terms of nuclear envelope assembly properties on micronuclei? Are there any detectable features in midzone MT organization in Kif18A KO cells that would justify the observed differences?

      Significance

      Kif18A plays a key role in chromosome alignment, without apparently affecting kinetochore-microtubule attachments in non-transformed cells. Because they cannot establish a proper metaphase plate Kif18A KO cells enter anaphase with highly asynchronous segregation due to non-uniform chromosome distribution along the spindle axis. Consequently, some "delayed" chromosomes form micronuclei, in cell culture and in vivo. Interestingly, prior art has failed to detect any increased signs of genomic instability in Kif18A KO cells and mice, and, contrary to what would be expected based on current trends, these mice do now show any signs of increased incidence of tumors, in fact they even show some protective effect to induced colitis-associated colorectal cancer. Noteworthy, all previous experimental works pointing to a role of micronuclei as key intermediates of genomic instability in cancer relied on models in which the tumor suppressor protein p53 had been inactivated. In the present work, the authors explore the relationship between micronuclei formation and p53 inactivation by investigating tumor formation in Kif18A/p53 double KO animals (1 or 2 alleles of p53 inactivated).The reported results are timely and will attract the interest of a broad readership, while decisively contributing to shed light into an ongoing debate. I am therefore all in favor for the publication of this work in any journal affiliated with review commons, pending some minor revisions.

  3. Dec 2020
    1. Note: This rebuttal was posted by the corresponding author to Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Reply to the reviewers

      We thank the reviewers for their constructive suggestions, which have substantially improved this work. We have comprehensively revised the manuscript, and detail individual responses below:

      Reviewer #1 (Evidence, reproducibility and clarity (Required)):

      The study by Forbes et al describes and characterizes a 2nd generation peptide-based inhibitor of the MYB:CBP interaction, termed CRYBMIM, which they use to study MYB:cofactor interactions in leukemia cells. The CRYBMIM has improved properties relative to the MYBMIM peptide, and display more potency in biochemical and cell-based assays. Using a combination of epigenomics and biochemical screens, the authors define a list of candidate MYB cofactors whose functional significance as AML dependencies is supported by analysis of the DepMap database. Using genomewide profiling of TF and CBP occupancy, the authors provide evidence that CRYBMIM treatment reprograms the interactome of MYB in a manner that disproportionately changes specific cis-elements over others. Stated differently, the overall occupancy pattern of many TFs/cofactors shows gains and losses at specific cis elements, resulting in a complex modulation of MYB function and changes in transcription in leukemia cells. Overall, this is a strong, well-written study, with clear experimental results and relatively straightforward conclusions. The therapeutic potential of modulating MYB in cancer is enormous, and hence I believe this study will attract a broad interest in the cancer field and will likely be highly cited. I list below a few control experiments that would clarify the specificity of CRYBMIM. 1) Does CRYBMIM bind to other KIX domains, such as of MED15. It would be important to evaluate the specificity of this peptide for whether it binds to other KIX domains.

      Response: We analyzed all known human KIX domain sequences, and found that the most similar one to CBP/P300 is MED15 (38% identity), as shown in revised Supp. Fig. 2D. The sequence similarity of the remaining human KIX domains is substantially lower. To determine the specificity of CRYBMIM in binding the CBP/P300 versus MED15, we exposed human AML cell extracts to biotinylated CRYBMIM immobilized on streptavidin beads versus beads alone. Whereas CRYBMIM binds efficiently to CBP/P300, it does not exhibit any measurable binding to MED15 (even though MED15 is highly expressed), as shown in revised Supp. Fig. 2E, and reproduced for convenience below. While this does not exclude the possibility that CRYBMIM binds to other proteins, the biochemical specificity observed here, combined with the genetic requirement of CBP for cellular effects of CRYBMIM as shown by a genome-wide CRISPR screen (Fig. 1B and below), indicate that CRYBMIM is a specific ligand of CBP/P300. The manuscript has been revised on page 6 and 4-5 accordingly.

      2) Similarly, it would be useful to perform a mass spec analysis to all nuclear factors that associate with streptavidin-immobilized CRYBMIM. This again would be help the reader to understand the specificity of this peptide.

      Response: We agree with the reviewer that macromolecular ligands like CRYBMIM may interact with cellular proteins in complex ways. To define specific effects, we utilized four orthogonal strategies, explained below.

      First, we purified the CBP-containing nuclear complex using immunoprecipitation and determined its composition by mass spectrometry proteomics. This analysis revealed 833 proteins that are specifically associated with CBP (revised Table S6). Although technically feasible, the fact that CBP is associated with hundreds of proteins would make the experiment suggested by the reviewer difficult to interpret, because it would be a major challenge to distinguish proteins bound directly by the peptide versus proteins purified indirectly by virtue of the fact that CRYBMIM binds to CBP/P300, which in turn binds to many other proteins. While we recently developed improved methods for cross-linking mass spectrometry proteomics that permit the identification of direct protein-protein interactions (Ser, Cifani, Kentsis 2019, https://doi.org/10.1021/acs.jproteome.9b00085), we believe that these experiments are beyond the scope of the current manuscript, which already includes 40 new figure panels as part of this revision.

      In lieu of this experiment, we purified the CBP-containing nuclear complex after treatment with CRYBMIM or control using immunoprecipitation and determined its composition by targeting Western blotting. This analysis revealed RUNX1, LYL1 and SATB1 are specifically associated with CBP (revised Fig. 14B), among which RUNX1 is specifically remodeled in the MYB:CBP/P300 complex upon CRYBMIM binding. This transcriptional factor recruitment and remodeling support the idea of CRYBMIM’s specificity for the MYB:CBP/P300 complex.

      Second, to define the specificity of CRYBMIM, we used glycine mutants of CRYBMIM and its parent MYBMIM, CG3 and TG3, respectively, in which residues that form key salt bridge and hydrophobic interactions with KIX are replaced with glycines, but otherwise retain all other features of the active probes. Both CG3 and TG3 exhibit significantly reduced effects on the viability of AML cell lines, consistent with the specific effects of CRYBMIM (Fig. 3D).

      To confirm that this is due to CBP binding, we purified cellular CBP/P300 by binding to biotinylated CRYBMIM, and observed that it can be efficiently competed by excess of free CRYBMIM, but not TAT (Fig. 2E).

      Finally, to establish definitively that cellular CBP is responsible for CRYBMIM effects, we generated isogenic cell lines that are either deficient or proficient for CBP using CRISPR genome editing. This experiment demonstrated that CBP deficiency confers significant resistance to CRYBMIM, indicating that CBP is required for CRYBMIM-mediated effects (revised Figure 4), and reproduced below. We revised the manuscript on pages 21, 8, 6 and 9 accordingly.

      3) The major limitation of this study which modestly lessens my enthusiasm of this work is that the mechanistic model of MYB-sequestered TFs proposed here is based on a face-value interpretation of IP-MS data coupled with ChIP-seq data. Normally, I would expect such a mechanism to be supported with some additional focused biochemical experiments of specific interactions, to complement all of the omics approaches. For example, can the authors evaluate and/or validate further how MYB physically interacts with LYL1, CEBPA, SPI1, or RUNX1. Are these interactions direct or indirect? Which domains of these proteins are involved? Does CRYBMIM treatment modulate the ability of these proteins to associate with one another in a co-IP? Do these interactions occur in normal hematopoietic cells? A claim is made throughout this study that these are aberrant TF complexes, but I believe more evidence is required to support this claim.

      Response: We appreciate the reviewer’s comment and totally agree with this point. To examine how MYB aberrantly assembles transcription factors in AML, we performed MYB co-immunoprecipitation (co-IP) in a panel of seven genetically diverse AML cell lines with varying susceptibility to CRYBMIM, chosen to represent the common and refractory forms of human AML. Here, we confirmed co-assembly of CBP/P300, LYL1, E2A, LMO2 in all AML cell lines tested, and cell type-specific co-assembly of SATB1 and CEBPA, as shown in revised Fig. 8A, which are in agreement with the IP-MS and ChIP-seq results. We further corroborated these findings by co-IP studies of CBP/P300, as shown in the revised Fig. 8B. We performed similar co-IP experiments in normal hematopoietic progenitor cells, and found most of the co-assembled factors in AML cells were not observed in normal cells except for CBP/P300 and LYL1, as shown in the revised Figure 9E. Combined with the apparently aberrant expression of E2A and SATB1 in AML cells but not normal blood cells, this leads us to conclude that MYB assembles aberrant transcription factor complexes in AML cells. These complexes can be remodeled by peptidomimetic inhibitors, leading to their redistribution on chromatin, suppression of oncogenic gene expression and induction of cellular differentiation. We confirmed this mechanism by direct biochemical experiments in AML cells, demonstrating disassembly and remodeling of CBP/P300 complexes, as shown in the revised Figure 14. At least some of these interactions are direct, given the known direct binding between MYB and CEBPA (Oelgeschläger, Nuchprayoon, Lüscher, Friedman 1996, https://doi.org/10.1128/mcb.16.9.4717). We revised the manuscript text on pages 13, 15 and 21 accordingly.

      Reviewer #1 (Significance (Required)):

      Overall, this is a strong, well-written study, with clear experimental results and relatively straightforward conclusions. The therapeutic potential of modulating MYB in cancer is enormous, and hence I believe this study will attract a broad interest in the cancer field and will likely be highly cited.

      Response: We appreciate this sentiment and completely agree with the reviewer. The phenomenon reported in this work represents the first of its kind demonstration of the aberrant organization of transcription factor control complexes in cancer, and its pharmacologic modulation. We believe that this concept will serve as a transformative paradigm for understanding oncogenic gene control and the development of effective therapies for its definitive treatment.

      Reviewer #2 (Evidence, reproducibility and clarity (Required)):

      This manuscript reports the generation of a new and improved peptide mimetic inhibitor of the interaction between MYB and CBP/P300. The original MYBMIM inhibitor of this interaction, reported recently by the same laboratory, was modified by addition and substitution of peptide sequences from CREB, thus improving the affinity of the resulting CRYBMIM peptide to CBP/P300. The improved inhibitor profile results in increased anti-AML efficacy of CRYBMIM over MYBMIM. The authors go on to examine the mechanism underlying the anti-AML activity of CRYBMIM by integrating gene expression analysis, chromatin immunoprecipitation sequencing and mass spectrometric protein complex identification in human AML cells. I have some minor questions the authors may wish to comment on:

      1) The relocation of MYB, along with CBP/P300, to genes controlling myeloid differentiation (clusters 4 and 9) upon CRYBMIM treatment is reminiscent of the increased binding of MYB to myeloid pro-differentiation genes in AML cells following RUVBL2 silencing, recently reported in Armenteros-Monterroso et al. 2019 Leukemia 33:2817. Do the authors know if there is any overlap between genes in either of the clusters and the list reported in the latter study?

      Response: We thank the reviewer for making this suggestion. We also observe both RUVBL2 and RUVBL1 in the protein complex specifically associated with MYB (Fig. 7A and B). We compared the gene expression changes induced by CRYBMIM with those reported by Armenteros-Monterroso et al in 2019 (https://doi.org/10.1038/s41375-019-0495-8), and found that 37% of upregulated genes by RUVBL2 silencing were shared with genes induced by CRYBMIM treatment. In addition, upregulated genes in cluster 4 and 9 included myeloid differentiation-related genes, such as JUN, FOS and FOSB, which were also induced RUVBL2 silencing. We revised the manuscript to reflect this association on page 12.

      2) Could the authors comment on a possible mechanism to explain the co-localization of MYB and CBP/P300 to the loci in clusters 4 and 9 following CRYBMIM treatment? Is it possible that CBP/P300 is recruited by other transcription factors to these loci, independently of binding to MYB? Or is the binding of CBP/P300 to MYB at these loci somehow more resistant to disruption by CRYBMIM?

      Response: The reviewer has focused on an interesting point. At least for cluster 9, these genes exhibit gain of CBP/P300 in association with RUNX1 (Figure 12A), which we confirm by direct biochemical studies of MYB and CBP/P300 complexes immunoprecipitated from AML cells (revised Figure 14B-C). These experiments show that CRYBMIM treatment disrupts the MYB:CBP/P300 complexes, leading to the increased assembly of CBP/P300 with RUNX1. These findings are consistent with a dynamic competition mechanism that governs availability of CBP/P300 to transcriptional co-activation, in which distinct transcription factors compete for limiting amounts of CBP/P300. This possible mechanism is discussed in the revised manuscript (page 18-19 and 21).

      3) In the first paragraph of page 9, the text states: "Previously, we found that MYBMIM can suppress MYB:CBP/P300-dependent gene expression, leading to AML cell apoptosis that required MYB-mediated suppression of BCL2 (Ramaswamy et al., 2018)." I think this is a typo, since in this study, MYBMIM treatment results in loss of MYB binding to the BCL2 gene and consequent reduction in BCL2 expression. Do the authors mean 'MYBMIM-mediated suppression of BCl2' or 'loss of MYB-mediated activation of BCL2'?

      Response: We thank the reviewer and have corrected this typographic error in the text.

      4) The authors explain the failure of excess CREBMIM to displace CBP/P300 from immobilised CREBMIM (Figure 1E-F) by the nature of the CREB:CBP/P300 interaction. Does this imply that CREBMIM is unable to disrupt the interaction between CREB and CBP/P300 in living cells and that the CBP/P300 purified from native MV4;11 lysates by immobilised CREBMIM was from a pool not associated with CREB?

      Response: We thank the reviewer for making this point. Indeed, we reproducibly observe that CRYBMIM binding to CBP can be competed with excess free CRYBMIM, but CREBMIM binding cannot be competed by excess CREBMIM. This may be due to the different stabilities of the CBP complexes that are available for binding in cells. Alternatively, it is also possible that CREB binding to CBP, as reflected by CREBMIM, has a relatively slow dissociation rate, as compared to MYB, as reflected by CRYBMIM. We have begun to purify cellular CBP complexes (revised Fig 8. and response to comment 2 for Reviewer 1), and aim to define their determinants in future studies, as enabled by the introduction of CRYBMIM, CREBMIM and MLLMIM probes in the current work.

      Reviewer #2 (Significance (Required)):

      Based on this integrative analysis, the authors propose a convincing hypothesis, involving the assembly of aberrant transcription factor complexes and sequestration of P300/CBP from genes involved in normal myeloid development, for the oncogenic activity of MYB in AML. As well as the obvious therapeutic potential of the CRYBMIM inhibitor itself, the data reported here reveal multiple avenues for future investigation into novel anti-AML therapeutic strategies. This is an innovative and important study.

      This study will be of interest to scientists and clinicians involved in leukaemia research as well as cancer biology in general.

      My field of expertise: leukaemia biology, leukaemia models, aberrant transcription factor activity in leukaemia

      Response: We appreciate and agree with this assessment.

      Reviewer #3 (Evidence, reproducibility and clarity (Required)):

      This manuscript describes an improved MYB-mimetic peptide (cf the group's earlier work published in Nature Communications, 2018) and its effects on AML cell lines. It also describes - and this constitutes the majority of the paper - the dynamics of chromatin occupancy by MYB and other associated transcription factors upon disruption of the MYB-CBP/P300 interaction. The authors suggest this represents a shift from an oncogenic program to a myeloid differentiation program. \*Major comments:***

      Regarding the improved affinity, and biological activity, of CRYBMIM:

      1.Improved affinity of CRYBMIM cf MYBMIM: clearly, it is improved, but not by a lot. By MST the increased affinity is about 3x. In terms of effects on AML cell viability: there is no direct comparison, and this should be included. In the group's previous paper there is no direct estimate for MYBMIM but it looks like the IC50 is between 10 and 20 micromolar so the effect is again around 2.5 fold. Also, the effects of the amino acid substitutions in CG3 are also very small (2.4x) given that 3 critical residues are altered. This is quite concerning.

      Response: As pointed out by the reviewer, CRYBMIM exhibits several fold increase in binding affinity, as measured using purified proteins in vitro. Similar increase in cellular potency is observed after short-term treatment of AML cells, as shown in revised Figure 3C, and reproduced below. However, increasing the duration of treatment to several days leads to substantial improvement in apparent cellular potency (Figure 3G). For example, while MYBMIM induces approximately 100-fold reduction in cell viability of MV411 cells, CRYBMIM induces more than 1,000-fold reduction. Similarly, whereas MYBMIM exhibited relatively modest effects on OCIAML3 and SKM1 cells, CRYBMIM induces more than 1,000-fold reduction in cell viability. As we show in the revised manuscript, this appears to be due to the combination of increased biochemical affinity and specific proteolysis of MYB, which cooperate to induce extensive remodeling of MYB transcriptional complexes and gene expression (revised Figure 11). In all, this exemplifies how pharmacologic modulators of protein interactions can achieve significantly improved biological potency from relatively modest affinity effects, a concept that recently has been successfully used to develop a variety of PROTACs that leverage this “event-driven” as opposed to occupancy-driven pharmacology. The manuscript has been revised on page 8 and 18 to clarify this point.

      2.Does CRYBMIM really "spare" normal hematopoietic cells? Not according to Fig 2E, where there is only a 2-fold difference in IC50.

      Response: To better define the relative toxicity of CRYBMIM and MYBMIM, we examined their effects on the growth and survival of normal hematopoietic progenitor cells as compared to AML cells using colony forming assays in methylcellulose under more physiologic conditions in the presence of human hematopoietic cytokines (revised Figure 3E, and reproduced below). While CRYBMIM significantly reduced the clonogenic capacity, growth and survival of MV411 AML cells, there were no significant effects on the total clonogenic activity of normal CD34+ human umbilical cord blood progenitor cells under these conditions. At the highest dose, CRYBMIM induced modest reduction in CFU-MG colony formation, and modest increase in BFU-E colony formation of normal hematopoietic progenitor cells. We revised the manuscript to indicate that CRYBMIM “relatively spares” normal blood progenitor cells on page 8.

      Response: We appreciate the attention to this issue. In the original manuscript, we showed dose-response curves of cord blood progenitor cells cultured in suspension supplemented with fetal bovine serum, a system that is known to induce in appropriate hematopoietic cell differentiation (https://doi.org/10.1016/j.molmed.2017.07.003). In the revised manuscript, we show results of colony formation assays of hematopoietic progenitor cells cultured in serum-free, semi-solid conditions supplemented with human hematopoietic cytokines (revised Figure 3E and 3F). This is a more physiologic system which more faithfully maintains normal hematopoietic cell differentiation, as compared to the cellular differentiation induced by fetal bovine serum-containing media lacking hematopoietic growth factors, as used in the experiments in our original manuscript. To establish a positive control, in addition to treating AML cells under the same condition, we used doxorubicin, which is part of current treatment of patients with AML, and which in our experiments, exhibits significant and pronounced reduction in the clonogenic capacity, growth and survival of normal blood progenitor cells (revised Figure S3B). The manuscript has been revised on page 8 accordingly.

      1. Fig 2F doesn't include any lines that express very low or undetectable levels of MYB. Some of these should be included to further examine specificity.

      Response: We have now tested CRYBMIM against a large panel of non-hematopoietic tumor and non-tumor cell lines, with varying degrees of MYB expression. Some of those cells exhibit high level of MYB gene expression and MYB genetic dependency, which is at least in part correlated with susceptibility to CRYBMIM. (revised Figure S4, and reproduced below). The manuscript has been revised on page 8 accordingly.

      Effects on gene expression and MYB binding:

      Data on MYB target gene expression and apoptosis/differentiation, and the conclusions drawn per se are sound, but:

      5.Fig S3 seems to show that MYB protein is lost on treatment with CRYBMIM. This isn't even mentioned in the text but raises a whole range of major questions eg why is this the case? Is this what is responsible for the loss of MYB-p300 interaction and/or biological effects on AML cells? Is this what is responsible for the effects on MYB target gene expression in Fig 3 and MYB binding to chromatin in Fig 4? This must be addressed.

      Response: We have revised the manuscript to include this discussion, and performed additional experiments to define this phenomenon. We confirmed rapid reduction in MYB protein levels upon CRYBMIM treatment on the time-scale of one to four hours in diverse AML cell lines (revised Figure 11), with the rate of MYB protein loss correlating to the cellular susceptibility to CRYBMIM (revised Figure 11, and reproduced below). The manuscript has been revised on page 18 accordingly.

      This is consistent with the specific proteolysis of MYB induced by the peptidomimetic remodeling of the MYB:CBP/P300 complex. We confirmed this by combined treatment with the proteosomal/protease inhibitor MG132 (revised Figure 11C, and reproduced below). This effect was specific because overexpression of BCL2, which blocks MYBMIM-induced apoptosis (Ramaswamy et al, Kentsis, https://doi.org/10.1038/s41467-017-02618-6), was unable to rescue CRYBMIM-induced proteolysis of MYB, arguing that MYB proteolysis is a specific effect of CRYBMIM rather than a non-specific consequence of apoptosis. The manuscript has been revised on page 18 accordingly.

      6.Fig 4 and the accompanying text are a bit hard to follow, but if I understood them correctly, I am surprised that the "gained MYB peaks" don't include the MYB binding motif itself? This at least deserves some comment. Also, there doesn't seem to have been any attempt to integrate the ChIP-Seq data with the expression data of Fig 3. This would provide clearer insights into the identities and types of MYB-regulated genes that are directly affected by suppression of CBP/p300 binding to MYB.

      Response: We thank the reviewer for this suggestion. The revised manuscript now includes a comprehensive and integrated analysis of chromatin and gene expression dynamics (revised Figures 13A and 13B). In contrast to the model in which blockade of MYB:CBP/P300 induces loss of gene expression and loss of transcription factor and CBP/P300 chromatin occupancy, we also observed a large number of genes with increased expression and gain of CBP/P300 occupancy (revised Figure 13A-B, and reproduced below). This includes numerous genes that control hematopoietic differentiation, such as FOS, JUN, and ATF3. As a representative example, in the case of FOS, we observed that CRYBMIM-induced accumulation of CBP/P300 was associated with increased binding of RUNX1, and eviction of CEBPA and LYL1 (revised Figure 13C). Thus, the absence of “gained MYB peaks” is due to the redistribution of CBP/P300 with alternative transcription factors, such as RUNX1. In all, these results support the model in which the core regulatory circuitry of AML cells is organized aberrantly by MYB and its associated co-factors including LYL1, CEBPA, E2A, SATB1 and LMO2, which co-operate in the induction and maintenance of oncogenic gene expression, as co-opted by distinct oncogenes in biologically diverse subtypes of AML (revised Figure 14). This involves apparent sequestration of CBP/P300 from genes controlling myeloid cell differentiation. Thus, oncogenic gene expression is associated with the assembly of aberrantly organized MYB transcriptional co-activator complexes, and their dynamic remodeling by selective blockade of protein interactions can induce AML cell differentiation. The manuscript has been revised on page 20-21 accordingly.

      7.The MS studies on MYB-interacting proteins seem very interesting and novel. I am not an expert on MS, though, so I'd suggest this section be reviewed by someone who is. Moreover, I was unable to see the actual data from this study because the material I was provided with didn't include Table S4 and S5.

      Response: We appreciate this point. For this reason, we have deposited all of our mass spectrometry data to be openly available via PRIDE (accession number PXD019708), and also openly provide all of the analyzed data via Zenodo (https://doi.org/10.5281/zenodo.4321824), as additionally provided in the Supplementary Material for this manuscript.

      \Should the authors qualify some of their claims as preliminary or speculative, or remove them altogether?* 8.Claims regarding biological activity, specificity and improvements cf MYBMIM should be moderated given the small size of these effects as mentioned above (points 1 and 3).*

      Response: As explained in detail in response to comments 1-3 above (page 12-14 of this response), we have substantially revised the manuscript to incorporate both new experimental results and additional explanations (pages 6-8).

      9.I found the description of the studies related to Figs 5 and 6 somewhat difficult to follow and convoluted. While changes in MYB and CBP/p300 chromatin occupancy clearly occur on M CRYBMIM treatment, it is not clear that the complexes seen on genes prior to treatment represent "aberrant" complexes. These may just be characteristic of undifferentiated (myeloid) cells. The authors appear to argue that because some of the candidate co-factors show "apparently aberrant expression in AML cells" based on comparison of (presumably mRNA) expression data with normal cells, the presence of these factors in the complexes make them "aberrant" (moreover, the "aberrancy score" of Fig 5 C is not defined anywhere, as far as I can see). This inference is drawing a rather long bow, given that the AML-specific factors may not actually be absent from the complexes in normal cells. So this conclusion should be moderated if a more direct MS comparison cannot be provided (for which I understand the technical difficulties).

      Response: We have now measured protein abundance levels of key transcription factors assembled with MYB in AML cells in various normal human hematopoietic cells (revised Figure 9, and reproduced below). We found that most transcription factors that are assembled with MYB in diverse AML cell lines could be detected in one or more normal human blood cells, albeit with variable abundance, with the exception of CEBPA and SATB1 that were measurably expressed exclusively in AML cells (revised Figure 9A). Using unsupervised clustering and principal component analysis, we defined the combinations of transcription factors that are associated with aberrant functions of MYB:CBP/P300, as defined by their susceptibility to peptidomimetic remodeling (revised Figure 9B-D). In addition, we directly examined the physical assembly of MYB with key transcription factors in normal hematopoietic cells using co-immunoprecipitation studies (revised Figure 9E). In agreement with the physical association of MYB seen in AML cell lines, we observed association with CBP/P300 and LYL1 in normal hematopoietic cells. However, we did not observe physical association with E2A and SATB1 in normal cells, which indicates aberrant association of these in AML cell lines. This leads us to propose that these complexes are aberrantly assembled, at least in part due to the inappropriate transcription factor co-expression. The manuscript has been revised on page 15 accordingly.

      \Would additional experiments be essential to support the claims of the paper?*

      Response: As explained in detail in response to comment 5 above (page 16 of this response), we have carried out extensive studies of the specific proteolysis of MYB. We conclude that MYB transcription complexes are regulated both by MYB:CBP/P300 binding and by specific factor proteolysis, and can be induced by its peptidomimetic blockade in AML cells. Such “event-driven” pharmacology is emerging as a powerful tool to modulate protein function in cells, and studies reported in our work should enable its translation into improved therapies for patients, and improved probes for basic science.

      11.Provision of a positive control for the experiment of Fig S2.

      Response: As explained in detail in response to comment 2 above (page 13-14 of this response), we precisely defined the effects of CRYBMIM and MYBMIM on the clonogenic capacity, growth and survival of normal hematopoietic progenitor cells in serum-free, methylcellulose media supplemented with human hematopoietic cytokines. These experiments showed relatively modest effects (9.3 ± 3.8% reduction) of CRYBMIM on normal cells (Figure 3E), as compared to substantial inhibition (54 ± 2.4 % reduction) of the growth and survival of AML cells (Figures 3E). For comparison, doxorubicin led to more than 98 % reduction in clonogenic capacity (revised Figure S3B).

      12.\Are the data and the methods presented in such a way that they can be reproduced?**

      -Mostly yes

      Response: The revised manuscript includes a complete description of all methods, including a detailed supplement, listing technical details, with all analyzed data available openly via Zenodo (https://doi.org/10.5281/zenodo.4321824).

      13.\Are the experiments adequately replicated and statistical analysis adequate?**

      -Mostly yes

      Response: All experiments were performed in at least three replicates, with all quantitative comparisons performed using appropriate statistical tests, as explained in the manuscript.

      **Minor comments:**

      *Specific experimental issues that are easily addressable.*

      -These are mostly indicated above.

      In addition:

      14.Why is BCL2 expression down-regulated by MYBMIM but not CRYMYB?

      Response: We made the same observation, and attribute this difference to the fact that BCL2 expression is regulated by several transcription factors, including CEBPA, which is affected by CRYBMIM but not MYBMIM. Similar to MYBMIM treatment, MYB occupancy at the BCL2 enhancer was reduced upon CRYBMIM treatment. However, new binding sites of other factors, such as CBP/P300 and RUNX1, appeared simultaneously, suggesting that redistribution of transcription factors following CRYBMIM treatment can affect transcriptional regulation of BCL2 expression (revised Figure S9 and shown below).

      *Are prior studies referenced appropriately?

      -Yes *Are the text and figures clear and accurate?*

      15.Generally, although some details are missing eg what aberrancy score in Fig 5C means.

      Response: Thank you for pointing this out. We have revised this figure to clarify this score, which is defined as the ratio of gene expression in AML cells relative to normal hematopoietic progenitor cells (revised Figure 7C).

      16.\Do you have suggestions that would help the authors improve the presentation of their data and conclusions?**

      -The title of this manuscript could and I think should be changed. The term "therapeutic", is not appropriate because no therapeutic agents are described in the m/s nor is any form of AML, even experimentally, treated. Also "CBP" should be replaced with CBP/P300, especially since most evidence suggests that P300 is the likely more important partner of MYB (eg Zhao et al 2011

      Response: We agree and have revised the title to clarify the significance of this work: “Convergent organization of aberrant MYB complexes controls oncogenic gene expression in acute myeloid leukemia.” We have revised the manuscript to indicate CBP/P300.

      17.-It would be worth discussing the core observation that disruption of the MYB-CBP/P300 interaction actually results in changes in MYB DNA binding. That this would occur is not at all obvious, because CBP/p300 doesn't interact with MYB's DNA binding domain nor does it have intrinsic DNA binding activity.

      Response: We thank the reviewer for this comment, and agree that remodeling of the MYB complex must affect the binding of MYB and other cofactors to DNA, at least in part mediated by potential acetylation by CBP/P300 (page 24).

      Reviewer #3 (Significance (Required)):

      **The Nature and Significance of the Advance**

      1) The major significance of this work lies in the chromatin occupancy and MYB complex studies. There are a number of very interesting findings including the apparent redistribution of MYB and/or CBP/P300 upon treatment with CRYBMIM. These suggest a series of changes in factors associated with particular gene sets involved in myeloid differentiation, although as mentioned above particular target genes are not specifically identified. However the pathways corresponding to these are listed in Table S6.

      Response: We have revised the manuscript to include the target genes in revised Supplemental Table 4 as well as DESeq2 tables (deposited in Zenodo, https://doi.org/10.5281/zenodo.4321824).

      2) The new peptide design (CRYBMIM) is interesting but its differences in binding and biological effects of MYBMIM are mostly incremental. See above.

      Response: We respectfully disagree and would like to explain how this work is significant both for conceptual and technical reasons. First, while the biochemical affinity of CRYBMIM is quantitatively increased compared with MYBMIM, this quantitatively increased affinity translates into qualitatively improved biological potency, as a result of “event-driven” pharmacology that characterizes pharmacologic protein interaction modulators (please also see response to Reviewer 3, comment 1, page 6 of this response). MYBMIM suppresses the growth and survival mostly of MLL-rearranged leukemias, whereas CRYBMIM does so for the vast majority (10 out of 11) of studied subtypes of AML. This now enables its therapeutic translation, as we are currently pursuing in collaboration with Novartis. Second, its improved biological activity led to the discovery of the previously unknown and unanticipated CBP/P300 sequestration mechanism of oncogenic gene control. We use this discovery to develop a precise model of aberrant gene control in AML that for the first time unifies previously disparate observations into a general mechanism. This is highly significant because it provides shared molecular dependencies for most subtypes of AML, a long-standing conundrum in cancer biology.

      *Place the work in the context of the existing literature (provide references, where appropriate).*

      -This m/s builds on and extends the report from the same group in Nature Communications (2018), which described the earlier peptide MYBMIM, some effects on MYB target genes and on AML cells. It and the previous paper also draw on the findings regarding the role of the MYB-CBP/P300 interaction in myeloid leukemogenesis (Pattabirman et al 2014) and on previous genome-wide studies of MYB target genes (Zhoa et al 2011; Zuber et al 2011).

      *State what audience might be interested in and influenced by the reported findings.*

      -This m/s will likely be of interest to scientists interested in MYB per se, in AML, in cancer genomics and transcriptional regulation.

      *Define your field of expertise with a few keywords to help the authors contextualize your point of view. Indicate if there are any parts of the paper that you do not have sufficient expertise to evaluate.* -My expertise: AML, experimental hematology, transcription, MYB, cancer genomics

      3) As mentioned above, I feel that additional expertise is required to review the MS studies.

      Response: We have deposited all raw data in PRIDE (accession number PXD019708) and all processed data in Zenodo (https://doi.org/10.5281/zenodo.4321824), making it available for the community for further analysis.

    2. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #3

      Evidence, reproducibility and clarity

      Summary

      This manuscript describes an improved MYB-mimetic peptide (cf the group's earlier work published in Nature Communications, 2018) and its effects on AML cell lines. It also describes - and this constitutes the majority of the paper - the dynamics of chromatin occupancy by MYB and other associated transcription factors upon disruption of the MYB-CBP/P300 interaction. The authors suggest this represents a shift from an oncogenic program to a myeloid differentiation program.

      Major comments:

      Regarding the improved affinity, and biological activity, of CRYBMIM:

      1.Improved affinity of CRYBMIM cf MYBMIM: clearly, it is improved, but not by a lot. By MST the increased affinity is about 3x. In terms of effects on AML cell viability: there is no direct comparison, and this should be included. In the group's previous paper there is no direct estimate for MYBMIM but it looks like the IC50 is between 10 and 20 micromolar so the fecct is again around 2.5 fold. Also, the effects of the amino acid substitutions in CG3 are also very small (2.4x) given that 3 critical residues are altered. This is quite concerning.

      2.Does CRYBMIM really "spare" normal hematopoietic cells? Not according to Fig 2E, where there is only a 2-fold difference in IC50.

      3.Fig 2E and Supp Fig S2 appear to be contradictory. The latter shows no effect of 20micromolar CRYBMIM on colony formation by normal CD34+ cells, in complete contrast to killing with IC50 of 12.8 micromolar in Fig 2E. There is no +ve control for Fig S2 ie does the peptide work under colony assay conditions? This MUST be addressed.

      4.Fig 2F doesn't include any lines that express very low or undetectable levels of MYB. Some of these should be included to further examine specificity.2

      Effects on gene expression and MYB binding:

      Data on MYB target gene expression and apoptosis/differentiation, and the conclusions drawn per se are sound, but:

      5.Fig S3 seems to show that MYB protein is lost on treatment with CRYBMIM. This isn't even mentioned in the text but raises a whole range of major questions eg why is this the case? Is this what is responsible for the loss of MYB-p300 interaction and/or biological effects on AML cells? Is this what is responsible for the effects on MYB target gene expression in Fig 3 and MYB binding to chromatin in Fig 4? This must be addressed.

      6.Fig 4 and the accompanying text are a bit hard to follow, but if I understood them correctly, I am surprised that the "gained MYB peaks" don't include the MYB binding motif itself? This at least deserves some comment. Also, there doesn't seem to have been any attempt to integrate the ChIP-Seq data with the expression data of Fig 3. This would provide clearer insights into the identities and types of MYB-regulated genes that are directly affected by suppression of CBP/p300 binding to MYB.

      7.The MS studies on MYB-interacting proteins seem very interesting and novel. I am not an expert on MS, though, so I'd suggest this section be reviewed by someone who is. Moreover, I was unable to see the actual data from this study because the material I was provided with didn't include Table S4 and S5.

      Should the authors qualify some of their claims as preliminary or speculative, or remove them altogether?

      8.Claims regarding biological activity, specificity and improvements cf MYBMIM should be moderated given the small size of these effects as mentioned above (points 1 and 3).

      9.I found the description of the studies related to Figs 5 and 6 somewhat difficult to follow and convoluted. While changes in MYB and CBP/p300 chromatin occupancy clearly occur on M CRYBMIM treatment, it is not clear that the complexes seen on genes prior to treatment represent "aberrant" complexes. These may just be characteristic of undifferentiated (myeloid) cells. The authors appear to argue that because some of the candidate co-factors show "apparently aberrant expression in AML cells" based on comparison of (presumably mRNA) expression data with normal cells, the presence of these factors in the complexes make them "aberrant" (moreover, the "aberrancy score" of Fig 5 C is not defined anywhere, as far as I can see). This inference is drawing a rather long bow, given that the AML-specific factors may not actually be absent from the complexes in normal cells. So this conclusion should be moderated if a more direct MS comparison cannot be provided (for which I understand the technical difficulties).

      Would additional experiments be essential to support the claims of the paper?

      1. Address the issue of the apparent loss of MYB protein upon CRYBMIM treatment. If this is occurring, the whole premise of the subsequent work is undermined.

      12.Provision of a positive control for the experiment of Fig S2.

      Are the data and the methods presented in such a way that they can be reproduced?

      -Mostly yes

      Are the experiments adequately replicated and statistical analysis adequate?

      -Mostly yes

      Minor comments:

      Specific experimental issues that are easily addressable. -These are mostly indicated above.

      In addition: oWhy is BCL2 expression down-regulated by MYBMIM but not CRYMYB?

      *Are prior studies referenced appropriately?

      -Yes

      Are the text and figures clear and accurate?

      -Generally, although some details are missing eg what aberrancy score in Fig 5C means.

      Do you have suggestions that would help the authors improve the presentation of their data and conclusions?

      -The title of this manuscript could and I think should be changed. The term "therapeutic", is not appropriate because no therapeutic agents are described in the m/s nor is any form of AML, even experimentally, treated. Also "CBP" should be replaced with CBP/P300, especially since most evidence suggests that P300 is the likely more important partner of MYB (eg Zhao et al 2011

      -It would be worth discussing the core observation that disruption of the MYB-CBP/P300 interaction actually results in changes in MYB DNA binding. That this would occur is not at all obvious, because CBP/p300 doesn't interact with MYB's DNA binding domain nor does it have intrinsic DNA binding activity.

      Significance

      The Nature and Significance of the Advance

      -The major significance of this work lies in the chromatin occupancy and MYB complex studies. There are a number of very interesting findings including the apparent redistribution of MYB and/or CBP/P300 upon treatment with CRYBMIM. These suggest a series of changes in factors associated with particular gene sets involved in myeloid differentiation, although as mentioned above particular target genes are not specifically identified. However the pathways corresponding to these are listed in Table S6.

      -The new peptide design (CRYBMIM) is interesting but its differences in binding and biological effects cf MYBMIM are mostly incremental. See above.

      Place the work in the context of the existing literature (provide references, where appropriate).

      -This m/s builds on and extends the report from the same group in Nature Communications (2018), which described the earlier peptide MYBMIM, some effects on MYB target genes and on AML cells. It and the previous paper also draw on the findings regarding the role of the MYB-CBP/P300 interaction in myeloid leukemogenesis (Pattabirman et al 2014) and on previous genome-wide studies of MYB target genes (Zhoa et al 2011; Zuber et al 2011).

      State what audience might be interested in and influenced by the reported findings.

      -This m/s will likely be of interest to scientists interested in MYB per se, in AML, in cancer genomics and transcriptional regulation.

      Define your field of expertise with a few keywords to help the authors contextualize your point of view. Indicate if there are any parts of the paper that you do not have sufficient expertise to evaluate.

      -My expertise: AML, experimental hematology, transcription, MYB, cancer genomics

      -As mentioned above, I feel that additional expertise is required to review the MS studies.

    3. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #2

      Evidence, reproducibility and clarity

      This manuscript reports the generation of a new and improved peptide mimetic inhibitor of the interaction between MYB and CBP/P300. The original MYBMIM inhibitor of this interaction, reported recently by the same laboratory, was modified by addition and substitution of peptide sequences from CREB, thus improving the affinity of the resulting CRYBMIM peptide to CBP/P300. The improved inhibitor profile results in increased anti-AML efficacy of CRYBMIM over MYBMIM. The authors go on to examine the mechanism underlying the anti-AML activity of CRYBMIM by integrating gene expression analysis, chromatin immunoprecipitation sequencing and mass spectrometric protein complex identification in human AML cells.

      I have some minor questions the authors may wish to comment on:

      1) The relocation of MYB, along with CBP/P300, to genes controlling myeloid differentiation (clusters 4 and 9) upon CRYBMIM treatment is reminiscent of the increased binding of MYB to myeloid pro-differentiation genes in AML cells following RUVBL2 silencing, recently reported in Armenteros-Monterroso et al. 2019 Leukemia 33:2817. Do the authors know if there is any overlap between genes in either of the clusters and the list reported in the latter study?

      2) Could the authors comment on a possible mechanism to explain the co-localization of MYB and CBP/P300 to the loci in clusters 4 and 9 following CRYBMIM treatment? Is it possible that CBP/P300 is recruited by other transcription factors to these loci, independently of binding to MYB? Or is the binding of CBP/P300 to MYB at these loci somehow more resistant to disruption by CRYBMIM?

      3) In the first paragraph of page 9, the text states: "Previously, we found that MYBMIM can suppress MYB:CBP/P300-dependent gene expression, leading to AML cell apoptosis that required MYB-mediated suppression of BCL2 (Ramaswamy et al., 2018)." I think this is a typo, since in this study, MYBMIM treatment results in loss of MYB binding to the BCL2 gene and consequent reduction in BCL2 expression. Do the authors mean 'MYBMIM-mediated suppression of BCl2' or 'loss of MYB-mediated activation of BCL2'?

      4) The authors explain the failure of excess CREBMIM to displace CBP/P300 from immobilised CREBMIM (Figure 1E-F) by the nature of the CREB:CBP/P300 interaction. Does this imply that CREBMIM is unable to disrupt the interaction between CREB and CBP/P300 in living cells and that the CBP/P300 purified from native MV4;11 lysates by immobilised CREBMIM was from a pool not associated with CREB?

      Significance

      Based on this integrative analysis, the authors propose a convincing hypothesis, involving the assembly of aberrant transcription factor complexes and sequestration of P300/CBP from genes involved in normal myeloid development, for the oncogenic activity of MYB in AML. As well as the obvious therapeutic potential of the CRYBMIM inhibitor itself, the data reported here reveal multiple avenues for future investigation into novel anti-AML therapeutic strategies. This is an innovative and important study.

      This study will be of interest to scientists and clinicians involved in leukaemia research as well as cancer biology in general.

      My field of expertise: leukaemia biology, leukaemia models, aberrant transcription factor activity in leukaemia

    4. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #1

      Evidence, reproducibility and clarity

      The study by Forbes et al describes and characterizes a 2nd generation peptide-based inhibitor of the MYB:CBP interaction, termed CRYBMIM, which they use to study MYB:cofactor interactions in leukemia cells. The CRYBMIM has improved properties relative to the MYBMIM peptide, and display more potency in biochemical and cell-based assays. Using a combination of epigenomics and biochemical screens, the authors define a list of candidate MYB cofactors whose functional significance as AML dependencies is supported by analysis of the DepMap database. Using genomewide profiling of TF and CBP occupancy, the authors provide evidence that CRYBMIM treatment reprograms the interactome of MYB in a manner that disproportionately changes specific cis-elements over others. Stated differently, the overall occupancy pattern of many TFs/cofactors shows gains and losses at specific cis elements, resulting in a complex modulation of MYB function and changes in transcription in leukemia cells.

      Overall, this is a strong, well-written study, with clear experimental results and relatively straightforward conclusions. The therapeutic potential of modulating MYB in cancer is enormous, and hence I believe this study will attract a broad interest in the cancer field and will likely be highly cited. I list below a few control experiments that would clarify the specificity of CRYBMIM.

      1) Does CRYBMIM bind to other KIX domains, such as of MED15. It would be important to evaluate the specificity of this peptide for whether it binds to other KIX domains.

      2) Similarly, it would be useful to perform a mass spec analysis to all nuclear factors that associate with streptavidin-immobilized CRYBMIM. This again would be help the reader to understand the specificity of this peptide.

      The major limitation of this study which modestly lessens my enthusiasm of this work is that the mechanistic model of MYB-sequestered TFs proposed here is based on a face-value interpretation of IP-MS data coupled with ChIP-seq data. Normally, I would expect such a mechanism to be supported with some additional focused biochemical experiments of specific interactions, to complement all of the omics approaches. For example, can the authors evaluate and/or validate further how MYB physically interacts with LYL1, CEBPA, SPI1, or RUNX1. Are these interactions direct or indirect? Which domains of these proteins are involved? Does CRYBMIM treatment modulate the ability of these proteins to associate with one another in a co-IP? Do these interactions occur in normal hematopoietic cells? A claim is made throughout this study that these are aberrant TF complexes, but I believe more evidence is required to support this claim.

      Significance

      Overall, this is a strong, well-written study, with clear experimental results and relatively straightforward conclusions. The therapeutic potential of modulating MYB in cancer is enormous, and hence I believe this study will attract a broad interest in the cancer field and will likely be highly cited.

    1. Note: This rebuttal was posted by the corresponding author to Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Reply to the reviewers

      Reviewer #1 The authors study allostery with a beautiful genotype-phenotype experiment to study the fitness landscape of an allosteric lac repressor protein. The authors make a mutational library using error prone pcr and measure the impact on antibiotic resistance protein expression at varying levels of ligand, IPTG, expression. After measuring the impact of mutations authors fill-in the missing data using a neural net model. This type of dose response is not standard in the field, but the richness of their data and the discovery of the "band pass" phenomena prove its worth here splendidly. Using this mixed experimental/predicted data the authors explore how each mutation alters the different parameters of a hill equation fit of a dose response curve. Using higher order mutational space the authors look at how mutations can qualitatively switch phenotypes to inverted or band-stop dose-response curves. To validate and further explore a band-stop novel phenotype, the authors focused on a triple mutant and made all combinations of the 3 mutations. The authors find that only one mutation alone alters the dose-response and only in combination does a band-stop behavior present itself. Overall this paper is a fantastic data heavy dive into the allosteric fitness landscape of protein. Overall, the data presented in this paper is thoroughly collected and analyzed making the conclusions well-based. We do not think additional experiments nor substantial changes are needed apart from including basic experimental details and more biophysical rationale/speculation as discussed in further detail below.

      The authors do a genotype-phenotype experiment that requires extensive deep sequencing experiments. However, right now quite a bit of basic statistics on the sequencing is missing. Baseline library quality is somewhat shown in supplementary fig 2 but the figure is hard to interpret. It would be good to have a table that states how many of all possible mutations at different mutation depths (single, double, etc) there are. Similarly, sequencing statistics are missing- it would be useful to know how many reads were acquired and how much sequencing depth that corresponds to. This is particularly important for barcode assignment to phenotype in the long-read sequencing. In addition, a synonymous mutation comparison is mentioned but in my reading that data is not presented in the supplemental figures section.

      We thank the reviewer for this succinct summary of the manuscript and the results. We appreciate the reviewer identifying data of interest that were not included in the original manuscript. We agree that this information is necessary to consider the results. Specific changes are summarized in the comments below.

      The paper is very much written from an "old school" allostery perspective with static end point structures that are mutually exclusive - eg. p5l10 "relative ligand-binding affinity between the two conformations" - however, an ensemble of conformations is likely needed to explain their data. This is especially true for the bandpass and inverted phenotypes they observe. The work by Hilser et al is of particular importance in this area. We would invite the authors to speculate more freely about the molecular origins of their findings.

      We agree with the suggestions to adopt a modern allosteric perspective. We have changed the language throughout the manuscript to align with the ensemble model of allostery. We continue to frame results using the Monad-Wyman-Changeaux model, which reliably predicts LacI activity from biophysical parameters and is not exclusive of more modern models of allostery.

      **Minor** There are a number of small modifications. In general this paper is very technical and could use with some explanation and discussion for relevance to make the manuscript more approachable for a broader audience. P1L23: Ligand binding at one site causes a conformational change that affects the activity of another > not necessarily true - and related to using more "modern" statistical mechanical language for describing allostery.

      We agree with the reviewer’s comment. We have addressed this comment by adopting language in line with more modern view of allostery, for example:

      “With allosteric regulation, ligand binding at one site on a biomolecule changes the activity of another, often distal, site. Switching between active and inactive states provides a sense-and-response function that defines the allosteric phenotype.”

      P2L20: The core experiment of this paper is a selection using a mutational library. In the main body the authors mention the library was created using mutagenic pcr but leave it at that. More details on what sort of mutagenic pcr was used in the main body would be useful. According to the methods error prone pcr was used. Why use er-pcr vs deep point mutational libraries? Presumably to sample higher order phenotype? Rationale should be included. Were there preliminary experiments that helped calibrate the mutation level?

      We agree that justifying the decision to use error-prone PCR for library construction would be helpful. To explain this decision, we have added to the main text to explain this decision and to reflect on the consequences.

      “We used error-prone PCR across the full lacI CDS to investigate the effects of higher-order substitutions spread across the entire LacI sequence and structure.”

      And

      Novel phenotypes emerged at mutational distances greater than one amino acid substitution, highlighting the value in sampling a broader genotype space with higher-order mutations. Furthermore, the untargeted, random mutagenesis approach used here was critical for finding these novel phenotypes, as the genotypes required for these novel phenotypes were unpredictable.”

      P2L20: Baseline library statistics would be great in a table for coverage, diversity, etc especially as this was done by error prone pcr vs a more saturated library generation method. This is present in sup fig2 but it's a bit complicated.

      To more clearly convey the diversity within the library, we have included a heatmap of amino acid substitution counts found within the library (Supplementary Fig. 4). Additionally, we have added Supplementary Table 1, which lists the distribution of mutational distances of LacI variants found within the library, and the corresponding coverage of all possible mutations for each mutational distance.

      P2L26: How were FACS gates drawn? This is in support fig17 - should be pointed to here.

      We agree that a better description of the FACS process would be helpful. To address this we have included Supplementary Fig. 2, showing flow cytometry measurements of the library before and after FACS. Additionally, we have extended the description of the FACS process:

      “The initial library had a bimodal distribution of G__­0, as indicated by flow cytometry results, with a mode at low fluorescence (near G__­0 of wildtype LacI), and mode at higher gene expression. To generate a library in which most of the LacI variants could function as allosteric repressors, we used fluorescence activated cell sorting (FACS) to select the portion of the library with low fluorescence in the absence of ligand, gating at the bifurcation of the two modes (Sony SH800S Cell Sorter, Supplementary Fig. 2).”

      __

      P3L4: Where is the figure/data for the synonymous SNP mutations? This should be in the supplement.

      We agree this data is necessary to support the claim that LacI function was not impacted by synonymous mutations. We have included a new Supplementary Fig. 9, which shows the distribution of Hill equation parameters for LacI variants that code for the wild-type amino acid sequence, but with non-identical coding DNA sequences. Additionally, we included the results of a statistical analysis in the main text, this analysis compared all synonymous sequences in the library:

      “__We compared the distributions of the resulting Hill equation parameters between two sets of variants: 39 variants with exactly the wild-type coding DNA sequence for LacI (but with different DNA barcodes) and 310 variants with synonymous nucleotide changes (i.e. the wild-type amino acid sequence, but a non-wild-type DNA coding sequence). Using the Kolmogorov-Smirnov test, we found no significant differences between the two sets (p-values of 0.71, 0.40, 0.28, and 0.17 for G0, G∞, EC50, and n respectively, Supplementary Fig. 9).” __

      P3L20: The authors use a ML learning deep neural network to predict variant that were not covered in the screen. However, the library generation method is using error prone pcr meaning there could multiple mutations resulting in the same amino acid change. The models performance was determined by looking at withheld data however error prone pcr could result in multiple nonsynomymous mutations of the same amino acid. For testing were mutations truly withheld or was there overlap? Because several mutations are being represented by different codon combinations. Was the withheld data for the machine learning withholding specific substitutions?

      We thank the reviewer for identifying the need to clarify this critical data analysis. Data was held-out at the amino acid level, and so no overlap between the training and testing datasets occurred. We have clarified the description of the method in the main text:

      “We calculated RMSE using only held-out data not used in the model training, and the split between held-out data and training data was chosen so that all variants with a specific amino acid sequence appear in only one of the two sets.”


      In addition, higher order protein interactions are complicated and idiosyncratic. I am surprised how well the neural net performs on higher order substitutions. P4L4: Authors find mutations at the dimer/tetramer interfaces but don't mention whether polymerization is required. is dimerization required for dna binding? Tetramerization?

      We agree with the reviewer that, overall, a description of LacI structure and function would improve messaging the reported results. As such, we have added Supplementary Table 2, which defines the structural features discussed throughout the manuscript. Additionally, we have strived to describe the relevant structural and functional role of specific amino acids that are discussed in the text. Finally, we have also added a paragraph to the main text that summarizes the structure and function of LacI.

      “The LacI protein has 360 amino acids arranged into three structural domains__22–24__. The first 62 N-terminal amino acids form the DNA-binding domain, comprising a helix-turn-helix DNA-binding motif and a hinge that connects the DNA-binding motif and the core domain. The core domain, comprising amino acid positions 63-324, is divided into two structural subdomains: the N-terminal core and the C-terminal core. The full core domain forms the ligand-binding pocket, core-pivot region, and dimer interface. The tetramerization domain comprises the final 30 amino acids and includes a flexible linker and an 18 amino acid α-helix (Fig. 3, Supplementary Table 2). Naturally, LacI functions as a dimer of dimers: Two LacI monomers form a symmetric dimer that further assembles into a tetramer (a dimer of dimers).”

      P4L8: Substitutions near the dimer interface both impact g0 and ec50, which authors say is consistent with a change in the allosteric constant. Can authors explain their thinking more in the paper to make it easier to follow? Are the any mutations in this area that only impact g0 or ec50 alone? Why may these specific residues modify dimerization?

      We agree that a more in-depth discussion on the possible mechanisms behind these phenotypic changes would improve the manuscript. We have added discussion throughout the subsection “Effects of amino acid substitutions on LacI phenotype,” we believe this added discussion improve the manuscript and clarify the relationship between the observed allosteric phenotypes and the molecular mechanisms behind them. W

      Overall, we have made a number of changes in the manuscript that we hope will address these concerns.

      P4L8: The authors discuss the allosteric constant extensively within the paper but do not explain it. It would be helpful to have an explanation of this to improve readability. This explanation should include the statistical mechanical basis of it and some speculation about the ways it manifests biophysically.

      The allosteric constant is a critical concept, and we agree that it must be defined and discussed clearly throughout the manuscript. We have greatly expanded the discussion of the effects of single amino acid substitutions, and in the process we give examples of biochemical changes in the protein, and how they may affect the allosteric constant. We think this added text improves the manuscript and helps clarify the allosteric constant and the biomolecular processes that affect it.

      P4L1-16: Authors see mutations in the dimerization region that impact either G0 and Gsaturated in combination with Ec50 but not g0 and gsaturated together. Maybe we do not fully understand the hill equation but why are there no mutations that impact both g0 and gsaturated seen in support fig 13c? Why would mutations in the same region potentially impacting dimerization impact either g0 or gsaturated? What might be the mechanism behind divergent responses?

      It is important to recognize that the dimer interface does not just support the formation of dimers. There are many points of contact along the dimer interface that change when LacI switches between the active and inactive states. So, the dimer interface also helps regulate the balance between the active and inactive states. Our results show that different substitutions near the dimer interface can push this balance either toward the active or inactive states to varying degrees. We’ve added text throughout the description of single-substitutions effects to give specific examples and added a new paragraph at the end of that section to provide additional discussion and context. With regard to the more specific question of changes to both G0 and Ginf, the models indicate that simultaneous changes to those Hill Equation parameters requires an unusual combination of biophysical changes. To clarify this point, we added a short paragraph to the text:

      “None of the single amino substitutions measured in the library simultaneously decrease __G∞ and increase G0 (Supplementary Fig. 20c). This is not surprising, since substitutions that shift the biophysics to favor the active state tend to decrease G∞ while those that favor the inactive state tend to increase G0, and the biophysical models2,14,15 indicate that only a combination of parameter changes can cause both modifications to the dose-response. The library did, however, contain several multi-substitution variants with simultaneously decrease __G∞ and increase G0. These inverted variants, and their associated substitutions are discussed below.”


      P4L29: for interpretability it would be good to explain what log-additive effect means in the context of allostery.

      We agree that this information would be useful to the reader and have added additional text to explain log-additivity. We thank the reviewer for pointing out this oversight.

      “Combining multiple substitutions in a single protein almost always has a log-additive effect on EC50. That is, the proportional effects of two individual amino acid substitutions on the EC50 can be multiplied together. For example, if substitution A results in a 3-fold change, and substitution B results in a 2-fold change, the double substitution, AB, behaving log-additively, results in a 6-fold change__.”__

      P4L34-P5L19: This section is wonderful. Really cool results and interesting structural overlap! P5L34 Helix 9 of the protein is mentioned but it's functional relevance is not. This is common throughout the paper - it would be useful for there to be an overview somewhere to help the reader contextualize the results with known structural role of these elements.

      We agree with the reviewer that this information would help to contextualize the results. We have made a number of changes to address this. First, we have added Supplementary Table 2, which describes the structural features of LacI. Second, we have added a paragraph overviewing the structure and function of LacI. Third, we have expanded the section “the effects of individual amino acid substitutions on the function of LacI” to discuss the structural or biochemical impact of specific substitutions. We thank the reviewer for this suggestion.

      P5L39: The authors identified a triple mutant with the band-stop phenotype then made all combination of the triple mutant. Of particular interest is R195H/G265D which is nearly the same as the triple mutant. It would be nice if the positions of each of these mutations and have some discussion to begin to rationalize this phenotype, even if to point out how far apart they are and that there is no easy structural rationale!

      We appreciate the reviewer highlighting this area of interest. We have added structural information to Fig. 6, which indicates to position of the amino acid substitutions that result in the band-stop phenotype, as well as a small discussion in the main text:

      “To further investigate the band-stop phenotype, we chose a strong band-stop LacI variant with only three amino acid substitutions (R195H/G265D/A337D). These three positions are distributed distally on the periphery of the C-terminal core domain, and the role that each of these substitutions plays in the emergence of the band-stop phenotype is unclear.”

      P6L9: There should be more discussion of the significance of this work directly compared to what is known. For instance, negative cooperativity is mentioned as an explanation for bi-phasic dose response but this idea is not explained. Why would the relevant free energy changes be more entropic? Another example is the reverse-TetR phenotype observed by Hillen et al.

      We agree that more discussion is necessary to frame the results reported in the manuscript. To address this, we have added additional discussion throughout the manuscript that relates the results to the current understanding of allostery. Also, in the Conclusion, we added specific examples that lead us to link the ideas of bi-phasic dose response, negative cooperativity, and entropy/disorder. We believe these additions have improved the manuscript and we thank the reviewer for this suggestion.

      P6L28: The authors mention that phenotypes exist with genotypes that are discoverable with genotype-phenotype landscapes. This study due to the constraints of error prone pcr were somewhat limited. How big is the phenotypic landscape? Is it worth doing a more systematic study? What is the optimal experimental design: Single mutations, doubles, random - where is there the most information. How far can you drift before your machine learning model breaks down? How robust would it be to indels?

      The reviewer raises some excellent questions here, some of which are appropriate subjects for future work. The optimal experimental design depends on the objective: If the goal is to understand every possible mutation, a systematic site-saturation approach would be more appropriate. However, the landscape of a natural protein is limited by its wild-type DNA coding sequence, and so some substitutions are inaccessible (due to the arrangement of the codon table). The approach we took allowed to us characterize most of the accessible amino acid substitutions, while also allowing us to identify novel functions that would not have been identified with other approaches. We have added a little to the main text to discuss this (below). With regard to the DNN model, in the manuscript (SI Fig. 14), we show how the predictive accuracy degrades with mutational distance from the wild-type. It is possible that the type of DNN that we used could handle indels, since it effectively encodes each variant as a set of step-wise changes from the wild-type. But as with all machine-learning methods, it would require training with a dataset that included indels.

      “Novel phenotypes emerged at mutational distances greater than one amino acid substitution, highlighting the value in sampling a broader genotype space with higher-order mutations. Furthermore, the untargeted, random mutagenesis approach used here was critical for finding these novel phenotypes, as the genotypes required for these novel phenotypes were unpredictable.”

      Figures: Sup figs 3-7: The comparison of library-based results and single mutants is a great example of how to validate genotype-phenotype experiments!

      Thank you.

      Supp fig 5.: Missing figure number.

      We appreciate the reviewer catching this error and have attempted to properly label all figures and tables in this revision. Thank you.

      Supp fig7: G0 appears to have very poor fit between library vs single mutant version. Why might this be? R^2 would likely be better to report here as opposed to RMSE as RMSE is sensitize to the magnitude of the data such that you cannot directly compare RMSE of say 'n' to G0.

      We agree that these are important discussion points and have addressed this concern with an expanded discussion in the main text, as well as the addition of coefficient of correlation (R^2) in the caption for Figure 2 (previously supplementary figure 7). We believe these additions contribute meaningfully to the manuscript, and they address the concerns of the reviewer. The additional text reads:

      “We compared the Hill equation parameters from the library-scale measurement to those same parameters determined from flow cytometry measurements for each of the chemically synthesized LacI variants (Fig. 2). This served as a check of the new library-scale method’s overall ability to measure dose-response curves with quantitative accuracy. The accuracy for each Hill equation parameter in the library-scale measurement was: 4-fold for G0, 1.5-fold for G∞, 1.8-fold for EC50, and ± 0.28 for n. For G0, G∞, and EC50, we calculated the accuracy as: __, where __ is the root-mean-square difference between the logarithm of each parameter from the library-scale and cytometry measurements. For n, we calculated the accuracy simply as the root-mean-square difference between the library-scale and cytometry results. The accuracy for the gene expression levels (G0 and G∞) was better at higher gene expression levels (typical for G∞) than at low gene expression levels (typical for G0), which is expected based on the non-linearity of the fitness impact of tetracycline (Supplementary Figs. 10-11). Measurements of the Hill coefficient, n, had high relative uncertainties for both barcode-sequencing and flow cytometry, and so the parameter n was not used in any quantitative analysis.”

      Sup fig13c: it is somewhat surprising that mutations only appear to effect g0 and not gsaturated. This implies that basal and saturated activity are not coupled. Is this expected? Why or why not?

      This comment is partially addressed with a response above (P4L1-16). Coupled gene expression increases do occur, especially with substitutions at the start codon that result in fewer copies of LacI in the cell. In this instance, both G0 and G∞ are increased. Otherwise, changes to multiple biophysical parameters are required to increase both G0 and G∞.

      Reviewer #1 (Significance (Required)): Allostery is hard to comprehend because it involves many interacting residues propagating information across a protein. The Monod-Wyman-Changeux (MWC) and Koshland, Nemethy, and Filmer (KNF) models have been a long standing framework to explain much of allostery, however recent formulations have focused on the role of the conformational ensemble and a grounding in statistical mechanics. This manuscript focuses on the functional impact of mutations and therefore contribution of the amino acids to regulation. The authors unbiased approach of combining a dose-response curve and mutational library generation let them fit every mutant to a hill equation. This approach let the authors identify the allosteric phenotype of all measured mutations! The authors found inverted phenotypes which happen in homologs of this protein but most interesting is the strange and idiosyncratic 'Band-stop' phenotype. The band-stop phenotype is bi-phasic that will hopefully be followed up with further studies to explain the mechanism. This manuscript is a fascinating exploration of the adaptability of allosteric landscapes with just a handful of mutations. Genotype-phenotype experiments allow sampling immense mutational space to study complex phenotypes such as allostery. However, a challenge with these experiments is that allostery and other complicated phenomena come from immense fitness landscapes altering different parameters of the hill equation. The authors approach of using a simple error prone pcr library combined with many ligand concentrations allowed them to sample a very large space somewhat sparsely. However, they were able to predict this data by training and using a neural net model. I think this is a clever way to fill in the gaps that are inherent to somewhat sparse sampling from error prone pcr. The experimental design of the dose response is especially elegant and a great model for how to do these experiments. With some small improvements for readability, this manuscript will surely find broad interest to the genotype-phenotype, protein science, allostery, structural biology, and biophysics fields. We were prompted to do this by Review Commons and are posting our submitted review here: Willow Coyote-Maestas has relevant expertise in high throughput screening, protein engineering, genotype-phenotype experiments, protein allostery, dating mining, and machine learning. James Fraser has expertise in structural biology, genotype-phenotype experiments, protein allostery, protein dynamics, protein evolution, etc.

      Reviewer #2 (Evidence, reproducibility and clarity (Required)): The authors use deep mutational scanning to infer the dose-response curves of ~60,000 variants of the LacI repressor and so provide an unprecedently systematic dataset of how mutations affect an allosteric protein. Overall this is an interesting dataset that highlights the potential of mutational scanning for rapidly identifying diverse variants of proteins with desired or unexpected activities for synthetic biology/bioengineering. The relatively common inverted phenotypes and their sequence diversity is interesting, as is the identification of several hundred genotypes with non-sigmoidal band-stop dose-response curves and their enrichment in specific protein regions. A weakness of the study is that some of the parameter estimates seem to have high uncertainty and this is not clearly presented or the impact on the conclusions analysed. A second shortcoming is that there is little mechanistic insight beyond the enrichments of mutations with different effects in different regions of the protein. But as a first overview of the diversity of mutational effects on the dose-response curve of an allosteric protein, this is an important dataset and analysis. **Comments** **Data quality and reproducibility** "The flow cytometry results confirmed both the qualitative and quantitative accuracy of the new method (Supplementary Figs. 3-7)"

      • There need to be quantitative measures of accuracy in the text here for the different parameters.

      We believe this comment is addressed along with the following two comments.

      • Sup fig 7 panels should be main text panels - they are vital for understanding the data quality In particular, the G0 parameter estimates from the library appear to have a lower bound ie they provide no information below a cytometry Go of ~10^4. This is an important caveat and needs to be highlighted in the main text. The Hill parameter (n) estimate for wt (dark gray) replicate barcodes is extremely variable - why is this?

      • In general there is not a clear enough presentation of the uncertainty and biases in the parameter estimations which seem to be rather different for the 4 parameters. Only the EC50 parameter seems to correlate very well with the independent measurements.

      We thank the reviewer for identifying a need for more information on the accuracy of this method. So, we have moved Supplementary Fig. 7 to the main text (Fig 2 in the revised manuscript) and have added coefficients of correlation to each Hill equation parameter in that figure caption. Furthermore, we have added new data (Supplementary Fig. 11), which shows the uncertainty associated with different gene expression levels. Finally, we have added a discussion on the accuracy of this method for each parameter of the Hill equation to the main text. Estimation of the Hill coefficient (n) from data is often highly uncertain and variable, because that parameter estimate can be highly sensitive to random measurement errors at a single point on the curve. The estimate for the wild type appears to be highly variable because the plot contains 53 replicate measurements. So, the plotted variability represents approximately 2 standard deviations. The spread of wild-type results in the plot is consistent with the stated RMSE for the Hill coefficient. Furthermore, the Hill coefficient is not used in any of the additional quantitative analysis in our manuscript, partially because of its relatively high measurement uncertainty, but also because, based on the biophysical models, it is not as informative of the underlying biophysical changes.

      “We compared the Hill equation parameters from the library-scale measurement to those same parameters determined from flow cytometry measurements for each of the chemically synthesized LacI variants (Fig. 2). This served as a check of the new library-scale method’s overall ability to measure dose-response curves with quantitative accuracy. The accuracy for each Hill equation parameter in the library-scale measurement was: 4-fold for G0, 1.5-fold for G∞, 1.8-fold for EC50, and ± 0.28 for n. For G0, G∞, and EC50, we calculated the accuracy as: "exp" ["RMSE" ("ln" ("x" ))], where "RMSE" ("ln" ("x" )) is the root-mean-square difference between the logarithm of each parameter from the library-scale and cytometry measurements. For n, we calculated the accuracy simply as the root-mean-square difference between the library-scale and cytometry results. The accuracy for the gene expression levels (G0 and G∞) was better at higher gene expression levels (typical for G∞) than at low gene expression levels (typical for G0), which is expected based on the non-linearity of the fitness impact of tetracycline (Supplementary Figs. 10-11). Measurements of the Hill coefficient, n, had high relative uncertainties for both barcode-sequencing and flow cytometry, and so the parameter n was not used in any quantitative analysis.”

      • The genotypes in the mutagenesis library contain a mean of 4.4 aa substitutions and the authors us a neural network to estimate 3 of the Hill equation parameters (with uncertainties) for the 1991/2110 of the single aa mutations. It would be useful to have an independent experimental evaluation of the reliability of these inferred single aa mutational effects by performing facs on a panel of single aa mutants (using single aa mutants in sup fig 3-7, if there are any, or newly constructed mutants).

      We agree that the predictive performance of the DNN requires experimental validation. We evaluated the performance by withholding data from 20% of the library, including nearly 200 variants with single amino acid substitutions, and then compared the predicted effect of those substitutions to the measured effect. The results of this test are reported in Supplementary Fig. 14. Additionally, we have adjusted the main text to more clearly explain the evaluation process.

      “To evaluate the accuracy of the model predictions, we used the root-mean-square error (RMSE) for the model predictions compared with the measurement results. We calculated RMSE using only held-out data not used in the model training, and the split between held-out data and training data was chosen so that all variants with a specific amino acid sequence appear in only one of the two sets.” __ __

      • fig3/"Combining multiple substitutions in a single protein almost always has a log-additive effect on EC50." How additive are the other 2 parameters? this analysis should also be presented in fig 3. If they are not as additive is it simply because of lower accuracy of the measurements? If the mutational effects are largely additive, then a simple linear model (rather than the DNN) could be used to estimate the single mutant effects from the multiple mutant genotypes.

      We agree with the reviewer that exploring the log-additivity of the Hill equation parameters is informative, and have included Supplementary Figure 21, which displays this information. Furthermore, we expanded the discussion of log-additivity on all three parameters in the main text:

      “Combining multiple substitutions in a single protein almost always has a log-additive effect on EC50. That is, the proportional effects of two individual amino acid substitutions on the EC50 can be multiplied together. For example, if substitution A results in a 3-fold change, and substitution B results in a 2-fold change, the double substitution, AB, behaving log-additively, results in a 6-fold change. Only 0.57% (12 of 2101) of double amino acid substitutions in the measured data have EC50 values that differ from the log-additive effects of the single substitutions by more than 2.5-fold (Fig. 4). This result, combined with the wide distribution of residues that affect EC50, reinforces the view that allostery is a distributed biophysical phenomenon controlled by a free energy balance with additive contributions from many residues and interactions, a mechanism proposed previously1,39 and supported by other recent studies17, rather than a process driven by the propagation of local, contiguous structural rearrangements along a defined pathway.

      A similar analysis of log-additivity for G0 and G∞ is complicated by the more limited range of measured values for those parameters, the smaller number of substitutions that cause large shifts in G0 or G∞, and the higher relative measurement uncertainty at low G(L). However, the effects of multiple substitutions on G0 and G∞ are also consistent with log-additivity for almost every measured double substitution variant (Supplementary Fig. 21).”

      **Presentation/clarity of text and figures**

      • The main text implies that the DNN is trained to predict 3 parameters of the Hill equation but not the Hill coefficient (n). This should be clarified / justified in the main text.

      We agree that the decision to exclude the parameter ‘n’ requires explanation in the main text. To address this, we have added to the main text:

      “Measurements of the Hill coefficient, n, had high relative uncertainties for both barcode-sequencing and flow cytometry, and so the parameter n was not used in any quantitative analysis.”

      and

      “We trained the model to predict the Hill equation parameters G0, G∞, and EC50 (Supplementary Fig. 13), the three Hill equation parameters that were determined with relatively low uncertainty by the library-scale measurement.”

      • The DNN needs to be better explained and justified in the main text for a general audience. How do simpler additive models perform for phenotypic prediction / parameter inference?

      We agree with the reviewer that the DNN needs to be justified in the main text. As part of the revision plan, we propose to compare the predictive performance of the DNN to an additive model.

      • Ref 14. analyses a much smaller set of mutants in the same protein but using an explicit biophysical model. It would be helpful to have a more extensive comparison with the approach and conclusions to this previous study.

      Throughout the manuscript, we frame the results and discussion in terms of the referenced biophysical model. Using the model, we describe the biophysical effects that a substitution may have on LacI, based on observed changes to function associated with that substitution. We also comment briefly on the limitations of this model when applied to the extensive dataset presented here.

      “Most of the non-silent substitutions discussed above are more likely to affect the allosteric constant than either the ligand or operator affinities. Within the biophysical model, those affinities are specific to either the active or inactive state of LacI, i.e. they are defined conditionally, assuming that the protein is in the appropriate state. So, almost by definition, substitutions that affect the ligand-binding or operator-binding affinities (as defined in the models) must be at positions that are close to the ligand-binding site or within the DNA-binding domain. Substitutions that modify the ability of the LacI protein to access either the active state or inactive state, by definition, affect the allosteric constant. This includes, for example, substitutions that disrupt dimer formation (dissociated monomers are in the inactive state), substitutions that lock the dimer rigidly into either the active or inactive state, or substitutions that more subtly affect the balance between the active and inactive states. Thus, because there are many more positions far from the ligand- and DNA- binding regions than close to those regions, there are many more opportunities for substitutions to affect the allosteric constant than the other biophysical parameters. Note that this analysis assumes that substitutions don’t perturb the LacI structure too much, so that the active and inactive states remain somehow similar to the wild-type states. Our results suggest that this is not always the case: consider, for example, the substitutions at positions __K84 and M98 discussed above and the substitutions resulting in the inverted and band-stop phenotypes discussed below.”__

      • Enrichments need statistical tests to know how unexpected that results are e.g. p5 line 12 "67% of strongly inverted variants have substitutions near the ligand-binding pocket"

      We agree that this information is necessary to interpret the results. We have included p-values (previously reported only in the Methods section) throughout the main text of the manuscript.

      The publication by Poelwijk et al. was considered extensively when planning this work, and failing to cite that manuscript would have been tremendously unjust. We have included it, as well as a few additional references that have identified and discussed inverted LacI variants. We sincerely thank the reviewer for identifying this oversight.

      • What mechanisms do the authors envisage that could produce the band-stop dose response curves? There is likely previous theoretical work that could be cited here. In general there is little discussion of the biophysical mechanisms that could underlie the various mutational effects.

      We agree with the reviewer, that discussing the biophysical mechanisms that underlie many of the reported mutations is important to understand the results. We have expanded the subsection “Effects of amino acid substitutions on LacI phenotype” to include discussion on several of the key substitutions (or groups of substitutions) and their potential biophysical effects. Additionally, we consider mechanism that may underlie the band-stop sensor, and propose one model that could explain the band-stop phenotype:

      “In particular, the biphasic dose-response of the band-stop variants suggests negative cooperativity: that is, successive ligand binding steps have reduced ligand binding affinity. Negative cooperativity has been shown to be required for biphasic dose-response curves__42,43. The biphasic dose-response and apparent negative cooperativity are also reminiscent of systems where protein disorder and dynamics have been shown to play an important role in allosteric function1, including catabolite activator protein (CAP)44,45 and the Doc/Phd toxin-antitoxin system46. This suggests that entropic changes may also be important for the band-stop phenotype. A potential mechanism is that band-stop LacI variants have two distinct inactive states: an inactive monomeric state and an inactive dimeric state. In the absence of ligand, inactive monomers may dominate the population. Then, at intermediate ligand concentrations, ligand binding stabilizes dimerization of LacI into an active state which can bind to the DNA operator and repress transcription. When a second ligand binds to the dimer, it returns to an inactive dimeric state, similar to wildtype LacI. This mechanism, and other possible mechanisms, do not match the MWC model of allostery or its extensions2,13–15__ and require a more comprehensive study and understanding of the ensemble of states in which these band-stop LacI variants exist.”

      • "This result, combined with the wide distribution of residues that affect EC50, suggests that LacI allostery is controlled by a free energy balance with additive contributions from many residues and interactions." 'additive contributions and interactions' covers all possible models of vastly different complexity i.e. this sentence is rather meaningless.

      We have attempted to contextualize this statement by adding additional discussion and references. We hope these additions give more meaning to this section.

      “__This result, combined with the wide distribution of residues that affect EC50, reinforces the view that allostery is a distributed biophysical phenomenon controlled by a free energy balance with additive contributions from many residues and interactions, a mechanism proposed previously1,39 and supported by other recent studies17, rather than a process driven by the propagation of local, contiguous structural rearrangements along a defined pathway.”__

      • fig 4 c and d compress a lot of information into one figure and I found this figure confusing. It may be clearer to have multiple panels with each panel presenting one aspect. It is also not clear to me what the small circular nodes exactly represent, especially when you have one smaller node connected to two polygonal nodes, and why they don't have the same colour scale as the polygonal nodes.

      We agree with the reviewer that figure 4 (or Figure 5 in the revised manuscript) contains a lot of information. The purpose of this figure is to convey the structural and genetic diversity among the sets of inverted variants and band-stop variants. We designed this figure to convey this point at two levels: a brief overview, where the diversity is apparent by quickly considering the figure, and at a more informative level, with some quantitative data and structurally relevant points highlighted. We have modified the caption slightly, in an effort to improve clarity.

      • line 25 - 'causes a conformational change' -> 'energetic change' (allostery does not always involve conformational change

      We thank the reviewer for this comment and have adopted a more modern language describe allostery throughout the manuscript.

      • sup fig 5 legend misses '5'

      We thank the reviewer for pointing this out, we have attempted to number all figures and tables more carefully.

      • sup fig 7. pls add correlation coefficients to these plots (and move to main text figures).

      We agree that this information is of interest and have included this data as main text Figure 2. In addition, we have included coefficients of correlation in the caption of this figure.

      • Reference 21 is just a title and pubmed link

      We thank the reviewer for identifying this error, we have corrected this in the references.

      • "fitness per hour" -> growth rate

      To ensure that this connection is clearly established, when we introduce fitness for the first time, we clarify that it relates to growth rate:

      “Consequently, in the presence of tetracycline, the LacI dose-response modulates cellular fitness (i.e. growth rate) based on the concentration of the input ligand isopropyl-β-D-thiogalactoside (IPTG).”

      Also, we define ‘fitness’ in the Methods section:

      “The experimental approach for this work was designed to maintain bacterial cultures in exponential growth phase for the full duration of the measurements. So, in all analysis, the Malthusian definition of fitness was used, i.e. fitness is the exponential growth rate__58__.”

      • page 6 line 28 - "discoverable only via large-scale landscape measurements" - directed evolution approaches can also discover such genotypes (see e.g. Poelwijk /Tans paper). Please re-phrase.

      We agree with the reviewer and have adjusted the main text accordingly.

      “__Overall, our findings suggest that a surprising diversity of useful and potentially novel allosteric phenotypes exist with genotypes that are readily discoverable via large-scale landscape measurements.”__

      • pls define jargon the first time it is used e.g. band-stop and band-pass

      We agree that all unconventional terms should be explicitly defined when used, and we have attempted to define the band-pass and band-stop dose-response curves more clearly in the main text:

      “These include examples of LacI variants with band-stop dose-response curves (i.e. variants with high-low-high gene expression; e.g. Fig. 1e, Supplementary Fig. 7), and LacI variants with band-pass dose-response curves (i.e. variants with low-high-low gene expression; e.g. Supplementary Fig. 8).”

      **Methods/data availability/ experimental and analysis reproducibility:** The way that growth rate is calculated on page 17 equation 1- This section is confusing. Please be explicit about how you accounted for the lag phase, what the lag phase was, and total population growth during this time. In addition, please report the growth curves from the wells of the four plates, the final OD600 of the pooled samples, and exact timings of when the samples were removed from 37 degree incubation in a table. These are critical for calculating growth rate in individual clones downstream.

      We thank the reviewer for identifying the need to clarify this section of text. The ‘lag’ in this section referred to a delay before tetracycline began impacting the growth rate of cells. To address this, we have changed ‘lag’ in this context to ‘delay.’ Furthermore, we have attempted to clarify precisely the cause of this delay, and how we accounted for it in calculating growth rates:

      For samples grown with tetracycline, the tetracycline was only added to the culture media for Growth Plates 2‑4. Because of the mode of action of tetracycline (inhibition of translation), there was a delay in its effect on cell fitness: Immediately after diluting cells into Growth Plate 2 (the first plate with tetracycline), the cells still had a normal level of proteins needed for growth and proliferation and they continued to grow at nearly the same rate as without tetracycline. Over time, as the level of proteins required for cell growth decreased due to tetracycline, the growth rate of the cells decreased. Accordingly, the analysis accounts for the variation in cell fitness (growth rate) as a function of time after the cells were exposed to tetracycline. With the assumption that the fitness is approximately proportional to the number of proteins needed for growth, the fitness as a function of time is taken to approach the new value with an exponential decay:

      (3)

      where μitet is the steady-state fitness with tetracycline, and α is a transition rate. The transition rate was kept fixed at α = log(5), determined from a small-scale calibration measurement. Note that at the tetracycline concentration used during the library-scale measurement (20 µg/mL), μitet was greater than zero even at the lowest G(L) levels (Supplementary Fig. 10). From Eq. (3), the number of cells in each Growth Plate for samples grown with tetracycline is:

      • What were the upper and lower bounds of the measurements? (LacI deletion vs Tet deletion / autofluoresence phenotype - true 100% and true 0% activity). Knowing and reporting these bounds will also allow easier comparison between datasets in the future.

      We agree that knowing the limitations of the measurement are important for contextualizing the results. To address this point, we have included Supplementary Fig. 11, which shows the uncertainty of the measurement across gene expression levels.

      Please clarify whether there was only 1 biological replicate (because the plates were pooled before sequencing)? Or if there were replicates present an analysis of reproducibility.

      We thank the reviewer for pointing out the ambiguity in the original manuscript. The library-scale measurement reported here was completed once, the 24 growth conditions were spread across 96 wells, so each condition occupied 4 wells. The 4 wells were combined prior to DNA extraction. We have clarified this process in the methods by removing ‘duplicate’:

      “Growth Plate 2 contained the same IPTG gradient as Growth Plate 1 with the addition of tetracycline (20 µg/mL) to alternating rows in the plate, resulting in 24 chemical environments, with each environment spread across 4 wells.”

      Despite there being only a single library-scale measurement, the accuracy and reliability of the results are supported by many distinct biological replicates within the library (i.e. LacI variants with the same amino acid sequence but with different barcodes, see new Supplementary Fig. 9), as well as over 100 orthogonal dose-response curve measurements completed with flow cytometry (Figure 2). We believe these support the reproducibility of the work and we have included statistical analysis on the accuracy of the library-scale measurement results.

      “To test the accuracy of the new method for library-scale dose-response curve measurements, we independently verified the results for over 100 LacI variants from the library. For each verification measurement, we chemically synthesized the coding DNA sequence for a single variant and inserted it into a plasmid where LacI regulates the expression of a fluorescent protein. We transformed the plasmid into E. coli and measured the resulting dose-response curve with flow cytometry (e.g. Fig. 1e). We compared the Hill equation parameters from the library-scale measurement to those same parameters determined from flow cytometry measurements for each of the chemically synthesized LacI variants (Fig. 2). This served as a check of the new library-scale method’s overall ability to measure dose-response curves with quantitative accuracy. The accuracy for each Hill equation parameter in the library-scale measurement was: 4-fold for G0, 1.5-fold for G∞, 1.8-fold for EC50, and ± 0.28 for n. For G0, G∞, and EC50, we calculated the accuracy as: "exp" ["RMSE" ("ln" ("x" ))], where "RMSE" ("ln" ("x" )) is the root-mean-square difference between the logarithm of each parameter from the library-scale and cytometry measurements. For n, we calculated the accuracy simply as the root-mean-square difference between the library-scale and cytometry results (Supplementary Fig. 7).”

      • Please provide supplementary tables of the data (in addition to the raw sequencing files). Both a table summarising the growth rates, inferred parameter values and uncertainties for genotypes and a second table with the barcode sequence counts across timepoints and associated experimental data.

      We agree that access to this information is critical. Due to the size of the associated data, we have made this data available for download in a public repository. We direct readers to the repository information in the “Data Availability” statement:

      “The raw sequence data for long-read and short-read DNA sequencing have been deposited in the NCBI Sequence Read Archive and are available under the project accession number PRJNA643436. Plasmid sequences have been deposited in the NCBI Genbank under accession codes MT702633, and MT702634, for pTY1 and pVER, respectively.

      The processed data table containing comprehensive data and information for each LacI variant in the library is publicly available via the NIST Science Data Portal, with the identifier ark:/88434/mds2-2259 (https://data.nist.gov/od/id/mds2-2259 or https://doi.org/10.18434/M32259). The data table includes the DNA barcode sequences, the barcode read counts, the time points used for the libarary-scale measurement, fitness estimates for each barcoded variant across the 24 chemical environments, the results of both Bayesian inference models (including posterior medians, covariances, and 0.05, 0.25, 0.75, and 0.95 posterior quantiles), the LacI CDS and amino acid sequence for each barcoded variant (as determined by long-read sequencing), the number of LacI CDS reads in the long-read sequencing dataset for each barcoded variant, and the number of unintended mutations in other regions of the plasmid (from the long-read sequencing data).

      Code Availability

      All custom data analysis code is available at https://github.com/djross22/nist_lacI_landscape_analysis.”

      Reviewer #2 (Significance (Required)): The authors present an unprecedently systematic dataset of how mutations affect an allosteric protein. This illustrates the potential of mutational scanning for rapidly identifying diverse variants of allosteric proteins / regulators with desired or unexpected activities for synthetic biology/bioengineering. Previous studies have identified inverted dose-response curve for a lacI phenotypes https://www.cell.com/fulltext/S0092-8674(11)00710-0 but using directed evolution i.e. they were not comprehensive in nature. The audience of this study would be protein engineers, the allostery field, synthetic biologists and the mutation scanning community and evolutionary biologists interested in fitness landscapes. My relevant expertise is in deep mutational scanning and genotype-phenotype landscapes, including work on allosteric proteins and computational methods. Reviewer #3 (Evidence, reproducibility and clarity (Required)): In this interesting manuscript the authors developed in ingenious high throughput screening approach which utilizes DNA barcoding to select variants of LacI proteins with different allosteric profiles for IPTG control using E. coli fitness (growth rate) in a range of antibiotic concentrations as a readout thus providing a genotype-phenotype map for this enzyme. The authors used library of 10^5-10^ variants of LacI expressed from a plasmid and screened for distinct IPTG activation profiles under different conditions including several antibiotic stressors. As a result they identified various patterns of activation including normal (sigmoidal increase), inverted (decrease) and unusual stop-band where the dependence of growth on [IPTG] is non-monotonic. The study is well-conceived, well executed and provides statistically significant results. The key advance provided by this work is that it allows to identify specific mutations in LacI connected with one of three allosteric profiles. The paper is clearly written all protocols are explained and it can be reproduced in a lab that possesses proper expertise in genetics. Reviewer #3 (Significance (Required)): The significance of this work is that it discovered libraries of LacI variants which give rise to distinct profiles of allosteric control of activation of specific genes (in this case antibiotic resistance) by the Lac mechanism. The barcoding technology allowed to identify specific mutations which are (presumably) causal of changes in the way how allosteric activation of LacI by IPTG works. As such it provides a rich highly resolved dataset of LacI variants for further exploration and analysis. Alongside with these strengths several weaknesses should also be noted:

      1. First and foremost the paper does not provide any molecular-level biophysical insights into the impact of various types of mutations on molecular properties of LacI. Do the mutations change binding affinity to IPTG? Binding side? Communication dynamics? Stability? The diagrams of connectivity for the stop-band mutations (Fig.4) do not provide much help as they do not tell much which molecular properties of LacI are affected by mutations and why certain mutations have specific effect on allostery. A molecular level exploration would make this paper much stronger.

      We address this comment with comment (2), below.

      1. In the same vein a theoretical MD study would be quite illuminating in answering the key unanswered question of this work: Why do mutations have various and pronounced effects of allosteric regulation by LacI?. I think publication of this work should not be conditioned on such study but again adding would make the work much stronger.

      We appreciate the reviewer’s comments and agree that investigating the molecular mechanisms driving the phenotypic changes identified in this work is a compelling proposition. Throughout the manuscript, we identify positions and specific amino acid substitutions that affect the measurable function of LacI, and occasionally discuss the biophysical effects that may underly these changes. We have expanded the discussion to include possible molecular-level effects.

      The dataset reported here identifies many potential candidates for molecular-level study, either computationally or experimentally. However, this manuscript is scoped to report a large-scale method to measure the genotype-phenotype landscape of an allosteric protein, and a limited investigation into the emergence of novel phenotypes that are identified in the landscape.

      1. Lastly a recent study PNAS v.116 pp.11265-74 (2019) explored a library of variants of E. coli Adenylate Kinase and showed the relationship between allosteric effects due to substrate inhibition and stability of the protein. Perhaps a similar relationship can explored in this case of LacI.

      We thank the reviewer for highlighting this publication. We agree with the reviewer that similar effects may play a role in the activity of LacI. Establishing such a relationship would require additional experimentation, and, we think, is outside the scope of the submitted manuscript. Although, we hope follow-up studies using this dataset will investigate this phenomenon and other related mechanisms, that may underlie the band-stop phenotype and other observed effects.

    2. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #3

      Evidence, reproducibility and clarity

      In this interesting manuscript the authors developed in ingenious high throughput screening approach which utilizes DNA barcoding to select variants of LacI proteins with different allosteric profiles for IPTG control using E. coli fitness (growth rate) in a range of antibiotic concentrations as a readout thus providing a genotype-phenotype map for this enzyme. The authors used library of 10^5-10^ variants of LacI expressed from a plasmid and screened for distinct IPTG activation profiles under different conditions including several antibiotic stressors. As a result they identified various patterns of activation including normal (sigmoidal increase), inverted (decrease) and unusual stop-band where the dependence of growth on [IPTG] is non-monotonic. The study is well-conceived, well executed and provides statistically significant results. The key advance provided by this work is that it allows to identify specific mutations in LacI connected with one of three allosteric profiles. The paper is clearly written all protocols are explained and it can be reproduced in a lab that possesses proper expertise in genetics.

      Significance

      The significance of this work is that it discovered libraries of LacI variants which give rise to distinct profiles of allosteric control of activation of specific genes (in this case antibiotic resistance) by the Lac mechanism. The barcoding technology allowed to identify specific mutations which are (presumably) causal of changes in the way how allosteric activation of LacI by IPTG works. As such it provides a rich highly resolved dataset of LacI variants for further exploration and analysis.

      Alongside with these strengths several weaknesses should also be noted:

      1. First and foremost the paper does not provide any molecular-level biophysical insights into the impact of various types of mutations on molecular properties of LacI. Do the mutations change binding affinity to IPTG? Binding side? Communication dynamics? Stability? The diagrams of connectivity for the stop-band mutations (Fig.4) do not provide much help as they do not tell much which molecular properties of LacI are affected by mutations and why certain mutations have specific effect on allostery. A molecular level exploration would make this paper much stronger.
      2. In the same vein a theoretical MD study would be quite illuminating in answering the key unanswered question of this work: Why do mutations have various and pronounced effects of allosteric regulation by LacI?. I think publication of this work should not be conditioned on sucgh study but again adding would make the work much stronger.
      3. Lastly a recent study PNAS v.116 pp.11265-74 (2019) explored a library of variants of E. coli Adenylate Kinase and showed the relationship between allosteric effects due to substrate inhibition and stability of the protein. Perhaps a similar relationship can explored in this case of LacI.
    3. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #2

      Evidence, reproducibility and clarity

      The authors use deep mutational scanning to infer the dose-response curves of ~60,000 variants of the LacI repressor and so provide an unprecedently systematic dataset of how mutations affect an allosteric protein. Overall this is an interesting dataset that highlights the potential of mutational scanning for rapidly identifying diverse variants of proteins with desired or unexpected activities for synthetic biology/bioengineering. The relatively common inverted phenotypes and their sequence diversity is interesting, as is the identification of several hundred genotypes with non-sigmoidal band-stop dose-response curves and their enrichment in specific protein regions. A weakness of the study is that some of the parameter estimates seem to have high uncertainty and this is not clearly presented or the impact on the conclusions analysed. A second shortcoming is that there is little mechanistic insight beyond the enrichments of mutations with different effects in different regions of the protein. But as a first overview of the diversity of mutational effects on the dose-response curve of an allosteric protein, this is an important dataset and analysis.

      Comments

      Data quality and reproducibility

      "The flow cytometry results confirmed both the qualitative and quantitative accuracy of the new method (Supplementary Figs. 3-7)"

      • There need to be quantitative measures of accuracy in the text here for the different parameters.
      • Sup fig 7 panels should be main text panels - they are vital for understanding the data quality In particular, the G0 parameter estimates from the library appear to have a lower bound ie they provide no information below a cytometry Go of ~10^4. This is an important caveat and needs to be highlighted in the main text. The Hill parameter (n) estimate for wt (dark gray) replicate barcodes is extremely variable - why is this?
      • In general there is not a clear enough presentation of the uncertainty and biases in the parameter estimations which seem to be rather different for the 4 parameters. Only the EC50 parameter seems to correlate very well with the independent measurements.
      • The genotypes in the mutagenesis library contain a mean of 4.4 aa substitutions and the authors us a neural network to estimate 3 of the Hill equation parameters (with uncertainties) for the 1991/2110 of the single aa mutations. It would be useful to have an independent experimental evaluation of the reliability of these inferred single aa mutational effects by performing facs on a panel of single aa mutants (using single aa mutants in sup fig 3-7, if there are any, or newly constructed mutants).
      • fig3/"Combining multiple substitutions in a single protein almost always has a log-additive effect on EC50." How additive are the other 2 parameters? this analysis should also be presented in fig 3. If they are not as additive is it simply because of lower accuracy of the measurements? If the mutational effects are largely additive, then a simple linear model (rather than the DNN) could be used to estimate the single mutant effects from the multiple mutant genotypes.

      Presentation/clarity of text and figures

      • The main text implies that the DNN is trained to predict 3 parameters of the Hill equation but not the Hill coefficient (n). This should be clarified / justified in the main text.
      • The DNN needs to be better explained and justified in the main text for a general audience. How do simpler additive models perform for phenotypic prediction / parameter inference?
      • Ref 14. analyses a much smaller set of mutants in the same protein but using an explicit biophysical model. It would be helpful to have a more extensive comparison with the approach and conclusions o this previous study.
      • Enrichments need statistical tests to know how unexpected that results are e.g. p5 line 12 "67% of strongly inverted variants have substitutions near the ligand-binding pocket"
      • missing citation: Poelwijk et al 2011 https://www.cell.com/fulltext/S0092-8674(11)00710-0 previously reported an inverted dose-response curve for a lacI mutant.
      • What mechanisms do the authors envisage that could produce the band-stop dose response curves? There is likely previous theoretical work that could be cited here. In general there is little discussion of the biophysical mechanisms that could underlie the various mutational effects.
      • "This result, combined with the wide distribution of residues that affect EC50, suggests that LacI allostery is controlled by a free energy balance with additive contributions from many residues and interactions." 'additive contributions and interactions' covers all possible models of vastly different complexity i.e. this sentence is rather meaningless.
      • fig 4 c and d compress a lot of information into one figure and I found this figure confusing. It may be clearer to have multiple panels with each panel presenting one aspect. It is also not clear to me what the small circular nodes exactly represent, especially when you have one smaller node connected to two polygonal nodes, and why they don't have the same colour scale as the polygonal nodes.
      • line 25 - 'causes a conformational change' -> 'energetic change' (allostery does not always involve conformational change
      • sup fig 5 legend misses '5'
      • sup fig 7. pls add correlation coefficients to these plots (and move to main text figures).
      • Reference 21 is just a title and pubmed link
      • "fitness per hour" -> growth rate
      • page 6 line 28 - "discoverable only via large-scale landscape measurements" - directed evolution approaches can also discover such genotypes (see e.g. Poelwijk /Tans paper). Please re-phrase.
      • pls define jargon the first time it is used e.g. band-stop and band-pass

      Methods/data availability/ experimental and analysis reproducibility:

      • The way that growth rate is calculated on page 17 equation 1- This section is confusing. Please be explicit about how you accounted for the lag phase, what the lag phase was, and total population growth during this time. In addition, please report the growth curves from the wells of the four plates, the final OD600 of the pooled samples, and exact timings of when the samples were removed from 37 degree incubation in a table. These are critical for calculating growth rate in individual clones downstream.
      • What were the upper and lower bounds of the measurements? (LacI deletion vs Tet deletion / autofluoresence phenotype - true 100% and true 0% activity). Knowing and reporting these bounds will also allow easier comparison between datasets in the future.
      • Please clarify whether there was only 1 biological replicate (because the plates were pooled before sequencing)? Or if there were replicates present an analysis of reproducibility.
      • Please provide supplementary tables of the data (in addition to the raw sequencing files). Both a table summarising the growth rates, inferred parameter values and uncertainties for genotypes and a second table with the barcode sequence counts across timepoints and associated experimental data.

      Significance

      The authors present an unprecedently systematic dataset of how mutations affect an allosteric protein. This illustrates the potential of mutational scanning for rapidly identifying diverse variants of allosteric proteins / regulators with desired or unexpected activities for synthetic biology/bioengineering.

      Previous studies have identified inverted dose-response curve for a lacI phenotypes https://www.cell.com/fulltext/S0092-8674(11)00710-0 but using directed evolution i.e. they were not comprehensive in nature.

      The audience of this study would be protein engineers, the allostery field, synthetic biologists and the mutation scanning community and evolutionary biologists interested in fitness landscapes.

      My relevant expertise is in deep mutational scanning and genotype-phenotype landscapes, including work on allosteric proteins and computational methods.

    4. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #1

      Evidence, reproducibility and clarity

      The authors study allostery with a beautiful genotype-phenotype experiment to study the fitness landscape of an allosteric lac repressor protein. The authors make a mutational library using error prone pcr and measure the impact on antibiotic resistance protein expression at varying levels of ligand, IPTG, expression. After measuring the impact of mutations authors fill-in the missing data using a neural net model. This type of dose response is not standard in the field, but the richness of their data and the discovery of the "band pass" phenomena prove its worth here splendidly.

      Using this mixed experimental/predicted data the authors explore how each mutation alters the different parameters of a hill equation fit of a dose response curve. Using higher order mutational space the authors look at how mutations can qualitatively switch phenotypes to inverted or band-stop dose-response curves. To validate and further explore a band-stop novel phenotype, the authors focused on a triple mutant and made all combinations of the 3 mutations. The authors find that only one mutation alone alters the dose-response and only in combination does a band-stop behavior present itself. Overall this paper is a fantastic data heavy dive into the allosteric fitness landscape of protein.

      Major

      Overall, the data presented in this paper is thoroughly collected and analyzed making the conclusions well-based. We do not think additional experiments nor substantial changes are needed apart from including basic experimental details and more biophysical rationale/speculation as discussed in further detail below.

      The authors do a genotype-phenotype experiment that requires extensive deep sequencing experiments. However, right now quite a bit of basic statistics on the sequencing is missing. Baseline library quality is somewhat shown in supplementary fig 2 but the figure is hard to interpret. It would be good to have a table that states how many of all possible mutations at different mutation depths (single, double, etc) there are. Similarly, sequencing statistics are missing- it would be useful to know how many reads were acquired and how much sequencing depth that corresponds to. This is particularly important for barcode assignment to phenotype in the long-read sequencing. In addition, a synonymous mutation comparison is mentioned but in my reading that data is not presented in the supplemental figures section.

      The paper is very much written from an "old school" allostery perspective with static end point structures that are mutually exclusive - eg. p5l10 "relative ligand-binding affinity between the two conformations" - however, an ensemble of conformations is likely needed to explain their data. This is especially true for the bandpass and inverted phenotypes they observe. The work by Hilser et al is of particular importance in this area. We would invite the authors to speculate more freely about the molecular origins of their findings.

      Minor

      There are a number of small modifications. In general this paper is very technical and could use with some explanation and discussion for relevance to make the manuscript more approachable for a broader audience.

      P1L23: Ligand binding at one site causes a conformational changes that affects the activity of another > not necessarily true - and related to using more "modern" statistical mechanical language for describing allostery.

      P2L20: The core experiment of this paper is a selection using a mutational library. In the main body the authors mention the library was created using mutagenic pcr but leave it at that. More details on what sort of mutagenic pcr was used in the main body would be useful. According to the methods error prone pcr was used. Why use er-pcr vs deep point mutational libraries? Presumably to sample higher order phenotype? Rationale should be included. Were there preliminary experiments that helped calibrate the mutation level?

      P2L20: Baseline library statistics would be great in a table for coverage, diversity, etc especially as this was done by error prone pcr vs a more saturated library generation method. This is present in sup fig2 but it's a bit complicated.

      P2L26: How were FACS gates drawn? This is in support fig17 - should be pointed to here.

      P3L4: Where is the figure/data for the synonymous SNP mutations? This should be in the supplement.

      P3L20: The authors use a ML learning deep neural network to predict variant that were not covered in the screen. However, the library generation method is using error prone pcr meaning there could multiple mutations resulting in the same amino acid change. The models performance was determined by looking at withheld data however error prone pcr could result in multiple nonsynomymous mutations of the same amino acid. For testing were mutations truly withheld or was there overlap? Because several mutations are being represented by different codon combinations. Was the withheld data for the machine learning withholding specific substitutions?

      In addition, higher order protein interactions are complicated and idiosyncratic. I am surprised how well the neural net performs on higher order substitutions.

      P4L4: Authors find mutations at the dimer/tetramer interfaces but don't mention whether polymerization is required. is dimerization required for dna binding? Tetramerization?

      P4L8: Substitutions near the dimer interface both impact g0 and ec50, which authors say is consistent with a change in the allosteric constant. Can authors explain their thinking more in the paper to make it easier to follow? Are the any mutations in this area that only impact g0 or ec50 alone? Why may these specific residues modify dimerization?

      P4L8: The authors discuss the allosteric constant extensively within the paper but do not explain it. It would be helpful to have an explanation of this to improve readability. This explanation should include the statistical mechanical basis of it and some speculation about the ways it manifests biophysically.

      P4L1-16: Authors see mutations in the dimerization region that impact either G0 and Gsaturated in combination with Ec50 but not g0 and gsaturated together. Maybe we do not fully understand the hill equation but why are there no mutations that impact both g0 and gsaturated seen in support fig 13c? Why would mutations in the same region potentially impacting dimerization impact either g0 or gsaturated? What might be the mechanism behind divergent responses?

      P4L29: for interpretability it would be good to explain what log-additive effect means in the context of allostery.

      P4L34-P5L19: This section is wonderful. Really cool results and interesting structural overlap!

      P5L34 Helix 9 of the protein is mentioned but it's functional relevance is not. This is common throughout the paper - it would be useful for there to be an overview somewhere to help the reader contextualize the results with known structural role of these elements.

      P5L39: The authors identified a triple mutant with the band-stop phenotype then made all combination of the triple mutant. Of particular interest is R195H/G265D which is nearly the same as the triple mutant. It would be nice if the positions of each of these mutations and have some discussion to begin to rationalize this phenotype, even if to point out how far apart they are and that there is no easy structural rationale!

      P6L9: There should be more discussion of the significance of this work directly compared to what is known. For instance negative cooperativity is mentioned as an explanation for bi-phasic dose response but this idea is not explained. Why would the relevant free energy changes be more entropic? Another example is the reverse-TetR phenotype observed by Hillen et al.

      P6L28: The authors mention that phenotypes exist with genotypes that are discoverable with genotype-phenotype landscapes. This study due to the constraints of error prone pcr were somewhat limited. How big is the phenotypic landscape? Is it worth doing a more systematic study? What is the optimal experimental design: Single mutations, doubles, random - where is there the most information. How far can you drift before your machine learning model breaks down? How robust would it be to indels?

      Figures:

      Sup figs 3-7: The comparison of library-based results and single mutants is a great example of how to validate genotype-phenotype experiments!

      Supp fig 5.: Missing figure number.

      Supp fig7: G0 appears to have very poor fit between library vs single mutant version. Why might this be? R^2 would likely be better to report here as opposed to RMSE as RMSE is sensitize to the magnitude of the data such that you cannot directly compare RMSE of say 'n' to G0.

      Sup fig13c: it is somewhat surprising that mutations only appear to effect g0 and not gsaturated. This implies that basal and saturated activity are not coupled. Is this expected? Why or why not?

      Significance

      Allostery is hard to comprehend because it involves many interacting residues propagating information across a protein. The Monod-Wyman-Changeux (MWC) and Koshland, Nemethy, and Filmer (KNF) models have been a long standing framework to explain much of allostery, however recent formulations have focused on the role of the conformational ensemble and a grounding in statistical mechanics. This manuscript focuses on the functional impact of mutations and therefore contribution of the amino acids to regulation. The authors unbiased approach of combining a dose-response curve and mutational library generation let them fit every mutant to a hill equation. This approach let the authors identify the allosteric phenotype of all measured mutations! The authors found inverted phenotypes which happen in homologs of this protein but most interesting is the strange and idiosyncratic 'Band-stop' phenotype. The band-stop phenotype is bi-phasic that will hopefully be followed up with further studies to explain the mechanism. This manuscript is a fascinating exploration of the adaptability of allosteric landscapes with just a handful of mutations.

      Genotype-phenotype experiments allow sampling immense mutational space to study complex phenotypes such as allostery. However, a challenge with these experiments is that allostery and other complicated phenomena come from immense fitness landscapes altering different parameters of the hill equation. The authors approach of using a simple error prone pcr library combined with many ligand concentrations allowed them to sample a very large space somewhat sparsely. However, they were able to predict this data by training and using a neural net model. I think this is a clever way to fill in the gaps that are inherent to somewhat sparse sampling from error prone pcr. The experimental design of the dose response is especially elegant and a great model for how to do these experiments.

      With some small improvements for readability, this manuscript will surely find broad interest to the genotype-phenotype, protein science, allostery, structural biology, and biophysics fields.

      We were prompted to do this by Review Commons and are posting our submitted review here:

      Willow Coyote-Maestas has relevant expertise in high throughput screening, protein engineering, genotype-phenotype experiments, protein allostery, dating mining, and machine learning.

      James Fraser has expertise in structural biology, genotype-phenotype experiments, protein allostery, protein dynamics, protein evolution, etc.

      Referees cross-commenting

      Seems like our biggest issues are: better uncertainty estimates of the parameters and more biophysical/mechanistic explanation/speculation. The uncertainty estimates might be tricky with the deep learning approach. The more biophysical speculation will require some re-writing around an ensemble rather than a static structure perspective.

    1. Note: This rebuttal was posted by the corresponding author to Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Reply to the reviewers

      *Reviewer #1 (Evidence, reproducibility and clarity (Required)):**

      This study addresses the role IL-13 in promoting lung damage following migration of the helminth N. brasiliensis larvae from the circulatory system to the lung. The work clearly shows using IL13-/- mice that Nb elicited IL-13 immunity at days 2-6 post-infection reduces pathology. The authors demonstrate an association with reduced eosinophils but no effect on neutrophil numbers.

      Proteomic analysis identifies a number of molecules known to be involved in protecting against type 2 pathologies such as relm-a and SP-D.

      The authors then identify a clear requirement for IL-13 in driving relm-a expression.

      Finally, the authors present a whole lung RNA transcript profile which largely supports their proteomic observations.

      Taken together the work presents a sound case for IL-13 being an important player in protecting against initial lung pathology.

      **Major requests:**

      The paper is really very interesting and important. To an extent it questions existing dogma of IL-13 being a driver of lung inflammation.

      Addressing the following could hopefully be achieved using archived samples or with an acceptable amount of extra experimental work.

      Figure 1: D2 and D6 Lung IL-13 concentrations (ELISA) in WT mice would set the scene for the papers story*

      We agree that showing IL-13 concentrations in the lung would nicely set the stage for the role of IL-13 during __Nippostrongylus__ infection. In the current paper, we showed IL-13 mRNA levels in Figure 3 but in a revised version, we will include D2 and D6 mRNA data in Figure 1. We attempted to quantify IL-13 protein levels in the BAL fluid of infected WT mice on D2 and D6 post-infection. However, IL-13 in the BAL was below the levels of detection for our ELISA assay. Therefore, we would need to measure IL-13 protein in total lung homogenates but we do not have material archived at present. If the editor feels this is a critical piece of data we will perform repeat experiments.

      Figure 2: The authors should add evidence that function/activity of neutrophils/eosinophils is changed/not changed: e.g. granzyme, MBP, EPO release in BAL and/or lung.

      As supported by referee 3, we feel that measuring functional readouts of neutrophils and eosinophils, while interesting, is currently outside of the scope of the paper. Further, with respect to eosinophils, we see a major reduction in total eosinophil numbers in IL-13-deficient mice which would likely result in a reduction in the level of functional molecules such as MBP. Thus, these readouts in the BAL may not be a reliable indicator of cellular function and results difficult to interpret in light of altered cell numbers.

      Additionally, some data showing changes in epithelial stress related cytokines such as IL-23 and IL-33 would be informative (IHC and /or ELISA).

      The reviewer makes a good suggestion that would complement our proteomics/pathway analysis. As described in our comment below regarding Foxa2 pathways, we do have additional data showing epithelial cell defects in the absence of IL-13 and will add this to a revised manuscript. While we do see a trend for a reduction in IL-33 mRNA in infected IL-13-deficient mice, it is difficult to correlate this with functional protein. If requested, we can perform additional analyses to measure IL-23 and/or IL-33 protein levels in archived BAL fluid or by IHC of lung sections.

      *The following will require a new experiment:

      The authors present a strong case for RELMa being associated with/driven by IL-13 responses. The following I feel would prove that IL-13 driven RELMa is important in reducing lung pathology. Can enhanced lung pathology or cell responses associated with pathology be reduced/altered by dosing Nb infected IL13-/- mice with recombinant relma or by restimulating BAL cells (for example) from IL-13-/- mice. This team is well placed to comment on the potential for such an in vivo experiment to be feasible.

      Or could the authors could also test the ability for other candidate molecules to reduce lung pathology? Would for example i/n dosing of IL-13-/- mice with AMCase, BRP39 or SP-D protect against pathology? It would be expected to be the case for SP-D.*

      Our previous study has shown that RELM-__a plays an important yet highly complex role during lung repair (see Sutherland et al. 2018: https://doi.org/10.1371/journal.ppat.1007423____). The suggested experiments would advance our understanding of the function of RELM-a and other effector molecules during type 2 immunity and repair. However, it is unlikely that the impact of IL-13 will be due to a single effector molecule (as supported by Reviewer 3) and thus these types of experiments would shift the focus of the paper from the impact of IL-13 to understanding specific function of type 2 effectors. Since our study deals more broadly with the function of IL-13 rather than the downstream effectors, we hope that this will open up further investigation of these specific molecules to the wider community to take forward.__

      *Reviewer #1 (Significance (Required)):

      The manuscript places IL-13 as an important initiator of early protection from acute lung damage. This is important as it is to an extent a non-canonical role for this cytokine. This is also important as IL-13 can be manipulated therapeutically. To maximise potential application of such drugs requires detailed understanding of the various contextual roles of IL-13. This study provides such evidence.

      The authors identify a range of target mediators.

      This is an important body of work that is useful for understanding how acute lung damage can be regulated.

      This work will be of interest to Type 2 immunologists, any researcher with an interest in pulmonary inflammation as well as mucosal immunity.

      I make these suggestions/comments based on my own background in Type 2 immunity, lung inflammation and parasitic helminth infection and immunity.

      Reviewer #2 (Evidence, reproducibility and clarity (Required)):

      In this manuscript, Chenery et al report that IL-13 plays a critical role in protecting mice from lung damage caused by the infection of a nematode, Nippostrongylus Brasiliensis, in WT or IL-13 knockout mice (IL-13 eGFP knock-in mice, Neill et al., Nature 2010). Phenotypically, they demonstrated that IL-13 genetic deficiency resulted in more severe lung injuries and haemorrhaging following the larvae migratory infections. Through the proteomic and transcriptomic profiling, they identified gene-expression changes involved in the cellular stress responses, e.g. up-regulating the expression of epithelial-derived type 2 molecules, controlled by IL-13. They also found that type 2 effector molecules including RELM-alpha and surfactant protein D were compromised in IL-13 knockout mice. Thus, they proposed that IL-13 has tissue-protective functions during lung injury and regulates epithelial cell responses during type 2 immunity in this acute setting. Overall, the manuscript was clearly written and a number of findings were interesting and expected compared to the published knowledge. However, this work could be improved and more impactful by further performing the following suggested experiments.

      Major points:

      1. It may not be accurate to claim that "IL-13 played a critical role in limiting tissue injury ... in the lung following infection" since IL-13 participates in both repelling worms and activating tissue reparative responses. It is very hard to distinguish these two kinds of responses with the current experimental settings because the much higher worm burden led to more direct lung damage in IL-13-/- mice than WT counterparts.*

      The reviewer raises an important point that we will need to clarify in a revised manuscript. Based on several studies, the role of IL-13 in mediating __Nippostrongylus expulsion occurs in the small intestine, after the parasites have already cleared the lung tissue. The number of worms in the lung do not differ at the time points we are investigating. We have qRT-PCR data measuring Nippostrongylus__-specific actin levels, which we and others have previously shown to accurately reflect worm numbers. We can therefore demonstrate that the differences in lung damage do not reflect a difference in the number of larvae in the lungs of IL-13 KO mice compared to WT mice. These data will be incorporated into the manuscript to better clarify this point.

      1. It would be more informative if the authors could perform the RNA-seq analysis on the IL-13-responsive cell type such as airway epithelial cells (goblet cell) by comparing WT vs IL13-/- in the context of lung damage caused by Nitrostrongylus Brasiliensis infection.*

      RNA-sequencing of specific cells would indeed be an excellent experiment that would reveal more IL-13-depedendent processes in our model. However, this would be a considerable undertaking at this stage (as reviewer 3 has pointed out). Nonetheless, our extended analysis of the Foxa2 pathway as requested below has highlighted a number of genes regulated by IL-13, which are known to be involved in epithelial cell function.

      We agree with the reviewer that showing additional validation data to support the Foxa2 defect in IL-13-deficient mice would strengthen our paper’s overall message. We have additional qRT-PCR data of IL-13-dependent genes regulated by Foxa2 (__Clca1, Muc5ac, Ccl11, and Foxa3__) that clearly support this epithelial cell-specific defect that we can readily incorporate into the revised paper.

      *Reviewer #2 (Significance (Required)):

      Overall, the manuscript was clearly written and a number of findings were interesting and expected compared to the published knowledge.

      **Referees cross-commenting**

      To Reviewer #1's Review: fair and constructive

      To Reviewer #3's Review: agree in general.*

      * Reviewer #3 (Evidence, reproducibility and clarity (Required)):

      In this study, Allen, Sutherland and colleagues utilize IL-13 deficient mice to investigate the function of IL-13 in the early response to lung tissue damage induced by helminth infection. They demonstrate that IL-13 deficiency has significant effects on the acute tissue response to helminth infection (at day 2 and 6 post-infection). Particularly, IL-13 deficiency results in increased lung hemorrhaging, and more pronounced lung tissue damage evidenced by increased gaps in the alveolar architecture. They perform proteomic and transcriptomic profiling of the lungs to determine IL-13-induced pathways and demonstrate many protein and gene expression changes in the absence of IL-13. These include dysregulated collagens, reduced epithelial-derived proteins RELMalpha and surfactant protein D, downregulated pathways related to cellular stress, and increased genes associated with the Foxa2 pathway.

      Overall, the key conclusions are convincing, and the study design, methods and data analysis are clear, rigorous and thorough.

      **Minor Comments:**

      1. The authors concluded that lung epithelial cells are more sensitive to IL-13 than IL-4, but the intranasal injection of both proteins showed a similar induction of RELMα - investigation into this difference would be useful. Alternatively, providing an explanation for these different findings could be helpful.*

      Our suggestion that epithelial cells are likely to be more sensitive to IL-13 was based both on our data and the existing literature. We would agree that we do not have definitive evidence for this. Indeed, because the type 2 receptor can respond to both IL-4 and IL-13 this issue is difficult to easily resolve experimentally. We will expand on this in a revised manuscript, making our explanations clearer whilst acknowledging the alternative explanations.

      This is a good suggestion and we have additional flow cytometry data looking at hematopoietic cell expression of RELM-__a from these experiments that we can incorporate into the revised manuscript. We have found that airway macrophages were another source of RELM-a__ in the lung and mirrored the airway epithelial cell responses to both intraperitoneal and intranasal delivery of IL-4 and IL-13.

      We agree that a comparison of IL-13Ra1 versus IL-13 deficiency should be included in the discussion of our manuscript. These authors found epithelial-specific defects in IL-13Ra1-deficient mice such as Clca1 (aka Clca3), RELM-__a, and chitinase-like proteins even under homeostatic conditions, which is highly consistent with our data. This study also found that IL-13Ra1 deficiency led to increased bleomycin-induced pathology and together with our data, offers further insight into the IL-13/IL-13Ra__1 axis during lung injury. We will add these points to our discussion and will attempt to directly compare their gene expression data set with our data to find more overlapping genes between the two mouse strains and disease models.

      This is indeed a very important point we will address in a revised discussion. IL-4R__a-deficient mice did show increased bleeding in the Chen et al. study that was not seen in the IL-13Ra__1 KO suggesting IL-4 alone is sufficient to limit bleeding. This is in contrast to our study where we found increased bleeding in IL-13 KO mice independent of IL-4. However, a major difference between the studies is the background strain of mice used, which was BALB/c in the Chen et al. study versus C57BL/6 mice we used in our study. In addition to differences in IL-4 and IL-13 levels between the strains, we have unpublished observations of major differences in vascular integrity with BALB/c much more prone to bleeding, which is an active area of investigation in the lab. Although we have yet to unravel these differences mechanistically, they could explain differential requirements for IL-4 versus IL-13 to limit bleeding between the two strains.

      Our apologies, we will fix the reference duplication.

      *Reviewer #3 (Significance (Required)):

      This study addresses the specific function of IL-13 in acute helminth infection of the lung, which has not previously been studied, as most studies investigate the combined function of IL-4 and IL-13 through IL-4 receptor KO or Stat6 KO mice.

      It is a thorough, well-conducted and well-organized study with high quality data using 'omics' strategies to profile IL-13-induced genes and proteins. Their data identifies intriguing pathways that are dependent on IL-13, opening new avenues to explore for IL-13-mediated protective roles in acute lung tissue damage. Therefore this study provides conceptual and technical advances. Additionally, since targeting IL-4 and IL-13 are in clinical trials or employed therapeutically for pulmonary disorders, the findings from these studies are clinically relevant. It would however have been useful to validate some of these pathways and demonstrate epithelial-specific outcomes for IL-13-induced tissue protection.

      Previous studies using IL4RKO have shown that IL-4 and IL-13 are necessary to protect from acute tissue damage in helminth infection (Chen, Nature medicine - referred to by authors). Other studies have investigated IL-13 in fibrosis and granulomatous inflammation (papers referenced by authors, and Ramalingam Nature Immunology 2009). Last, one study shows that IL-13Ra1 signaling is important for protection in bleomycin-induced lung injury, findings using a different transgenic mouse, which are relevant for this study and may be useful to discuss (Karo-Atar, Mucosal Immunology 2016).

      As stated above - the data in this manuscript identify intriguing pathways that are dependent on IL-13, opening new, exciting avenues to explore for IL-13-mediated protective roles in acute lung tissue damage. Their data is also unique as it combines proteomics and transcriptomics, and identities previously unappreciated IL-13 regulated pathways such as cellular stress and Foxa2, which would be interesting to investigate further.

      **Referees cross-commenting**

      To Reviewer 1: The suggested data for Figure 1 (IL-13 concentrations) could be useful, but suggested experiments for Figure 2 could be outside the main focus of the paper.

      For the main suggested experiment: treatment of IL-13-/- with RELMalpha, this could be useful, One caveat is that RELMalpha might not be the only effector molecule downstream of IL-13 so the authors may not get a definitive answer. An alternative (although not as RELMalpha-specific) would be to treat IL13KO mice with FcIL-4 or FcIL-13 - the latter that drives RELMalpha, and look at whether FcIL-13 is more protective than FcIL-4.*

      We agree that rescue experiments could provide insights into the relative protective effects of IL-4 versus IL-13. However, it might be challenging to interpret the results in part because of the difficulty in establishing physiologically relevant doses and timing and the fact that IL-4 will also signal through the type 2 receptor. These difficulties are reflected in the interpretation of our current data as discussed above (pt. 1 reviewer 3). Although we have found IL-4 and IL-13 delivery experiments valuable and have used them in many of our papers, we have always been cautious in our interpretation, as we typically use these at super-physiological doses. However, this is an experiment we would consider if the editors felt it essential to the story.

      To Reviewer 2: I agree with points 1 and 3 - especially with point 3, which would give more in-depth understanding into the functional outcomes of the IL-13 -> FoxA2 pathway identified. For point 2, RNA-seq of epithelial cells would be informative, but may be beyond the scope of the project.

    2. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #3

      Evidence, reproducibility and clarity

      In this study, Allen, Sutherland and colleagues utilize IL-13 deficient mice to investigate the function of IL-13 in the early response to lung tissue damage induced by helminth infection. They demonstrate that IL-13 deficiency has significant effects on the acute tissue response to helminth infection (at day 2 and 6 post-infection). Particularly, IL-13 deficiency results in increased lung hemorrhaging, and more pronounced lung tissue damage evidenced by increased gaps in the alveolar architecture. They perform proteomic and transcriptomic profiling of the lungs to determine IL-13-induced pathways and demonstrate many protein and gene expression changes in the absence of IL-13. These include dysregulated collagens, reduced epithelial-derived proteins RELMalpha and surfactant protein D, downregulated pathways related to cellular stress, and increased genes associated with the Foxa2 pathway.

      Overall, the key conclusions are convincing, and the study design, methods and data analysis are clear, rigorous and thorough.

      Minor Comments:

      1. The authors concluded that lung epithelial cells are more sensitive to IL-13 than IL-4, but the intranasal injection of both proteins showed a similar induction of RELMα - investigation into this difference would be useful. Alternatively, providing an explanation for these different findings could be helpful.
      2. Providing data by immunofluorescence or flow cytometry of non-epithelial expression of RELMalpha following intranasal versus intraperitoneal injection of IL-4 versus IL-13 would be useful.
      3. Discussion of IL-13Ra1 deficient mice would be useful, in particular the study by Karo-Atar and Munitz in Mucosal Immunology 2016, showing that IL13Ra1 is protective against bleomycin-induced pulmonary injury (PMID: 26153764). Comparing their data with the gene expression datasets from this study would be useful (acknowledging the caveat that IL-4 effects through the type 2 receptor would also be abrogated in these IL13Ra1 mice).
      4. The authors reference Chen et al. Nature Medicine 2012, but do not discuss the finding in this paper that neither IL-4-/- nor IL13Ra1-/- have increased lung hemorrhage. This might be a mouse strain issue and worthwhile discussing.
      5. Reference 32 and 36 (Sutherland PLoS pathogens) are duplicates

      Significance

      This study addresses the specific function of IL-13 in acute helminth infection of the lung, which has not previously been studied, as most studies investigate the combined function of IL-4 and IL-13 through IL-4 receptor KO or Stat6 KO mice.

      It is a thorough, well-conducted and well-organized study with high quality data using 'omics' strategies to profile IL-13-induced genes and proteins. Their data identifies intriguing pathways that are dependent on IL-13, opening new avenues to explore for IL-13-mediated protective roles in acute lung tissue damage. Therefore this study provides conceptual and technical advances. Additionally, since targeting IL-4 and IL-13 are in clinical trials or employed therapeutically for pulmonary disorders, the findings from these studies are clinically relevant. It would however have been useful to validate some of these pathways and demonstrate epithelial-specific outcomes for IL-13-induced tissue protection.

      Previous studies using IL4RKO have shown that IL-4 and IL-13 are necessary to protect from acute tissue damage in helminth infection (Chen, Nature medicine - referred to by authors). Other studies have investigated IL-13 in fibrosis and granulomatous inflammation (papers referenced by authors, and Ramalingam Nature Immunology 2009). Last, one study shows that IL-13Ra1 signaling is important for protection in bleomycin-induced lung injury, findings using a different transgenic mouse, which are relevant for this study and may be useful to discuss (Karo-Atar, Mucosal Immunology 2016).

      As stated above - the data in this manuscript identify intriguing pathways that are dependent on IL-13, opening new, exciting avenues to explore for IL-13-mediated protective roles in acute lung tissue damage. Their data is also unique as it combines proteomics and transcriptomics, and identities previously unappreciated IL-13 regulated pathways such as cellular stress and Foxa2, which would be interesting to investigate further.

      Referees cross-commenting

      To Reviewer 1: The suggested data for Figure 1 (IL-13 concentrations) could be useful, but suggested experiments for Figure 2 could be outside the main focus of the paper.

      For the main suggested experiment: treatment of IL-13-/- with RELMalpha, this could be useful, One caveat is that RELMalpha might not be the only effector molecule downstream of IL-13 so the authors may not get a definitive answer. An alternative (although not as RELMalpha-specific) would be to treat IL13KO mice with FcIL-4 or FcIL-13 - the latter that drives RELMalpha, and look at whether FcIL-13 is more protective than FcIL-4.

      To Reviewer 2: I agree with points 1 and 3 - especially with point 3, which would give more in-depth understanding into the functional outcomes of the IL-13 -> FoxA2 pathway identified. For point 2, RNA-seq of epithelial cells would be informative, but may be beyond the scope of the project.

    3. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #2

      Evidence, reproducibility and clarity

      In this manuscript, Chenery et al report that IL-13 plays a critical role in protecting mice from lung damage caused by the infection of a nematode, Nippostrongylus Brasiliensis, in WT or IL-13 knockout mice (IL-13 eGFP knock-in mice, Neill et al., Nature 2010). Phenotypically, they demonstrated that IL-13 genetic deficiency resulted in more severe lung injuries and haemorrhaging following the larvae migratory infections. Through the proteomic and transcriptomic profiling, they identified gene-expression changes involved in the cellular stress responses, e.g. up-regulating the expression of epithelial-derived type 2 molecules, controlled by IL-13. They also found that type 2 effector molecules including RELM-alpha and surfactant protein D were compromised in IL-13 knockout mice. Thus, they proposed that IL-13 has tissue-protective functions during lung injury and regulates epithelial cell responses during type 2 immunity in this acute setting. Overall, the manuscript was clearly written and a number of findings were interesting and expected compared to the published knowledge. However, this work could be improved and more impactful by further performing the following suggested experiments.

      Major points:

      1. It may not be accurate to claim that "IL-13 played a critical role in limiting tissue injury ... in the lung following infection" since IL-13 participates in both repelling worms and activating tissue reparative responses. It is very hard to distinguish these two kinds of responses with the current experimental settings because the much higher worm burden led to more direct lung damage in IL-13-/- mice than WT counterparts.
      2. It would be more informative if the authors could perform the RNA-seq analysis on the IL-13-responsive cell type such as airway epithelial cells (goblet cell) by comparing WT vs IL13-/- in the context of lung damage caused by Nitrostrongylus Brasiliensis infection.
      3. Figure 6C, the transcriptional profiling of mouse lungs revealed that the Foxa2 pathway was significantly up-regulated in the IL-13-/- infected mice. This is an important finding because this pathway plays a critical role in the process of alveolarization and inhibiting goblet cell hyperplasia. In order to validate this finding, some components in this pathway could be further examined.

      Significance

      Overall, the manuscript was clearly written and a number of findings were interesting and expected compared to the published knowledge.

      Referees cross-commenting

      To Reviewer #1's Review: fair and constructive

      To Reviewer #3's Review: agree in general.

    4. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #1

      Evidence, reproducibility and clarity

      This study addresses the role IL-13 in promoting lung damage following migration of the helminth N. brasiliensis larvae from the circulatory system to the lung. The work clearly shows using IL13-/- mice that Nb elicited IL-13 immunity at days 2-6 post-infection reduces pathology. The authors demonstrate an association with reduced eosinophils but no effect on neutrophil numbers.

      Proteomic analysis identifies a number of molecules known to be involved in protecting against type 2 pathologies such as relm-a and SP-D.

      The authors then identify a clear requirement for IL-13 in driving relm-a expression.

      Finally, the authors present a whole lung RNA transcript profile which largely supports their proteomic observations.

      Taken together the work presents a sound case for IL-13 being an important player in protecting against initial lung pathology.

      Major requests:

      The paper is really very interesting and important. To an extent it questions existing dogma of IL-13 being a driver of lung inflammation.

      Addressing the following could hopefully be achieved using archived samples or with an acceptable amount of extra experimental work.

      Figure 1: D2 and D6 Lung IL-13 concentrations (ELISA) in WT mice would set the scene for the papers story

      Figure 2: The authors should add evidence that function/activity of neutrophils/eosinophils is changed/not changed: e.g. granzyme, MBP, EPO release in BAL and/or lung. Additionally, some data showing changes in epithelial stress related cytokines such as IL-23 and IL-33 would be informative (IHC and /or ELISA).

      The following will require a new experiment:

      The authors present a strong case for RELMa being associated with/driven by IL-13 responses. The following I feel would prove that IL-13 driven RELMa is important in reducing lung pathology. Can enhanced lung pathology or cell responses associated with pathology be reduced/altered by dosing Nb infected IL13-/- mice with recombinant relma or by restimulating BAL cells (for example) from IL-13-/- mice. This team is well placed to comment on the potential for such an in vivo experiment to be feasible.

      Or could the authors could also test the ability for other candidate molecules to reduce lung pathology? Would for example i/n dosing of IL-13-/- mice with AMCase, BRP39 or SP-D protect against pathology? It would be expected to be the case for SP-D.

      Significance

      The manuscript places IL-13 as an important initiator of early protection from acute lung damage. This is important as it is to an extent a non-canonical role for this cytokine. This is also important as IL-13 can be manipulated therapeutically. To maximise potential application of such drugs requires detailed understanding of the various contextual roles of IL-13. This study provides such evidence.

      The authors identify a range of target mediators.

      This is an important body of work that is useful for understanding how acute lung damage can be regulated.

      This work will be of interest to Type 2 immunologists, any researcher with an interest in pulmonary inflammation as well as mucosal immunity.

      I make these suggestions/comments based on my own background in Type 2 immunity, lung inflammation and parasitic helminth infection and immunity.

    1. Note: This rebuttal was posted by the corresponding author to Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Reply to the reviewers

      We thank the reviewers for carefully reading our manuscript. We found their comments to be incredibly thoughtful and constructive and greatly appreciate their feedback. We are confident that addressing the reviewers’ concerns will strengthen our manuscript.

      Reviewer #1 (Evidence, reproducibility and clarity (Required)):

      In this manuscript entitled 'Combinatorial patterns of graded RhoA activation and uniform F-actin depletion promote tissue curvature' by Denk-Lobnig et al. the authors study the organisation of junctional F-actin during the process of mesoderm invagination during gastrulation in the model Drosophila. Following on from previous work by the same lab that identified and analysed a multicellular myosin II gradient across the mesoderm important for apical constriction and tissue bending, the authors now turn their attention to actin. Using imaging of live and fixed samples, they identify a patterning of F-actin intensity/density at apical junctions that they show is dynamically changing going into mesoderm invagination and is set up by the upstream transcription factors driving this process, Twist and Snail. They go on to show, using genetic perturbations, that both actin and the previously described myosin gradient are downstream of regulation and activation by RhoA, that in turn is controlled by a balance of RhoGEF2 activation and RhoGAP C-GAP inactivation. The authors conclude that the intricate expression patterns of all involved players, that all slightly vary from one another, is what drives the wild-type distinctive cell shape changes in particular rows of cells of the presumptive mesoderm and surrounding epidermis.

      This is a very interesting study analysing complex and large-scale cell and tissue shape changes in the early embryo. Much has been learned over the last decade and more about many of the molecular players and their particular behaviours that drive the process, but how all upstream regulators work together to achieve a coordinated tissue-scale behaviours is still not very well understood, and this study add important insights into this.

      The experiments seem well executed and support the conclusion drawn, but I have a few comments and questions that I feel the authors should address to strengthen their argument.

      We thank the reviewer for their interest in the paper and their helpful comments.

      **General points:**

      1. The authors state early on that they chose to focus on junctional rather than apical medial F-actin, but it is unclear to me really what the rationale behind that is. In much of the authors earlier work, they study the very dynamic behaviour of the apical-medial actomyosin that drives the apical cell area reduction in mesodermal cells required for folding. They have previously analysed F-actin in the constricting cells, but have only focused on the most constricting central cell rows (Coravos, J. S., & Martin, A. C. (2016). Developmental Cell, 1-14). The role of junctional F-actin compared to the apical-medial network on which the myosin works to drive constriction is much less clear, it could stabilize overall cell shape or modulate physical malleability or compliance of cells, or it could more actively be involved in implementing the 'ratchet' that needs to engage to stabilise a shrunken apical surface. I would appreciate more explanation or guidance on why the authors chose not to investigate apical-medial F-actin across the whole mesoderm and adjacent ectoderm, but rather focused in junctional F-actin, especially explaining better throughout what they think the role of the junctional F-actin they measure is.

      We focused on the junctional/lateral F-actin pool because this is where tissue-wide patterns in intensity variation are observed, especially when looking across the mesoderm-ectoderm boundary. Indeed, when we compare the apical-medial F-actin of marginal mesoderm cells to ectoderm cells in cross sections, we find no apparent difference, whereas there is a striking difference in junctional/lateral F-actin density (Fig. 1B, C; Supplemental Fig. 1A, D). We provide some preliminary en face views of the medial-apical surface in our response to Point 2, and we will obtain higher resolution images from live and fixed embryos to better show the network organization. We agree with the reviewer that this requires added justification. Therefore, we will: 1) Provide higher resolution images of apical-medial F-actin comparing different regions of mesoderm and ectoderm, and 2) revise the text to better justify why we chose junctional/lateral F-actin to focus our tissue-level analysis and to elaborate more on what we think the role of junctional/lateral F-actin in this process may be.

      Comparing the F-actin labeling in the above previous paper to the stainings/live images shown here, they look quite different. This is most likely due to the authors here not showing the whole apical area but focusing on junctional, i.e. below the most apical region. It is not completely clear to me from the paper at what level along the apical-basal axis the authors are analysing the junctional F-actin. Supplemental Figure 2 seems to suggest about half-way down the cell, which would be below junctional levels. Could the authors indicate this more clearly, please? Overall, I would appreciate if the authors could supply some more high-resolution images of F-actin from fixed samples (which I assume will give the better resolution) of how F-actin actually looks in the different cells with differing levels. Is there for instance a visible change to F-actin organisation? And could this help explain the observed changes in intensity and their function?

      We apologize for the confusion, we were referring to ‘junctions’ as the lateral contacts between cells, as opposed to the adherens junctions at the apical surface. We have modified the text to use the term ‘lateral’ rather than ‘junctional’ F-actin, so as to avoid this confusion. The difference in cortical F-actin staining is not restricted to a particular apical-basal position, but extends along the length of the lateral domain (Fig. 1B, C). As far as we can tell the actin is bundled and underlies the entire cell circumference. We will: 1) better define the apical-basal position within the cell that we are showing, and 2) show high-resolution en face images of F-actin at different apical-basal positions, across different cell positions, in live and fixed embryos to better justify our focus on lateral F-actin (similar orientation, but higher resolution/quality than preliminary live data below).

      Along the same lines of thought as in point 2): Dehapiot et al. (Dehapiot, B., ... & Lecuit, T. (2020). Assembly of a persistent apical actin network by the formin Frl/Fmnl tunes epithelial cell deformability. Nature Cell Biology, 1-21) have recently shown for the process of germband extension and amnioserosa contraction that two pools of F-actin can be observed, a persistent pool not dependent on Rho[GTP] and a Rho-[GTP] dependent one. Could the authors comment on what they think might occur in the mesoderm, are similar pools present here as well?

      1. As the authoirs state themselves, Rho does not only affect actin via diaphanous, but of course also myosin via Rock. So it would be good to refelect this more in the interpretation and discussion of data, as the causal timeline could be complex.

      We thank the reviewer for reminding us to address this point and to discuss this excellent recent paper. We have not observed a persistent medial actin network in mesoderm cells or ectoderm cells at this stage (i.e. prior to germband extension). It was previously shown in mesoderm cells that pulsed myosin contractions condense the medio-apical F-actin network, but that this is often followed by F-actin network remodeling and that total F-actin levels decrease during apical constriction (Mason et al., 2013). Furthermore, Rho-kinase inhibition in mesoderm cells significantly disrupts this network, but does not inhibit the rapid assembly and disassembly of apical F-actin cables, which could reflect elevated actin turnover (Mason et al., 2013; Jodoin et al., 2015). To address the reviewer’s points, we 1) now include a paragraph in the Discussion to discuss the Dehapiot et al. paper (Comment 3) and the possible roles of various pools of F-actin and Rock/myosin shape the tissue (Comment 4) (lines 404-408), and 2) will image the apical surface of mesoderm and ectoderm at this stage and also germband extension (as a positive control) in order to determine whether there is a persistent network.

      **More specific comments to experiments and figures:**

      1. Reduction of junction function by alpha-catenin-RNAi: how strong is the reduction in catenin? Could they label a-catenin in fixed embryos? The authors conclude the original pre-constriction patterning of F-actin intensity is not dependent on intact junctions, but they show that the increase in F-actin in the mesodermal cells concomitant with apical constriction is in fact impaired in the RNAi. Thus, the authors can also not conclude whether the continued accumulation of myosin and its persistence depend on intact junctions. The initial set-up of the myosin gradient in terms of intensity distribution is unaffected, but clearly dynamics, subcellular pattern, interconnectivity etc. of myosin are affected and thus may well depend on some mechanical feed-back. I find this section of the manuscript slightly overstated and feel the conclusion should be more cautious.

      We thank the reviewer for pointing this out; we completely agree that we should have been more precise with our language. Our main conclusion was that myosin accumulation in a gradient does not require ‘sustained mechanical connectivity’. We felt it was important, given our model of transcriptional patterning, to show that some patterns did not result from mechanics or even apical constriction. Alpha-catenin knock-down provides the cleanest and most severe disruption of adhesion that we can accomplish at this developmental stage. We showed that alpha-catenin-RNAi resulted in: a) almost no intercellular connectivity in myosin structures (Yevick et al., 2019), and b) no apical constriction (this study, Fig. 3B).

      We: 1) revised the text in this section, clarifying that we are only referring to the gradient and that other myosin properties clearly do depend on mechanics, 2) will include data better showing the extent of the alpha-catenin knockdown and its effects on junctions and actomyosin.

      Figure 1 versus Figure 2: Why do the Utrophin-ABD virtual cross-sections look so fuzzy and bad in comparison to phalloidin labelled F-actin in the virtual cross-section in Fig. 1B and C? The labelling shown in 2B and D does not even look very junctional...

      We apologize that we did not explain the difference in visualization methods more clearly. For live images (Figure 2), we used a projection of cross-sections, which includes 20 µm length along the anterior-posterior (AP) axis. This projection method is less dependent on the specific AP position of the cross-section and the specific cells being shown. We did this because the projection helps to visualize the tissue pattern in live images where fluorescence images are noisier than fixed images, which exhibit cleaner labeling (Fig. 1). To address this point, we plan to: 1) Edit the text to make the method of visualization clearer, and 2) fix snail and twist mutant embryos and also provide thin cross-sections analogous to Fig. 1.

      Figure 5 C and D: the control gradients for myosin shown in C and D are completely different, for C the half-way height cell row is deduced as 5 whereas the (in theory identical) control measure in D has row 3 at halfway height! Why is this? Putting all curves together in the same panel would suggest that that C control curve is very similar to RhoGEF2-OE! This can't be right.

      The reason for the different width of the gradients in these controls is the Sqh::GFP copy number. All of our experiments perturbing Rho were carefully controlled so as to ensure the same copy number of the fluorescent marker that we were visualizing. For technical reasons, we were only able to get 1 copy of the Sqh::GFP into the RhoGEF2-OE background. Having two copies of the Sqh::GFP appears to have a slightly activating effect; in fact, the reviewer might have noticed that ventral furrows with 2 copies Sqh::GFP (and a wider gradient) have lower curvature, consistent with our main conclusion (Fig. 7 C). The effects of fluorescently tagged markers were a concern for us and so we were careful to show that the effects of changing RhoA activity on tissue curvature occur regardless of the fluorescent marker (i.e., Sqh::GFP or Utr::GFP, Fig. 7 and Sup. Fig. 7).

      Still in Figure 5: Panels C and D again, but for apical area: are the control and C-GAP-RNAi or RhoGEF2-OE curves significantly different? What statistics were used on this?

      We thank the reviewer for this point. We did not include statistical comparisons of the gradient width originally, because we felt that it does not completely capture the difference between the two curves and that presenting the curves instead lets readers examine the intricacies of the data as a whole. However, to address the reviewer’s point, we will add statistical comparisons for apical area as well as myosin and actin patterns.

      Supplemental Figure 1: Panels in D: I appreciate this control, but would really also like to see the same control at a stage when folding has commenced and stretched cells are present at the margin of the mesoderm. How homogenous does the GAP43 label look in those?

      We will add a more apical projection (with quantification) of this embryo, in which folding has already commenced, to the revised manuscript, so its stage is clearer.

      Supplemental Figure 5: Panel 5 B: the authors conclude that the myosin gradient under RhoGEF2 RNAi is not smaller, but looking at the curves it in fact looks wilder. They also mention that the overall level of myosin in this condition is lower than the control...

      We will include quantification of absolute levels in Supplemental Figure 5 to compare overall levels. We will also statistically compare RhoGEF2 RNAi and control gradients and update our conclusions accordingly.

      Following on from the above, a comment of Figure 7: - The authors use RhoGEF2 RNAi stating that it affects the actin pattern, but the myosin pattern also seems affected. In line 318 the authors state that they use this condition to look at how junctional actin density affects curvature. I find this phrase misleading as It might lead the readers to think that RHoGEF2 RNAi only affects junctional F-actin, although it also affects myosin patterning.

      We thank the reviewer for catching this, that’s a good point. We have revised the text in lines 317-326 to more accurately describe the effect of RhoGEF2-RNAi on actin and myosin patterning, and to connect this to the effect on curvature.

      • Line 311: confusingly, the authors state that an increase in the actomyosin gradient affects curvature. But it is only the myosin gradient that is increased, while the junctional actin gradient is flatter than the control in both C-GAP RNAi and RhoGEF2 OE (the distinction is even made by authors line 243). Could this be clarified?

      We thank the reviewer for pointing out this imprecision on our part and have revised Line 311 to more precisely describe the individual effects on myosin and F-actin pattern changes upon RhoA perturbation.

      Reviewer #2 (Evidence, reproducibility and clarity (Required)):

      Mesoderm invagination during Drosophila gastrulation has been a paradigm for how regionally restricted gene expression locally activates Rho signalling and for how subsequently activated acto-myosin drives cell shape changes which in turn lead to a change in tissue morphology. Despite the numerous studies on this subject and a good understanding of the overall process, several important aspects have remained elusive so far. Among these is the dynamics of cortical and junctional F-actin and its contribution to the shape changes of cells and tissue. Previous studies have focused on MyoII, the „active" component of the actin cytoskeleton. The dynamics of the „passive" counterpart, namely actin filaments, has been neglected, although it is clear that Rho signalling controls both branches.

      We thank the reviewer for the tough questions. The reviewer raises important points that, even if not all feasible to address experimentally, can be addressed by being more precise with our language__ and conclusions.__

      1. Although I clearly acknowledge the efforts taken by the authors to define a function of cortical (junctional) F-actin in apical constriction and furrow formation, several central aspects of the study are not sufficiently resolved and conclusive. Rho signalling controls MyoII via Rok and F-actin via forming/dia, among other less defined targets. The role of MyoII and cortical contraction could be conclusively sorted out, since inhibition of Rok affects the MyoII branch but not the other branches. A similar approach, i. e. a specific inhibition/depletion without affecting the other branch, has not been taken yet for the F-actin branch. The authors have not resolved this issue. When analysing the mutants, the authors cannot distinguish the effect of Rho signalling on the MyoII and F-actin branch. For this reason the changes in F-actin distribution in the mutants are linked to changes in Myo activity and thus a function cannot be assigned to F-actin. In order to derive a specific role of F-actin distribution for furrow formation, the authors need to find experimental ways to affect F-actin levels without affecting MyoII, for example by analysing mutants for dia or other formins.

      The reviewer’s assertion that Rok and Diaphanous only affect myosin and actin, respectively, is oversimplified. For example, in mammals, Rok regulates the Lim-Kinase/Cofilin pathway and thus F-actin (Geneste et al., JCB, 2002). The ‘F-actin branch’ of the RhoA pathway has been examined in multiple previous studies of mesoderm invagination (Fox and Peifer, 2007; Homem et al., 2008; Mason et al., 2013). We did not include diaphanous mutants in this tissue-level study because diaphanous mutants and actin drugs: a) affect RhoA signaling (Munjal et al., 2015; Coravos et al., 2016; Michaux et al., 2018), b) disrupt adherens junctions and tissue integrity (Homem et al, 2008; Mason et al., 2013), and c) have a preponderance of cellularization defects (Afshar et al., 2000). However, we agree with the reviewer that this could potentially be interesting, and so we 1) will look at the tissue-level pattern in Diaphanous-depleted embryos, 2) will analyze tissue-level actomyosin patterns in Rok inhibitor-injected embryos, and 3) have added a section to the Discussion (lines 418-432) explaining past work in this area and why we did not provide data on diaphanous mutants. A caveat of the proposed experiments is that actin and myosin ‘branches’ may be too interconnected to be conclusively separated.

      The authors employ a discontinuous spatial axis by the cell number. Although there are good arguments to understand and treat the cells as units, there are also good arguments for using a scale with absolute distance. I have doubts that the graded distributions presented by the authors are a result of this scaling with cell units. When looking at panel B of Fig 1 or Fig. 2A,B, for example, a sharp step like distribution is visible at the boundary between mesoderm and ectoderm anlage. In contrast a F-actin intensity distribution is graded after quantification. The graded distribution appears not to be a consequence of averaging because an even sharper step is very obvious in a projection along the embryonic axis as shown in panel B and D of Fig. 2, for example. The difference of a sharp step in the images and graded distribution after quantification with a spatial axis in cell number, is obvious for a-catenin in Fig. 3D and Rho signalling in Fig. 4 B. As the authors base their central conclusion (see headline) on the graded distribution, resolving the issue of spatial scale is a prerequisite of publication.

      We thank the reviewer for their point. It is an excellent idea and we have included representative plots with a continuous spatial scale in addition to our cell-based analysis (see below, each trace is average line intensity for 1 embryo). The spatially resolved analysis shows similar patterns for F-actin, myosin and RhoA pathway components as the cell-based metric and we plan to include this data as Supplemental Fig. 3 and 4 in a revised version of the manuscript.

      The authors put the spatial distribution of Rho signalling and F-actin into the center of their conclusion. They do so by affecting the pattern with mutants in twist/snail and varying upstream factors of Rho signalling. With respect to myo activation this have been done previously although possibly with less detail and it is no new insight that the width of the mesoderm anlage and corresponding Rho signalling domain has a consequence on the shape of the groove and furrow. To maintain the conclusion of the manuscript that spatially graded Rho signalling is contributes to tissue curvature, more convincing ways to change the pattern of Rho signalling are needed. Changing the balance of GEF and GAP shows the importance of Rho signalling and possibly signalling levels but not the contribution of its spatial distribution.

      A strength of our study was that we were able to stably ‘tune’ Rho signaling pattern and then follow tissue shape at later stages to determine the connection between the two. We respectfully disagree with the statement that, “with respect to myosin activation this has been done previously”. In past work, we expanded myosin activation by modifying embryonic cell fate, including changes in dorsal cell fates (Heer et al. 2017; Chanet et al., 2017). Here, we directly manipulate RhoA signaling, maintaining the width of the mesoderm anlage (see images below).

      A central conclusion of our study is that RhoA activation level determines the width of myosin activation within a normally sized mesoderm anlage, which has not been done before. The genetic approach presented in the paper was the best way we found to manipulate the spatial pattern of myosin/actin in a stable manner that lasts through invagination. It is worth noting that this approach allowed us to carefully ‘tune’ the level of RhoA activation so as to avoid elevating RhoA levels to the point that it disrupts signaling polarity within the cell (Mason et al., 2016). In our hands, optogenetic manipulation of RhoA, which requires continuous optical input, was less robust because: a) 2D tissue flow precludes delivering a consistent level of activation to given cells over the time course of invagination, b) tissue folding (i.e. 3D deformation) dramatically alters how much light is delivered to the mesoderm cells.

      To address the reviewer’s point, we: 1) edited the Discussion to explicitly state that we did not alter the pattern of RhoA activation without altering RhoA signaling levels and (lines 339-343), 2) plan to include Snail or Twist stainings showing that the width of the mesoderm anlage is not altered by changes in RhoA signaling so there is no confusion about this point, and 3) plan to include a mechanical model that compares how altering signaling levels vs. altering the spatial distribution of signaling affect fold curvature, respectively.

      Reviewer #2 (Significance (Required)):

      The question of a contribution of F-actin is addressed in this manuscript. The authors quantify F-actin in fixed and living embryos at two prominent steps in ventral furrow formation, (1) shortly prior to onset of apical constrictions and (2) when the groove has formed. They distinguish junctional and „medial" cortical F-actin. They employ a discontinuous spatial axis, the number of cells away from the ventral midline but not an absolute scale (see my notes below). The measurements are applied to wild type and mutant embryos affecting the transcriptional patterning (twist, snail), adherens junctions, and Rho signalling. The authors claim to reveal by their measurements a graded distribution of F-actin intensities with a peak at the ventral midline and a second peak at the boundary between mesoderm and ectoderm with a low point in the stretching cells of the mesectoderm. The authors further claim to reveal a graded distribution of Rho signalling components within the mesoderm anlage. Based on these data the authors conclude that graded Rho signalling and depletion of F-actin promote tissue curvature.

      Reviewer #3 (Evidence, reproducibility and clarity (Required)):

      Previous work has shown that mesoderm invagination at the ventral midline of the Drosophila embryo requires precise spatial regulation of actomyosin levels in order to fold the tissue. In this work, Denk-Lobnig and colleagues further investigate the spatial distribution of myosin and F-actin in the mesoderm and how these patterns are established. The authors identify an F-actin pattern at the apical cell junctions that emerges upon folding, with elevated levels in the cells around the ventral midline, a decrease in junctional F-actin in the marginal mesoderm, and then an increase at the mesoderm-ectoderm border. They identify Snail and Twist as regulating different aspects of establishing this F-actin pattern. Additionally, by modulating RhoA activity (downstream of Twist) the authors are able to alter the width of the actomyosin pattern without affecting the width of the mesoderm tissue, which in turn affects the curvature of the tissue fold and the post-fold lumen size.

      The authors have conducted an elegant quantitative analysis of the distribution of actin, myosin and several of their regulators across the tissue. The study makes an attempt at integrating a large amount of information into a model of tissue folding, and the concept of mechanical gradients is exciting and still underexplored. I am concerned that the interpretation of some results focuses on specific details but ignores larger scale effects (e.g. potential effects of some of the manipulations on the ectoderm, and the impact that that could have on tissue folding are largely ignored). The statistical analysis of several results should also be improved. I suggest to address the following points.

      We thank the reviewer for their interest in our work and their important suggestions.

      **MAJOR**

      1. Line 127 and Figure 1E: The authors argue that there is an anticorrelation between F-actin distribution and cell areas. However, an R-squared value of 0.1083 rather suggests little-to-no correlation. The authors should evaluate the statistical significance of that correlation.

      To indicate whether the relationship between F-actin distribution and cell areas is significant, we will report the p-value for the F-test for overall significance for our regression analysis, as well as sample size, of this data in the revised manuscript. The F-statistic for this analysis is __F = 89.2, p-value = 4.7e-20.__

      Figure 5: claims that the width of the actomyosin gradient is affected by the various perturbations should be supported with statistical analysis. For example, the half-maximal gradient position for each individual myosin trace could be calculated (instead of using the mean trace), displayed using a box plot, and tested for significance using the Mann-Whitney U test, as in Figure 7. This is slightly complicated by the fact that the control group in Figure 5C is the same as the control group in Figure 3E, which needs to be carefully considered. Also, similar calculations should be made for the F-actin data in Fig 5E-G since throughout the rest of the paper, the authors refer to the width of the "actomyosin gradient" which implicates both myosin and actin.

      We thank the reviewer for this point We will include statistical comparisons for myosin gradients in the revised manuscript. To allow for multiple comparisons using the same control, we plan to use Kruskal-Wallis testing, which is analogous to one-way ANOVA for non-parametric data, and a post-hoc test to determine which pairs have significantly different distributions.

      We will update the language in the manuscript to distinguish between actin and myosin patterns. As our main conclusion is that F-actin depletion levels are changed by RhoA in marginal mesoderm cells, we will statistically compare this between groups.

      Line 142 and Figure 2B-C: I was confused by the description of the snail phenotype: - a. the claim that in snail mutants actin levels are uniform: based on Figure 2C, I'd say that F-actin levels decrease across the mesoderm moving away from the ventral midline, and that the main issue is with the accumulation of actin in the distal end of the mesoderm. The authors should better justify the claim that F-actin levels are uniform in snail mutants (or remove it). Maybe comparing F-actin levels in the first four or five rows of the mesoderm? - b. how about the increase of F-actin in the distal mesoderm, just adjacent to the ectoderm boundary? Why is it gone in snail mutants?

      1. We agree that the intensity in all embryos appears to decrease on the sides of the embryos when imaged in this way, but it is also clear that there is no abrupt increase in F-actin density going into the ectoderm. In our experience, the edge effect is due to the distance of the side of the embryo from the coverslip rather than actual lower F-actin density. This is suggested by: a) the fact that all snail mutant embryos peak at the center of the image even though they are not all oriented with the ventral side perfectly on top, and b) all embryos exhibit an intensity decrease within the ectoderm toward the edges of the image that are further away from the coverslip (Fig. 2 C, E, F). We will: 1) modify the text to include an explanation, and 2) fix and stain snail and twist mutant cross-sections that will not exhibit this effect of imaging depth, for comparison.
      2. We show in Figure S1C that in wild-type, F-actin does not actually increase in cells at the ectoderm boundary, but merely decreases in lateral mesoderm cells. Thus, it is likely that snail mutant embryos are merely lacking patterning in the mesoderm, where snail is active.
      3. With alpha-catenin-RNAi, F-actin depletion across the mesoderm still occurs, but junctional F-actin levels are not increased around the midline. While some explanations are offered in the text, the reason for this phenotype seems important for the story. The text in lines 204-205 suggests that F-actin that would normally be localized to the apical junctions is instead being drawn into medioapical actomyosin foci. Is this idea supported by evidence that medioapical F-actin in control embryos is lower than in alpha-catenin RNAi?

      We appreciate the reviewer’s suggestion to explain this more thoroughly. We find that in alpha-catenin-RNAi and even arm (β-catenin) mutant embryos, junctional complexes (i.e., E-cadherin) are drawn into the myosin spot through continuous contractile flow (see below and Martin et al., 2010 for arm). To make this clear in the manuscript, we plan to: 1) include data showing the effects of alpha-catenin RNAi on F-actin and E-cadherin localization in fixed embryos, which is now included in Supplemental Figure S3, and 2)

      include live imaging of UtrGFP-labeled alpha-catenin RNAi embryos.

      Figure 6A: there is a correlation between cell position and the productivity of myosin pulses, which the authors attribute to the RhoA gradient. This should be more definitively demonstrated by:

      • a. Plot and calculate the correlation between RhoA levels (measured with the RhoA probe) and the change in cell area caused by a contraction pulse. Is this a significant correlation?

      • b. How does myosin persistence change when RhoA is manipulated, e.g. in RhoA overexpressing embryos or in RhoA RNAi?

      It has already been shown that there is a correlation between myosin amplitude and apical constriction amplitude (Xie et al., 2015).__ Apical myosin and Rho-kinase localization depends entirely on RhoA activity (Mason et al., 2016) and Rho-kinase co-localizes precisely with myosin in both space and time (Vasquez et al., 2014). Changing levels of the RhoA regulator C-GAP has been shown to affect myosin persistence and the productivity of apical constriction, with higher C-GAP causing less productive constriction (Mason et al., 2016). We plan to update the text to connect the observation with what has been shown in previous studies and to make statements regarding causality on the tissue-level more cautious. However, our observation further shows how cytoskeletal activity is patterned across the mesoderm, so we think it has value and that it should be included in this paper. An in depth study of the connection between RhoA regulators and myosin persistence/pulsing is beyond the scope of the present study, especially considering possible COVID-19 restrictions. Making these connections will require substantial effort in the future.__

      **MINOR**

      1. The authors should indicate if the myosin shown in Figure 1A is junctional or medioapical. If it is junctional, does medioapical myosin better match junctional F-actin and cell areas? Similarly, if they are showing medioapical myosin, how does junctional myosin compare to junctional actin? It seems to me that consistently comparing the patterns of junctional F-actin and medioapical myosin (and RhoGEF2, RhoA, and ROCK in Figure 4) could be somewhat misleading, as the pools compared localize in different subcellular compartments.

      The myosin images shown throughout the paper are medioapical myosin. Junctional myosin in mesoderm cells is lower in intensity and cannot easily be seen by live imaging. We agree that it is important for the reader to see all pools of these proteins. Therefore, we will include in a supplemental figure high resolution images of actin and myosin at both apical and subapical positions for midline mesoderm, marginal mesoderm, and ectoderm cells at the time of folding. We will also justify why the analyzed pools were chosen, respectively.

      Most of the intensity traces for myosin and F-actin are presented as normalized intensity, relative to the highest intensity in the trace. However, there are claims throughout the text about the relative levels of myosin (ex. Line 241) and F-actin (conclusions based on Fig. 2B-D) that should be supported by quantification. It seems that changes in intensity for both F-actin and myosin, in addition to shape of the gradient, would contribute to the understanding of actomyosin regulation in this tissue. However, if intensities cannot be directly compared between groups due to variation in imaging settings or staining protocols, there should be no claims made about changes in overall F-actin or myosin intensity.

      We appreciate the point made by the reviewer here. To address this point, we will provide data for absolute levels in relevant cases and be more precise in our conclusions.

      The significance of the correlation in Figure 7E should be quantified.

      We will report the p-value for the F-test for overall significance for our regression analysis of this data. The F-statistic for this analysis is F = __15.6, p-value = 0.00103.__

      Supplemental Figure 2: does the segmentation image match the second Z reslice immediately above? It does not appear so, or perhaps they are just not aligned. Having the two match would be more convincing of the segmentation technique.

      We will ensure that matching images are used for this figure.

      Reviewer #3 (Significance (Required)):

      The authors have conducted an elegant quantitative analysis of the distribution of actin, myosin and several of their regulators across the tissue. The study makes an attempt at integrating a large amount of information into a model of tissue folding, and the concept of mechanical gradients is exciting and still underexplored. I am concerned that the interpretation of some results focuses on specific details but ignores larger scale effects (e.g. potential effects of some of the manipulations on the ectoderm, and the impact that that could have on tissue folding are largely ignored). The statistical analysis of several results should also be improved.

      This is a great point. It is important to note that our conclusions required us to ‘tune’ the expression of GEF and the depletion of GAP with GAL4 drivers to get expression levels that do not dramatically affect RhoA polarity within mesoderm cells, but that alter the tissue level pattern within the mesoderm. Furthermore, we were cautious in making sure that our perturbations that elevate RhoA activation level did not lead to elevated myosin in the ectoderm (Fig. 5A and B). It is worth noting that RhoGEF2 is still full-length in all cases and has all of the normal regulatory domains that allow its activity to be restricted to the mesoderm at this stage. To more explicitly show the effect of our perturbations on ectoderm cells, we plan to include higher resolution images comparing myosin and F-actin organization/levels in the ectoderm for our manipulations of RhoA signaling.

    2. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #3

      Evidence, reproducibility and clarity

      Previous work has shown that mesoderm invagination at the ventral midline of the Drosophila embryo requires precise spatial regulation of actomyosin levels in order to fold the tissue. In this work, Denk-Lobnig and colleagues further investigate the spatial distribution of myosin and F-actin in the mesoderm and how these patterns are established. The authors identify an F-actin pattern at the apical cell junctions that emerges upon folding, with elevated levels in the cells around the ventral midline, a decrease in junctional F-actin in the marginal mesoderm, and then an increase at the mesoderm-ectoderm border. They identify Snail and Twist as regulating different aspects of establishing this F-actin pattern. Additionally, by modulating RhoA activity (downstream of Twist) the authors are able to alter the width of the actomyosin pattern without affecting the width of the mesoderm tissue, which in turn affects the curvature of the tissue fold and the post-fold lumen size.

      The authors have conducted an elegant quantitative analysis of the distribution of actin, myosin and several of their regulators across the tissue. The study makes an attempt at integrating a large amount of information into a model of tissue folding, and the concept of mechanical gradients is exciting and still underexplored. I am concerned that the interpretation of some results focuses on specific details but ignores larger scale effects (e.g. potential effects of some of the manipulations on the ectoderm, and the impact that that could have on tissue folding are largely ignored). The statistical analysis of several results should also be improved. I suggest to address the following points.

      MAJOR

      1. Line 127 and Figure 1E: The authors argue that there is an anticorrelation between F-actin distribution and cell areas. However, an R-squared value of 0.1083 rather suggests little-to-no correlation. The authors should evaluate the statistical significance of that correlation.
      2. Figure 5: claims that the width of the actomyosin gradient is affected by the various perturbations should be supported with statistical analysis. For example, the half-maximal gradient position for each individual myosin trace could be calculated (instead of using the mean trace), displayed using a box plot, and tested for significance using the Mann-Whitney U test, as in Figure 7. This is slightly complicated by the fact that the control group in Figure 5C is the same as the control group in Figure 3E, which needs to be carefully considered. Also, similar calculations should be made for the F-actin data in Fig 5E-G since throughout the rest of the paper, the authors refer to the width of the "actomyosin gradient" which implicates both myosin and actin.
      3. Line 142 and Figure 2B-C: I was confused by the description of the snail phenotype:
        • a. the claim that in snail mutants actin levels are uniform: based on Figure 2C, I'd say that F-actin levels decrease across the mesoderm moving away from the ventral midline, and that the main issue is with the accumulation of actin in the distal end of the mesoderm. The authors should better justify the claim that F-actin levels are uniform in snail mutants (or remove it). Maybe comparing F-actin levels in the first four or five rows of the mesoderm?
        • b. how about the increase of F-actin in the distal mesoderm, just adjacent to the ectoderm boundary? Why is it gone in snail mutants?
      4. With alpha-catenin-RNAi, F-actin depletion across the mesoderm still occurs, but junctional F-actin levels are not increased around the midline. While some explanations are offered in the text, the reason for this phenotype seems important for the story. The text in lines 204-205 suggests that F-actin that would normally be localized to the apical junctions is instead being drawn into medioapical actomyosin foci. Is this idea supported by evidence that medioapical F-actin in control embryos is lower than in alpha-catenin RNAi?
      5. Figure 6A: there is a correlation between cell position and the productivity of myosin pulses, which the authors attribute to the RhoA gradient. This should be more definitively demonstrated by:
        • a. Plot and calculate the correlation between RhoA levels (measured with the RhoA probe) and the change in cell area caused by a contraction pulse. Is this a significant correlation?
        • b. How does myosin persistence change when RhoA is manipulated, e.g. in RhoA overexpressing embryos or in RhoA RNAi?

      MINOR

      1. The authors should indicate if the myosin shown in Figure 1A is junctional or medioapical. If it is junctional, does medioapical myosin better match junctional F-actin and cell areas? Similarly, if they are showing medioapical myosin, how does junctional myosin compare to junctional actin? It seems to me that consistently comparing the patterns of junctional F-actin and medioapical myosin (and RhoGEF2, RhoA, and ROCK in Figure 4) could be somewhat misleading, as the pools compared localize in different subcellular compartments.
      2. Most of the intensity traces for myosin and F-actin are presented as normalized intensity, relative to the highest intensity in the trace. However, there are claims throughout the text about the relative levels of myosin (ex. Line 241) and F-actin (conclusions based on Fig. 2B-D) that should be supported by quantification. It seems that changes in intensity for both F-actin and myosin, in addition to shape of the gradient, would contribute to the understanding of actomyosin regulation in this tissue. However, if intensities cannot be directly compared between groups due to variation in imaging settings or staining protocols, there should be no claims made about changes in overall F-actin or myosin intensity.
      3. The significance of the correlation in Figure 7E should be quantified.
      4. Supplemental Figure 2: does the segmentation image match the second Z reslice immediately above? It does not appear so, or perhaps they are just not aligned. Having the two match would be more convincing of the segmentation technique.

      Significance

      The authors have conducted an elegant quantitative analysis of the distribution of actin, myosin and several of their regulators across the tissue. The study makes an attempt at integrating a large amount of information into a model of tissue folding, and the concept of mechanical gradients is exciting and still underexplored. I am concerned that the interpretation of some results focuses on specific details but ignores larger scale effects (e.g. potential effects of some of the manipulations on the ectoderm, and the impact that that could have on tissue folding are largely ignored). The statistical analysis of several results should also be improved.

    3. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #2

      Evidence, reproducibility and clarity

      Mesoderm invagination during Drosophila gastrulation has been a paradigm for how regionally restricted gene expression locally activates Rho signalling and for how subsequently activated acto-myosin drives cell shape changes which in turn lead to a change in tissue morphology. Despite the numerous studies on this subject and a good understanding of the overall process, several important aspects have remained elusive so far. Among these is the dynamics of cortical and junctional F-actin and its contribution to the shape changes of cells and tissue. Previous studies have focused on MyoII, the „active" component of the actin cytoskeleton. The dynamics of the „passive" counterpart, namely actin filaments, has been neglected, although it is clear that Rho signalling controls both branches.

      1. Although I clearly acknowledge the efforts taken by the authors to define a function of cortical (junctional) F-actin in apical constriction and furrow formation, several central aspects of the study are not sufficiently resolved and conclusive. Rho signalling controls MyoII via Rok and F-actin via forming/dia, among other less defined targets. The role of MyoII and cortical contraction could be conclusively sorted out, since inhibition of Rok affects the MyoII branch but not the other branches. A similar approach, i. e. a specific inhibition/depletion without affecting the other branch, has not been taken yet for the F-actin branch. The authors have not resolved this issue. When analysing the mutants, the authors cannot distinguish the effect of Rho signalling on the MyoII and F-actin branch. For this reason the changes in F-actin distribution in the mutants are linked to changes in Myo activity and thus a function cannot be assigned to F-actin. In order to derive a specific role of F-actin distribution for furrow formation, the authors need to find experimental ways to affect F-actin levels without affecting MyoII, for example by analysing mutants for dia or other formins.
      2. The authors employ a discontinuous spatial axis by the cell number. Although there are good arguments to understand and treat the cells as units, there are also good arguments for using a scale with absolute distance. I have doubts that the graded distributions presented by the authors are a result of this scaling with cell units. When looking at panel B of Fig 1 or Fig. 2A,B, for example, a sharp step like distribution is visible at the boundary between mesoderm and ectoderm anlage. In contrast a F-actin intensity distribution is graded after quantification. The graded distribution appears not to be a consequence of averaging because an even sharper step is very obvious in a projection along the embryonic axis as shown in panel B and D of Fig. 2, for example. The difference of a sharp step in the images and graded distribution after quantification with a spatial axis in cell number, is obvious for a-catenin in Fig. 3D and Rho signalling in Fig. 4 B. As the authors base their central conclusion (see headline) on the graded distribution, resolving the issue of spatial scale is a prerequisite of publication.
      3. The authors put the spatial distribution of Rho signalling and F-actin into the center of their conclusion. They do so by affecting the pattern with mutants in twist/snail and varying upstream factors of Rho signalling. With respect to myo activation this have been done previously although possibly with less detail and it is no new insight that the width of the mesoderm anlage and corresponding Rho signalling domain has a consequence on the shape of the groove and furrow. To maintain the conclusion of the manuscript that spatially graded Rho signalling is contributes to tissue curvature, more convincing ways to change the pattern of Rho signalling are needed. Changing the balance of GEF and GAP shows the importance of Rho signalling and possibly signalling levels but not the contribution of its spatial distribution.

      Significance

      The question of a contribution of F-actin is addressed in this manuscript. The authors quantify F-actin in fixed and living embryos at two prominent steps in ventral furrow formation, (1) shortly prior to onset of apical constrictions and (2) when the groove has formed. They distinguish junctional and „medial" cortical F-actin. They employ a discontinuous spatial axis, the number of cells away from the ventral midline but not an absolute scale (see my notes below). The measurements are applied to wild type and mutant embryos affecting the transcriptional patterning (twist, snail), adherens junctions, and Rho signalling. The authors claim to reveal by their measurements a graded distribution of F-actin intensities with a peak at the ventral midline and a second peak at the boundary between mesoderm and ectoderm with a low point in the stretching cells of the mesectoderm. The authors further claim to reveal a graded distribution of Rho signalling components within the mesoderm anlage. Based on these data the authors conclude that graded Rho signalling and depletion of F-actin promote tissue curvature.

    4. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #1

      Evidence, reproducibility and clarity

      In this manuscript entitled 'Combinatorial patterns of graded RhoA activation and uniform F-actin depletion promote tissue curvature' by Denk-Lobnig et al. the authors study the organisation of junctional F-actin during the process of mesoderm invagination during gastrulation in the model Drosophila. Following on from previous work by the same lab that identified and analysed a multicellular myosin II gradient across the mesoderm important for apical constriction and tissue bending, the authors now turn their attention to actin. Using imaging of live and fixed samples, they identify a patterning of F-actin intensity/density at apical junctions that they show is dynamically changing going into mesoderm invagination and is set up by the upstream transcription factors driving this process, Twist and Snail. They go on to show, using genetic perturbations, that both actin and the previously described myosin gradient are downstream of regulation and activation by RhoA, that in turn is controlled by a balance of RhoGEF2 activation and RhoGAP C-GAP inactivation. The authors conclude that the intricate expression patterns of all involved players, that all slightly vary from one another, is what drives the wild-type distinctive cell shape changes in particular rows of cells of the presumptive mesoderm and surrounding epidermis.

      This is a very interesting study analysing complex and large-scale cell and tissue shape changes in the early embryo. Much has been learned over the last decade and more about many of the molecular players and their particular behaviours that drive the process, but how all upstream regulators work together to achieve a coordinated tissue-scale behaviours is still not very well understood, and this study add important insights into this.

      The experiments seem well executed and support the conclusion drawn, but I have a few comments and questions that I feel the authors should address to strengthen their argument.

      General points:

      1. The authors state early on that they chose to focus on junctional rather than apical medial F-actin, but it is unclear to me really what the rationale behind that is. In much of the authors earlier work, they study the very dynamic behaviour of the apical-medial actomyosin that drives the apical cell area reduction in mesodermal cells required for folding. They have previously analysed F-actin in the constricting cells, but have only focused on the most constricting central cell rows (Coravos, J. S., & Martin, A. C. (2016). Developmental Cell, 1-14). The role of junctional F-actin compared to the apical-medial network on which the myosin works to drive constriction is much less clear, it could stabilize overall cell shape or modulate physical malleability or compliance of cells, or it could more actively be involved in implementing the 'ratchet' that needs to engage to stabilise a shrunken apical surface. I would appreciate more explanation or guidance on why the authors chose not to investigate apical-medial F-actin across the whole mesoderm and adjacent ectoderm, but rather focused in junctional F-actin, especially explaining better throughout what they think the role of the junctional F-actin they measure is.
      2. Comparing the F-actin labeling in the above previous paper to the stainings/live images shown here, they look quite different. This is most likely due to the authors here not showing the whole apical area but focusing on junctional, i.e. below the most apical region. It is not completely clear to me from the paper at what level along the apical-basal axis the authors are analysing the junctional F-actin. Supplemental Figure 2 seems to suggest about half-way down the cell, which would be below junctional levels. Could the authors indicate this more clearly, please? Overall, I would appreciate if the authors could supply some more high-resolution images of F-actin from fixed samples (which I assume will give the better resolution) of how F-actin actually looks in the different cells with differing levels. Is there for instance a visible change to F-actin organisation? And could this help explain the observed changes in intensity and their function?
      3. Along the same lines of thought as in point 2): Dehapiot et al. (Dehapiot, B., ... & Lecuit, T. (2020). Assembly of a persistent apical actin network by the formin Frl/Fmnl tunes epithelial cell deformability. Nature Cell Biology, 1-21) have recently shown for the process of germband extension and amnioserosa contraction that two pools of F-actin can be observed, a persistent pool not dependent on Rho[GTP] and a Rho-[GTP] dependent one. Could the authors comment on what they think might occur in the mesoderm, are similar pools present here as well?
      4. As the authoirs state themselves, Rho does not only affect actin via diaphanous, but of course also myosin via Rock. So it would be good to refelect this more in the interpretation and discussion of data, as the causal timeline could be complex.

      More specific comments to experiments and figures:

      1. Reduction of junction function by alpha-catenin-RNAi: how strong is the reduction in catenin? Could they label a-catenin in fixed embryos? The authors conclude the original pre-constriction patterning of F-actin intensity is not dependent on intact junctions, but they show that the increase in F-actin in the mesodermal cells concomitant with apical constriction is in fact impaired in the RNAi. Thus, the authors can also not conclude whether the continued accumulation of myosin and its persistence depend on intact junctions. The initial set-up of the myosin gradient in terms of intensity distribution is unaffected, but clearly dynamics, subcellular pattern, interconnectivity etc. of myosin are affected and thus may well depend on some mechanical feed-back. I find this section of the manuscript slightly overstated and feel the conclusion should be more cautious.
      2. Figure 1 versus Figure 2: Why do the Utrophin-ABD virtual cross-sections look so fuzzy and bad in comparison to phalloidin labelled F-actin in the virtual cross-section in Fig. 1B and C? The labelling shown in 2B and D does not even look very junctional...
      3. Figure 5 C and D: the control gradients for myosin shown in C and D are completely different, for C the half-way height cell row is deduced as 5 whereas the (in theory identical) control measure in D has row 3 at halfway height! Why is this? Putting all curves together in the same panel would suggest that that C control curve is very similar to RhoGEF2-OE! This can't be right.
      4. Still in Figure 5: Panels C and D again, but for apical area: are the control and C-GAP-RNAi or RhoGEF2-OE curves significantly different? What statistics were used on this?
      5. Supplemental Figure 1: Panels in D: I appreciate this control, but would really also like to see the same control at a stage when folding has commenced and stretched cells are present at the margin of the mesoderm. How homogenous does the GAP43 label look in those?
      6. Supplemental Figure 5: Panel 5 B: the authors conclude that the myosin gradient under RhoGEF2 RNAi is not smaller, but looking at the curves it in fact looks wilder. They also mention that the overall level of myosin in this condition is lower than the control...
      7. Following on from the above, a comment of Figure 7:
        • The authors use RhoGEF2 RNAi stating that it affects the actin pattern, but the myosin pattern also seems affected. In line 318 the authors state that they use this condition to look at how junctional actin density affects curvature. I find this phrase misleading as It might lead the readers to think that RHoGEF2 RNAi only affects junctional F-actin, although it also affects myosin patterning.
        • Line 311: confusingly, the authors state that an increase in the actomyosin gradient affects curvature.But it is only the myosin gradient that is increased, while the junctional actin gradient is flatter than the control in both C-GAP RNAi and RhoGEF2 OE (the distinction is even made by authors line 243). Could this be clarified?

      Significance

      Morphogenesis of organs, and how these highly coordinated processes are driven by transcriptional events, local control (of for instance cytoskeletal behaviour), is a major field in developmental and cell biology. Advances over the last decade have led to a much better understanding of the role of myosin (in the form of actomyosin) in defining cell and therefore tissue shape in morphogenesis. The role and control fo actin organisation, that the myosin depends upon for its action, is much less understood. Thus this study will add an important piece of understanding of the basic control of morphogenesis.

    1. Note: This rebuttal was posted by the corresponding author to Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Reply to the reviewers

      We thank the reviewers for their enthusiastic support for our work and their insightful comments and suggestions which we believe strengthen the manuscript. Below we detail how we propose to respond to each of the specific points raised by each reviewer.

      Reviewer #1__

      1). It is convincingly shown that adding insulator elements (cHS4) reduces crosstalk between the two PAX6 CREs tested (Fig. 3). However, it is unclear if this approach will work for other CREs. This point should be discussed, and perhaps the authors could give some troubleshooting advice (e.g. adding more insulators or trying different insulator elements?).

      We will include these suggestions in the discussion and describe some ongoing efforts to characterise another insulator element in our assay.

      2). All CREs used in proof-of-concept experiments in this work have well known activities in zebrafish embryos. A new/uncharacterized CRE has not been tested yet using this system. It is unclear from the workflow (Fig. 1B) what happens if the CRE does not drive detectable levels of EGFP/mCherry. How does one determine whether lack of reporter expression is due to technical problem (with the transgene or phiC31 integration) or that the CRE is not active in zebrafish? Perhaps adding a PCR-based genotyping step could address this potential problem?

      We will include a PCR-based genotyping assay in the description of the assay pipeline and discuss its utility in assessing successful integration events as suggested by the reviewer.

      3). Other limitations of the system should also be discussed. For example, the system appears to be useful for identifying variant CREs that result in a change (either loss or gain) of temporal or spatial activity, but it is not clear how subtle changes in expression level (either slightly increased or decreased) would be identified or quantified. Perhaps other approaches could be used in combination with this system to fully analyze mutant CRE activity. Another limitation is that this approach is only be applicable to CREs that are active in the first few days of zebrafish embryonic development.

      We will include these suggestions in the discussion and clearly address the limitations of the system

      **Minor points:**

      i) Although it is discussed in the previous work published in PLoS Genetics, it is probably worth mentioning here why the gata2 minimal promoter was chosen for the reporter system.

      The choice of the gata2 promoter in our constructs was based on previously published work from our group. We will re-iterate and reference these studies in the workflow description.

      1. ii) It would be helpful if the cSH4 element is briefly described (e.g. "insulator element") in Fig.1 legend. We will modify the figure legend according to the suggestion.

      3). It is not clear from the manuscript whether the new reagents reported here-including dual reporter vectors and transgenic attB landing site zebrafish strains-will be made available to the scientific community, or how these reagents would be distributed.

      We would include a section describing our plans for distribution of reagents and tools described in the manuscript. All the vectors would be deposited in Addgene for distribution and all the zebrafish lines would be openly shared with the scientific community.

      Reviewer #2:

      1. The dual reporter system uses EGFP and mCherry to report the activities of two different CREs in the same animal. However, EGFP and mCherry have drastically different fluorescence properties which have not been measured particularly well in vivo and especially not in zebrafish. They have different maturation times (mCherry is much quicker). Both are quite stable in vivo, but mCherry is particularly stable in cell culture and in vivo, even resisting lysosomal degradation (EGFP does not - it is acid and protease sensitive) (Katayama et al., 2008; McWilliams et al., 2016). Often, promoter activity assays in zebrafish employ short lived "destabilized" FPs, such as destabilized GFP and destabilized dsRed. With stable FPs, false positives could be reported due to the fluorescent signal remaining for a long period of time after promoter activity has ceased. Replacing the traditional FPs with destabilized versions could be one way to improve the temporal resolution of this assay. This is probably not necessary to do in the present study but might be a worthy future direction.

      We would discuss these points in the possible limitations of our assay and will also endeavour to incorporate these suggestions in future versions of our assays.

      However, no matter which pair of FPs is chosen, there will be differences in signal intensity/brightness and decay rate. Thus, the FP swap experiments should be employed for any experiment claiming a temporal (Fig. 4) or quantitative (Fig. 5) difference between CRE activation or deactivation. If the EGFP/mCherry swap experiments show the same results, the confidence in the assay will be significantly bolstered.

      We estimate the proposed experiments to take about 4 months to allow for molecular cloning of the FP swapped constructs, injection into the "landing" strain, raising to sexual maturity (2.5 mo), screening for founders, and performing the imaging. These are the only two suggested experiments I would need to feel confident in the results and to recommend publication

      We appreciate the reviewer’s suggestion but would point out that we included dye-swaps for the PAX6-CREs described in Figure 3 in this manuscript. The dye-swap experiment for SBE2WT/SBE2Mut were described in our previous work published in Plos Genetics. However, to increase the confidence of the readers in our current system we would include the other suggested dye swaps in the revised version of our manuscript.

      Reviewer #3:

      **Major comments**

      1. First, given the importance of quality landing lines for the methodology, I would like to see more clarity and emphasis on validation of the Shh-SBE2 landing pad in the main text. Based on supplemental tables 1 and 2, this reviewer is somewhat unclear on whether there is one or three lines with Shh-SBE2 based landing pads (one site is mentioned in table 1, but table 3 mentions three F0 lines, and the text is ambiguous). The authors also state that the Shh-SBE2 landing pad is a single copy integration, but the data supporting this conclusion does not appear to be included (linker mediated PCR does not rule out other integrations).

      We will provide a detailed description of the landing lines addressing all the concerns raised by the reviewer.

      It would also be useful to have more clear numbers indicating the reproducibility of the expression pattern in F1 animals. Do 100% of F1 progeny from multiple crosses show the integration show the expression pattern in image 2 A? If there is variability how much, and how many fish were examined? This reviewer also wonders whether appropriate expression of Shh-SBE2 in this landing site is enough to call it neutral. For example, perhaps position effects might be observed with a different weaker CRE in this site? Better documentation will allow for more widespread and appropriate use of the landing pad.

      We will expand the description for the part of the pipeline the reviewer is referring to, providing the details of transgene segregation.

      Similar concerns apply to the integration of test constructs. To evaluate the practicality of the approach, it would be useful to have numbers reporting the frequency of recovering F1 individuals with PhiC mediated integration of the reporter into the desired landing site. It is also important to provide better documentation of the degree of reproducibility in expression patterns between F1 progeny. Numbers of embryos imaged and fraction with the indicated expression pattern are needed for all data in the main text. At minimum, gross expression patterns should be examined in at least 10 F1 larvae. If there is variability between individuals, some image documentation of this in supplementary data would be welcome.

      We will include the suggested information in the results and provide the supplementary data as suggested by the reviewer.

      **Minor comments:**

      i) For figure 1, it may be clearer to present generation of the landing pad lines and screening of CRES using these lines in separated figure panels (B) for generation of landing pads, and (C) for CRE analysis.

      We will modify figure 1 as suggested.

      ii) Landing pads that were less effective might also be moved out of figure 2, to the supplemental material to help improve clarity and to allow for focus on the tools with the most utility

      We will modify figure 2 as suggested.

      iii) Scale bars should be included in all images,

      This will be done for all the images

      iv) In some cases, image labeling somewhat obscures the relevant features

      We will rectify this in the revised version

      v) To help evaluate consistency, in all relevant figures (4, 5, sup fig 3 ect) the number of embryos examined should be included in the legend.

      We will modify the figure legends to include this information

    2. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #3

      Evidence, reproducibility and clarity

      Summary:

      The manuscript by Bhatia addresses a longstanding need for rigorous methods to directly compare the effectiveness of cis-regulatory elements (CREs) during vertebrate embryogenesis. The manuscript describes a method for simultaneous quantitative assessment of the spatial and temporal activity of wild-type and mutant CREs using live imaging in zebrafish embryos. The approach takes advantage of a predefined neutral docking site, and dual-CRE reporter cassette that can be integrated into this site using PhiC31. Using this method, the authors demonstrate subtle differences in the spatial and temporal dynamics of two shh CREs that have been previously reported to have similar domains of activity, and they demonstrate changes in CRE activity in embryos harboring a disease specific mutation in the SBE2 CRE.

      Major comments

      Overall this manuscript describes a valuable tool and key conclusions regarding its need and utility convincing. However, some additional documentation of methods and key reagents, and numbers would be of value.

      First, given the importance of quality landing lines for the methodology, I would like to see more clarity and emphasis on validation of the Shh-SBE2 landing pad in the main text. Based on supplemental tables 1 and 2, this reviewer is somewhat unclear on whether there is one or three lines with Shh-SBE2 based landing pads (one site is mentioned in table 1, but table 3 mentions three F0 lines, and the text is ambiguous). The authors also state that the Shh-SBE2 landing pad is a single copy integration, but the data supporting this conclusion does not appear to be included (linker mediated PCR does not rule out other integrations). It would also be useful to have more clear numbers indicating the reproducibility of the expression pattern in F1 animals. Do 100% of F1 progeny from multiple crosses show the integration show the expression pattern in image 2 A? If there is variability how much, and how many fish were examined? This reviewer also wonders whether appropriate expression of Shh-SBE2 in this landing site is enough to call it neutral. For example, perhaps position effects might be observed with a different weaker CRE in this site? Better documentation will allow for more widespread and appropriate use of the landing pad.

      Similar concerns apply to the integration of test constructs. To evaluate the practicality of the approach, it would be useful to have numbers reporting the frequency of recovering F1 individuals with PhiC mediated integration of the reporter into the desired landing site. It is also important to provide better documentation of the degree of reproducibility in expression patterns between F1 progeny. Numbers of embryos imaged and fraction with the indicated expression pattern are needed for all data in the main text. At minimum, gross expression patterns should be examined in at least 10 F1 larvae. If there is variability between individuals, some image documentation of this in supplementary data would be welcome.

      Presumably nearly all of this data has already been collected during validation of the tools and just isn't reported clearly, so these updates would not require significant time or cost.

      Minor comments:

      With respect to clarity, while the authors do an excellent job of explaining the rational for their system, the details of execution in the manuscript can be difficult to follow at times, below are minor suggestions to help the reader follow more easily.

      For figure 1, it may be clearer to present generation of the landing pad lines and screening of CRES using these lines in separated figure panels (B) for generation of landing pads, and (C) for CRE analysis.

      Landing pads that were less effective might also be moved out of figure 2, to the supplemental material to help improve clarity and to allow for focus on the tools with the most utility

      Scale bars should be included in all images,

      In some cases, image labeling somewhat obscures the relevant features

      To help evaluate consistency, in all relevant figures (4, 5, sup fig 3 ect) the number of embryos examined should be included in the legend.

      Significance

      This manuscript is significant as if provides useful tools for direct comparison of CRE activity in stable transgenic embryos, where two CREs are integrated into a single genomic location. The method offers an advance in efficiency and rigor compared to past approaches. As a zebrafish researcher, it is easy to recognize the value of having a transgenic line with a validated neutral landing site for transgene analysis, and having a well-designed construct for detailed in vivo comparison of CRE activity.

    3. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #2

      Evidence, reproducibility and clarity

      This study presents a dual fluorescent protein (FP) reporter system to determine differential activities of Cis regulator elements (CREs) on transcription factor behavior in an in vivo setting. The strategy uses the PhiC31 system to ensure single copy insertion into a consistent genomic locus and is an important improvement over the authors' previous work using a similar system with random genomic integration and separated FP constructs. Because different genomic loci are more accessible than others, comparing the activities of randomly inserted CREs cannot be quantitative and requires generation and comparison of multiple lines for each CRE to validate. The bulk of this study is validation of the new specifically inserted, dual FP system including showing that including insulator sequences between the CREs of interest is necessary to prevent crosstalk. The last two figures demonstrate the utility of the system to interrogate spatial and temporal regulation of CRE variants and the quantitative expression levels of a mutant and WT CRE pair. This is an exciting tool with clear potential to uniquely compare CRE activities in vivo, and the results are clearly presented. However, given that the impact of this study is as a technical improvement over previous methods and that it is aimed to demonstrate the robustness and utility of the reporter system, additional controls are necessary to demonstrate that FP choice does not influence the temporal or quantitative readouts.

      The dual reporter system uses EGFP and mCherry to report the activities of two different CREs in the same animal. However, EGFP and mCherry have drastically different fluorescence properties which have not been measured particularly well in vivo and especially not in zebrafish. They have different maturation times (mCherry is much quicker). Both are quite stable in vivo, but mCherry is particularly stable in cell culture and in vivo, even resisting lysosomal degradation (EGFP does not - it is acid and protease sensitive) (Katayama et al., 2008; McWilliams et al., 2016). Often, promoter activity assays in zebrafish employ short lived "destabilized" FPs, such as destabilized GFP and destabilized dsRed. With stable FPs, false positives could be reported due to the fluorescent signal remaining for a long period of time after promoter activity has ceased. Replacing the traditional FPs with destabilized versions could be one way to improve the temporal resolution of this assay. This is probably not necessary to do in the present study but might be a worthy future direction. However, no matter which pair of FPs is chosen, there will be differences in signal intensity/brightness and decay rate. Thus, the FP swap experiments should be employed for any experiment claiming a temporal (Fig. 4) or quantitative (Fig. 5) difference between CRE activation or deactivation. If the EGFP/mCherry swap experiments show the same results, the confidence in the assay will be significantly bolstered.

      We estimate the proposed experiments to take about 4 months to allow for molecular cloning of the FP swapped constructs, injection into the "landing" strain, raising to sexual maturity (2.5 mo), screening for founders, and performing the imaging. These are the only two suggested experiments I would need to feel confident in the results and to recommend publication.

      Significance

      The impact of this study is as a technical improvement over previous methods and is aimed to demonstrate the robustness and utility of the reporter system.

      The manuscript is geared towards zebrafish experts with an interest in the imaging of intracellular and transcriptional processes.

      Our laboratory has expertise in zebrafish developmental genetics and live imaging of reporters.

    4. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #1

      Evidence, reproducibility and clarity

      This is a technical manuscript that describes a new transgenic reporter system in zebrafish that is designed to simultaneously test the activity of two cis-regulatory elements (CREs) in the same living embryo. This is an extension of previous work from the authors that established methods to compare two CREs in transgenic zebrafish embryos (published in PLoS Genetics; DOI: 10.1371/journal.pgen.1005193). Here, to address the problem of position effects caused by random transgene integration, the authors have created a dual reporter transgene that can be integrated into a specific neutral site (using phiC31 recombination) in the zebrafish genome. Expression of different fluorescent proteins (EGFP and mCherry) are regulated by two CREs of interest in the zebrafish embryo, which allows visualization of the temporal and spatial activity of the CREs in real time during embryonic development. The authors propose this system could be used to directly compare wild-type and mutant CREs, and then provide several lives of evidence that establish proof-of-concept. Overall, the results are clearly presented, and the conclusions are convincing. The description of methods (including supplemental tables) is extensive, which will facilitate reproducibility. The manuscript is succinct, and describes a useful approach to characterize CREs. However, I have a few points for the authors to consider:

      Major points:

      1)It is convincingly shown that adding insulator elements (cHS4) reduces crosstalk between the two PAX6 CREs tested (Fig. 3). However, it is unclear if this approach will work for other CREs. This point should be discussed, and perhaps the authors could give some troubleshooting advice (e.g. adding more insulators or trying different insulator elements?).

      2)All CREs used in proof-of-concept experiments in this work have well known activities in zebrafish embryos. A new/uncharacterized CRE has not been tested yet using this system. It is unclear from the workflow (Fig. 1B) what happens if the CRE does not drive detectable levels of EGFP/mCherry. How does one determine whether lack of reporter expression is due to technical problem (with the transgene or phiC31 integration) or that the CRE is not active in zebrafish? Perhaps adding a PCR-based genotyping step could address this potential problem?

      3)Other limitations of the system should also be discussed. For example, the system appears to be useful for identifying variant CREs that result in a change (either loss or gain) of temporal or spatial activity, but it is not clear how subtle changes in expression level (either slightly increased or decreased) would be identified or quantified. Perhaps other approaches could be used in combination with this system to fully analyze mutant CRE activity. Another limitation is that this approach is only be applicable to CREs that are active in the first few days of zebrafish embryonic development.

      Minor points:

      1)Although it is discussed in the previous work published in PLoS Genetics, it is probably worth mentioning here why the gata2 minimal promoter was chosen for the reporter system.

      2)It would be helpful if the cSH4 element is briefly described (e.g. "insulator element") in Fig.1 legend.

      3)It is not clear from the manuscript whether the new reagents reported here-including dual reporter vectors and transgenic attB landing site zebrafish strains-will be made available to the scientific community, or how these reagents would be distributed.

      Significance

      This work introduces a new method to analyze cis-regulatory element (CRE) activity in vivo. By generating transgenic zebrafish with a neutral phiC31 landing site for reporter transgene integration, this work improves on previous methods by overcoming the problem of position effects caused by random transgene integration. This will be useful approach to characterize CREs during embryonic development, and variant CREs associated with human disease. This paper will be of interest to developmental biologists, and geneticists trying to understand CRE activity. I have expertise in zebrafish genetics, with extensive experience using Tol2 transgenesis, and some experience using phiC31 recombination. The described experimental approach here is straightforward, and will be easy to apply in labs with experience in zebrafish transgenesis, and imaging fluorescent protein expression in embryos.

  4. Nov 2020
    1. Note: This rebuttal was posted by the corresponding author to Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Reply to the reviewers

      Reviewer__ #1 (Evidence, reproducibility and clarity (Required)):__ Septins are highly conserved small GTPase cytoskeletal proteins that function as molecular scaffolds for dynamic cell wall and plasma membrane-remodeling, as well as diffusion barriers restricting movement of membrane and cell wall-associated molecules. Recent work has started to unravel the functional connections between the septins, cell wall integrity MAPK pathway signaling, and lipid metabolism, however most studies have focused on a small sub-set of septin monomers and/or were conducted in primarily yeast-type fungi. Here the authors show in the filamentous fungus A. nidulans that the core hexamer septins are required for proper coordination of the cell wall integrity pathway, that all septins are involved in lipid metabolism. Especially sphingolipid, but not sterols and phosphoinositides, contributes to the localization and stability of core septins at the plasma membrane. The experiments are simple and clear, therefore the conclusion is convincing. Fig.8 model, I would like to see the situation of septin mutant.

      We thank the reviewer for the positive comments. In response to the request from this reviewer and a similar one from reviewer 2 for more on the effect of the loss of individual septins, we added text clarifying the roles of core hexamer, core octamer and noncore septins throughout the manuscript including in the legend to Fig 8 (li 439-444) and the discussion (li 388-402). Please see responses to reviewer 2 comments for more detail.

      Reviewer #1 (Significance (Required)):

      Since localization of cell wall synthesis proteins, lipid domains and septins are likely to depend on each other, sometimes difficult to evaluate the effect is direct or indirect. The comprehensive analyses like performed here are helpful to catch the overview in the field.

      Reviewer__ #2 (Evidence, reproducibility and clarity (Required)):__ **Summary** The study by Mela and Momany describes the function of core septins of A. nidulans and links with the requirement of the cell wall integrity pathway and the sphingolipids which, are required for membrane and cell wall stability. The study is of interest for the fungal genetics community, and the authors have conducted a substantial amount of work in a field they have substantial experience. However, one of the main weaknesses of the manuscript is the assumption whether the CWI pathway controls de septin function of if the core septins control it.

      We agree that while our data clearly indicate interactions between the septins and the CWI pathway, which component controls the other is not clear. We have modified the text to address this concern in several places as detailed in responses to the reviewer’s specific comments below.

      **Major comments** In the abstract, the authors claim that double mutant analysis suggested core septins function downstream of the final kinase of the cell wall integrity pathway. However, from the experiments showed, it is difficult to be convinced about that. The authors should make efforts do make it clear in the manuscript and the discussion. For example: -Line 25-26 (abstract): "Double mutant analysis suggested core septins function downstream of the final kinase of the cell wall integrity pathway."

      We agree that while the double mutant analysis shows interaction of septins with the CWI pathway, the evidence for them being downstream is not strong. We have revised the abstract as follows:

      Li29-30: Double mutant analysis with Δ**mpkA suggested core septins interact with the cell wall integrity pathway.”

      -Line 181-182; 219-220 (results) "Double mutant analyses suggest core septins modulate the cell wall integrity pathway downstream of the kinase cascade." This conclusion is one of the most important of the manuscript. However, this reviewer argues that it cannot be convincingly addressed if at least the phosphorylation ok the MAP kinase MpkA in the septins background is not evaluated under conditions of cell stress and sphingolipid biosynthesis inhibition. The genetic analysis alone maybe not enough to infer if septins control the CWI or the other way around. There may have compensatory effects when the CWI pathway is impaired. For example, most of the septins and mpkA double mutants seems to suppress the defect of the delta mpkA under cell wall stress. The authors should consider this idea.

      Although we discuss the epistasis experiments as one possible interpretation, we agree the genetic analysis is not enough to definitively show that the septins are upstream of the CWI pathway or the other way around. The suppression of cell wall defects by deletion of septins in a mpkA null mutant background under cell wall stress suggests a bypass of the CWI pathway for remediation of the cell wall or some other alternate regulatory node. One possible interpretation of these data could be that by inactivation of normal CWI integrity function through deletion of the final kinase, in addition to deletion of septins (possibly acting as negative regulators of CWI components), there may be a parallel node by which cell wall remediation could still occur.

      Wording throughout the abstract, results, and discussion has been modified accordingly.

      Li 29-30: Double mutant analysis with Δ**mpkA suggested core septins interact with the cell wall integrity pathway.

      Li 208-209: Double mutant analyses suggest the core septin aspB cdc3 modulates the cell wall integrity pathway in the ∆mpkA background under cell wall stress.

      Li 221-225: When challenged with low concentrations of CASP and CFW, the ∆aspBcdc3**∆mpkAslt2 and ∆aspE ∆mpkA slt2 mutants were more sensitive than ∆aspBcdc3 and ∆aspE single mutants, but suppressed the colony growth defects of ∆mpkA slt2. The novel phenotype of the double mutants shows that septins are involved in cell wall integrity and raises the possibility that they act in a bypass or parallel node for remediation of cell wall defects (Fig 4).

      Li 227-228: Fig 4. Double mutant analyses suggest core septins modulate the cell wall integrity pathway.

      Li 464-468: Double mutant analyses between septins and CWI pathway kinases also support a role for core septins in maintaining cell wall integrity under stress (Fig 4). Suppression of cell wall defects under cell wall stress by deletion of septins in an ∆mpkA slt2 background suggests a parallel node by which septins negatively regulate cell wall integrity pathway sensors or kinases could exist.

      There is no clear evidences on the manuscript that the core septins AspA, AspB, AspC, and ApsD are epithastic in A. nidulans. Therefore, the authors choice of using different Asp deletion mutants as a proxy for all the septins mutants is questionable. For example, there is no mention of why AspB was chosen for Figure 2 (chitin and β-1,3-glucan deposition), and AspA was chosen for Figure 3 (chitin synthase localization) since these experiments are correlated. The same is true for Figure S1 where AspB and AspE were used. One can wonder if some of the core septins would have a major impact in the chitin content.

      We agree with the reviewer that not all four core septins are equivalent. Previously published work from our lab shows that AspACdc11, AspBCdc3, AspCCdc12, and AspDCdc10 form octamers and that AspACdc11, AspBCdc3, and AspCCdc12 form hexamers, that both of these heteropolymers co-exist, and that the noncore septin AspE is not part of either core heteropolymer, though it appears to influence them possibly through brief interactions (Lindsay et al., 2010; Hernandez-Rodriguez et al., 2012; Hernandez-Rodriguez et al., 2014). This previous work also clearly shows that strains in which the hexameric septins have been deleted (ΔaspA, ΔaspB, and ΔaspC) have very similar phenotypes while strains in which the octamer-exclusive septin has been deleted (ΔaspD) have different phenotypes.

      In our attempt to simplify the current manuscript we discussed the four core septins as a group. In retrospect this caused us to miss important distinctions on the roles of hexamer vs octamer septins and we are grateful to the reviewer for pointing this out. We have modified language throughout the revised manuscript to specify whether results and interpretations apply to core hexamer septins, core octamer septins, the noncore septin, or individual septins. This more detailed analysis has given us several new ideas to test in future work.

      While we cannot exclude the possibility that interesting results might be produced by analyzing null alleles of each individual septin gene for all experiments, we agree with the cross-reference by Reviewer #3 that there is a very low likelihood that we would see different results by analyzing all individual septins within each subgroup (hexamer, octamer or noncore).

      To the reviewer’s questions on choice of septins for Fig 2, Fig 3, and Fig S1:

      ΔaspA, ΔaspB, and ΔaspC showed similar sensitivity to cell wall-disturbing agents in the plate-based assays in Fig 1 and are all part of the core hexamer. We have modified text including the figure legends to make it clear which septins were used in the experiments and which group they belong to.

      In a related comment about Figure 3, the reallocation of chitin synthases in the absence of septins is very interesting, but consider that all the core septin genes should be tested. Without a fully functioning cell wall, the formation of septa will be impaired. It makes their results less surprising.

      In the case of Fig 3, we were unable to recover ChsB-GFP in the ΔaspB or ΔaspC backgrounds but were able to recover it in the ΔaspA background. We have clarified as follows:

      Li184-187: To determine the localization of synthases, a chitin synthase B-GFP (chsB-GFP) strain was crossed with strains in which core hexamer septins were deleted. After repeated attempts, the only successful cross was with core hexamer deletion strain ∆aspA cdc11.

      Figure 3, Panels A and B, chitin was also labeled by Calcofluor White which clearly shows that the formation of septa was not impaired even in the septin null mutant background (this is in agreement with previous work form our lab which shows that septa still forms in individual septin null mutants). The results showed that unlike WT cells, chitin synthase is not only absent in most branch tips in the septin null mutant background, but seems to be limited primarily to longer (presumably actively growing/non-aborted) branches; these findings were surprising to us, considering other major cell wall synthesis events, such as targeting of cell wall synthases to septa during septation appeared to be unimpaired (based on the presence of fully-developed, chitin-labeled septa).

      The labeling of septa by calcofluor is now noted in the legend to Figure 3 as follows:

      Li 201: Calcofluor White labeling shows the presence of the polymer chitin at septa, main hyphal tips, branches, and …

      Why was chitin synthase B chosen to be analyzed in terms of reallocation? How many chitin synthases are in the A. nidulans genome. This rationale should be explained in the manuscript.

      We have added the following:

      Lines 173-182: A. nidulans contains six genes for chitin synthases: chsA, chsB, chsC, chsD, csmA, and csmB. Chitin synthase B localizes to sites of polarized growth in hyphal tips, as well as developing septa in vegetative hyphae and conidiophores, a pattern very similar to septin localization. Deletion of chitin synthase B shows severe defects in most filamentous fungi analyzed thus far, and repression of the chitin synthase b gene expression in chsA, chsC, and chsD double mutants exacerbated growth defects from a number of developmental states observed in each single mutant, suggesting it plays a major role in chitin synthesis at most growth stages (Fukuda et al., 2009). For these reasons, we chose chitin synthase B as a candidate to observe in septin mutant background for possible defects in localization.

      Figure 3 and Figure 4. The authors should make efforts to quantify the phonotypes they claim. They are overall very subtle, especially for Figure 3. Also, a decrease of fluorescence is a tricky observation that should be better reported by quantification.

      Line scans of aniline blue and CFW label were conducted and added as Fig S1. Quantitation was performed and added as Fig S3. See author’s response to Reviewer #3 below for details.

      Again, in Figures 5, 6, and 7, it is clear that the different septins respond differently when ergosterol or sphingolipids synthesis is impaired. It also raises the question again if there are differences in the role of septin genes. Can the authors use previous information about differences in septin function to improve the model (Figure 8)

      As described above, we have modified the manuscript throughout to clarify which phenotypes are seen for core hexamer, core octamer, and noncore septin deletions. As the reviewer notes, these are especially relevant for the sphingolipid-disrupting agents. Our model includes interaction of septins with sterol rich domains that contain both sphingolipids and ergosterol. Because it is not yet clear how subgroups of septins interact with each other and are organized at SRDs, we show all core septins in our model without distinguishing hexamers and octamers in the drawing, but we have now added text to clarify roles and outstanding questions.

      The changes are summarized in the abstract as follows:

      Li 37-40: Our data suggest that the core hexamer and octamer septins are involved in cell wall integrity signaling with the noncore septin playing a minor role; that all five septins are involved in monitoring ergosterol metabolism; that the hexamer septins are required for sphingolipid metabolism; and that septins require sphingolipids to coordinate the cell wall integrity response.

      The clarifications are reflected in the Figure 8 legend (and associated sections of the discussion) as follows:

      Li 436-441: As described in the text, our data suggest that all five septins are involved in cell wall and membrane integrity coordination. The core septins that participate in hexamers appear to be most important for sphingolipid metabolism while all septins appear to be involved in ergosterol metabolism and cell wall integrity. Because SRDs contain both sphingolipids and ergosterol and because it is not yet clear how subgroups of septins interact with each other at SRDs, we show all core septins in our model without distinguishing hexamers and octamers.

      For the above-discussed reasons, the conclusion on lines 384-388 (discussion) is not completely supported by the experiments shown in the manuscript. The authors need to make a better structured and more straightforward story emphasizing the stronger points and reducing descriptions of more speculative points.

      As discussed above, we have made changes throughout the manuscript to clarify which subgroups of septins are involved in which process and to refine our conclusions accordingly. The beginning of the discussion section has been changed as follows:

      Li 384-399: Our data show that A. nidulans septins play roles in both plasma membrane and cell wall integrity and that distinct subgroups of septins carry out these roles. Previous work has shown that the five septins of A. nidulans septins form hexamers (AspACdc11, AspBCdc3, and AspCCdc12) and octamers (AspACdc11, AspBCdc3, AspCCdc12, and AspDCdc10) and that the noncore septin AspE does not appear to be a stable member of a heteropolymer (20). The current work suggests that though all septins are involved in coordinating cell wall and membrane integrity, the roles of hexamers, octamers, and the noncore septin are somewhat different. Core hexamer septins appear to be most important for sphingolipid metabolism, all five septins appear to be involved in ergosterol metabolism, and core septins are most important for cell wall integrity pathway with the noncore septin possibly playing a minor role. As summarized in Figure 8 and discussed in more detail below, our previous and current data are consistent with a model in which: (A) All five septins assemble at sites of membrane and cell wall remodeling in a sphingolipid-dependent process; (B) All five septins recruit and/or scaffold ergosterol and the core hexamer septins recruit and/or scaffold sphingolipids and associated sensors at these sites, triggering changes in lipid metabolism; and (C) The core septins recruit and/or scaffold cell wall integrity machinery to the proper locations and trigger changes in cell wall synthesis. The noncore septin might play a minor role in this process.

      Minor comments Overall the figure caption could be shortened. They are too descriptive and contain details that are easily inferred for the images and from the materials and methods.

      Legends to the following figures have been streamlined by removing portions that belong in the methods: Figure 2, Fig 3, and Fig 6

      The authors made every effort to cove the precedent literature, but the manuscript has 115 references. The authors should evaluate if all the cited literature is extremely relevant. The manuscript would benefit for that conciseness.

      Because this manuscript addresses septins, ergosterol, sphingolipids, cell wall integrity, and multiple different pathways, there is a lot of literature underlying our approaches. Our strong preference is to cite primary literature, however we can shorten our reference list by relying on reviews if requested by the journal.

      Line 124, 493: Replace 10ˆ7, 10ˆ4 to 107, 104, etc

      “10^7” and all other scientific notation was altered to replace carrots “^7” with superscripts “7” throughout.

      The use of fludioxonil as a probe to detect cell wall impairment is perhaps out of context. This drug responds primarily to the HOG pathway and also respond to oxidative damage. So, these results could be suppressed.

      Previous work by Kojima et al., 2006 showed that in addition to the HOG pathway, cell wall integrity is required for resistance to fludioxonil treatment. C. neoformans cell wall integrity mutants bck1, mkk1, and mpk1 (Aspergillus nidulans bckA, mkkA, and mpkA homologues) all exhibit hypersensitivity to fludioxonil, and this was shown to be remediated by the addition of osmotic stabilizers, suggesting cell wall impairment was involved in the growth defect produced by this treatment. Although this drug seems to act primarily through the HOG pathway, the CWI and HOG pathways have been shown to antagonize/negatively regulate one another through a parallel pathway (SVG pathway in yeast) (Lee and Elion, 1999). It has been hypothesized that internal accumulation of glycerol by constitutive activation of the HOG pathway causes decreased cell wall integrity. Due to the apparent cross-pathway control between the HOG and CWI pathways, as well as the high level of conservation of these pathway components in filamentous fungi, we thought this treatment was rightfully dual-purposed to investigate both cell wall impairment in the septin mutants and any possible involvement of the HOG pathway. This seems to be would a reasonable drug treatment to look at cell wall impairment that is not likely to be redundant with the modes of action observed in the other Figure 1 treatments (e.g. CFW, Congo Red, and Caspofungin).

      The text clarifies this point as follows: li 110-112: Fludioxonil (FLU), a phenylpyrrol fungicide that antagonizes the group III histidine kinase in the osmosensing pathway and consequently affects cell wall integrity pathway signaling (Fig 1)(58-67).

      Line 140: "exposure" would be more appropriate than architecture. Please also consider that the difference in the cell wall reported in Figure S1 are very subtle. Are they relevant?

      The differences in the cell wall content reported in Figure S1 (Figure S2 in the revised manuscript) showed that the peak for 4-Glc was almost identical in WT and aspB null mutant, however the overall ratio of peaks switched, where 4-GlcNac content exceeded the 4-Glc content in the mutant compared to WT. By comparison, this was not the case with the septin aspE null mutant. Although this could be considered a ‘subtle’ change in chitin content, we believe this was an important unbiased analysis of the cell wall polysaccharide content and addressed some of the cell wall sensitivity phenotypes we observed, not only between WT and the septin mutants, but also between the septin null mutants which showed sensitivity to cell wall disturbing agents (i.e. aspA, aspB, and aspC) vs. those that did not show significant sensitivity (e.g. aspE). For these reasons we believe this warranted at the very least a supplemental figure for these data.

      Though our idea of cell wall architecture includes changes in polymer exposure, as pointed out by the reviewer, others might use the phrase to mean only content changes. To avoid this misunderstanding, we have replaced the word “architecture” with “organization” in Li 147-148: These data show that cell wall organization is altered in ∆aspB cdc3 and raise the possibility that it might be altered in other core hexamer septin null mutants as well.

      Line 144: explain briefly what it is about and why it was chosen instead of the total detection of chitin sugar monomers. Line 538: Cell wall extraction section. Is this a new method? There is no supporting literature.

      We chose this method because it provides an analysis of all cell wall polysaccharide components and associated linkages. Detection of chitin sugar monomers would have also been a reasonable analysis if this were the only component of the cell wall we were investigating initially. The results showed differences in cell wall chitin content, so these were the data we presented.

      This was addressed on lines 574-576: “Cell walls were isolated from a protocol based on (Bull, 1970); cell wall extraction and lyophilization were conducted as previously described in (Guest and Momany, 2000) with slight modifications listed in full procedure below.”

      The results described on lines 232-257 are marginal to the study and are not exploited by the authors to address the central question of the manuscript, which is the role of the CWI pathway, septins, and sphingolipids. This section could be suppressed or very briefly mentioned in the preceding section.

      We agree that these data did not show any additional involvement of septins in the Calcineurin and cAMP-PKA pathways, and the relevance of the TOR signaling pathway connection is still quite unclear. For this reason, these data were added as a supplemental figure. On the other hand, there are a number of important signaling pathways which have been shown to affect the Cell Wall Integrity pathway directly and indirectly (these three pathways in particular), which is part of the central question of the manuscript. Considering such extensive ‘cross-talk’ between pathways (references produced on Line 65) in filamentous fungi, we felt it necessary to inspect possible involvement of these pathways in septin function via plate-based assays and feel that this s most clearly communicated as its own brief section in the text.

      Reviewer #2 (Significance (Required)): The topic of the manuscript is highly relevant to the fungal biology field and employs a very important genetic model. The cooperation of signaling pathways in mains aspects of fungal physiology is the main significant contribution of this manuscript. Reviewer__ #3 (Evidence, reproducibility and clarity (Required)):__ **Summary:** In this work the authors use genetic analysis in Aspergillus nidulans to identify phenotypes of septin mutants that point to roles for septins in coordinating the cell wall integrity pathway with lipid metabolism in a manner involving sphingolipids. Most of the major conclusions derive from monitoring the effects of combined genetic or chemical manipulations that target specific components of the pathways of interest. Additionally, the authors monitor the subcellular localization of septins, cell-wall modifying enzymes, and components of the cell wall itself. **Major comments:** The key conclusions are convincing, with the unavoidable caveat that null mutations of this sort and chemical inhibitors of these kinds could have unanticipated effects, such as upregulation of unexpected pathways or other compensatory alterations. The authors qualify their conclusions appropriately in this regard. The methods are explained very clearly and the data are presented appropriately. In some cases results are shown as representative images illustrating altered localization of a protein or a cell wall component. The changes observed in the experimental conditions are fairly obvious, but some quantification would not be difficult and would likely make the results even more obvious. For example, the Calcofluor White staining patterns might be nicely quantified by linescans along the hyphal length, and the same is true for AspB-GFP localization upon addition of drugs.

      We thank the reviewer for the positive comments and have made the suggested changes as follows:

      Line scans of aniline blue and CFW label were conducted and added as Fig S1. Text has been modified accordingly (Li 140-147).

      Quantification of Chitin synthase-GFP localization and CFW staining and statistical analysis have now been added as Figure S3 and main text (Li 187-191) has been modified accordingly.

      I could imagine one simple experiment that might generate interesting and relevant results, but by no means would this be a critical experiment for this study. In yeast, exposure to Calcofluor triggers increased chitin deposition in the wall. It would be interesting to know how Calcofluor staining looks in WT or septin-mutant cells that have been growing the presence of Calcofluor for some time, particularly with regard to the localization of chitin deposition in these cells. Such experiments could help connect the idea of septins as sensors of membrane lipid status and also effectors of CWI signaling.

      This is a cool idea that we will pursue in future work. Thanks!

      **Minor comments:** • Body text refers to Figure 1A and 1B but the figure itself does not have panels labeled A or B.

      Figure 1 was revised to show panels A and B labeled clearly.

      • Line 885: "S3" is missing from the beginning of the title of the figure.

      “S” was added to the figure title.

      Reviewer Identity: This is Michael McMurray, PhD, Associate Professor of Cell and Developmental Biology, University of Colorado Anschutz Medical Campus

      Reviewer #3 (Significance (Required)): This is an important conceptual advance in our understanding of septin function because previous work in fungal septins mostly points toward them being important in directing or restricting the localization of other proteins that modify the cell wall or plasma membrane. This new work suggests that septins can play a sensing role, as well. As a fungal (budding yeast) septin researcher myself, I think that other fungal septin researchers would be very interested in these results, and I also think the broader septin community would appreciate it. Additionally, those studying fungal cell wall and plasma membrane biogenesis and coordination, including the Cell Wall Integrity Pathway, will be interested. REFEREES CROSS COMMENTING After reading Reviewer #1's comments, I agree that it would be appropriate to modify the wording of the authors' conclusions about where the septins lie in the CWI pathway (upstream or downstream). While they do mention that there may be other ways to interpret their results, a reader would have to search for the mention of these caveats and if the reader did not, then the strong conclusion statements might be taken as fact.

      The abstract, main text, and discussion have been modified to show that while there is evidence that the septins interact with the CWI pathway, it is not clear which component is upstream vs downstream. See response to reviewer 2 above for details.

      On the other hand, I don't think additional experiments looking at deletions of the other core septins will be worthwhile. I think that there is sufficient evidence to suspect that any single core septin deletion mutant will behave similar to another, and therefore that any one can be taken as representative. While it's possible that the authors might find something informative by looking at other mutants, I personally find the likelihood too low to justify additional experimentation along those lines.

      Based on results from previous work from our lab, there are two subgroups of core septins in A. nidulans (hexamer and octamer) and septins within subgroups appear to behave similarly. The results from the current work support this idea with the same groups of mutants behaving in very similar ways. So, the core hexamer septins, AspACdc11, AspBCdc3, and AspCCdc12 can be used to make predictions about each other, but not about the octamer-exclusive septin AspDCdc10 or the noncore septin AspE. We agree with reviewer 3 that repeating analysis on multiple septins within a subgroup is not likely to give new insight. However, we were not careful in the original version of the manuscript to distinguish between core hexamer and octamer septins. As detailed in the response to reviewer 2 above, we have modified the manuscript throughout to make clear which subgroup of septins were being examined and to put conclusions into this context.

    2. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #3

      Evidence, reproducibility and clarity

      Summary:

      In this work the authors use genetic analysis in Aspergillus nidulans to identify phenotypes of septin mutants that point to roles for septins in coordinating the cell wall integrity pathway with lipid metabolism in a manner involving sphingolipids. Most of the major conclusions derive from monitoring the effects of combined genetic or chemical manipulations that target specific components of the pathways of interest. Additionally, the authors monitor the subcellular localization of septins, cell-wall modifying enzymes, and components of the cell wall itself.

      Major comments:

      The key conclusions are convincing, with the unavoidable caveat that null mutations of this sort and chemical inhibitors of these kinds could have unanticipated effects, such as upregulation of unexpected pathways or other compensatory alterations. The authors qualify their conclusions appropriately in this regard.

      The methods are explained very clearly and the data are presented appropriately. In some cases results are shown as representative images illustrating altered localization of a protein or a cell wall component. The changes observed in the experimental conditions are fairly obvious, but some quantification would not be difficult and would likely make the results even more obvious. For example, the Calcofluor White staining patterns might be nicely quantified by linescans along the hyphal length, and the same is true for AspB-GFP localization upon addition of drugs.

      I could imagine one simple experiment that might generate interesting and relevant results, but by no means would this be a critical experiment for this study. In yeast, exposure to Calcofluor triggers increased chitin deposition in the wall. It would be interesting to know how Calcofluor staining looks in WT or septin-mutant cells that have been growing the presence of Calcofluor for some time, particularly with regard to the localization of chitin deposition in these cells. Such experiments could help connect the idea of septins as sensors of membrane lipid status and also effectors of CWI signaling.

      Minor comments:

      • Body text refers to Figure 1A and 1B but the figure itself does not have panels labeled A or B. • Line 885: "S3" is missing from the beginning of the title of the figure.

      Reviewer Identity: This is Michael McMurray, PhD, Associate Professor of Cell and Developmental Biology, University of Colorado Anschutz Medical Campus

      Significance

      This is an important conceptual advance in our understanding of septin function because previous work in fungal septins mostly points toward them being important in directing or restricting the localization of other proteins that modify the cell wall or plasma membrane. This new work suggests that septins can play a sensing role, as well. As a fungal (budding yeast) septin researcher myself, I think that other fungal septin researchers would be very interested in these results, and I also think the broader septin community would appreciate it. Additionally, those studying fungal cell wall and plasma membrane biogenesis and coordination, including the Cell Wall Integrity Pathway, will be interested.

      REFEREES CROSS COMMENTING

      After reading Reviewer #1's comments, I agree that it would be appropriate to modify the wording of the authors' conclusions about where the septins lie in the CWI pathway (upstream or downstream). While they do mention that there may be other ways to interpret their results, a reader would have to search for the mention of these caveats and if the reader did not, then the strong conclusion statements might be taken as fact. On the other hand, I don't think additional experiments looking at deletions of the other core septins will be worthwhile. I think that there is sufficient evidence to suspect that any single core septin deletion mutant will behave similar to another, and therefore that any one can be taken as representative. While it's possible that the authors might find something informative by looking at other mutants, I personally find the likelihood too low to justify additional experimentation along those lines.

    3. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #2

      Evidence, reproducibility and clarity

      Summary

      The study by Mela and Momany describes the function of core septins of A. nidulans and links with the requirement of the cell wall integrity pathway and the sphingolipids which, are required for membrane and cell wall stability. The study is of interest for the fungal genetics community, and the authors have conducted a substantial amount of work in a field they have substantial experience. However, one of the main weaknesses of the manuscript is the assumption whether the CWI pathway controls de septin function of if the core septins control it.

      Major comments

      In the abstract, the authors claim that double mutant analysis suggested core septins function downstream of the final kinase of the cell wall integrity pathway. However, from the experiments showed, it is difficult to be convinced about that. The authors should make efforts do make it clear in the manuscript and the discussion.

      For example:

      -Line 25-26 (abstract): "Double mutant analysis suggested core septins function downstream of the final kinase of the cell wall integrity pathway."

      -Line 181-182; 219-220 (results) "Double mutant analyses suggest core septins modulate the cell wall integrity pathway downstream of the kinase cascade."

      This conclusion is one of the most important of the manuscript. However, this reviewer argues that it cannot be convincingly addressed if at least the phosphorylation ok the MAP kinase MpkA in the septins background is not evaluated under conditions of cell stress and sphingolipid biosynthesis inhibition. The genetic analysis alone maybe not enough to infer if septins control the CWI or the other way around. There may have compensatory effects when the CWI pathway is impaired. For example, most of the septins and mpkA double mutants seems to suppress the defect of the delta mpkA under cell wall stress. The authors should consider this idea.

      There is no clear evidences on the manuscript that the core septins AspA, AspB, AspC , and ApsD are epithastic in A. nidulans. Therefore, the authors choice of using different Asp deletion mutants as a proxy for all the septins mutants is questionable. For example, there is no mention of why AspB was chosen for Figure 2 (chitin and β-1,3-glucan deposition), and AspA was chosen for Figure 3 (chitin synthase localization) since these experiments are correlated. The same is true for Figure S1 where AspB and AspE were used. One can wonder if some of the core septins would have a major impact in the chitin content.

      In a related comment about Figure 3, the reallocation of chitin synthases in the absence of septins is very interesting, but consider that all the core septin genes should be tested. Without a fully functioning cell wall, the formation of septa will be impaired. It makes their results less surprising.

      Why was chitin synthase B chosen to be analyzed in terms of reallocation? How many chitin synthases are in the A. nidulans genome. This rationale should be explained in the manuscript.

      Figure 3 and Figure 4. The authors should make efforts to quantify the phonotypes they claim. They are overall very subtle, especially for Figure 3. Also, a decrease of fluorescence is a tricky observation that should be better reported by quantification.

      Again, in Figures 5, 6, and 7, it is clear that the different septins respond differently when ergosterol or sphingolipids synthesis is impaired. It also raises the question again if there are differences in the role of septin genes. Can the authors use previous information about differences in septin function to improve the model (Figure 8)

      For the above-discussed reasons, the conclusion on lines 384-388 (discussion) is not completely supported by the experiments shown in the manuscript. The authors need to make a better structured and more straightforward story emphasizing the stronger points and reducing descriptions of more speculative points. Minor comments Overall the figure caption could be shortened. They are too descriptive and contain details that are easily inferred for the images and from the materials and methods.

      The authors made every effort to cove the precedent literature, but the manuscript has 115 references. The authors should evaluate if all the cited literature is extremely relevant. The manuscript would benefit for that conciseness.

      Line 124, 493: Replace 10ˆ7, 10ˆ4 to 107, 104, etc

      The use of fludioxonil as a probe to detect cell wall impairment is perhaps out of context. This drug responds primarily to the HOG pathway and also respond to oxidative damage. So, these results could be suppressed.

      Line 140: "exposure" would be more appropriate than architecture. Please also consider that the difference in the cell wall reported in Figure S1 are very subtle. Are they relevant?

      Line 144: explain briefly what it is about and why it was chosen instead of the total detection of chitin sugar monomers. Line 538: Cell wall extraction section. Is this a new method? There is no supporting literature.

      The results described on lines 232-257 are marginal to the study and are not exploited by the authors to address the central question of the manuscript, which is the role of the CWI pathway, septins, and sphingolipids. This section could be suppressed or very briefly mentioned in the preceding section.

      Significance

      The topic of the manuscript is highly relevant to the fungal biology field and employs a very important genetic model. The cooperation of signaling pathways in mains aspects of fungal physiology is the main significant contribution of this manuscript.

    4. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #1

      Evidence, reproducibility and clarity

      Septins are highly conserved small GTPase cytoskeletal proteins that function as molecular scaffolds for dynamic cell wall and plasma membrane-remodeling, as well as diffusion barriers restricting movement of membrane and cell wall-associated molecules. Recent work has started to unravel the functional connections between the septins, cell wall integrity MAPK pathway signaling, and lipid metabolism, however most studies have focused on a small sub-set of septin monomers and/or were conducted in primarily yeast-type fungi.

      Here the authors show in the filamentous fungus A. nidulans that the core hexamer septins are required for proper coordination of the cell wall integrity pathway, that all septins are involved in lipid metabolism. Especially sphingolipid, but not sterols and phosphoinositides, contributes to the localization and stability of core septins at the plasma membrane.

      The experiments are simple and clear, therefore the conclusion is convincing. Fig.8 model, I would like to see the situation of septin mutant.

      Significance

      Since localization of cell wall synthesis proteins, lipid domains and septins are likely to depend on each other, sometimes difficult to evaluate the effect is direct or indirect. The comprehensive analyses like performed here are helpful to catch the overview in the field.

    1. Note: This rebuttal was posted by the corresponding author to Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Reply to the reviewers

      Reviewer #1 (Evidence, reproducibility and clarity (Required)):

      In this study, the authors use focused-ion beam (FIB) milling coupled with cryo-electron tomography and subtomogram averaging to uncover the structure of the elusive proximal and distal centrioles, as well as different regions of the axoneme in the sperm of 3 mammalian species: pig, horse, and mouse. The in-situ tomograms of the sperm neck region beautifully illustrate the morphology of both the proximal centriole, confirming the partial degeneration of mouse sperm, and intriguingly, asymmetry in the microtubule wall of pig sperm. In distal centrioles, the authors show that in all mammalian species, microtubule doublets of the centriole wall are organized around a pair of singlet microtubules. The presented segmentation of the connecting piece is beautiful and nicely shows the connecting piece forming a nine-fold, asymmetric, chamber the centrioles. The authors further use subtomogram averaging to provide the first maps of the mammalian central pair and identify sperm-specific radial spoke-bridging barrel structures. Lastly, the authors perform further subtomogram averaging to show to the connecting site of the outer dense fibers to the microtubule doublet of the proximal principal piece and confirm the presence of the TAILS microtubule inner protein complex (Zabeo et al, 2018) in the singlet microtubules occupying the tip of sperm tails.

      The manuscript provides the clearest insight into flagellar base morphology to date, giving insight into the morphological difference between different mammalian cilia and centriole types. The manuscript is suitable for publication, once the following questions are addressed.

      We are ecstatic that the reviewer shares our enthusiasm for this work. We are particularly grateful that the reviewer appreciates the significance of the unique, and hitherto under-explored biology of the sperm centrioles and the flagellar base.

      **Major Points:**

      How many centrioles and axonemes were used in generating the averages presented in the paper? If too few samples were used, especially in centrioles undergoing dramatic remodeling or degeneration, the reality of MIPs and MAPs being present might be completely affected. For instance, In figure 1d, the authors present a cryoET map of the centriole microtubule triplet. However, centrioles are divided into several regions with different accessory elements. Here, the authors could show the presence of only part of the A-C linker. The A-C linker covers only 40% of the centriole, so does it mean that this centriole is made only of the accessories that characterize the proximal side of the centriole? In the same line, what were the boundaries governing subtomogram extraction? For example, in the distal centriole, were microtubules extracted from just before the start of the transition zone, to the end of the microtubule vaulting, more pronounced at the end of the proximal region? There are known heterogeneities in centriole, as well as flagella, ultrastructure along the proximal distal axis. If no pre-classification was performed for subtomogram longitudinal position along with the centriole and axoneme, structural features may be averaged out, and or present and not reflecting their real longitudinal localization. The classification should be applied here if it was not the case.

      These are all valid points. Because there is no easy way to target the PC/DC when cryo-FIB milling, and because there is only one of each structure in every cell, the chances of catching them in ~150-nm-thin lamellae are slim (not to mention the number of things that can and do go wrong when doing cryo-ET on lamellae). As such, the averages of the PC were generated from 3 tomograms (3 cells) and those of the DC from 2 tomograms (2 cells). We do have more tomograms with the PC/DC, but these were used for segmentation/visual inspection since we only used the best tomograms for averaging. These numbers are not entirely atypical for cryo-FIB datasets; the only other in situ centriole structures are from 5-6 centrioles (from Chlamydomonas, from Le Guennec et al 2020 doi: 10.1126/sciadv.aaz4137 and Klena et al 2020 doi: 10.15252/embj.2020106246).

      To allow readers to adjust their interpretations according to the small number of cells analysed, we explicitly stated the number of animals/cells/tomograms used to generate averages in Table S1. Furthermore, we amended the text to clarify which regions of the centrioles our averages represent. These changes are detailed below:

      (1) proximal centriole

      The lamellae used for averaging PC triplets caught mostly the proximal end of the centriole, and essentially all of the particles come from the most proximal ~ 400 nm. In a sense, this was a form of pre-classification. We now state explicitly that our structure represents only the proximal region and that proximal/distal differences may be identified in the future (see section on distal centriole below). Despite the limited particle number, we are confident in the presence of the MIPs as these are also visible in the raw data (the striations in Fig. 1a, now Fig. 1d, for instance). Page 7, Line 165 was edited accordingly as well as the legend to Fig. 1.

      (2) distal centriole

      The subtomograms used for the DC average were extracted from the region of the distal centriole closest to the base of the axoneme (i.e; the region marked “distal centriole” in Fig. 2h-i). Because the DC doublet average in Fig. 2j was generated from very few particles, we tried to be very conservative when interpreting it. Page 9, Line 216 was edited accordingly likewise the legend to Fig. 2.

      (3) axoneme

      We did attempt to average the axoneme from different regions of flagella (midpiece, proximal principal piece, distal principal piece). This is shown in Fig. 6d-l. The major difference we found was at the doublet-ODF connection. We did not find any striking differences in MIP densities, or in radial spoke densities along the proximodistal axis. As such, the averages in Fig. 5 are from the entire principal piece (but not the midpiece), which we state in the figure legend.

      Because mammalian sperm flagella are very long, it is possible that we missed more subtle differences. We now state this in the Discussion (page 20, line 491):

      **Minor Points:**

      • In line 3, motile cilia are not only used to swim, they can move liquid or mucus for instance.

      Done. Page 3, line 64

      • In line 175, the authors stated " a prominent MIP associated with protofilament A9, was also reported in centrioles isolated from CHO cells (Greenan et al. 2018) and in basal bodies from bovine respiratory epithelia (Greenan et al 2020). Actually, this MIP has been seen in many other centrioles from other species, such as Trichonympha (https://doi.org/10.1016/j.cub.2013.06.061 ), Chlamydomonas, and Paramecium ( DOI: 10.1126/sciadv.aaz4137 ). Citing these studies will reinforce the evolutionary conservation of this MIP and therefore its potential crucial role in the A microtubule.

      We thank the reviewer for pointing out these very important papers, we added them to the manuscript (page 7, lines 175-176).

      • In Line178, the authors stated: "Protofilaments A9 and A10 are proposed to be the location of the seam (Ichikawa et 2017)". High-resolution cryoEM maps confirmed it: https://doi.org/10.1016/j.cell.2019.09.030 . This publication should be cited. Moreover, authors should also refer to this paper when discussing MIPs in the microtubule doublet.

      Done (page 7, lines 178-179 and page 13, line 329).

      We also now cite Ma et al (along with Ichikawa et al 2019 doi: 10.1073/pnas.1911119116 and Khalifa et al 2020 doi: 10.7554/eLife.52760) in the Discussion when alluding to high-resolution structures as a possible means of identifying MIPs (page 19, lines 479).

      • In Line 187-189 the authors stated, "We resolved density of the A-C linker (gold) which is associated with protofilaments C9 and C10." The A-C linker interconnects the triplets of the proximal centriole (Guichard et. al. 2013, Li et. al. 2019, Klena et. al. 2020) with distinct regions binding the C-tubule, as shown by the authors in gold, as well as an A-link, making contact with the A-tubule through various protofilaments in a species-specific manner, but always on protofilament A9. The authors may have identified the A-link, labeled in green, on the outside of protofilament A8/A9 in Figure 1d.

      We thank the reviewer for pointing this out. The position of the olive green density associated with A8/A9 is indeed consistent with the A-link, and this is also now illustrated more clearly in the new version of Fig. 1e (now Fig. 1h, see below). We accordingly edited page 8, lines 187-188.

      • In figure 1e, the authors provide a 9-fold representation of the centriole based on their map. How relevant is this model ? the distance between triplet is inconsistent here, which has not been observed before. Do they use true 3D coordinates to generate this model? The A-C linker, which is only partially reconstructed, does not contact the A microtubule. Is it really the case? did the authors see that the A-link density of the A-C linker has disappeared? If these points are not clearly specified, this representation might be misleading.

      In order to avoid misleading readers, we replaced this panel with a model generated directly by plotting back the averages into their original positions and orientations in the tomogram (new Fig. 1h). This model now shows that the olive green density on A8/A9 is in the right position to form part of the A-C linker (as Reviewer 1 correctly pointed out in their previous point). We have amended the figure legend accordingly. We also described how the plotback was generated in the Materials and Methods section (page 26, line 648).

      As the reviewer points out, the distance between triplets does indeed seem inconsistent in the plotback. This is an interesting observation, but we feel it is a bit too preliminary to discuss in detail here. This can be explored in a follow-up study more focused on sperm centriole geometry.

      • The nomenclature regarding MIPs is sometimes confusing in this manuscript. For example, in lines 228-229 "We then determined the structure of DC doublets, revealing the presence of MIPs distinct from those in the PC." Does this include the gold and turquoise labeled structures in Figure 2j? These densities appear to correspond to the inner scaffold stem in the gold density presented in Figure 2j, and armA, presented in the turquoise density (Li et. al. 2011, Le Guennec et. al. 2020). The presence of this Stem here is important as it correlates with the presence of the molecular player making the inner scaffold (POC5, POC1B, CENTRIN): https://doi.org/10.1038/s41467-018-04678-8

      While we were initially very conservative with interpreting the DC doublet average (as stated above it comes from very few particles), we agree with the reviewer’s assessment that the gold and turquoise densities in Fig. 2j are consistent with the Stem and armA respectively of the inner scaffold. Because the inner scaffold contributes to centriole rigidity, it will be interesting to determine if and how it changes during remodelling of the atypical DC in mammalian sperm. Intriguingly, at least some inner scaffold components (including POC5, POC1B) reorganise into two rods in the mammalian sperm DC (Fishman et al 2018 doi: 10.1038/s41467-018-04678-8). We expanded the section on the DC average (page 9, lines 218-220):

      • The connecting piece is composed of column vaults emanating from the striated columns is compelling and beautiful segmentation data. However, it is important to note how many pig sperm proximal centrioles had immediate-short triplet side contact with the Y-shaped segmented column 9, as well as in how many mouse centrioles have the two electron-dense structures flanking the striated columns.

      Done. Material and Methods Page 25, lines 615-619.

      The resolution of the mammalian central pair is an important development brought by this work. The structural similarity between the central pair of pig and horse is convincing. However, with only 281 subtomograms being averaged for the murine central pair, corresponding to an estimated resolution of 49Å, the absence of the helical MIP of C1 with 8 nm periodicity suggests that there is simply not enough signal to capture it in the average. The same could be said for the smaller MIP displayed in Figure 4 c, panel ii. This point should be clearly stated.

      We agree with the reviewer that the quality of the mouse CPA structure is not on par with the pig and horse CPA structures. We now explicitly state this caveat in the text (pages 11, lines 276-277):

      Another piece of compelling data presented in this study is the attachment of the outer dense fibers to the axoneme of the midpiece and proximal and distal principal pieces. From the classification data presented along the flagellar length, it is clear that the only ODF contact made with the axoneme is at the proximal principle plate. However, this is far from obvious in the native top view images presented. Is it possible to include a zoomed inset of the connection between the A-tubule and ODF connection?

      We are very happy that the reviewer finds this data exciting. As Fig. 6 is quite cluttered as is, we instead tried to better annotate the cross-section views of the axoneme by tracing one doublet-ODF pair in each image (or only a doublet in the case of the distal principal piece). This shows that there is a gap between the doublet and the ODF in the midpiece, and that there is no such gap in the principal piece. We also hope that annotating one doublet-ODF pair helps the reader see that the same pattern holds true for the other doublets/ODFs. The legend to Fig. 6 was changed accordingly.

      Reviewer #1 (Significance (Required)):

      This work is of good quality and provides crucial information on the structure of centriole and axoneme in 3 different species. This work complements well the previous works.

      The audience for this type of study is large as it is of interest to researchers working on centrioles, cilium, and sperm cell architecture.

      We are pleased the reviewer appreciate the quality of our work and see the interest for broad audience.

      My expertise is cryo-tomography and centriole biology

      Reviewer #2 (Evidence, reproducibility and clarity (Required)):

      In this study, Leung et al. used state-of-the-art EM imaging techniques, including FIB cryo-milling, Volta Phase plate, cryo-electron tomography and subtomogram averaging, to study the structure of sperm flagella from three mammalian species, pig, horse and mouse. First, they described two unique centrioles in the sperm, the PC and the DC. They found the PCs are composed of a mixture of triplet and doublet MTs. In contrast, the DCs are composed mainly of doublet and singlet MTs. By using subtomogram averaging, they identified a number of accessory proteins, including many MIPs bound to the MT wall. Many are unique to the mammalian sperm. They further described the connecting piece region of the sperm enclosing the centrioles and found an asymmetric arrangement. Furthermore, the authors presented the structure of sperm axonemes from all three species. These include the DMT and the CPA. Finally, they described the tail region of the sperm and described how the DMTs transitioned to the singlet MTs.

      This is a beautiful piece of work! It is by far the most comprehensive structural study of mammalian sperm cells. These findings will serve as a valuable resource for structure and function analysis of the mammalian flagella in the future. Now the stage is set for identifying the molecular nature of the structures and densities described in this study.

      We thank the reviewer for their positive evaluation! We are very happy that they share our excitement for the work, and that they also see it as “setting the stage” for future studies at the molecular level.

      The manuscript is clearly written. The data analysis is thorough. The conclusions are solid and not overstated. I don't have any major issues for its publication. A number of minor suggestions are listed below. Most are related to the figures and figure legends.

      Figure 1d, the figure legend should mention this is the subtomogram average of PC triplet MTs from pig sperm, though this is mentioned in the text. Also, for convenience, the color codes for the MIPs should be mentioned in the figure legend.

      Done.

      Figure 2J, similarly, the figure legend should mention this is the subtomogram average of DC doublets. It also needs a description of the color codes of the identified MIPs. For the DMT, please indicate the A- and B-tubule, which are colored in light or dark blue.

      Done, except we would prefer not to enumerate the MIPs as we did not name them nor discuss them extensively in the main text as we do not want to over-interpret the MIPs at this point as the average is from relatively small number of particles. However, we did specify that the gold and turquoise densities on the luminal surface are consistent with the inner scaffold. The figure legend was edited accordingly.

      Line 228, "We then determined the structure of DC doublet by subtomogram averaging"

      Done.

      For both Fig 2 and Fig 3. the DC doublets are colored in dark and light blue, please specify which is the A- or B-tubule in the figure legends.

      Done.

      Line 273, need space between "goldenrod"

      We would prefer to keep “goldenrod” spelled as is since this is how the color is referred to in Chimera and ChimeraX.

      Figure 4. need to expand the figure legend. Panels I, ii, iii, iv, are cut-through view of the lumen of CPA microtubules C1 and C2.

      Done.

      Line 338, Interestingly, the RS1 barrel is radially distributed asymmetrically around the axoneme

      Done.

      Figure 5, need color codes for the arrowheads (light pink, pink, magenta) in panels i~n,

      Done.

      Figure 7, (a-c) please use arrowheads to indicate the location of caps in the singlet MT.

      Done.

      Reviewer #2 (Significance (Required)):

      This is a beautiful and significant work - by far the most comprehensive analysis of mammalian sperm structure

      We are thrilled the reviewer appreciate the novelty of our work.

      Reviewer #3 (Evidence, reproducibility and clarity (Required)):

      This is a very interesting study that explores the structural diversity of mammalian sperm flagella, in pig, mouse and horse, at high resolution using cryo-FIB milling and cryo-tomography. The study provides the first in situ cryo-EM structure of a mammalian centriole and describes a number of microtubule associated structures, such as MIPs and plugs at the plus-end of microtubules, that were not been reported so far. Additionally, the authors identify several asymmetries in the overall structure of the flagellum in the three species, which have implications for the understanding of the flagellar beat and waveform geometry in sperm, which are discussed by the authors. Although this study does not provide mechanistic novel information on the function of the described structures, it will undoubtedly serve as a reference for future theoretical and empirical work on the role of these structures in shaping the flagellar beat.

      With the exception of a couple of "eclectic word choices" in the Introduction (see detailed feedback in Minor Comments), the manuscript is also well written. Image acquisition and analysis are sound.

      We thank the reviewer for positively evaluating our work. We are glad that they feel our study will “serve as a reference” to inform future studies.

      However, I have some suggestions that should help the authors to strengthen their claims and present their results. The study is in principle suitable to be published, after the following points will be addressed:

      **Major comments:**

      • A major concern is that it is not clear how many animals, sperms and lamellae the authors used to acquire the data presented in the manuscript. This information needs to be provided, because it not uncommon to encounter aberrant flagella, even in a wildtype animal. The authors should state how many animals, and how many flagella per each animal were analyzed, in order to allow the reader to have an opinion on the reliability of their observations.

      • The figures are esthetically pleasing; however, the figures legends should be carefully revised to include necessary information about color codes, image annotations.

      We thank the reviewer for raising these points. We completely agree that the numbers of animals and cells are important pieces of information. As such, we now explicitly state the number of animals/cells/tomograms used for each average in Table S1. For more qualitative observations (such as the relationship between the asymmetry of the pig sperm PC and the Y-shaped segmented columns), we now state in the number of cells and animals in which we see each feature (see detailed response to Reviewer 1).

      **Minor comments:**

      • Line 26. I do not think that the word "menagerie" is properly used in this context.

      • Line 29. The same is true for the word "Bewildering" in this sentence.

      We apologise for our somewhat eclectic word choice. We see the reviewer’s point that unconventional word choice may distract readers, so we replaced these two words with ‘diverse’ and ‘an extensive’, respectively.

      • Line 286 "Our structures of the CPA are the first from any mammalian system, and our structures of the doublets are the first from any mammalian sperm, thus filling crucial gaps in the gallery of axoneme structures." Sentences like this one would fit much better in the Conclusions or at least in the Discussion.

      We thank the reviewer for this suggestion, but we would prefer to keep this sentence where it is, if possible. We think it is useful to tell the audience upfront why these structures are significant, especially since readers who aren’t deep in the field may be bogged down by all the details.

      • Line 377 "Large B-tubule MIPs have so far only been seen in human respiratory cilia (Fig. 5j) and in Trypanosoma (the ponticulus, Fig. 5n), but the morphometry of these MIPs differs from the helical MIPs in mammalian sperm." Please insert the citations for the studies about respiratory cilia and Trypanosoma flagella.

      Done.

      • In Figure 1. What do the stars shown in panel a and a' indicate?

      We indeed failed to specify what the asterisks/stars indicate. They are meant to emphasise that the electron-dense material in the lumen of the PC is continuous with the CP. We have now specified this in the text (page 10, lines 245).

      Given the complexity of the structures that compose the flagellar system of sperms, it would be helpful to add an illustration of the sperm with careful annotation of the centriole structures and the various segments of the flagellum.

      This is an excellent suggestion. To help orient readers, we added three panels to Fig. 1 (Fig. 1a-c) showing low-magnification images of whole sperm cells. We annotated different parts of the flagellum (neck, midpiece, principal piece, endpiece) so that readers can refer back to these panels in case they want to know which part of the cell the averages are from.

      • Figure 2. Explanation of the used color codes is missing. Additionally, the authors should include an explanation for the black and white arrows and for the 2 insets in i.

      Done. For the color code, please see response to Reviewer 2. For the black and white arrows, we edited the figure legend.

      • In "(j) In situ structure of the pig sperm DC with the tubulin backbone in grey and microtubule inner protein densities colored individually" ...it should be written "...sperm DC microtubule doublet..."

      Done.

      • In this figure, but also in every other figure that shows centriole, axoneme, or even microtubule averages it is important to indicate the microtubule polarity. Please add the symbol + and - to indicate microtubule polarity in the figures.

      Done. In order to avoid overcrowding, we only labelled the pig structures as the horse and the mouse structures are always shown in the same orientations as the pig.

      • Figure 3. Additional to the images in a,b, and c, the original tomographic slices (without segmentation) should be shown here, to allow the reader to visualize the structure.

      We now include three additional supplementary movies slicing through the respective tomograms.

      • Figure 7. Scale bars are missing in d-f.

      Done.

      • Scale bars are missing in most Supplementary figures.

      Done.

      • Table S1. The Information about horse and mouse centriole data is missing.

      The reviewer is correct, but this information is missing because we did not average from the horse and the mouse. For the mouse, the triplets were in various stages of degeneration, resulting in heterogeneity that precluded us from averaging. For the horse, we simply did not catch enough centrioles to generate a meaningful structure.

      Reviewer #3 (Significance (Required)):

      This study provides several novel structural insights in to the sperm flagellum structure that have implications for the understanding of the flagellar beat and waveform geometry in sperm. Although this study does not provide mechanistic novel information on the function of the described structures, it will undoubtedly serve as a reference for future theoretical and empirical work on the role of these structures in shaping the flagellar beat.

      Great to see the reviewer appreciate the novelty of our work.

    2. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #3

      Evidence, reproducibility and clarity

      This is a very interesting study that explores the structural diversity of mammalian sperm flagella, in pig, mouse and horse, at high resolution using cryo-FIB milling and cryo-tomography. The study provides the first in situ cryo-EM structure of a mammalian centriole and describes a number of microtubule associated structures, such as MIPs and plugs at the plus-end of microtubules, that were not been reported so far. Additionally, the authors identify several asymmetries in the overall structure of the flagellum in the three species, which have implications for the understanding of the flagellar beat and waveform geometry in sperm, which are discussed by the authors. Although this study does not provide mechanistic novel information on the function of the described structures, it will undoubtedly serve as a reference for future theoretical and empirical work on the role of these structures in shaping the flagellar beat. With the exception of a couple of "eclectic word choices" in the Introduction (see detailed feedback in Minor Comments), the manuscript is also well written. Image acquisition and analysis are sound.

      However, I have some suggestions that should help the authors to strengthen their claims and present their results. The study is in principle suitable to be published, after the following points will be addressed:

      Major comments:

      • A major concern is that it is not clear how many animals, sperms and lamellae the authors used to acquire the data presented in the manuscript. This information needs to be provided, because it not uncommon to encounter aberrant flagella, even in a wildtype animal. The authors should state how many animals, and how many flagella per each animal were analyzed, in order to allow the reader to have an opinion on the reliability of their observations.
      • The figures are esthetically pleasing; however, the figures legends should be carefully revised to include necessary information about color codes, image annotations.

      Minor comments:

      • Line 26. I do not think that the word "menagerie" is properly used in this context.
      • Line 29. The same is true for the word "Bewildering" in this sentence.
      • Line 286 "Our structures of the CPA are the first from any mammalian system, and our structures of the doublets are the first from any mammalian sperm, thus filling crucial gaps in the gallery of axoneme structures." Sentences like this one would fit much better in the Conclusions or at least in the Discussion.
      • Line 377 "Large B-tubule MIPs have so far only been seen in human respiratory cilia (Fig. 5j) and in Trypanosoma (the ponticulus, Fig. 5n), but the morphometry of these MIPs differs from the helical MIPs in mammalian sperm." Please insert the citations for the studies about respiratory cilia and Trypanosoma flagella.
      • In Figure 1. What do the stars shown in panel a and a' indicate? Given the complexity of the structures that compose the flagellar system of sperms, it would be helpful to add an illustration of the sperm with careful annotation of the centriole structures and the various segments of the flagellum.
      • Figure 2. Explanation of the used color codes is missing. Additionally, the authors should include an explanation for the black and white arrows and for the 2 insets in i.
      • In "(j) In situ structure of the pig sperm DC with the tubulin backbone in grey and microtubule inner protein densities colored individually" ...it should be written "...sperm DC microtubule doublet..."
      • In this figure, but also in every other figure that shows centriole, axoneme, or even microtubule averages it is important to indicate the microtubule polarity. Please add the symbol + and - to indicate microtubule polarity in the figures.
      • Figure 3. Additional to the images in a,b, and c, the original tomographic slices (without segmentation) should be shown here, to allow the reader to visualize the structure.
      • Figure 7. Scale bars are missing in d-f.
      • Scale bars are missing in most Supplementary figures.
      • Table S1. The Information about horse and mouse centriole data is missing.

      Significance

      This study provides several novel structural insights in to the sperm flagellum structure that have implications for the understanding of the flagellar beat and waveform geometry in sperm. Although this study does not provide mechanistic novel information on the function of the described structures, it will undoubtedly serve as a reference for future theoretical and empirical work on the role of these structures in shaping the flagellar beat.

    3. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #2

      Evidence, reproducibility and clarity

      In this study, Leung et al. used state-of-the-art EM imaging techniques, including FIB cryo-milling, Volta Phase plate, cryo-electron tomography and subtomogram averaging, to study the structure of sperm flagella from three mammalian species, pig, horse and mouse. First, they described two unique centrioles in the sperm, the PC and the DC. They found the PCs are composed of a mixture of triplet and doublet MTs. In contrast, the DCs are composed mainly of doublet and singlet MTs. By using subtomogram averaging, they identified a number of accessory proteins, including many MIPs bound to the MT wall. Many are unique to the mammalian sperm. They further described the connecting piece region of the sperm enclosing the centrioles and found an asymmetric arrangement. Furthermore, the authors presented the structure of sperm axonemes from all three species. These include the DMT and the CPA. Finally, they described the tail region of the sperm and described how the DMTs transitioned to the singlet MTs.

      This is a beautiful piece of work! It is by far the most comprehensive structural study of mammalian sperm cells. These findings will serve as a valuable resource for structure and function analysis of the mammalian flagella in the future. Now the stage is set for identifying the molecular nature of the structures and densities described in this study.

      The manuscript is clearly written. The data analysis is thorough. The conclusions are solid and not overstated. I don't have any major issues for its publication. A number of minor suggestions are listed below. Most are related to the figures and figure legends.

      Figure 1d, the figure legend should mention this is the subtomogram average of PC triplet MTs from pig sperm, though this is mentioned in the text. Also, for convenience, the color codes for the MIPs should be mentioned in the figure legend.

      Figure 2J, similarly, the figure legend should mention this is the subtomogram average of DC doublets. It also needs a description of the color codes of the identified MIPs. For the DMT, please indicate the A- and B-tubule, which are colored in light or dark blue.

      Line 228, "We then determined the structure of DC doublet by subtomogram averaging"

      For both Fig 2 and Fig 3. the DC doublets are colored in dark and light blue, please specify which is the A- or B-tubule in the figure legends.

      Line 273, need space between "goldenrod"

      Figure 4. need to expand the figure legend. Panels I, ii, iii, iv, are cut-through view of the lumen of CPA microtubules C1 and C2.

      Line 338, Interestingly, the RS1 barrel is radially distributed asymmetrically around the axoneme

      Figure 5, need color codes for the arrowheads (light pink, pink, magenta) in panels i~n,

      Figure 7, (a-c) please use arrowheads to indicate the location of caps in the singlet MT.

      Significance

      This is a beautiful and significant work - by far the most comprehensive analysis of mammalian sperm structure

    4. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #1

      Evidence, reproducibility and clarity

      In this study, the authors use focused-ion beam (FIB) milling coupled with cryo-electron tomography and subtomogram averaging to uncover the structure of the elusive proximal and distal centrioles, as well as different regions of the axoneme in the sperm of 3 mammalian species: pig, horse, and mouse. The in-situ tomograms of the sperm neck region beautifully illustrate the morphology of both the proximal centriole, confirming the partial degeneration of mouse sperm, and intriguingly, asymmetry in the microtubule wall of pig sperm. In distal centrioles, the authors show that in all mammalian species, microtubule doublets of the centriole wall are organized around a pair of singlet microtubules. The presented segmentation of the connecting piece is beautiful and nicely shows the connecting piece forming a nine-fold, asymmetric, chamber the centrioles. The authors further use subtomogram averaging to provide the first maps of the mammalian central pair and identify sperm-specific radial spoke-bridging barrel structures. Lastly, the authors perform further subtomogram averaging to show to the connecting site of the outer dense fibers to the microtubule doublet of the proximal principal piece and confirm the presence of the TAILS microtubule inner protein complex (Zabeo et al, 2018) in the singlet microtubules occupying the tip of sperm tails. The manuscript provides the clearest insight into flagellar base morphology to date, giving insight into the morphological difference between different mammalian cilia and centriole types. The manuscript is suitable for publication, once the following questions are addressed.

      Major Points: How many centrioles and axonemes were used in generating the averages presented in the paper? If too few samples were used, especially in centrioles undergoing dramatic remodeling or degeneration, the reality of MIPs and MAPs being present might be completely affected. For instance, In figure 1d, the authors present a cryoET map of the centriole microtubule triplet. However, centrioles are divided into several regions with different accessory elements. Here, the authors could show the presence of only part of the A-C linker. The A-C linker covers only 40% of the centriole, so does it mean that this centriole is made only of the accessories that characterize the proximal side of the centriole? In the same line, what were the boundaries governing subtomogram extraction? For example, in the distal centriole, were microtubules extracted from just before the start of the transition zone, to the end of the microtubule vaulting, more pronounced at the end of the proximal region? There are known heterogeneities in centriole, as well as flagella, ultrastructure along the proximal distal axis. If no pre-classification was performed for subtomogram longitudinal position along with the centriole and axoneme, structural features may be averaged out, and or present and not reflecting their real longitudinal localization. The classification should be applied here if it was not the case.

      Minor Points:

      • In line 3, motile cilia are not only used to swim, they can move liquid or mucus for instance.
      • In line 175, the authors stated " a prominent MIP associated with protofilament A9, was also reported in centrioles isolated from CHO cells (Greenan et al. 2018) and in basal bodies from bovine respiratory epithelia (Greenan et al 2020). Actually, this MIP has been seen in many other centrioles from other species, such as Trichonympha (https://doi.org/10.1016/j.cub.2013.06.061 ), Chlamydomonas, and Paramecium ( DOI: 10.1126/sciadv.aaz4137 ). Citing these studies will reinforce the evolutionary conservation of this MIP and therefore its potential crucial role in the A microtubule.
      • In Line178, the authors stated: "Protofilaments A9 and A10 are proposed to be the location of the seam (Ichikawa et 2017)". High-resolution cryoEM maps confirmed it: https://doi.org/10.1016/j.cell.2019.09.030 . This publication should be cited. Moreover, authors should also refer to this paper when discussing MIPs in the microtubule doublet.
      • In Line 187-189 the authors stated, "We resolved density of the A-C linker (gold) which is associated with protofilaments C9 and C10." The A-C linker interconnects the triplets of the proximal centriole (Guichard et. al. 2013, Li et. al. 2019, Klena et. al. 2020) with distinct regions binding the C-tubule, as shown by the authors in gold, as well as an A-link, making contact with the A-tubule through various protofilaments in a species-specific manner, but always on protofilament A9. The authors may have identified the A-link, labeled in green, on the outside of protofilament A8/A9 in Figure 1d.
      • In figure 1e, the authors provide a 9-fold representation of the centriole based on their map. How relevant is this model ? the distance between triplet is inconsistent here, which has not been observed before. Do they use true 3D coordinates to generate this model? The A-C linker, which is only partially reconstructed, does not contact the A microtubule. Is it really the case? did the authors see that the A-link density of the A-C linker has disappeared? If these points are not clearly specified, this representation might be misleading.
      • The nomenclature regarding MIPs is sometimes confusing in this manuscript. For example, in lines 228-229 "We then determined the structure of DC doublets, revealing the presence of MIPs distinct from those in the PC." Does this include the gold and turquoise labeled structures in Figure 2j? These densities appear to correspond to the inner scaffold stem in the gold density presented in Figure 2j, and armA, presented in the turquoise density (Li et. al. 2011, Le Guennec et. al. 2020). The presence of this Stem here is important as it correlates with the presence of the molecular player making the inner scaffold (POC5, POC1B, CENTRIN): https://doi.org/10.1038/s41467-018-04678-8
      • The connecting piece is composed of column vaults emanating from the striated columns is compelling and beautiful segmentation data. However, it is important to note how many pig sperm proximal centrioles had immediate-short triplet side contact with the Y-shaped segmented column 9, as well as in how many mouse centrioles have the two electron-dense structures flanking the striated columns.

      The resolution of the mammalian central pair is an important development brought by this work. The structural similarity between the central pair of pig and horse is convincing. However, with only 281 subtomograms being averaged for the murine central pair, corresponding to an estimated resolution of 49Å, the absence of the helical MIP of C1 with 8 nm periodicity suggests that there is simply not enough signal to capture it in the average. The same could be said for the smaller MIP displayed in Figure 4 c, panel ii. This point should be clearly stated.

      Another piece of compelling data presented in this study is the attachment of the outer dense fibers to the axoneme of the midpiece and proximal and distal principal pieces. From the classification data presented along the flagellar length, it is clear that the only ODF contact made with the axoneme is at the proximal principle plate. However, this is far from obvious in the native top view images presented. Is it possible to include a zoomed inset of the connection between the A-tubule and ODF connection?

      Significance

      This work is of good quality and provides crucial information on the structure of centriole and axoneme in 3 different species. This work complements well the previous works. The audience for this type of study is large as it is of interest to researchers working on centrioles, cilium, and sperm cell architecture.

      My expertise is cryo-tomography and centriole biology

    1. Note: This rebuttal was posted by the corresponding author to Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Reply to the reviewers

      Reviewer #1 (Evidence, reproducibility and clarity):

      This manuscript follows on from previous work from the Rhind lab to investigate whether the load of MCMs at origins is a factor in when the origin activate (as a population average) during S phase. The authors use budding yeast and a auxin degron system to modulate the levels of an MCM subunit. This allows them to titrate down the concentration of the MCM hexamer and observe the effect. Crucially, they assay both the reduction in MCM load at origins and the subsequent replication dynamics in the same experiment. This is the power of their approach and allows them to rigorously test their hypothesis.

      **Major comments**

      1.I found the introductory paragraph discussing the Rhind lab hypothesis about the possibility of multiple MCM being loaded at origins somewhat misleading. The first paragraph of the discussion was much clear. However, I feel that the introductory paragraph should deal with the difference between the two proposals: 0-1 MCM-DH per origin (de Moura et al), vs 0-50+ MCM-DH (Yang et al). It s also important to note that Foss et al find that "In budding yeast, [MCM] complexes were present in sharp peaks comprised largely of single double-hexamers" - i.e. consistent with 0-1 MCM-DH per origin.

      To improve the balance of the introduction, I think the authors should briefly introduce the concepts behind the 0-1 MCM-DH per origin; this was defined as origin competence by Stillman and clearly described by McCune et al (2008; see figure 8) prior to the work from de Moura et al.

      Furthermore, in the discussion the authors should be more even-handed. To date there is no data to conclusively rule one way or the other in distinguishing between single vs multiple MCMs. The authors cite Lynch et al and state "overexpression of origin-activating factors in S phase causes most all origins to fire early in S phase, consistent with most origins having at least one MCM loaded". However, Lynch et al report equivalent (roughly equal) origin efficiencies, but the assay doesn't distinguish between all going up to high efficiency or all going to a lower intermediary efficiency. Given that fork factors (polymerases, etc) are likely to become limiting at some point (or checkpoints could be activated due to limited dNTP supplies) it would seem plausible that uniform origin efficiency could be a consequence of less than maximal origin firing. As part of this discussion it would be useful for the authors to include what conclusions have been reached on MCM load from in vitro systems (with chromatin substrates).

      Because the main focus of the paper is not dependent on whether MCM stoichiometry varies from 0 to 1 or 0 to many, we had relegated our discussion of absolute stoichiometry to the Discussion. However, it is clear from multiple reviewer's comments that it is something very much on readers minds. Therefore, we have now included a brief introduction to the 0-to-1 and 0-to-many scenarios in the Introduction and moved the bulk of the discussion of the data supporting the two scenarios to the Discussion.

      2.The authors are not the first to look at the consequence of reduced MCM concentrations on origin function. This was essentially the basis for the MCM screen undertaken by Bik Tye's lab that first identified the MCM genes. In addition to temperature sensitive mutants, the Tye group also examined heterozygotes (Lei et al., 1996) to show differential effect on the ability of two origins to support plasmid replication. The authors finds are entirely consistent with these early studies, particularly since ARS416 (formerly ARS1) was found to highly sensitive to reduced MCM levels and ARS1021 (formerly ARS121) was found to be insensitive to MCM levels. The authors find a signifiant reduction in MCM load at ARS416, but the MCM load at ARS1021 is unaltered by reduced MCM concentration. It would be worth the authors noting this consistency. The authors do cite the Lei study, but not in this context. The original MCM screen was published here:

      Maine, G., Sinha, P., Tye, B. (1984). Mutants of S. cerevisiae defective in the maintenance of minichromosomes Genetics 106(3), 365 - 385.

      Furthermore, at the end of the discussion the authors state that "it will be interesting to dissect the specific cis- and trans-acting factors that make origins sensitive or resistant to changes in MCM levels". The equivalent effect reported by the Tye lab has already been dissected by the Donaldson lab (Nieduszynski et al., 2006) and perhaps it would be worth briefly mentioning their findings.

      We have included both of these literature precedents in the Discussion.

      3.The authors should show the flow cytometry data for each of their cell cycle experiments, if only in supplementary figures. This is important to allow a reader (and reviewer) to judge the level of synchrony achieved when interpreting the results.

      This data is now included as Figure S1

      4.I think the authors should show the ChIP signal at some example origins, including ones sensitive and insensitive to the reduction in MCM concentration. Currently all the high resolution ChIP data (i.e. over 1400 bp, e.g. Fig 3a) is presented as meta-analyses of many origins.

      We will include this analysis in a subsequent revision.

      5.When describing the results in Fig 4a the authors focus on changes (highlighted in black boxes) that fit their expectation. However, there are other sites that should at least be mentioned that don't seem to fit the authors model, e.g. ARS517, ARS518. It would be worth discussing what fraction of the timing data can be explained by the reduced MCM load.

      We now explicitly point out that Figures 4c and 4d address this issue of the robustness of the correlation. Although there is significant variation, as the reviewer points out, the trend is seen genome wide. As it happens, both ARS517 and ARS518 do fit the model reasonably well. They have intermediate loss of MCM signal and intermediate delay in timing.

      **Minor comments**

      -These data, rather than this data (throughout).

      I suspect that the journal style and/or copy editors will make the final call. However, I will point out that although 'data' is most certainly plural in Latin, its predominate modern English usage is as a mass noun, such as water or sand or information. In general, users do not think of, or use, 'data' as a collection of discrete elements, each on being a 'datum', a contention supported by the very infrequent use of the word datum. For instance, in ChIP-seq experiment, what is a datum? Each individual read? Each individual nucleotide in each read? The quality score for each individual nucleotide in each read? Each pixel in each image from the sequencer? When one wants to refer to an individual piece of data, common usage is to refer to a data point, just as one would refer to a grain of sand. Moreover, if 'data' were plural, it would be incorrect to use it in phrases such as "there is very little data available". Would the review really suggest using "there are very few data available"?

      -the authors should clearly state in figure legends what window size has been used in analysing genomic data.

      All analyses were done using 1kb windows, as now stated in the figure legends.

      -in figure 2a the authors show pairwise comparisons between conditions, it would be nice to see the 3rd pairwise comparisons perhaps as a supplementary figure

      We have included the third comparison in Figure 2a.

      -in figure 2c it would be clearer to use the same colour for the lines and the points

      The regression lines are in the same colors as the data points they fit. x=y is shown in blue for comparison, as now noted in the figure legend.

      -the authors should avoid the use of red/green colour combinations in their figures (see: https://thenode.biologists.com/data-visualization-with-flying-colors/research/)

      All figures will be redrawn in colorblind-accessible colors in a subsequent revision.

      -in the text the authors state "ORC binding to the ACS and subsequent MCM loading is a directional process dependent on a ACS- site and a similar but inverted nearby sequence (Xu et al., 2006)". I think it would be more appropriate to cite the following study here:

      Coster, G., Diffley, J. (2017). Bidirectional eukaryotic DNA replication is established by quasi-symmetrical helicase loading Science (New York, NY) 357(6348), 314 - 318. https://dx.doi.org/10.1126/science.aan0063

      The Coster reference has been included.

      -the list of factors that influence replication timing should include Rif1, whereas it is less clear that Rpd3 acts within the unique genome (as opposed to indirectly via repetitive DNA, e.g. rDNA)

      Rif1 has been added to the list.

      -figure 4 - it might help to mark the centromere on panel a. Also, why do the ChIP peaks and annotated origins appear to line up so poorly?

      The shift between the peaks and the ACS positions was introduced during the construction of the figure. Thanks for catching it. The alignment has been corrected and the centromere annotation has been added.

      -figure 4d - would it not be better to use fraction of lost MCM signal on the x-axis as in previous figures?

      If T_rep was a linear function of MCM stoichiometry, fraction lost would work as well as amount lost. However, we find that there is a lower correlation between fraction of MCM signal lost and T_rep delay than between absolute MCM signal lost and T_rep delay, suggesting a more complicated relationship.

      -"with galactose or raffinose, to induce or repress Mcm2-7 overexpression, respectively." This is incorrect, raffinose does not repress this promoter (that requires glucose).

      Fixed.

      -the S. pombe spike in is a great addition to the over expression experiments. It's a shame that it wasn't included in the auxin experiments.

      Yes, we agree.

      -why does the data in fig 5d appear to be at much lower resolution that the previous ChIP data?

      The resolution was inadvertently reduced during the rendering of the figure. The resolution has restored.

      -in the sequencing analysis pipeline for MCM ChIP the authors use a 650 bp upper size limit; why have such a large threshold compared to the size of a nucleosome? Are the analyses and findings sensitive to this size threshold?

      Although the MNase digestion was optimized to produce mostly mononucleosomal-sized digestion, some di- and very little tri- nucleosomal fragments still remain. In order to capture as many of the MCM-protected immunoprecipitated fragments as possible, the upper limit was set at 650 bp (up to 4 nucleosomes-worth of DNA). However, there is a very minimal contribution from fragments larger than mononucleosomes, qualitatively as well as quantitatively in 1kb windows around origins. Figure 3a provides a qualitative depiction of the contribution of dinucleosomes (input, ~300bp).

      -the repliscope package was published here:

      Batrakou, D., Müller, C., Wilson, R., Nieduszynski, C. (2020). DNA copy-number measurement of genome replication dynamics by high-throughput sequencing: the sort-seq, sync-seq and MFA-seq family. Nature Protocols 15(3), 1255 - 1284. https://dx.doi.org/10.1038/s41596-019-0287-7

      The reference has been corrected.

      Reviewer #1 (Significance):

      This work builds upon a body of work from the Rhind group (and others) to determine the contribution of MCM load to replication origin activation dynamics. To my mind this is the most convincing dataset and analysis to date and goes a long way to supporting the model that the efficiency of MCM loading is a major factor in determining the mean replication time of an origin. As the authors state, they are still not able to distinguish between two different models of MCM load (single vs multiple). It would be interesting for the authors to discuss how these two models could be distinguished in the future (perhaps with single cell/molecule experiments).

      This study will be of interest to those in the fields of DNA replication and genome stability.

      My field of expertise is DNA replication and replication origin function.

      Reviewer #2 (Evidence, reproducibility and clarity):

      **Summary:**

      This is a nice study that characterizes the consequences of limiting or increasing Mcm expression on the replication program. Prior ChIP experiments in yeast have observed that not all origins exhibit the same level of Mcm enrichment and that increased mcm enrichment was correlated with origin activity. These observations led to two different models -- a) that multiple Mcm2-7 double hexamer complexes are loaded at some origins and b) a probabilistic model where the differential enrichment of Mcm2-7 reflected the fraction of cells in a population that had loaded the Mcm2-7 complex at a specific origin. While the titration experiments presented here don't provide any conclusive support for either model, they do provide some novel and relevant insights for the replication field, in part, due to the increased resolution and quantification afforded by the MNase ChIP-seq approach (and S. pombe spike in). The authors very nicely demonstrate that origins are differentially sensitive to Mcm2-7 depletion and that loss of Mcm2-7 loading results in an altered replication timing profile. The origins most impacted by loss of Mcm2-7 are 'weak' origins as described by the Fox group. Intriguingly, the authors find that the 5X overexpression of Mcm2-7 does not perturb the relative Mcm2-7 loading at individual origins, but rather instead globally represses Mcm2-7 association at all origins. They also find that overexpression of both Cdt1 and Mcm2-7 is detrimental to the cell (although no obvious replication phenotype was observed). Finally, the authors present a reasonable interpretation of their data in the context of models for replication timing which was very well articulated.

      **Major Comments:**

      From the methods it appears that different analyses were performed with different replicates?

      "Replicate #1 was used for all analyses except for V plots, for which the higher resolution Replicate #2 was used."

      Ideally all of the conclusions should be supported by all the replicates independently, or if the replicates are concordant -- they should be merged (at a similar sequencing depth) prior to doing the analyses.. Even the v-plots with merged replicates will be informative due to the greater sequencing depth.

      Though we agree that greater sequencing depth would be informative for aggregation analysis, we think that one of the main strengths of our study is the analysis of MCM quantitation and replication timing in the same population of cells. Although the experiments were performed in exactly the same way, there is always slight biological or temporal differences between the replicates, due to the complicated nature of the experimental design. This variation increases the noise between the MCM ChIP and the replication timing analyses. Therefore, were analyzed the replicates separately. However, we did do all of the analyses on both replicates and got similar results. We have now explicitly stated as much.

      The authors should provide a separate analysis for the larger nucleosomal sized fragments and smaller putative MCM double hexamer fragments with regards to the Mcm loading and relationship to ACS and orientation. They may represent an interesting intermediate with mechanistic consequences for the interpretation.

      We will include the suggested analysis in a subsequent revision.

      The authors should present the v-plots and an analysis of which side the Mcm's load for the overexpression studies. I was surprised that there was no further in-depth analysis for these two extremes. Perhaps similar conclusions will be reached, but it should at least be mentioned/presented as a supplementary figure.

      We will include the suggested analysis in a subsequent revision.

      **Minor Comments:**

      This is largely semantic, but the majority of MNase ChIP-seq signal recovered is associated with the nucleosomes and not in the NDR and as the signal in the NDR is differentially sensitive to digestion, I would suggest rephrasing the following sentence:

      "In contrast to previous genome-wide reports (Belsky et al., 2015), but in agreement with recent in-vitro cryo-EM structures (Miller et al., 2019), we also observe MCM signal in the nucleosome-depleted region (NDR) of origins. "

      to :

      "In agreement with a previous genome-wide report (belsky 2015), we found that the bulk of the MCM signal was associated with nucleosomal sized fragments; however the increased resolution afforded by our approach allowed us to also detect protected fragments in the NDR as predicted by recent in vitro cryo em structures..."

      We have modified the sentence as suggested.

      As a sanity check, please double check V-plots and presence of small fragments with the digestion conditions. In the Henikoff manuscript the bulk of sub-nucleosomal fragments were lost with the longer digestion time. Specifically, the TF footprints were more pronounced with minimal digestion. While it might be argued that the longer digestion more tightly resolved the binding site, in many cases they were completely lost with the 20 minute digestion. This is just a simple check -- I don't doubt the results as reported given the experimental conditions are very different. For example, the henikoff manuscript did not use cross linking or an antibody enrichment step.

      We double checked and confirmed that more small fragments are found in the more digested library. The reason that we see more small fragments when we digest more, in contrast to the contrary observation in the Henikoff paper is presumably because MCM has a larger footprint than a transcription factor and protects that footprint more effectively.

      Last paragraph of the "MCM associates with nucleosomes section" which reports that the Mcm2-7 complex is loaded up or downstream from the ACS independent of orientation should cite Belsky 2015 (Figure 5 and discussion) for the initial observation.

      Done.

      The authors argue that the global reduction in MCM loading associated with overexpression may be a technical artifact given that all origins exhibit a proportional reduction in mcm2-7 loading. However, this is exactly what the S. pombe spike in control is intended for. The relative difference between individual origins resulting from Mcm2-7 depletion would still be evident without the spike in. The authors do discuss different possibilities, but I would not be so keen to discard this as technical artifact.

      We, too, are reluctant to dismiss this result as a technical artifact. However, we are at a loss to offer any other explanation. We raise a handful of biological possibilities in the Discussion, but dismiss each one as failing to account for our results. We would be happy to entertain other suggestions.

      Reviewer #2 (Significance):

      This work has several advances that will be appreciated by the replication field -- including a high resolution view of Mcm2-7 loading in the context of chromatin; the impact of titrating (low and high) MCM expression on MCM loading and replication timing program; and a well reasoned discussion of how different models of MCM loading would impact origin activation and replication timing program. The work builds on prior studies in the field (eg. Belsky 2015), while some of the conclusions regarding the localization of the Mcm2-7 complex relative to the ACS and surrounding nucleosomes are confirmatory, the increased resolution provides new insight (like the enrichment of small fragments in the NDR) that could be further strengthened by additional analysis (see above).

      My expertise is DNA replication and chromatin.

      Reviewer #3 (Evidence, reproducibility and clarity (Required)):

      In this study, the authors use Auxin-mediated degradation of Mcm4 to reduce the concentration of the MCM helicase complex in yeast, and determine the effects of this reduction on both MCM-origin association (interpreted as MCM loading) by MNase-MCM-ChIPSeq and on replication origin function by Sync-Seq replication timing experiments (deep sequencing of a yeast population as it progresses through a synchronized S-phase). Complementary experiments testing the effect of induced MCM complex over-expression on MCM-origin association are also performed.

      The authors find that reducing Mcm4 levels (and thus loading-competent MCM complexes) causes yeast cells to be more sensitive to DNA replication stress. In addition, not all origins are equally susceptible to reductions in MCM levels; the origins that do lose MCM binding at reduced MCM levels show a reduction in activity and an associated delay in their replication time under those conditions. Finally, over-expression of the MCM complex has no effect on MCM-origin association or origin function, suggesting that MCM levels are not limiting for origin licensing in yeast under normal lab conditions. The strengths of the study are the well-executed experiments and very nice data that are presented. However, there are several weaknesses. The authors make conclusions that are not supported by their data; and several of the outcomes are not at all unexpected based on extensive published studies in yeast and mammalian cells, raising issues about whether this study advances and/or clarifies the current gaps in the field. While some of the relevant past studies were referenced, the authors did not place their own study in the context to published work and current models in the field, which reduced the scholarly value of their study. Because the work was not placed in context of the field, some of the rationale and conclusions were misleading.

      **Some specific major comments:**

      1,The title is misleading. The authors have clearly shown that when MCM levels are be made limiting in an engineered system, some origins are substantially less active, which means that these origin loci are replicated "passively" (i.e. by a Replication Fork (RF) emanating from a distal origin) rather than actively (i.e. by "firing" and initiating replication). Their own replication data show that. But this competition is only revealed when MCM levels are artificially/experimentally lowered. What is the evidence that competition for MCM complexes among individual origins establishes replication timing patterns in yeast? If anything, the over-expression experiment suggests the opposite--that MCM levels are not limiting and therefore do not play a substantial role in establishing the replication timing patterns that are observed in yeast. Instead those patterns appear to result primarily from the fact that MCM complex activation factors are present in limiting concentrations relative to origins.

      We agree with the reviewer's analysis and have revised the title to "The Capacity of Origins to Load MCM Establishes Replication Timing Patterns".

      2,The abstract states that "the number of MCMs loaded onto origins has been proposed to be a key determinant of when those origins initiate DNA replication during S-phase". While it is true that this lab has proposed this model in budding yeast, the current study performs no experiments that directly address this model--i.e. that i. individual origins possess a different number of MCM complexes and or ii that these differences underlie timing differences. They acknowledge this point in their Discussion--a ChIPSeq experiment is an ensemble experiment--there is no way to know that differences in MCM signals correspond to a different number of MCM complexes per origin versus a differences in the fraction of cells that contain and MCM complex at all at a given origin . But this statement in the abstract, combined with their conclusion in the same section of the paper: "Our results support a model in which the loading activity of origins, controlled by their ability to recruit ORC and compete for MCM, determines the number of helicases loaded, which in turn affects replication timing" implies that they have tested a model that they have not tested. Given how quickly readers "skim" the literature these days, a misleading abstract can do a lot of damage to a field. The results presented in this study neither support nor refute the model for the number of helicases loaded per origin, and the fact that reducing origin licensing efficiency by making the major substrate limiting reduces the number of licensed origins in a cell population is fully expected based on the current state of the field .

      Four questions are addressed in this comment. The first is whether there is variable MCM stoichiometry at origins. The second is whether that variation ranges from 0 to 1 and 0 to many. The third is if the variation is stoichiometry affects replication timing. The fourth is how this variation in stoichiometry comes about.

      Our work is based on the conclusion, supported by a substantial body of literature, that MCM loading stoichiometry varies among origins. Our data in this paper further supports this conclusion.

      As the reviewer notes, and as we had tried to make clear, the data is this paper does not address the range of the variation. Moreover, as we also tried to make clear, our hypotheses, results and conclusions are not affected by whether the range is 0 to 1 or 0 to many.

      This paper focuses on Questions 3 and 4. We have reworked the introduction to make these distinctions more clear.

      We have also corrected the abstract to refer to "the stoichiometry", instead of "the number", of MCMs.

      3,The rationale for the study as stated in the Introduction: "Although the molecular biochemistry of initiation at individual origins continues to be elucidated in great detail (Bleichert, 2019), the mechanism governing the time at which different regions of the genome replicate has remained largely elusive (Boos and Ferreira, 2019)." Is also misleading. In fact, in budding yeast (and other organisms) there have been several advances in this area particularly with respect to DNA replication origin activation. The S-phase origin activation factors are limiting for origin function, and factors such as Ctf19 at centromeres and Fkh1/2 at non-centromeric early-acting origins help to directly recruit the limiting S-phase factor, Dbf4, to origins. It is misleading to ignore this substantial progress and not make an effort to place this current study, which is important and one of the first to look directly at MCM loading control in yeast, into a relevant context with respect to what is known. What's interesting is that this S-phase model assumes/requires that most origins are, in fact, licensed and thus that differences in licensing efficiency are not a major driving of replication timing patterns in yeast. But we do not know why there are only subtle differences in MCM loading---this study may help explain that.

      We have broadened the scope of our Introduction and Discussion to address these points. However, it is not the case that "there are only subtle differences in MCM loading". MCM ChIP-seq (, and this paper) and MCM ChEC-seq both show well over ten-fold variation in MCM stoichiometry at origins. We have now explicitly made this point in the Introduction.

      4,The authors link the differential ability of MCM loading deficiencies when MCM is made limiting to differences in ORC binding categories. The "weak" origins, that presumably bind ORC weakly, were most affected by reductions in MCM. Are these origins less efficient than the other categories, DNA and chromatin-dependent (using the origin efficiency metric data from the Whitehouse lab) where MCM binding is not reduced as much? In normal cells are these early or late origins? Is the idea that the role of excess MCM is to achieve a sufficient number or "back up" origins per cell to deal with potential stress, as proposed by the Blow and Schwob labs in tissue culture cells many years ago? It seems likely that the data reported here are in fact confirmations of those early studies in mammalian cells---which is useful to know even if not unexpected.

      We will include the suggested analyses in a subsequent revision.

      Excess MCM do, as has been long appreciated and as we discuss, contribute to replication-stress tolerance. However, that is not a major point of our paper.

      5,Aren't the results that losing MCM signal corresponds to loss of origin activity peaks entirely expected? The same result would be obtained if you made a point mutation in that origin's ACS. Of course preventing an origin from being licensed will delay that region's replication time in S-phase because it now must be replicated passively. Licensing affects replication timing patterns because the MCM complex is the substrate for limiting S-phase factors, but that is far different from concluding that the number of MCMs at an origin is what controls the time in S-phase when an origin is activated.

      Yes, "the results that losing MCM signal corresponds to loss of origin activity peaks [are] entirely expected". However, this is not the important result. The key result is that the distribution of MCM at origins is not uniformly affected, which leads to our conclusions that, in wild-type cells, origin capacity dominates MCM stoichiometry and that, when MCM become limiting, origin activity (probably determined by ORC affinity) becomes critical—neither of which were expected results. In any case, the expected correlation between MCM loading and origin activity was observed as a consequence of measuring MCM stoichiometry and replication timing and is an obvious analysis to include, so we did so.

      6,The authors stated that the measured MCM abundance for the 43% of origins that are not known to be controlled by the multiple mechanisms that have been shown to control origin replication time. Is this because they think that MCM loading contributes to the timing control of only these origins? Was MCM loading not affected at any of these other origins when MCM levels were reduced? Are those 43% of origins in the "weak" binding category in terms of ORC? The rationale for eliminating so many origins from these analyses were not clear.

      We propose that the probability of origin activation is the product of the stoichiometry of MCM at the origin and the rate of MCM activation, which may be affected by trans-acting factors. For the 43% of origins for which there is no known trans-acting regulation, the correlation with stoichiometry is stronger. However, the correlation holds when looking at all origin, too. The suggestion to look at only the 57% of origins with known trans-action regulation is a good one. We will include this analysis and the other suggested analyses in a subsequent revision.

      7,Doesn't the data in Figure 4c at 0 mM auxin support the conclusion that differences in MCM ChIP signals have negligible effects on origin activation time, in contrast to the publication by Das, 2015 from this lab? Or is the point that these origins are sensitive to reductions in MCM levels and the more sensitive they are the more delayed their replication time (but again, doesn't that have to be true? If they are losing MCM signals they cannot function as origins, so they are replicated passively and, by definition, will show delayed replication timing. An origin is defined as such by a loaded MCM complex.)

      No. The reason the correlation in 4c is not a good as in our previous work is that in Das 2015 we compared origin-activation efficiency (calculated from our stochastic model in Yang 2010), instead of T_rep, which we used here. T_rep is a convolution of origin-activation time and passive-replication time, reducing to correlation. The important observation is that the correlation gets better as MCM levels are reduced.

      The correlation between MCM stoichiometry and activation efficiency may seem trivial, but just because a model is simple does not mean it is not correct. If stoichiometry was the only factor regulating origin activation, we would expect a stronger correlation. So, we conclude that there are other factors at play, quite possible the trans-acting factors that the reviewer mentions in their second point. However, if stoichiometry played no role, we would expect no correlation. So, we propose that MCM stoichiometry is "an important determinant of replication timing".

      8,I do not understand the conclusions from Figure 4d. There is an extremely small positive correlation between how much of an MCM signal is lost and delay in replication time of an origin, but this correlation is not surprising as an unlicensed origin cannot be an origin and will be replicated passively. What seems most surprising about these data is that the effect is so weak, not that it exists. There is quite a lot of scatter in this plot at 500 uM auxin, with some origins losing a given amount of signal (x) and being only slightly delayed in replication time, and others losing the same amount of signal (x) and being substantially delayed. What underlies this outcome?--Are the ones that are not substantially delayed closer to origins that have not been affected at all by MCM reductions? Why is the correlation so weak? The other regulators of origin activation time have stronger and more precise effects--for example the centromere-control can be precisely eliminated so that only the replication time of the centromere-proximal origins are delayed.

      We believe that much of the noise in Figure 4d is due, as the reviewer suggests, to passive replication of origins which lose most of their MCM signal and become inactive but happen to reside next to origins which don’t lost any MCM signal and fire early. And excellent example is ARS 510 (see Figure 4a). ARS510 loses most of its MCM signal and clearly loses its initiation peak in the T_rep plot. However, because it is next to ARS511, which does not lose much MCM signal and which remains a efficient origin, ARS510 is still replicated early. We will include this example in a subsequent revision.

      9,Multiple studies in yeast and mammalian cells indicate that MCM subunits are in excess relative to other licensing and S-phase initiation factors, so it is not unexpected that over-expressing MCM did not lead to enhanced levels of licensing. It seems much more plausible that Cdc6 or Cdt1 or both factors are present in limiting amounts for MCM loading, so I did not understand the point of over-producing MCM subunits. If the "weak" origins are the ones that are most dramatically affected by reducing MCM to "limiting" levels, isn't the question whether you can increase licensing at these origins when you over-produce a factor that is likely limiting for licensing, such as Cdt1 or Cdc6 (or both) while leaving MCM at its normal levels. The fact that MCM levels are not limiting for licensing is not surprising and, if anything, argues against these levels having a regulatory role in origin activation timing---which seems to be the opposite of what the authors want to conclude.

      Orc1-6, Cdc6 and Cdt1 are all substoichiometric to MCM. However, they all act catalytically to load MCM. So, although they may be kinetically limiting, they do not prevent most or all MCMs being loaded in wild-type cells. The fact that overexpressing MCMs (with or without Cdt1) does not allow for more MCM loading suggests that under normal conditions origins are saturated with MCMs and have little or no capacity to load more MCM, even when given plenty of time to do so. From this result, we conclude that origin capacity is a major determinant of MCM loading in wild-type cells. From our MCM-reduction experiments, we also conclude that, when MCM is limiting, origin competition affects which origins load MCMs faster. However, we agree with the reviewer's first point, that our title gave the incorrect impression that we concluded that origin competition is the primary determinant of MCM loading in wild-type cells. Thus, as suggested, we have changed the title. We have also reworked the Introduction and Discussion to more clearly explain that competition is only a determining factor when MCMs are limited.

      In summary, I think the technical aspects of the experiments were quite strong, but I do not think that the experiments answered the question that was posed by the authors.

      **Minor points:**

      Many places where "This data" should be changed to "These data". Data are plural.

      See comments on this point in the response to Reviewer #2.

    2. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #3

      Evidence, reproducibility and clarity

      In this study, the authors use Auxin-mediated degradation of Mcm4 to reduce the concentration of the MCM helicase complex in yeast, and determine the effects of this reduction on both MCM-origin association (interpreted as MCM loading) by MNase-MCM-ChIPSeq and on replication origin function by Sync-Seq replication timing experiments (deep sequencing of a yeast population as it progresses through a synchronized S-phase). Complementary experiments testing the effect of induced MCM complex over-expression on MCM-origin association are also performed.

      The authors find that reducing Mcm4 levels (and thus loading-competent MCM complexes) causes yeast cells to be more sensitive to DNA replication stress. In addition, not all origins are equally susceptible to reductions in MCM levels; the origins that do lose MCM binding at reduced MCM levels show a reduction in activity and an associated delay in their replication time under those conditions. Finally, over-expression of the MCM complex has no effect on MCM-origin association or origin function, suggesting that MCM levels are not limiting for origin licensing in yeast under normal lab conditions. The strengths of the study are the well-executed experiments and very nice data that are presented. However, there are several weaknesses. The authors make conclusions that are not supported by their data; and several of the outcomes are not at all unexpected based on extensive published studies in yeast and mammalian cells, raising issues about whether this study advances and/or clarifies the current gaps in the field. While some of the relevant past studies were referenced, the authors did not place their own study in the context to published work and current models in the field, which reduced the scholarly value of their study. Because the work was not placed in context of the field, some of the rationale and conclusions were misleading.

      Some specific major comments:

      1,The title is misleading. The authors have clearly shown that when MCM levels are be made limiting in an engineered system, some origins are substantially less active, which means that these origin loci are replicated "passively" (i.e. by a Replication Fork (RF) emanating from a distal origin) rather than actively (i.e. by "firing" and initiating replication). Their own replication data show that. But this competition is only revealed when MCM levels are artificially/experimentally lowered. What is the evidence that competition for MCM complexes among individual origins establishes replication timing patterns in yeast? If anything, the over-expression experiment suggests the opposite--that MCM levels are not limiting and therefore do not play a substantial role in establishing the replication timing patterns that are observed in yeast. Instead those patterns appear to result primarily from the fact that MCM complex activation factors are present in limiting concentrations relative to origins.

      2,The abstract states that "the number of MCMs loaded onto origins has been proposed to be a key determinant of when those origins initiate DNA replication during S-phase". While it is true that this lab has proposed this model in budding yeast, the current study performs no experiments that directly address this model--i.e. that i. individual origins possess a different number of MCM complexes and or ii that these differences underlie timing differences. They acknowledge this point in their Discussion--a ChIPSeq experiment is an ensemble experiment--there is no way to know that differences in MCM signals correspond to a different number of MCM complexes per origin versus a differences in the fraction of cells that contain and MCM complex at all at a given origin . But this statement in the abstract, combined with their conclusion in the same section of the paper: "Our results support a model in which the loading activity of origins, controlled by their ability to recruit ORC and compete for MCM, determines the number of helicases loaded, which in turn affects replication timing" implies that they have tested a model that they have not tested. Given how quickly readers "skim" the literature these days, a misleading abstract can do a lot of damage to a field. The results presented in this study neither support nor refute the model for the number of helicases loaded per origin, and the fact that reducing origin licensing efficiency by making the major substrate limiting reduces the number of licensed origins in a cell population is fully expected based on the current state of the field .

      3,The rationale for the study as stated in the Introduction: "Although the molecular biochemistry of initiation at individual origins continues to be elucidated in great detail (Bleichert, 2019), the mechanism governing the time at which different regions of the genome replicate has remained largely elusive (Boos and Ferreira, 2019)." Is also misleading. In fact, in budding yeast (and other organisms) there have been several advances in this area particularly with respect to DNA replication origin activation. The S-phase origin activation factors are limiting for origin function, and factors such as Ctf19 at centromeres and Fkh1/2 at non-centromeric early-acting origins help to directly recruit the limiting S-phase factor, Dbf4, to origins. It is misleading to ignore this substantial progress and not make an effort to place this current study, which is important and one of the first to look directly at MCM loading control in yeast, into a relevant context with respect to what is known. What's interesting is that this S-phase model assumes/requires that most origins are, in fact, licensed and thus that differences in licensing efficiency are not a major driving of replication timing patterns in yeast. But we do not know why there are only subtle differences in MCM loading---this study may help explain that.

      4,The authors link the differential ability of MCM loading deficiencies when MCM is made limiting to differences in ORC binding categories. The "weak" origins, that presumably bind ORC weakly, were most affected by reductions in MCM. Are these origins less efficient than the other categories, DNA and chromatin-dependent (using the origin efficiency metric data from the Whitehouse lab) where MCM binding is not reduced as much? In normal cells are these early or late origins? Is the idea that the role of excess MCM is to achieve a sufficient number or "back up" origins per cell to deal with potential stress, as proposed by the Blow and Schwob labs in tissue culture cells many years ago? It seems likely that the data reported here are in fact confirmations of those early studies in mammalian cells---which is useful to know even if not unexpected.

      5,Aren't the results that losing MCM signal corresponds to loss of origin activity peaks entirely expected? The same result would be obtained if you made a point mutation in that origin's ACS. Of course preventing an origin from being licensed will delay that region's replication time in S-phase because it now must be replicated passively. Licensing affects replication timing patterns because the MCM complex is the substrate for limiting S-phase factors, but that is far different from concluding that the number of MCMs at an origin is what controls the time in S-phase when an origin is activated.

      6,The authors stated that the measured MCM abundance for the 43% of origins that are not known to be controlled by the multiple mechanisms that have been shown to control origin replication time. Is this because they think that MCM loading contributes to the timing control of only these origins? Was MCM loading not affected at any of these other origins when MCM levels were reduced? Are those 43% of origins in the "weak"binding category in terms of ORC? The rationale for eliminating so many origins from these analyses were not clear.

      7,Doesn't the data in Figure 4c at 0 mM auxin support the conclusion that differences in MCM ChIPsignals have negligible effects on origin activation time, in contrast to the publication by Das, 2015 from this lab? Or is the point that these origins are sensitive to reductions in MCM levels and the more sensitive they are the more delayed their replication time (but again, doesn't that have to be true? If they are losing MCM signals they cannot function as origins, so they are replicated passively and, by definition, will show delayed replication timing. An origin is defined as such by a loaded MCM complex.)

      8,I do not understand the conclusions from Figure 4d. There is an extremely small positive correlation between how much of an MCM signal is lost and delay in replication time of an origin, but this correlation is not surprising as an unlicensed origin cannot be an origin and will be replicated passively. What seems most surprising about these data is that the effect is so weak, not that it exists. There is quite a lot of scatter in this plot at 500 uM auxin, with some origins losing a given amount of signal (x) and being only slightly delayed in replication time, and others losing the same amount of signal (x) and being substantially delayed. What underlies this outcome?--Are the ones that are not substantially delayed closer to origins that have not been affected at all by MCM reductions? Why is the correlation so weak? The other regulators of origin activation time have stronger and more precise effects--for example the centromere-control can be precisely eliminated so that only the replication time of the centromere-proximal origins are delayed.

      9,Multiple studies in yeast and mammalian cells indicate that MCM subunits are in excess relative to other licensing and S-phase initiation factors, so it is not unexpected that over-expressing MCM did not lead to enhanced levels of licensing. It seems much more plausible that Cdc6 or Cdt1 or both factors are present in limiting amounts for MCM loading, so I did not understand the point of over-producing MCM subunits. If the "weak" origins are the ones that are most dramatically affected by reducing MCM to "limiting" levels, isn't the question whether you can increase licensing at these origins when you over-produce a factor that is likely limiting for licensing, such as Cdt1 or Cdc6 (or both) while leaving MCM at its normal levels. The fact that MCM levels are not limiting for licensing is not surprising and, if anything, argues against these levels having a regulatory role in origin activation timing---which seems to be the opposite of what the authors want to conclude.

      In summary, I think the technical aspects of the experiments were quite strong, but I do not think that the experiments answered the question that was posed by the authors.

      Minor points:

      Many places where "This data" should be changed to "These data". Data are plural.

      Significance

      Significance: see above

      Referees Cross Commenting

      Reviewer 3. My overall conclusions about this study are that the data are extremely nice and useful to the field, but that their potential to advance the field or clarify it for 'outsiders' are limited by 1, a biased. model-centric presentation that fails to put the work in context of a lot of strong previous work. Some of the conclusions cannot event be tested by the experimental design 2, some of the data analyses, for example the parsing of origins for analyses of MCM effects versus effects on replication time seem arbitrary and were not clearly justified. 3, The correlation between reductions in MCM loading and Trep delay seemed weak, even after parsing for origins expected to experience the largest effects, which is actually kind of interesting, but was ignored in favor of the pre-determined interpretation.

    3. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #2

      Evidence, reproducibility and clarity

      Summary:

      This is a nice study that characterizes the consequences of limiting or increasing Mcm expression on the replication program. Prior ChIP experiments in yeast have observed that not all origins exhibit the same level of Mcm enrichment and that increased mcm enrichment was correlated with origin activity. These observations led to two different models -- a) that multiple Mcm2-7 double hexamer complexes are loaded at some origins and b) a probabilistic model where the differential enrichment of Mcm2-7 reflected the fraction of cells in a population that had loaded the Mcm2-7 complex at a specific origin. While the titration experiments presented here don't provide any conclusive support for either model, they do provide some novel and relevant insights for the replication field, in part, due to the increased resolution and quantification afforded by the MNase ChIP-seq approach (and S. pombe spike in). The authors very nicely demonstrate that origins are differentially sensitive to Mcm2-7 depletion and that loss of Mcm2-7 loading results in an altered replication timing profile. The origins most impacted by loss of Mcm2-7 are 'weak' origins as described by the Fox group. Intriguingly, the authors find that the 5X overexpression of Mcm2-7 does not perturb the relative Mcm2-7 loading at individual origins, but rather instead globally represses Mcm2-7 association at all origins. They also find that overexpression of both Cdt1 and Mcm2-7 is detrimental to the cell (although no obvious replication phenotype was observed). Finally, the authors present a reasonable interpretation of their data in the context of models for replication timing which was very well articulated.

      Major Comments:

      From the methods it appears that different analyses were performed with different replicates?

      "Replicate #1 was used for all analyses except for V plots, for which the higher resolution Replicate #2 was used."

      Ideally all of the conclusions should be supported by all the replicates independently, or if the replicates are concordant -- they should be merged (at a similar sequencing depth) prior to doing the analyses.. Even the v-plots with merged replicates will be informative due to the greater sequencing depth.

      The authors should provide a separate analysis for the larger nucleosomal sized fragments and smaller putative MCM double hexamer fragments with regards to the Mcm loading and relationship to ACS and orientation. They may represent an interesting intermediate with mechanistic consequences for the interpretation.

      The authors should present the v-plots and an analysis of which side the Mcm's load for the overexpression studies. I was surprised that there was no further in-depth analysis for these two extremes. Perhaps similar conclusions will be reached, but it should at least be mentioned/presented as a supplementary figure.

      Minor Comments:

      This is largely semantic, but the majority of MNase ChIP-seq signal recovered is associated with the nucleosomes and not in the NDR and as the signal in the NDR is differentially sensitive to digestion, I would suggest rephrasing the following sentence:

      "In contrast to previous genome-wide reports (Belsky et al., 2015), but in agreement with recent in-vitro cryo-EM structures (Miller et al., 2019), we also observe MCM signal in the nucleosome-depleted region (NDR) of origins. "

      to :

      "In agreement with a previous genome-wide report (belsky 2015), we found that the bulk of the MCM signal was associated with nucleosomal sized fragments; however the increased resolution afforded by our approach allowed us to also detect protected fragments in the NDR as predicted by recent in vitro cryo em structures..."

      As a sanity check, please double check V-plots and presence of small fragments with the digestion conditions. In the Henikoff manuscript the bulk of sub-nucleosomal fragments were lost with the longer digestion time. Specifically, the TF footprints were more pronounced with minimal digestion. While it might be argued that the longer digestion more tightly resolved the binding site, in many cases they were completely lost with the 20 minute digestion. This is just a simple check -- I don't doubt the results as reported given the experimental conditions are very different. For example, the henikoff manuscript did not use cross linking or an antibody enrichment step.

      Last paragraph of the "MCM associates with nucleosomes section" which reports that the Mcm2-7 complex is loaded up or downstream from the ACS independent of orientation should cite Belsky 2015 (Figure 5 and discussion) for the initial observation.

      The authors argue that the global reduction in MCM loading associated with overexpression may be a technical artifact given that all origins exhibit a proportional reduction in mcm2-7 loading. However, this is exactly what the S. pombe spike in control is intended for. The relative difference between individual origins resulting from Mcm2-7 depletion would still be evident without the spike in. The authors do discuss different possibilities, but I would not be so keen to discard this as technical artifact.

      Significance

      This work has several advances that will be appreciated by the replication field -- including a high resolution view of Mcm2-7 loading in the context of chromatin; the impact of titrating (low and high) MCM expression on MCM loading and replication timing program; and a well reasoned discussion of how different models of MCM loading would impact origin activation and replication timing program. The work builds on prior studies in the field (eg. Belsky 2015), while some of the conclusions regarding the localization of the Mcm2-7 complex relative to the ACS and surrounding nucleosomes are confirmatory, the increased resolution provides new insight (like the enrichment of small fragments in the NDR) that could be further strengthened by additional analysis (see above).

      My expertise is DNA replication and chromatin.

    4. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #1

      Evidence, reproducibility and clarity

      This manuscript follows on from previous work from the Rhind lab to investigate whether the load of MCMs at origins is a factor in when the origin activate (as a population average) during S phase. The authors use budding yeast and a auxin degron system to modulate the levels of an MCM subunit. This allows them to titrate down the concentration of the MCM hexamer and observe the effect. Crucially, they assay both the reduction in MCM load at origins and the subsequent replication dynamics in the same experiment. This is the power of their approach and allows them to rigorously test their hypothesis.

      Major comments

      1.I found the introductory paragraph discussing the Rhind lab hypothesis about the possibility of multiple MCM being loaded at origins somewhat misleading. The first paragraph of the discussion was much clear. However, I feel that the introductory paragraph should deal with the difference between the two proposals: 0-1 MCM-DH per origin (de Moura et al), vs 0-50+ MCM-DH (Yang et al). It s also important to note that Foss et al find that "In budding yeast, [MCM] complexes were present in sharp peaks comprised largely of single double-hexamers" - i.e. consistent with 0-1 MCM-DH per origin.

      To improve the balance of the introduction, I think the authors should briefly introduce the concepts behind the 0-1 MCM-DH per origin; this was defined as origin competence by Stillman and clearly described by McCune et al (2008; see figure 8) prior to the work from de Moura et al. Furthermore, in the discussion the authors should be more even-handed. To date there is no data to conclusively rule one way or the other in distinguishing between single vs multiple MCMs. The authors cite Lynch et al and state "overexpression of origin-activating factors in S phase causes most all origins to fire early in S phase, consistent with most origins having at least one MCM loaded". However, Lynch et al report equivalent (roughly equal) origin efficiencies, but the assay doesn't distinguish between all going up to high efficiency or all going to a lower intermediary efficiency. Given that fork factors (polymerases, etc) are likely to become limiting at some point (or checkpoints could be activated due to limited dNTP supplies) it would seem plausible that uniform origin efficiency could be a consequence of less than maximal origin firing. As part of this discussion it would be useful for the authors to include what conclusions have been reached on MCM load from in vitro systems (with chromatin substrates).

      2.The authors are not the first to look at the consequence of reduced MCM concentrations on origin function. This was essentially the basis for the MCM screen undertaken by Bik Tye's lab that first identified the MCM genes. In addition to temperature sensitive mutants, the Tye group also examined heterozygotes (Lei et al., 1996) to show differential effect on the ability of two origins to support plasmid replication. The authors finds are entirely consistent with these early studies, particularly since ARS416 (formerly ARS1) was found to highly sensitive to reduced MCM levels and ARS1021 (formerly ARS121) was found to be insensitive to MCM levels. The authors find a signifiant reduction in MCM load at ARS416, but the MCM load at ARS1021 is unaltered by reduced MCM concentration. It would be worth the authors noting this consistency. The authors do cite the Lei study, but not in this context. The original MCM screen was published here: Maine, G., Sinha, P., Tye, B. (1984). Mutants of S. cerevisiae defective in the maintenance of minichromosomes Genetics 106(3), 365 - 385. Furthermore, at the end of the discussion the authors state that "it will be interesting to dissect the specific cis- and trans-acting factors that make origins sensitive or resistant to changes in MCM levels". The equivalent effect reported by the Tye lab has already been dissected by the Donaldson lab (Nieduszynski et al., 2006) and perhaps it would be worth briefly mentioning their findings.

      3.The authors should show the flow cytometry data for each of their cell cycle experiments, if only in supplementary figures. This is important to allow a reader (and reviewer) to judge the level of synchrony achieved when interpreting the results.

      4.I think the authors should show the ChIP signal at some example origins, including ones sensitive and insensitive to the reduction in MCM concentration. Currently all the high resolution ChIP data (i.e. over 1400 bp, e.g. Fig 3a) is presented as meta-analyses of many origins.

      5.When describing the results in Fig 4a the authors focus on changes (highlighted in black boxes) that fit their expectation. However, there are other sites that should at least be mentioned that don't seem to fit the authors model, e.g. ARS517, ARS518. It would be worth discussing what fraction of the timing data can be explained by the reduced MCM load.

      Minor comments

      -These data, rather than this data (throughout).

      -the authors should clearly state in figure legends what window size has been used in analysing genomic data.

      -in figure 2a the authors show pairwise comparisons between conditions, it would be nice to see the 3rd pairwise comparisons perhaps as a supplementary figure

      -in figure 2c it would be clearer to use the same colour for the lines and the points

      -the authors should avoid the use of red/green colour combinations in their figures (see: https://thenode.biologists.com/data-visualization-with-flying-colors/research/)

      -in the text the authors state "ORC binding to the ACS and subsequent MCM loading is a directional process dependent on a ACS- site and a similar but inverted nearby sequence (Xu et al., 2006)". I think it would be more appropriate to cite the following study here: Coster, G., Diffley, J. (2017). Bidirectional eukaryotic DNA replication is established by quasi-symmetrical helicase loading Science (New York, NY) 357(6348), 314 - 318. https://dx.doi.org/10.1126/science.aan0063

      -the list of factors that influence replication timing should include Rif1, whereas it is less clear that Rpd3 acts within the unique genome (as opposed to indirectly via repetitive DNA, e.g. rDNA)

      -figure 4 - it might help to mark the centromere on panel a. Also, why do the ChIP peaks and annotated origins appear to line up so poorly?

      -figure 4d - would it not be better to use fraction of lost MCM signal on the x-axis as in previous figures?

      -"with galactose or raffinose, to induce or repress Mcm2-7 overexpression, respectively." This is incorrect, raffinose does not repress this promoter (that requires glucose).

      -the S. pombe spike in is a great addition to the over expression experiments. It's a shame that it wasn't included in the auxin experiments.

      -why does the data in fig 5d appear to be at much lower resolution that the previous ChIP data?

      -in the sequencing analysis pipeline for MCM ChIP the authors use a 650 bp upper size limit; why have such a large threshold compared to the size of a nucleosome? Are the analyses and findings sensitive to this size threshold?

      -the repliscope package was published here:

      Batrakou, D., Müller, C., Wilson, R., Nieduszynski, C. (2020). DNA copy-number measurement of genome replication dynamics by high-throughput sequencing: the sort-seq, sync-seq and MFA-seq family. Nature Protocols 15(3), 1255 - 1284. https://dx.doi.org/10.1038/s41596-019-0287-7

      Significance

      This work builds upon a body of work from the Rhind group (and others) to determine the contribution of MCM load to replication origin activation dynamics. To my mind this is the most convincing dataset and analysis to date and goes a long way to supporting the model that the efficiency of MCM loading is a major factor in determining the mean replication time of an origin. As the authors state, they are still not able to distinguish between two different models of MCM load (single vs multiple). It would be interesting for the authors to discuss how these two models could be distinguished in the future (perhaps with single cell/molecule experiments).

      This study will be of interest to those in the fields of DNA replication and genome stability.

      My field of expertise is DNA replication and replication origin function.

    1. Note: This rebuttal was posted by the corresponding author to Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Reply to the reviewers

      Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      *Reviewer #1 (Evidence, reproducibility and clarity (Required)):

      The manuscript by Abrams and Nance describes how the polarity proteins PAR-6 and PKC-3/aPKC promote lumen extension of the unicellular excretory canal in C. elegans. Using tissue-specific depletion methods they find that CDC-42 and the RhoGEF EXC-5/FGD are required for luminal localization of PAR-6, which recruits the exocyst complex required for lumen extension. Interestingly, they show that the ortholog of the mammalian exocyst receptor, PAR-3, is dispensable for luminal membrane extension. Overall, this is a well-written and interesting manuscript.*

      1.Because depletion of PAR-3 in the canal causes milder defects than PAR-6 or CDC-42 the authors suggest that they cannot rule out the possibility that an alternative isoform of PAR-3 is expressed and buffering the defect. They should perform canal-specific RNAi-mediated depletion of the entire PAR-3 gene to determine if this is true.

      We agree with Reviewer 1 that it would be useful to provide additional evidence that an alternative isoform of PAR-3 lacking the ZF1 degron is not expressed. While tissue-specific RNAi could be used, we have not been successful obtaining complete knockdown in previous tissue-specific RNAi experiments. Moreover, this approach does not target any maternal PAR-3 protein that may be inherited by the excretory cell. As an alternative approach to address this point, we will analyze par-3::zf1::yfp/par-3(null) worms following excretory-cell-specific expression of zif-1, and compare to par-3::zf1::yfp/par-3::zf1::yfp siblings. We would expect the excretory cell phenotype to become more severe if additional, ‘phenotype-buffering’ forms of PAR-3 were present, or if there was incomplete degradation of PAR-3::ZF1::YFP in our previous experiments.

      2.The authors suggest that GTP-loaded (activated) CDC-42 recruits PAR-6 to the luminal membrane. It would be nice if they could use a biosensor, such as the GBD-WSP-1 reagent from Buechner's lab to confirm that EXC-5 depletion also reduces activated CDC-42, as would be expected. This should be achievable since there is strong CDC-42 signal, even in the cytoplasm.

      This is an excellent suggestion. We will utilize a CDC-42 biosensor – an integrated cdc42p::gfp::wsp-1(gbd) strain created in our lab and previously validated and characterized (Zilberman et al. 2017). We have confirmed that the biosensor is detected in the excretory canal and appears enriched at or near the lumenal membrane. We will cross the biosensor into the exc-5::zf1::mScarlet background. This will allow us to assess lumenal enrichment, and using heat shock inducible ZIF-1, determine if there is a reduction in biosensor lumenal enrichment when EXC-5::ZF1::mScarlet is acutely degraded.

      If the biosensor is difficult to measure at the canal lumen, an alternative approach would be to use an available exc-5 null allele to examine genetically if cdc-42 and exc-5 are acting in the same pathway. We could cross CDC-42exc(-) larvae into exc-5(rh232) and quantify excretory canal phenotypes. If CDC-42 and EXC-5 are indeed functioning in the same pathway we would expect no enhancement of the CDC-42exc(-) phenotype.

      3.Related to point 2, (i) does mutation of the CRIB domain of PAR-6 impair its recruitment to the luminal membrane, and (ii) does this mutant exacerbate canal defects when PAR-3 is depleted?

      (i) Our lab has previously generated and characterized a transgenic par6P::par-6(**CRIB)::gfp strain (Zilberman et al., 2017). We will examine this strain to determine if expression is detectable in the excretory canal, and if so, we will compare lumenal enrichment of PAR-6(CRIB)::GFP to control worms expressing wild-type PAR-6::GFP.

      (ii) This is a very interesting experiment, as it would help address if the mild phenotype observed in PAR-3 depleted animals is due to the remaining PAR-6 that is recruited by CDC-42. Our lab has previously shown that par6P::par-6(**CRIB)::gfp cannot rescue the embryonic lethality of a par-6 mutant, in contrast to par-6::gfp (Zilberman et al. 2017). This indicates that the CRIB domain is needed for PAR-6 function during embryogenesis and suggests that CRIB domain mutations introduced by CRISPR would almost certainly be lethal, precluding analysis of the excretory cell.

      As an alternative experiment, we would determine if PAR-3 localizes to the lumenal membrane independently of CDC-42; such a finding would imply that PAR-3 and CDC-42 likely have independent contributions to PAR-6 localization (rather than CDC-42 promoting PAR-6 localization by localizing PAR-3). To do this, we will degrade ZF1::YFP::CDC-42 in the excretory cell and examine the localization of PAR-3::mCherry compared to controls. We have all of the strains needed for this experiment.

      4.The authors hypothesize that partial recruitment of PAR-6 by CDC-42 is sufficient for luminal membrane extension to explain the mild defects caused by PAR-3 depletion. Since depletion of PAR-6 and CDC-42 alone causes milder canal truncations the authors should co-deplete these proteins (as well as PAR-3 and CDC-42) to determine if there is an additive effect.

      This is an excellent suggestion in principal. However, it is not possible to know in any given degradation experiment whether the targeted protein is completely degraded; we can only say it is no longer detectable by fluorescence. Thus, any degron allele (in the presence of ZIF-1) could behave like a strong hypomorph rather than a null. It would not be possible to interpret double degradation experiments in such a case, as a more severe phenotype in the double could simply be a result of combining two hypomorphic alleles, further reducing pathway activity even if the genes function together in the same pathway. To interpret this experiment properly, a null allele of at least one of the genes would have to be used. This is not possible since par and cdc-42 null mutants are lethal and there is also maternal contribution. As an alternative to these double depletion experiments, we will deplete PAR-6::ZF1::YFP or PAR-3::ZF1::YFP in exc-5 null mutant larvae, as unlike cdc-42, exc-5 is not an essential gene.

      5.In figure 2, the authors show that depletion of PKC-3 causes more severe canal truncations than PAR-6. Since these proteins function in the same complex what do they think is the reason for this difference? This point could be discussed more in the manuscript.

      As described in the previous point, incomplete degradation could produce modestly different phenotypes even for genes that act in the same pathway. Therefore, it is not possible to determine whether PAR-6 and PKC-3 have different roles using this approach. We will add text to the discussion bringing up this point.

      6.Related to point 5, more experiments with PKC-3 should be done to determine if, for example, localization of SEC-10 is similarly affected as ablation of PAR-3, PAR-6 and CDC-42.

      We agree, and will address this point by acutely degrading ZF1::GFP::PKC-3 and examining transgenic SEC-10::mCherry, as we have done for other par genes.

      Reviewer #2 (Evidence, reproducibility and clarity (Required)): The manuscript by Abrams & Nance describes a precise investigation of the role of PAR proteins in the recruitment of the exocyst during and after the extension of the C. elegans excretory canal. State-of-the-art genetic techniques are used to acutely deplete proteins only in the targeted cell, and examine the localization of endogenously expressed markers. Experiments are well described and carefully quantified, with systematic statistical analysis. The manuscript is easy to follow and the bibliography is very good. Most conclusions are well supported.

      1) I am not entirely convinced by the presence of CDC-42 at the lumenal membrane (Fig3G); it seems to be more sub-lumenal that really lumenal. It peaks well before PAR-6 (Fig3H) which itself seem slightly less apical that PAR-3 (Fig3F). Could you use super-resolution microscopy (compatible with endogenous expression levels) to more precisely localize CDC-42? Similar point for PAR-3 and PAR-6 which do not seem to colocalize completely - a longitudinal line scan along the lumenal membrane might provide the answer even without super-resolution; this could help explain why these two proteins do not have the same function. These suggestions are easy to do provided the authors can have access to super-resolution (Airyscan to name it; although other methods will be perfectly acceptable I believe it is the most simple one).

      We agree that the CDC-42 localization peak does not precisely match the PAR-6 peak. As the reviewer notes, resolving the subcellular localization of these two proteins will not be feasible using standard confocal microscopy. We will image the ZF1::YFP::CDC-42; PAR-6:mKate strain using a Zeiss LSM 880 with Airyscan to determine if their subcellular localization patterns are distinct.

      To examine PAR-3 and PAR-6 colocalization at the lumen, we will acquire additional confocal images of the PAR-6-ZF1-YFP; PAR-3-mCherry strain and examine colocalization of the clusters along the lumenal membrane. As a positive control for two proteins that should co-localize, we will image ZF1::GFP::PKC-3; PAR-6-mKate; these two proteins bind directly and co-localize in nearly all cells in which they have been examined.

      2) The same group has described a CDC-42 biosensor to detect its active form. It could be used here to precisely pinpoint where active CDC-42 is required: in the cytoplasm? At the lumenal membrane? colocalizing with what other protein? This will require the expression of a transgene under an excretory cell specific promotor and a simple injection strategy while helping to strengthen the description of the CDC-42 role.

      See Reviewer 1 point #2.

      3) As the authors certainly know, there is a PAR-6 mutation which prevents its binding to CDC-42. They could express this construct in the excretory canal a simple extrachromosomal array should be sufficient) to validate the direct interaction between these proteins in this cell.

      See Reviewer 1 point #3.

      4) What is the lethality of ZIF-1-mediated depletion of the various factors under the exc promoter? Can homozygous strains be maintained? Authors just have to add a sentence in the Mat&Met section.

      All of the strains with excretory cell-specific degradation we have examined are viable when grown on NGM plates. We will add this point to the materials and methods.

      Provided that the authors have access to an Airyscan, all the questions asked here can be answered in two months (one month for constructs, one month for injection and data analysis) at a very minor cost.

      Reviewer #3 (Evidence, reproducibility and clarity (Required)):

      Strengths of this manuscript include the use of endogenously tagged proteins (rather than over-expressed transgenes) for high resolution imaging and a cell-type specific acute depletion strategy that avoids complicating pleiotropies and allows tests of molecular epistasis. While some results were fairly expected based on prior studies of Cdc42, PAR proteins, and the exocyst in other tissues or systems, differences in the requirements for par-6 and pkc-3 vs. par-3 strongly suggest that the former genes play more important roles in exocyst recruitment. I was also excited to see a connection made between EXC-5 and PKC-3 localization.

      1.Lumen formation vs. lumen extension. The abstract and introduction use these two terms almost interchangeably, but they are not the same and more care should be taken to avoid the former term. The data here do not demonstrate any roles for par or other genes in lumen formation, but do demonstrate roles in lumen extension and organization/shaping.

      We agree and will correct wording to indicate that lumen extension is affected.

      2.Related to the above, mutant phenotypes here are surprisingly mild and variable. The authors discuss possible reasons for the particularly mild phenotype of par-3 mutants, but don't specifically address the mild phenotypes of the others. Clearly quite a bit of polarization and apical membrane addition occurs in ALL of the mutants. Is this because those early steps use other/redundant molecular players, or is depletion too late or incomplete to reveal an early role?

      We agree with Reviewer 3 and will bring up these points in the discussion. Degradation of proteins strongly predicted to function together (RAL-1 and SEC-5; PAR-6 and PKC-3) produce similar although not identical phenotypes; as discussed above we consider it likely that these differences reflect minor differences in degradation efficiency below our ability to detect by fluorescence. As Reviewer 3 points out, the excretory-specific driver we use to express ZIF-1 may not be active at the very earliest stages of lumen formation, and degradation could take 45 minutes or more after the promoter becomes active (Armenti et al, 2014). Thus, we agree that phenotypes could be more severe if it were possible to completely deplete each tagged protein prior to the onset of lumen formation. However, this caveat does not change the interpretations of our experiments since all proteins are degraded with the same driver. We have avoided mentioning that the phenotypes we observe reflect the ‘null’ phenotype for these reasons. We will emphasize these points in the discussion.

      The authors introduce a new reagent, "excP" (the promoter for T28H11.8), which they use to drive canal cell expression of ZIF-1 for their degron experiments. Please provide more information about when in embryogenesis this promoter becomes active, how that compares to when the par genes, sec-5, ral-1 and cdc-42 are first expressed, and what canal length is at that time. It would also be helpful to show the timeframe for degron-based depletion using this reagent (Figure 1C shows only depletion at L4, days later).

      Publicly available single cell RNA seq data (https://pubmed.ncbi.nlm.nih.gov/31488706/ and https://cello.shinyapps.io/celegans_explorer/) suggest that canal expression of the endogenous T28H11.8 gene doesn't really ramp up until the 580-650 minute timepoint, which is several hours after par gene canal expression (270-390 minutes) and the initiation of canal lumen formation (bean stage, 400-450 minutes). These data suggest that excP might come on too late to test requirements in lumen formation and early stages of extension. This caveat should be at least mentioned.

      See point #2 above. We agree that providing more information on expression from the T28H11.8 promoter would be important for interpreting the severity of phenotypes. We will raise this point in the discussion, and include existing published expression data and a more detailed analysis of the excP::mCherry transgene.

      3.There are two major aspects to the mutant phenotypes observed here: short lumens and cystic lumens. A short lumen makes sense intuitively, but the cysts could use a little more explanation. (What are cysts? What is thought to be the basis of their formation?). It is intriguing that cysts in sec-5 vs. ral-1 mutants (Figure 1) and par-6 vs. pkc-3 mutants (Figure 4) seem to have a very different size and overall appearance. Are these consistent differences, and if so, what could be the explanation for them?

      This is an interesting point. Since it is not practical to perform time-lapse imaging to watch canal cysts form, we analyzed only L1 and L4 larvae. We believe from our imaging that these are discontinuous regions of the lumen. One explanation for the expansion and dilation of the cystic lumens by L4 stage could be that the canal lumen has been expanded by fluid buildup resulting from a defect in canal function in osmoregulation, but we have not tested this directly. The reviewer also raises an interesting point regarding different appearances of cysts in SEC-5 and RAL-1 depleted larvae compared to PAR-6 and PKC-3. It is possible that these differences arise because SEC-5 and RAL-1 might direct whether vesicles will fuse at all, whereas PAR proteins direct where they will fuse in the cell (i.e. there could be fusion at basal surfaces, or just reduced apical fusion). We will bring up these points in the discussion.

      4.The authors did not test if PKC-3, like PAR-6, is required to recruit exocyst to the canal cell apical membrane, but their prior studies in the embryo suggested that it is (Armenti et al 2014). They also did not test if EXC-5 is required to recruit PAR-6 and the exocyst (along with PKC-3), or if CDC-42 is required to recruit PKC-3 (along with PAR-6). There seems to be an assumption that PAR-6 and PKC-3 are regulated and function in a common manner (as is often the case), but that has not been demonstrated here specifically. The basis for this assumption and alternatives to the linear model should be acknowledged.

      As discussed above (Reviewer 1 point #6), we will directly test whether PKC-3 is required to recruit SEC-10::mCherry to the lumenal membrane. We agree with Reviewer 3 that we have not shown that PAR-6 and PKC-3 always function similarly, although this is expected based on their similar phenotypes and co-dependent functions in other cells. We will mention this caveat in the discussion.

      5.EXC-5 is presumed to act upstream of CDC-42 based on shared phenotypes and the known Rho GEF activity of its mammalian homologs. However, direct evidence for this is currently lacking. In future, the authors might test if depleting EXC-5 affects CDC-42 activation/GTP-loading by using CDC-42 biosensors that have been reported in the literature (e.g. Lazetic et al 2018).

      See Reviewer 1 point #2.

      \*Minor comments:** Figure 1, Figure 4, Figure S3, Figure S4 Blue color/CFP indicates the apical/luminal membrane or the apical region of the canal cytoplasm, not the actual lumen as the labels suggest. The lumen is a hollow cavity on the opposite side of the plasma membrane from these markers, and it is shown as white in the Figure 1A upper right cartoon.*

      Thank you for pointing this out. We will correct the figure labelling.

      Figure 2, Figure S2 I'm not confident in the statistical analysis used here (Fisher's Exact test on two bins, 50% canal length), given that four length bins (not two) were defined. I recommend consulting a statistician.

      Our rationale for using two bins for the statistical analysis was because control larvae nearly all have a similar canal length (L1 stage: 99% of larvae have canal length that is 51-75% of body length; L4 stage: 98% of larvae have canal length that is 76-100% of body length), making it straightforward to ask if mutants are shorter. We chose not to make more granular phenotypic comparisons, as we cannot rule out that subtle differences in degradation efficiency, rather than differences in biological function, underlie any differences in canal length of the degron mutants. We will consult with a statistician to determine if this is an acceptable way to statistically compare controls and mutants.

      p.3 "Born during late embryogenesis..." Actually, the canal cell is born at ~270 minutes after first cleavage, which is in the first half of embryogenesis, not what I would call "late".

      We agree and will correct the wording.

    2. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #3

      Evidence, reproducibility and clarity

      Summary:

      The C. elegans excretory canal cell is a classic model for studying single cell tubulogenesis, where a cell establishes an intracellular apical domain that extends to form a lumen. Prior studies in this system have identified a set of gene products that localize to the growing apical domain and/or are important for its organization and size, but the molecular pathways through which these various gene products act remain poorly understood. Here, Abrams and Nance are able to connect the dots among several of these to flesh out a pathway for apical membrane addition. Specifically, they demonstrate that CDC-42 is needed to recruit PAR-6, and that PAR-6 is needed to recruit the exocyst to the apical membrane and to promote proper apical membrane growth and organization. EXC-5, a candidate GEF for CDC-42, also appears to act in this pathway.

      Strengths of this manuscript include the use of endogenously tagged proteins (rather than over-expressed transgenes) for high resolution imaging and a cell-type specific acute depletion strategy that avoids complicating pleiotropies and allows tests of molecular epistasis. While some results were fairly expected based on prior studies of Cdc42, PAR proteins, and the exocyst in other tissues or systems, differences in the requirements for par-6 and pkc-3 vs. par-3 strongly suggest that the former genes play more important roles in exocyst recruitment. I was also excited to see a connection made between EXC-5 and PKC-3 localization.

      Major comments:

      1.Lumen formation vs. lumen extension. The abstract and introduction use these two terms almost interchangeably, but they are not the same and more care should be taken to avoid the former term. The data here do not demonstrate any roles for par or other genes in lumen formation, but do demonstrate roles in lumen extension and organization/shaping.

      2.Related to the above, mutant phenotypes here are surprisingly mild and variable. The authors discuss possible reasons for the particularly mild phenotype of par-3 mutants, but don't specifically address the mild phenotypes of the others. Clearly quite a bit of polarization and apical membrane addition occurs in ALL of the mutants. Is this because those early steps use other/redundant molecular players, or is depletion too late or incomplete to reveal an early role?

      The authors introduce a new reagent, "excP" (the promoter for T28H11.8), which they use to drive canal cell expression of ZIF-1 for their degron experiments. Please provide more information about when in embryogenesis this promoter becomes active, how that compares to when the par genes, sec-5, ral-1 and cdc-42 are first expressed, and what canal length is at that time. It would also be helpful to show the timeframe for degron-based depletion using this reagent (Figure 1C shows only depletion at L4, days later).

      Publicly available single cell RNA seq data (https://pubmed.ncbi.nlm.nih.gov/31488706/ and https://cello.shinyapps.io/celegans_explorer/) suggest that canal expression of the endogenous T28H11.8 gene doesn't really ramp up until the 580-650 minute timepoint, which is several hours after par gene canal expression (270-390 minutes) and the initiation of canal lumen formation (bean stage, 400-450 minutes). These data suggest that excP might come on too late to test requirements in lumen formation and early stages of extension. This caveat should be at least mentioned.

      3.There are two major aspects to the mutant phenotypes observed here: short lumens and cystic lumens. A short lumen makes sense intuitively, but the cysts could use a little more explanation. (What are cysts? What is thought to be the basis of their formation?). It is intriguing that cysts in sec-5 vs. ral-1 mutants (Figure 1) and par-6 vs. pkc-3 mutants (Figure 4) seem to have a very different size and overall appearance. Are these consistent differences, and if so, what could be the explanation for them?

      4.The authors did not test if PKC-3, like PAR-6, is required to recruit exocyst to the canal cell apical membrane, but their prior studies in the embryo suggested that it is (Armenti et al 2014). They also did not test if EXC-5 is required to recruit PAR-6 and the exocyst (along with PKC-3), or if CDC-42 is required to recruit PKC-3 (along with PAR-6). There seems to be an assumption that PAR-6 and PKC-3 are regulated and function in a common manner (as is often the case), but that has not been demonstrated here specifically. The basis for this assumption and alternatives to the linear model should be acknowledged.

      5.EXC-5 is presumed to act upstream of CDC-42 based on shared phenotypes and the known Rho GEF activity of its mammalian homologs. However, direct evidence for this is currently lacking. In future, the authors might test if depleting EXC-5 affects CDC-42 activation/GTP-loading by using CDC-42 biosensors that have been reported in the literature (e.g. Lazetic et al 2018).

      Minor comments:

      Figure 1, Figure 4, Figure S3, Figure S4 Blue color/CFP indicates the apical/luminal membrane or the apical region of the canal cytoplasm, not the actual lumen as the labels suggest. The lumen is a hollow cavity on the opposite side of the plasma membrane from these markers, and it is shown as white in the Figure 1A upper right cartoon.

      Figure 2, Figure S2 I'm not confident in the statistical analysis used here (Fisher's Exact test on two bins, <50% and >50% canal length), given that four length bins (not two) were defined. I recommend consulting a statistician.

      p.3 "Born during late embryogenesis..." Actually, the canal cell is born at ~270 minutes after first cleavage, which is in the first half of embryogenesis, not what I would call "late".

      Significance

      Polarized plasma membrane addition is critical for the development of epithelial tissues, so understanding the mechanisms that control this is of broad interest to many cell and developmental biologists. This study will be of particularly high interest to researchers working on PAR proteins, the exocyst, or single cell tube development.

      The results here add to the existing body of evidence for PAR-dependent recruitment of exocyst to expanding apical/luminal surfaces (e.g. Bryant et al 2010; Jones et al 2011, 2014; Armenti et al 2014) and to evidence for key functional distinctions between PAR-6 & PKC-3 vs. PAR-3 (e.g. Achilleos et al 2010; Jones et al 2014). The results here are more robust than in those prior studies and more clearly illustrate directionality due to the authors' acute depletion strategy, which avoids major tissue disruptions that could secondarily affect protein localization.

      expertise keywords: C. elegans, epithelia, tubulogenesis

    3. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #2

      Evidence, reproducibility and clarity

      The manuscript by Abrams & Nance describes a precise investigation of the role of PAR proteins in the recruitment of the exocyst during and after the extension of the C. elegans excretory canal. State-of-the-art genetic techniques are used to acutely deplete proteins only in the targeted cell, and examine the localization of endogenously expressed markers. Experiments are well described and carefully quantified, with systematic statistical analysis. The manuscript is easy to follow and the bibliography is very good. Most conclusions are well supported.

      I only have a few minor questions or remarks:

      1) I am not entirely convinced by the presence of CDC-42 at the lumenal membrane (Fig3G); it seems to be more sub-lumenal that really lumenal. It peaks well before PAR-6 (Fig3H) which itself seem slightly less apical that PAR-3 (Fig3F). Could you use super-resolution microscopy (compatible with endogenous expression levels) to more precisely localize CDC-42? Similar point for PAR-3 and PAR-6 which do not seem to colocalize completely - a longitudinal line scan along the lumenal membrane might provide the answer even without super-resolution; this could help explain why these two proteins do not have the same function. These suggestions are easy to do provided the authors can have access to super-resolution (Airyscan to name it; although other methods will be perfectly acceptable I believe it is the most simple one).

      2) The same group has described a CDC-42 biosensor to detect its active form. It could be used here to precisely pinpoint where active CDC-42 is required: in the cytoplasm? At the lumenal membrane? colocalizing with what other protein? This will require the expression of a transgene under an excretory cell specific promotor and a simple injection strategy while helping to strengthen the description of the CDC-42 role.

      3) As the authors certainly know, there is a PAR-6 mutation which prevents its binding to CDC-42. They could express this construct in the excretory canal a simple extrachromosomal array should be sufficient) to validate the direct interaction between these proteins in this cell.

      4) What is the lethality of ZIF-1-mediated depletion of the various factors under the exc promoter? Can homozygous strains be maintained? Authors just have to add a sentence in the Mat&Met section.

      Provided that the authors have access to an Airyscan, all the questions asked here can be answered in two months (one month for constructs, one month for injection and data analysis) at a very minor cost.

      Significance

      The reviewer has an expertise in cell polarity and membrane trafficking, using C. elegans as a model.

      The manuscript by Abrams & Nance describes a precise investigation of the role of PAR proteins in the recruitment of the exocyst during and after the extension of the C. elegans excretory canal. The interactions between these factors have already been examined in a number of models and contexts. In particular it follows a previous study from the same group (Armenti et al, Dev Biol, 2014) which established that the exocyst and RAL-1 controls polarized secretion in this model, and that PAR proteins are required for the polarized localization of the exocyst, but using the early embryo. This new manuscript is entirely focused on the excretory canal and 1) confirms the previous results, and 2) significantly extends them by precisely dissecting the role of CDC-42 and the apical PAR proteins. It will be of interest to researchers investigating the links between polarity and membrane trafficking with the description of a molecular cascade required for membrane trafficking in the context of a single-cell tube.

    4. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #1

      Evidence, reproducibility and clarity

      The manuscript by Abrams and Nance describes how the polarity proteins PAR-6 and PKC-3/aPKC promote lumen extension of the unicellular excretory canal in C. elegans. Using tissue-specific depletion methods they find that CDC-42 and the RhoGEF EXC-5/FGD are required for luminal localization of PAR-6, which recruits the exocyst complex required for lumen extension. Interestingly, they show that the ortholog of the mammalian exocyst receptor, PAR-3, is dispensable for luminal membrane extension. Overall, this is a well-written and interesting manuscript.

      Major comments

      1.Because depletion of PAR-3 in the canal causes milder defects than PAR-6 or CDC-42 the authors suggest that they cannot rule out the possibility that an alternative isoform of PAR-3 is expressed and buffering the defect. They should perform canal-specific RNAi-mediated depletion of the entire PAR-3 gene to determine if this is true.

      2.The authors suggest that GTP-loaded (activated) CDC-42 recruits PAR-6 to the luminal membrane. It would be nice if they could use a biosensor, such as the GBD-WSP-1 reagent from Buechner's lab to confirm that EXC-5 depletion also reduces activated CDC-42, as would be expected. This should be achievable since there is strong CDC-42 signal, even in the cytoplasm.

      3.Related to point 2, (i) does mutation of the CRIB domain of PAR-6 impair its recruitment to the luminal membrane, and (ii) does this mutant exacerbate canal defects when PAR-3 is depleted?

      4.The authors hypothesize that partial recruitment of PAR-6 by CDC-42 is sufficient for luminal membrane extension to explain the mild defects caused by PAR-3 depletion. Since depletion of PAR-6 and CDC-42 alone causes milder canal truncations the authors should co-deplete these proteins (as well as PAR-3 and CDC-42) to determine if there is an additive effect.

      5.In figure 2, the authors show that depletion of PKC-3 causes more severe canal truncations than PAR-6. Since these proteins function in the same complex what do they think is the reason for this difference? This point could be discussed more in the manuscript.

      6.Related to point 5, more experiments with PKC-3 should be done to determine if, for example, localization of SEC-10 is similarly affected as ablation of PAR-3, PAR-6 and CDC-42.

      Significance

      This manuscript builds off their previous work on the role of the exocyst in excretory canal extension and in our view represents an important advance that is relevant to biological tube development across phyla. Therefore, this work should be of interest to biologists studying tubulogenesis in many different model systems.

      My areas of expertise include model organism genetics, biological tube development, and biochemistry.

    1. Note: This rebuttal was posted by the corresponding author to Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Reply to the reviewers

      We are grateful to Review Commons for the opportunity to get valuable comments on our manuscript “Trim39 regulates neuronal apoptosis by acting as a SUMO-targeted E3 ubiquitin-ligase for the transcription factor NFATc3”. We would like to acknowledge the very nice and constructive reviews that our manuscript received. We found all of the reviewer comments well founded and we are taking them into careful consideration in preparing the revised version. We are currently performing additional experiments to address the questions raised by the reviewers. We are not yet able to provide a revised version of the manuscript, but you will find below our response to the reviewers and our plan of revision. It is difficult to anticipate exactly how much time we will need to get the requested results and to prepare a complete revised version, as it will depend on whether we can work normally and whether we encounter technical problems. However, it should be possible within a few months.

      Reviewer #1

      **Summary:**

      Desagher and co-workers investigate the regulation of the NFAT family member NFATc3, a transcription factor in neurons with a pro-apoptotic role. They identify TRIM39 as a ubiquitin E3 ligase regulating NFATc3. They demonstrate that TRIM39 can bind and ubiquitinate NFATc3 in vitro and in cells. They identify a critical SUMO interaction motif in TRIM39, that is required for its interaction with NFATc3 and for its ability to ubiquitinate NFATc3. Moreover, mutating sumoylation sites in NFATc3 reduces the interaction with TRIM39 and reduces its ubiquitination. Silencing TRIM39 increases the protein levels of NFATc3 and its transcriptional activity, leading to apoptosis of neurons. TRIM17 modulates the TRIM39-NFATc3 axis. Combined, TRIM39 appears to be a SUMO-targeted ubiquitin ligase (STUbL) for NFATc3 in neurons.

      **Major points:**

      1.This manuscript containing two stories: the rather exciting story that TRIM39 is a STUbL for NFATc3 (as mentioned in the title) and the second less exciting story: TRIM17 modulates the regulation of NFATc3 by TRIM39. These stories are now mixed in a confusing manner, disrupting the flow of the first story. It would be better to focus the current manuscript on the first story and strengthen it further and develop the second story in a second manuscript.

      We understand that the reviewer is more interested in the part of our manuscript related to the characterization of Trim39 as a STUbL due to his/her field of expertise. However, the two other reviewers are also interested in the other parts of our work. Notably the third reviewer would like us to highlight the physiological importance of our findings. Indeed, the main goal of this article is to describe the mechanisms regulating the stability of the transcription factor NFATc3. Trim17 plays a role in this regulation by inhibiting Trim39. It is particularly important for understanding the impact of these mechanisms on neuronal apoptosis as Trim17 is induced in these conditions. As we want to reach a wide audience, we prefer not to focus our manuscript on the identification of a new STUbL. However, we agree with the reviewer that it would be very interesting to strengthen this part of our work and we are grateful for his/her suggestions.

      2.Whereas the cellular experiments to indicate that TRIM39 acts as a STUbL are properly carried out, the observed effects are not necessarily direct. Direct evidence that TRIM39 is indeed a STUbL for sumoylated NFATc3 needs to be obtained in vitro, using purified recombinant proteins. Does TRIM39 indeed preferentially ubiquitinate sumoylated NFATc3? Is ubiquitination reduced for non-sumoylated NFATc3? Is ubiquitination of sumoylated NFATc3 dependent on SIM3 of TRIM39? Do other SIMs in TRIM39 contribute?

      We agree with the reviewer that additional in vitro experiments using purified recombinant proteins would strengthen the characterization of Trim39 as a STUbL. In order to answer the specific questions of the reviewer, we propose to perform in vitro ubiquitination using different forms of GST-Trim39 (WT/mSIM3/mSIM1&2) following in vitro SUMOylation (or not) of NFATc3 produced by TnT (wheat germ) and purified by immunoprecipitation. Preliminary results using WT Trim39 show that indeed the in vitro ubiquitination of NFATc3 is improved by prior in vitro SUMOylation. We have to confirm these results and to test the SIM mutants of Trim39 in the same conditions.

      3.Rule out potential roles for other STUbLs by including control knockdowns of RNF4 and RNF111 and verify the sumoylation of NFATc3 and ubiquitination of wildtype and sumoylation-mutant NFATc3.

      Our data show that silencing of Trim39 deeply decreases the ubiquitination level of NFATc3 in Neuro2A cells, indicating that Trim39 plays a major role in this process. We agree that this does not exclude the possible involvement of other STUbLs in NFATc3 ubiquitination in this model but their potential contribution would be limited. This point will be better addressed in the discussion.

      4.Figure 6B: use SUMO inhibitor ML-792 to demonstrate that ubiquitination of wildtype NFATc3 by TRIM39 is dependent on sumoylation.

      We thank the reviewer for suggesting this experiments that can easily improve the strength of our demonstration. Our preliminary results indeed indicate that in vivo ubiquitination of NFATc3 by Trim39 is strongly decreased following treatment with the SUMO inhibitor ML-792. We have to confirm these results.

      **Minor points:**

      5.Figure 1A and B: demonstrate by immunoprecipitation and Western that the endogenous counterparts indeed interact.

      We are currently setting the conditions to immunoprecipitate endogenous NFATc3 and Trim39 in order to demonstrate that they indeed interact.

      6.Figure 1C and 1E: Quantify the PLA results properly and perform statistics.

      We will perform these quantification and statistical analysis as requested.

      7.Figure 2B: Correct unequal loading of samples.

      We agree with the reviewer (as with reviewer #2) that the blots showing the total lysates of this experiment are confusing. As mentioned in the legend, some material has been lost during the TCA precipitation resulting in unequal loading. However, these experiments have been performed a very long time ago and we do not have the protein extracts anymore. We are currently trying to produce efficient shRNA-expressing lentiviruses to reproduce this experiment and provide a better figure.

      8.Figure 6B: proper statistics are needed here from at least three independent experiments.

      The reviewer is right. Statistics are needed to reinforce the significance of these results. We have quantified three independent experiments and made graphs and statistics that will be presented in the revised version of the manuscript. They better support our conclusion.

      Reviewer #1 (Significance (Required)):

      Humans have over 600 different ubiquitin E3s. Currently, RNF4 and RNF111 are the only known human SUMO-Targeted Ubiquitin Ligases (STUbLs). Here, the authors present evidence that the ubiquitin E3 ligase TRIM39 is a STUbL for sumoylated NFATc3. Identification of a new STUbL is an exciting finding for the ubiquitin and SUMO field and for the field of ubiquitin-like signal transduction in general, but needs to be strengthened as outlined above. My field of expertise is SUMO and ubiquitin signal transduction.

      Reviewer #2

      In this manuscript, the authors analyze the effect of TRIM39, a ubiquitin E3 ligase, on NFATc3, a transcription factor that regulates apoptosis in the nervous system. The authors show that TRIM39 can promote the ubiquitination of NFATc3 and regulate its half-life. Furthermore, ubiquitination depends on the SUMOylation state of NFATc3, which suggests that TRIM39 could be a new example of SUMOylation-dependent ubiquitin ligase or STUbL. **In addition, the authors show that TRIM17 interferes with TRIM39 ubiquitination, representing a new regulatory level for NFATc3 degradation. This has consequences on the regulation of apoptosis in cells derived from the nervous system.

      The authors show well-controlled, sound results for the most part. The manuscript is well written, and argumentation is convincing. Given the fact that only 2 STUbLs were previously characterized in mammals, the results are relevant and represent an advance in the field. Overall, this is a nice piece of work. Here are some comments.

      **Major comments**

      -In Fig. 2B, the levels of material loaded are uneven, which difficult the interpretation.

      We agree with the reviewer (as with reviewer #1) that the blots showing the total lysates of this experiment are confusing. As mentioned in the legend, some material has been lost during the TCA precipitation, resulting in unequal loading. In the other experiments, we have the same problem or the background is too high. We are currently trying to produce efficient shRNA-expressing lentiviruses to reproduce this experiment and provide a better figure.

      However, it seems that the control shRNA also has an effect on NFATc3 ubiquitination, which should not be the case.

      It is true that, in the present figure, the ubiquitination signal is decreased in cells transduced with the control shRNA. However, this is likely due to reduced expression of transfected NFATc3 following lentiviral infection, as it can be seen on the western blot of total lysates.

      Also, by reducing ubiquitination by TRIM39, shouldn't you expect an increase in the levels of NFATc3, if this ubiquitination was driving degradation? The authors do not specify whether those cells were treated or not with proteasomal inhibitor.

      We agree that an increase in the protein level of NFATc3 is expected following silencing of Trim39. However, in the assay presented in Figure 2B, NFATc3 is transfected and the part of overexpressed NFATc3 that is ubiquitinated by endogenous Trim39 is certainly low. Therefore, silencing of Trim39 cannot have a visible impact on the total protein level of NFATc3.

      Indeed, cells were treated with proteasome inhibitor. It is mentioned in the legend of Figure 2A. To avoid repeating it in the legend of Figure 2B, we just wrote that, after 24h transfection, cells were treated as in A, with includes MG-132 treatment for 6h.

      Same applies in Figure 4B, where no reduction in NFATc3 are seen after including TRIM39 in the reaction (beyond the fact that it looks reduced because the presence of ubiquitinated forms).

      In Figure 4B, the reaction of ubiquitination is performed in an acellular medium with purified recombinant proteins. Although NFATc3 is produced by in vitro transcription/translation in wheat germ extract, it is purified by immunoprecipitation before in vitro ubiquitination. Therefore, the reaction does not contain any proteasome and NFATc3 should not be degraded following its ubiquitination by TRIM39.

      -After the experiments in vitro shown in Fig. 2C, the authors conclude that the NFATc3 is a direct substrate of TRIM39. I think the authors used the right approach by using bacterially produced GST-TRIM39 for the ubiquitination reaction. However NFATc3 is produced by an in vitro transcription-translation system, which could in principle provide other contaminant proteins to the reaction. Did the authors try to use bacterially produced NFATc3? This might be difficult in the case of big proteins, in which case the authors could add some caution note in the text. Same applies in Figure 4B.

      The reviewer is right. It would have been preferable to use NFATc3 produced in bacteria. Indeed, we started with this approach. However, it was very difficult to get NFATc3 expressed in bacteria, and when we succeeded, most of the protein was degraded. We tried different protease inhibitor cocktails and we used a strain of bacteria (BL21-CodonPlus(DE3)-RP) that is mutated on the genes coding for the proteases Lon and OmpT and is further engineered to express tRNAs that are often limiting when expressing mammalian proteins. Unfortunately, this did not improve our production enough.

      We agree that, in principle, in vitro transcription-translation (TnT) systems can include contaminant proteins. However, we used wheat germ extract to produce NFATc3 by TnT. Moreover, we immunopurified NFATc3 from the TnT reaction prior to the ubiquitination reaction. The probability that proteins modifying NFATc3 are expressed in plants and are co-purified with NFATc3 is low. Nevertheless, we will discuss this point in the result section of the revised version of the manuscript, when describing results of Figure 2B and 4B.

      -In Fig. 6B, higher levels of ubiquitination in the different SUMOylation mutants are shown. Is this effect consistent? How this can be explained?

      We are grateful to the reviewer for pointing out this inconsistency in our manuscript. It will be corrected. Indeed, the values indicated in red in Figure 6B are confusing and are certainly not consistent. We calculated them by normalizing the intensity of the ubiquitination signal by the intensity of NFATc3 in total lysates, which seems to have introduced a bias. Variations in NFATc3 levels are probably responsible for the artificially higher levels of ubiquitination for different SUMOylation mutants after normalization. When quantifying three independent experiments, as requested by reviewer #1, we realized that results are much more consistent without normalization. Therefore, in the revised version of manuscript, we will add a graph showing the average and standard deviation of three independent experiments quantified without normalization. We will also replace the experiment currently presented in Figure 6B by another one in which the levels of NFATc3 show lower variations in the total lysates.

      In addition, variations in the levels of NFATc3 are shown in the total lysate, despite the use of proteasomal inhibitors. How the author explain this effect?

      These variations in NFATc3 levels in the total lysates may be due to differential protein precipitation by TCA. That is why, in more recent experiments, we collected a portion of the homogenous cell suspension before lysis in the guanidinium buffer, to assess the expression level of transfected proteins (as presented in Figures 4A and 7E).

      It is true that treatment with proteasome inhibitor should attenuate differences in protein level due to different ubiquitination levels. However, cells are transfected for 24h and then treated with MG-132 for 6h before lysis. Proteasome inhibition cannot compensate for what occurred in the cells during the 24h transfection. It is added essentially to accumulate poly-ubiquitinated forms of NFATc3.

      Somehow, this is contradictory with the general message of SUMOylation-dependent ubiquitination.

      The reduced levels of SUMOylation mutants in total lysates may appear to be contradictory with SUMOylation-dependent ubiquitination. However, as mentioned above, this could be due to differential protein precipitation by TCA or to different transfection efficiencies. In contrast, the half-life measurement of WT and EallA mutant, that does not rely on initial expression levels, clearly shows a stabilization of the SUMOylation mutant. Moreover, the average of the three ubiquitination experiments is really convincing. Therefore, we believe that the data that will be presented in the revised manuscript will strongly support our hypothesis.

      -In Fig. 7E, not clear to me what the big bands above 130 KDa is after the nickel beads. Do they correspond to monoUb NFATc3 or to the unmodified protein that is sticky to the beads? Do the authors have side-by-side gels of the initial lysate next to the nickel beads eluates to show the increase in molecular weight?

      The big bands above 130 kD among nickel bead-purified proteins in Figure 7A are unlikely to be unmodified NFATc3 sticking to the beads. Indeed, in the control condition, in which NFATc3 is overexpressed in the absence of His-ubiquitin, these bands are not visible. Therefore, they might be mono-ubiquitinated forms of NFATc3, or degradation products of poly-ubiquitinated NFATc3. We will correct the figure to clarify this point. Unfortunately, we do not have a gel with nickel bead eluates and total lysates side by side for this experiment.

      -Quantifications in some pictures (i.e. Figures 5A, 5B, 6B, 7) is shown in red above or below the bands. Not clear whether the quantifications shown correspond to that single experiment or is the average of several experiments. In the first case, the number would not be very valuable. Authors could add quantification graphs with standard deviations or error bars to the experiments if they want to make the point of changes (significant or not) in the levels. Alternatively, indicate in the Figure legends whether the numbers correspond to the average of several experiments.

      These quantifications correspond to the representative experiments shown in the different figures. We will clarify this point in the Figure legends of the revised manuscript. We added these quantifications to normalize the amount of co-precipitated proteins by the amount of the precipitated partner (Fig 5A, 5B, 7B, 7C, 7D) which is not always precipitated with the same efficiency in the different conditions. We think that it should help the reader to assess the degree of interaction. We also added quantifications to Figure 7E to normalize the ubiquitination signal by the amount of NFATc3 expressed in the total lysate. However, we did not want to overload the figures by adding too many graphs.

      For Figure 6B, where TCA precipitation of total lysates created an inconsistency, we will provide a graph with the average and standard deviation of three independent experiments, as requested by reviewer #1.

      -In Fig. 8, the quantification of apoptotic nuclei has been done just based on the morphology after DAPI staining. Could you use an apoptosis marker (i.e. cleaved caspase Abs) to label the apoptotic cells?

      We have been using primary cultures of cerebellar granule neurons (CGN) as an in vitro model of neuronal apoptosis for many years. Nuclear condensation, visualized after DAPI staining, is very characteristic in these neurons and allows a reliable assessment of neuronal apoptosis. In a previous study (Desagher et al. JBC 2005), we have shown that the kinetics of apoptosis in CGN is the same whether we measure cytochrome c release, active caspase 3 or nuclear condensation (Fig 1b). We therefore believe that the counting of apoptotic nuclei is sufficient to support our conclusions, notably for transfection experiments in Figure 8A which would require a lot of work to be repeated with active caspase 3 staining. However, if we can produce efficient shRNA-expressing lentiviruses, we will reproduce the experiment presented in Figure 8B and we will perform a western blot using anti-active caspase 3 to confirm our conclusion.

      **Minor comments**

      -In Figs. 1 and 5, the red channel should be put in black and white, as it is much easier to see the signal. Not relevant to have DAPI alone in B&W (it does not hurt either), as it is well visible in the merge picture. Also, quantification of the PLA positive dots should be shown in Fig. 1.

      We thank the reviewer for these suggestions. We will modify the figures and we will quantify the PLA dots in Figure 1 as requested.

      -In Fig. 3C, is the difference in TRIM17 expression between empty plasmid and NFATc3 plasmid significant? If so, indicate it in the graph. The same in panels D, E, indicate all significant differences. Same in other Figures.

      No, the difference in Trim17 expression is not statistically significant between NFATc3 and empty plasmid although it clearly increases. However, we agree with the reviewer that more significant differences could be shown in the figures, particularly in Figure 3. Nonetheless, we will try not to overload the figures and will restrict ourselves to comparisons that make sense.

      -It would be nice to show a scheme on the location of SIMs in TRIM39 in relation to the other feature of the protein.

      We are grateful to the reviewer for this suggestion. We will be happy to add a scheme of Trim39 showing its different domains and the location of its SIMs in the revised Figure 7.

      -In Fig. 2 legend, "Note that in the presence of ubiquitin the unmodified form of WT GST-Trim39 is lower due to high Trim39 ubiquitination." Please change to "...in the presence of ubiquitin the levels of the unmodified form..."

      -In Fig. 7 legend, the phrases "The intensity of the bands ... " are not clear. Please rephrase.

      -In Fig. 8 legend, "\** * PWe thank the reviewer for pointing out typographical errors and awkward sentences in our manuscript. Changes will be made as requested.

      Reviewer #2 (Significance (Required)):

      In this manuscript, the authors analyze the effect of TRIM39, a ubiquitin E3 ligase, on NFATc3, a transcription factor that regulates apoptosis in the nervous system. The authors show that TRIM39 can promote the ubiquitination of NFATc3 and regulate its half-life. Furthermore, ubiquitination depends on the SUMOylation state of NFATc3, which suggests that TRIM39 could be a new example of SUMOylation-dependent ubiquitin ligase or STUbL. In addition, the authors show that TRIM17 interferes with TRIM39 ubiquitination, representing a new regulatory level for NFATc3 degradation. This has consequences on the regulation of apoptosis in cells derived from the nervous system.

      The authors show well-controlled, sound results for the most part. The manuscript is well written, and argumentation is convincing. Given the fact that only 2 STUbLs were previously characterized in mammals, the results are relevant and represent an advance in the field. Overall, this is a nice piece of work.

      Audience: researchers interested on proteostasis in general and on nervous system regulation

      My expertise: postranslational modifications

      Reviewer #3

      **Summary:**

      In this study, Shrivastava et al. elucidated the previously unknown function of TRIM39 in regulating protein stability of NFATc3, the predominant member of the NFAT family of transcription factor in neurons, where it plays a pro-apoptotic role. NFATs have been shown to be regulated by multiple mechanisms, including at the level of protein stability. In this study, the authors identify TRIM39 as the E3 ligase for NFATc3. Interestingly, TRIM39 recognizes the SUMOylated form of NFATc3 and the interaction facilitates its ubiquitylation and subsequent proteasomal degradation. They further showed that binding of TRIM39 to NFATc3 can also be regulated by TRIM17. Like TRIM39, TRIM17 is a ring-finger containing protein previously shown by this group that it binds NFATc3 but the interaction resulted in an up- rather than down-regulation of NFATc3. In this study, they offer insight to the paradox that overexpression of TRIM17 binding to TRIM39 is to inhibit TRIM39-mediated ubiquitylation of NFATc3. Furthermore, they showed activation of NFATc3 transcriptionally activates TRIM17 expression, thus forming a feedback loop between NFATc3 and TRIM17. Hence, an TRIM17-TRIM39-NFATc3 signaling axis for modulating the protein stability for promoting the activity of NFATc3 in regulating apoptosis in the cerebellar granule neurons induced by KCl deprivation is proposed

      The key conclusions are convincing. The data in general are of good quality and with many of the key interactions vigorously documented **by conducting reciprocal interaction analysis. For knockdown expeRIMents, two shRNA independent sequences were used. However, some issues remain to be addressed:

      **Major comments:**

      1.Figure 1D - the authors should demonstrate that the depletion of TRIM39 expression by shRNA in Neuro2A by Western blotting

      We agree with the reviewer that it would be better to provide this control. Unfortunately, we have never been able to observe a convincing decrease in the protein level of Trim39, following knockdown, by Western blotting in Neuro2A cells. This is surprising because the decrease is clearly visible by immunofluorescence in Neuro2A cells, and by western blotting in neurons (see Figure 8C). It is possible that Neuro2A cells, but not neurons, express a protein that is non-specifically recognized by our best anti-Trim39 antibody in western blots and that migrates at the same size as Trim39, thus preventing the investigator to detect the depletion of Trim39. We will test additional anti-Trim39 antibodies to address this question.

      2.Figure 3 - the author should show overexpression of TRIM39 resulted in reduction of basal level of endogenous NFATc3 due to its effect on protein stability by using CHX or other pulse chase method.

      This is an important point and we have performed many experiments using cycloheximide to measure the half-life of NFATc3 in the presence or the absence of overexpressed Trim39. The results were neither consistent nor reproducible. This is certainly due to the fact that the half-life of endogenous NFATc3 is longer than that of overexpressed Trim39 and that cycloheximide inhibits the expression of both proteins. Therefore, we will perform pulse-chase experiments after metabolic labelling of cells with [35S]-Met. We are currently setting up the conditions to immunoprecipitate endogenous NFATc3 to be able to perform these experiments.

      3.Figure 3 - Does overexpression or knockdown of TRIM39 has an effect on affecting levels of NFATc3 mRNAs?

      The reviewer is right. It is important to control that overexpression and knockdown of Trim39 do not modify the mRNA level of NFATc3. Therefore, we are currently measuring NFATc3 mRNA levels in all the experiments used to make the graphs of Figure 3. These results will be added to the revised version of the manuscript as supplemental data. First results show no significant change of NFATc3 mRNA levels in these experiments.

      4.Figure 6A - the authors should confirm the multiple bands that are slower migrating are SUMO form of NFATc9 by demonstrating the presence of SUMO in these forms of NFATc3, or alternatively, perform His-SUMO pull-down and probe for NFATc3.

      The reactions shown in Figure 6B have been performed in vitro, with purified recombinant proteins and with NFATc3 produced by in vitro transcription/translation. The wheat germ extract used to produce NFATc3 is unlikely to provide the material needed for post-translation modification of a mammalian protein. However, we agree that it would be better to confirm that slower migrating bands are indeed SUMOylated forms of NFATc3. We may hybridize the membranes with an anti-SUMO antibody but it would give a smear as the enzymes added to the reaction mix are themselves SUMOylated. Therefore, we will show an experiment in which the reaction mix has been incubated with and without SUMO. The results show no slower migrating bands in the absence of SUMO although all conditions were otherwise identical. This will be added to the revised Figure 6.

      5.Figure 7C - the quantification for mSIM1 does not seem to agree with the band intensity.

      Yes, we agree with the reviewer that the quantification (122%) does not seem to reflect the amount of SUMO-chains bound to GST-Trim39 mSIM1. This is due to the normalization of the SUMO signals by the intensity of GST-Trim39 bands. Indeed, it is difficult to control exactly how much recombinant protein is used. GST-Trim39 mSIM1 was slightly less abundant than the other GST-Trim39 proteins in this experiment, explaining why less SUMO-chains were eluted in this condition. The normalization is mentioned in the legend of Figure 7C.

      6.TRIM17 reduces TRIM39/NFATc3 interaction and inhibits TRIM39 E3 activity, which results in stabilization of NFATc3. NFATc3 in turn transcriptionally induces TRIM17 expression, thus forming a feedback loop between NFATc3 and TRIM17. It will be good if the authors can discuss the possibility of the existence of this feedback mechanism in physiological context? Is the protein level of NFATc3 level, which should be low abundance at the resting state, elevated by KCI deprivation? If so, can the authors discuss the possible signalling event(s) that that lead to activation of NFATc3 upon KCI deprivation? For instance, does KCL deprivation cause de-SUMOylation of NFATc3?

      We thank the reviewer for these suggestions. Our preliminary results suggest that the protein level of NFATc3 is increased in neurons following KCl deprivation. We are currently performing additional experiments to confirm this result. If proved, this increase may be due to the transcriptional induction of Trim17 that should result in the stabilization of NFATc3 through the inhibition of Trim39. It may also be due to a possible deSUMOylation of NFATc3 following apoptosis induction, as suggested by the reviewer. To address the latter point, we are currently setting up PLA using anti-NFATc3 and anti-SUMO antibodies to assess the SUMOylation level of endogenous NFATc3 in neurons. If they are of good quality, we will add these data to Figure 8 and we will discuss the possible existence of feedback loops in neuronal apoptosis, as suggested by the reviewer.

      **Minor comments:**

      1.Line 294 - it should be "SUMOylation" instead of "SUMO".

      We thank the reviewer for pointing out this typographical error that will be corrected.

      2.Figure 8 - to include TRIM39/NFATc3 double knockdown to show the effect on increased neuronal apoptosis in the cells with TRIM39 knocked down was due to elevation of NFATc3 rather than other target(s) of TRIM39.

      We agree that it would be interesting to test whether the increase on neuronal apoptosis following Trim39 silencing is mainly due to its effect on NFATc3. We will therefore perform double silencing of Trim39 and NFATc3 in neurons in order to address this point.

      3.The discussion may be shortened and revised to highlight the physiological importance of the findings linked to cerebellar granule neurons survival.

      As suggested by the reviewer, we will modify the discussion to better highlight the physiological implications of our data, particularly by discussing the results of the additional experiments we will conduct in neurons.

      Reviewer #3 (Significance (Required)):

      Prior to this study, the mechanism by which protein stability of NFATc3, the pre-dominant member of the NFAT family of transcription factor in neurons, is regulated remains poorly understood. Shrivastava et al. have unravelled the interplay between ubiquitylation and SUMOylation involving TRIM39 and TRIM17 to have an important role in regulating protein stability of NFATc3. The work is interesting and bears significance towards understanding how apoptosis could be finely controlled in cerebellar granule neurons. Furthermore, the study has also expanded the understanding of the role and regulation of the TRIM family of proteins. The senior author is an expert in this field and over the years, her group has contributed many key discoveries on the function of TRIM family of E3 ubiquitin ligases and their critical ubiquitylation substrates in neuronal survival and its relevance to neuronal biology and diseases.

      The referee's field of expertise in in the field of mitochondrial apoptosis signalling. The referee extensively involved in studying how protein stability of regulators in apoptosis signalling are regulated by the ubiquitin-proteasome system (UPS) and how does the regulation play a role in physiology and diseases.

      Key words: apoptosis, ubiquitylation, cell signaling, liver diseases

    2. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #3

      Evidence, reproducibility and clarity

      Summary:

      In this study, Shrivastava et al. elucidated the previously unknown function of TRIM39 in regulating protein stability of NFATc3, the predominant member of the NFAT family of transcription factor in neurons, where it plays a pro-apoptotic role. NFATs have been shown to be regulated by multiple mechanisms, including at the level of protein stability. In this study, the authors identify TRIM39 as the E3 ligase for NFATc3. Interestingly, TRIM39 recognizes the SUMOylated form of NFATc3 and the interaction facilitates its ubiquitylation and subsequent proteasomal degradation. They further showed that binding of TRIM39 to NFATc3 can also be regulated by TRIM17. Like TRIM39, TRIM17 is a ring-finger containing protein previously shown by this group that it binds NFATc3 but the interaction resulted in an up- rather than down-regulation of NFATc3. In this study, they offer insight to the paradox that overexpression of TRIM17 binding to TRIM39 is to inhibit TRIM39-mediated ubiquitylation of NFATc3. Furthermore, they showed activation of NFATc3 transcriptionally activates TRIM17 expression, thus forming a feedback loop between NFATc3 and TRIM17. Hence, an TRIM17-TRIM39-NFATc3 signaling axis for modulating the protein stability for promoting the activity of NFATc3 in regulating apoptosis in the cerebellar granule neurons induced by KCl deprivation is proposed.

      The key conclusions are convincing. The data in general are of good quality and with many of the key interactions vigorously documented by conducting reciprocal interaction analysis. For knockdown expeRIMents, two shRNA independent sequences were used. However, some issues remain to be addressed:

      Major comments:

      1.Figure 1D - the authors should demonstrate that the depletion of TRIM39 expression by shRNA in Neuro2A by Western blotting

      2.Figure 3 - the author should show overexpression of TRIM39 resulted in reduction of basal level of endogenous NFATc3 due to its effect on protein stability by using CHX or other pulse chase method.

      3.Figure 3 - Does overexpression or knockdown of TRIM39 has an effect on affecting levels of NFATc3 mRNAs?

      4.Figure 6A - the authors should confirm the multiple bands that are slower migrating are SUMO form of NFATc9 by demonstrating the presence of SUMO in these forms of NFATc3, or alternatively, perform His-SUMO pull-down and probe for NFATc3.

      5.Figure 7C - the quantification for mSIM1 does not seem to agree with the band intensity.

      6.TRIM17 reduces TRIM39/NFATc3 interaction and inhibits TRIM39 E3 activity, which results in stabilization of NFATc3. NFATc3 in turn transcriptionally induces TRIM17 expression, thus forming a feedback loop between NFATc3 and TRIM17. It will be good if the authors can discuss the possibility of the existence of this feedback mechanism in physiological context? Is the protein level of NFATc3 level, which should be low abundance at the resting state, elevated by KCI deprivation? If so, can the authors discuss the possible signalling event(s) that that lead to activation of NFATc3 upon KCI deprivation? For instance, does KCL deprivation cause de-SUMOylation of NFATc3?

      Minor comments:

      1.Line 294 - it should be "SUMOylation" instead of "SUMO".

      2.Figure 8 - to include TRIM39/NFATc3 double knockdown to show the effect on increased neuronal apoptosis in the cells with TRIM39 knocked down was due to elevation of NFATc3 rather than other target(s) of TRIM39.

      3.The discussion may be shortened and revised to highlight the physiological importance of the findings linked to cerebellar granule neurons survival.

      Significance

      Prior to this study, the mechanism by which protein stability of NFATc3, the pre-dominant member of the NFAT family of transcription factor in neurons, is regulated remains poorly understood. Shrivastava et al. have unravelled the interplay between ubiquitylation and SUMOylation involving TRIM39 and TRIM17 to have an important role in regulating protein stability of NFATc3. The work is interesting and bears significance towards understanding how apoptosis could be finely controlled in cerebellar granule neurons. Furthermore, the study has also expanded the understanding of the role and regulation of the TRIM family of proteins. The senior author is an expert in this field and over the years, her group has contributed many key discoveries on the function of TRIM family of E3 ubiquitin ligases and their critical ubiquitylation substrates in neuronal survival and its relevance to neuronal biology and diseases.

      The referee's field of expertise in in the field of mitochondrial apoptosis signalling. The referee extensively involved in studying how protein stability of regulators in apoptosis signalling are regulated by the ubiquitin-proteasome system (UPS) and how does the regulation play a role in physiology and diseases.

      Key words: apoptosis, ubiquitylation, cell signaling, liver diseases

    3. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #2

      Evidence, reproducibility and clarity

      In this manuscript, the authors analyze the effect of TRIM39, a ubiquitin E3 ligase, on NFATc3, a transcription factor that regulates apoptosis in the nervous system. The authors show that TRIM39 can promote the ubiquitination of NFATc3 and regulate its half-life. Furthermore, ubiquitination depends on the SUMOylation state of NFATc3, which suggests that TRIM39 could be a new example of SUMOylation-dependent ubiquitin ligase or STUbL. In addition, the authors show that TRIM17 interferes with TRIM39 ubiquitination, representing a new regulatory level for NFATc3 degradation. This has consequences on the regulation of apoptosis in cells derived from the nervous system. The authors show well-controlled, sound results for the most part. The manuscript is well written, and argumentation is convincing. Given the fact that only 2 STUbLs were previously characterized in mammals, the results are relevant and represent an advance in the field. Overall, this is a nice piece of work. Here are some comments.

      Major comments

      -In Fig. 2B, the levels of material loaded are uneven, which difficult the interpretation. However, it seems that the control shRNA also has an effect on NFATc3 ubiquitination, which should not be the case. Also, by reducing ubiquitination by TRIM39, shouldn't you expect an increase in the levels of NFATc3, if this ubiquitination was driving degradation? The authors do not specify whether those cells were treated or not with proteasomal inhibitor. Same applies in Figure 4B, where no reduction in NFATc3 are seen after including TRIM39 in the reaction (beyond the fact that it looks reduced because the presence of ubiquitinated forms).

      -After the experiments in vitro shown in Fig. 2C, the authors conclude that the NFATc3 is a direct substrate of TRIM39. I think the authors used the right approach by using bacterially produced GST-TRIM39 for the ubiquitination reaction. However NFATc3 is produced by an in vitro transcription-translation system, which could in principle provide other contaminant proteins to the reaction. Did the authors try to use bacterially produced NFATc3? This might be difficult in the case of big proteins, in which case the authors could add some caution note in the text. Same applies in Figure 4B.

      -In Fig. 6B, higher levels of ubiquitination in the different SUMOylation mutants are shown. Is this effect consistent? How this can be explained? In addition, variations in the levels of NFATc3 are shown in the total lysate, despite the use of proteasomal inhibitors. How the author explain this effect? Somehow, this is contradictory with the general message of SUMOylation-dependent ubiquitination.

      -In Fig. 7E, not clear to me what the big bands above 130 KDa is after the nickel beads. Do they correspond to monoUb NFATc3 or to the unmodified protein that is sticky to the beads? Do the authors have side-by-side gels of the initial lysate next to the nickel beads eluates to show the increase in molecular weight?

      -Quantifications in some pictures (i.e. Figures 5A, 5B, 6B, 7) is shown in red above or below the bands. Not clear whether the quantifications shown correspond to that single experiment or is the average of several experiments. In the first case, the number would not be very valuable. Authors could add quantification graphs with standard deviations or error bars to the experiments if they want to make the point of changes (significant or not) in the levels. Alternatively, indicate in the Figure legends whether the numbers correspond to the average of several experiments.

      -In Fig. 8, the quantification of apoptotic nuclei has been done just based on the morphology after DAPI staining. Could you use an apoptosis marker (i.e. cleaved caspase Abs) to label the apoptotic cells?

      Minor comments

      -In Figs. 1 and 5, the red channel should be put in black and white, as it is much easier to see the signal. Not relevant to have DAPI alone in B&W (it does not hurt either), as it is well visible in the merge picture. Also, quantification of the PLA positive dots should be shown in Fig. 1.

      -In Fig. 3C, is the difference in TRIM17 expression between empty plasmid and NFATc3 plasmid significant? If so, indicate it in the graph. The same in panels D, E, indicate all significant differences. Same in other Figures.

      -It would be nice to show a scheme on the location of SIMs in TRIM39 in relation to the other feature of the protein.

      -In Fig. 2 legend, "Note that in the presence of ubiquitin the unmodified form of WT GST-Trim39 is lower due to high Trim39 ubiquitination." Please change to "...in the presence of ubiquitin the levels of the unmodified form..."

      -In Fig. 7 legend, the phrases "The intensity of the bands ... " are not clear. Please rephrase.

      -In Fig. 8 legend, " P<0.001". Change to "* P<0.001".

      Significance

      In this manuscript, the authors analyze the effect of TRIM39, a ubiquitin E3 ligase, on NFATc3, a transcription factor that regulates apoptosis in the nervous system. The authors show that TRIM39 can promote the ubiquitination of NFATc3 and regulate its half-life. Furthermore, ubiquitination depends on the SUMOylation state of NFATc3, which suggests that TRIM39 could be a new example of SUMOylation-dependent ubiquitin ligase or STUbL. In addition, the authors show that TRIM17 interferes with TRIM39 ubiquitination, representing a new regulatory level for NFATc3 degradation. This has consequences on the regulation of apoptosis in cells derived from the nervous system.

      The authors show well-controlled, sound results for the most part. The manuscript is well written, and argumentation is convincing. Given the fact that only 2 STUbLs were previously characterized in mammals, the results are relevant and represent an advance in the field. Overall, this is a nice piece of work.

      Audience: researchers interested on proteostasis in general and on nervous system regulation

      My expertise: postranslational modifications

    4. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #1

      Evidence, reproducibility and clarity

      Summary:

      Desagher and co-workers investigate the regulation of the NFAT family member NFATc3, a transcription factor in neurons with a pro-apoptotic role. They identify TRIM39 as a ubiquitin E3 ligase regulating NFATc3. They demonstrate that TRIM39 can bind and ubiquitinate NFATc3 in vitro and in cells. They identify a critical SUMO interaction motif in TRIM39, that is required for its interaction with NFATc3 and for its ability to ubiquitinate NFATc3. Moreover, mutating sumoylation sites in NFATc3 reduces the interaction with TRIM39 and reduces its ubiquitination. Silencing TRIM39 increases the protein levels of NFATc3 and its transcriptional activity, leading to apoptosis of neurons. TRIM17 modulates the TRIM39-NFATc3 axis. Combined, TRIM39 appears to be a SUMO-targeted ubiquitin ligase (STUbL) for NFATc3 in neurons.

      Major points:

      1.This manuscript containing two stories: the rather exciting story that TRIM39 is a STUbL for NFATc3 (as mentioned in the title) and the second less exciting story: TRIM17 modulates the regulation of NFATc3 by TRIM39. These stories are now mixed in a confusing manner, disrupting the flow of the first story. It would be better to focus the current manuscript on the first story and strengthen it further and develop the second story in a second manuscript.

      2.Whereas the cellular experiments to indicate that TRIM39 acts as a STUbL are properly carried out, the observed effects are not necessarily direct. Direct evidence that TRIM39 is indeed a STUbL for sumoylated NFATc3 needs to be obtained in vitro, using purified recombinant proteins. Does TRIM39 indeed preferentially ubiquitinate sumoylated NFATc3? Is ubiquitination reduced for non-sumoylated NFATc3? Is ubiquitination of sumoylated NFATc3 dependent on SIM3 of TRIM39? Do other SIMs in TRIM39 contribute?

      3.Rule out potential roles for other STUbLs by including control knockdowns of RNF4 and RNF111 and verify the sumoylation of NFATc3 and ubiquitination of wildtype and sumoylation-mutant NFATc3.

      4.Figure 6B: use SUMO inhibitor ML-792 to demonstrate that ubiquitination of wildtype NFATc3 by TRIM39 is dependent on sumoylation.

      Minor points:

      5.Figure 1A and B: demonstrate by immunoprecipitation and Western that the endogenous counterparts indeed interact.

      6.Figure 1C and 1E: Quantify the PLA results properly and perform statistics.

      7.Figure 2B: Correct unequal loading of samples.

      8.Figure 6B: proper statistics are needed here from at least three independent experiments.

      Significance

      Humans have over 600 different ubiquitin E3s. Currently, RNF4 and RNF111 are the only known human SUMO-Targeted Ubiquitin Ligases (STUbLs). Here, the authors present evidence that the ubiquitin E3 ligase TRIM39 is a STUbL for sumoylated NFATc3. Identification of a new STUbL is an exciting finding for the ubiquitin and SUMO field and for the field of ubiquitin-like signal transduction in general, but needs to be strengthened as outlined above. My field of expertise is SUMO and ubiquitin signal transduction.

    1. Note: This rebuttal was posted by the corresponding author to Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Reply to the reviewers

      Reviewer #1 (Evidence, reproducibility and clarity):

      **A. Summary:**

      In this modeling study, the authors devised a multicellular model to investigate how circadian clocks in different parts (organs) of plants coordinate their timing. The model uses a plausible mechanism to explain how having a different sensitivity to light leads to different phase and period of circadian clock, which is observed in different plant organs. The model allows for entrainment in Light-Dark (LD) cycles and then a release in always-light (LL) environments. The model disentangles numerous factors that have confounded previous experiments. In one instance, the authors assigned different light sensitivities to the different organs (e.g., root tip, hypocotyl, etc.) which unambiguously show that this one element alone - spatially differing sensitivity to light - is sufficient for recapitulating experimentally observed differences in periods and phases between plant organs. The model also recapitulates the spatial waves of gene expression within and between organs that experimentalists reported. At the sub-tissue level, the model-produced waves have similar patterns as the experimentally observed waves. This confirmation further validates the model. By having the cells share clock mRNA, from any clock component genes, showed the same, experimentally observed spatial dynamics. The main conclusion of the study is that regional differences (e.g., between different organs) in light senilities, when combined with cell-to-cell sharing of clock-gene mRNAs, enables a robust, yet flexible, circadian timing under noisy environmental cycles.

      Thank you for your assessment of our work. We plan to make the following revisions based on your feedback.

      **B. Specific points:**

      1.Lines 125-127: "To simulate the variability observed in single cell clock rhythms, we multiplied the level of each mRNA and protein by a time scaling parameter that was randomly selected from a normal distribution." - Why not add a white (Gaussian) noise term to these equations? How does multiplying by a random variable (for rescaling time) different from my proposal? Some explanation should be given in the text here.

      We opted for a time scaling approach as this generates between-cell period differences but avoids within-cell period differences. This is consistent with single cell experiments (S1 Fig; Gould et al., 2018, eLife). We will provide an explanation of this in the text.

      2.Does the spatial network model simplify calculations by assuming separations of timescales (e.g., for equilibration in concentrations of mRNAs that diffuse between cells)? If so, it would be good to spell these out in the beginning of the Results section (where the model is described).

      We agree that a more detailed discussion of the model assumptions would be beneficial and we will provide this in the text.

      3.Lines 161-162: "....in a phase only model by local...." should be "....in a phase model only by local...."

      Thank you for your correction.

      4.Lines 188-190: The authors observed that qualitatively similar/indistinguishable behaviors arose regardless of which elements are varied (e.g., global versus local cell-cell coupling, setting light input to be equal in all regions of the seedling, etc.). Then they claim here that "...these results show that the assumptions of local cell-to-cell coupling and differential light sensitivity between regions are the key aspects of our model that allow a match to experimental data." - I don't see how this follows from the observation almost any of the variations lead to the same behaviors in this section (spatial waves). Show the reasoning in the text here.

      We observed spatial waves with different local coupling regimes (4 v. 8 nearest neighbours). However, we did not observe spatial waves with global coupling (S10 Fig). This led us to conclude that local coupling is a key aspect. In addition, we do not observe waves when setting the light input to be equal in all regions of the seedling (S11 Fig). This confirms that local differences in light sensitivity are also required in our simulations to generate spatial waves. We will clarify these points with revisions to the text.

      5.Pgs. 9-10: Section on "Cell-to-cell coupling maintains global coordination under noisy light-dark cycles": The simulation results rigorously support the authors' main conclusion here, which is that local cell-to-cell coupling allows for global coordination under noisy LD cycles. But I'm missing an intuitive explanation (or just any explanation) for why this is. At the end of this section, the authors should provide some intuition or qualitative explanation for the observations that they produced using their model in this section.

      We will revise the text to provide an intuitive explanation of these results. The coupling decreases the within-region phase differences. Despite the between-regions phase differences persisting, this effect is sufficient to improve the overall global synchrony.

      6.Lines 261-262: Replace the present tenses with past tenses.

      Thank you for your correction.

      7.Is the main idea that cell-to-cell coupling allows for averaging of fluctuations, between organs or cells within the same organ, while allowing for coordination of the average quantities? Is this responsible for both the flexibility and robustness observed under noisy environmental cycles?

      The cell-to-cell-coupling allows for the averaging of fluctuations between cells and the regional flexibility arises from the different light sensitivities in each region. What was interesting to us was that under light-dark cycles the regional flexibility was not lost due to either the noise in the light or the averaging effect of the cell-to-cell coupling. We will revise the text to emphasize these points. Thank you for your prompts.

      8.Line 304: Is it really true that the mammalian circadian rhythm is centralized? Don't some parts of our bodies have different circadian clock (e.g., slight differences in phase) than some other parts of our bodies?

      There are indeed some small phase differences between parts of our bodies because the mammalian system, like the plant system, is imperfectly coupled. However, the mammalian system is considered more centralized because the suprachiasmatic nucleus in the brain receives the key entraining signal of light and then coordinates rhythms across the body (Bell-Pedersen et al., 2005, Nat Rev Gen; Brown & Azzi, 2013, Circadian Clocks). We will expand on these interesting points by adding a paragraph to the discussion.

      Reviewer #1 (Significance):

      **Overall assessment:**

      I enthusiastically recommend this work for publication after the authors address my comments below (please see "Specific points").

      The model's main strength is that the authors could vary each ingredient separately - light sensitivity of each cell/organ, which gene's mRNA diffuses between cells, cellular noise, local versus global cell-cell coupling, etc. Afterwards, the authors could determine which of these variations produces which experimentally observed behaviors. Another strength of the model is that it can reproduce not just one, but numerous, experimentally observed behaviors that are important for understanding circadian clocks in plants. Thus, the model is grounded in experimental truth and produces experimentally observed results. Crucially, since the authors could vary every single element in the model independently of the other elements, the authors are able to provide plausible explanations for why the experiments produced the results that they did (experimentally, a number of confounding factors prevented one from pinpointing to which element produced which observation).

      Another strength of the model is also extendable, by other researchers to investigate other plant physiologies in the future (e.g., circadian clock's influence on cell division). The authors highlight these future uses in the discussion section. Therefore, I believe that this work will be valuable to plant biologists, non-plant biologists who are interested in circadian clocks, and systems biologists in general.

      The manuscript is also well written and relatively easy to follow, even for non-plant biologists like myself.

      Thank you for the positive feedback - we are pleased that you find the manuscript of broad interest to a range of readers.

      Comment on Reviewer #2:

      I agree with his/her major criticism #3 (ELF4 long-distance movement). I find this to be a reasonable request. Fulfilling it would increase the paper's impact.

      Please see our response to reviewer #2.

      Comment on Reviewer #3:

      The reviewer's point (1) asks for a reasonable request.

      Regarding his/her point (2): This is also reasonable. I'd recommend his/her suggestion (a). In the end, I'd be interested to see how the authors respond to this (what function they choose to let adjacent cells be subjected to some correlated light-input intensity. I'd be happy with something simple such as + noise, where is a deterministic term that, for example, decreases exponentially as one moves away from some central cell. Basically, I'd let the authors decide how to implement this and accept their current implementation - no correlation in light-intensity between adjacent cells - as an extreme scenario, as this reviewer points out.

      Please see our response to reviewer #3.

      Reviewer #2 (Evidence, reproducibility and clarity):

      **Summary:**

      The manuscript presents an improved model of the circadian clock network that accounts for tissue-specific clock behavior, spatial differences in light sensitivity, and local coupling achieved through intercellular sharing of mRNA. In contrast to whole-plant or "phase-only" models, the authors' approach enables them to address the mechanism behind coupling and how the clock maintains regional synchrony in a noisy environment. Using 34 parameters to describe clock activity and applying the properties mentioned above, the authors demonstrate that their model can recapitulate the spatial waves in circadian gene expression observed and can simulate how the plant maintains local synchrony with regional differences in rhythms under noisy LD cycles. Spatial models that incorporate cell-type-specific sensitivities to environmental inputs and local coupling mechanisms will be most accurate for simulating clock activity under natural environments.

      Thank you for your assessment of our work. We plan to make the following revisions based on your feedback.

      *We have the following **major criticisms** as follows*

      1) When assigning light sensitivities in different regions of the plant, the authors assign a higher sensitivity value to the root tip (L=1.03) than they do to the other part of the root (L=0.90). We are curious why the root tip would have higher light sensitivity than the rest of the root. Is this based on experimental data (if so, please cite in this section or methods)? It seems that these L values were assigned simply to make sure they recapitulated the period differences observed in Fig. 2A. Are these values based on PhyB expression in those organs? Or perhaps based on cell density in those locations?

      We assign the light sensitivity to match observed experimental period differences across the plant (Fig 2A,B). This is based on previous experiments demonstrating that experimental period differences are dependent on light input through the light sensing gene PHYB (Greenwood et al., 2019, PLoS Bio; Nimmo et al., 2020, Physiologia Plantarum). For example, in WT seedlings, the root tip oscillates faster than the root, but this difference is lost in the phyb-9 mutant (Greenwood et al., 2019). Thus, we assume the root tip to be more sensitive to light than the roots.

      Further supporting this assumption, there is evidence that expression of phytochromes and cryptochromes are increased in the root tip relative to the root (e.g., Somers & Quail, 1995, Plant J; Bognar et al., 1999, PNAS; Toth et al., 2001, Plant Physiol), as the reviewer proposes. However, further experiments would be needed to verify that these differences in expression are what lead to the differences in clock timing. We will add a discussion of these experiments to the text.

      2) In the discussion of the test where they set the "light inputs to be equal" in all regions to simulate the phyb-9 mutant, could the authors please clarify whether that means they set the L light sensitivity value equal in all regions?

      This is indeed what we mean, we will rephrase the text for clarity.

      a. If they are referring to setting the L value equal to all regions, we suggest that this discussion be moved to the section about different light sensitivities instead of the local sharing of mRNA section.

      Thank you for your suggestion, we agree and will move this discussion.

      b. Additionally, is it possible to set the light sensitivity to zero for all parts of the plant? We think this would be more suitable to simulate the phyb-9 mutant phenotype.

      We thank the reviewer for this suggestion. We will include a simulation with light sensitivity set to zero in the revised manuscript, in addition to the existing simulations with light sensitivity set to 1.

      3) Based on the recent Chen et al. (2020) paper showing ELF4 long-distance movement, we think it would be of great interest for the authors to model ELF4 protein synthesis/translation as the coupling factor, in addition to the modeling using CCA1/LHY mRNA sharing. We understand you may be saving this analysis for a future modeling paper, but this addition to the paper could increase the impact of this paper.

      Thank you for the suggestion to improve our manuscript. We agree it will be of interest to model ELF4 protein as the local coupling factor. In the revision, we will simulate each clock protein (including ELF4) as the local coupling factor and compare.

      In addition, we will also modify the coupling mechanism to simulate the long-distance transport of ELF4 proposed by Chen et al., 2020. Our preliminary simulations show that we can couple shoot rhythms to those in the root tip, but that this long range coupling can not on its own generate the spatial structure observed in experiments. We agree with the reviewers that this analysis and an associated discussion will further increase the impact of the paper.

      4) This model is able to simulate circadian rhythms under 12:12 LD cycles, which represents two days of the year-the equinoxes. We are curious if the model can simulate rhythms under short days and long days as well. We understand this analysis may be outside the scope of this paper and may require changing the values of the 34 parameters used but think it could be a useful addition here or in future work.

      We agree it would be interesting to observe the behavior of the model under different day lengths. We will include simulations under short and long days in the revision.

      *And **minor criticisms** as follows*

      1) In the first paragraph of the results section, it would be helpful for the authors to reference Table S1 when they mention the 34 parameters used to model oscillator function

      We agree and we will implement this helpful suggestion.

      2) In the first paragraph of the section titled "Local flexibility persists under idealized and noisy LD cycles", it would be helpful for the authors to reference S12 Fig after the last sentence that starts "However, ELF4/LUX appeared more synchronized..."

      We agree and we will implement this helpful suggestion.

      3) In the first paragraph of the section titled "Cell-to-cell coupling maintains global communication under noisy light-dark cycles", the authors refer to a "Table 1" but I think they mean to refer to Table S1"

      Thank you, we will implement this helpful suggestion.

      4) In Fig. 1, panel C is described as demonstrating the cell-to-cell coupling through the "level of CCA1/LHY". This phrasing is vague and we think could be improved to the "mRNA level of CCA1/LHY".

      We agree and will implement this helpful suggestion.

      Reviewer #2 (Significance (Required)):

      This work would be broadly interesting to other researchers studying cell-to-cell signaling and coupling of circadian rhythms in plants and other species where spatial waves of gene expression have been observed (i.e., mice and humans). Additionally, the computational modeling aspect of this work was easily interpretable for someone outside this expertise. Our expertise lies in plant circadian biology.

      We thank the reviewer for recognising the broad appeal of our work.

      Reviewer #3 (Evidence, reproducibility and clarity):

      **Summary:**

      The authors start by taking a previously published model of the plant circadian clock and implement five changes: 1) updating the network topology to reflect some recent experimental findings, 2) make a spatial model loosely based on a seedling template 3) introduce coupling between cells based on shared levels of CCA1/LHY 4) randomly rescale time in each cell to induce inter-cell differences in period, 5) include a light sensitivity that depends on the region considered.

      For a certain configuration of light sensitivities/intensities, the different periods of oscillations in each seedling region roughly match that of experiments. With a sufficiently high coupling between cells, the system can also generate spatial waves, which are also observed in the experimental system.

      With pulsed light inputs the spatial pattern is still produced. The authors then investigate the robustness to environmental noise by generating stochastic light signals and show that the global synchrony, as measured with a synchronisation index, increases with cell-to-cell coupling strength. The paper is overall well-written, and the background and details of the analysis are well presented.

      Thank you for your assessment of our work. We plan to make the following revisions based on your feedback.

      **Major comments:**

      For the first part of paper, the output of the model is certainly the focus. There is virtually no discussion of the inferred parameters and how much confidence the authors have in their values.

      Thank you for this point. We will add discussion of the inferred parameters to the initial part of the results.

      My main issue with the paper is about the section with noisy light signals, which is included in the title and is ultimately one of the main themes of the article.

      Specifically, on line 224:

      "This decrease in cell-to-cell variation revealed an underlying spatial structure (Fig 4D, middle and right, and S13 Fig), comparable to that observed under idealized LD cycles (Fig 4B, middle and right, and S12 Fig)."

      Firstly, I don't feel these conclusions match with the data presented. Comparing figure 4D middle and right with figure 4B middle and right shows a clear and pronounced loss in spatial structure. In its current form, this statement has to change, but I believe there are at least two other major issues with this figure:

      We agree there are some differences in the spatial structure between idealized (Fig 4B) and noisy (Fig 4D) LD cycles. Preliminary simulations suggest that this is due to the way the noisy LD cycles are programmed.

      In the current implementation of noisy LD cycles, the maximum intensity of L, L**max, differs between each region, such that relative differences in light sensitivity between regions are maintained. This means that some phase differences between regions are maintained. However, as the reviewer correctly points out in point 1 below, due to the noise fluctuations, the average level of light is lower than under idealized LD cycles, and with considerable day-to-day variation. We believe this is why the spatial structure differs.

      Preliminary simulations suggest that if we normalize the mean light intensity such that the mean is equal between the two conditions (as the reviewer suggests in point 1 below), the spatial structure appears similar. We will present this analysis in the revision.

      1) The figure is clearly designed to invite a comparison between the noise-free light cycles on the left with the noisy cycles on the right. However, due to how the noisy light is simulated, the variance of light signal increases AND the average intensity of light decreases by 50%. When comparing the left and the right, we therefore don't know whether the changes are due to differences in the average signal or differences from the stochasticity. I think the authors should simulate a noisy light signal with the same mean intensity level as the deterministic signal.

      As discussed above, we agree that the average intensity of the light decreases due to the noise, and this complicates interpretation. We will simulate idealized and noisy light cycles with the same mean light level upon revision.

      2) The noise model for the light doesn't seem realistic. On line 484 is says:

      "We made the simplifying assumption that each cell is exposed to an independent noisy LD cycle due to their unique positions in the environment. LD cycles were input to the molecular model through the parameter L".

      In fact, this could be considered as an incredibly complex signal, because for 800 cells it means drawing 800 random light signals. The implication is that two adjacent cells receive statistically independent light signals. Depending on chance, one cell might receive tropical levels of light while its neighbour experiences a cloudy day. This affects the interpretation and conclusions from figures 4 and 5. I propose two different ways of improving the simulation of the noisy light signal:

      a) In one extreme case, all cells receive the same noisy light signal, and the other extreme, they all receive independent signals. You could consider a mixture model of light signals, where each cell receives \lambda L_global(t) + (1-\lambda) L_individual(t), where L_global(t) is a global light signal that is shared by all cells and L_individual(t) is a light signal unique to an individual cell. The mixing parameter \lambda controls how similar the light signal is between cells

      b) Clearly the light signal will differ depending on the region, but there will be some spatial correlation. You could also consider methods of simulating light such that neighbouring cells receive correlated signals, although this might be difficult.

      Thank you for your proposals. We agree that our current implementation of noisy LD cycles represents an extreme scenario. Given that there is no environmental data at sufficient resolution to reliably evaluate which implementation is most realistic, we will explore different approaches based on your suggestions and present them in our revision.

      Assuming that the problem with the mean signal is corrected, do you expect the average spatial pattern to be the same between figure 4 B and D with no coupling (J=0) (although an increase in the variance between cells)? Perhaps not (owing to nonlinearities in the system), but it would be interesting to comment.

      We agree that the decreased light intensity complicates interpretation of the spatial structure. Although in the current implementation relative light differences between regions are maintained, the spatial structure is altered because the mean intensities are lower. Preliminary simulations with the mean intensity fixed do result in spatial patterns more similar to that seen in Fig 4B, but with increased variance. Comprehensive simulations will be included in the revised manuscript.

      The different periods in the different regions of the seedling are caused by differences in light sensitivity, which the authors claim is justified from refs 12-15. An alternative hypothesis is the that biochemical parameters such as degradation rates are different between regions. This is briefly alluded to in the introduction, but I think it would be interesting to discuss further. What would be the pros and cons of the two different mechanisms?

      We agree that an alternative hypothesis is that biochemical parameters such as degradation rates may differ between regions. Experimental evidence, however, more supports the light sensitivity hypothesis. This is because, for example, mutations in light signalling remove the spatial differences between regions. We agree though that this is an important point, and will add a paragraph to the discussion discussing the pros and cons of the two different mechanisms.

      I understand that the authors used a pre-existing model, but I must say that I find the way that light is incorporated into the model a bit confusing.

      On line 345 it says:

      "L(t) represents the input light signal (L = 0, lights off; L > 0, lights on) and D(t) denotes a corresponding darkness input signal (D = 1, lights off; D = 0, lights on)."

      Surely the only thing that matters biophysically is the number of photons hitting the plant? Could you explain why the model needs to have a separate "darkness signal" compared to just a single light signal?

      A darkness signal has been introduced in many circadian clock models because degradation rates of the clock genes can depend upon the light or dark condition. We agree with the reviewer that we should explain this clearer in the text.

      In the model, the light intensity changes depending on the region. It might make more sense for interpretability if instead there is an additional light-sensitivity coefficient that depends on the region, because at the moment I'm not sure what units L(t) is supposed to take.

      Thank you for your suggestion. We will try to implement this approach.

      **Minor comments**

      Could you more explicitly describe a possible molecular mechanism through which the coupling acts?

      Thank you for your suggestion. We will more explicitly discuss likely transport mechanisms in the text.

      In Figure 1C it looks like different genes are coupling to different genes, so you may need to rearrange it.

      In our model, the level of CCA1/LHY is shared. Thus, CCA1/LHY from one cell can be considered to repress the expression of other interacting genes in the neighbour cell.

      Line 103: "We found that regional differences persist even under LD cycles, but cell to-cell minimized differences between neighbor cells." Missing word.

      Thank you for your correction.

      Line 124: "The coupling strength was set to 2 (Methods)." This is meaningless in isolation, so it would be better to briefly explain what the coupling parameter is before mentioning its value.

      Thank you for your suggestion, we will describe the coupling function in more detail.

      Through the text, I think De Caluwe should be corrected to De Caluwé

      Thank you for your correction.

      Typo line 493

      Thank you for your correction.

      Code and data are not made available.

      Model code will be made available from our project GitLab page: https://gitlab.com/slcu/teamJL/greenwood_tokuda_etal_2020

      Output of analysis of experimental data and simulations will also be made available on the GitLab page.

      Reviewer #3 (Significance (Required)):

      The authors motivate the paper by highlighting that their proposed model improves on phase-based models in that it describes underlying molecular mechanisms.

      From an experimental side, it's interesting that a model is developed and directly compared with measured spatio-temporal waves of gene expression. From a theoretical side, the authors address questions relating to oscillations, multi-scale modelling and noise robustness that also generalise to other systems. I therefore expect that both experimental and theoretical audiences will be interested in the results.

      There are many possible additions and modifications that could be made to the model, and so the model and analysis could provide a platform for future research. However, I can't comment on whether there are similar pre-existing models of the plant circadian clock that contain both a molecular description of the circadian clock as well as a spatial scale.

      We appreciate the reviewer’s view that the work is interesting to both experimental and theoretical audiences.

      Comments on Review #1:

      The time is rescaled in each cell, meaning that each cell has a unique period, but the dynamics remain deterministic and hence the peak-to-peak times will be exactly the same for each cell. I imagine this isn't completely consistent with single-cell data (if available), where peak-to-peak times are very likely to be variable due to noisy gene expression. In a future paper it would be interesting to analyse the system using stochastic differential equations.

      Please see our response to reviewer #1.

      Comments on Review #2:

      I agree on the following two points:

      1) It would add value to discuss whether the different ranking of light sensitivities by organ matches any available experimental data.

      Please see our response to reviewer #2.

      2) As the Reviewers point out, there are many possibilities for testing the robustness of the system to light clues, including varying the length of the day. Although outside of the scope of this paper, I wonder if it's possible to find data from a light sensor measuring light intensity across an entire year? Plugging such data into the model and measuring how the amplitude and period changes would be really interesting, in my opinion.

      Thank you for your suggestion. We also see this as an interesting future direction.

    2. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #3

      Evidence, reproducibility and clarity

      Summary:

      The authors start by taking a previously published model of the plant circadian clock and implement five changes: 1) updating the network topology to reflect some recent experimental findings, 2) make a spatial model loosely based on a seedling template 3) introduce coupling between cells based on shared levels of CCA1/LHY 4) randomly rescale time in each cell to induce inter-cell differences in period, 5) include a light sensitivity that depends on the region considered.

      For a certain configuration of light sensitivities/intensities, the different periods of oscillations in each seedling region roughly match that of experiments. With a sufficiently high coupling between cells, the system can also generate spatial waves, which are also observed in the experimental system.

      With pulsed light inputs the spatial pattern is still produced. The authors then investigate the robustness to environmental noise by generating stochastic light signals and show that the global synchrony, as measured with a synchronisation index, increases with cell-to-cell coupling strength. The paper is overall well-written, and the background and details of the analysis are well presented.

      Major comments:

      For the first part of paper, the output of the model is certainly the focus. There is virtually no discussion of the inferred parameters and how much confidence the authors have in their values.

      My main issue with the paper is about the section with noisy light signals, which is included in the title and is ultimately one of the main themes of the article.

      Specifically, on line 224:

      "This decrease in cell-to-cell variation revealed an underlying spatial structure (Fig 4D, middle and right, and S13 Fig), comparable to that observed under idealized LD cycles (Fig 4B, middle and right, and S12 Fig)."

      Firstly, I don't feel these conclusions match with the data presented. Comparing figure 4D middle and right with figure 4B middle and right shows a clear and pronounced loss in spatial structure. In its current form, this statement has to change, but I believe there are at least two other major issues with this figure:

      1) The figure is clearly designed to invite a comparison between the noise-free light cycles on the left with the noisy cycles on the right. However, due to how the noisy light is simulated, the variance of light signal increases AND the average intensity of light decreases by 50%. When comparing the left and the right, we therefore don't know whether the changes are due to differences in the average signal or differences from the stochasticity. I think the authors should simulate a noisy light signal with the same mean intensity level as the deterministic signal. . 2) The noise model for the light doesn't seem realistic. On line 484 is says:

      "We made the simplifying assumption that each cell is exposed to an independent noisy LD cycle due to their unique positions in the environment. LD cycles were input to the molecular model through the parameter L".

      In fact, this could be considered as an incredibly complex signal, because for 800 cells it means drawing 800 random light signals. The implication is that two adjacent cells receive statistically independent light signals. Depending on chance, one cell might receive tropical levels of light while its neighbour experiences a cloudy day. This affects the interpretation and conclusions from figures 4 and 5. I propose two different ways of improving the simulation of the noisy light signal:

      a) In one extreme case, all cells receive the same noisy light signal, and the other extreme, they all receive independent signals. You could consider a mixture model of light signals, where each cell receives \lambda L_global(t) + (1-\lambda) L_individual(t), where L_global(t) is a global light signal that is shared by all cells and L_individual(t) is a light signal unique to an individual cell. The mixing parameter \lambda controls how similar the light signal is between cells

      b) Clearly the light signal will differ depending on the region, but there will be some spatial correlation. You could also consider methods of simulating light such that neighbouring cells receive correlated signals, although this might be difficult.

      Assuming that the problem with the mean signal is corrected, do you expect the average spatial pattern to be the same between figure 4 B and D with no coupling (J=0) (although an increase in the variance between cells)? Perhaps not (owing to nonlinearities in the system), but it would be interesting to comment.

      The different periods in the different regions of the seedling are caused by differences in light sensitivity, which the authors claim is justified from refs 12-15. An alternative hypothesis is the that biochemical parameters such as degradation rates are different between regions. This is briefly alluded to in the introduction, but I think it would be interesting to discuss further. What would be the pros and cons of the two different mechanisms?

      I understand that the authors used a pre-existing model, but I must say that I find the way that light is incorporated into the model a bit confusing.

      On line 345 it says: "L(t) represents the input light signal (L = 0, lights off; L > 0, lights on) and D(t) denotes a corresponding darkness input signal (D = 1, lights off; D = 0, lights on)."

      Surely the only thing that matters biophysically is the number of photons hitting the plant? Could you explain why the model needs to have a separate "darkness signal" compared to just a single light signal?

      In the model, the light intensity changes depending on the region. It might make more sense for interpretability if instead there is an additional light-sensitivity coefficient that depends on the region, because at the moment I'm not sure what units L(t) is supposed to take.

      Minor comments

      Could you more explicitly describe a possible molecular mechanism through which the coupling acts?

      In Figure 1C it looks like different genes are coupling to different genes, so you may need to rearrange it.

      Line 103: "We found that regional differences persist even under LD cycles, but cell to-cell minimized differences between neighbor cells." Missing word.

      Line 124: "The coupling strength was set to 2 (Methods)." This is meaningless in isolation, so it would be better to briefly explain what the coupling parameter is before mentioning its value.

      Through the text, I think De Caluwe should be corrected to De Caluwé

      Typo line 493

      Code and data are not made available.

      Significance

      The authors motivate the paper by highlighting that their proposed model improves on phase-based models in that it describes underlying molecular mechanisms.

      From an experimental side, it's interesting that a model is developed and directly compared with measured spatio-temporal waves of gene expression. From a theoretical side, the authors address questions relating to oscillations, multi-scale modelling and noise robustness that also generalise to other systems. I therefore expect that both experimental and theoretical audiences will be interested in the results.

      There are many possible additions and modifications that could be made to the model, and so the model and analysis could provide a platform for future research. However, I can't comment on whether there are similar pre-existing models of the plant circadian clock that contain both a molecular description of the circadian clock as well as a spatial scale.

      REFEREE'S CROSS-COMMENTING

      Comments on Review #1:

      The time is rescaled in each cell, meaning that each cell has a unique period, but the dynamics remain deterministic and hence the peak-to-peak times will be exactly the same for each cell. I imagine this isn't completely consistent with single-cell data (if available), where peak-to-peak times are very likely to be variable due to noisy gene expression. In a future paper it would be interesting to analyse the system using stochastic differential equations.

      Comments on Review #2:

      I agree on the following two points:

      1) It would add value to discuss whether the different ranking of light sensitivities by organ matches any available experimental data.

      2) As the Reviewers point out, there are many possibilities for testing the robustness of the system to light clues, including varying the length of the day. Although outside of the scope of this paper, I wonder if it's possible to find data from a light sensor measuring light intensity across an entire year? Plugging such data into the model and measuring how the amplitude and period changes would be really interesting, in my opinion.

    3. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #2

      Evidence, reproducibility and clarity

      Summary:

      The manuscript presents an improved model of the circadian clock network that accounts for tissue-specific clock behavior, spatial differences in light sensitivity, and local coupling achieved through intercellular sharing of mRNA. In contrast to whole-plant or "phase-only" models, the authors' approach enables them to address the mechanism behind coupling and how the clock maintains regional synchrony in a noisy environment. Using 34 parameters to describe clock activity and applying the properties mentioned above, the authors demonstrate that their model can recapitulate the spatial waves in circadian gene expression observed and can simulate how the plant maintains local synchrony with regional differences in rhythms under noisy LD cycles. Spatial models that incorporate cell-type-specific sensitivities to environmental inputs and local coupling mechanisms will be most accurate for simulating clock activity under natural environments.

      We have the following major criticisms as follows

      1) When assigning light sensitivities in different regions of the plant, the authors assign a higher sensitivity value to the root tip (L=1.03) than they do to the other part of the root (L=0.90). We are curious why the root tip would have higher light sensitivity than the rest of the root. Is this based on experimental data (if so, please cite in this section or methods)? It seems that these L values were assigned simply to make sure they recapitulated the period differences observed in Fig. 2A. Are these values based on PhyB expression in those organs? Or perhaps based on cell density in those locations?

      2) In the discussion of the test where they set the "light inputs to be equal" in all regions to simulate the phyb-9 mutant, could the authors please clarify whether that means they set the L light sensitivity value equal in all regions? a. If they are referring to setting the L value equal to all regions, we suggest that this discussion be moved to the section about different light sensitivities instead of the local sharing of mRNA section. b. Additionally, is it possible to set the light sensitivity to zero for all parts of the plant? We think this would be more suitable to simulate the phyb-9 mutant phenotype.

      3) Based on the recent Chen et al. (2020) paper showing ELF4 long-distance movement, we think it would be of great interest for the authors to model ELF4 protein synthesis/translation as the coupling factor, in addition to the modeling using CCA1/LHY mRNA sharing. We understand you may be saving this analysis for a future modeling paper, but this addition to the paper could increase the impact of this paper.

      4) This model is able to simulate circadian rhythms under 12:12 LD cycles, which represents two days of the year-the equinoxes. We are curious if the model can simulate rhythms under short days and long days as well. We understand this analysis may be outside the scope of this paper and may require changing the values of the 34 parameters used but think it could be a useful addition here or in future work.

      And minor criticisms as follows

      1) In the first paragraph of the results section, it would be helpful for the authors to reference Table S1 when they mention the 34 parameters used to model oscillator function

      2) In the first paragraph of the section titled "Local flexibility persists under idealized and noisy LD cycles", it would be helpful for the authors to reference S12 Fig after the last sentence that starts "However, ELF4/LUX appeared more synchronized..."

      3) In the first paragraph of the section titled "Cell-to-cell coupling maintains global communication under noisy light-dark cycles", the authors refer to a "Table 1" but I think they mean to refer to Table S1"

      4) In Fig. 1, panel C is described as demonstrating the cell-to-cell coupling through the "level of CCA1/LHY". This phrasing is vague and we think could be improved to the "mRNA level of CCA1/LHY".

      Significance

      This work would be broadly interesting to other researchers studying cell-to-cell signaling and coupling of circadian rhythms in plants and other species where spatial waves of gene expression have been observed (i.e., mice and humans). Additionally, the computational modeling aspect of this work was easily interpretable for someone outside this expertise. Our expertise lies in plant circadian biology.

    4. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #1

      Evidence, reproducibility and clarity

      A. Summary:

      In this modeling study, the authors devised a multicellular model to investigate how circadian clocks in different parts (organs) of plants coordinate their timing. The model uses a plausible mechanism to explain how having a different sensitivity to light leads to different phase and period of circadian clock, which is observed in different plant organs. The model allows for entrainment in Light-Dark (LD) cycles and then a release in always-light (LL) environments. The model disentangles numerous factors that have confounded previous experiments. In one instance, the authors assigned different light sensitivities to the different organs (e.g., root tip, hypocotyl, etc.) which unambiguously show that this one element alone - spatially differing sensitivity to light - is sufficient for recapitulating experimentally observed differences in periods and phases between plant organs. The model also recapitulates the spatial waves of gene expression within and between organs that experimentalists reported. At the sub-tissue level, the model-produced waves have similar patterns as the experimentally observed waves. This confirmation further validates the model. By having the cells share clock mRNA, from any clock component genes, showed the same, experimentally observed spatial dynamics. The main conclusion of the study is that regional differences (e.g., between different organs) in light senilities, when combined with cell-to-cell sharing of clock-gene mRNAs, enables a robust, yet flexible, circadian timing under noisy environmental cycles.

      B. Specific points:

      1.Lines 125-127: "To simulate the variability observed in single cell clock rhythms, we multiplied the level of each mRNA and protein by a time scaling parameter that was randomly selected from a normal distribution." - Why not add a white (Gaussian) noise term to these equations? How does multiplying by a random variable (for rescaling time) different from my proposal? Some explanation should be given in the text here.

      2.Does the spatial network model simplify calculations by assuming separations of timescales (e.g., for equilibration in concentrations of mRNAs that diffuse between cells)? If so, it would be good to spell these out in the beginning of the Results section (where the model is described).

      3.Lines 161-162: "....in a phase only model by local...." should be "....in a phase model only by local...."

      4.Lines 188-190: The authors observed that qualitatively similar/indistinguishable behaviors arose regardless of which elements are varied (e.g., global versus local cell-cell coupling, setting light input to be equal in all regions of the seedling, etc.). Then they claim here that "...these results show that the assumptions of local cell-to-cell coupling and differential light sensitivity between regions are the key aspects of our model that allow a match to experimental data." - I don't see how this follows from the observation almost any of the variations lead to the same behaviors in this section (spatial waves). Show the reasoning in the text here.

      5.Pgs. 9 -10: Section on "Cell-to-cell coupling maintains global coordination under noisy light-dark cycles": The simulation results rigorously support the authors' main conclusion here, which is that local cell-to-cell coupling allows for global coordination under noisy LD cycles. But I'm missing an intuitive explanation (or just any explanation) for why this is. At the end of this section, the authors should provide some intuition or qualitative explanation for the observations that they produced using their model in this section.

      6.Lines 261-262: Replace the present tenses with past tenses.

      7.Is the main idea that cell-to-cell coupling allows for averaging of fluctuations, between organs or cells within the same organ, while allowing for coordination of the average quantities? Is this responsible for both the flexibility and robustness observed under noisy environmental cycles?

      8.Line 304: Is it really true that the mammalian circadian rhythm is centralized? Don't some parts of our bodies have different circadian clock (e.g., slight differences in phase) than some other parts of our bodies?

      Significance

      Overall assessment:

      I enthusiastically recommend this work for publication after the authors address my comments below (please see "Specific points").

      The model's main strength is that the authors could vary each ingredient separately - light sensitivity of each cell/organ, which gene's mRNA diffuses between cells, cellular noise, local versus global cell-cell coupling, etc. Afterwards, the authors could determine which of these variations produces which experimentally observed behaviors. Another strength of the model is that it can reproduce not just one, but numerous, experimentally observed behaviors that are important for understanding circadian clocks in plants. Thus, the model is grounded in experimental truth and produces experimentally observed results. Crucially, since the authors could vary every single element in the model independently of the other elements, the authors are able to provide plausible explanations for why the experiments produced the results that they did (experimentally, a number of confounding factors prevented one from pinpointing to which element produced which observation).

      Another strength of the model is also extendable, by other researchers to investigate other plant physiologies in the future (e.g., circadian clock's influence on cell division). The authors highlight these future uses in the discussion section. Therefore, I believe that this work will be valuable to plant biologists, non-plant biologists who are interested in circadian clocks, and systems biologists in general.

      The manuscript is also well written and relatively easy to follow, even for non-plant biologists like myself.

      REFEREE'S CROSS-COMMENTING

      Comment on Reviewer #2:

      I agree with his/her major criticism #3 (ELF4 long-distance movement). I find this to be a reasonable request. Fulfilling it would increase the paper's impact.

      Comment on Reviewer #3:

      The reviewer's point (1) asks for a reasonable request. Regarding his/her point (2): This is also reasonable. I'd recommend his/her suggestion (a). In the end, I'd be interested to see how the authors respond to this (what function they choose to let adjacent cells be subjected to some correlated light-input intensity. I'd be happy with something simple such as < intensity > + noise, where <intensity> is a deterministic term that, for example, decreases exponentially as one moves away from some central cell. Basically, I'd let the authors decide how to implement this and accept their current implementation - no correlation in light-intensity between adjacent cells - as an extreme scenario, as this reviewer points out.

    1. Reviewer #3:

      I found the question, approach and analysis provide a clever framework for understanding how vigilance changes over time. I believe this work will contribute greatly to the literature. However, I have one main concern in the interpretation of the patterns of results and the a priori assumptions that are made, but never explicitly discussed or justified.

      The introduction makes it clear that the authors acknowledge that there may be multiple sources of interference contributing to declining vigilance over time: the encoding of sensory information, appropriate responses to the stimuli, or a combination of both. In the introduction, it would help if the authors review how infrequent targets affect response patterns.

      In addition, it would help if the theoretical approach and assumptions of the authors were explicitly stated. On p. 23, lines 481-483: The connectivity analysis between the frontal and occipital areas as a way to get at the effect of vigilance is useful, but some consideration of the theoretical justification for this analysis should be added here. The a priori assumption surrounding this analysis should be acknowledged and discussed in the interpretation of the pattern of results (e.g., p. 32, line 658). Based on the analysis between frontal and occipital areas, we have to assume it's the sensory processing alone, but this does not preclude other influences. For instance, effects could also occur on response patterns. These considerations should be added as caveats to the interpretation and to avoid the impression of a confirmation bias.

    2. Reviewer #2:

      In the manuscript "Neural signatures of vigilance decrements predict behavioural errors before they occur", Karimi-Rouzbahani and colleagues present a study which used a multiple-object monitoring task in combination with magnetoencephalography (MEG) recordings in humans to investigate the neural coding and decoding-based connectivity of vigilance decrements. They found that increasing the rarity of targets led to weaker decoding accuracy for the crucial feature (distance to an object), and weaker decoding was also found for misses compared to correct responses. They also report a drop in decoding-based connectivity between frontal and occipital/parietal regions of interest for misses, and they could predict upcoming performance errors early during a trial based on accumulative decoding accuracy for the relevant target feature.

      This is an interesting study with a quite complex paradigm and a very interesting analysis approach. However, the logic of the approach and the results are rather difficult to unpack, and I am not convinced that it is always correct. My main issues are: Firstly, it is not clear what role eye fixations play here. Participants could freely scan the display, so the retinotopic representations would change depending on where the participants fixate, but at the same time the authors claim that eye position did not matter. Secondly, the display of the results is very dense, and it is not always clear whether decoding for a specific variable was above chance or not. The authors often focused on relative differences, making it difficult to fully understand the meaning of the full pattern of results. Thirdly, the connectivity analysis appears to be a correlation of decoding results between two regions of interest. The more parsimonious interpretation here is that information might have been represented across all channels at this time. Lastly, while this is methodologically interesting work, there is no convincing case made for what exactly the contribution of this study is for theories of vigilance. It seems that the findings can be reduced to that a lack of decodability of relevant target features from brain activity predicts that participants will miss the target. I have outlined my specific comments below.

      1) Methods, Page 11: The authors state that "We did not perform eye-blink artefact removal because it has been shown that blink artefacts are successfully ignored by multivariate classifiers as long as they are not systematically different between decoded conditions (Grootswagers et al., 2017)." I actually doubt that this is really true. Firstly, the cited paper makes a theoretical argument rather than showing this empirically. Secondly, even if this were true, the frequency of eye-related artefacts seems to be of crucial importance for a paradigm that involves moving stimuli (and no fixation). There could indeed be systematic differences between conditions that are then picked up by the classifier (i.e. if more eye-blinks are related to tiredness and in turn decreased vigilance). The authors should show that their results replicate if standard artefact removal is performed on the data.

      2) Relatedly, on page 16 the authors claim that "If the prediction from the MEG decoding was stronger than that of the eye tracking, it would mean that there was information in the neural signal over and above any artefact associated with eye movement." In my view, this statement is problematic: Firstly, such a result might only mean that prediction from MEG decoding is stronger than decoding from eye-movements, but not relate to "artefacts" in general, to which blinks would also count. Secondly, given that the signal underlying both analyses is entirely different (and the number of features), it is not valid to directly compare the results between these analyses.

      3) Results: The Bayes-factor plots in the decoding results figures are so cramped that it is very difficult to actually see the individual dots and to unpack all of this (e.g., Fig 3). I'm wondering whether this complexity could be somehow reduced, maybe by dividing the panels into separate figures? The two top panels in Figure 3B should also include the chance level as in A. It looks like the accuracy is very low for unattended trials, which is only true in comparison to attended trials, but (as also shown in Supplementary Figure 1) it was clearly also encoded in unattended trials, which is very important for interpreting the results.

      4) The section on informational brain connectivity already contains a fair bit of interpretation and discussion in relation to the literature (e.g., "Weaker connectivity between occipital and frontal areas could have led to the behavioural misses observed in this study [...]"). This should be avoided.

      5) Relatedly, if I understand the informational brain connectivity analysis correctly, the authors only show that frontal and occipital/parietal patterns of decoding results are correlated? This means, if one "region" allows for decoding the distance to the object, the other one does too. However, this alone does not equal connectivity. It could simply mean that patterns across the entire brain allow for decoding the same information. For example, it would not be surprising to find that both ROIs correlate more strongly for correct trials (i.e. the brain has obviously represented the relevant information) than for errors (i.e. the brain has failed to represent the information), without this necessarily being related to connectivity at all. The information might simply be spread-out across all channels. The authors show no evidence that only these two (arbitrarily selected) "regions" encode the information while others do not. In my view, to show evidence for meaningful connectivity, a) the spread of information should be limited to small sub-regions, and b) the decoding results in one "region" should predict the results in another region in time (as for DCM).

      6) Predicting miss trials: The implicit assumption here is that there is "less representation" for miss trials compared to correct trials (e.g., of distance to object). But even for miss trials, the representation is significantly above chance. However, maybe the lower accuracy for the miss trials resulted from on average more trials in which the target was not represented at all rather than a weaker representation across all trials. This would call into questions the interpretation of a decline in coding. In other words, on a single trial, a representation might only be present (but could result in a miss for other reasons) or not present (which would be the case for many miss trials), and the lower averages for misses would then be the result of more trials in which the information was completely absent.

      7) Having said that, I am wondering whether the results of the subsequent analysis (predicting misses and correct responses before they occur) might be in conflict with my more pessimistic interpretation. If I understand this correctly, here the classifier predicts Distance to Object for each individual trial, and Fig 6B shows that while there is a clear difference between the correct and miss trials, the latter can still be predicted above chance level but never exceed the threshold? If this is true for all single trials, this would indeed speak for a weak but "unused" representation on miss trials. But for this the authors need to show how many of the miss trials per participant had a chance-level accuracy (i.e. might be truly unrepresented), and how many were above chance but did not exceed the threshold (i.e. might have been "less represented").

      8) In general, it is not clear to me how the brain decoding results were impacted by participants freely looking around on the screen. I am not convinced that decoding from the strongly reduced feature space of eye movements necessarily gives an answer. More detailed analyses of fixations and fixation duration on targets and distractors might indeed be strongly related to behaviour. What is decodable at a given time might just be driven by what participants are looking at.

      9) Discussion: The authors discuss their connectivity results in relation to previous studies on connectivity changes in mind wandering. However, given that the connectivity analysis here is questionable, I'm not sure these results can be meaningfully related.

      10) Overall, even if the issues above are addressed, the study only demonstrates that with less attention to the target, there is less evidence of representations of the relevant features of targets in the brain. The authors also find the expected decrements for rare targets and when participants do not actively monitor the targets. While this is interesting, in particular to directly show this in neural representations, I am not sure whether this is also a conceptually novel contribution to the field. It seems that these general effects are quite well-known from previous work (although demonstrated with different methods)? I am not sure how these findings actually contribute to "theories of vigilance", as claimed by the authors.

    3. Reviewer #1:

      Karimi-Rouzbahani and colleagues investigate vigilance and sustained monitoring, using a complex and intriguing task in which participants attend to multiple colored dots moving towards the center and occasionally make. They use computationally sophisticated multivariate analyses of MEG data to disentangle attentional factors in this task. The authors demonstrate that they can decode spatial location of the dot (left vs. right) as well as the spatial distance from the critical deflection location, and relate the multivariate decoding ability to features of the task. In addition, they develop methods that can predict errors by accumulating information from distance-based classifiers in the time window preceding behavioral responses. While I was intrigued by this paper, I had numerous questions about the details of their multivariate pattern analyses and the conclusions that they drew from them.

      1) One key finding was that while classifying the direction of the dots was modulated by attention, it was insensitive to many features that were captured by a classifier trained to decode the distance from the deflection. In some ways, I find this very surprising because both are spatial features that seem hard to separate. In addition, the procedures to decode direction vs distance were very different. Therefore, I wonder if there would still be a lack of an effect if the procedure used to train the direction classifier was more analogous or matched?

      2) The distance classifier was trained using only correct trials. Then in the testing stage, it was generalized to either correct or miss trials. While I understand the rationale for using correct trials, I wonder if decoding of error prediction is an artifact of the training sample, reflecting the fact that misses were not included in the training set?

      3) By accumulating classifiers across time, it looks like classifier prediction improves closer to deflection. However, this could also be due to the fact that the total amount of information provided to the classifier increased. I understand the rationale that additional information improves classification, but I wonder if that is because classifiers are relatively poor at distinguishing adjacent distances? Alternatively, perhaps there is a way to control for the total amount of information at different timepoints (e.g., by using a trailing window lag rather than accumulation), or contrast the classifier that derives from accumulating information with the classifier trained moment-by-moment?

      4) The relationship between the vigilance decrement and error prediction. Is vigilance decrement driving the error prediction? That is, if errors increase later on, and the signal goes down, then maybe the classifier is worse. Alternatively, maybe the classifier predictions do not necessarily monotonically decrease throughout the experiment. I wonder if the classifier is equally successful at predicting errors early and late?

      5) When decoding of distance, one thing I found intriguing is that active decoding declines from early to late, even though performance does not decline (or even slightly improves from early to late). This discrepancy seems hard to explain. Is this decline in classification driven by differences in the total signal from early to late?

      6) I noted that classifier performance was extremely high almost immediately after trial onset. Does the classifier perform at chance before the trial onset, or does this reflect sustained but not stimulus-specific information?

    4. Preprint Review

      This preprint was reviewed using eLife’s Preprint Review service, which provides public peer reviews of manuscripts posted on bioRxiv for the benefit of the authors, readers, potential readers, and others interested in our assessment of the work. This review applies only to version 4 of the manuscript.

      This manuscript is under revision at eLife.

      Summary:

      Karimi-Rouzbahani and colleagues investigate vigilance and sustained monitoring, using a multiple-object monitoring task in combination with magnetoencephalography (MEG) recordings in humans to investigate the neural coding and decoding-based connectivity of vigilance decrements. Using computationally sophisticated multivariate analyses of the MEG data, they found that increasing the rarity of targets led to weaker decoding accuracy for the crucial feature (distance to an object), and weaker decoding was also found for misses compared to correct responses.

    1. Note: This rebuttal was posted by the corresponding author to Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Reply to the reviewers

      Reviewer #1 (Evidence, reproducibility and clarity (Required)):

      The authors generated and analyzed a great amount of single-cell RNA FISH data over time on circadian genes (Nr1d1, Cry1, Bmal1), and performed model selection/fitting to explain the observed mRNA distributions. They decomposed the mRNA variability into distinct sources, and showed that intrinsic noise (transcription burst) dominates the variance. Therefore, looking at transcript counts may not be feasible to estimate single-cell circadian phase. However, the study is quite descriptive and ends up being a bit dissatisfying, so if the authors could improve this aspect by perhaps analyzing a mechanism on cell-specific burst size (F5), gene-specific dependence on cell size (beta), or the positive/negative gene-pair correlations (rho), it would help quite a bit in this regard. The model selection/fitting itself was not really sufficient to compensate for this, as it stands .

      We thank the reviewer for appreciating the new smFISH data, the analyses performed, and the consequences regarding phase inference from single cell snapshots.

      The reviewer suggests “perhaps analyzing a mechanism on cell-specific burst size (F5), gene-specific dependence on cell size (beta), or the positive/negative gene-pair correlations (rho)”, and we have thus added a new Results paragraph (lines 281-316) and two new Supp Figures 13 and 14 to directly address this point.

      Specifically, we have added a dynamic, stochastic model of the circadian clock in order to add mechanistic insight into the parameters of the preferred model M4. Concerning \rho, in the initial manuscript we suggested that the correlations of cell-specific burst sizes (described by the parameter \rho) in the preferred model M4 could result from the underlying network topology. To substantiate this claim, we have now added an analysis of a stochastic model of the clock that includes gene-gene interaction amongst the core-clock genes. The core-clock network involves variables (such as protein levels), parameters (such as mRNA/ protein half-lives) and additional genes (such as Clock) that are not directly measurable in our experiments; and thus offering a detailed mechanistic mathematical model for our data is therefore not realistic. We therefore developed a simplified mathematical model for the three measured genes to explore the underlying mechanisms that could control the parameter \rho, as the referee suggests. As a starting point, we used the circadian clock gene network topology for Nr1d1, Cry1 and Bmal1 as modelled in Relógio et al. (Relógio et al., 2011) (see new Supplementary Material). To keep the model close to the inference framework, we used oscillatory functions for the burst frequency while the transcription rate (and hence the burst size) for each gene is affected by the protein levels of the other genes in the network. Using stochastic simulations we show that, for particular configurations of feedback where the negative repression of Nr1d1 by CRY1 is high, the network can generate positive mRNA correlation between Bmal1/Cry1 mRNA and negative correlation between Nr1d1/Cry1mRNA, as observed in our data (Figure 2C). Furthermore, using the same inference framework as for our data on the simulated mRNA distributions, the obtained \rho is positive for Bmal1/Cry1 and negative for Nr1d1/Cry1, which was also found for our data (Figure 3C). Even though the model is clearly a simplified representation of the clock, these simulations give credence to the scenario that the \rho parameter obtained from the data is a signature of the underlying network topology.

      While the emphasis of the paper is certainly on parameter inference of the single-cell RNA FISH data, we believe the addition of this dynamic model provides more mechanistic insight into the results of the model fitting and hence significantly more depth to the article.

      \*Specific comments:** *

      1.It is hard to distinguish the RNA FISH signals (Figure 1A, 2B). It is probably technically challenging as the mRNAs are of low abundance. I think it may help if they adjust the contrast for the cytoplasm stain or just delineate the cell boundaries.

      Thank you for pointing this out, and we agree that our rendering of the FISH images was not optimal and have now significantly improved it (see new Figure 1A and 2B). Considering the other reviewers’ comments related to the images, we have now 1) added the cell contours as requested; 2) use red/green for the smFISH signal in the pairs of genes; 3) we have improved the contrast to make it easier to distinguish the RNA FISH signals.

      2.In Figure 2C, the authors showed gene-pair correlations with cells of all sizes. Could the authors do a size-dependent extrinsic-noise filtering (Padovan-Merhar, Dev. Cell, 2015; Hansen et al., 2018, Cell Systems) to better dissect the correlations?

      We used negative binomial distributions to directly model the number of mRNA in the cells, which is a natural choice given that the raw smFISH are integer counts. The model incorporates cell size dependencies in a unified framework, which predicts the joint distribution of raw counts, which is why we showed raw counts in the main figure. That being said, as the referee suggests, it can be useful for exploratory purposes to see the relationship between the measured genes while regressing out the contribution of cell area, and we have now added this analysis as Supp Figure 9. On line 156-161 we write:

      “To also estimate the correlation between genes while accounting for cell area, we regressed out the area for each gene and recalculated the correlation coefficients [37,38]. Since all genes are positively correlated with area (Fig. 2A), this processing shifted the correlations for both pairs of genes. Specifically, the correlation coefficients for the area-filtered mRNA counts decreased but remained positive for Bmal1/Cry1 and became more negative for Nr1d1/Cry1(Supp Figure 9).”

      3.For fitting model M3, as the authors pointed out, there are many local minima. Is the fitting score truly sufficient to eliminate the possibility for partial synchrony especially considering that the authors didn't show how effective the Dex treatment was to synchronize the circadian phase?

      Thank you for this comment. In fact, we didn't mean to fully eliminate the possibility of imperfect synchronization, but have tried our best to address it both experimentally and with modeling.

      Experimentally, in addition to the Dex treatment, we also compared with a condition in which we entrained the cells using temperature cycles, which is a standard in the field to achieve the best synchronization. We obtained a fold change of 2.1, which was in the range of previous studies (Saini, et al, 2012) and was slightly higher than with Dex synchronisation (1.6). Given that the improvement was not high and that it was important for us to study the system under free-running conditions and not in an entrained state (i.e. phase locking, which distorts the free dynamics and noise characteristics of the oscillator), we used the Dex protocol.

      Model 3 was used as a computational approach to correct for the individual phases. In addition to the difficult optimisation landscape, the challenge with model M3 also resides in the difficulty of estimating an individual phase for each cell, as the two mRNA counts measured in each cell do not contain sufficient phase information. This could potentially be resolved by either measuring more genes simultaneously, but is, however, beyond the scope of the present manuscript. We have added discussion on this to the text on lines 244-248:

      “Thus, it was apparently difficult to use model M3 to correct the individual phase for each cell, likely due to the fact that the two mRNA counts measured in each cell do not contain sufficient phase information, and that the global optimisation problem contains many local minima. This could potentially be improved by measuring more genes simultaneously.”

      We have also added a new Results section (lines 305-316) and Supp Figure 14 to show that imperfect synchrony alone cannot explain the correlation structure observed in our data. Indeed, if two genes have a similarly phased oscillation, the expression of the two genes will be positively correlated (as shown in the new Supp Figure 14). Similarly, when the oscillations are in anti-phase, negative correlations will be found. Given that Nr1d1 and Cry1 are closer in phase than Bmal1 and Cry1, one would expect that the correlation between Nr1d1 and Cry1 (once accounting for area) would be more positive than for Bmal1 and Cry1, which was not found in the data (area-corrected correlations shown in Supp Figure 9). It therefore seems unlikely that the observed correlations could be caused by imperfect synchrony alone. Together with our simulations of the gene network (described above), we therefore argue that gene-gene interactions are a more plausible mechanistic explanation of the correlations observed in our measured bivariate mRNA distributions.

      4.Regarding model M4, the authors added a cell-specific noise term without specifying the contributing factors. Typically adding degrees of freedom should improve fitting and make it easier for a model to fit, why not in this case? Can the authors provide some explanations/mechanisms.

      We believe there has been a misunderstanding regarding model M4. By adding parameters, model M4 is indeed easier to fit. There is even a problem of overfitting whereby the burst frequency becomes unrealistically high and the model effectively fits a Poisson distribution to each individual cell. To avoid this, we lock the burst frequency values to the posterior mean values from model M2. After describing model M4, we write (lines 260-265):

      “When all parameters are free, we noticed that the burst frequency can become unrealistically high due to a tendency to overfit to individual cells, and we therefore locked the burst frequency to the posterior mean values from model M2. The PSIS-LOO scores overall favoured model M4 (Fig. 3B), and the predicted joint probability density shows good similarity to the observed data (Fig. 3D) (all time points shown in Supp figure 11).”

      Regarding the above comment in the reviewer’s summary on contributing factors of model M4 we added a simple dynamical model that attempts to explain at least one possible mechanism of generating correlations in cell-specific bursting parameters (see above).

      5.The authors should include the number (range) of cells analyzed in the figure legends.

      We have now added the number of cells used at each time point to the legend of Figure 1D. To respond to Reviewer #2 we have also added details on the number of smFISH replicates used at each time point. The number of cells for each replicate is shown in Supp Figures 2-5.

      Reviewer #1 (Significance (Required)):

      Overall, we felt conflicted about the manuscript. On one hand, the authors generated and analyzed a great amount of single-cell RNA FISH data over time on circadian genes. On the other hand, the manuscript was a bit dissatisfying/descriptive. If the authors could provide and analyze some sort of mechanisms on cell-specific burst size (F5), gene-specific dependence on cell size (beta), or the positive/negative gene-pair correlations (rho) it should help improve the manuscript.

      We thank the review for the suggestion to expand on the mechanistic interpretation, which we have followed. In addition, we would like to emphasise that a similar smFISH analysis of the core circadian oscillator has never been done, and we believe our data represents a significant contribution to the field. Moreover, our quite generic probabilistic inference framework for smFISH using mixture models to describe intrinsic (transcriptional bursting) and extrinsic fluctuations is also novel and the code provided (written using the Stan probabilistic programming language) might find a wide applicability.

      Concerning the mechanistic description, as described above, we added a stochastic, dynamic model of gene expression and propose that gene-gene interactions within the core-clock network topology represent a plausible mechanism for generating correlated burst parameters between genes, which are a feature of the preferred model M4 found during inference. We additionally added an explanatory figure to argue that, given the phase relationship between genes, imperfect synchronisation alone cannot explain the observed correlations that we observe between the pairs of genes. Together, this analysis provides more mechanistic insight into the underlying factors controlling the gene-gene relationships in our measured bivariate mRNA distributions.

      \*Referees cross-commenting** *

      I agree with Reviewer #3 regarding expanding the discussion to include the Shah & Tyagi and Raj et al citations on buffering. However caution should be exercised regarding ref 26 as it is quite controversial and subsequent analyses came to different conclusions (PMID: 30359620 and 30243562). The general consensus is that nuclear buffering of transcript noise (proposed in ref 26) is not a general phenomenon (ref 27 is specific to the calcium response pathway). In fact, the presence and evolution of specific pathways to buffer transcriptional noise, such as protein-protein mechanisms (Shah & Tyagi) or extended half-life proteins (Raj et al. and others), argues that transcript fluctuations are not probably buffered in general.

      Following the suggestion of Reviewer #3, we have expanded the Discussion to include the references cited (Shah & Tyagi, Raj and others).

      Previous work from our lab is also nuancing the conclusions from references 26 and 27. Specifically, buffering effects are expected to be highly gene-specific (3’UTR), and in fact we have not seen those with our unstable construct during live-cell imaging (Suter et al., 2011; Zoller et al., 2015). We have also added text in order to explicitly state that subsequent papers have nuanced the general claims in references 26 and 27. In the text we write (lines 335-342):

      “One explanation for the low intrinsic fluctuation in these studies is that transcriptional fluctuations are filtered by nuclear retention, though other reports suggest that Fano factors (variance/mean, a measure of overdispersion compared to the Poisson distribution) can be even larger in the cytoplasm than in the nucleus [38]. In the cells used here, the strong signature of transcriptional bursting and high intrinsic noise is consistent with live imaging of a Bmal1transcriptional reporter in the same cell line under similar growth conditions, where intrinsic noise was estimated to be 4-times larger than extrinsic noise [23].”.

      Reviewer #2 (Evidence, reproducibility and clarity (Required)):

      \*Summary:** *

      The authors study experimentally and computationally the dynamic transcription of circadian clock genes over time in individual cells with single molecule RNA-FISH with the aim to understand how different noise sources contribute to single cell transcription variability and basic functions of circadian clocks. The authors integrate experiments with computational modeling to understand biology.

      \*Major comments:** *

      This study has some major limitations that need to be addressed to test the model usefulness, to understand noise sources and to gain biological insights into circadian clocks.

      We thank this reviewer for the constructive feedback which enabled us to significantly strengthen the revised manuscript.

      The limitations are on the experiments, the computational implementation of the modeling and the integration of experiments with models.

      Although the experimental datasets contain several hundred cells per time point for multiple time points, only a single replica experiment is presented. From the presented data it is not clear how reproducible these temporal patterns are and if indeed differences between timepoints can be resolved if multiple biological replica experiments have been analyzed. To address this point at least three biological experiments needs to be presented and analyzed for each of the genes. Plotting the SEM on the means in figure 1B is misleading because several hundred cells have been measured which automatically makes the error small. The SEM just describes how well we can determine the mean from a distribution. Instead a mean and std from the biological replicas need to be plotted to show how experimental variability in experiments is resulting in the described expression pattern. This is similar to RNA-seq data or RT-PCR from multiple replica.

      We certainly agree that demonstrating reproducibility is important. Note that our smFISH data is from three independent cell culture dishes and microscopy slides, which included independent cell synchronization. This was described in the Methods but we agree that the data presentation was not showing the individual replicas, which we have now added. In Figure 1B, we now show the mean of each replicate for each time point. While the reviewer suggested displaying the mean and standard deviation across replicates, we show all data points at each time point to make it even more transparent. The mRNA distribution of each replicate is also shown in Supp Figures 2-5, together with individual quantification of mean, coefficient of variation and number of cells.

      In addition, to further demonstrate the reproducibility of the temporal patterns we have performed an additional independent experiment on four time points. This experiment shows that the oscillatory patterns for Nr1d1 and Cry1are clearly significant and reproducible (new Supp Figure 7). The combination of the replicates shown for the main experiment (Supp Figures 2-5) and the new replicate experiment (Supp Figure 7) shows that the oscillatory temporal patterns for the mean mRNA levels are robust and reproducible, and in fact similar as those found in bulk analyses (Ukai-Tadenuma et al., 2011; Hughes et al., 2009), which is expected.

      It is also not clear how good the cell segmentation works and how does cell segmentation influence the analysis. In figure 1A show the segmentation of the cell boundary together with the membrane stain.

      Thanks to this and other reviewers’ comments, we have now significantly improved the presentation of the FISH images. We have now 1) added the cell contours as requested; 2) used red/green for the smFISH signal in the pairs of genes; 3) we have improved the contrast to make it easier to distinguish the RNA FISH signals.

      We have also added Supp Figure 1 to show that the cell segmentation we used is reliable. In fact, as we had described, we used the sum Z-stack projections of the red channel (Wu et al., 2018), which we found provides the most accurate cell segmentation. We now show in Supp Figure 1 that the obtained segmentation shows convincing agreement with the cell autofluorescence .

      The authors use the RNA mean and RNA-FISH distributions and combine this data to build and compare different models. How do you know that the given data fulfils the central limit so that a model describing the mean is an adequate approach? To test this point, the authors should show through subsampling from the data and the model that indeed their data sets have enough cells to fulfil the central limit theorem.

      This comment reflects a misunderstanding of our approach, which we now try to better explain. In our inference framework we use a negative binomial (NB) distribution (and mixtures of NBs) to model the full distribution of mRNA counts, and our approach is therefore not based exclusively on the mean of the distribution. The estimation of model parameters and comparison of models is performed using the PSIS-LOO optimisation procedure (see below). The mixture model of NB binomials makes a few assumptions which we had clearly stated. In fact it captures both bursty transcription (in the limit of short bursts as is biologically plausible, which yields the NB distribution), and cell-to-cell variability (extrinsic noise) captured by the mixture. The suitability of the NB to model bursty transcription is established (Raj et al., 2006), and it is parameterized by a mean and a dispersion coefficient, such that the CV of the distribution is the inverse of the burst frequency (Zoller et al., 2015). Therefore the mean is indeed an important parameter of the model, but we do not see the relationship with the CLT. The used probabilistic inference (PSIS-LOO: Pareto-Smoothed Importance Sampling Leave-One-Out, Vehtari et al. 2017, see below) is established and state-of-the-art for selecting models of the appropriate complexity and we are not aware of a similar previous quantitative model for smFISH analysis.

      We have now added significantly more explanations both on the general approach as well as the methodological details in a fully-revised Methods section to avoid further misunderstanding.

      A strength of the manuscript is that several competing and biologically meaningful models have been generated. However, the manuscript lacks rigor in terms of how fitting and model selection is performed. It is not clear how good the models fit the data. To address this point, the authors should visually compare the model fits to the data and plot their fit errors as a function of model complexity.

      We fully agree that comparing different models using a model selection approach is a powerful methodology, in fact it is arguably the most systematic way to approach modeling problems in quantitative biology. Model selection is an active research area and there have been significant developments recently. Here, we used a state-of-the-art and established Bayesian approach (PSIS-LOO: Pareto-Smoothed Importance Sampling Leave-One-Out, Vehtari et al. 2017), which is certainly rigorous and more objective than visual comparison. The PSIS-LOO is conceptually similar to other approaches of model performance such as AIC or WAIC, and the entire field of model selection aims at establishing rigorous methods to assess the tradeoff between fit errors and model complexity. In PSIS-LOO, this is done by using pareto-smoothed importance sampling to estimate the expected log pointwise predictive density for a new dataset using leave-one-out cross-validation. The PSIS-LOO is the currently recommended metric for measuring model performance in Bayesian analysis (Vehtari et al., 2017) and is considered superior to other approaches such as computations of Bayes factors since it is less sensitive to model priors (Gelman et al. 2013). The performance of the models as measured with PSIS-LOO is shown in Figure 3B. As already mentioned, we have added further details as to how the fitting and model selection is performed in a revised Methods section. We agree that visual comparison is useful to gain intuition and this is why we showed the bivariate distributions in Figure 3D and in Supp Figure 11.

      Regarding the comment on “fit error”, note also that we probabilistically model the full mRNA distribution for each gene. In each cell, there is a likelihood score that measures the likelihood of observing the measured mRNA count given the modelled probability distribution. As our approach is based on this likelihood, the notion of “fitting error” needs to be replaced by the log likelihood (‘fitting error’ is mathematically equivalent to a log-likelihood when the noise model is Gaussian, which is not the case here).

      Another limitation is that the models have not been validated for example by using them to make predictions. One type of prediction could be to fit the model to one biological replica and then predict the other replica (cross validation). Another prediction would be to take the distribution fitted to the experimental data and then compare the model mean to the experimental mean.

      Thank you for this comment. As explained above, we used the state-of-the-art PSIS-LOO to measure the predictive performance of the models, which approximates the result of leave-one-out cross-validation using the full data set. To further assess the predictive capabilities of the model, we have now also added a “leave-replicate-out” cross-validation, as the reviewer suggests (new Supp Figure 12). The aim of our “leave-replicate-out” cross-validation was to test how well the predictions of each model generalise to independent cells that are not in the training set. To do this, we trained each model while omitting the data from one gene on a test slide. We then calculated the likelihood score of the test slide using the parameters from the training set, and repeated this for all slides. Similarly to the PSIS-LOO, the results of the leave-replicate-out cross-validation convincingly show that model M4 has the highest predictive performance. This is now described in the updated text on lines 265-271.

      The results from fitting and prediction should be plotted as a function of model complexity. This kind of analysis will illustrate how model complexity is supported by the data.

      As already mentioned, we used state-of-the-art algorithms to analyze prediction vs. complexity. With the above addition, we now have two methods of calculating the predictive performance of each model: the approximate leave-one-out score as measured with PSIS-LOO and the leave-replicate-out cross-validation. For each model, the PSIS-LOO score is plotted in Figure 3B and the leave-replicate-out cross-validation score is shown in Supp Figure 12.

      In the method section on models, a biological motivation must be presented to justify the different model assumption.

      Thank you for pointing out that the biological justification of the models needed to be expanded. In addition to the improved justifications already provided in the Results section, we have now updated the Methods section such that a biological motivation is included for each model.

      How do the models that fit the distributions describe the mean?

      As explained above, the inference is performed on the entire distributions, using a family of distributions (mixtures of NBs) which are parameterized in a biologically relevant manner (transcriptional bursting + extrinsic noise). The mean and variance of the distribution are now described on lines 585-586 in addition to Figure 3A.

      It is necessary to list model parameters for each of the models, their description, their parameter values, their parameter uncertainty and units of each parameter.

      Thank you, this has now been added as Supplementary Tables 2-5.

      It is not clear to me how the joint probability in figures 2,4, S2 and S4 have been used to fit the model.

      Again, the joint distributions are modeled using mixtures of NBs and the inference is performed on the entire dataset at once using a log-likelihood approach. This uses all the data at once, and it is embedded in a Bayesian model selection method. The way that the joint probability is used is now clarified in the revised Methods section and in the Results section (lines 208-214):

      “For both models M1 and M2, the likelihood of observing the data given the parameters of the model is evaluated using the model-specific NB distribution and the mRNA counts for both genes in each cell. This is performed for both Bmal1/Cry1 and Nr1d1/Cry1 pairs across all time points, and this likelihood is combined with model priors to define the posterior parameter distribution for each model (Methods). We applied Hamiltonian Monte Carlo sampling within the STAN probabilistic programming language to sample the posterior distribution and infer model parameters 40.”

      How do the models make sense in the context of the fact that human genes exist as a diploids?

      This is a good point, although note though that the 3T3 cells are from mice and not humans. 3T3 cells are tetraploid, and it turns out that under the justified assumption that the bursts are short (Zoller et al., 2015; Suter et al., 2011), the number of alleles rescales the burst frequency, i.e. the effective (observed) burst frequency equals the number of alleles times the burst frequency per allele, but it does not change the shape of the distributions. On line 580-582 we have now written: “Since 3T3 cells are tetraploid, and, again assuming that the bursts are short, the inferred burst frequency for tetraploid cells will be approximately four times that of a single allele.”

      The variance decomposition is shortly described but no results are presented to show how this is done. This should be better explained.

      The variance decomposition we used is not a new result; in fact, we used the analytical results of Bowsher, C. G. & Swain, P. S. “Identifying sources of variation and the flow of information in biochemical networks” (PNAS, 2012). The mathematical proofs of the formula we use are contained within that reference; however, we have re-written this section to make it clearer to the reader (lines 688-718).

      \*Minor comments:** *

      In figure 3A, it is not clear to me what these different plots relate to the models. It is also not clear what are equations that describe each model.

      The Methods section has now been improved to show the full data-generating mechanism for each model, and each model has its own section title to make it easier to find. We have also improved the legend for Figure 3 to make the relationship to each model clearer.

      The legends in figure 3 are not very informative. More details need to be presented to understand this figure.

      Thank you for pointing this out, and we have now re-written the figure legend for Figure 3 to make the figure clearer.

      Reviewer #2 (Significance (Required)):

      This is an interesting and important topic with the potential to have general implication of how to model periodic single cell gene expression data and eventually better understand circadian clocks. This study will expand on other modeling studies of circadian clocks and has the potential to advance the field (PMCID: PMC7229691). I personally have done similar analysis and experiments in another system and biological context which has demonstrated the power of this approach if implemented rigorously. I am not an expert in circadian clocks in human cells.

      We thank the reviewer for appreciating the implications for the circadian and single cell gene expression community. Note that to our knowledge, modeling smFISH counts using mixtures of negative binomials combined with Bayesian model selection has not been done. It is both highly relevant biologically (combines intrinsic and extrinsic fluctuations in a rigorous way), general and its applicability extends far beyond the circadian oscillator. Therefore, this approach for quantitative smFISH data analysis also fills an important methodological gap.

      \*Referees Cross commenting** *

      Reviewer #1:

      I agree with the assessment that model fitting and model selection was not sufficient. But I disagreed that the data is enough. Although many cells and time points are analyzed, there is no evidence of how reproducible each mRNA distribution can be measured at each time point. I think reproducibility is key and will also help with the model fitting and identification.

      Regarding the point on reproducibility, we have made the following four changes:

      1. We have added an independent 4 time-point experiment to show that the oscillatory patterns of the distributions are reproducible (Supp Figure 7).
      2. In Figure 1 we now also show the mean of each replicate for the main experiment (Figure 1B).
      3. We also show the mRNA distributions of each replicate in Supp Figures 2-5.
      4. We have added the “leave-replicate-out” cross-validation to show that that the model performance of the preferred model generalises to independent slides that were not included in training (Supp Figure 12). In responding to Reviewer #1 regarding the modeling, we have now also added a simplified dynamical model of circadian clock expression to add mechanistic insight into our proposed models. Overall, we have significantly expanded the description of the model selection approaches to help readers who are less familiar with Bayesian model selection methods.

      Reviewer #3:

      Regarding the red background, my understanding is that this comes from the probe hybridization. This is maybe because the probe concentration has not been optimized or the number of probes per gene is low and the signal to noise is not so good.Or it could be auto fluorescent background. In this case a different fluorophore needs to be used to avoid this problem.

      Thank you for those comments, and we agree with all reviewers that the presentation of the images needed to be improved. It turned out that in Figure 1, we had shown the cell mask in red so it is clearly not related to probe concentration or autofluorescence. We have now removed the cell mask channel from the main images which allows highlighting better the smFISH signals. All smFISH images for Figures 1 and 2 have been much improved, and we’ve added a new Supp Figure 1 to show the performance of our cell segmentation.

      Reviewer #3 (Evidence, reproducibility and clarity (Required)):

      In this paper Nicholas et al image mRNAs encoding the key controllers of circadian rhythms, Rev-erba, Cry and Bmal1 in single cells over time. It was shown earlier that single cells exhibit circadian rhythms using reporter genes. A large number of studies have shown that transcription is an inherently stochastic process, which raises a question as to how single cells are able to achieve their rhythms on the face of this noise. Their results show that the number of mRNAs for the three genes exhibit the expected periodicity, but this periodicity is associated with significant cell-to-cell variation. They also explore to what extent this variability derives from stochastic transcription vs other sources of variation that are extrinsic to the genes. The results are interesting and experimental and modeling results are important (however this reviewer is not able to judge the veracity of mathematics that underlay the models).

      We thank this reviewer for appreciating the importance of our work.

      \*Some of the concerns that arose are listed below:** *

      1.The images show an annoying red background. If the red is HCS cell mask, it should be removed, and RNA presented on grey scale. This will make a better presentation. The red hue also appears in fig 2 b but here it is one of the RNA. I suggest in Fig 2 one RNA can be presented in green and the other in red, while the nuclei in blue.

      Thank you for this comment. We had indeed shown the cell mask in the red channel and now removed it. Together with the other suggestions and comments from the reviewers, we implemented the following changes: 1) added the cell contours as requested; 2) use red/green for the smFISH signal in the pairs of genes; 3) we have improved the contrast to make it easier to distinguish the RNA FISH signals. The presentation of the images is now much improved.

      2.This paper and a few others talk about the cell size contributing to the cell-to-cell variability in mRNA numbers. Where does it come from physically? One can imagine based on the cell cycle stage there could be more than two copies of then gene in a cell, which will yield more RNAs, but they say that their cells don't have much cell cycle variability. Perhaps a clearer discussion is called for rather than just being polite to other investigators.

      The referee is right that several studies observed empirically that larger cells show more mRNA molecules in smFISH experiments (Padovan et al., 2015; Kempe et al., 2015). In Padovan et al. (2015), the authors found that transcriptional burst size changes with cell volume and burst frequency with cell cycle. The main theory for transcription scaling with cell volume is to maintain transcript concentration. Using cell fusion experiments, they showed that cellular size can directly and globally affect gene expression by modulating transcription. Furthermore, they proposed that the mechanism underlying the global regulation integrates both DNA content and cellular volume to produce the appropriate amount of RNA for a cell of a given size, which is consistent with a model whereby a factor limiting for transcription is sequestered to the DNA. We used these results to propose a model whereby burst size scales with area, and we found an increase in predictive performance (compare M2 with M1 in Figure 3B). While our model selection supported the inclusion of cell area, the variance decomposition showed that the fraction of variance due to cell area ranged from 4.2% for Nr1d1 to 17.6% for Bmal1. We have now expanded the introduction to discuss this in more depth (lines 73-80) as requested.

      3.References 26 and 27 are cited for 10-80% of variance due to gene extrinsic sources. These references actually deny that there is a significant transcriptional noise in most genes. Again, stronger discussion is called for.

      As mentioned in the reply to Reviewer 1, previous work from our lab is also nuancing the conclusions from references 26 and 27. Specifically, buffering effects are expected to be highly gene-specific (3’UTR), and in fact we have not seen those with our unstable construct during live-cell imaging (Suter et al., 2011; Zoller et al., 2015). We have also added text in order to explicitly state that subsequent papers have nuanced the general claims in references 26 and 27. In the text we write (lines 335-342):

      “One explanation for the low intrinsic fluctuation in these studies is that transcriptional fluctuations are filtered by nuclear retention, though other reports suggest that Fano factors (variance/mean, a measure of overdispersion compared to the Poisson distribution) can be even larger in the cytoplasm than in the nucleus [38]. In the cells used here, the strong signature of transcriptional bursting and high intrinsic noise is consistent with live imaging of a Bmal1transcriptional reporter in the same cell line under similar growth conditions, where intrinsic noise was estimated to be 4-times larger than extrinsic noise [23].”.

      4.The results raise a very important question, whether and to what extent the transcriptional noise propagates to the next step of gene regulation and are there buffering mechanisms in the cell. For example, Raj et al, Variability in gene expression underlies incomplete penetrance, Nature 2010, show that alternative pathways serve to buffer the impact of gene expression noise. Similarly, Shah and Tyagi, Barriers to transmission of transcriptional noise in a c-fos c-jun pathway, Mol Syst Biol, 2013, show that variability in mRNA is buffered at protein level and the level of protein-protein complexes. Furthermore, they show that to the extent those vary, the chromatin intrinsically buffers against the fluctuations in numbers of transcription factors. Mention of these and other studies will enrich the paper.

      We have modified the Discussion section and now discuss these papers (and a few more). We thank the reviewer for the suggestions, which will help the reader to have a broader overview of noise buffering in gene expression and indeed enrich the paper.

      Reviewer #3 (Significance (Required)):

      Significance is high. Quality is high.

      \*Referees Cross-Commenting** *

      I agree with the comments made by other reviewers particularly about references 26 and 27. The major conclusions of reference 26 were questioned by Hansen et al 2018. At the bottom of page 7 the authors are qualifying their results in the light of references 26 and 27. Perhaps now there is less of a need to do so.

      As mentioned above, we have added the following sentence citing the Hansen paper to make it clear to the reader that key conclusions of the references 26 and 27 are disputed (lines 335-342):

      “One explanation for the low intrinsic fluctuation in these studies is that transcriptional fluctuations are filtered by nuclear retention, though other reports suggest that Fano factors (variance/mean, a measure of overdispersion compared to the Poisson distribution) can be even larger in the cytoplasm than in the nucleus [38].

      References

      Gelman A, Carlin JB, Stern HS, Dunson DB, Vehtari A, Rubin DB. 2013. Bayesian Data Analysis, 3rd edn. CRC Press, London.

      Hughes ME, DiTacchio L, Hayes KR, Vollmers C, Pulivarthy S, Baggs JE, Panda S, Hogenesch JB. 2009. Harmonics of circadian gene transcription in mammals. PLoS Genet 5. doi:10.1371/journal.pgen.1000442

      Kempe H, Schwabe A, Cremazy F, Verschure PJ, Bruggeman FJ. 2015. The volumes and transcript counts of single cells reveal concentration homeostasis and capture biological noise. Mol Biol Cell 26:797–804. doi:10.1091/mbc.E14-08-1296

      Padovan-Merhar O, Nair GP, Biaesch AG, Mayer A, Scarfone S, Foley SW, Wu AR, Churchman LS, Singh A, Raj A. 2015. Single Mammalian Cells Compensate for Differences in Cellular Volume and DNA Copy Number through Independent Global Transcriptional Mechanisms. Mol Cell 58:339–352. doi:10.1016/j.molcel.2015.03.005

      Raj A, Peskin CS, Tranchina D, Vargas DY, Tyagi S. 2006. Stochastic mRNA synthesis in mammalian cells. PLoS Biol4:e309. doi:10.1371/journal.pbio.0040309

      Relógio A, Westermark PO, Wallach T, Schellenberg K, Kramer A, Herzel H. 2011. Tuning the mammalian circadian clock: Robust synergy of two loops. PLoS Comput Biol 7:1–18. doi:10.1371/journal.pcbi.1002309

      Saini C, Morf J, Stratmann M, Gos P, Schibler U. 2012. Simulated body temperature rhythms reveal the phase-shifting behavior and plasticity of mammalian circadian oscillators. Genes Dev 26:567–580. doi:10.1101/gad.183251.111

      Suter DM, Molina N, Gatfield D, Schneider K, Schibler U, Naef F. 2011. Mammalian Genes Are Transcribed with Widely Different Bursting Kinetics. Science (80- ) 332:472–474. doi:10.1126/science.1198817

      Ukai-Tadenuma M, Yamada RG, Xu H, Ripperger JA, Liu AC, Ueda HR. 2011. Delay in feedback repression by cryptochrome 1 Is required for circadian clock function. Cell 144:268–281. doi:10.1016/j.cell.2010.12.019

      Vehtari A, Gelman A, Gabry J. 2017. Practical Bayesian model evaluation using leave-one-out cross-validation and WAIC. Stat Comput 27:1413–1432. doi:10.1007/s11222-016-9696-4

      Wu C, Simonetti M, Rossell C, Mignardi M, Mirzazadeh R, Annaratone L, Marchiò C, Sapino A, Bienko M, Crosetto N, Nilsson M. 2018. RollFISH achieves robust quantification of single-molecule RNA biomarkers in paraffin-embedded tumor tissue samples. Commun Biol 1:1–8. doi:10.1038/s42003-018-0218-0

      Zoller B, Nicolas D, Molina N, Naef F. 2015. Structure of silent transcription intervals and noise characteristics of mammalian genes. Mol Syst Biol 11:823. doi:10.15252/msb.20156257

    2. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #3

      Evidence, reproducibility and clarity

      In this paper Nicholas et al image mRNAs encoding the key controllers of circadian rhythms, Rev-erba, Cry and Bmal1 in single cells over time. It was shown earlier that single cells exhibit circadian rhythms using reporter genes. A large number of studies have shown that transcription is an inherently stochastic process, which raises a question as to how single cells are able to achieve their rhythms on the face of this noise. Their results show that the number of mRNAs for the three genes exhibit the expected periodicity, but this periodicity is associated with significant cell-to-cell variation. They also explore to what extent this variability derives from stochastic transcription vs other sources of variation that are extrinsic to the genes. The results are interesting and experimental and modeling results are important (however this reviewer is not able to judge the veracity of mathematics that underlay the models).

      Some of the concerns that arose are listed below:

      1.The images show an annoying red background. If the red is HCS cell mask, it should be removed, and RNA presented on grey scale. This will make a better presentation. The red hue also appears in fig 2 b but here it is one of the RNA. I suggest in Fig 2 one RNA can be presented in green and the other in red, while the nuclei in blue.

      2.This paper and a few others talk about the cell size contributing to the cell-to-cell variability in mRNA numbers. Where does it come from physically? One can imagine based on the cell cycle stage there could be more than two copies of then gene in a cell, which will yield more RNAs, but they say that their cells don't have much cell cycle variability. Perhaps a clearer discussion is called for rather than just being polite to other investigators.

      3.References 26 and 27 are cited for 10-80% of variance due to gene extrinsic sources. These references actually deny that there is a significant transcriptional noise in most genes. Again, stronger discussion is called for.

      4.The results raise a very important question, whether and to what extent the transcriptional noise propagates to the next step of gene regulation and are there buffering mechanisms in the cell. For example, Raj et al, Variability in gene expression underlies incomplete penetrance, Nature 2010, show that alternative pathways serve to buffer the impact of gene expression noise. Similarly, Shah and Tyagi, Barriers to transmission of transcriptional noise in a c-fos c-jun pathway, Mol Syst Biol, 2013, show that variability in mRNA is buffered at protein level and the level of protein-protein complexes. Furthermore, they show that to the extent those vary, the chromatin intrinsically buffers against the fluctuations in numbers of transcription factors. Mention of these and other studies will enrich the paper.

      Significance

      Significance is high. Quality is high.

      Referees Cross-Commenting

      I agree with the comments made by other reviewers particularly about references 26 and 27. The major conclusions of reference 26 were questioned by Hansen et al 2018. At the bottom of page 7 the authors are qualifying their results in the light of references 26 and 27. Perhaps now there is less of a need to do so.

    3. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #2

      Evidence, reproducibility and clarity

      Summary: The authors study experimentally and computationally the dynamic transcription of circadian clock genes over time in individual cells with single molecule RNA-FISH with the aim to understand how different noise sources contribute to single cell transcription variability and basic functions of circadian clocks. The authors integrate experiments with computational modeling to understand biology.

      Major comments:

      This study has some major limitations that need to be addressed to test the model usefulness, to understand noise sources and to gain biological insights into circadian clocks.

      The limitations are on the experiments, the computational implementation of the modeling and the integration of experiments with models.

      Although the experimental datasets contain several hundred cells per time point for multiple time points, only a single replica experiment is presented. From the presented data it is not clear how reproducible these temporal patterns are and if indeed differences between timepoints can be resolved if multiple biological replica experiments have been analyzed. To address this point at least three biological experiments needs to be presented and analyzed for each of the genes. Plotting the SEM on the means in figure 1B is misleading because several hundred cells have been measured which automatically makes the error small. The SEM just describes how well we can determine the mean from a distribution. Instead a mean and std from the biological replicas need to be plotted to show how experimental variability in experiments is resulting in the described expression pattern. This is similar to RNA-seq data or RT-PCR from multiple replica.

      It is also not clear how good the cell segmentation works and how does cell segmentation influence the analysis. In figure 1A show the segmentation of the cell boundary together with the membrane stain.

      The authors use the RNA mean and RNA-FISH distributions and combine this data to build and compare different models. How do you know that the given data fulfils the central limit so that a model describing the mean is an adequate approach? To test this point, the authors should show through subsampling from the data and the model that indeed their data sets have enough cells to fulfil the central limit theorem.

      A strength of the manuscript is that several competing and biologically meaningful models have been generated. However, the manuscript lacks rigor in terms of how fitting and model selection is performed. It is not clear how good the models fit the data. To address this point, the authors should visually compare the model fits to the data and plot their fit errors as a function of model complexity.

      Another limitation is that the models have not been validated for example by using them to make predictions. One type of prediction could be to fit the model to one biological replica and then predict the other replica (cross validation). Another prediction would be to take the distribution fitted to the experimental data and then compare the model mean to the experimental mean.

      The results from fitting and prediction should be plotted as a function of model complexity. This kind of analysis will illustrate how model complexity is supported by the data.

      In the method section on models, a biological motivation must be presented to justify the different model assumption.

      How do the models that fit the distributions describe the mean?

      It is necessary to list model parameters for each of the models, their description, their parameter values, their parameter uncertainty and units of each parameter.

      It is not clear to me how the joint probability in figures 2,4, S2 and S4 have been used to fit the model.

      How do the models make sense in the context of the fact that human genes exist as a diploids?

      The variance decomposition is shortly described but no results are presented to show how this is done. This should be better explained.

      Minor comments:

      In figure 3A, it is not clear to me what these different plots relate to the models. It is also not clear what are equations that describe each model.

      The legends in figure 3 are not very informative. More details need to be presented to understand this figure.

      Significance

      This is an interesting and important topic with the potential to have general implication of how to model periodic single cell gene expression data and eventually better understand circadian clocks. This study will expand on other modeling studies of circadian clocks and has the potential to advance the field (PMCID: PMC7229691). I personally have done similar analysis and experiments in another system and biological context which has demonstrated the power of this approach if implemented rigorously. I am not an expert in circadian clocks in human cells.

      Referees Cross commenting

      Reviewer #1: I agree with the assessment that model fitting and model selection was not sufficient. But I disagreed that the data is enough. Although many cells and time points are analyzed, there is no evidence of how reproducible each mRNA distribution can be measured at each time point. I think reproducibility is key and will also help with the model fitting and identification.

      Reviewer #3: Regarding the red background, my understanding is that this comes from the probe hybridization. This is maybe because the probe concentration has not been optimized or the number of probes per gene is low and the signal to noise is not so good. Or it could be auto fluorescent background. In this case a different fluorophore needs to be used to avoid this problem.

    4. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #1

      Evidence, reproducibility and clarity

      The authors generated and analyzed a great amount of single-cell RNA FISH data over time on circadian genes (Nr1d1, Cry1, Bmal1), and performed model selection/fitting to explain the observed mRNA distributions. They decomposed the mRNA variability into distinct sources, and showed that intrinsic noise (transcription burst) dominates the variance. Therefore, looking at transcript counts may not be feasible to estimate single-cell circadian phase. However, the study is quite descriptive and ends up being a bit dissatisfying, so if the authors could improve this aspect by perhaps analyzing a mechanism on cell-specific burst size (F5), gene-specific dependence on cell size (beta), or the positive/negative gene-pair correlations (rho), it would help quite a bit in this regard. The model selection/fitting itself was not really sufficient to compensate for this, as it stands .

      Specific comments:

      1.It is hard to distinguish the RNA FISH signals (Figure 1A, 2B). It is probably technically challenging as the mRNAs are of low abundance. I think it may help if they adjust the contrast for the cytoplasm stain or just delineate the cell boundaries.

      2.In Figure 2C, the authors showed gene-pair correlations with cells of all sizes. Could the authors do a size-dependent extrinsic-noise filtering (Padovan-Merhar, Dev. Cell, 2015; Hansen et al., 2018, Cell Systems) to better dissect the correlations?

      3.For fitting model M3, as the authors pointed out, there are many local minima. Is the fitting score truly sufficient to eliminate the possibility for partial synchrony especially considering that the authors didn't show how effective the Dex treatment was to synchronize the circadian phase?

      4.Regarding model M4, the authors added a cell-specific noise term without specifying the contributing factors. Typically adding degrees of freedom should improve fitting and make it easier for a model to fit, why not in this case? Can the authors provide some explanations/mechanisms.

      5.The authors should include the number (range) of cells analyzed in the figure legends.

      Significance

      Overall, we felt conflicted about the manuscript. On one hand, the authors generated and analyzed a great amount of single-cell RNA FISH data over time on circadian genes. On the other hand, the manuscript was a bit dissatisfying/descriptive. If the authors could provide and analyze some sort of mechanisms on cell-specific burst size (F5), gene-specific dependence on cell size (beta), or the positive/negative gene-pair correlations (rho) it should help improve the manuscript.

      Referees cross-commenting

      I agree with Reviewer #3 regarding expanding the discussion to include the Shah & Tyagi and Raj et al citations on buffering. However caution should be exercised regarding ref 26 as it is quite controversial and subsequent analyses came to different conclusions (PMID: 30359620 and 30243562). The general consensus is that nuclear buffering of transcript noise (proposed in ref 26) is not a general phenomenon (ref 27 is specific to the calcium response pathway). In fact, the presence and evolution of specific pathways to buffer transcriptional noise, such as protein-protein mechanisms (Shah & Tyagi) or extended half-life proteins (Raj et al. and others), argues that transcript fluctuations are not probably buffered in general.

    1. Note: This rebuttal was posted by the corresponding author to Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Reply to the reviewers

      Reviewer #1 (Evidence, reproducibility and clarity (Required)): **Summary:** In this study, the authors investigate the role of hedgehog signaling and lipid metabolism in the neural stem cell niche of the Drosophila larvae. They demonstrate that Hedgehog localizes to lipid droplets in glial cells and show that Hh is necessary but not sufficient for elaboration of glial membranes and normal rates of glial proliferation during development. In addition, they provide an extensive set of results in support of a model that FGF signaling functions upstream of lipid metabolism and hh in glial cells as well as a parallel ROS mediated pathway in glial cells to promote neuroblast proliferation. In general, the results provide strong support for the conclusions. Specifically, the approaches are sound, the images clearly demonstrate the phenotypes described, and the effects are quantified and tested for statistical significance. **Major comments:** 1.Since Hh RNAi decreases the glial compartment (which slows NB proliferation) and increases the frequency of pH3+ NBs, it is unclear why it would decrease the number of EdU+ NBs (Fig. S3C). 2.If overexpression of htl[ACT] slows the NB cell cycle (as evidenced by reduced pH3 and EdU positive cells), it unclear why it does not reduce the number of NBs (Fig. 4L). 3.What is the justification for presenting the EdU quantifications as an EdU index in which the experimental values are normalized to the average number of positive cells in the control? In many cases, the comparison is to the same w[1118] line so it does not control for a specific genetic backgrounds and yet this method may be obscuring experimental variation present between datasets. Likewise, why is glial number presented as a fold-change but NB number is presented as raw counts (e.g. 2D vs S3E)? **Minor comments:** On the top of P.14, "Figure S7A-C" should probably be "Figure S6A-C" Reviewer #1 (Significance (Required)): The cell autonomous regulation of growth and proliferation of neuroblasts in the larval brain have been well-studied, but much less is known about the non-cell autonomous signals. This paper significantly moves forward knowledge in this area by describing multiple steps of a molecular mechanism for glial regulation of the neuroblast cell cycle. These findings would be of interest not only to the study of Drosophila neuroblasts, but also to the broader adult stem cell field. My expertise is in Drosophila stem cell biology and genetics. Reviewer #2 (Evidence, reproducibility and clarity (Required)): **Summary:** The study by Dong et al., investigates the role of Hedgehog in the glial niche during larval neurogenesis in Drosophila. The authors describe the expression of Hh in cortex glia and its association with lipid droplets. They show that Hh expression in cortex glia is required for cortex glial proliferation, cell autonomously, and for maintenance of the normal cell cycle in neuroblasts. They go on to use a well characterised Drosophila glioma model, activation of FGF signalling, to investigate the requirement for Hh during cortex glial overgrowth. They show that FGF-activated cortex glial overproliferation requires Hh for modulation of neuroblast cell cycle, although Hh does not regulate cortex glial proliferation in this context. Finally, they show that inhibition of lipid modification of Hh rescues the neuroblast proliferation cell cycle defect caused by FGF activation in cortex glia. **Major comments:** 1.From the data in presented in Fig. 2H-K and Fig. S3C, I am very confused about role of Hh in the non-cell autonomous regulation of neuroblast cell cycle. Both RNAi and overexpression of Hh with Repo-Gal4 cause a reduction in the neuroblast EdU index (Fig. 2H-K and S3C). The authors conclude this section on p.7 saying "Together, our data suggests that high levels of glial Hh expression restricts NB cell cycle progression." This statement is not consistent with data. What is the normal physiological role of Hh if both decreased and increased levels of cortex glial Hh expression reduce neuroblast cell cycle? The discussion of p.15 does not clarify this issue. The model in Fig.7J relates to the role of Hh in the context of cortex glial FGF activation and does not illustrate the normal physiological role of Hh in the regulation of neuroblast cell cycle. 2.P.8 "Analysis of the total glial cell number indicates overexpression of htlACT, but not InRwt or EgfrACT, led to an increase in the number of cortex glial cells (Figure 4E-G, I-K)." This statement is confusing as Repo staining was used to quantify total glial numbers (including perineural, sub-perineural and cortex glia) but these data are then taken to represent and increase specifically in cortex glia. This should be clarified. 3.It should be mentioned on p.8 that the data in Fig.4A-K reproduce the findings of Avet-Rochex et al., 2012 and Read et al., 2009. 4.Figure 6F. Presumably due to the increase in glia cell number and dramatic increase in glial cell volume, any gene that is specific to, or enriched in, cortex glia will have increased expression levels in RepoGal4>htlACT larval CNS. Can the authors provide evidence that the increase in the expression of these genes is specific to FGF transcriptional regulation and not just a relative increase in the levels of these genes due to an increase in cortex glia as proportion of total CNS volume? Is there any evidence that Hh, fasn1 and lsd2 are direct transcriptional targets of FGF signalling in glia? 5.FGF signalling has been shown to be necessary and sufficient for cortex glial proliferation. So does knockdown of Htl, or expression of dominant negative Htl, cause a reduction in Hh, fasn1 and lsd2 expression in cortex glia? If so, does how does reduction of cortex glial numbers independent of FGF signalling, using for example knockdown of String or expression of Decapo, affect the expression of Hh, fasn1 and lsd2 in cortex glia? 6.Can the authors speculate on why and how increased levels of Hh in cortex glia, in the context of FGF activation, inhibit neuroblast cell cycle? Is this a physiological mechanism to limit neuroblast proliferation in the face of increased gliogenesis, or is it simply an indirect result of 'spillover' of excess Hh from cortex glia onto neuroblasts (which are autonomously regulated by Hh and so sensitive to this ligand) by due to increased cortex glia cells? **Minor comments:** -Figure 1C' some lipid droplets are extremely large, is this consistent with previous literature? -Including a profile plot of relative fluorescence intensity in Figure 1C',F',H' to illustrate colocalization of lipidTOX and Hh, would be helpful. -Figure S3A,B quantify Hh protein level and CNS size phenotypes with Hh RNAi. -p.6 include data showing overexpression of Hh does not cause glial overgrowth. -Top of p.14 should be FigS6A-C. -Include quantification of glial overgrowth and lipid droplet phenotypes with HtlACT plus catalase and SOD1 overexpression (Fig. S6D-K). Reviewer #2 (Significance (Required)): The is a novel and very interesting study, well written and the data are very clearly presented. It builds on and adds to the emerging literature on the glial niche and its role in neural stem cell regulation. It will be of great interest to Drosophila neurobiologists but also to the broader field of neural stem cell biology. My expertise is Drosophila neurobiology.

      Dear editor

      Below is our response to the reviewer’s comments and our experimental plan in addressing these concerns.

      Reviewer #1

      Major comments:

      1.Since Hh RNAi decreases the glial compartment (which slows NB proliferation) and increases the frequency of pH3+ NBs, it is unclear why it would decrease the number of EdU+ NBs (Fig. S3C).

      Our experimental data suggests that accompanying glial niche disruption and downregulation of glia-derived signals, NBs are stalled in M phase (we detected an increase in the percentage of pH3+ NBs). As a consequence, less NBs are in G1 and S phase. Therefore, when we conducted a 15-min EdU incorporation, we observed a reduction in EdU incorporation. This NB phenotype (increase in pH3 index and decrease in EdU index) was also observed by Speder and Brand, 2018, when they induced glial niche impairment by inhibiting the PI3K signaling pathway (discussed in P7 of this ms).

      To address whether glial-Hh knockdown reduces the ability of NBs to produce progeny, we plan to carry out two experiments:

      • We will assess the total number of neurons in the CB by assessing Elav+ neurons.

      • We will conduct two EdU pulse-chase experiments. First, we will assess the total number of EdU+ neurons produced within a 4-hr time window (neurons marked with Elav); and the secondly, we will mark the NB lineage (with either nerfin-1-GFP or pros-GFP) and quantify the number of EdU+ neurons produced per lineage during a 4-hr time window.

      Together, these experiments should allow us to assess the consequence of glial-Hh knockdown on NB proliferation.

      If overexpression of htl[ACT] slows the NB cell cycle (as evidenced by reduced pH3 and EdU positive cells), it unclear why it does not reduce the number of NBs (Fig. 4L).

      The number of NBs in the larval CNS is specified at the beginning of post-embryonic neurogenesis, when quiescent NBs re-enter the cell cycle (reviewed by Homem and Knoblich, 2012). Once NBs re-enter the cell cycle, the number of NBs remain constant. NBs undergo asymmetric division to produce one daughter NB and a GMC, which divides once to generate two neurons. With each round of NB-division, the number of NBs remain constant. Therefore, changes in NB cell cycle speed does not alter the overall NB number, only the number of neurons produced.

      To clarify this, we will add a schematic depicting NB asymmetric division to Figure 1.

      3.What is the justification for presenting the EdU quantifications as an EdU index in which the experimental values are normalized to the average number of positive cells in the control?

      EdU index is calculated as number of EdU+ NBs normalised to control EdU+ NBs. The number of EdU+ NBs reflects the NBs that progress through S phase in a 15-min time relative to the control. A similar method was used in Kanai et al., 2018. This method would not be valid only if NB number varied between control and experimental data sets, however, the number of NBs in all our genetic manipulations are not significantly altered relative to their control. We present the quantification of some key manipulations in Reviewer_Figure 1A, B.

      As regards to why we normalise to control in each of these experiments, this is because in-vitro EdU incorporation rely on Click-IT chemistry, which is inherently variable due to incubation conditions. To overcome this, we always incubate control and experimental brains in the same tube and imaged them with the same confocal setting, and each experiment is normalised to its control done in parallel. We have now included Table 1 which includes all the raw data from these experiments (Table 1)

      In the revised manuscript, we will clarify our methodology in greater detail in the Methods section, and we are happy to include Table 1in the supplementary data.

      In many cases, the comparison is to the same w [1118] line so it does not control for a specific genetic backgrounds and yet this method may be obscuring experimental variation present between datasets.

      We have used three different controls in our experiments, namely GAL4 or lexA >w1118, or UAS-mcherryRNAi, or UAS-luc. We detect no significant difference in terms of raw EdU+ NB numbers between the controls used in our experiments, as demonstrated below (Reviewer_Figure 1C). In our revised manuscript, we will include a sentence “As UAS-mcherryRNAi or UAS-luc are indistinguishable from the > w1118 control, we have used GAL4 driver > w1118 as control in place of UAS-luc in our results”.

      Reviewer_Figure 1. Total NB number and Edu+ NB number quantification

      1. A) Hh knockdown or overexpression in glia does not significantly alter NB number compared to control.
      2. B) htlACT overexpression in glia does not significantly alter NB number compared to control.
      3. C) EdU+ NB number is not significantly different within the controls GAL4 or lexA > w1118, or UAS-mcherryRNAi, or UAS-luc. P-value was obtained performing student t-test in A, B and One-way ANOVA in C.

      Likewise, why is glial number presented as a fold-change but NB number is presented as raw counts (e.g. 2D vs S3E)?

      Glial number quantification was carried out using Fiji 3D object counter and a plug-in called “DeadEasy Larval Glia” (Forero et al., 2012), where the threshold of detection is dependent on the brightness of Repo staining in each experiment, this data is presented as fold-change, as control and experiment stained in the same tube are compared to each other. We represented this data as fold-change to allow easy comparison between experiments. The raw data is presented in Table 2. NB number is counted manually and is therefore presented as raw counts.

      **Minor comments:**

      On the top of P.14, "Figure S7A-C" should probably be "Figure S6A-C"

      We will correct this.

      Reviewer #1 (Significance (Required)):

      The cell autonomous regulation of growth and proliferation of neuroblasts in the larval brain have been well-studied, but much less is known about the non-cell autonomous signals. This paper significantly moves forward knowledge in this area by describing multiple steps of a molecular mechanism for glial regulation of the neuroblast cell cycle. These findings would be of interest not only to the study of Drosophila neuroblasts, but also to the broader adult stem cell field.

      My expertise is in Drosophila stem cell biology and genetics.

      Reviewer #2 (Evidence, reproducibility and clarity (Required)):

      **Major comments:**

      1.From the data in presented in Fig. 2H-K and Fig. S3C, I am very confused about role of Hh in the non-cell autonomous regulation of neuroblast cell cycle. Both RNAi and overexpression of Hh with Repo-Gal4 cause a reduction in the neuroblast EdU index (Fig. 2H-K and S3C). The authors conclude this section on p.7 saying "Together, our data suggests that high levels of glial Hh expression restricts NB cell cycle progression." This statement is not consistent with data. What is the normal physiological role of Hh if both decreased and increased levels of cortex glial Hh expression reduce neuroblast cell cycle? The discussion of p.15 does not clarify this issue. The model in Fig.7J relates to the role of Hh in the context of cortex glial FGF activation and does not illustrate the normal physiological role of Hh in the regulation of neuroblast cell cycle.

      With repo-GAL4>hhRNAi, the cortex glial niche enwrapping NBs is dramatically disrupted, which indirectly alters NB cell cycle progression, indicated by an increase in pH3 index and a decrease in EdU index. From these two pieces of data, it is likely that NBs are stuck in M phase, thus resulting in less NBs in G1 and S phase that are capable to incorporate EdU within a 15-min incubation time window. We will firm up this data with experiments proposed to address concerns of Reviewer 1, Point 1.

      Both RNAi and overexpression of Hh with repo-GAL4 causes a reduction in NB EdU index is seemingly contradictory. However, it is consistent with a previous report from Speder and Brand, 2018, where it was shown that that glial niche impairment induced by the PI3K pathway inhibition also causes a similar NB phenotype (an increase in pH3 index and a decrease in EdU incorporation). Furthermore, with repo-GAL4>htlDN, which caused a similar glia niche impairment (data not shown), we observed a similar phenotype (an increase in pH3 index and a slight decrease in EdU incorporation). Therefore, we concluded that the NB cell cycle progression defects is due to a general cortex glial niche disruption rather than a direct effect of Hh inhibition on NBs. We are happy to include the repo-GAL4>htlDN data in the supplementary data if required.

      With regards to the physiological role of Hh, we can only conclude from the data at hand that Hh is required for the development of cortex glial niche, which is required to maintain NB activities. In terms of how glial niche impairment impedes NB cell cycle progression, we observed that without a proper niche chamber, NBs cluster together instead of residing in separate niches (Figure 2F-G). Therefore, it is possible that the localization of other cell types (i.e. GMCs and neurons) are also altered as a result of NB clustering, which can potentially affect the NB cell cycle. While these questions will be interesting to explore in the future, they are beyond the scope of this current study.

      In contrast, we robustly showed Hh signals, when overexpressed in glial niche, were capable of making contact with NBs (Figure 7C-C’) and triggering a slow-down of NB S-phase progression. Therefore, it is fair to conclude that “high levels of glial Hh expression restricts NB cell cycle progression”.

      In the revised manuscript, we will discuss these findings in greater detail.

      2.P.8 "Analysis of the total glial cell number indicates overexpression of htlACT, but not InRwt or EgfrACT, led to an increase in the number of cortex glial cells (Figure 4E-G, I-K)." This statement is confusing as Repo staining was used to quantify total glial numbers (including perineural, sub-perineural and cortex glia) but these data are then taken to represent and increase specifically in cortex glia. This should be clarified.

      We thank the reviewer for picking this up. Our intention was to quantify the number of cortex glia cells in glial-specific htlACT, InRwt and EgfrACT manipulations. However, two reported cortex glial antibodies (PntP2 from Avet-Rochex et al., 2012 and SoxN described in Read, 2018), showed unspecific labelling of other cell types (Reviewer_Figure 2, arrows, neurons and NBs). As an alternative, we quantified the total glial cell number (Repo+) in htlACT, InRwt or EgfrACT overexpressed using a cortex glial driver (NP2222-GAL4). We expect that the alterations in glial cell number would be primarily attributed to cortex glial-specific gene manipulation. We agree that we should say that “overexpression of htlACT, but not InRwt or EgfrACT, led to an increase in the number of glial cell”.

      In the revised manuscript, we will clarify this in the results section.

      Reviewer_Figure 2: PntP2 staining in the larval CNS.

      A-B) Representative images showing that PntP2 antibody stains cortex glial cells (marked by NP2222-GAL4>mGFP, yellow arrows), NBs (white arrows) and neurons (blue arrows). B) is the zoomed in image of A). Scale bar = 50 mm.

      It should be mentioned on p.8 that the data in Fig.4A-K reproduce the findings of Avet-Rochex et al., 2012 and Read et al., 2009.

      We will correct this.

      4.Figure 6F. Presumably due to the increase in glia cell number and dramatic increase in glial cell volume, any gene that is specific to, or enriched in, cortex glia will have increased expression levels in RepoGal4>htlACT larval CNS. Can the authors provide evidence that the increase in the expression of these genes is specific to FGF transcriptional regulation and not just a relative increase in the levels of these genes due to an increase in cortex glia as proportion of total CNS volume? Is there any evidence that Hh, fasn1 and lsd2 are direct transcriptional targets of FGF signalling in glia?

      We agree that FGF activation causes a dramatic increase in glial cell number, thus will cause a relative increase in the level of hh, fasn1 and lsd2s. However, with RT-qPCR, the same amounts of total RNA (1μg) were extracted from control vs repo-GAL4> htlACT and reverse transcribed into cDNA for qPCR. Therefore, the mRNA level described in Figure 6 F are already normalized to the total amount of genetic material.

      In the literature, it is not reported that hh, fasn1 and lsd2 are direct transcriptional targets of FGF signalling. However, lipid metabolism rewiring is well known as a hallmark of glioblastoma. For example, high levels of FASN has been linked with high grade glioblastoma (Grube et al., 2014). Furthermore, FGF signalling has also been shown to modulate lipid metabolism and alter the transcription of the Lsd-2 homologue called Plin2 in a mouse model (Ye et al., 2016).

      To figure out whether hh, fasn1 and lsd2 are direct transcriptional targets of FGF signalling. we will have to first find out which TFs are altered in the glia upon altered FGF signalling via cortex glia specific RNA-seq, and then conduct DamID to identify their target genes. This would be interesting to follow-up but is however beyond the scope this current study.

      We will add a section on this in the discussion section of the revised ms.

      FGF signalling has been shown to be necessary and sufficient for cortex glial proliferation. So does knockdown of Htl, or expression of dominant negative Htl, cause a reduction in Hh, fasn1 and lsd2 expression in cortex glia?

      In response to glial htlDN overexpression, we observed a significant reduction in total glial number and overall Hh expression. However, RT-qPCR showed that mRNA levels of hh, fasn1 or lsd-2 were not altered upon htlDNoverexpression (Reviewer_Figure 3).

      This data will be included in the supplementary data in the revised ms.

      Reviewer_Figure 3. Glial htlDN overexpression doesn’t alter the expression of hh, fasn1 and lsd2. The mRNA levels of hh, fasn1 and lsd2 are normalized to the reference gene rpl32.

      Continued: If so, how does reduction of cortex glial numbers independent of FGF signalling, using for example knockdown of String or expression of Decapo, affect the expression of Hh, fasn1 and lsd2 in cortex glia?

      To address this question, we plan to assess the expression levels of hh, fasn1 and lsd-2 using glia specific expression of an inhibitor of the PI3K (delta p60), which has been shown by Speder and Brand, 2018 to cause a reduction in cortex glial number. We will also ascertain whether Decapo overexpression causes cortex glial niche impairment. If so, we will also assess the expression levels of hh, fasn1 and lsd-2 in this setting.

      6.Can the authors speculate on why and how increased levels of Hh in cortex glia, in the context of FGF activation, inhibit neuroblast cell cycle? Is this a physiological mechanism to limit neuroblast proliferation in the face of increased gliogenesis, or is it simply an indirect result of 'spillover' of excess Hh from cortex glia onto neuroblasts (which are autonomously regulated by Hh and so sensitive to this ligand) by due to increased cortex glia cells?

      We favour the model that excess Hh in the glia compartment “spills over” to reduce NB proliferation, which are autonomously regulated by Hh and therefore are sensitive to this ligand. We can add this to the discussion.

      **Minor comments:**

      -Figure 1C' some lipid droplets are extremely large, is this consistent with previous literature?

      These large lipid droplets are caused by lipid droplet fusion due to the use of detergent in this experiment. When we perform antibody staining together with lipid droplet staining, PBST detergent is required for antibody staining to work. However, this created the artefact of large lipid droplets, due to lipid droplet fusion. This has previously been reported by Bailey et al., 2015, and we have explained this in P19 of the Method section.

      -Including a profile plot of relative fluorescence intensity in Figure 1C',F',H' to illustrate colocalization of lipidTOX and Hh, would be helpful.

      We will include this in the revised ms.

      -Figure S3A,B quantify Hh protein level and CNS size phenotypes with Hh RNAi.

      We will include this in the revised ms.

      -p.6 include data showing overexpression of Hh does not cause glial overgrowth.

      We will include this in the revised ms.

      -Top of p.14 should be FigS6A-C.

      We will correct this.

      -Include quantification of glial overgrowth and lipid droplet phenotypes with HtlACT plus catalase and SOD1 overexpression (Fig. S6D-K).

      We will include this in the revised ms.

      Reviewer #2 (Significance (Required)):

      The is a novel and very interesting study, well written and the data are very clearly presented. It builds on and adds to the emerging literature on the glial niche and its role in neural stem cell regulation. It will be of great interest to Drosophila neurobiologists but also to the broader field of neural stem cell biology.

      My expertise is Drosophila neurobiology.








      Table 1. EdU+ NB numbers for each genotype described in each Figure

      Figure

      Genotype

      EdU incubation time

      Average EdU+ NB number

      SEM

      Number of samples

      Figure 2J

      repo-GAL4>w1118

      15 min

      66.63

      1.79

      16

      Figure 2J

      repo-GAL4>UAS-hh

      15 min

      57.35

      1.35

      20

      Figure 2K

      NP2222-GAL4>w1118

      15 min

      67.91

      1.44

      11

      Figure 2K

      NP2222-GAL4>UAS-hh

      15 min

      60.79

      0.79

      14

      Figure 2P

      dnab-GAL4>w1118

      15 min

      70.5

      1.44

      12

      Figure 2P

      dnab-GAL4>ciACT

      15 min

      60.1

      1.48

      10

      Figure S3C

      repo-GAL4>dcr2; mcherryRi

      10 min

      57.42

      0.63

      12

      Figure S3C

      repo-GAL4>dcr2; hhRi43255

      10 min

      48.56

      2.65

      9

      Figure 3K

      NP2222-GAL4>w1118

      The same dataset as Figure 2K

      Figure 3K

      NP2222-GAL4>UAS-hh

      Figure 3K

      NP2222-GAL4>UAS-hh; mcherryRi

      15 min

      57.44

      1.41

      16

      Figure 3K

      NP2222-GAL4>UAS-hh; lsdRi34617

      15 min

      63.36

      1.34

      14

      Figure 3K

      NP2222-GAL4>UAS-hh; mcherryRi

      15 min

      58.83

      2.61

      6

      Figure 3K

      NP2222-GAL4>UAS-hh; lsdRi32846

      15 min

      64.5

      1.2

      14

      Figure 5E

      repo-GAL4>w1118

      15 min

      71.6

      1.28

      15

      Figure 5E

      repo-GAL4>UAS-htlACT

      15 min

      56

      1.59

      14

      Figure 5E

      NP2222-GAL4>w1118

      15 min

      70.2

      1.58

      10

      Figure 5E

      NP2222-GAL4>UAS-htlACT

      15 min

      54.75

      1.24

      16

      Figure 6G

      NP2222-GAL4>w1118

      The same dataset as Figure 5E

      Figure 6G

      NP2222-GAL4>UAS-htlACT

      Figure 6G

      NP2222-GAL4>UAS-htlACT;mcherryRi

      15 min

      60

      1.24

      7

      Figure 6G

      NP2222-GAL4>UAS-htlACT;hhRi43255

      15 min

      67.17

      1.13

      12

      Figure 6G

      NP2222-GAL4>UAS-htlACT;mcherryRi

      15 min

      59.29

      1.79

      14

      Figure 6G

      NP2222-GAL4>UAS-htlACT;hhRi25794

      15 min

      68.55

      1.68

      11

      Figure 6H

      dnab-GAL4>mcherryRi

      10 min

      49.13

      1.6

      8

      Figure 6H

      dnab-GAL4>ciRi2125-R2

      10 min

      56.54

      1.27

      13

      Figure 6H

      repo-lexA>w1118

      15 min

      68.5

      1.1

      10

      Figure 6H

      repo-lexA>lexAop-htlACT

      15 min

      55.7

      2.15

      10

      Figure 6H

      repo-lexA>lexAop-htlACT; GFPRi

      15 min

      52

      1.58

      30

      Figure 6H

      repo-lexA>lexAop-htlACT; ciRiHMJ23860

      15 min

      62.4

      1.79

      15

      Figure 6H

      repo-lexA>lexAop-htlACT; GFPRi

      15 min

      56.33

      1.49

      12

      Figure 6H

      repo-lexA>lexAop-htlACT; ciRi2125-R2

      15 min

      62.86

      1.81

      7

      Figure 6J

      NP2222-GAL4>w1118

      The same dataset as Figure 5E

      Figure 6J

      NP2222-GAL4>UAS-htlACT

      Figure 6J

      NP2222-GAL4>UAS-htlACT;mcherryRi

      15 min

      58.64

      0.99

      14

      Figure 6J

      NP2222-GAL4>UAS-htlACT;fasn1Ri3523R2

      15 min

      65

      2.41

      9

      Figure 6J

      NP2222-GAL4>UAS-htlACT;mcherryRi

      The same dataset as Figure 6G control of NP2222-GAL4>UAS-htlACT;hhRi25794

      Figure 6J

      NP2222-GAL4>UAS-htlACT;lsd2Rikk102269

      15 min

      68.13

      1.08

      8

      Figure S5H

      NP2222-GAL4>mcherryRi

      15 min

      66.4

      1.71

      10

      Figure S5H

      NP2222-GAL4>fasn1Ri3523R6

      15 min

      65.5

      1.38

      10

      Figure S5H

      NP2222-GAL4>mcherryRi

      15 min

      66.4

      1.13

      15

      Figure S5H

      NP2222-GAL4>lsd2Rikk102269

      15 min

      64.2

      0.94

      10

      Figure S5H

      NP2222-GAL4>UAS-luc

      15 min

      65

      1.07

      10

      Figure S5H

      NP2222-GAL4>UAS-lsd2

      15 min

      64.9

      1.51

      10

      Figure S5I

      NP2222-GAL4>w1118

      The same dataset as Figure 5E

      Figure S5I

      NP2222-GAL4>UAS-htlACT

      Figure S5I

      NP2222-GAL4>UAS-htlACT;mcherryRi

      15 min

      57.93

      0.9

      14

      Figure S5I

      NP2222-GAL4>UAS-htlACT;fasn1Ri3523R6

      15 min

      63.79

      1.25

      14

      Figure S5I

      NP2222-GAL4>UAS-htlACT;mcherryRi

      15 min

      50.25

      2.52

      8

      Figure S5I

      NP2222-GAL4>UAS-htlACT;lsd2Ri32846

      15 min

      59.3

      1.2

      10

      Figure 7B

      NP2222-GAL4>mcherryRi

      15 min

      65

      0.93

      10

      Figure 7B

      NP2222-GAL4>raspRi11495R2

      15 min

      65.13

      1.29

      15

      Figure 7B

      NP2222-GAL4>w1118

      The same dataset as Figure 5E

      Figure 7B

      NP2222-GAL4>UAS-htlACT

      Figure 7B

      NP2222-GAL4>UAS-htlACT;mcherryRi

      15 min

      58.33

      1.06

      18

      Figure 7B

      NP2222-GAL4>UAS-htlACT;raspRi11495R1

      15 min

      63.95

      1.05

      21

      Figure 7B

      NP2222-GAL4>UAS-htlACT;mcherryRi

      15 min

      59.04

      1.019

      26

      Figure 7B

      NP2222-GAL4>UAS-htlACT;raspRi11495R2

      15 min

      63.07

      0.92

      29

      Figure 7D

      NP2222-GAL4>w1118

      15 min

      69.46

      1.02

      13

      Figure 7D

      NP2222-GAL4>UAS-hh.N.EGFP

      15 min

      52.25

      1.9

      12

      Figure 7F

      repo-GAL4>UAS-hh.N.EGFP;mcherryRi

      15 min

      54.4

      1.18

      15

      Figure 7D

      repo-GAL4>UAS-hh.N.EGFP;fasn1Ri3523R2

      15 min

      65.69

      1.43

      13

      Figure S6L

      NP2222-GAL4>UAS-htlACT; UAS-LacZ

      15 min

      59.17

      1.18

      12

      Figure S6L

      NP2222-GAL4>UAS-htlACT; UAS-Cat.A

      15 min

      64

      1.31

      12

      Figure S6L

      NP2222-GAL4>UAS-htlACT; UAS-LacZ

      15 min

      53.6

      2.32

      10

      Figure S6L

      NP2222-GAL4>UAS-htlACT; UAS-Sod.1

      15 min

      62.7

      1.76

      10

      Table 2. Raw data on glial number

      Figure

      Genotype

      Average Repo+glial number

      SEM

      Number of samples

      Figure 2D

      repo-GAL4>dcr2; mcherryRi

      843

      44.29

      7

      Figure 2D

      repo-GAL4>dcr2; hhRi43255

      666.5

      46.77

      8

      Figure 4K

      NP2222-GAL4>w1118

      1165

      20.55

      10

      Figure 4K

      NP2222-GAL4>htlACT

      2325

      107.5

      10

      Figure 4K

      NP2222-GAL4>InRwt

      1189

      85.92

      10

      Figure 4K

      wrapper-GAL4>w1118

      1305

      51.78

      7

      Figure 4K

      wrapper-GAL4>EgfrACT

      1192

      38.16

      12

      Reference:

      Avet-Rochex, A., Kaul, A.K., Gatt, A.P., McNeill, H., and Bateman, J.M. (2012). Concerted control of gliogenesis by InR/TOR and FGF signalling in the Drosophila post-embryonic brain. Development 139, 2763-2772.

      Bailey, A.P., Koster, G., Guillermier, C., Hirst, E.M., MacRae, J.I., Lechene, C.P., Postle, A.D., and Gould, A.P. (2015). Antioxidant Role for Lipid Droplets in a Stem Cell Niche of Drosophila. Cell 163, 340-353.

      Forero, M.G., Kato, K., and Hidalgo, A. (2012). Automatic cell counting in vivo in the larval nervous system of Drosophila. J Microsc 246, 202-212.

      Grube, S., Dunisch, P., Freitag, D., Klausnitzer, M., Sakr, Y., Walter, J., Kalff, R., and Ewald, C. (2014). Overexpression of fatty acid synthase in human gliomas correlates with the WHO tumor grade and inhibition with Orlistat reduces cell viability and triggers apoptosis. J Neurooncol 118, 277-287.

      Homem, C.C., and Knoblich, J.A. (2012). Drosophila neuroblasts: a model for stem cell biology. Development 139, 4297-4310.

      Kanai, M.I., Kim, M.J., Akiyama, T., Takemura, M., Wharton, K., O'Connor, M.B., and Nakato, H. (2018). Regulation of neuroblast proliferation by surface glia in the Drosophila larval brain. Sci Rep 8, 3730.

      Read, R.D. (2018). Pvr receptor tyrosine kinase signaling promotes post-embryonic morphogenesis, and survival of glia and neural progenitor cells in Drosophila. Development 145.

      Speder, P., and Brand, A.H. (2018). Systemic and local cues drive neural stem cell niche remodelling during neurogenesis in Drosophila. Elife 7.

      Ye, M., Lu, W., Wang, X., Wang, C., Abbruzzese, J.L., Liang, G., Li, X., and Luo, Y. (2016). FGF21-FGFR1 Coordinates Phospholipid Homeostasis, Lipid Droplet Function, and ER Stress in Obesity. Endocrinology 157, 4754-4769.

    2. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #2

      Evidence, reproducibility and clarity

      Summary:

      The study by Dong et al., investigates the role of Hedgehog in the glial niche during larval neurogenesis in Drosophila. The authors describe the expression of Hh in cortex glia and its association with lipid droplets. They show that Hh expression in cortex glia is required for cortex glial proliferation, cell autonomously, and for maintenance of the normal cell cycle in neuroblasts. They go on to use a well characterised Drosophila glioma model, activation of FGF signalling, to investigate the requirement for Hh during cortex glial overgrowth. They show that FGF-activated cortex glial overproliferation requires Hh for modulation of neuroblast cell cycle, although Hh does not regulate cortex glial proliferation in this context. Finally, they show that inhibition of lipid modification of Hh rescues the neuroblast proliferation cell cycle defect caused by FGF activation in cortex glia.

      Major comments:

      1.From the data in presented in Fig. 2H-K and Fig. S3C, I am very confused about role of Hh in the non-cell autonomous regulation of neuroblast cell cycle. Both RNAi and overexpression of Hh with Repo-Gal4 cause a reduction in the neuroblast EdU index (Fig. 2H-K and S3C). The authors conclude this section on p.7 saying "Together, our data suggests that high levels of glial Hh expression restricts NB cell cycle progression." This statement is not consistent with data. What is the normal physiological role of Hh if both decreased and increased levels of cortex glial Hh expression reduce neuroblast cell cycle? The discussion of p.15 does not clarify this issue. The model in Fig.7J relates to the role of Hh in the context of cortex glial FGF activation and does not illustrate the normal physiological role of Hh in the regulation of neuroblast cell cycle.

      2.P.8 "Analysis of the total glial cell number indicates overexpression of htlACT, but not InRwt or EgfrACT, led to an increase in the number of cortex glial cells (Figure 4E-G, I-K)." This statement is confusing as Repo staining was used to quantify total glial numbers (including perineural, sub-perineural and cortex glia) but these data are then taken to represent and increase specifically in cortex glia. This should be clarified.

      3.It should be mentioned on p.8 that the data in Fig.4A-K reproduce the findings of Avet-Rochex et al., 2012 and Read et al., 2009.

      4.Figure 6F. Presumably due to the increase in glia cell number and dramatic increase in glial cell volume, any gene that is specific to, or enriched in, cortex glia will have increased expression levels in RepoGal4>htlACT larval CNS. Can the authors provide evidence that the increase in the expression of these genes is specific to FGF transcriptional regulation and not just a relative increase in the levels of these genes due to an increase in cortex glia as proportion of total CNS volume? Is there any evidence that Hh, fasn1 and lsd2 are direct transcriptional targets of FGF signalling in glia?

      5.FGF signalling has been shown to be necessary and sufficient for cortex glial proliferation. So does knockdown of Htl, or expression of dominant negative Htl, cause a reduction in Hh, fasn1 and lsd2 expression in cortex glia? If so, does how does reduction of cortex glial numbers independent of FGF signalling, using for example knockdown of String or expression of Decapo, affect the expression of Hh, fasn1 and lsd2 in cortex glia?

      6.Can the authors speculate on why and how increased levels of Hh in cortex glia, in the context of FGF activation, inhibit neuroblast cell cycle? Is this a physiological mechanism to limit neuroblast proliferation in the face of increased gliogenesis, or is it simply an indirect result of 'spillover' of excess Hh from cortex glia onto neuroblasts (which are autonomously regulated by Hh and so sensitive to this ligand) by due to increased cortex glia cells?

      Minor comments:

      -Figure 1C' some lipid droplets are extremely large, is this consistent with previous literature?

      -Including a profile plot of relative fluorescence intensity in Figure 1C',F',H' to illustrate colocalization of lipidTOX and Hh, would be helpful.

      -Figure S3A,B quantify Hh protein level and CNS size phenotypes with Hh RNAi.

      -p.6 include data showing overexpression of Hh does not cause glial overgrowth.

      -Top of p.14 should be FigS6A-C.

      -Include quantification of glial overgrowth and lipid droplet phenotypes with HtlACT plus catalase and SOD1 overexpression (Fig. S6D-K).

      Significance

      The is a novel and very interesting study, well written and the data are very clearly presented. It builds on and adds to the emerging literature on the glial niche and its role in neural stem cell regulation. It will be of great interest to Drosophila neurobiologists but also to the broader field of neural stem cell biology.

      My expertise is Drosophila neurobiology.

    3. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #1

      Evidence, reproducibility and clarity

      Summary:

      In this study, the authors investigate the role of hedgehog signaling and lipid metabolism in the neural stem cell niche of the Drosophila larvae. They demonstrate that Hedgehog localizes to lipid droplets in glial cells and show that Hh is necessary but not sufficient for elaboration of glial membranes and normal rates of glial proliferation during development. In addition, they provide an extensive set of results in support of a model that FGF signaling functions upstream of lipid metabolism and hh in glial cells as well as a parallel ROS mediated pathway in glial cells to promote neuroblast proliferation. In general, the results provide strong support for the conclusions. Specifically, the approaches are sound, the images clearly demonstrate the phenotypes described, and the effects are quantified and tested for statistical significance.

      Major comments:

      1.Since Hh RNAi decreases the glial compartment (which slows NB proliferation) and increases the frequency of pH3+ NBs, it is unclear why it would decrease the number of EdU+ NBs (Fig. S3C).

      2.If overexpression of htl[ACT] slows the NB cell cycle (as evidenced by reduced pH3 and EdU positive cells), it unclear why it does not reduce the number of NBs (Fig. 4L).

      3.What is the justification for presenting the EdU quantifications as an EdU index in which the experimental values are normalized to the average number of positive cells in the control? In many cases, the comparison is to the same w[1118] line so it does not control for a specific genetic backgrounds and yet this method may be obscuring experimental variation present between datasets. Likewise, why is glial number presented as a fold-change but NB number is presented as raw counts (e.g. 2D vs S3E)?

      Minor comments:

      On the top of P.14, "Figure S7A-C" should probably be "Figure S6A-C"

      Significance

      The cell autonomous regulation of growth and proliferation of neuroblasts in the larval brain have been well-studied, but much less is known about the non-cell autonomous signals. This paper significantly moves forward knowledge in this area by describing multiple steps of a molecular mechanism for glial regulation of the neuroblast cell cycle. These findings would be of interest not only to the study of Drosophila neuroblasts, but also to the broader adult stem cell field.

      My expertise is in Drosophila stem cell biology and genetics.

    1. Note: This rebuttal was posted by the corresponding author to Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Reply to the reviewers

      We thank the three reviewers for providing valuable feedback on our original manuscript. A point-by-point response to all of these comments is provided below. [Note that figures are not added in-line because of text-only limitations.]

      Reviewer #1 (Evidence, reproducibility and clarity (Required)):

      The submitted manuscript entitled 'Predicting cell health phenotypes using image-based morphology profiling' (RC-2020-00394) by Way et al. presents a set of seven dyes/staining (as two separate panels) to microscopically screen cell viability. For automatic classification a training/test set of 119 CRISPR (approximately 2 sgRNAs per gene) perturbations on 3 cancer cell lines were generated (lung A549, ovarian ES2, lung HCC44). After segmentation of cell nuclei a set of morphological cell measurements were extracted from each perturbation (total 952 features). The nature of these feature spanning cell cycle and viability phenotypes, enabled the authors to define 70 different phenotype classes, which are used to model a classifier by elastic linear regression. Specific definitions (cell cycle and ROS) were partly predicted/validated in an independent existing image data set (Drug Repurposing Hub project). The data is available as web-based application/visualization and the supplementary method is well described.

      We thank the reviewer for their constructive comments and helpful feedback.

      There is one subtle point that is worth raising given this description: The images we use to measure the cell cycle and viability phenotypes (two different staining panels in the Cell Health assays) are not the same images we use to extract morphology measurements (Cell Painting assay). This lack of connection, which is based on a light wavelength limitation present in all microscopes that limits the number of stains in a single assay, prevents us from developing a method that analyzes the same cells across the three assays. This distinction will become important later in the review, and we have made specific changes in the manuscript to increase clarity.

      **Major concerns:**

      (1)The only fundamental argument of this manuscript not to apply state-of-the-art deep learning (DL) machine-learning (mentioned in McCain et al. 2018), which does not require segmentation, feature extraction, abstraction, manual gating is the 'interpretability' of the predictions. However, performance, precision, scalability (by modern GPUs) with DL should clearly outperform 'manual' regression models. All recent machine vision benchmarks in microscopy confirm this, but also clearly shows 'real world' translational applications, e.g.

      https://www.nature.com/articles/s43018-020-0085-8,

      https://www.biorxiv.org/content/10.1101/2020.07.02.183814v1.full.pdf,

      In other words, the presented methodology is not compared to DL, and is not convincing in terms of interpretability benefits.

      (We’ve copied a similar critique from __Significance sectio__n from Reviewer #1 in order to reduce redundancy) The author/co-authors have been instrumental/pioneered with their past work on cell-based image processing (CellProfiler software), but the presented methodology is simply outdated. Therefore, a revision towards a comparison and benchmarking with DL will also not help.

      Ref (DL with MIL): https://academic.oup.com/bioinformatics/article/32/12/i52/2288769

      We agree that deep learning approaches are exciting; much of our laboratory’s work focuses on their application (see https://doi.org/10.1073/pnas.2001227117, https://doi.org/10.1038/s41592-019-0612-7; https://doi.org/10.1002/cyto.a.23863, https://doi.org/10.1109/CVPR.2018.00970), and we agree that they are likely to outperform simpler regression models trained using so-called hand-engineered features. We thank the reviewer for highlighting our failure to accurately and fully describe our rationale.

      We intentionally did not use deep learning for this problem given (a) data limitations (b) the primary goal of the manuscript, which is to demonstrate feasibility.

      Data limitations. There is no mechanism to link the cells of the assays (Cell Health and Cell Painting) together, which greatly reduces the available sample size. In the two referenced manuscripts, which each propose an exciting approach, the dataset is much larger (~17,000 and ~1,000 images respectively). Our dataset is only 357 perturbations that can only be linked between assays at the perturbation level rather than a single-cell level. Therefore, a deep learning approach is likely to produce models that don’t generalize to other datasets. Furthermore, reviewer 3 commented in favor of the approach we presented: “Using elastic net regression models is well-suited to the problem due to the low number of observations.”

      Primary goal of the manuscript is to demonstrate feasibility. In addition, the primary goal of the manuscript is to add cell health annotations as functional readouts to perturbations. Our aim was to demonstrate feasibility of predicting cell health states, not to optimize performance. Optimizing performance would require collecting much more data, or developing new deep learning or data collection methods to account for the lack of matched single cell readouts.

      To make this rationale more clear and concise, we have made the following changes in the manuscript:

      In the first paragraph of page 3, we make some minor contextual updates (”To demonstrate proof of concept, we collected a small pilot dataset of 119 CRISPR knockout perturbations…”) and replaced “We used simple machine learning methods, which are relatively easy to interpret compared to deep learning” with:

      We used simple machine learning methods instead of a deep learning approach because of our limited sample size of 119 perturbations and the inability to increase the sample size by linking single cell measurements across assays.

      We have also amended the Conclusions section to emphasize our primary goal and note possible deep learning extensions as future directions. The Conclusions now reads:

      We have demonstrated feasibility that information in Cell Painting images can predict many different Cell Health indicators even when trained on a small dataset. The results motivate collecting larger datasets for training, with more perturbations and multiple cell lines. These new datasets would enable the development of more expressive models, based on deep learning, that can be applied to single cells. Including orthogonal imaging markers of CRISPR infection would also enable us to isolate cells with expected morphologies. More data and better models would improve the performance and generalizability of Cell Health models and enable annotation of new and existing large-scale Cell Painting datasets with important mechanisms of cell health and toxicity.

      (2)One aforementioned point of the methodology is cryptically/not described: Why it should be less expensive compared with other (which?) approaches (see introduction)?

      We thank the reviewer for bringing up this point. We believe that part of this confusion stems from a slight misunderstanding about how images from the three assays (two Cell Health and one Cell Painting) are collected. The Cell Health assays are two distinct panels of targeted reagents that are separately prepared as two physically distinct assays. The Cell Painting assay is already an established assay used by many labs and companies around the world to mark cell morphology in an unbiased and relatively cheap way. We are comparing the expenses between the two Cell Health assays vs. the Cell Painting assay.

      We believe that this misunderstanding likely results from our somewhat cryptic and inconsistent language when describing the Cell Health assays in the abstract and introduction. We’ve updated the third sentence of the abstract from “We developed two customized microscopy assays that use seven reagents to measure 70 specific cell health phenotypes...” to now read:

      We developed two customized microscopy assays, one using four targeted reagents and the other three targeted reagents, to collectively measure 70 specific cell health phenotypes including proliferation, apoptosis, reactive oxygen species (ROS), DNA damage, and cell cycle stage.

      For consistency, we have also updated the penultimate paragraph in the introduction to now read:

      To do this, we first developed two customized microscopy assays, which collectively report on 70 different cell health indicators via a total of seven reagents applied in two reagent panels. Collectively, we call these assays “Cell Health”.

      With these clarifications in mind, we believe that the question of comparing monetary costs is more clear. We are comparing the costs of the targeted reagents in the two Cell Health assays to the unbiased reagents in the single Cell Painting assay. We’ve also modified the last two sentences in the first paragraph of the introduction to strengthen the connection between Cell Health assays, targeted reagents, and high cost:

      Cell health is normally assessed by eye or measured by specifically targeted reagents, which are either focused on a single Cell Health parameter (ATP assays) or multiple, in combination, via FACS-based or image-based analyses, which involves a manual gating approach, complicated staining procedures, and significant reagent cost. These traditional approaches limit the ability to scale to large perturbation libraries such as candidate compounds in academic and pharmaceutical screening centers.

      (3)Generalizability and/or training data size is essential for any model-based classification, but not evaluated or validated in the current manuscript. The independent validation on a A549 cell line only data might be not sufficient/convincing.

      We separately address the two distinct points raised by the reviewer of 1) generalizability and 2) training data size:

      Generalizability We agree that any model-based classification must demonstrate generalizability. For this reason, we have taken careful consideration to assess the generalizability of all 70 models in two contexts. First, we assessed model performance in a single held out test set (15% of all data). All results we report in the main text (e.g. Figure 2) report performance on this test set. We see high performance in many (but not all) models, and we observe much better model performance compared to a negative control baseline (New Supplementary Figure S5). High performance in the test set indicates that, for some cell health indicators, the models generalize well.

      Second, we also demonstrate that these models generalize to data from an entirely different experiment using a fundamentally different perturbation (CRISPR vs. drug compounds). We demonstrate generalizability to this external validation data in four different ways: 1) Validating a relatively simple model (“Number of Live Cells”) with an orthogonal viability readout from the PRISM assay (barcoding-based cell viability; updated Figure 4); 2) Demonstrating that proteasome inhibitors, which are known to produce reactive oxygen species, are predicted to do so; 3) Demonstrating that PLK inhibitors, which are known to reduce entry to G1, show a robust dose response in the "G1 Cell Count" model; and 4) Demonstrating that aurora kinase and tubulin inhibitors are predicted to induce high DNA damage (gH2AX) in G1 cells. These two drug classes are known to cause “mitotic slippage” and double stranded DNA breaks. The fourth example was added in response to a comment by reviewer 3.

      We’ve also added a series of enrichment tests, as described in the following new text:

      We also chose to validate three additional models: ROS, G1 cell count, and Number of gH2AX spots in G1 cells. We observed that the two proteasome inhibitors (bortezomib and MG-132) in the Drug Repurposing Hub set yielded high ROS predictions (OR = 76.7; p -15) (Figure 4C). Proteasome inhibitors are known to induce ROS (Han and Park, 2010; Ling et al., 2003). As well, PLK inhibitors yielded low G1 cell counts (OR = 0.035; p = 3.9 x 10-8) (Figure 4C). The PLK inhibitor HM-214 showed an appropriate dose response (Figure 4D). PLK inhibitors block mitotic progression, thus reducing entry into the G1 cell cycle phase (Lee et al., 2014). Lastly, we observed that aurora kinase and tubulin inhibitors were enriched for high Number of gH2AX spots in G1 cells predictions (OR = 11.3; p -15) (Figure 4E). In particular, we observed a strong dose response for the aurora kinase inhibitor barasertib (AZD1152) (Figure 4F). Aurora kinase and tubulin inhibitors cause prolonged mitotic arrest, which can lead to mitotic slippage, G1 arrest, DNA damage, and senescence (Orth et al. 2011; Cheng and Crasta 2017; Tsuda et al. 2017).

      The updated methods section describing our approach to assess generalizability perform the enrichment tests now states:

      Assessing generalizability of cell health models applied to Drug Repurposing Hub data

      We used our cell health webapp (https://broad.io/cell-health-app) to identify compounds with high predictions for three models with high or intermediate performance: ROS, Number of G1 cells, and Number of gH2AX spots in G1 cells. For each model, we identified classes of compounds with consistently high scores, then tested for statistical enrichment: for proteasome inhibitors in the ROS model, PLK inhibitors in the Number of G1 cells model, and aurora kinase and tubulin inhibitors in the Number of gH2AX spots in G1 cells model. We used one-sided Fisher’s exact tests to quantify differences in expected proportions between high and low model predictions. For each case, we determined high and low predictions based on the 50% quantile threshold for each model independently.

      We acknowledge that prospectively making predictions and measuring Cell Health readouts directly in a new experiment would be more convincing, but we note that our existing assessment of generalizability in an external experiment is already unusual in machine learning publications. Additionally and unfortunately, collecting a second validation dataset for this manuscript is not currently feasible given experiments backlogged from COVID.

      1. Training data size

      We also agree that a more comprehensive analysis on training data size would be an important indicator of model limitations. Therefore, we performed a sample titration analysis in which we randomly dropped samples from the training procedure, and tracked performance of the held out test set. We add the following figure, figure legend, and results text to describe and interpret the results.

      Supplementary Figure S13: Dropping samples from training reduces test set model performance in high, mid, and low performing models. We determined model performance stratification by taking the top third, mid third, and bottom third of test set performance when using all data. We performed the sample titration analysis with 10 different random seeds and visualized the median test set performance for each model.

      We updated the results section to introduce and discuss this result:

      Lastly, we performed a sample size titration analysis in which we randomly removed a decreasing amount of samples from training. For the high and mid performing models, we observed a consistent performance drop, suggesting that increasing sample size would result in better overall performance (Supplementary Figure 13).

      Finally, the updated methods section describing our sample titration analysis now reads:

      Machine learning robustness: Investigating the impact of sample size

      We performed an analysis in which we randomly dropped an increasing amount of samples from the training set before model training. After dropping the predefined number of samples, we retrained all 70 cell health models and assessed performance on the original holdout test set. We performed this procedure ten times with ten unique random seeds to mirror a more realistic scenario of new data collection and to reduce the impact of outlier samples on model training.

      All software updates introducing this analysis can be viewed at https://github.com/broadinstitute/cell-health/pull/143

      **Minor concerns:**

      (1)Highest test performance comprises that precision is mainly driven by cell cycle/count and live status and could be probably derived from DRAQ7 (Fig. 2) and DNA granularity (Fig. 3, bottom right) and would argue for rigid feature selection across channels and features.

      We believe that clarifying the confusion between the two Cell Health assays we developed and the well-established Cell Painting assay addresses part of this concern. The DRAQ7 dye marks dead cells, and is measured in Cell Health. In other words, readouts from this reagent are what we aim to predict, not what we use for training. Indeed, DRAQ7-based phenotypes are among the top predicted models, which is a result we present in Supplementary Figure S7 - this figure uncovers which Cell Health phenotypes are more easily predicted by Cell Painting.

      The DNA granularity morphology measurements are collected from the Cell Painting assay and thus are available for training, and, as noted by the reviewer, encode a high proportion of signal in predicting the various cell health phenotypes. In our most common processing workflows for other projects, we do apply a rigid feature selection pipeline to all Cell Painting profiles before analysis, but we do not do this in this analysis since we were using a model with a sparsity-inducing penalty (elastic net).

      To directly answer the question of how channels and feature groups influence model performance, we’ve performed a systematic experiment removing different channel, compartment, and feature groups and retraining all models with the specific group dropped. We now include the following supplementary figure:

      Supplementary Figure S12: Systematically removing classes of features has little impact on most models’ performance. We retrained all 70 cell health models after dropping features associated with specific (a) feature groups, (b) channels, and (c) compartments. Each dot is one model (predictor), and the performance difference between the original model and the retrained model after dropping features is shown on the x axis. Any positive change indicates that the models got worse after dropping the feature group. (d) Individual model differences in performance after dropping features. Each dot is one class of features removed (as in a-c).

      Additionally, we updated the results section to introduce and discuss this result:

      We also performed a systematic feature removal analysis, in which we retrained cell health models after dropping features that are measured from specific groups, compartments, and channels. We observed that most models were robust to dropping entire feature classes during training (Supplementary Figure 12). This result demonstrates that many Cell Painting features are highly correlated, which might permit prediction “rescue” even if the directly implicated morphology features are not measured. Because of this, we urge caution when generating hypotheses regarding causal relationships between readouts and individual Cell Painting features.

      And we add the following to the methods section:

      Machine learning robustness: Systematically removing feature classes

      We performed an analysis in which we systematically dropped features measured in specific compartments (Nuclei, Cells, and Cytoplasm), specific channels (RNA, Mito, ER, DNA, AGP), and specific feature groups (Texture, Radial Distribution, Neighbors, Intensity, Granularity, Correlation, Area Shape) and retrained all models. We omitted one feature class and then independently optimized all 70 cell health models as described in the Machine learning framework results section above. We repeated this procedure once per feature class.

      All software updates introducing this analysis can be viewed at https://github.com/broadinstitute/cell-health/pull/143

      (2)Any H2AX and 'polynuclear' would probably fail in any cell line with this size of training data.

      Indeed we would expect certain cell health phenotype models to fail if they had few hits and a relatively low variance of output values. This hit rate is directly associated with the phenotypes that the CRISPR perturbations induce, which is why we intentionally selected them to span multiple gene pathways in an attempt to maximize morphology diversity (see Supplementary Table S1).

      We did indeed observe that the polynuclear model had few hits in the training data and relatively poor performance. We did not expect this result, given that DNA stains are captured in the Cell Health and Cell Painting assays. We suspect the poor performance in this model is likely because so few cells were classified as polynuclear in our gating strategy, making it perhaps an inconsistently measured readout.

      By contrast, some gH2AX models did have relatively good performance. In the conclusion, we note that increased training data size using more perturbations is likely to improve model performance:

      The results motivate collecting larger datasets for training, with more perturbations and multiple cell lines. These new datasets would enable the development of more expressive models, based on deep learning, that can be applied to single cells. Including orthogonal imaging markers of CRISPR infection would also enable us to isolate cells with expected morphologies. More data and better models would improve the performance and generalizability of Cell Health models and enable annotation of new and existing large-scale Cell Painting datasets with important mechanisms of cell health and toxicity.

      (3)To what refers the 'weights' of the model in Fig. 1c?

      We thank the reviewer for pointing out that we never defined this term in the Figure 1 legend. We use “weights” to refer to the coefficients from the regression model. To make this more clear, we have updated the legend to now read: “Model coefficient weights” and the text in Figure 1C to now read “model weights”.

      Reviewer #1 (Significance (Required)):

      This manuscript is not advanced in the context of latest improvements/developments of cell-based microscopic classification. Rationale in the introduction and the conclusion are not linked (interpretability, generalizability, costs). It seems to be unfinished or unformatted to this end?

      Since responding to these reviews, we believe that our primary motivation - to demonstrate proof-of-concept of predicting cell health phenotypes directly from Cell Painting data - is now much clearer, holistically. We provide below an updated introduction, which improves rationale.

      Perturbing cells with specific genetic and chemical reagents in different environmental contexts impacts cells in various ways (Kitano, 2002). For example, certain perturbations impact cell health by stalling cells in specific cell cycle stages, increasing or decreasing proliferation rate, or inducing cell death via specific pathways (Markowetz, 2010; Szalai et al., 2019). Cell health is normally assessed by eye or measured by specifically targeted reagents, which are either focused on a single Cell Health parameter (ATP assays) or multiple, in combination, via FACS-based or image-based analyses, which involves a manual gating approach, complicated staining procedures, and significant reagent cost. These traditional approaches limit the ability to scale to large perturbation libraries such as candidate compounds in academic and pharmaceutical screening centers.

      Image-based profiling assays are increasingly being used to quantitatively study the morphological impact of chemical and genetic perturbations in various cell contexts (Caicedo et al., 2016; Scheeder et al., 2018). One unbiased assay, called Cell Painting, stains for various cellular compartments and organelles using non-specific and inexpensive reagents (Gustafsdottir et al., 2013). Cell Painting has been used to identify small-molecule mechanisms of action (MOA), study the impact of overexpressing cancer mutations, and discover new bioactive mechanisms, among many other applications (Caicedo et al., 2018; Christoforow et al., 2019; Hughes et al., 2020; Pahl and Sievers, 2019; Rohban et al., 2017; Simm et al., 2018; Wawer et al., 2014). Additionally, Cell Painting can predict mammalian toxicity levels for environmental chemicals (Nyffeler et al., 2020) and some of its derived morphology measurements are readily interpreted by cell biologists and relate to cell health (Bray et al., 2016). However, no single assay enables discovery of fine-grained cell health readouts.

      We hypothesized that we could predict many cell health readouts directly from the Cell Painting data, which is already available for hundreds of thousands of perturbations. This would enable the rapid and interpretable annotation of small molecules or genetic perturbations. To do this, we first developed a customized microscopy assays, which collectively report on 70 different cell health indicators via a total of seven reagents applied in two reagent panels. Collectively, we call these assay panels “Cell Health”.

      To demonstrate proof of concept, we collected a small pilot dataset of 119 CRISPR knockout perturbations in three different cell lines using Cell Painting and Cell Health. We used the Cell Painting morphology readouts to train 70 different regression models to predict each Cell Health indicator independently. We used simple machine learning methods instead of a deep learning approach because of our limited sample size and the inability to increase it by linking single cell measurements from both assays. We predicted certain readouts, such as the number of S phase cells, with high performance, while performance on other readouts, such as DNA damage in G2 phase cells, was low. We applied and validated these models on a separate set of existing Cell Painting images acquired from 1,571 compound perturbations measured across six different doses from the Drug Repurposing Hub project (Corsello et al., 2017). We provide all predictions in an intuitive web-based application at http://broad.io/cell-health-app, so that others can extend our work and explore cell health impacts of specific compounds.

      Reviewer #2 (Evidence, reproducibility and clarity (Required)):

      This report from Way et al describes a method of extending a very popular screening technology called Cell Painting developed by the Carpenter Lab. The authors are contending with an important issue and as such this paper potentially will be of great interest to the community. Cell Painting provides quantitative fingerprints of cell phenotypes in response to changes in the molecular or physiological status of cells. However the molecular basis or even the candidate pathways for those changes is not always clear. Here, the authors take specific markers of cell physiology, e.g., DNA damage, ROS production, cell cycle progression etc. and relate them to Cell Painting features. The authors are trying to address the issue that running many probes of cell physiology is expensive and time consuming and that identifying proxies for these assays using much simpler Cell Painting technologies would be a useful and potentially powerful approach. The overall goal is to develop some type of regression model that can link the state of cells (the "health") to Cell Painting fingerprints.

      The authors use three separate cell lines and CRISPR knockouts delivered through lentivirus that target 59 genes to establish a range of cell physiologies that they directly measure (the "Cell Health") and then relate to similar assays performed by Cell Painting. Ultimately they aim to use Cell Painting models to predict Cell Health.

      We thank the reviewer for their succinct summary of our goals and rationale for this manuscript, and for the constructive and valuable comments herein.

      **Major Issues:**

      It appears that the phenotypes that are detected at a high enough level of significance (see Fig. 2), e.g DNA damage (gH2Ax), apoptosis (Caspase 3/7), dead cells, ROS (CellROX), etc. are probably most easily detected by simply monitoring DAPI signal in these screens. To detect many of the phenotypes, the authors have presented a fairly complex method of doing much simpler assays. The authors correctly highlight in Fig. 3 that the phenotypes they are detecting go beyond pure signals from DAPI. They report power in their models from Radial Distribution across many different components of the Cell Painting feature set.

      We agree that the two assays we’re collectively calling “Cell Health” are indeed fairly complex - we use two different panels of multiplexed stains and a series of gating strategies to measure phenotypes in various cell subpopulations. However, the fundamental message in the manuscript is that we may no longer need to perform these complex assays if we get this information from the simpler Cell Painting assay.

      We agree that our machine learning approach to predict the various cell health phenotypes uses signals beyond nucleus-based stains. However, even if we are predicting just DAPI signals, this reinforces our argument that the specific stains in the Cell Health assays (which are commonly used in targeted experiments) are not necessary to measure specifically. Instead, in certain circumstances, a scientist should just use unbiased stains to capture their biology of interest, since the stains are cheaper at scale and one has access to much more information.

      It is also worth noting that the DNA damage phenotypes in specific cell subpopulations (e.g. DNA Damage in G1 cells) would not be possible to measure with high precision without EdU co-staining.

      However these appear to give outputs that won't be that useful. It is hard to tell whether this is simply because they don't have enough images or whether their signal is confounded by using cell lines where the lentivirus CRISPR knockouts are working less efficiently.

      (Reviewer 2 introduced a similar critique below, which we now move here) A fundamental issue that the authors mention but do not address is the efficiency of the CRISPR KOs. The authors should measure the efficiency of representative guides and present these data to help support the interpretation of their models.

      We definitely agree that sample size is a limitation in this manuscript. Our primary goal with this paper was to demonstrate feasibility of the approach to predict the targeted Cell Health readouts using a simpler (and more affordable/scalable) assay in Cell Painting. The promising results we observed, especially given this sample size limitation, motivates collecting a larger dataset using more perturbations.

      Potentially confounded signal by low efficiency CRISPR knockouts is also an interesting topic. We do provide Supplementary Figure S8 to describe a subtle relationship that we observed regarding CRISPR infection efficiency. We also discuss this in the results as: “We observed overall better predictivity in ES2 cells, which had the highest CRISPR infection efficiency (Supplementary Figure 8), suggesting that stronger perturbations provide better information for training and that training on additional data should provide further benefit.”

      Additionally, we made a substantial effort to maximize CRISPR efficiency by independently optimizing lentivirus volumes for each sgRNA. In general, we observed that some cell lines are easier to CRISPR, probably based on more factors beyond Cas9 expression. However, we note that CRISPR is being used simply as a perturbation to elicit a variable morphology response. In other words, the type, efficacy, and even accuracy of perturbation does not matter as long as it satisfies two constraints: 1) induces a morphology response for a sufficient number of perturbations, and 2) is consistent between the two assays (Cell Health and Cell Painting). Our setup satisfies both constraints.

      However, this experiment (and data from the experiment) can be used in other contexts in which the CRISPR efficiency is extremely important. Therefore, we added three columns to Supplementary Table 1 providing the efficiency readouts for the three cell lines. (This information was already present in GitHub, but we moved it to a more obvious location in Supplementary Table 1). Code describing this change can be viewed here: https://github.com/broadinstitute/cell-health/pull/142

      In regards to the first sentence of this concern: “However these appear to give outputs that won’t be that useful” - indeed, we fully expected that many cell health readouts would be difficult to predict. In the original submission, we included the following explanation for potential sources of low performing models: ”Performance differences might result from random technical variation, small sample sizes for training models, different number of cells in certain Cell Health subpopulations (e.g. mitosis or polynuclear cells), fewer cells collected in the viability panel (see methods), or the inability of Cell Painting reagents to capture certain phenotypes.”

      It seems misleading (or perhaps the explanation lacks clarity) to describe in the same paragraph the need to validate the model by applying it to new datasets, namely the Drug Repurposing Hub project, then describe gradients in cell health features across UMAP coordinates.

      We thank the reviewer for pointing out this source of confusion and for providing an opportunity to improve the clarity of this section. Our major revisions here are as follows: 1) Introduce the Drug Repurposing Hub as an external dataset for validation; 2) Validate a high performing and simple model (number of live cells) by comparing model readout predictions from the Drug Repurposing Hub Cell Painting profiles against orthogonal PRISM viability readouts (in compounds with slightly different doses); 3) Validate three additional models: enrichment of proteasome inhibitors in the ROS model, enrichment of PLK inhibitors in the G1 cell count model, and enrichment of tubulin-destabilizing compounds in the Number of gH2Ax spots in G1 cells model; 4) Display a global structure of Cell Health predictions in UMAP space for select models. Note that for the fourth point, we are using the UMAP gradients to observe patterns, and not to validate models.

      In order to encapsulate the updated flow, we’ve pasted below the entire Drug Repurposing Hub results/discussion section, which introduces two additional analyses and new text in response to various other reviewer comments. We feel that the updated section improves clarity and purpose.

      The updated section now reads:

      “Predictive models of cell health would be most useful if they could be trained once and successfully applied to data sets collected separately from the experiment used for training. Otherwise one could not annotate existing datasets that lack parallel Cell Health results, and Cell Health assays would have to be run alongside each new dataset. We therefore applied our trained models to a large, publicly-available Cell Painting dataset collected as part of the Drug Repurposing Hub project (Corsello et al., 2017). The data derive from A549 lung cancer cells treated with 1,571 compound perturbations measured in six doses.

      We first chose a simple, high-performing model to validate. The number of live cells model captures the number of cells that are unstained by DRAQ7. We compared model predictions to orthogonal viability readouts from a third dataset: Publicly available PRISM assay readouts, which count barcoded cells after an incubation period (Yu et al., 2016). Despite measuring perturbations with slightly different doses and being fundamentally different ways to count live cells (Figure 4A), the predictions correlated with the assay readout (Spearman's Rho = 0.35, p -3; Figure 4B).

      We also chose to validate three additional models: ROS, G1 cell count, and Number of gH2AX spots in G1 cells. We observed that the two proteasome inhibitors (bortezomib and MG-132) in the Drug Repurposing Hub set yielded high ROS predictions (OR = 76.7; p -15) (Figure 4C). Proteasome inhibitors are known to induce ROS (Han and Park, 2010; Ling et al., 2003). As well, PLK inhibitors yielded low G1 cell counts (OR = 0.035; p = 3.9 x 10-8) (Figure 4C). The PLK inhibitor HM-214 showed an appropriate dose response (Figure 4D). PLK inhibitors block mitotic progression, thus reducing entry into the G1 cell cycle phase (Lee et al., 2014). Lastly, we observed that aurora kinase and tubulin inhibitors yielded high Number of gH2AX spots in G1 cells predictions (OR = 11.3; p Figure 4E). In particular, we observed a strong dose response for the aurora kinase inhibitor barasertib (AZD1152) (Figure 4F). Aurora kinase and tubulin inhibitors cause prolonged mitotic arrest, which can lead to mitotic slippage, G1 arrest, DNA damage, and senescence (Orth et al. 2011; Cheng and Crasta 2017; Tsuda et al. 2017).

      We applied uniform manifold approximation (UMAP) to observe the underlying structure of the samples as captured by morphology data (McInnes et al., 2018). We observed that the UMAP space captures gradients in predicted G1 cell count (Supplementary Figure S14A) and in predicted ROS (Supplementary Figure S14B). We also observed similar gradients in the ground truth cell health readouts in the CRISPR Cell Painting profiles used for training cell health models (Supplementary Figure S15). Gradients in our data suggest that cell health phenotypes manifest in a continuum rather than in discrete states.

      Lastly, we observed moderate technical artifacts in the Drug Repurposing Hub profiles, indicated by high DMSO profile dispersion in the Cell Painting UMAP space (Supplementary Figure 14C). This represents an opportunity to improve model predictions with new batch effect correction tools. Additionally, it is important to note that the expected performance of each Cell Health model can only be as good as the performance observed in the original test set (see Figure 2), and that all predictions require further experimental validation.“

      Updated Figure 4:

      Figure 4: Validating Cell Health models applied to Cell Painting data from The Drug Repurposing Hub. The models were not trained using the Drug Repurposing Hub data. (a) The results of the dose alignment between the PRISM assay and the Drug Repurposing Hub data. This view indicates that there was not a one-to-one matching between perturbation doses. (b) Comparing viability estimates from the PRISM assay to the predicted number of live cells in the Drug Repurposing Hub. The PRISM assay estimates viability by measuring barcoded A549 cells after an incubation period. (c) Drug Repurposing Hub profiles stratified by G1 cell count and ROS predictions. Bortezomib and MG-132 are proteasome inhibitors and are used as positive controls in the Drug Repurposing Hub set; DMSO is a negative control. We also highlight all PLK inhibitors in the dataset. (d) HMN-214 is an example of a PLK inhibitor that shows strong dose response for G1 cell count predictions. (e) Tubulin and aurora kinase inhibitors are predicted to have high Number of gH2AX spots in G1 cells compared to other compounds and controls. (f) Barasertib (AZD1152) is an aurora kinase inhibitor that is predicted to have a strong dose response for Number of gH2AX spots in G1 cells predictions.

      Updated Supplementary Figure:

      Supplementary Figure S14: Applying a Uniform Manifold Approximation (UMAP) to Drug Repurposing Hub consensus profiles of 1,571 compounds across six doses. The models were not trained using the Drug Repurposing Hub data. (a) The point color represents the output of the Cell Health model trained to predict the number of cells in G1 phase (G1 cell count). (b) The same UMAP dimensions, but colored by the output of the Cell Health model trained to predict reactive oxygen species (ROS). (c) In the UMAP space, we highlight DMSO as a negative control, and Bortezomib and MG-132 as two positive controls (proteasome inhibitors) in the Drug Repurposing Hub set. We observe moderate batch effects in the negative control DMSO profiles, based on their spread in this visualization. The color represents the predicted number of live cells. The positive controls were acquired with a very high dose and are expected to result in a very low number of predicted live cells.

      All software updates required to update these figures can be viewed at https://github.com/broadinstitute/cell-health/pull/145

      Is it surprising that cell health phenotypes and gradients therein are present in a dataset describing cell health perturbations?

      This was not surprising to us, and we thank the reviewer for asking the question. We have now added a new Supplementary Figure to present a UMAP with ground truth cell health measurements in the CRISPR dataset (pasted below). By adding the figure, we show how Cell Health predictions are expected to show gradients in UMAP space. In fact, for any lower-dimensional embedding that is able to preserve local neighborhoods of the high-dimensional space, we should expect all linear transformations of the input data (in the high-dimensional space) to vary smoothly across the lower-dimensional embedding. However, it is still informative to observe where the specific Cell Health phenotype predictions manifest in relation to global morphology structure. We add the following sentence in the Drug Repurposing Hub paragraph juxtaposed to the other UMAP gradient observations:

      We applied uniform manifold approximation (UMAP) to observe the underlying structure of the samples as captured by morphology data (McInnes et al., 2018). We observed that the UMAP space captures gradients in predicted G1 cell count (Supplementary Figure S14A) and in predicted ROS (Supplementary Figure S14B). We also observed similar gradients in the ground truth cell health readouts in the CRISPR Cell Painting profiles used for training cell health models (Supplementary Figure S15). Gradients in our data suggest that cell health phenotypes manifest in a continuum rather than in discrete states.

      Supplementary Figure S15: Applying a Uniform Manifold Approximation (UMAP) to the Cell Painting consensus profile data of CRISPR perturbations. UMAP coordinates visualized by (a) cell line, (b) ground truth G1 cell counts, and (c) ground truth ROS counts. (d) Visualizing the distribution of ground truth ROS compared against G1 cell count. The two outlier ES2 profiles are CRISPR knockdowns of GPX4, which is known to cause high ROS.

      We have also added the option to explore the CRISPR profile Cell Health ground truth in our shiny app https://broad.io/cell-health (screenshot pasted below)

      Modifications to the software introducing these changes can be viewed at https://github.com/broadinstitute/cell-health/pull/141.

      The actual test of the model's performance is in the paragraph below, but the data associated with the Spearman correlation is hidden in Fig. S10b. The data is not convincing by eye, and the artifactually low p value suggests that proper statistical corrections were not applied.

      We have moved the Spearman correlation figure (previously Supplementary Figure S10B) into a main figure, along with a complete restructuring of the results and discussion in the Drug Repurposing Hub section.

      We appreciate the careful observations and interpretations, and confirm the statistical test performed here is sound and the p value is correct (there is no need to account for multiple testing since there is only one test being applied, a test of correlation between two variables).

      We add this rationale to the “Comparing viability predictions to an orthogonal readout” methods section:

      We performed the non-parametric Spearman correlation test because 1) the doses were not aligned between the datasets we compared, and 2) it is possible that a strong nonlinear correlation exists between readouts from two fundamentally different ways to measure viability.

      It is definitely valid to critique the scatter plot relationship to understand that the mean squared error is quite high (i.e. if two datasets had viability measurements using the two approaches, it would be wrong to assume that lower measurements in one assay automatically could be compared to lower measurements of the other assay). This level of variability would be lost if all we did was report the test statistic, which is the reason why we included the scatter plot as a figure.

      It may also be important to mention that the authors of the PRISM paper also noted high variation in their estimates (from Corsello et al https://doi.org/10.1038/s43018-019-0018-6): "At the level of individual compound dose–responses, we note that the PRISM Repurposing dataset tends to be somewhat noisier, with a higher standard error estimated from vehicle control measurements (Extended Data Fig. 5c and Extended Data Fig. 6a–c)."

      Nevertheless, we agree that the current way we report this p value is distracting and potentially misleading, depending on how the p value is interpreted. Therefore, we have updated the reporting of all p values to say that they are less than a predefined cutoff. The figure now states that p

      Fig 1A and associated methods are not sufficient information to describe the manual gating strategy and any variability found across iterations in these gates. Effort should be taken to quantify where these manual boundaries were set and why.

      We describe the manual gating strategies in much detail in the methods section “Cell Health assay: Image analysis”. However, we agree that a description of measurement variability and experimental approach requires more detail, and we agree that the manuscript would benefit from a visual example of these gates. These improvements required us to rearrange Figure 1.

      With a goal of increasing reproducibility in the cell health assay, we’ve (1) moved example images of the Cell Health assay to Figure 1A; (2) Moved the existing gating strategies drawing to Supplementary Figure 1; (3) Added real data examples of the manual gating strategy as a new Supplementary Figure 2. We show all updates below:

      Updated Figure 1:

      Figure 1. Data processing and modeling approach. (a) Example images and workflow from the Cell Health assays. We apply a series of manual gating strategies (see Methods) to isolate cell subpopulations and to generate cell health readouts for each perturbation. (top) In the “Cell Cycle” panel, in each nucleus we measure Hoechst, EdU, PH3, and gH2AX. (bottom) In the “Cell Viability” panel, we capture digital phase contrast images, measure Caspase 3/7, DRAQ7, and CellROX. (b) Example Cell Painting image across five channels, plus a merged representation across channels. The image is cropped from a larger image and shows ES2 cells. Below are the steps applied in an image-based profiling pipeline, after features have been extracted from each cell’s image. (c) Modeling approach where we fit 70 different regression models using CellProfiler features derived from Cell Painting images to predict Cell Health readouts.

      Updated Supplementary Figure S1:

      Supplementary Figure S1: Illustration of the gating strategy in the Cell Health assays. We extract 70 different readouts from the Cell Health imaging assay. The assay consists of two customized reagent panels, which use measurements from seven different targeted reagents and one channel based on digital phase contrast (DPC) imaging; shown are five toy examples to demonstrate that individual cells are isolated into subpopulations by various gating strategies to define the Cell Health readouts.

      Updated Supplementary Figure S2 (Example gating strategies):

      Supplementary Figure S2: Real data of manual gating in the Cell Health assays.

      For each cell line, we apply a series of manual gating strategies defined by various stain measurements in single cells to define cell subpopulations. (a) In the cell cycle panel, we first select cells that are useful for cell cycle analysis based on nucleus roundness and Hoechst intensity measurements. We also identify polyploid and “large not round” (polynuclear) cells. (b) We then subdivide the cells used for cell cycle to G1, G2, and S cells based on total Hoechst intensity (DNA content) and EdU incorporation signal intensity. (c) We use Hoechst and PH3 nucleus intensity to define mitotic cells. The points are colored by EdU intensity in the nucleus in both (b) and (c). (d) Example gating in the viability panel. We use DRAQ7 and CellEvent (Caspase 3/7) to distinguish alive and dead cells, and categorize early or late apoptosis. See Methods for more details about how the Cell Health measurements are made.

      We’ve also added the following to the methods section:

      Additionally, we set these gates for each cell subpopulation using a set of random wells from each cell line and experiment independently. We observed that the intensity measurements used to form the gates were consistent across wells and plates, and generally formed distinct cell subpopulation clusters. After using the random wells to set the gates, we used the Harmony microscope software to apply the gates to the remaining wells and plates.

      In general however, the need to clearly define this process further emphasizes a strength in our approach: There is great potential for inconsistencies when different humans draw gates. We aim to reduce these inconsistencies by predicting these readouts from Cell Painting images directly.

      The authors conclude that their results motivate further data acquisition and model training, and that this will improve model performance. This is only true if their lack of predictive power comes from the data volume itself, and not in larger problems of data quality, variability and the core assumptions of their method. The authors note the better predictability in ES2 cells, likely due to higher CRISPR efficiency and therefore stronger phenotypes. It is possible, as I believe the authors suggest, that the ES2 cells provide information that improves the predictive power of cells with poor infection efficiency. It is instead possible that only the ES2 cells with strong phenotypes yield predictive power, pulling the average of the dataset up. Authors could train the cell line specific datasets independently and compare relative changes in predictive performance. Otherwise, is it possible that subtle or highly complex phenotypes simply cannot be detected by this method and more data will be unlikely to improve predictability in modest perturbations.

      We thank the reviewers for raising this possibility. To explore this, we performed a cell-line holdout analysis in which we retrained (and individually reoptimized) all 70 cell health models on every combination of two cell lines and predicted readouts from the held out third cell line.

      Despite there being fewer samples in the training set in the cell line holdout test compared to the original test set (66% vs. 85%) and the fact that each model had never seen the held out cell line before, many cell health phenotypes could still be predicted. We add the following results in a new Supplementary Figure:

      Supplementary Figure S11: Results from a cell line holdout analysis. We trained and evaluated all 70 cell health models in three different scenarios using each combination of two cell lines to train, and the remaining cell line to evaluate. For example, we trained all 70 models using data from A549 and ES2 and evaluated performance in HCC44. We bin all cell health models into 14 different categories (see Supplementary Table S3 and https://github.com/broadinstitute/cell-health/6.ml-robustness for details about the categories and scores). We also provide the original test set (15% of the data, distributed evenly across all cell types) performance in the last row, as well as results after training with randomly permuted data. This cross-cell-type analysis yields worse performance overall. Nevertheless, despite the models never encountering certain cell lines, and having fewer training data points, many models still have predictive power across cell line contexts. Note that we truncated the y axis to remove extreme outliers far below -1. The raw scores are available on https://github.com/broadinstitute/cell-health.

      We’ve also performed a sample size titration analysis, which suggests that more data would indeed improve model performance. More data would also enable a deep learning approach, which is also likely to improve performance.

      Supplementary Figure S13: Dropping samples from training reduces test set model performance in high, mid, and low performing models. We determined model performance stratification by taking the top third, mid third, and bottom third of test set performance when using all data. We performed the sample titration analysis with 10 different random seeds and visualized the median test set performance for each model.

      We also update the results section to introduce and discuss this result:

      Lastly, we performed a sample size titration analysis in which we randomly removed a decreasing amount of samples from training. For the high and mid performing models, we observed a consistent performance drop, suggesting that increasing sample size would result in better overall performance (Supplementary Figure 13).

      And an updated methods describing this analysis now reads:

      Machine learning robustness: Investigating the impact of sample size

      We performed an analysis in which we randomly dropped an increasing amount of samples from the training set before model training. After dropping the predefined number of samples, we retrained all 70 cell health models and assessed performance on the original holdout test set. We performed this procedure ten times with ten unique random seeds to mirror a more realistic scenario of new data collection and to reduce the impact of outlier samples on model training.

      All software updates introducing this analysis can be viewed at https://github.com/broadinstitute/cell-health/pull/143

      Although the authors argue that the Cell Painting assay is capturing complex health phenotypes using a variety of morphological features, there is a clear overweighting of a particular few (in fact two...). It would be interesting to systematically retrain with exclusion of particular features to determine if equalizing the weight across features changes performance. These are also notably the feature groups with the fewest features-- how many individual features within these feature groups are pulling all the weight?

      We agree that an additional computational analysis including a systematic feature removal would be interesting and valuable. We’ve included this analysis as part of a new results subsection in which we assess where classification improvements are likely to come from by testing robustness of the ML models.

      Specifically, we’ve systematically removed individual features that belong to specific feature groups, channels, and compartments to determine how much their absence negatively affects model performance. The added supplementary figure is pasted below.

      Supplementary Figure S12: Systematically removing classes of features has little impact on most models’ performance. We retrained all 70 cell health models after dropping features associated with specific (a) feature groups, (b) channels, and (c) compartments. Each dot is one model (predictor), and the performance difference between the original model and the retrained model after dropping features is shown on the x axis. Any positive change indicates that the models got worse after dropping the feature group. (d) Individual model differences in performance after dropping features. Each dot is one class of features removed (as in a-c).

      We conclude that the majority of cell health models are robust to missing feature groups. Some models actually improve with a reduction in the feature space. Combined with the feature heatmap presented in Figure 3, these results tell us that a lot of the morphology signal is redundant across Cell Painting features.

      We add the following text to the results:

      We also performed a systematic feature removal analysis, in which we retrained cell health models after dropping features that are measured from specific groups, compartments, and channels. We observed that most models were robust to dropping entire feature classes during training (Supplementary Figure 12). This result demonstrates that many Cell Painting features are highly correlated, which might permit prediction “rescue” even if the directly implicated morphology features are not measured. Because of this, we urge caution when generating hypotheses regarding causal relationships between readouts and individual Cell Painting features.

      And the following to the methods:

      Machine learning robustness: Systematically removing feature classes

      We performed an analysis in which we systematically dropped features measured in specific compartments (Nuclei, Cells, and Cytoplasm), specific channels (RNA, Mito, ER, DNA, AGP), and specific feature groups (Texture, Radial Distribution, Neighbors, Intensity, Granularity, Correlation, Area Shape) and retrained all models. We omitted one feature class and then independently optimized all 70 cell health models as described in the Machine learning framework results section above. We repeated this procedure once per feature class.

      All software updates introducing this analysis can be viewed at https://github.com/broadinstitute/cell-health/pull/143

      In summary there is a very interesting concept here, but for several possible, currently undefined reasons, the authors are reporting a very weak measurement. The authors allude to these limitations, but it would be great if the authors could address these issues and provide a stronger dataset.

      We thank the reviewers for their encouraging remarks. We believe that with the added robustness analyses and with increased clarity about the motivation behind the paper, we’ve successfully demonstrated a proof of concept for the approach to predict cell health phenotypes from Cell Painting images. We believe that we’ve provided sufficient evidence to a reader to demonstrate the benefits of the prediction approach. As well, given the additional details describing the Cell Health assay reproducibility, that the paper also successfully introduces a new assay paradigm.

      Furthermore, while many of the cell health measurements are definitely weak (and unreliable), it is not fair to generalize all predictions as weak (especially given the sample size limitations).

      It is also worth noting that, under the current circumstances, separating the one dataset we have into a train/test set and validating the model in an external set is the best we could do; we do not have additional budget to run further wet lab experiments (which would also face a COVID backlog in our chemical screening group). We agree that additional datasets would benefit the field; our current data is now public, all of our future data will be public (to the extent possible), and we hope that others building on our work will make their data public too to address these questions.

      Lastly, in response to the “currently undefined reasons” comment, as well as other comments throughout, we’ve now included a new subsection in the Results/Discussion subsection to more directly answer some of the reasons why many models may have underperformed. Specifically, and as mentioned previously in this response, we perform three distinct robustness analyses: 1) Cell line holdout; 2) feature holdout; 3) sample size titration.

      Authors should include representative images of their Cell Health assay in the main figures. A full figure of all labels and examples of manual gating should be included (S1 is too limited)

      Scale bars need to be included in all images, some are missing in S1

      We thank the reviewers for this suggestion. We have since substantially updated figure 1 and supplementary figure S1. We have also added a new supplementary figure S2 as an example of the manual gating strategies, and we have updated all scale bars appropriately. We’ve attached the specific figure updates in an earlier response.

      "20x water objective in confocal mode" is not a sufficient level of detail on image acquisition parameters especially considering the lack of representative images. At the very least, NA and if appropriate pinhole size should be reported. Similarly, "9 FOV per well" is not sufficient. Pixel size and FOV area/dimensions are necessary.

      We have added these necessary details in their representative methods sections:

      We acquired all cell images using an Opera Phenix High Content Imaging Instrument (PerkinElmer) with a 20X water objective (a numerical aperture (NA) of 1.0), in confocal mode (a pinhole size of 50µm). The effective pixel size was 0.65µm/pixel. We acquired images in four channels using default excitation / emission combinations: for the blue channel (Hoechst) 405/435-480; for the green channel (Alexa 488 and CellEvent) 488/500-550; for the orange channel (Alexa 568 and CellRox Orange) 561/570-630 and for the far-red channel (Alexa 647 and DRAQ7) 640/650-760. We applied the Cell Health reagents for cell viability and for cell cycle in two separate plates.

      The legends for the different parts of Fig S10 are transposed which makes the figure quite confusing.The authors should amend or clarify the language of "guide perturbation" and "guide profile".

      Wow! We thank the reviewers for pointing out this oversight, and for their careful attention to detail. This figure is now completely different after the restructuring of the Drug Repurposing Hub results/discussion section. The legends for all figures are now correct.

      EdU is defined after it is abbreviated in methods

      We thank the reviewers for noting this. We’ve now fixed where these acronyms are abbreviated in the methods section and removed their definition in later sections where redundant:

      The authors should address the following image processing reproducibility concerns:

      Segmentation and feature extraction parameters are not included in the Supplementary Information. Either attach the CellProfiler pipeline or add a table with parameters and settings used for each module.

      CellProfiler and Harmony versions are missing.

      We thank the reviewers for pointing out these very important omissions. We have since rectified in the methods section:

      We built a CellProfiler image analysis and illumination correction pipeline (version 2.2.0) to extract these image-based features (McQuin et al., 2018). We include the CellProfiler pipelines in our github repository.

      We developed and ran two distinct image analysis pipelines in Harmony software (version 4.1; PerkinElmer) for each of the Cell Health plates.

      We also add the CellProfiler pipelines to our GitHub repository. A pull request introducing this change can be viewed here: https://github.com/broadinstitute/cell-health/pull/149

      Subpopulation definition (page 14) should be defined in a way that the algorithms (pipelines) could be reproduced, e.g.: "unusually high intensity of Hoechst max" requires a stricter definition.

      These definitions are subjective by nature. Gating decisions will be different depending on the scientist performing the image analysis. We feel that the sentence: “We excluded outlier nuclei with unusually high intensity of Hoechst max” conveys this subjectivity well. One of the strengths of the proposed approach to predict cell health phenotypes directly from the Cell Painting images is the removal of gating subjectivity.

      Why is the nucleus roundness calculated in PE Harmony and not in the CellProfiler pipeline itself?

      We used the nucleus roundness measurements as calculated in PE Harmony to define the “cells selected for cell cycle” subpopulation in the first panel of the Cell Health assay. I.e. this measurement was integral to the Cell Health assay itself. We believe that the addition of example gates (in supplementary figure 2) clears up this confusion.

      Reviewers:

      Jason Swedlow

      Melpi Platani

      Erin Diel

      Emil Rozbicki

      Reviewer #2 (Significance (Required)):

      Nature and Significance: This study aims to demonstrate how phenotypic studies using different markers can be combined and linked to deliver wider application and value.

      Relationship to Published Work: This study extends previous work from the same group and attempts a novel extension. The approach is a useful concept and potentially important.

      Audience: The method this paper proposes will be of interests to scientists involved with drug discovery and/or computational biology.

      Reviewer's Expertise: Cell Biology, Imaging, Imaging Informatics, Machine Learning, Computer Vision

      We would like to again express thanks to these reviewers for their careful read, very helpful comments, and encouraging remarks.

      Reviewer #3 (Evidence, reproducibility and clarity (Required)):

      The authors present a novel idea on predicting various cell health readouts based on a general set of markers and cell painting assay. The cell health readouts are based on more specific markers performed in different assays measuring cell proliferation and death. The authors suggest that such an approach can reduce the number of experiments needed. The paper is well written, and the figures are clear and comprehensive.

      We thank the reviewer for their helpful comments and encouragement!

      **Major comments:**

      Some of the health readouts are based on general morphology (cell and nucleus) which can be obtained based on cell painting assay. Although some of these models perform well, it is surprising that the model of nuclear roundness did not perform very well especially for HCC4 (R-square reaching zero). This is surprising as these data can be extracted from cell painting assays. Can the author elaborate on why this is the case?

      We agree that the performance of the live cell roundness and nucleus roundness models were unexpectedly low. One would expect that these shape features as measured by PerkinElmer Harmony software, would be easily predicted from CellProfiler readouts from the Cell Painting assay.

      The roundness property was used in Harmony versions,

      2*sqrt(π)*sqrt(Area-BorderArea/2.0)/BorderArea-0.1)

      where Area is object area in pixels and BorderArea is border area in pixels (we thank Joe Trask, Olavi Ollikainen, Hartwig Preckel, and Kaupo Palo at PerkinElmer for this information.)

      No single feature in the CellProfiler readouts measures roundness directly; instead, CellProfiler will measure a combination of shape features that together could synthesize the idea of “roundness”. However, given that the elastic net approach is well-suited for this type of synthesis, it remains unclear why roundess is not predicted well.

      One possible explanation is that shape features are the most different measurements across cell lines and they are measured precisely in both assays. Precise measurements coupled with our training strategy of using all three lines together, might lead to poor performance in predicting certain cell-line intrinsic features.

      We tested this shape result directly (and also generally to the other cell health features) in a “cell line holdout” analysis, which we describe in more detail in response to the next comment. In this analysis, we tested how well models generalized to cell lines not encountered in the training process. In this analysis, we trained on every combination of two cell lines and applied the trained models to the third. We observed that cell line intrinsic features, like shape, are predicted poorly if a model was not trained using the cell line.

      Using elastic net regression models is well-suited to the problem due to the low number of observations. However, there is a significant difference between the performance of different cell lines. Does the performance of the models improve if different models were trained for every cell line? Leave one out approach can be used to accommodate the scarcity of samples.

      We thank the reviewer for this important question. We also appreciate how different certain models behaved with certain cell lines. We would like to stress that the results presented here represent a small pilot study that is not meant to optimize model performance. Instead, the motivation of the manuscript is to demonstrate proof-of-concept of the approach to predict specific cell health phenotypes directly from Cell Painting images. We believe that the current results demonstrate positive proof, which warrants an expansion of data collection and an improvement of the classification methodology.

      Nevertheless, with our current data, we can answer an important question about the feasibility of signal transfer between cell lines. Therefore, we performed an additional “cell line holdout” analysis. We believe that the cell line holdout analysis tells us that signals can be transferred across contexts, but that any leading observations must be followed up with experiments performed directly in the cell line of interest. This signal transfer is diluted compared to the original test set performance, but it is also worth noting that the models presented in Supplementary Figure 11 (pasted below) were trained on only 66% of the data in the holdout cell line analysis and 85% of the data in the original analysis.

      Supplementary Figure S11: Results from a cell line holdout analysis. We trained and evaluated all 70 cell health models in three different scenarios using each combination of two cell lines to train, and the remaining cell line to evaluate. For example, we trained all 70 models using data from A549 and ES2 and evaluated performance in HCC44. We bin all cell health models into 14 different categories (see Supplementary Table S3 and https://github.com/broadinstitute/cell-health/6.ml-robustness for details about the categories and scores). We also provide the original test set (15% of the data, distributed evenly across all cell types) performance in the last row, as well as results after training with randomly permuted data. This cross-cell-type analysis yields worse performance overall. Nevertheless, despite the models never encountering certain cell lines, and having fewer training data points, many models still have predictive power across cell line contexts. Note that we truncated the y axis to remove extreme outliers far below -1. The raw scores are available on https://github.com/broadinstitute/cell-health.

      And we add the following text to the results section:

      We performed a series of analyses to determine certain parameters and options that are likely to improve models in the future. First, we performed a “cell line holdout” analysis, in which we trained models on two of three cell lines and predicted cell health readouts on the held out cell line. We observed that certain models including those based on viability, S phase, early mitotic and death phenotypes could be moderately predicted in cell lines agnostic to training (Supplementary Figure 11). Not surprisingly, shape-based phenotypes could not be predicted in holdout cell lines, which emphasizes the limitations of transferring certain cell-line specific measurements across cell lines.

      All software updates introducing this analysis can be viewed at https://github.com/broadinstitute/cell-health/pull/143

      The authors chose to validate based on the number of live cells as it is one of the best models. However, this readout can be obtained using simple viability assays. It would be more convincing to validate on a more complex phenotype that can only be attained using imaging such as #gH2AX spots.

      It is worth noting that we do also show generalizability in the Drug Repurposing Hub for two other models: ROS and G1 cell count. We show that proteasome inhibitors significantly induce high ROS and PLK inhibitors restrict entry to G1. We have also added enrichment tests demonstrating high statistical significance for these compound mechanisms.

      While we recognize that these two examples provide anecdotal evidence, they suggest the ability and power of the approach to assign phenotypes to Cell Painting images.

      Nevertheless, we thank the reviewer for bringing up this critical point and certainly appreciate the benefit of validating a gH2AX model. Therefore, we’ve added a similar analysis in which we demonstrate generalizability of the top performing gH2Ax model: Number of gH2AX spots in G1 cells. We discuss these changes in an updated section:

      We also chose to validate three additional models: ROS, G1 cell count, and Number of gH2AX spots in G1 cells. We observed that the two proteasome inhibitors (bortezomib and MG-132) in the Drug Repurposing Hub set yielded high ROS predictions (OR = 76.7; p -15) (Figure 4C). Proteasome inhibitors are known to induce ROS (Han and Park, 2010; Ling et al., 2003). As well, PLK inhibitors yielded low G1 cell counts (OR = 0.035; p = 3.9 x 10-8) (Figure 4C). The PLK inhibitor HM-214 showed an appropriate dose response (Figure 4D). PLK inhibitors block mitotic progression, thus reducing entry into the G1 cell cycle phase (Lee et al., 2014). Lastly, we observed that aurora kinase and tubulin inhibitors yielded high Number of gH2AX spots in G1 cells predictions (OR = 11.3; p Figure 4E). In particular, we observed a strong dose response for the aurora kinase inhibitor barasertib (AZD1152) (Figure 4F). Aurora kinase and tubulin inhibitors cause prolonged mitotic arrest, which can lead to mitotic slippage, G1 arrest, DNA damage, and senescence (Orth et al. 2011; Cheng and Crasta 2017; Tsuda et al. 2017).

      We also modify the abstract summarizing this result:

      For Cell Painting images from a set of 1,500+ compound perturbations across multiple doses, we validated predictions by orthogonal assay readouts, and by confirming mitotic arrest, ROS, and DNA damage phenotypes via PLK, proteasome, and aurora kinase/tubulin inhibition, respectively.

      And we add this analysis to an updated Figure 4:

      Figure 4: Validating Cell Health models applied to Cell Painting data from The Drug Repurposing Hub. The models were not trained using the Drug Repurposing Hub data. (a) The results of the dose alignment between the PRISM assay and the Drug Repurposing Hub data. This view indicates that there was not a one-to-one matching between perturbation doses. (b) Comparing viability estimates from the PRISM assay to the predicted number of live cells in the Drug Repurposing Hub. The PRISM assay estimates viability by measuring barcoded A549 cells after an incubation period. (c) Drug Repurposing Hub profiles stratified by G1 cell count and ROS predictions. Bortezomib and MG-132 are proteasome inhibitors and are used as positive controls in the Drug Repurposing Hub set; DMSO is a negative control. We also highlight all PLK inhibitors in the dataset. (d) HMN-214 is an example of a PLK inhibitor that shows strong dose response for G1 cell count predictions. (e) Tubulin and aurora kinase inhibitors are predicted to have high Number of gH2AX spots in G1 cells compared to other compounds and controls. (f) Barasertib (AZD1152) is an aurora kinase inhibitor that is predicted to have a strong dose response for Number of gH2AX spots in G1 cells predictions.

      All software updates required to update these figures can be viewed at https://github.com/broadinstitute/cell-health/pull/145

      It is also worth noting that collecting more data for this manuscript is not currently feasible given the amount of projects backlogged from COVID. We feel that given that the motivation of the project is to demonstrate feasibility of the approach, with our current training/testing machine learning framework and the application to Drug Repurposing Hub data is sufficient.

      The text would benefit from expanding the discussion to include the advantages and limitations of their approach.

      We thank the reviewer for bringing up this concern, and we agree that it is worth an increased discussion about advantages and limitations of the approach. Indeed, we’ve added a full new results/discussion subsection directly testing many of the assumptions for why some models performed well and others didn’t. The new section introduces many model limitations:

      We performed a series of analyses to determine certain parameters and options that are likely to improve models in the future. First, we performed a “cell line holdout” analysis, in which we trained models on two of three cell lines and predicted cell health readouts on the held out cell line. We observed that certain models including those based on viability, S phase, early mitotic and death phenotypes could be moderately predicted in cell lines agnostic to training (Supplementary Figure 11). Not surprisingly, shape-based phenotypes could not be predicted in holdout cell lines, which emphasizes the limitations of transferring certain cell-line specific measurements across cell lines. We also performed a systematic feature removal analysis, in which we retrained cell health models after dropping features that are measured from specific groups, compartments, and channels. We observed that many models were robust to dropping entire feature classes during training (Supplementary Figure 12). This result demonstrates that many Cell Painting features are highly correlated, which might permit prediction “rescue” even if the directly implicated morphology features are not measured. Because of this, we urge caution when generating hypotheses regarding causal relationships between phenotypes and individual Cell Painting features. Lastly, we performed a sample size titration analysis in which we randomly removed a decreasing amount of samples from training. For the high and mid performing models we observed a consistent performance drop, suggesting that increasing sample size would result in better overall performance (Supplementary Figure 13).

      **Minor comments**

      Page 8: The authors visualize the predicted G1 cell count and ROS when overlayed on a UMAP based on cell painting data from Drug Repurposing Hub. How these visualisations look like if applied to the original CRISPR training data.

      We address this comment by adding a supplementary figure showing ground truth G1 cell count and ROS readouts.

      We applied uniform manifold approximation (UMAP) to observe the underlying structure of the samples as captured by morphology data (McInnes et al., 2018). We observed that the UMAP space captures gradients in predicted G1 cell count (Supplementary Figure S14A) and in predicted ROS (Supplementary Figure S14B). We also observed similar gradients in the ground truth cell health readouts in the CRISPR Cell Painting profiles used for training cell health models (Supplementary Figure S15). Gradients in our data suggest that cell health phenotypes manifest in a continuum rather than in discrete states.

      Where Supplementary Figure 15 is pasted below:

      Supplementary Figure S15: Applying a Uniform Manifold Approximation (UMAP) to the Cell Painting consensus profile data of CRISPR perturbations. UMAP coordinates visualized by (a) cell line, (b) ground truth G1 cell counts, and (c) ground truth ROS counts. (d) Visualizing the distribution of ground truth ROS compared against G1 cell count. The two outlier ES2 profiles are CRISPR knockdowns of GPX4, which is known to cause high ROS.

      We have also added the option to explore the CRISPR profile Cell Health ground truth in our shiny app https://broad.io/cell-health (screenshot pasted below)

      Modifications to the software introducing these changes can be viewed at https://github.com/broadinstitute/cell-health/pull/141.

      The second part of the last paragraph on page 8 is confusing as it is not related to the first part using the PRISM data.

      We thank the reviewer for noting this. We agree that the clarity of this section could be improved. We have now completely reworked the final section of applying the cell health models to the Drug Repurposing Hub data.

      In particular, we’ve moved the PRISM data section as the first, most simple model to validate, and moved these results to Figure 4. We then describe validation for three other models: ROS, G1 cell count and Number of gH2Ax spots in G1 cells. And we end with the UMAP discussion, which is the original second part of the last paragraph on page 8.

      The PRISM section now reads:

      We first chose a simple, high-performing model to validate. The number of live cells model captures the number of cells that are unstained by DRAQ7. We compared model predictions to orthogonal viability readouts from a third dataset: Publicly available PRISM assay readouts, which count barcoded cells after an incubation period (Yu et al., 2016). Despite measuring perturbations with slightly different doses and being fundamentally different ways to count live cells (Figure 4A), the predictions correlated with the assay readout (Spearman's Rho = 0.35, p -3; Figure 4B).

      Reviewer #3 (Significance (Required)):

      This approach can be of wide interest as it is easy to implement, cost-effective and lead to interpretable models. It would be interesting to see if the results improve when increasing the sample size. Another aspect that can be useful to investigate in the future is whether including a separate marker that indicates infected cells only in the more detailed assays would result in better accuracies.

      We thank the reviewer for their enthusiasm and for this concluding idea. Indeed, we also feel that including a separate marker to indicate infected cells could lead to improved accuracy. We add this thought to the concluding section as a future direction. The full updated conclusion reads as follows:

      We have demonstrated feasibility that information in Cell Painting images can predict many different Cell Health indicators even when trained on a small dataset. The results motivate collecting larger datasets for training, with more perturbations and multiple cell lines. These new datasets would enable the development of more expressive models, based on deep learning, that can be applied to single cells. Including orthogonal imaging markers of CRISPR infection would also enable us to isolate cells with expected morphologies. More data and better models would improve the performance and generalizability of Cell Health models and enable annotation of new and existing large-scale Cell Painting datasets with important mechanisms of cell health and toxicity.

    2. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #3

      Evidence, reproducibility and clarity

      The authors present a novel idea on predicting various cell health readouts based on a general set of markers and cell painting assay. The cell health readouts are based on more specific markers performed in different assays measuring cell proliferation and death. The authors suggest that such an approach can reduce the number of experiments needed. The paper is well written, and the figures are clear and comprehensive.

      Major comments:

      Some of the health readouts are based on general morphology (cell and nucleus) which can be obtained based on cell painting assay. Although some of these models perform well, it is surprising that the model of nuclear roundness did not perform very well especially for HCC4 (R-square reaching zero). This is surprising as these data can be extracted from cell painting assays. Can the author elaborate on why this is the case?

      Using elastic net regression models is well-suited to the problem due to the low number of observations. However, there is a significant difference between the performance of different cell lines. Does the performance of the models improve if different models were trained for every cell line? Leave one out approach can be used to accommodate the scarcity of samples.

      The authors chose to validate based on the number of live cells as it is one of the best models. However, this readout can be obtained using simple viability assays. It would be more convincing to validate on a more complex phenotype that can only be attained using imaging such as #gH2AX spots.

      The text would benefit from expanding the discussion to include the advantages and limitations of their approach.

      Minor comments

      Page 8: The authors visualize the predicted G1 cell count and ROS when overlayed on a UMAP based on cell painting data from Drug Repurposing Hub. How these visualisations look like if applied to the original CRISPR training data.

      The second part of the last paragraph on page 8 is confusing as it is not related to the first part using the PRISM data.

      Significance

      This approach can be of wide interest as it is easy to implement, cost-effective and lead to interpretable models. It would be interesting to see if the results improve when increasing the sample size. Another aspect that can be useful to investigate in the future is whether including a separate marker that indicates infected cells only in the more detailed assays would result in better accuracies.

    3. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #2

      Evidence, reproducibility and clarity

      This report from Way et al describes a method of extending a very popular screening technology called Cell Painting developed by the Carpenter Lab. The authors are contending with an important issue and as such this paper potentially will be of great interest to the community. Cell Painting provides quantitative fingerprints of cell phenotypes in response to changes in the molecular or physiological status of cells. However the molecular basis or even the candidate pathways for those changes is not always clear. Here, the authors take specific markers of cell physiology, e.g., DNA damage, ROS production, cell cycle progression etc. and relate them to Cell Painting features. The authors are trying to address the issue that running many probes of cell physiology is expensive and time consuming and that identifying proxies for these assays using much simpler Cell Painting technologies would be a useful and potentially powerful approach. The overall goal is to develop some type of regression model that can link the state of cells (the "health") to Cell Painting fingerprints.

      The authors use three separate cell lines and CRISPR knockouts delivered through lentivirus that target 59 genes to establish a range of cell physiologies that they directly measure (the "Cell Health") and then relate to similar assays performed by Cell Painting. Ultimately they aim to use Cell Painting models to predict Cell Health.

      Major Issues:

      It appears that the phenotypes that are detected at a high enough level of significance (see Fig. 2), e.g DNA damage (gH2Ax), apoptosis (Caspase 3/7), dead cells, ROS (CellROX), etc. are probably most easily detected by simply monitoring DAPI signal in these screens. To detect many of the phenotypes, the authors have presented a fairly complex method of doing much simpler assays. The authors correctly highlight in Fig. 3 that the phenotypes they are detecting go beyond pure signals from DAPI. They report power in their models from Radial Distribution across many different components of the Cell Painting feature set. However these appear to give outputs that won't be that useful. It is hard to tell whether this is simply because they don't have enough images or whether their signal is confounded by using cell lines where the lentivirus CRISPR knockouts are working less efficiently.

      It seems misleading (or perhaps the explanation lacks clarity) to describe in the same paragraph the need to validate the model by applying it to new datasets, namely the Drug Repurposing Hub project, then describe gradients in cell health features across UMAP coordinates. Is it surprising that cell health phenotypes and gradients therein are present in a dataset describing cell health perturbations? The actual test of the model's performance is in the paragraph below, but the data associated with the Spearman correlation is hidden in Fig. S10b. The data is not convincing by eye, and the artifactually low p value suggests that proper statistical corrections were not applied.

      Fig 1A and associated methods are not sufficient information to describe the manual gating strategy and any variability found across iterations in these gates. Effort should be taken to quantify where these manual boundaries were set and why.

      A fundamental issue that the authors mention but do not address is the efficiency of the CRISPR KOs. The authors should measure the efficiency of representative guides and present these data to help support the interpretation of their models.

      The authors conclude that their results motivate further data acquisition and model training, and that this will improve model performance. This is only true if their lack of predictive power comes from the data volume itself, and not in larger problems of data quality, variability and the core assumptions of their method. The authors note the better predictability in ES2 cells, likely due to higher CRISPR efficiency and therefore stronger phenotypes. It is possible, as I believe the authors suggest, that the ES2 cells provide information that improves the predictive power of cells with poor infection efficiency. It is instead possible that only the ES2 cells with strong phenotypes yield predictive power, pulling the average of the dataset up. Authors could train the cell line specific datasets independently and compare relative changes in predictive performance. Otherwise, is it possible that subtle or highly complex phenotypes simply cannot be detected by this method and more data will be unlikely to improve predictability in modest perturbations.

      Although the authors argue that the Cell Painting assay is capturing complex health phenotypes using a variety of morphological features, there is a clear overweighting of a particular few (in fact two...). It would be interesting to systematically retrain with exclusion of particular features to determine if equalizing the weight across features changes performance. These are also notably the feature groups with the fewest features-- how many individual features within these feature groups are pulling all the weight?

      In summary there is a very interesting concept here, but for several possible, currently undefined reasons, the authors are reporting a very weak measurement. The authors allude to these limitations, but it would be great if the authors could address these issues and provide a stronger dataset.

      Minor issues: Authors should include representative images of their Cell Health assay in the main figures. A full figure of all labels and examples of manual gating should be included (S1 is too limited) Scale bars need to be included in all images, some are missing in S1

      "20x water objective in confocal mode" is not a sufficient level of detail on image acquisition parameters especially considering the lack of representative images. At the very least, NA and if appropriate pinhole size should be reported. Similarly, "9 FOV per well" is not sufficient. Pixel size and FOV area/dimensions are necessary.

      The legends for the different parts of Fig S10 are transposed which makes the figure quite confusing.The authors should amend or clarify the language of "guide perturbation" and "guide profile".

      EdU is defined after it is abbreviated in methods

      The authors should address the following image processing reproducibility concerns:

      Segmentation and feature extraction parameters are not included in the Supplementary Information. Either attach the CellProfiler pipeline or add a table with parameters and settings used for each module.

      CellProfiler and Harmony versions are missing.

      Subpopulation definition (page 14) should be defined in a way that the algorithms (pipelines) could be reproduced, e.g.: "unusually high intensity of Hoechst max" requires a stricter definition.

      Why is the nucleus roundness calculated in PE Harmony and not in the CellProfiler pipeline itself?

      Reviewers: Jason Swedlow Melpi Platani Erin Diel Emil Rozbicki

      Significance

      Nature and Significance: This study aims to demonstrate how phenotypic studies using different markers can be combined and linked to deliver wider application and value.

      Relationship to Published Work: This study extends previous work from the same group and attempts a novel extension. The approach is a useful concept and potentially important.

      Audience: The method this paper proposes will be of interests to scientists involved with drug discovery and/or computational biology.

      Reviewer's Expertise: Cell Biology, Imaging, Imaging Informatics, Machine Learning, Computer Vision

    4. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #1

      Evidence, reproducibility and clarity

      The submitted manuscript entitled 'Predicting cell health phenotypes using image-based morphology profiling' (RC-2020-00394) by Way et al. presents a set of seven dyes/staining (as two separate panels) to microscopically screen cell viability. For automatic classification a training/test set of 119 CRISPR (approximately 2 sgRNAs per gene) perturbations on 3 cancer cell lines were generated (lung A549, ovarian ES2, lung HCC44). After segmentation of cell nuclei a set of morphological cell measurements were extracted from each perturbation (total 952 features). The nature of these feature spanning cell cycle and viability phenotypes, enabled the authors to define 70 different phenotype classes, which are used to model a classifier by elastic linear regression. Specific definitions (cell cycle and ROS) were partly predicted/validated in an independent existing image data set (Drug Repurposing Hub project). The data is available as web-based application/visualization and the supplementary method is well described.

      Major concerns:

      (1)The only fundamental argument of this manuscript not to apply state-of-the-art deep learning (DL) machine-learning (mentioned in McCain et al. 2018), which does not require segmentation, feature extraction, abstraction, manual gating is the 'interpretability' of the predictions. However, performance, precision, scalability (by modern GPUs) with DL should clearly outperform 'manual' regression models. All recent machine vision benchmarks in microscopy confirm this, but also clearly shows 'real world' translational applications, e.g.

      https://www.nature.com/articles/s43018-020-0085-8,

      https://www.biorxiv.org/content/10.1101/2020.07.02.183814v1.full.pdf,

      In other words, the presented methodology is not compared to DL, and is not convincing in terms of interpretability benefits.

      (2)One aforementioned point of the methodology is cryptically/not described: Why it should be less expensive compared with other (which?) approaches (see introduction)?

      (3)Generalizability and/or training data size is essential for any model-based classification, but not evaluated or validated in the current manuscript. The independent validation on a A549 cell line only data might be not sufficient/convincing.

      Minor concerns:

      (1)Highest test performance comprises that precision is mainly driven by cell cycle/count and live status and could be probably derived from DRAQ7 (Fig. 2) and DNA granularity (Fig. 3, bottom right) and would argue for rigid feature selection across channels and features.

      (2)Any H2AX and 'polynuclear' would probably fail in any cell line with this size of training data.

      (3)To what refers the 'weights' of the model in Fig. 1c?

      Significance

      This manuscript is not advanced in the context of latest improvements/developments of cell-based microscopic classification. Rationale in the introduction and the conclusion are not linked (interpretability, generalizability, costs). It seems to be unfinished or unformatted to this end?

      The author/co-authors have been instrumental/pioneered with their past work on cell-based image processing (CellProfiler software), but the presented methodology is simply outdated. Therefore, a revision towards a comparison and benchmarking with DL will also not help.

      Ref (DL with MIL): https://academic.oup.com/bioinformatics/article/32/12/i52/2288769

    1. Note: This rebuttal was posted by the corresponding author to Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Reply to the reviewers

      Reply to the reviewers:

      We are grateful to the referees for investing valuable time in reviewing our work, and for recognising the importance and utility. We thank them for their insightful and constructive comments that have helped us significantly improve the manuscript.

      Below, we provide a point-by-point response to all specific questions raised.

      Reviewer #1 (Evidence, reproducibility and clarity (Required)): In order to improve SARS-CoV-2 diagnostics, Reijns et al. developed a multiplexed RT-qPCR protocol that allows simultaneous detection of two viral genes, one housekeeping gene as well as an external gene as an extraction control. Compared to running parallel assays to detect genes individually, the turnaround time is much shorter and reagents are saved. Furthermore, the presented data suggest that the assay is more sensitive than commercial kits. The authors also propose the detection of the human housekeeping gene as a measure of sample quality control. In principal, this work has potential but the manuscript itself needs a better structure. **Major concerns:** The authors have used the Takara RT-qPCR kit for their study. Did the authors try other commercial kits?

      We have not assessed other commercial kits as the Takara reagent performed well, and has been easy to source. We expect that other one-step kits could be used if the need arose.

      When we initiated this work in March 2020, we selected the Takara One Step PrimeScript™ III RT-PCR Kit based on 1) the practical advantages of a one-step reaction mix, 2) published evidence of its successful use in SARS-CoV-2 detection (see below), 3) availability in sufficient quantities for testing at scale, and 4) affordability.

      (Published evidence: One of the first descriptions of an assay to detect SARS-CoV-2 [1] employed the Takara One Step PrimeScript™ III RT-PCR Kit, and this kit was later shown by others to perform as well as or better than Qiagen Quantifast Multiplex RT-PCR +R mastermix, ThermoFisher TaqPath 1-Step RT-qPCR MasterMix and ThermoFisher Taqman Fast Virus 1-step mastermix, when used to detect SARS-CoV-2 RNA from nose and throat swabs with N1, N2 or N gene assays [2].)

      Can the authors elaborate on the supply chain of the Takara kit?

      We have not had problems securing the Takara kit in sufficient quantities and in a timely fashion, and did so through the company’s Scotland and NE England representative. The managing director of Takara Bio Europe provided the following statement, as a clarification of the supply chain:

      “Takara Bio Inc. has worked on significantly increasing the production of one-step RT-qPCR reagents to cover worldwide needs for SARS-CoV-2 detection. The production of this kit is based in China under ISO13485 certification and the European stock is based in, and distributed, from Paris. Throughout this pandemic, Takara Bio Europe has supplied millions of reactions around Europe to COVID-19 testing labs, without encountering any shortages or significant shipping delays.”

      Could it cover population testing in case of shortages of other commercial kits?

      Yes, it could. The Takara kit is available in 4,000 and 20,000 reaction pack sizes and therefore could well be a useful option in case of shortages of other commercial kits. Indeed, one motivation for developing the multiplex assay was to ensure diagnostic testing resilience in the face of reagent shortages.

      For better comparison, is it possible to give information on which primers the commercial kits are based on?

      We contacted both ThermoFisher and Abbott to ask for more information on the primers and probes included in the TaqPath COVID‐19 Combo Kit (detects N, ORF1ab and S gene) and Abbott RealTime SARS‐CoV‐2 assay (detects RdRp and N gene). Unfortunately, we were informed that this information is proprietary. For clarity, we have included the following in the Materials and Methods section:

      “Primers and probes included in the TaqPath COVID-19 Combo Kit (Thermo Fisher Scientific, Cat. No. A47814) detect SARS-CoV-2 ORF1ab, N and S gene; those in the Abbott RealTime SARS-CoV-2 assay (Cat. No. 09N77-090) detect RdRp and N gene. Further details are not available, as this information is proprietary.”

      Also, explain better the primers used in this study. For example, the N1 and N2 primers are directed against different regions of the SARS-CoV-2 N gene.

      We thank the reviewer for encouraging us to better explain the primers we use for our own assays, and now provide more detailed information in a new Fig 1.

      The result section needs a better structure as the first two pages do not refer to any of the main figures. For example, in which figure or table can the reader find the data that are discussed in lines 83 to 87?

      We have now substantially re-structured the entire Results section, and include the data that was discussed in lines 83 to 87 of the original manuscript, in Fig 1D of the revised manuscript.

      Table S1, instead of current Table 1, could be moved to main figures as it contains the important finding that the multiplexed assay may be more sensitive than the commercial one.

      As suggested, we have moved Table S1 to the main display items (now Table 1), and moved the original Table 1 to the supplementary items (now Table S3).

      The authors identified some samples that scored negative in commercial assays but positive in their new assay. This is important, however, the possibility of detecting false positives should be strengthened in a "Discussion" section.

      We thank the reviewer for highlighting this, and now discuss the issue of detecting false positives in more detail in the Discussion section of the revised manuscript:

      “RT-qPCR tests are molecular tests with high intrinsic accuracy, however false positive and false negative results can occur. The use of multiplex assays that detect multiple SARS-CoV-2 targets, such as those reported here, reduces the chance of both. Off-target reactivity is one possible cause of false positives, and although some have reported high false positive rates for the E gene assay [20, 22], this does not match our experience. In two patients, our N1E-RP and N2E-RP assays detected virus, albeit weakly, whereas commercial assays did not. As multiple SARS-CoV-2 targets were positive, these are likely true positive results and not due to off-target reactivity. False positives can also occur due to lab issues such as sample mislabelling, data entry errors, reagent contamination with target nucleic acids or contamination of primary specimens. However high standards of quality control at all stages of testing, and effective mitigation strategies should quickly identify problems. Additionally, sample re-test with an independent assay and/or patient re-sampling should also be effective measures to counter false positives, particularly in low pre-test probability situations such as mass screening.”

      Figures 1 to 3 have different panels which seem to be redundant. For example, Fig 1 A and B, Fig 2 B and C, Fig 3 C and D.

      These panels did contain the same data, plotted to convey slightly different information. However, we agree that this introduces a level of redundancy. For enhanced clarity, in the revised manuscript, we have removed most of these panels altogether, or moved them to supplementary figures.

      Figure 1: Give a rational why comparing before and after extraction. This heavily depends on the extraction method and not on the detection itself. In addition, IVT RNA does not reflect the complexity of a clinical specimen. This is rather confusing and deviates from the important findings.

      As part of the validation procedure it was important for us to show that the entire workflow, including the extraction procedure, was robust for use in clinical diagnostics. In this context, comparing pre- and post-extraction RT-qPCR results for both IVT RNA and viral samples provided us with an opportunity to test extraction efficiency. However, we agree that for the purpose of this manuscript, the inclusion of these data in (the former) Fig 1 detracted from the main message. In the revised manuscript we have therefore moved the data comparing Cq values before and after extraction to a new Fig S1, and briefly state the rationale behind this in the main text and figure legend.

      It was not our intention to imply that IVT RNA in any way reflects the complexity of a clinical specimen. We include these data as part of the step-by-step validation of our assays. Firstly, we show high sensitivity using IVT RNA; secondly, we show that a similar sensitivity is achieved on viral positive controls; and thirdly, we show that our assays perform equally well to widely used commercial assays on clinical samples.

      Figure 3: Were any of the negative samples/patients tested with an undetectable housekeeping gene, re-test positively?

      None of our patient samples had undetectable levels of RPP30. We note that all NTS samples were collected by healthcare professionals and in this context such findings will likely be rare. However this may not be the case when dealing with samples obtained by self-swabbing as the reviewer highlights in a comment below.

      Did adding this housekeeping gene as a control actually improve the detection of any patient samples? If the authors want to convince the readership of this quality control, experimental evidence should be provided.

      Fig 3C and D seem to contain this information somewhat, as here, the values were normalized and the CT values for the E and N gene decreased. Nevertheless there is no real explanation of this figure provided in the Result section at all. While this figure has potential, the authors have to keep in mind that the number of cells in a swab can be affected by many biological factors, including age, sample timing, inflammation of the respiratory tract, etc. In addition, viral genomes can exist intra- as well as extracellular, in the form of free virus. So even in the absence of human cells/detectable housekeeping genomes, viral RNA can be or should be present in a sample in case of infection. This explains (probably) why a correlation between detectable housekeeping gene and viral RNA is absent (Fig 3A and B?). This entire Fig 3 just needs a better explanation. The provided text does not describe any results and should go into a "Discussion" section.

      We thank the reviewer for highlighting the need to explain Fig 3 more clearly and that a key question is whether there is a correlation between the levels of the housekeeping control and viral RNA. Prompted by this question, we reanalysed our data and now show that there is a strong and statistically significant positive correlation between Cq values for RPP30 and SARS-CoV-2 targets (see below, and new Fig 4C). This shows that there is a lower probability of detecting SARS-CoV-2 RNA in samples that contain fewer human cells. This likely implies that for samples with high RPP30 Cq values, a proportion of virus positive samples will be missed, contributing to the high false negative rates that have been reported [3-5].

      Providing additional experimentation would require systematic re-contacting and re-testing of cases, and this is beyond our current research framework. While outside the scope of the current study, we hope that our manuscript will encourage others to perform the necessary large-scale experiments. Nonetheless, with this correlation alone, we believe that RPP30 provides useful information of benefit to clinical diagnostics (also see our response to Reviewer 2), and in the revised manuscript we outline how it might be best utilised (Discussion, Table S6).

      To provide a better explanation of Figure 3 (now Fig 4), we have included the following in the Results section:

      “A statistically significant linear correlation between Cq values for each of the viral probes (E, N1, and N2) and the Cq values for the RPP30 sample quality probe (p 40; Fig 4D and Fig S4A). Theoretically, using this approach, even a strong positive sample (SARS-CoV-2 Cq value of 28.2) of good quality (RPP30 Cq value of 20.3) may have given a false negative test result (SARS-CoV-2 Cq value of 40) if it had contained the same low amount of human material as the reference sample (RPP30 Cq value of 32.1; viral Cq: 32.1-20.3+28.2=40). Conversely, normalising samples to an optimal quality sample (RPP30 Cq 20.1/20.3) gives an indication of what viral Cq values may have been if all samples had contained a similar (more optimal) amount of material (Fig 4E, Fig S4B). This highlights the possibility that a proportion of apparent SARS-CoV-2 negative samples are in fact false negatives as a result of insufficient material in the swab fluid.”

      Self-swabbing is surely a potential source of variability and false-negatives, but many publications have shown the suitability of saliva testing. This should also be discussed and would probably negate the need for such a quality control.

      We agree with the reviewer that self-swabbing will be more prone to variability. Therefore, the RPP30 control will have particular value here, lowering the associated risk of false negatives. While NTS sampling remains a major modality for testing for the foreseeable future, saliva is certainly a potential alternative strategy, one that may benefit from lower sample variability.

      We now include the reviewer’s point on this in the Discussion:

      “Testing saliva, as an alternative to NTS sampling, could also be beneficial as a modality that may have less-sample to sample variability [7]”

      Which assay works better, the N1E-RP or the N2E-RP assay? A final conclusion is missing here.

      Although we could not detect substantial differences between these two assays during our validation process, others have reported a marginally higher sensitivity of the N1 over the N2 assay [6]. We would therefore recommend the use of the N1E-RP assay for first line testing, with the N2E-RP assay available as a second line test of equivalent sensitivity in case of inconclusive initial test results. We comment on this in the revised manuscript:

      “Although we did not detect substantial differences between our two assays, others have reported higher sensitivity of the N1 over the N2 assay [19]. We therefore recommend the use of the N1E-RP assay for primary testing, and the N2E-RP assay could be employed if initial results are inconclusive.”

      Reviewer #1 (Significance (Required)): Naturally, in this pandemic, this topic is important as sensitive and affordable methods to detect SARS-CoV-2 infections are in need. This Reviewer agrees that multiplexing could be an elegant approach to fill this need.

      Reviewer #2 (Evidence, reproducibility and clarity (Required)): In this manuscript, Reijns and colleagues describe an approach to detect the causative agent of COVID-19, the beta coronavirus SARS-CoV-2, using an inexpensive in-house multiplex RT-qPCR. Concomitantly, viral E, N and RdRP(probe P2) as well as human RPP30 and a herpesvirus nucleic acid are also detected in order to monitor both the sample quality and the sample preparation. Reijns et al. performed testing on a huge amount of samples and used the data to describe the strength and limitations of the assay. The data is sound and give a very good impression of the 4-plex PCR capabilities. I read manuscript fluently and consider as linguistically very good. However, I still have a few comments and remarks that would strengthen the manuscript:

      **Major issues:** In the first section of the results section, many primer / probe conditions are given that make the reading flow difficult. Instead of using (data not shown) it would be helpful to use a table or a graphic to illustrate the various approaches.

      We thank the reviewer for suggesting the use of graphics to explain our different approaches. To aid the reader, we now include a diagram in the new Fig 1 that shows the positions of primers and probes used in our work (A), and illustrate the various 4-plex assays (B, C).

      In general, I suggest to replace Ct by Cq, since the IVT standards are a quantification method.

      As suggested by the reviewer we now use Cq instead of Ct throughout our manuscript, following MIQE guidelines [7].

      There has already been a change away from the initial E and RdRP gene based assay because of the published sensitivity issues and the use of degenerate bases as well as the detection of unspecific nucleic acids for E gene). In particular, it has been shown that the Sarbeco-E-yields false positive results (Toptan et al. 2020 (https://doi.org/10.3390/ijms21124396), Konrad et al. 2020 (https://doi.org/10.2807/1560-7917.ES.2020.25.9.2000173)), so that many laboratories do not consider E-gene-based results for borderline samples anymore. In this manuscript, the authors should comment on why they still use the results from the E gene / RdRP and describe their experience.

      We thank the reviewer for highlighting issues with the RdRp and E gene primer/probe pairs. In the process of our work we had also become aware that the RdRp-P2 assay suffers from low sensitivity, as has now been widely reported. However, although the E gene assay also detects SARS-CoV, we were not aware of potential problems with high rates of false positives as described by Toptan et al (2020) and Konrad et al (2020). It did come to our attention that early on in the pandemic some oligonucleotide producers reported problems with contamination of primers with SARS-CoV-2 template RNA synthesised in the same facilities, and were careful to avoid these providers. In our work, we did not experience any problems with apparent false positive detection of the E gene: it was never detected in any of our negative controls, and out of 84 patients that tested negative with the commercial TaqPath assay we did not find any that were positive for E gene only when using our N1E-RP and N2E-RP assays. In this context, it is also important to emphasise that a positive diagnosis is given only when both viral targets are detected (Table S6), which is one of the strengths of our multiplex assays.

      As suggested by Reviewer 1, we now discuss the issue of false positives in more detail in the revised manuscript. We also comment on high false positive rates observed by others for the E gene assay, citing the two studies, but state that this does not match our own experience:

      “Off-target reactivity is one possible cause of false positives, and although some have reported high false positive rates for the E gene assay [20, 23], this does not match our experience.”

      In this manuscript, it should be indicated that the SARS-CoV-2 specific Probe P2 (according to Corman et al. 2020) was used. The reason for lower sensitivity due to nucleotide ambiguity and mismatch has to be explained in more detail. In addition to Corman et al. 2020 (see reference 2), Toptan et al 2020 (https://doi.org/10.3390/ijms21124396) might serve as helpful literature.

      In tables describing primers and probes, and the new Fig 1, we indicate that we used RdRp probe P2. In addition, we now also specifically state in the legend of Fig 1 that this probe only detects SARS-CoV-2 and that the primers used in the RdRp-P2 assay (as originally designed by Corman et al) contain nucleotide ambiguities and a mismatch. Finally, in the main text we explain:

      “Overall, we find RdRp detection to be at least 20-fold less sensitive than for E gene, N1 and N2 under our assay conditions; consistent with reports by others [19]. This may be due to a mismatch in the reverse primer employed in the RdRp (P2) assay, as originally designed [14].”

      With regard to the marginally positive samples that were not consistent in all assays, were the PCR products analyzed using high-resolution PAA genes and, if possible, sequenced? The sequencing approach (Sanger or NGS) offers the final characterization of the PCR products (especially for pan-genotypic primers such as E-Sarbeco). The samples declared as "inconclusive" could be further characterized in this way.

      Unfortunately, it has not been possible for us to carry out additional analyses for such (now historical) samples. Given the high prevalence of SARS-CoV-2 and the low sequence variability at primer/probe binding sites (new Table 2 and S5), inconclusive or marginally positive samples most likely reflect low viral load and/or low sample quality. Nevertheless, we now highlight the utility of further characterising such samples in the revised manuscript:

      “However, differentiating between samples with low viral loads and false positives is challenging. Analysis of such samples by Sanger sequencing of PCR products, or nanopore sequencing of RNA present could provide useful information. Further clinical evaluation and repeat sampling of the patient involved may also be a beneficial route to a secure clinical diagnosis.”

      The normalization in figure 3 should be also explained in the main text. Especially, why this approach was used for normalization.

      In the Results section we now describe the normalisation as follows:

      “A statistically significant linear correlation between Cq values for each of the viral probes (E, N1, and N2) and the Cq values for the RPP30 sample quality probe (p 40; Fig 4D and Fig S4A). Theoretically, using this approach, even a strong positive sample (SARS-CoV-2 Cq value of 28.2) of good quality (RPP30 Cq value of 20.3) may have given a false negative test result (SARS-CoV-2 Cq value of 40) if it had contained the same low amount of human material as the reference sample (RPP30 Cq value of 32.1; viral Cq: 32.1-20.3+28.2=40). Conversely, normalising samples to an optimal quality sample (RPP30 Cq 20.1/20.3) gives an indication of what viral Cq values may have been if all samples had contained a similar (more optimal) amount of material (Fig 4E, Fig S4B). This highlights the possibility that a proportion of apparent SARS-CoV-2 negative samples are in fact false negatives as a result of insufficient material in the swab fluid.”

      Nonetheless, it looks like the normalized values wills cluster much more strongly than those corresponding to the actual values. The authors should comment on this phenomenon. It appears that the higher cq values (less virus) are subject to a strong correction factor more often than high values. Are there any statistical relevant tendencies towards this phenomenon? For everyday clinical practice, does this mean that low samples Cqs (mostly) only reflect the quality of the sample, but not the viral load?

      We thank the reviewer for highlighting the stronger clustering of Cq values after normalisation, and for encouraging us to explore this further. We now show that there is a statistically significant linear correlation between RPP30 and SARS-CoV-2 Cq values (Fig 4C). This would indeed imply that a substantial proportion of the variability in SARS-CoV-2 Cq values seen in clinical practice is due to sample quality rather than different viral loads. However, outliers from the linear correlation when comparing samples from many different patients are to be expected (as seen in Fig 4C), because viral load is known to vary, with time of sampling relative to onset of symptoms one important contributing factor. In a research context, expressing viral load relative to a human control may be beneficial to differentiate between sample quality and absolute quantities of (intra/extracellular) viral RNA.

      In the revised manuscript we state:

      “Notably, the SARS-CoV-2 Cq values clustered more strongly after normalisation (Fig 4D, E; Fig S4). This reduced variability not only shows that the amount of human material present in NTS samples impacts on assay sensitivity, but also suggests that variability in viral load is not as great as implied by RT-qPCR data without normalisation.”

      Finally, it remains somewhat unclear to what extent the Cq values of the RPP30 should have an influence on the routine diagnostics. The authors discuss that a fixed cutoff value would be a possibility to sort out poor swab samples, but if a cq value is available it would also make sense to generate a kind of quality score that can display the significance of a test. It would be helpful if the authors could comment on this or other possibilities.

      We agree that it would be beneficial for routine diagnostics to derive such a measure. However, at this stage we do not have sufficient data to generate a robust quality score based on the RPP30 Cq values. Nonetheless, we believe RPP30 Cq values have immediate utility for routine diagnostics, and could help improve validity of test results going forward:

      1. Samples with undetectable RPP30 should trigger repeat sample collection, and not be given a false negative test result;
      2. Samples with high viral Cq values and/or for which only one of two viral targets are detected can be better interpreted in the context of the amount of human material as measured by RPP30 Cq;
      3. Ongoing monitoring of swab quality allows rapid identification of potential technical issues with swabbing;
      4. Normalisation of viral Cq values using RPP30 Cq values might be helpful in a research context to derive a more meaningful measure of viral loads, by removing one source of variability;
      5. Collection of such data on an ongoing basis would ultimately allow this to be translated into a quality score that could be used as part of diagnostics algorithms. In the revised manuscript we now discuss this as follows:

      “Absence of RPP30 signal (undetected or Cq >40) clearly indicates that absence of viral detection cannot be interpreted as a negative test result and that a repeat test is required (Table S6). However, utilising RPP30 Cq values when interpreting an apparent SARS-CoV-2 negative sample requires further consideration: what should the RPP30 Cq limit be for which to order a repeat test? One option would be to simply set an arbitrary cut-off, e.g. one could decide to re-test any samples with RPP30 Cq >30, or with Cq values above the 95th centile (Cq ~ 31 for our 108 samples). To determine robust cut-off limits, collection of RPP30 data for a much larger number of patient samples would be desirable. This would allow development of diagnostic algorithms that could incorporate a sample quality score based on the level of RPP30 detected. Nonetheless, RPP30 data, even as it stands, are useful for the interpretation of cases for which only one of the SARS-CoV-2 targets is (weakly) positive, with samples with high RPP30 Cq values interpreted with particular caution. In such cases, repeat testing of the same sample (with an independent assay of equal or better sensitivity) would be advisable, and repeat patient specimen collection and testing might also be considered (see Table S6 for guidance).”

      Over the past few months, more and more virus subtypes have formed through the manifestation of point mutations (and amino acid substitutions). The authors should therefore definitely comment on the current strains as to whether all primers / probes are able to detect the virus variants circulating worldwide without loss of sensitivity.

      We thank the reviewer for this suggestion and now include a table providing information on mismatches in primer and probe binding sites (see Table 2 and Table S5 of the revised manuscript). This shows that only a small proportion of 97,782 strains for which high quality genome sequencing is available have changes in primer/probe binding sites. In addition, the use of two different primer/probe sets in our multiplex assays provides a further safeguard against failure to detect strains with such changes.

      Along this line, which virus strains were used for the cultivation as described in line 131? Is sequence data available? If so, it would provide helpful information to characterize the viral strain.

      We have added strain information, accession codes for genome sequences and information on primer/probe binding for both control strains (hCoV-19/England/02/2020 and BetaCoV/Munich/ChVir984/2020) we used in our work (see Materials and Methods of the revised manuscript).

      Line 206ff: In my opinion, this section belongs more to the discussion part than to material and methods that describe the technical implementation.

      We agree and have now moved this section to the Discussion. Furthermore, we’ve made additional changes to better highlight the potential for further improvements to our assays, and SARS-CoV-2 RT-qPCR assays in general.

      Is there a loss of sensitivity compared to the single PCRs? This data is very important and useful for other users. They should therefore be included explicitly in the manuscript (supplements).

      We set out to develop multiplex PCR assays to allow more efficient and cost-effective testing. In the early stages of this process we performed small pilot experiments with positive control IVT RNA and individual primer/probe pairs that are widely used and well-established to sensitively detect SARS-CoV-2 RNA. With the exception of the RdRp primers/probe, we found all to perform well, with the ability to detect 10 copies of RNA. However, we did not perform a side-by-side comparison of uni- and multiplex PCRs, and to improve the structure and flow of the Results section, as requested by Reviewer 1, we have now removed all mention of the single PCR assays.

      Altogether, the key message of our work is that the N1E-RP and N2E-RP assays are able to detect between 1 and 3 copies of SARS-CoV-2 RNA and show equivalent performance to commercially available multiplex assays.

      **Minor issues:** Line 15 ff.: Source is missing, is this WHO-data?

      The estimated number of infections and fatalities at the time of writing of the original manuscript was based on data from the online interactive dashboard hosted by Johns Hopkins University. At the suggestion of Reviewer 3, we have removed precise numbers from the revised manuscript to make the introduction less time-dependent. Nonetheless, we now include a reference to the JHU online resource, as well as the weekly epidemiological updates from the WHO (https://www.who.int/emergencies/diseases/novel-coronavirus-2019/situation-reports) for readers interested in the latest figures.

      Fig S3: How was the digital droplet PCR carried out? A brief description should be included in the legend text.

      We purchased these samples from QCMD, an independent International External Quality Assessment & Proficiency Testing (EQA/PT) organisation. QCMD performed the digital droplet PCR, before distribution under the QCMD 2020 Coronavirus Outbreak Preparedness EQA Pilot Scheme, and provided us with details, which have now been added to the Materials and Methods section:

      “Quantification of control samples was carried out by QCMD prior to distribution within the EQA scheme, using droplet digital PCR (ddPCR) with E-gene primers and probe [13, 14] on the Biorad droplet digital PCR platform. A serial dilution of inactivated SARS-CoV-2 (strain BetaCoV/Munich/ChVir984/2020; GenBank Accession MT270112, [32]) was prepared and each dilution replicate tested 4 times using both RT-qPCR and ddPCR assays. Regression analysis was used to assess the linearity across the dilution series, and the analytical measurement range established for both assays, comparing results of each by Bland-Altman difference plot."

      In addition, we provide more details with the relevant table (new Table S3) and in the legend of the associated figure (new Fig 2) we state: “See Materials and Methods for details”.

      Figure 1a: PCR efficiencies are missing.

      We have now added PCR efficiencies to all relevant graphs.

      Line 145: MS2 appears, but without explaining the context. This should be improved here with additional information (this does not appear until line 154).

      At first mention of MS2 in the main text, we now state:

      “Internal controls were included to provide confirmation of successful nucleic acid extraction and absence of PCR inhibitors, with lysis buffer spiked with both MS2 (an RNA bacteriophage that infects Escherichia coli) and PhHV (a DNA virus that infects seals), detected by the TaqPath and N1E-RP/N2E-RP assays respectively..”

      Page 15, H20 instead of H20, reaction mix instead of Reaction mix.

      In the supplementary protocol, we have changed “H2O” to “H2O” and “Reaction mix” to “reaction mix”.

      Reviewer #2 (Significance (Required)): The novel coronavirus SARS-CoV-2 is the causative agent of the acute respiratory disease COVID-19 which has become a global concern due to its rapid spread and high death rate. While some patients have no symptoms at all, but are still able to spread the virus, others have severe symptoms, often with fatal outcome. The gold standard in SARS-CoV-2 detection is the RT-qPCR approach, however, the high cost commercial kits are available in limited amounts only. The issue of the scarcity of resources is still an highly important issue, especially in terms of the incredibly rapidly increasing number of cases worldwide. Thus, the manuscript is of significance for the field and timely. Especially, diagnostic laboratories in low-income countries that are involved in the managing the pandemic but also researchers will benefit from this manuscript and save resources.

      Reviewer #3 (Evidence, reproducibility and clarity (Required)): In this study Reijns et al developed a multiplex RT-PCR assay (alternative primer-probe sets and enzyme mixes) to detect SARS‐CoV‐2 and internal controls. The authors conclude that their assay performed equally well as established commercial kits. The authors also demonstrated that nose‐and‐throat swab samples have considerable variability in patient material content (>1,000‐fold variability). High variability is expected, but it is still important to substantiate this notion with numbers. Overall, I like the study and find it methodologically sound. Sample numbers in the tests are in most cases good. I have very few objections and hope to see the manuscript published soon.

      **SPECIFIC COMMENTS:** 1."The COVID‐19 pandemic originated in Wuhan (China) in December 2019 and at the time of writing has infected more than 13.1 million people worldwide, resulting in well over 0.57 million COVID‐19‐related deaths..." I suggest a more timeless starting of the introduction, not pointing out exact number of infections and deaths since these numbers quickly become obsolete. The reader will know the severity of the pandemic and the importance of methodological development without statement of exact numbers. This comment reflects my personal opinion and it is completely up to the authors to choose how to phrase this section.

      We agree with the reviewer that a more timeless start to the introduction makes more sense. Therefore, as suggested, we have changed this section of the manuscript, which now reads as follows:

      “The COVID-19 pandemic, caused by the novel coronavirus SARS-CoV-2 [1], originated in Wuhan (China) in December 2019 and rapidly spread across the globe, resulting in substantial mortality [2, 3] and widespread economic damage. Until a vaccine becomes available, public health strategies centred on reducing the rate of transmission are crucial to mitigating the epidemic, for which effective and affordable testing strategies to enable widespread population surveillance are essential.”

      2.Tables listing primers and probes should include the amplicon (PCR product) length for each primer-probe pair. Product length is an important consideration for fragmented RNA samples, such as for example heat-inactivated or longer-term stored samples. It should not be put on the reader to find out the amplicon lengths.

      To provide the reader with this information, the revised manuscript now includes the following:

      1. As suggested, the amplicon length for each primer pair is added to all tables that list primers and probes (PCR products: RdRp – 100 bp; E- 113 bp; N1 – 72 bp; N2 – 67 bp);
      2. A diagram in a new Fig 1 indicates the positions of all primers and probes on the SARS-CoV-2 genome along with amplicon length.
      3. A supplementary SnapGene file with primers and probes on the SARS-CoV-2 (Wuhan-Hu-1) genome to allow readers to look at further details in the context of the viral genome.

        3.Line 131: "To confirm sensitivity using total viral RNA, nucleic acids isolated from cultured SARS‐CoV‐2 were also used to make a dilution series (10^‐1 to 10^‐6)." I lack a methodological description how viral nucleic acid was quantified. It is not entirely trivial to separate viral RNA from RNA contributed from the cells used for the in vitro expansion of the virus.

      We apologise for the lack of clarity on this in our original manuscript. The purpose of this experiment was not to measure a defined number of RNA molecules, but to ensure that there was no inhibition of viral target amplification in a more complex sample by demonstrating linearity over a range of dilutions. The cultured SARS-CoV-2 positive control was provided by Prof Rory Gunson (Clinical Lead West of Scotland Specialist Virology Centre, NHS Greater Glasgow and Clyde) as inactivated supernatant from virus (strain hCoV-19/England/02/2020) propagated in cell culture. We then isolated RNA from a dilution series of this supernatant, using the methods described in our manuscript, but did not determine the precise concentration. The RT-qPCR data for this series shows a good fit and amplification efficiency, similar to what was found for the IVT RNA, and QCMD virus calibration curves (new Fig 2). The known copy number of the QCMD virus (as determined by ddPCR) allowed us to calculate that the concentration of the virus in the supernatant provided to us was between 0.7 and 2.2 x 105 copies/ml, with viral RNA detected down to between 0.7 and 3 copies with our N1E-RP and N2E-RP assays. We have substantially restructured the results section, and hope to have made the way we used the different viral controls clearer in the revised version of the manuscript.

      4.Line 150: "All positive and negative controls gave the expected results (Table S4)" I don't like the exact formulation since it is not clear for the reader what are the "expected results", including the "expected" quantitative results (Ct).

      We agree that the use of “expected results” does not provide the reader with sufficient information. We have therefore changed this to:

      “Results for controls were as anticipated (Table S4), with signal absent (undetermined) for SARS-CoV-2 and RPP30 targets for the negative controls, and Cq values for the SARS-CoV-2 RNA positive control (50 copies) similar to those obtained previously (Fig 2A).”

      In addition, we now provide more information on the precise nature of the negative and positive controls with Table S4:

      “-ve (extr), negative control with viral transport medium after RNA isolation (does not contain SARS-CoV-2 or human material; does contain PhHV);

      -ve, negative control containing water only (should not contain any RNA)

      +ve, positive control with in vitro transcribed RNA (50 copies; contains SARS-CoV-2 target RNA, does not contain human or PhHV nucleic acids)”

      Reviewer #3 (Significance (Required)): This study provides an alternative multiplex RT-PCR assay to detect SARS-CoV-2 infection. I find the results important and useful for the research and medical community.

      Rebuttal references

      1. Zhu N, Zhang D, Wang W, Li X, Yang B, Song J, et al. A Novel Coronavirus from Patients with Pneumonia in China, 2019. N Engl J Med. 2020;382(8):727-33. Epub 2020/01/25. doi: 10.1056/NEJMoa2001017. PubMed PMID: 31978945; PubMed Central PMCID: PMCPMC7092803.
      2. Brown JR, O’Sullivan D, Pereira RP, Whale AS, Busby E, Huggett J, et al. Comparison of SARS-CoV2 N gene real-time RT-PCR targets and commercially available mastermixes. 2020:2020.04.17.047118. doi: 10.1101/2020.04.17.047118 %J bioRxiv.
      3. Arevalo-Rodriguez I, Buitrago-Garcia D, Simancas-Racines D, Zambrano-Achig P, del Campo R, Ciapponi A, et al. False-negative results of initial RT-PCR assays for COVID-19: A systematic review. 2020:2020.04.16.20066787. doi: 10.1101/2020.04.16.20066787 %J medRxiv.
      4. Watson J, Whiting PF, Brush JE. Interpreting a covid-19 test result. BMJ. 2020;369:m1808. Epub 2020/05/14. doi: 10.1136/bmj.m1808. PubMed PMID: 32398230.
      5. Woloshin S, Patel N, Kesselheim AS. False Negative Tests for SARS-CoV-2 Infection - Challenges and Implications. N Engl J Med. 2020;383(6):e38. Epub 2020/06/06. doi: 10.1056/NEJMp2015897. PubMed PMID: 32502334.
      6. Vogels CBF, Brito AF, Wyllie AL, Fauver JR, Ott IM, Kalinich CC, et al. Analytical sensitivity and efficiency comparisons of SARS-CoV-2 RT-qPCR primer-probe sets. Nat Microbiol. 2020. Epub 2020/07/12. doi: 10.1038/s41564-020-0761-6. PubMed PMID: 32651556.
      7. Bustin SA, Benes V, Garson JA, Hellemans J, Huggett J, Kubista M, et al. The MIQE guidelines: minimum information for publication of quantitative real-time PCR experiments. Clin Chem. 2009;55(4):611-22. Epub 2009/02/28. doi: 10.1373/clinchem.2008.112797. PubMed PMID: 19246619.
    2. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #3

      Evidence, reproducibility and clarity

      In this study Reijns et al developed a multiplex RT-PCR assay (alternative primer-probe sets and enzyme mixes) to detect SARS‐CoV‐2 and internal controls. The authors conclude that their assay performed equally well as established commercial kits. The authors also demonstrated that nose‐and‐throat swab samples have considerable variability in patient material content (>1,000‐fold variability). High variability is expected, but it is still important to substantiate this notion with numbers. Overall, I like the study and find it methodologically sound. Sample numbers in the tests are in most cases good. I have very few objections and hope to see the manuscript published soon.

      SPECIFIC COMMENTS:

      1."The COVID‐19 pandemic originated in Wuhan (China) in December 2019 and at the time of writing has infected more than 13.1 million people worldwide, resulting in well over 0.57 million COVID‐19‐related deaths..." I suggest a more timeless starting of the introduction, not pointing out exact number of infections and deaths since these numbers quickly become obsolete. The reader will know the severity of the pandemic and the importance of methodological development without statement of exact numbers. This comment reflects my personal opinion and it is completely up to the authors to choose how to phrase this section.

      2.Tables listing primers and probes should include the amplicon (PCR product) length for each primer-probe pair. Product length is an important consideration for fragmented RNA samples, such as for example heat-inactivated or longer-term stored samples. It should not be put on the reader to find out the amplicon lengths.

      3.Line 131: "To confirm sensitivity using total viral RNA, nucleic acids isolated from cultured SARS‐CoV‐2 were also used to make a dilution series (10^‐1 to 10^‐6)." I lack a methodological description how viral nucleic acid was quantified. It is not entirely trivial to separate viral RNA from RNA contributed from the cells used for the in vitro expansion of the virus.

      4.Line 150: "All positive and negative controls gave the expected results (Table S4)" I don't like the exact formulation since it is not clear for the reader what are the "expected results", including the "expected" quantitative results (Ct).

      Significance

      This study provides an alternative multiplex RT-PCR assay to detect SARS-CoV-2 infection. I find the results important and useful for the research and medical community.

    3. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #2

      Evidence, reproducibility and clarity

      In this manuscript, Reijns and colleagues describe an approach to detect the causative agent of COVID-19, the beta coronavirus SARS-CoV-2, using an inexpensive in-house multiplex RT-qPCR. Concomitantly, viral E, N and RdRP(probe P2) as well as human RPP30 and a herpesvirus nucleic acid are also detected in order to monitor both the sample quality and the sample preparation. Reijns et al. performed testing on a huge amount of samples and used the data to describe the strength and limitations of the assay. The data is sound and give a very good impression of the 4-plex PCR capabilities. I read manuscript fluently and consider as linguistically very good. However, I still have a few comments and remarks that would strengthen the manuscript:

      Major issues:

      In the first section of the results section, many primer / probe conditions are given that make the reading flow difficult. Instead of using (data not shown) it would be helpful to use a table or a graphic to illustrate the various approaches. In general, I suggest to replace Ct by Cq, since the IVT standards are a quantification method.

      There has already been a change away from the initial E and RdRP gene based assay because of the published sensitivity issues and the use of degenerate bases as well as the detection of unspecific nucleic acids for E gene). In particular, it has been shown that the Sarbeco-E-yields false positive results (Toptan et al. 2020 (https://doi.org/10.3390/ijms21124396), Konrad et al. 2020 (https://doi.org/10.2807/1560-7917.ES.2020.25.9.2000173)), so that many laboratories do not consider E-gene-based results for borderline samples anymore. In this manuscript, the authors should comment on why they still use the results from the E gene / RdRP and describe their experience.

      In this manuscript, it should be indicated that the SARS-CoV-2 specific Probe P2 (according to Corman et al. 2020) was used. The reason for lower sensitivity due to nucleotide ambiguity and mismatch has to be explained in more detail. In addition to Corman et al. 2020 (see reference 2), Toptan et al 2020 (https://doi.org/10.3390/ijms21124396) might serve as helpful literature. With regard to the marginally positive samples that were not consistent in all assays, were the PCR products analyzed using high-resolution PAA genes and, if possible, sequenced? The sequencing approach (Sanger or NGS) offers the final characterization of the PCR products (especially for pan-genotypic primers such as E-Sarbeco). The samples declared as "inconclusive" could be further characterized in this way.

      The normalization in figure 3 should be also explained in the main text. Especially, why this approach was used for normalization. Nonetheless, it looks like the normalized values wills cluster much more strongly than those corresponding to the actual values. The authors should comment on this phenomenon. It appears that the higher cq values (less virus) are subject to a strong correction factor more often than high values. Are there any statistical relevant tendencies towards this phenomenon? For everyday clinical practice, does this mean that low samples Cqs (mostly) only reflect the quality of the sample, but not the viral load? Finally, it remains somewhat unclear to what extent the Cq values of the RPP30 should have an influence on the routine diagnostics. The authors discuss that a fixed cutoff value would be a possibility to sort out poor swab samples, but if a cq value is available it would also make sense to generate a kind of quality score that can display the significance of a test. It would be helpful if the authors could comment on this or other possibilities.

      Over the past few months, more and more virus subtypes have formed through the manifestation of point mutations (and amino acid substitutions). The authors should therefore definitely comment on the current strains as to whether all primers / probes are able to detect the virus variants circulating worldwide without loss of sensitivity. Along this line,which virus strains were used for the cultivation as described in line 131? Is sequence data available? If so, it would provide helpful information to characterize the viral strain.

      Line 206ff: In my opinion, this section belongs more to the discussion part than to material and methods that describe the technical implementation.

      Is there a loss of sensitivity compared to the single PCRs? This data is very important and useful for other users. They should therefore be included explicitly in the manuscript (supplements).

      Minor issues:

      Line 15 ff.: Source is missing, is this WHO-data?

      Fig S3: How was the digital droplet PCR carried out? A brief description should be included in the legend text.

      Figure 1a: PCR efficiencies are missing.

      Line 145: MS2 appears, but without explaining the context. This should be improved here with additional information (this does not appear until line 154).

      Page 15, H20 instead of H20, reaction mix instead of Reaction mix.

      Significance

      The novel coronavirus SARS-CoV-2 is the causative agent of the acute respiratory disease COVID-19 which has become a global concern due to its rapid spread and high death rate. While some patients have no symptoms at all, but are still able to spread the virus, others have severe symptoms, often with fatal outcome. The gold standard in SARS-CoV-2 detection is the RT-qPCR approach, however, the high cost commercial kits are available in limited amounts only. The issue of the scarcity of resources is still an highly important issue, especially in terms of the incredibly rapidly increasing number of cases worldwide. Thus, the manuscript is of significance for the field and timely. Especially, diagnostic laboratories in low-income countries that are involved in the managing the pandemic but also researchers will benefit from this manuscript and save resources.

    4. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #1

      Evidence, reproducibility and clarity

      In order to improve SARS-CoV-2 diagnostics, Reijns et al. developed a multiplexed RT-qPCR protocol that allows simultaneous detection of two viral genes, one housekeeping gene as well as an external gene as an extraction control. Compared to running parallel assays to detect genes individually, the turnaround time is much shorter and reagents are saved. Furthermore, the presented data suggest that the assay is more sensitive than commercial kits. The authors also propose the detection of the human housekeeping gene as a measure of sample quality control. In principal, this work has potential but the manuscript itself needs a better structure.

      Major concerns:

      The authors have used the Takara RT-qPCR kit for their study. Did the authors try other commercial kits? Can the authors elaborate on the supply chain of the Takara kit? Could it cover population testing in case of shortages of other commercial kits?

      For better comparison, is it possible to give information on which primers the commercial kits are based on? Also, explain better the primers used in this study. For example, the N1 and N2 primers are directed against different regions of the SARS-CoV-2 N gene.

      The result section needs a better structure as the first two pages do not refer to any of the main figures. For example, in which figure or table can the reader find the data that are discussed in lines 83 to 87?

      Table S1, instead of current Table 1, could be moved to main figures as it contains the important finding that the multiplexed assay may be more sensitive than the commercial one. The authors identified some samples that scored negative in commercial assays but positive in their new assay. This is important, however, the possibility of detecting false positives should be strengthened in a "Discussion" section.

      Figures 1 to 3 have different panels which seem to be redundant. For example, Fig 1 A and B, Fig 2 B and C, Fig 3 C and D.

      Figure 1: Give a rational why comparing before and after extraction. This heavily depends on the extraction method and not on the detection itself. In addition, IVT RNA does not reflect the complexity of a clinical specimen. This is rather confusing and deviates from the important findings.

      Figure 3: Were any of the negative samples/patients tested with an undetectable housekeeping gene, re-test positively? Did adding this housekeeping gene as a control actually improve the detection of any patient samples? If the authors want to convince the readership of this quality control, experimental evidence should be provided.

      Fig 3C and D seem to contain this information somewhat, as here, the values were normalized and the CT values for the E and N gene decreased. Nevertheless there is no real explanation of this figure provided in the Result section at all. While this figure has potential, the authors have to keep in mind that the number of cells in a swab can be affected by many biological factors, including age, sample timing, inflammation of the respiratory tract, etc. In addition, viral genomes can exist intra- as well as extracellular, in the form of free virus. So even in the absence of human cells/detectable housekeeping genomes, viral RNA can be or should be present in a sample in case of infection. This explains (probably) why a correlation between detectable housekeeping gene and viral RNA is absent (Fig 3A and B?). This entire Fig 3 just needs a better explanation. The provided text does not describe any results and should go into a "Discussion" section.

      Self-swabbing is surely a potential source of variability and false-negatives, but many publications have shown the suitability of saliva testing. This should also be discussed and would probably negate the need for such a quality control.

      Which assay works better, the N1E-RP or the N2E-RP assay? A final conclusion is missing here.

      Significance

      Naturally, in this pandemic, this topic is important as sensitive and affordable methods to detect SARS-CoV-2 infections are in need. This Reviewer agrees that multiplexing could be an elegant approach to fill this need.

    1. Note: This rebuttal was posted by the corresponding author to Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Reply to the reviewers

      We thank the reviewers for their feedback and constructive comments to our work. We provide here a point-by-point response to the comments of Reviewers #1, #2 and #3 (text in grey and italic).

      Responses written in plain text correspond to Reviewer comments that have been addressed in the revised version of the manuscript provided at this stage of the review process (referred-to as “revised version I” below).

      Reponses written in bold text correspond to comments that need further experiments. The list of experiments we intend to perform to address these comments is provided in a separate document (Revision plan). The results of these additional experiments will be included in a later revised version of the manuscript referred-to as “revised version II” below.

      Reviewer #1

      The manuscript addresses an important topic, the posttranscriptional maturation of ribosomes. This topic is inherently interesting because we normally think of ribosome biogenesis as a sequential series of steps that automatically proceeds and cannot be "accelerated" in physiological conditions, but only "delayed" in the presence of genetic mutations. In short, the manuscript proposes that RIOK2 phosphorylation by the action of RSK, below the Ras/MAPK pathway promotes the synthesis of the human small ribosomal subunit.

      I honestly admit that I have some difficulties in reviewing this manuscript. The quality of the presented data is, in generally, good. However, overall I find the whole manuscript preliminary and I am not much convinced of the conclusions. Several aspects are superficially analyzed. In short, I think that most of the conclusions are not fully supported by the data because shortcuts are present. A list of all the aspects that I found wrong are listed.

      Biological issue

      1. _The authors claim that the effects of the inhibition of the maturation of ribosomes by acting on a pathway upstream of RIOk2 are limited to the 40S subunit. This is far from being a trivial point, for the following reason. RIOK2 is known to affect the maturation of 40S ribosomes. Hence, the fact that using an upstream inhibitor of the MAPK pathway such as PD does not inhibit 60S processing in reality would argue against a biologically relevant control in ribosome maturation (of the MAPK patheay). Have the authors considered this? In a way, also, given the fact that the mutants confirm a role in 18S final maturation, it is a bit complex to put all the data in a clear biological context.

      We agree that we put more emphasis on the effects on the pre-40S pathway than on the pre-60S pathway in the original manuscript but we did not claim that the effects of PD or LJH inhibitors of the MAPK pathway are restricted to the 40S subunit. We described that the effect of PD or LJH on the 32S was less severe than on the 30S, and we did mention variations of the 12S intermediate. These changes are in the same range of amplitude as the changes in the 21S and 18S-E intermediates in the small subunit pathway. The Northern blot data concerning the pre-60S pathway were placed in the supplementary material of the original manuscript, which may have left the reader with an impression of lesser emphasis. We rephrased this part in the present revised version I of the manuscript (Page 6, Line 26) and we now show the pre-40S and pre-60S intermediates on the same figures (Figures 1A and 1C).

      In addition, we will probe more exhaustively the intermediates of the pre-60S pathway in the revised version II of the manuscript as described in the revision plan. These data will be complemented with metabolic labeling experiments to provide a more dynamic analysis of the pre-rRNA processing defects resulting from inactivation of the MAPK pathway. Furthermore, as requested by Reviewer #2 (see below), we will quantify more accurately these data.

      A number of specific issues will be concisely described.

      Manuscript very well written. Data do not always support the strong conclusions. Low magnitude of the observed effects.

      In introduction the authors make a general claim that ribosome biogenesis is one of the most energetically demanding cellular activities. This statement lingers in the literature since 15 years but in reality it has never been formally proved for mammalian cells, and certainly not for HEK293 cells. The original statement, to my knowledge, can be traced by some obscure statement referred to the yeast case and then repeated as a truth. In conclusion, beside being a very banal observation, it should be referenced.

      We agree with this comment of Reviewer #1. The original statement has been proposed by Jonathan R. Warner (Warner, 1999, TiBS and references therein) and data from the Bähler group also supported this statement (Marguerat et al., 2012, Cell). However, these data were indeed referring to yeast (S. cerevisiae and S. pombe). In the present revised version I of the manuscript, we introduced the reference of a review providing quantitative data of ribosome biogenesis in human cells (Lewis & Tollervey, 2000, Science) and we modified the problematic sentence as follows:” Growing human cells produce around 7500 ribosomal subunits per minutes (Lewis and Tollervey 2000), which represents a significant expenditure of energy.” (Page 4, Line 1).

      Growth factors, energy status are not cues but are proteins or metabolites (introduction).

      We agree with this comment of Reviewer #1. We changed the text accordingly in the revised version I of the manuscript (Page 4, Line 8).

      Authors write about mTOR without making statements on mTORC1/2. This is very obsolete. Also I am not sure that the choice of Geyer et al., 1982, and subsequent papers makes much sense. At the very minimum TOP mRNA concepts and mTORC1 must be defined.

      We provide more details on the mTOR pathway in the revised version I of the manuscript according to Reviewer #1’s suggestions (Page 4, Line 13 and Page 5, Line 3).

      The authors claim that their work fills a major gap between known functions of MAPK and cytoplasmic translation. I would not be so sure about it.

      Our original sentence stated that “our work fills a major gap between currently known functions of MAPK signaling in Pol I transcription and cytoplasmic translation”. Indeed, although MAPK signaling was known to regulate Pol I transcription and cytoplasmic translation, the impact of the pathway on the post-transcriptional steps of ribosome synthesis, namely pre-ribosome assembly and maturation, has been very little investigated and remains poorly understood. Our data provides the first example of a detailed mechanism of regulation of the maturation of pre-ribosomal particles by the MAPK pathway. Reviewers #2 and #3 seem to agree with this point:

      Reviewer #2: “However, there is a lacking mechanistic connection of signaling pathways to pre-rRNA processing and maturation steps of ribosome biogenesis. The authors set out to provide a specific example of a direct target of MAPK signaling, RSK that regulates pre-rRNA maturation through the phosphorylation of a ribosome assembly factor (RIOK2), offering for the first time providing mechanistic insight into MAPK regulation of pre-rRNA maturation.

      Reviewer #3: “With these provisos, the work is technically good and will be of considerable interest to the field. The post-transcriptional regulation of ribosome synthesis is increasingly recognized a significant topic.

      Results. Authors start with a major mistake, i.e. that PMA selectively stimulates the MAPK pathway. Perhaps it stimulates, certainly it does not do it selectively.

      We agree with this comment of Reviewer #1. We removed the term “selectively” in the problematic sentence (Page 6, Line 8).

      RIOK2 phosphosites are first found by bioinformatics analysis. It should be noted that the predicted phosphosite (S483) is found only in a limited set of datasets from MS databases. The actual importance of this site would not emerge from unbiased studies. Also, there are many other phosphosites that were not analyzed in this study.

      We agree with Reviewer #1 that phosphorylation of S483 of RIOK2 has been detected in a limited number of mass spectrometry datasets, but these datasets have been reported in high impact journals (Nature Methods, Mol Cell Proteomics, Science), attesting of the quality of these studies

      As mentioned by Reviewer #1, there are several other phosphosites within RIOK2 that were not analyzed in our study. We provided the list of these phosphosites in Supplementary Table S1 of the original manuscript. Besides T481 and S483, none of the other sites belong to consensus motifs recognized by ERK or RSK at medium and high stringency. They are therefore less relevant to our study. We only analyzed phosphorylation at S483 because: (i) our mass spectrometry analysis revealed that S483 is the only phosphosite in RIOK2 whose level increases upon MAPK activation but not in the presence of the MAPK inhibitor PD184352 (Figure 2B); (ii) our in vitro kinase assay showed that the phosphorylation level of RIOK2 by RSK is residual when S483 is replaced by a non-phosphorylatable alanine (Figure 3D); (iii) our data presented in Figure 2C further show that mutation of T481 to an alanine does not prevent RIOK2 phosphorylation on RxRxxS/T motifs upon stimulation of the MAPK pathway.

      We clarified this point in the relevant part of the result section of the revised version I of the manuscript (Page 7, Lines 16 and 24, Page 8, Line 17 and Page 9, Line 5).

      Throughout the paper the authors use the word strongly, significantly, but the actual effects seem in general quite marginal.

      We agree with Reviewer #1 that some of the phenotypes described in the manuscript are modest, in particular the phenotypes resulting from the S483A mutation of RIOK2, which is not aberrant for a point mutation. We rephrased several sentences throughout the manuscript to soften the formulation in the description and interpretation of the data and in the conclusions.

      Discussion. The authors claim that they provide solid evidence on MAPK signalling to ribosome maturation. At the very best this is circumstantial evidence for the 40S maturation.

      We rephrased the sentence accordingly (Page 16, Line 5): “Our study provides evidence that MAPK signaling applies another level of coordination during ribosome biogenesis, by directly regulating pre-40S particle assembly and maturation.

      Figure 1.

      Unclear why LJH should increase P-ERK.

      A negative feedback loop has been described in the MAPK pathway whereby RSK activation partially inhibits ERK phosphorylation (Saha et al., 2012, Horm Metab Res; Dufresne et al., 2001, MCB; Schneider et al., 2011, Neurochem; Re Nett et al., 2018, EMBO Rep). Inactivation of RSK with LJH alleviates this inhibition, which results in increased phosphorylation levels of ERK.

      We added this information in the revised version of the manuscript along with the corresponding references (Page 6, Line 17).

      General lack of quantitation (sd, replicates, bars). Experiment done only on a single cell line in a single experimental setup.

      As also requested by Reviewer #2 (Major comment 1.), we applied in the revised version I of the manuscript RAMP quantifications to all Northern blot data. We included error bars corresponding to biological replicates.

      Furthermore, in order to validate the impact of the MAPK pathway on pre-ribosome assembly and maturation, we plan to perform the same experiments using PD inhibitors in different cell lines and we will provide a figure with accurate RAMP quantifications, error bars and statistical significance, in the revised version II of the manuscript (see revision plan).

      Very different effects on 21S by LJH, PMA and siRNA for RIOK2. Overall the message given by the authors is to me mysterious.

      We assume that the reviewer wanted to point out the difference between PMA, PMA+LJH and shRNA for RSK since we did not perform RNAi targeting RIOK2. We agree with this comment. We believe that this difference is likely due to experimental setups that are different between both experiments. In the experiment using inhibitors, we assessed short-term effects of RSK inhibition after acute stimulation of the MAPK pathway (starved cells stimulated with PMA), while in the experiment using shRSK, we monitored long term effects of RSK depletion in serum-growing cells in which other signaling pathways are also active. Prolonged RSK depletion is likely to induce pleiotropic cellular effects, which would interfere with ribosome biogenesis both directly and indirectly. These differences probably explain the variable effects on the 21S intermediate. However, in both experiments we do observe an accumulation of the early 30S intermediate, consistent with the phenotype observed when ERK is inactivated (PD inhibitor), therefore indicating that RSK regulates some post-transcriptional stages of ribosome biogenesis.

      To make our results clearer we have withdrawn the experiments using shRSK to avoid the risk of showing indirect effects due to the prolonged absence of RSK. Instead, we included RAMP analyses with error bars from 2 biological replicates using PD and LJH inhibitors (Figure 1B).

      Figure 2.

      Several red flags. For instance in 2C the loaded levels of RIOK2-HA loaded are clearly less than the ones of the other genotypes, hence the conclusion on P-RIOK2 is not convincing.

      Our aim in this experiment was to compare the impact of PMA treatment on the phosphorylation levels of different RIOK2 mutants (T481A, S483A, double mutant). For a given mutant, the levels of RIOK2 loaded in the two conditions (i.e. not stimulated and PMA stimulated) are very similar and we therefore assume that our conclusions are valid.

      We nevertheless plan to repeat these experiments and quantify the data for the revised version II of the manuscript.

      Staining with anti-P RIOK2 lacks controls, how can be sure that the signal is due to the phosphate? Phosphatase treatment?

      We fully agree with Reviewer #1 and we did perform an experiment showing that the phosphorylation signal disappears following treatment of the protein extracts with λ-phosphatase. We did not show these data in the original version of the manuscript because of space limitations. We added these data in the supplementary material of the revised version I of the manuscript (Supplementary Figure S2B) and amended the text accordingly (Page 7, Line 24)

      Why FBS does not lead to ERK staining in HEK293? There are plenty of growth factors in FBS that should lead to ERK phosphorylation. I do not understand this experiment.

      We agree with this comment. Addition of serum to starved cells does lead to ERK and RSK phosphorylation but with a much lesser efficiency compared to stimulation by EGF and PMA. ERK phosphorylation is barely visible on the exposure shown in Figure 2D but RSK-phosphorylation is clearly observed, although the signal is much weaker compared to EGF and PMA treatments. It is common to observe a stronger response with purified PMA and EGF (see Carrière et al., 2011, JBC ; Ray et al., 2013, Oncogene). There are indeed several growth factors in the serum, but the most abundant (Insulin, IGF1, TGF) are present at ng/ml concentration, while EGF is used at 25 µg/ml in Figure 2D. Moreover, they are not very strong activators of the Ras/MAPK pathway, and it is also possible that after 20 min of FBS treatment the phosphorylation is in the decreasing phase.

      In the present revised version I of the manuscript, we included a set of western blots from another experiment showing the same results but of better quality to make the effects more visible (Fig. 2D). We also provided quantifications of phosphorylation of RIOK2 and associated statistical analyses (Fig. 2E).

      Figure 3. In vitro phosphorylation, if I understood, it relies on a truncated version of RIOK2. Why? Is the folding of the full length protein not permissive to in vitro phosphorylation?

      We did not test phosphorylation of the full length RIOK2 protein in vitro because RIOK2 has been reported to auto-phosphorylate (Zemp I. et al., 2009, JCB) and we were concerned that this auto-phosphorylation activity of RIOK2 in addition to RSK phosphorylation may render this experiment inconclusive.

      HA-RSK3 is less?

      It was reported that RSK3 is insoluble when over-expressed (Zhao et al., 1996, JBC), which explains the lower levels of protein recovered in our soluble extract. The information was present in the legend of Figure but we transferred it to the main text of the result section in the present revised version I of the manuscript (Page 10, Line 3).

      Figure 4. Immunofluorescence is low mag, difficult to understand.

      We agree with Reviewer #1. We modified the FISH experiment figure to show cells with a higher magnification and we provided more details in the text (Page 12, Lines 20-25) to facilitate the understanding of the data.

      I really like the experiments with RIOK2 mutants, however I wonder what about protein levels after the knock-in? Given the 18S phenotype overlap between the phenotype of the RIOK2 loss of function with the S483A, testing protein level becomes of the utmost importance.

      We checked RIOK2 protein levels and observed that the mutations do not decrease the level of RIOK2. On the contrary, the mutations slightly increase RIOK2 levels. Therefore, we are pretty confident that the phenotypes resulting from expression of RIOK2 mutants do not result from defects in the global accumulation of the protein. These data have been added to Figure 4C of the revised version I of the manuscript and we amended the text accordingly (Page 12, Line 5).

      Figure 5. Low quality IFL.

      Our aim in preparing this figure was to show many cells in the different images to show that the effect of our mutation was homogenous at the level of cell populations. The drawback is that cells are small and look blurred. We improved the quality of the figure in this revised version I of the manuscript with new images from the same experiment, showing less cells with a higher magnification.

      Hard to think that histogram quantitation of nuclear versus cytoplasmic staining are reliable in the absence of fractionation, better quantitation, experiment done in other cell lines and so on.

      We provide in this revised version I of the manuscript a supplementary figure explaining the procedure we used to quantify the fluorescence data (Supplementary Fig. S7).

      Furthermore, to confirm this result using other experimental conditions and cell lines, we will transfect HEK293 and HeLa cells with plasmids expressing GFP-tagged RIOK2 WT or the S483S mutant and we will compare the kinetics of nuclear import of both proteins upon inhibition of pre-40S particle export by leptomycin B using fluorescence microscopy and GFP quantifications. Second, we will transfect HeLa cells with plasmids expressing HA-tagged RIOK2 WT or S483A and perform fractionation assays to monitor their presence in both cytoplasmic and nuclear compartments. We will include these data in the revised version II of the manuscript.

      However, very beautiful Fig. 5E perhaps the best of the paper shows also mobility shift driven by S483, thus supporting posttranslational modifications.

      We thank Reviewer #1 for this comment. We added the note on the evidence of RIOK2 post-translational modification in the result section (Page 14, Line 9).

      Fig. 6. IFL studies are really impossible to interpret.

      We improved the quality of the figure with new images from the same experiment, showing less cells with a higher magnification. NOB1 IF data and quantifications have been transferred to the supplemental material (Supplemental Fig. S4A and S4B) to clarify the figure. In addition, we provided more explanations on the principle of this experiment and expected results in the text (Page 15, Line 9).

      The effects on RIOK2 release (this figure) and 18S maturation (Fig. 5) are very clear and of great quality.

      We thank Reviewer #1 for this comment.

      Overall conclusions. The manuscript tends to overinflate the meaning of several experiments. What to me is very clear and interesting is that the the authors provide clear evidence that S483A mutants have a defect in 40S maturation. Whether this is due to MAPK signalling, is only circumstantial. I would suggest to build up on the strong findings and eliminate ambiguous data.

      We do not fully agree with this comment of Reviewer #1. If mutation S483A were simply a partial loss of function mutation, this would not be of strong interest for the subject of this manuscript. It would just indicate that S483 is important for RIOK2 function independently of its phosphorylation status. Our data show that the impact of S483 mutation on pre-rRNA processing and other phenotypes is different depending on whether the serine is converted to an alanine (phosphorylation mutant) or to an aspartic acid (phospho-mimetic mutation). These data are a strong indication that what matters is not simply the serine residue by itself but its phosphorylation status.

      Reviewer #1 (Significance (Required)):

      The paper deals with an important topic, namely whether a regulation of ribosome maturation exists, and how it is mechanistically regulated. In this context, the analysis of the ERK pathway is highly needed considered that most works deal with effects of the PI3K-mTOR pathway, and the parallel, yet important RAS-ERK pathway, is less understood.

      As a final note, we should consider that S6K downstream of mTOR, and ribosomal S6K, downstream of ERK have been considered to share some substrates.

      We introduced this information in the revised version of the manuscript (Page 19, Line 20). A related comment has been raised by Reviewer #3 (see below, Caveat #2).

      The manuscript is interesting, but several statements given by the authors are rather superficial. An example, listed in the previous section, relates to the linguistic usage of mTOR kinase, instead of detailing whether we are dealing with mTORc1 or mTORc2.

      We agree with this comment of Reviewer #1. Given that the main focus of this manuscript is the regulation by the MAPK pathway, we had chosen to put less emphasis on mTOR in the introduction. However, we added more precise information on mTOR in the present revised version I of the manuscript to address this comment (Page 4, Line 13 and Page 5, Line 3).

      A second gross mistake is the definition of PMA as a stimulator of the ERK pathway. If this is certainly true, this is historically not correct as seminal papers by the group of Parker define this drug as a stimulator of conventional PKC kinases. In short, this paper is a step back in knowledge from the perspective of the literature context.

      We are a bit confused by this comment because seminal papers from the Parker group clearly state that PMA activates the MAPK pathway via PKC (Adams and Parker, 1991, FEBS Lett.; Ways et al., 1992, JBC; Whelan et al., 1999, Cell Growth Differ.). We agree, as mentioned earlier by Reviewer #1, that PMA is not specific to MAPK, a comment that has been addressed above.

      All people interested to the crosstalk between ribosome maturation and signaling pathways will be certainly read this manuscript.

      My expertise is within the ribosome biology and signalling field.

      Reviewer #2 (Evidence, reproducibility and clarity (Required)):

      There have been mechanistic connections of various signaling pathways to regulation ribosome biogenesis steps including rDNA transcription by RNA polymerase I and III, ribosomal protein transcription, and differential mRNA translation efficiency. However, there is a lacking mechanistic connection of signaling pathways to pre-rRNA processing and maturation steps of ribosome biogenesis. The authors set out to provide a specific example of a direct target of MAPK signaling, RSK that regulates pre-rRNA maturation through the phosphorylation of a ribosome assembly factor (RIOK2), offering for the first time providing mechanistic insight into MAPK regulation of pre-rRNA maturation.

      The authors observe slight pre-rRNA processing defects upon the use of RSK inhibitors and RSK depletion. They identified several candidate ribosome assembly and modification factors containing the canonical RSK substrate motif, including the RIOK2 kinase. Phosphorylation at this motif was verified to be specifically phosphorylated by RSK1 and 2 isoforms in cells and in an in-vitro kinase assay. The authors produced RIOK2 knock-in eHAP1 cell lines expressing non-phosphorylatable or phosphomimetic versions of RIOK2, observing slowed cellular proliferation, decreases in global translation, slight pre-rRNA processing abnormalities, but not changes in overall mature 18S rRNA levels. More specifically, the authors defined the inability of RIOK2 to be phosphorylated leads to defects in RIOK2 dissociation from the pre-40S ribosomal subunit in an in-vitro assay, and inability for it to be recycled for reuse in pre-ribosome export from the nucleus to the cytoplasm by immunofluorescence.

      Overall, the authors provide an interesting mechanism of MAPK regulation of a ribosome assembly factor RIOK2. However, they fail to provide the necessary reproducibility, controls, quantification, and consistent results between experiments to support their hypotheses.

      Major Comments:

      1. The northern blots reported throughout the manuscript are lacking proper reproducibility and quantification. First, the northern blots are lacking a loading control, which is necessary to report fold changes that are being measured across treatments. Please include a proper loading control (i.e. 7SL or U6 RNAs). Additionally, more rigorous analysis of the pre-rRNA precursor levels through ratio analysis of multiple precursors (RAMP) (Wang et al 2014) can be completed to provide a clearer depiction on which precursor(s) are accumulating. It is unclear for the Figure 1 northern blots if there were replicates completed and what the error bars represent in Figure 1B. Please report replicates, so that statistical analysis can be completed on the differences in precursor relative abundance. This need is emphasized by the small changes observed in pre-rRNA levels (less than 2 fold) between conditions.

      As mentioned above (Reviewer #1), we applied in the revised version I of the manuscript RAMP quantifications to all Northern blot data. These quantifications are shown as separate panels in the figures of the revised manuscript.

      Furthermore, we are planning to repeat the Northern blot experiments of Figure 1 to obtain biological replicates in other cell lines. We will probe the membranes to detect the 7SL RNA as a loading control in all these experiments. We will perform RAMP analyses on all these Northern blot experiments to provide more accurate quantifications of the pre-rRNA levels in the different conditions. These data will be included in the revised version II of the manuscript.

      1. The western blots reported throughout the manuscript are lacking proper reproducibility and quantification. For example, the western blots validating RSK1 and RSK2 depletion in Figure 1C lack a proper loading control. Additionally, it is unclear if there are replicates completed and there is lack of statistical analysis to determine if the changes are significant. Please include loading controls, replicates, and quantification of the western blots throughout the manuscript.

      We have included actin levels as loading controls in several figures (Figures 2D, 3A, 3C, 3E, 4C) of the revised version I of the manuscript. We also added phosphorylated Rps6 at Ser235/36 to monitor RSK activity in Figures 1A, 2D, 3A.

      We provided quantifications and associated statistical analyses of phosphorylation of RIOK2 presented in Figures 3A and 3C of the revised version I of the manuscript. We also included quantifications of the in vitro phosphorylation assays presented in Figures 3F and 3G.

      We are nevertheless planning to repeat and quantify more accurately the western blot experiments presented in Figures 2A, 2C and 3E of the revised version I of the manuscript. These data will be included in the revised version II of the manuscript.

      1. Please report the full bioinformatic analysis of the RSK substrate motif search among human AMFs including other AMFs found in this search. A sorted list format would be valuable for the reader to understand other potential RSK substrates involved in ribosome biogenesis.

      We understand the request of Reviewer #2. Providing the full list of AMFs identified in our bioinformatic screen would be valuable for the reader, mostly because it would make clearer that RSK seems to be regulating multiple stages of the pre-ribosome maturation pathway, therefore that RSK inhibition induces pleiotropic defects in ribosome synthesis. However, we are currently working on a more global study of the impact of MAPK regulation on the post-transcriptional steps of ribosome synthesis that we would like to publish in a near future.

      1. The authors report that RSK inhibition/depletion leads to accumulation of the 30S pre-rRNA, yet mutation of its target site on RIOK2 or RIOK2 depletion leads to an accumulation of the 18S-E pre-rRNA. Additionally, the phosphomimic mutation of RIOK2 leads to an accumulation of 30S, the opposite of the expected result. Please elaborate on this discrepancy in processing defects observed across experiments.

      In contrast to RIOK2 which is specifically involved in the late, cytoplasmic stages of the maturation of the pre-40S particles, RSK regulates ribosome biogenesis at multiple levels. Upon activation of the MAPK pathway, RSK activates Pol I transcription in the nucleoli and promotes translation of mRNAs encoding ribosomal proteins and AMFs. In addition, our bioinformatic screen identified several AMFs at different stages of the maturation pathway of both ribosomal subunits as potential targets of RSK. These considerations imply that RSK inhibition is expected to impact ribosome biogenesis at multiple levels (Pol I transcription, availability of RPs and AMFs, export of the pre-ribosomal particles, probably several maturation steps) whereas RIOK2 inactivation more specifically delays 18S-E processing in the cytoplasm. In terms of processing, RSK inhibition induces a significant accumulation of the 30S intermediate. This is another evidence that RSK regulates pre-rRNA processing at several stages. This phenotype might result, as recently described in yeast (Yerlikaya et al., 2016, MCB), from an inhibition of RPS6 phosphorylation which affects its early incorporation into pre-ribosomes, although this has not been demonstrated in human cells. This 30S precursor accumulation affects production of the downstream intermediates and we strongly believe that this precludes accumulation of 18S-E even if the activity of RIOK2 is affected. Given the broad implication of RSK at different stages of ribosome biogenesis, it is biologically relevant to observe that inactivation of RSK does not result in the same processing defects as inactivation of RIOK2.

      We nevertheless tried to make this point clearer in the present revised version I of the manuscript. We added in the supplementary material a diagram (Supplementary Fig. S1C) showing all the known and hypothetical targets of ERK and RSK in ribosome synthesis to provide the readers with a global view of the function of RSK in this process and refer to this figure in the introduction and results. In the introduction, we also emphasize more on the multiple aspects of the regulation of ribosome synthesis by ERK and RSK (Page 4, Line 18).

      Concerning the phospho-mimetic mutant, it does accumulate slightly the 45S and 30S intermediates contrary to the non-phosphorylatable mutant but this is not totally unexpected. RIOK2 is incorporated into pre-ribosomes in the nucleus, at a stage that remains unclear, and constitutive RIOK2 phosphorylation may interfere with this recruitment and affect processing at an earlier stage. This point has been addressed in the discussion of the revised version I of the manuscript (Page 18, Line 7).

      Are there similar results for RSK depletion/inhibition and RIOK2 release from the pre-40S and inability to import into the nucleus? If so, this could provide phenotypic consistency between these two proteins in the proposed pathway to further support the hypothesis.

      We performed the same experiments as reported in Figure 6C to try to demonstrate a cytoplasmic retention of RIOK2 after leptomycin B treatment upon ERK inhibition (PD treatment). We also performed IF and cell fractionation experiments upon PD treatment. In all cases, we failed to observe the expected result. We strongly believe that we are facing here the same problem as described above for the previous comment of Reviewer #2. ERK and thus RSK inhibition leads to accumulation of the early, nucleolar 30S intermediate, indicating that the processing pathway is significantly blocked at an early stage preceding formation of the pre-40S particles in which RIOK2 is recruited. This early blockage most likely explains why we do not see the same phenotypes. We discussed this comment in the discussion section of the revised version I of the manuscript (Page 18, Line 19).

      1. Mature levels of 18S rRNA are not altered in the RIOK2 mutant cell lines. This could be due to compensation in these mutant cell lines since RIOK2 is essential.

      We agree with Reviewer #2 that compensation mechanisms may operate to restore mature 18S rRNA levels despite RIOK2 mutation. On the other hand, although RIOK2 is indeed essential, we may expect that the point mutation of S483 only partially affects RIOK2 function and delays the maturation of pre-40S particles but not to a sufficient extent to impact the mature 18S rRNA levels. This has been observed by others (Montellese et al., 2017, NAR; Srivastava et al., 2010, MCB).

      We added this point in the discussion section of the revised version I of the manuscript (Page 19, Line 9).

      Please report the mature 18S rRNA levels upon shRNA depletion and RSK inhibitors to provide insight into if this pathway significantly alters mature 18S rRNAs as a mechanism for the altered translation and proliferation observed.

      We will probe the levels of the mature 18S and 28S rRNAs in these experiments and the results will be included in Figure 1 of the revised version II of the manuscript.

      Minor Comments:

      1. Figure 1A lower: The authors use an RSK inhibitor LJH685, that does not inhibit RSK phosphorylation S380. Therefore, another verification of RSK inhibition must be used besides RSK-pS380 abundance as for PD184352 inhibition. Please validate the usage of this RSK inhibitor in the experiments by inclusion of quantification of a direct downstream substrate of RSK, such as YB1-pS102 quantification.

      We agree with Reviewer #2. We have probed the membrane with anti-RPS6 and anti-phosho-RPS6 antibodies to show the effect of LJH treatment on RPS6 phosphorylation. These data have been added to Figure 1A in the revised version I of the manuscript and the text has been updated (Page 6, Line 16).

      1. Page 7, Lines 8-12: The authors state that RSK knockdown led to increases in the 45S, while the LJH685 treatment led to no changes in 45S levels due to differences in growth conditions. Please elaborate more on how growth conditions would alter 45S pre-rRNA levels. It would be expected that stimulation of the MAPK pathway would increase pre-rRNA transcription compared to steady state growth conditions. However, pre-rRNA processing northern blots are only measuring steady state levels of the precursors. Thus, an rDNA transcription assay would need to be completed to evaluate these differences.

      We do observe that PMA treatment of starved cells induces an increase in 45S precursor levels, consistent with an increase in transcription but we agree that northern blot experiments measure the steady-state levels of the intermediates.

      To address this comment, we propose to perform short pulse labelings with ortho-phosphate to assess synthesis of the 45S precursor independently of its processing in the different conditions. These data will be included in the revised version II of the manuscript.

      1. Figure 2C: Please quantify these results to properly evaluate the role of these two phosphorylation sites in MAPK signaling.

      We will repeat these experiments and quantify the results in the new version of Figure 2C.

      1. Please include the RIOK2 pS483 antibody generation methodology used in this study.

      We added this information in the Materials and Methods section of the revised version I of the manuscript (Page 21, Line 22).

      1. In vitro kinase assay methods: Is the recombinant RSK1 the human version of the protein? Please clarify in methods.

      Human recombinant RSK1 has been purchased from SignalChem. The information has been added in the revised version I of the manuscript (Page 30, Line 5).

      1. Figure 4B: Please include statistical analysis of the puromycin incorporation assay.

      We performed a statistical analysis of this assay out of 3 replicates. This analysis has been included in the present revised version I of the manuscript (Figure 4B).

      1. Page 13, Line 18: Please explain why RIOK2 co-IP with NOB1 is important.

      We added this explanation in the result section of the revised version I of the manuscript (Page 14, Line 3).

      1. In vitro dissociation assay: There is no control for pulldown of entire pre-40S particles and not just NOB1 protein. Thus, it is unclear if RIOK2 is dissociating from NOB1 or entire pre-40S particles. Please reference previous literature of the methodology of this experiment if applicable. Additionally, please include controls, such as western blotting of ribosomal proteins or northern blotting of rRNA in the pulldown fraction used.

      We agree with Reviewer #2. We have probed the membranes with antibodies detecting LTV1 and ribosomal protein RPS7 to show that the entire pre-40S particle is indeed pulled down. These additional data have been added in Figure 6A of the revised version I of the manuscript and the text has been amended accordingly (Page 14, Line 20).

      1. Page 16, Lines 10-12: The authors state "RSK facilitates the release of RIOK2 and other AMFs", however the only other AMF in this study was NOB1. Please reword appropriately that most likely facilitates release of RIOK2 and other AMFs in a RIOK2 dependent or independent manner if it also phosphorylates other AMFs which possess the motif.

      We agree with Reviewer #2 and we changed the text accordingly (Page 16, Line 11) but we did not introduce the hypothesis that RIOK2 may target directly other AMFs of late pre-40S particles which possess the motif because our in silico screen did not identify consensus RXRXXS/T motifs in any of these factors.

      Reviewer #2 (Significance (Required)):

      This manuscript is significant due to the lack of mechanistic connection of cellular signaling pathways to pre-rRNA processing. There have been, for the most part, no mechanistic connection of signaling pathways to pre-rRNA processing regulation and none for direct targets of MAPK signaling (Reviewed in Gaviraghi et al 2019). They provide the groundwork for analysis of MAPK signaling in regulation of an assembly factor and inclusion of their motif analysis could provide RSK signaling targets' regulation of specific steps of ribosome biogenesis that remain to be elucidated.

      Although the research delves into a specific mechanism, its audience could be far reaching as it is in the ribosome biogenesis field and MAPK signaling, which have broad implications in cancer and developmental diseases.

      Reviewer #3 (Evidence, reproducibility and clarity (Required)):

      The authors report that inhibition of MAPK signaling via RSK is associated with modest alterations in the relative abundance of human pre-rRNA species, that are most marked for 30S but also visible for 21S - although not clearly shown for 18S-E.

      RIOK2 has two closely spaced sites predicted as RSK targets, one of which was confirmed to be MAPK sensitive and shown to be an RSK substrate in vitro. Substitution of Ser483 with Ala was associated with reduced growth and 18S-E accumulation, consistent with impaired NOB1 cleavage activity. RIOK2-S483A also showed greater pre-ribosome association in vivo and consistent with this, more stable association in vitro and increase cytoplasmic residence. These effects are clear, although the data do not directly demonstrate their linkage to loss of RSK phosphorylation.

      The mutations were apparently generated directly in the genome of haploid cells, potentially raising concerns that the introduction of a deleterious mutation might have been accompanied by compensatory mutations elsewhere. However, three cells line gave similar results, mitigating this concern.

      Specific comments:

      1. To help the reader, the authors should directly discuss why they think the data on MAPK inhibition did not reveal a clearer pre-18S cleavage phenotype, as would have been expected for loss of RIOK2 activity.

      This comment is similar to major comment #4 of Reviewer #2.

      Please refer to the above response.

      1. Fig. S3: The degree of RSK depletion with the siRNAs appears very modest, as are the effects on RIOK2-P. Moreover, the double depletion is not clearly better than single depletions. These data should probably be supported by quantitation or withdrawn._

      We agree with Reviewer #3 that the effects shown in this figure are modest but we originally chose to show these data because their further supported the role of RSK in RIOK2 phosphorylation at S483 in complement to Figure 3.

      We have withdrawn this figure from the present revised version I of the manuscript.

      1. Fig. 5D: For 18S-E recovery with RIOK2, is the ratio adjusted for the increase in 18S-E abundance in the mutant - ie is recovery increased when adjusted for the increased pre-rRNA abundance?_

      In these experiments, the tagged versions of RIOK2 WT and S483A have been expressed ectopically from plasmids in cells expressing the endogenous wild-type protein. RIOK2 S483A does not behave as a dominant negative mutant in these conditions and does not induce 18S-E accumulation, as shown in the northern blot analysis of the 18S-E levels in the cell lysates (lower panel). This information is indicated in the revised version I of the manuscript (Page 13, Line 26).

      Reviewer #3 (Significance (Required)):

      Overall, the analyses on the phenotype of RIOK2-S483A, and the demonstration that this site is an RSK target, appear convincing.

      Caveats are

      1) the phenotype seen on inhibition of RSK, would not have implicated RIOK2 as the obvious candidate for the factor responsible for the observed processing defects;

      We agree with this comment, which has also been raised by Reviewer #2 (Major comment 4.). We provide several evidence in the manuscript that RSK phosphorylates RIOK2 on S483 in vivo and in vitro (Figure 3). However, as explained above in response to Reviewer #2, we cannot correlate the in vivo phenotypes resulting from RSK or RIOK2 inactivation for biological reasons. As mentioned in the introduction, RSK regulates multiple substrates at different stages of ribosome biogenesis (Translation of RPs and AMFs, Pol I transcription, pre-ribosome maturation and export), whereas RIOK2 is specifically implicated in the cytoplasmic maturation of pre-40S particles. Inactivation of RSK is therefore expected to induce pleiotropic defects in ribosome biogenesis, and in particular early defects (Reduced Pol I transcription, 30S precursor accumulation) that preclude observation of the expected phenotype linked to RIOK2 inactivation, i.e. 18S-E accumulation.

      We nevertheless tried to clarify this point as described in the response to Reviewer #2, major comment 4.

      2) the RIOK2-S483A phenotype is not demonstrated to be RSK dependent. This raises the possibility that, although RSK can phosphorylate S483, the effects of the mutation are not due to the loss of this modification.

      As mentioned by Reviewer #3, our data show that RSK can phosphorylate RIOK2 S483 in vitro and in vivo (Figure 3). We believe that Figure 4C strongly suggests that the accumulation of the 18S-E in cells expressing RIOK2 S483A mutant is due to the loss of S483 phosphorylation, since mutation of S483 to an aspartic acid (S483D), generally considered as a mutation mimicking a phosphorylated serine, does not affect 18S-E maturation. However, although our manuscript provides many lines of evidence identifying RSK as the kinase responsible for RIOK2 phosphorylation at S483, we cannot formally exclude that other AGC kinases involved in growth and proliferation, such as S6K or Akt, may also be involved redundantly or alternatively. Our data presented in Figure 3A showing that treatment of cells with the RSK inhibitors LJH decrease RIOK2 phosphorylation at S483 support a specific role of RSK.

      We developed this point in the discussion section (Page 18, from Line 25).

      With these provisos, the work is technically good and will be of considerable interest to the field. The post-transcriptional regulation of ribosome synthesis is increasingly recognized a significant topic.

    2. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #2

      Evidence, reproducibility and clarity

      There have been mechanistic connections of various signaling pathways to regulation ribosome biogenesis steps including rDNA transcription by RNA polymerase I and III, ribosomal protein transcription, and differential mRNA translation efficiency. However, there is a lacking mechanistic connection of signaling pathways to pre-rRNA processing and maturation steps of ribosome biogenesis. The authors set out to provide a specific example of a direct target of MAPK signaling, RSK that regulates pre-rRNA maturation through the phosphorylation of a ribosome assembly factor (RIOK2), offering for the first time providing mechanistic insight into MAPK regulation of pre-rRNA maturation.

      The authors observe slight pre-rRNA processing defects upon the use of RSK inhibitors and RSK depletion. They identified several candidate ribosome assembly and modification factors containing the canonical RSK substrate motif, including the RIOK2 kinase. Phosphorylation at this motif was verified to be specifically phosphorylated by RSK1 and 2 isoforms in cells and in an in-vitro kinase assay. The authors produced RIOK2 knock-in eHAP1 cell lines expressing non-phosphorylatable or phosphomimetic versions of RIOK2, observing slowed cellular proliferation, decreases in global translation, slight pre-rRNA processing abnormalities, but not changes in overall mature 18S rRNA levels. More specifically, the authors defined the inability of RIOK2 to be phosphorylated leads to defects in RIOK2 dissociation from the pre-40S ribosomal subunit in an in-vitro assay, and inability for it to be recycled for reuse in pre-ribosome export from the nucleus to the cytoplasm by immunofluorescence.

      Overall, the authors provide an interesting mechanism of MAPK regulation of a ribosome assembly factor RIOK2. However, they fail to provide the necessary reproducibility, controls, quantification, and consistent results between experiments to support their hypotheses.

      Major Comments:

      1.The northern blots reported throughout the manuscript are lacking proper reproducibility and quantification. First, the northern blots are lacking a loading control, which is necessary to report fold changes that are being measured across treatments. Please include a proper loading control (i.e. 7SL or U6 RNAs). Additionally, more rigorous analysis of the pre-rRNA precursor levels through ratio analysis of multiple precursors (RAMP) (Wang et al 2014) can be completed to provide a clearer depiction on which precursor(s) are accumulating. It is unclear for the Figure 1 northern blots if there were replicates completed and what the error bars represent in Figure 1B. Please report replicates, so that statistical analysis can be completed on the differences in precursor relative abundance. This need is emphasized by the small changes observed in pre-rRNA levels (less than 2 fold) between conditions.

      2.The western blots reported throughout the manuscript are lacking proper reproducibility and quantification. For example, the western blots validating RSK1 and RSK2 depletion in Figure 1C lack a proper loading control. Additionally, it is unclear if there are replicates completed and there is lack of statistical analysis to determine if the changes are significant. Please include loading controls, replicates, and quantification of the western blots throughout the manuscript.

      3.Please report the full bioinformatic analysis of the RSK substrate motif search among human AMFs including other AMFs found in this search. A sorted list format would be valuable for the reader to understand other potential RSK substrates involved in ribosome biogenesis.

      4.The authors report that RSK inhibition/depletion leads to accumulation of the 30S pre-rRNA, yet mutation of its target site on RIOK2 or RIOK2 depletion leads to an accumulation of the 18S-E pre-rRNA. Additionally, the phosphomimic mutation of RIOK2 leads to an accumulation of 30S, the opposite of the expected result. Please elaborate on this discrepancy in processing defects observed across experiments. Are there similar results for RSK depletion/inhibition and RIOK2 release from the pre-40S and inability to import into the nucleus? If so, this could provide phenotypic consistency between these two proteins in the proposed pathway to further support the hypothesis.

      5.Mature levels of 18S rRNA are not altered in the RIOK2 mutant cell lines. This could be due to compensation in these mutant cell lines since RIOK2 is essential. Please report the mature 18S rRNA levels upon shRNA depletion and RSK inhibitors to provide insight into if this pathway significantly alters mature 18S rRNAs as a mechanism for the altered translation and proliferation observed.

      Minor Comments:

      1.Figure 1A lower: The authors use an RSK inhibitor LJH685, that does not inhibit RSK phosphorylation S380. Therefore, another verification of RSK inhibition must be used besides RSK-pS380 abundance as for PD184352 inhibition. Please validate the usage of this RSK inhibitor in the experiments by inclusion of quantification of a direct downstream substrate of RSK, such as YB1-pS102 quantification.

      2.Page 7, Lines 8-12: The authors state that RSK knockdown led to increases in the 45S, while the LJH685 treatment led to no changes in 45S levels due to differences in growth conditions. Please elaborate more on how growth conditions would alter 45S pre-rRNA levels. It would be expected that stimulation of the MAPK pathway would increase pre-rRNA transcription compared to steady state growth conditions. However, pre-rRNA processing northern blots are only measuring steady state levels of the precursors. Thus, an rDNA transcription assay would need to be completed to evaluate these differences.

      3.Figure 2C: Please quantify these results to properly evaluate the role of these two phosphorylation sites in MAPK signaling.

      4.Please include the RIOK2 pS483 antibody generation methodology used in this study.

      5.In vitro kinase assay methods: Is the recombinant RSK1 the human version of the protein? Please clarify in methods.

      6.Figure 4B: Please include statistical analysis of the puromycin incorporation assay.

      7.Page 13, Line 18: Please explain why RIOK2 co-IP with NOB1 is important.

      8.In vitro dissociation assay: There is no control for pulldown of entire pre-40S particles and not just NOB1 protein. Thus, it is unclear if RIOK2 is dissociating from NOB1 or entire pre-40S particles. Please reference previous literature of the methodology of this experiment if applicable. Additionally, please include controls, such as western blotting of ribosomal proteins or northern blotting of rRNA in the pulldown fraction used.

      9.Page 16, Lines 10-12: The authors state "RSK facilitates the release of RIOK2 and other AMFs", however the only other AMF in this study was NOB1. Please reword appropriately that most likely facilitates release of RIOK2 and other AMFs in a RIOK2 dependent or independent manner if it also phosphorylates other AMFs which possess the motif.

      Significance:

      This manuscript is significant due to the lack of mechanistic connection of cellular signaling pathways to pre-rRNA processing. There have been, for the most part, no mechanistic connection of signaling pathways to pre-rRNA processing regulation and none for direct targets of MAPK signaling (Reviewed in Gaviraghi et al 2019). They provide the groundwork for analysis of MAPK signaling in regulation of an assembly factor and inclusion of their motif analysis could provide RSK signaling targets' regulation of specific steps of ribosome biogenesis that remain to be elucidated.

      Although the research delves into a specific mechanism, its audience could be far reaching as it is in the ribosome biogenesis field and MAPK signaling, which have broad implications in cancer and developmental diseases.

    3. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #3

      Evidence, reproducibility and clarity

      The authors report that inhibition of MAPK signaling via RSK is associated with modest alterations in the relative abundance of human pre-rRNA species, that are most marked for 30S but also visible for 21S - although not clearly shown for 18S-E.

      RIOK2 has two closely spaced sites predicted as RSK targets, one of which was confirmed to be MAPK sensitive and shown to be an RSK substrate in vitro. Substitution of Ser483 with Ala was associated with reduced growth and 18S-E accumulation, consistent with impaired NOB1 cleavage activity. RIOK2-S483A also showed greater pre-ribosome association in vivo and consistent with this, more stable association in vitro and increase cytoplasmic residence. These effects are clear, although the data do not directly demonstrate their linkage to loss of RSK phosphorylation.

      The mutations were apparently generated directly in the genome of haploid cells, potentially raising concerns that the introduction of a deleterious mutation might have been accompanied by compensatory mutations elsewhere. However, three cells line gave similar results, mitigating this concern.

      Specific comments:

      1.To help the reader, the authors should directly discuss why they think the data on MAPK inhibition did not reveal a clearer pre-18S cleavage phenotype, as would have been expected for loss of RIOK2 activity.

      2.Fig. S3: The degree of RSK depletion with the siRNAs appears very modest, as are the effects on RIOK2-P. Moreover, the double depletion is not clearly better than single depletions. These data should probably be supported by quantitation or withdrawn.

      3.Fig. 5D: For 18S-E recovery with RIOK2, is the ratio adjusted for the increase in 18S-E abundance in the mutant - ie is recovery increased when adjusted for the increased pre-rRNA abundance?

      Significance

      Overall, the analyses on the phenotype of RIOK2-S483A, and the demonstration that this site is an RSK target, appear convincing.

      Caveats are

      1)the phenotype seen on inhibition of RSK, would not have implicated RIOK2 as the obvious candidate for the factor responsible for the observed processing defects;

      2)the RIOK2-S483A phenotype is not demonstrated to be RSK dependent. This raises the possibility that, although RSK can phosphorylate S483, the effects of the mutation are not due to the loss of this modification.

      With these provisos, the work is technically good and will be of considerable interest to the field. The post-transcriptional regulation of ribosome synthesis is increasingly recognized a significant topic.

    4. Note: This preprint has been reviewed by subject experts for Review Commons. Content has not been altered except for formatting.

      Learn more at Review Commons


      Referee #1

      Evidence, reproducibility and clarity

      The manuscript addresses an important topic, the posttranscriptional maturation of ribosomes. This topic is inherently interesting because we normally think of ribosome biogenesis as a sequential series of steps that automatically proceeds and cannot be "accelerated" in physiological conditions, but only "delayed" in the presence of genetic mutations. In short, the manuscript proposes that RIOK2 phosphorylation by the action of RSK, below the Ras/MAPK pathway promotes the synthesis of the human small ribosomal subunit.

      I honestly admit that I have some difficulties in reviewing this manuscript. The quality of the presented data is, in generally, good. However, overall I find the whole manuscript preliminary and I am not much convinced of the conclusions. Several aspects are superficially analyzed. In short, I think that most of the conclusions are not fully supported by the data because shortcuts are present. A list of all the aspects that I found wrong are listed.

      Biological issue

      1. The authors claim that the effects of the inhibition of the maturation of ribosomes by acting on a pathway upstream of RIOk2 are limited to the 40S subunit. This is far from being a trivial point, for the following reason. RIOK2 is known to affect the maturation of 40S ribosomes. Hence, the fact that using an upstream inhibitor of the MAPK pathway such as PD does not inhibit 60S processing in reality would argue against a biologically relevant control in ribosome maturation (of the MAPK patheay). Have the authors considered this? In a way, also, given the fact that the mutants confirm a role in 18S final maturation, it is a bit complex to put all the data in a clear biological context.

      A number of specific issues will be concisely described.

      Manuscript very well written. Data do not always support the strong conclusions. Low magnitude of the observed effects.

      In introduction the authors make a general claim that ribosome biogenesis is one of the most energetically demanding cellular activities. This statement lingers in the literature since 15 years but in reality it has never been formally proved for mammalian cells, and certainly not for HEK293 cells. The original statement, to my knowledge, can be traced by some obscure statement referred to the yeast case and then repeated as a truth. In conclusion, beside being a very banal observation, it should be referenced.

      Growth factors, energy status are not cues but are proteins or metabolites (introduction). Authors write about mTOR without making statements on mTORC1/2. This is very obsolete. Also I am not sure that the choice of Geyer et al., 1982, and subsequent papers makes much sense. At the very minimum TOP mRNA concepts and mTORC1 must be defined.

      The authors claim that heir work fills a major gap between known functions of MAPK and cytoplasmic translation. I would not be so sure about it.

      Results. Authors start with a major mistake, i.e. that PMA selectively stimulates the MAPK pathway. Perhaps it stimulates, certainly it does not do it selectively.

      RIOK2 phosphosites are first found by bioinformatics analysis. It should be noted that the predicted phosphosite (S483) is found only in a limited set of datasets from MS databases. The actual importance of this site would not emerge from unbiased studies. Also, there are many other phosphosites that were not analyzed in this study.

      Throughout the paper the authors use the word strongly, significantly, but the actual effects seem in general quite marginal.

      Discussion. The authors claim that they provide solid evidence on MAPK signalling to ribosome maturation. At the very best this is circumstantial evidence for the 40S maturation.

      Figure 1. Unclear why LJH should increase P-ERK. General lack of quantitation (sd, replicates, bars). Experiment done only on a single cell line in a single experimental setup. Very different effects on 21S by LJH,PMA and siRNA for RIOK2. Overall the message given by the authors is to me mysterious.

      Figure 2. Several red flags. For instance in 2C the loaded levels of RIOK2-HA loaded are clearly less than the ones of the other genotypes, hence the conclusion on P-RIOK2 is not convincing. Staining with anti-P RIOK2 lacks controls, how can be sure that the signal is due to the phosphate? Phosphatase treatment? Why FBS does not lead to ERK staining in HEK293? There are plenty of growth factors in FBS that should lead to ERK phosphorylation. I do not understand this experiment.

      Figure 3. In vitro phosphorylation, if I understood, it relies on a truncated version of RIOK2. Why? Is the folding of the full length protein not permissive to in vitro phosphorylation? HA-RSK3 is less?

      Figure 4. Immunofluorescence is low mag, difficult to understand. I really like the experiments with RIOK2 mutants, however I wonder what about protein levels after the knock-in? Given the 18S phenotype overlap between the phenotype of the RIOK2 loss of function with the S483A, testing protein level becomes of the utmost importance.

      Figure 5. Low quality IFL. Hard to think that histogram quantitation of nuclear versus cytoplasmic staining are reliable in the absence of fractionation, better quantitation, experiment done in other cell lines and so on. However, very beautiful Fig. 5E perhaps the best of the paper shows also mobility shift driven by S483, thus supporting posttranslational modifications.

      Fig. 6. IFL studies are really impossible to interpret. The effects on RIOK2 release (this figure) and 18S maturation (Fig. 5) are very clear and of great quality. Overall conclusions. The manuscript tends to overinflate the meaning of several experiments. What to me is very clear and interesting is that the the authors provide clear evidence that S483A mutants have a defect in 40S maturation. Whether this is due to MAPK signalling, is only circumstantial. I would suggest to build up on the strong findings and eliminate ambiguous data.

      Significance

      The paper deals with an important topic, namely whether a regulation of ribosome maturation exists, and how it is mechanistically regulated. In this context, the analysis of the ERK pathway is highly needed considered that most works deal with effects of the PI3K-mTOR pathway, and the parallel, yet important RAS-ERK pathway, is less understood. As a final note, we should consider that S6K downstream of mTOR, and ribosomal S6K, downstream of ERK have been considered to share some substrates.

      The manuscript is interesting, but several statements given by the authors are rather superficial. An example, listed in the previous section, relates to the linguistic usage of mTOR kinase, instead of detailing whether we are dealing with mTORc1 or mTORc2. A second gross mistake is the definition of PMA as a stimulator of the ERK pathway. If this is certainly true, this is historically not correct as seminal papers by the group of Parker define this drug as a stimulator of conventional PKC kinases. In short, this paper is a step back in knowledge from the perspective of the literature context.

      All people interested to the crosstalk between ribosome maturation and signaling pathways will be certainly read this manuscript.

      My expertise is within the ribosome biology and signalling field.

    1. Reviewer #3:

      This is an interesting study in which the authors compare Primacy and Recency weighting models' ability to predict momentary mood assessments during a well-established gambling task. They do so across a range of conditions:

      i) random/structured/structured-adaptive reward environments

      ii) different age groups

      iii) in healthy versus depressed participants They also perform the same task in fMRI. They find that the Primacy model wins in most cases, and relates more strongly to brain activations in fMRI.

      The paper is very clearly written and easy to read and understand. The conclusions are striking, given the greater dominance of recency-based models in the literature (e.g. Kahneman's peak-end heuristic). I do however have some major concerns with some aspects of the modelling and task design: I'm not sure if they are addressable or not. In summary, they are:

      i) the comparison of Primacy and Recency models doesn't seem fair to me, as the models also differ according to whether the E term is based on previous expectations or previous outcomes. How can the authors conclude that primacy/recency is the key feature of the winning model?

      ii) The structured and structured-adaptive versions of the task seem to me to have potential biases against the Recency model due to confounding effects: these other effects must be excluded for the conclusions to be robust.

      The following describes these and other concerns in more detail:

      Methods:

      The modelling seems to me to be problematic as a contrast between primacy and recency because the Primacy and Recency models differ in more than one respect: not just weighting of previous events (presented as the "critical difference between the two models" on p6), but also whether those events are expectations (in the Recency model) or outcomes (in the Primacy model). If the authors want to conclusively establish that Primacy is a better model than Recency then surely more models ought to be compared, at very least using a 2x2 design with primacy/recency of expectations/outcomes? This is also an issue for the fMRI analysis: it is hard to conclude much about the models from the fact that the Primacy model E beta (but not the Recency model E beta) correlates with a BOLD cluster when the Recency model E term is based on previous expectations, not previous outcomes. Likewise with the direct comparison of the models' voxel-wise correlation images.

      There also seems to be an error in Figure 1's Equation (1): presumably this just refers to the Primacy model's E term and not the Recency model's E term? Both should be shown for clarity. Also Equation (6) does not look like Equation (1) - is Equation (6) incorrect? In which case what is the R term supposed to look like in Equation (6) - is it also subject to primacy weighting or not? Also in the Discussion, the authors say the Primacy model maintained the overall exponential discounting of the E term. I might misunderstand but this seems a bit misleading because the discounting is by γ^(t-j) in one model but γ^k in the other?

      The authors also comment that the Primacy model performed better "when we did not distinguish between gambling and non-gambling trials, which was another divergence from the standard Recency model". But as I understand it, the standard Recency model was originally designed such that the certain option C was NOT the average of the two gambles, so C was required in the model (at least in the 2014 PNAS paper). Here, C is the average of the gambles, so presumably it would be identical to E in the Recency model, and therefore be extraneous in the Recency model as well as the Primacy model - did the authors do model comparison to see if it could be eliminated from the Recency model? If so, this is not another difference between the models after all. Apologies if I have misunderstood something...

      I might be misunderstanding the fitting approach here but it sounds like the leave-out sample validation is done to optimise the hyperparameters, not the parameters? In which case there is no complexity penalty to reduce overfitting in the plain MSE measure? I appreciate this is less of an issue if models have the same number of parameters...

      Results:

      The authors state that the Primacy model does best in the Random condition but this is not what is stated in Table S1, where its MSE is higher, not lower (0.006 vs 0.0008)?

      A major issue with the task structures as they stand is that the structured and structured-adaptive tasks seem to have some potential problems when it comes to assessing their impact on mood ratings:

      i) the valence of the blocks was not randomised, meaning that the results could be confounded by valence. E.g., what if negative RPE effects are longer-lasting than positive RPE effects? This seems plausible given the downward trend in mood in the random environment despite an average RPE of zero. This could also explain the pattern of mood in the other two tasks, rather than primacy?

      ii) issues of scale: if there is a non-linear relationship between cumulative RPE and mood, such that greater and greater RPEs are required to lift/decrease mood by the same amounts, then this will resemble a primacy effect? This is unlikely to be an issue in the random task but may well be a problem in the structured and certainly in the structured-adaptive tasks?

      iii) issues of individual differences in responsiveness to RPE: in the structured-adaptive task, some subjects' mood ratings may be very sensitive to RPE, and others very insensitive. One might expect that given the control algorithm has a target mood, the former group would reach this target fairly soon and then have trials without RPE, and the latter group would not reach the target despite ever increasing RPEs. In both cases the Primacy model would presumably win, due to sensitivity to outcomes in the first half or insensitivity to bigger outcomes in the second half respectively? Can these possibilities be excluded using model comparison methods?

      These issues are a concern because the plain MSE is not an ideal model comparison method, and the Streaming Prediction MSE is equivocal between the Primacy and Recency models in the Random environment - the only environment which seems unbiased towards the models (given the adolescent sample was also Structured-Adaptive).

    2. Reviewer #2:

      In this paper the authors report data from a series of online and one neuroimaging study in which participants played a simple game in which they had to select between a sure outcome and a gamble. Participants reported their current mood throughout the game and the authors compared the performance of a number of models of how the mood ratings were generated. They focus on two models, a standard model which assumes that participants' expectations assume a 50:50 gamble and an adapted model that uses average experienced outcomes as the expected value. They frame these models in terms of recency vs. past weighting and suggest that the results provide evidence in favour of a higher weight of earlier events on reported mood.

      The question of how humans combine experienced events into reported mood is topical. This paper takes an interesting approach to this issue.

      I struggled a bit to understand the logic of some of the arguments in the paper, in part because important experimental and methodological detail is missing. I list my points below. The overriding question is, I think, how certain we can be that the results reported by the authors reflect a true primacy effect, as opposed to some other process (e.g. just learning an expected value) that appears in this case to be a primacy effect.

      1) I didn't really understand where the weights from the primacy graph in Figure 1B came from. The recency weights make sense-there is a discount factor in the model that is less than 1, so there is an exponential discount of more distant past events. However, for the primacy model the expectation is calculated as the mean (apparently arithmetic mean) of previous outcomes (which suggests a flat weight across previous trials) and the discount factor remains-so how does this generate the decreasing pattern of weights? It would be really useful if the authors could spell this out.

      2) The models seem to differ in terms of whether they learn about the expected value of the gamble outcomes or whether they assume a 50:50 gamble (the recency model assumes this, the primacy model generates an average of all experienced outcomes). Might the benefit of the primacy model when explaining human behaviour simply be that people use experienced outcomes to generate their expectations rather than taking stated outcome probabilities as absolutes? In other words, it is not so much that people place more weight on earlier events, but that they learn.

      3) Linked to the above, the structured and adaptive environments seem to have something to learn (blocks with positive vs. negative RPEs), so it is perhaps not surprising that humans show evidence of learning here and a model with some learning outperforms one with none. The description of these environments isn't really sufficient at present-please explain how RPEs were manipulated (was it changing the probability of win/loss outcomes, if so, how? Or was it changing the magnitude of the options? For the adaptive design was the change deterministic? So was the outcome, and thus RPE, always positive if mood was low, or was this probabilistic and if so with what probability?). Also, did the recency model still estimate its expectations here as 50:50, even when (if) this was not the case? If so, can the authors justify this?

      4) What were participants told about the gambles (i.e. were they told they were 50:50, including in structured/adaptive environments)?

      5) Please report the estimated parameter values of the models (and tell us where the common parameters differed between models). This would help in understanding how they are behaving.

      6) In addition to changing the expectation term of the recency model, the primacy model also drops the term of for the sure outcomes (because this improves the performance of the primacy model). Does this account for the relative advantage of the primacy over the recency model? i.e. if the sure outcome term is dropped from the recency model, does the primacy model still perform better?

    3. Reviewer #1:

      Keren and co. presents a very interesting study whose goal is to determine what are the determinants of subjective mood rating. They correctly identify as the "baseline" model the model proposed by Rutledge et al. where a big determinant of mood seems to be the reward prediction error (Recency model) and they contrast it with a Primacy model, where first events (not late events) play a more important role.

      They validate the model across different behavioural datasets, involving (supposedly) healthy subjects, teenagers and depressive patients. They also have a fMRI experiment and found that the weights of the Primacy model (and not the weights of the Recency model) correlate across subjects with prefrontal activity.

      Overall I think this paper addresses an important question and presents an impressive amount of data. However, I do believe that there are some important checks to be made both concerning the computational and the fMRI analyses.

      Concerning model comparison, I would like the authors to show us whether or not their model selection criteria allows us to correctly recover the true generative model in simulated datasets. Are we sure that the model selection criteria are unbiased toward the two models?

      Equally important: can the authors provide at the group level a qualitative signature of mood data that falsify the Recency model (see Palminteri, Wyart and Koechlin. 2017). They do so in Figure S2 for one subject, but it would be important to show the same (or similar) result at the group level. This should be easier in the structured or in the structured-adaptive conditions.

      Concerning neuroimaging, if I am not missing something, the results they present in the main texte is the results of a second level ANCOVA, where the individual weights of the Primacy model are shown to correlate with activity in the prefrontal cortex. Similar analyses using the weights of Recency model do not produce significant results at the chosen threshold. This analysis is problematic for two reasons. First, absence of evidence does not imply evidence of absence. Second, to really validate the model the authors should show that the trial-by-trial correlates of expectations and prediction errors are consistent with the Primacy and not the recency model. Can the authors show that the Primacy regressors explain better trial-by-trial neural activity compared to the competing model? They could do so formally by estimating the model using the Baysian toolbox usually used to compare DCM models.

      Also concernant neuroimaging, I would be important to verify that the authors replicate Rutledge et al's results and Vinckier et al's results (vmPFC, insula, striatum...). This will tell us if the studies are really comparable and would be informative regardless of the result.

    4. Preprint Review

      This preprint was reviewed using eLife’s Preprint Review service, which provides public peer reviews of manuscripts posted on bioRxiv for the benefit of the authors, readers, potential readers, and others interested in our assessment of the work. This review applies only to version 2 of the manuscript.

      Summary:

      This is a very interesting study whose goal is to determine what drives subjective mood over time during a reward-based decision making task. The authors report data from a series of online studies and one performed with fMRI. Participants played a well-established gambling task during which they had to select between a sure outcome and a 50:50 gamble, reporting momentary mood assessments throughout the game. The authors compared the performance of a number of models of how the mood ratings were generated.

      The authors identify as their "baseline" model that proposed by Rutledge and colleagues, in which an important determinant of mood seems to be the reward prediction error: the authors call this Recency model. They contrast it with a Primacy model, where earlier events (in this case, average experienced outcomes) play a more important role. They validate the model across different behavioural conditions, involving healthy subjects, teenagers and depressive patients. The conclusion is that the data are more consistent with their Primacy model, in other words a higher weight of earlier events on reported mood. In the fMRI experiment they found that the weights of the Primacy model correlated with prefrontal activation across subjects, while this was not the case for the Recency model.

      The paper is clearly written and easy to understand. The question of how humans combine experienced events into reported mood is topical and the conclusions are striking, given the dominance of recency-based models in the literature (e.g., Kahneman's peak-end heuristic). The paper takes an interesting approach and presents an impressive amount of data.

      However, at some points the arguments seemed a considerable stretch, in part because important experimental and methodological detail is missing, and in part because the analyses do not currently consider a number of potential confounds in both the models and the task design. Ultimately, these concerns come down to whether we can be certain that the results reflect a true primacy effect, as opposed to some other process that simply appears at face value to be a primacy effect. To this end, some important checks need to be made concerning both the computational and the fMRI analyses, as detailed below. These do require substantial extra modelling work, and it is quite possible that the conclusions will not survive these control analyses.

    1. Reviewer #3:

      This is an interesting paper examining the role of electric fields as a tissue damage signal for epithelial cells in vivo. Previous work had indicated the presence of electric fields in wounded tissues. But whether these phenomena play a role in early wound detection by epithelial cells has been unclear. The authors use live imaging in zebrafish to track the behaviour of epithelial cells in response to wounds. Imaging of actin dynamics was used as a readout for directional sensing in these cells. The authors show that directional sensing depends on the local concentration of specific electrolytes and that application of external electric fields can stimulate directional migration. These major conclusions are interesting and well supported. Although this is not the first time that electric fields are suggested to play a role, the study offers valuable direct evidence, in vivo evidence, and introduces a new system in which the mechanisms can be studied further.

      Main comment:

      The study is focused on establishing whether electric fields play a role in wound sensing and does not touch on how these effects are mediated. The experiments were designed to distinguish osmotic from electric effects, establish whether the effects are global or local and assess the direct effects of electric fields on epithelial cell motion. These are significant and do not appear trivial. Nevertheless, some insight, even in the form of discussion, into how these effects might be sensed by epithelial cells seemed to be lacking. At the minimum, the authors could provide ideas based on the literature. Ideally, the study would include an analysis of cytoskeletal rearrangements and calcium dynamics in response to electric fields or alterations of electrolytes for completion. The authors introduce these key readouts of epithelial signalling, but they did not make full use of these in their functional assays. Depending on whether electric fields influence the calcium wave, different mechanistic hypotheses can be made for future studies.

    2. Reviewer #2:

      I enjoyed the manuscript. Driving cell movement and even overriding wound migrational cues with an electric field is very interesting. My principal concern is that it appears the manuscript has been written in a way to downplay the previous findings in this field. I am no expert on the effects of electric fields on wound healing and chemotaxis, but a cursory look at the literature shows that that lot has been published in this arena. It appears that most if not all of the findings in this manuscript have been seen before in other contexts.

      The zebrafish offers a great set of tools to interrogate electric fields on chemotaxis and wound healing. I am simply asking for a bit of clarity with respect to the history of electrical fields, cell chemotaxis and wound healing. The authors need to provide more context for their work in the introduction with respect to electrical fields and more clearly describe what has been done before. In addition, the authors need to make additions to the conclusion that clearly define what is novel in their findings and how it relates to previous studies of electric fields and cell chemotaxis.

    3. Reviewer #1:

      This manuscript by Kennard and Theriot reports that electrical cues guide skin cells directional migration in response to injury. The authors bring molecular tools and analysis to study environmental cues, like osmolarity and electric fields in vivo. The effects of electrical cues are most studied in vitro. The in vivo model, the vivo approaches with molecular and imaging techniques bring bioelectricity research closer to mainstream techniques. Demonstrating the direct effect of electrical effects independent of osmolarity represent a significant step in this field. The results demonstrating the effects of NaCl, but not quite a few osmolarity control are impressive.

      I have the following questions and suggestions, which I do not expect the authors to address with new experiments, because as with other pioneering research, this manuscript suggests more research questions/directions on the basis that it answers some very important questions. I believe perhaps the authors already have some results to some of those questions.

      1) Good reason for choosing laceration over transection is given. I am a bit puzzled if the EFs and osmolarity are the mechanisms, why were there such differences? The endogenous EFs and osmolarity would be expected to be the same in both the laceration and transection models. Could the laceration stretch the tissue during injury procedure, so the marked increased migration was present in the laceration model? The stretch could activate stretch activated channels, stimulate cells, and realign matrix.

      2) It is not clear what relationship can be established between GCaMP6f response and migration speed (Fig.1E, G, H). inhibition of the calcium response may help to test the relationship.

      3) The local concentration of NaCl showed remarkable inhibitory effects on cell migration, and cell volume. As we know injury may activate channels and pumps, which then facilitate the ionic fluxes, thus generate persistent ionic currents. Channel and pump inhibition experiments could quickly point to some molecular basis of the involvement of NaCl.

      4) I consider using Iso KCl is very interesting, because high K+ would significantly modulate cell membrane potential, however the effect on cell migration is very similar to those of Iso Choline Cl, iso NaGlunate, Iso Sorbitol. This would provide another side evidence for the role of wound electric fields in cell migration.

      5) 200V DC is much higher than endogenous EFs expected in such a model. Caution should be given when interpreting the results. I also wonder whether the authors attempted experiments (Fig. 4B, C) using wounded animals, perhaps the tissues after injury are not technically plausible (too fragmented) for such experiments.

      6) One assumption in the paper is the TEP and wound EFs in vivo. Glass microelectrodes may be able to verify those in space and time. If this works (the TEP and wound EFs can be mapped), the effects of various treatments can be tested and exclude other possibilities.

    4. Preprint Review

      This preprint was reviewed using eLife’s Preprint Review service, which provides public peer reviews of manuscripts posted on bioRxiv for the benefit of the authors, readers, potential readers, and others interested in our assessment of the work. This review applies only to version 1 of the manuscript.

      Summary:

      This paper examines the role of electric fields as a damage signal for epithelial cell wounding using a zebrafish tail laceration in vivo model. While electrical fields had been previously noted in vitro, whether they played a role in early wound detection by epithelial cells has been unclear. They tracked the ability of epithelial cells to sense direction by imaging actin dynamics in zebrafish epidermis. From these studies, they find that directional sensing depends on the local concentration of specific electrolytes. Additionally, external electric fields can independently stimulate directional migration.

    1. Reviewer #3:

      The goal of this manuscript “to develop predictive tools for inferring fitness trajectories in new environments” is an important goal and I appreciate the synthesis of theoretical modeling with parameter estimation from empirical mutation studies.

      Reading through the manuscript, however, I found myself repeatedly wondering whether the stated application of the methods developed here doesn't constitute something of a tautology. This could be a misreading on my end, but I'll explain: the authors state that they have the central goal of predicting whether a population adapting to one environment will lose fitness in another "non-home" environment. Yet the parameter estimation they develop and propose for estimating fitness trajectories requires fitness measurements in both the home and non-home environments. If one already has fitness measurements for both home and non-home, how much more information is added by estimating the JDFE? I understand that the authors are estimating the fitness trajectories over time, with the incorporation of population genetic parameters, but again, I was unsure of how much information was added with the JDFE particularly given large discrepancies in the Wright-Fisher models and the decreasing predictive capacity with time. The bottom row of Figure 1 provided perhaps the most convincing evidence of the usefulness of the JDFE, but the unintuitive result was not adequately explored nor explained (see comment below). Also, perhaps an exploration of how the predictions could be extended to unmeasured environments is possible (as in Kinsler et al 2020)?

      Further specific conceptual comments and suggestions:

      1) The authors demonstrate in Figure 1 that JDFEs even with similar shapes produce markedly different fitness trajectories. They argue that the correlation coefficient of the JDFE is not a reliable predictor of fitness trajectories in the home environment. I was struck by this counterintuitive result, and found myself searching for further explanation. Are the authors arguing that the practice of simply looking at the correlation coefficient in tradeoff studies in general is insufficient for predicting the fates of pleiotropic mutations? Either way, it would be helpful to the reader to elaborate on why and under which conditions the discrepancy with the correlation coefficient and fitness trajectories arises.

      2) The modeling results throughout the manuscript reveal poor predictive capabilities in Wright-Fisher simulations. For example, the results in figure 2 show substantial discrepancy between the theoretical predictions and the results of the Wright-Fisher simulations. The authors address this only briefly stating that outside of the strong selection, weak mutation model (SSWM) the pleiotropy statistics are only "statistical predictors". But the discrepancy was systematic and wide, suggesting rather little insight from the pleiotropy statistics in sequential adaptation scenarios. I could not find discussion of this discrepancy between the SSWM and Wright-Fisher modeling predictions.

    2. Reviewer #2:

      The authors present a theoretical framework for analysing pleiotropic effects in populations evolving in different environments based on the concept of a joint distribution of fitness effects (JDFE). Simple correlation measures are derived from the JDFE that allow one to predict the evolutionary outcome in the non-home environment. Analytic theory is derived in the SSWM regime and complemented by simulations covering the regime of large mutation supply. A proof-of-concept application to collateral antibiotic resistance and sensitivity in bacteria based on a published data set for knockout strains is presented. Overall, this is an important, systematic contribution to a very timely subject.

      Major Concerns:

      1) I do not quite share the authors' surprise at the outcomes shown in Figure 1. In fact there is a simple heuristic that allows one to predict the direction of the fitness change in the non-home environment in all cases: Simply look at the y-coordinate of the tail of the JDFE corresponding to the largest beneficial effects along the x-axis.

      2) Along the three rows of panels in Figure 2, there appears to be a systematic but in two cases non-monotonic variation of the slope with the mutation supply NU_b. Do the authors have a (tentative) explanation for this behavior?

    3. Reviewer #1:

      Ardell and Kryazhimskiy use bacterial TnSeq data in multiple conditions to study the structure of pleiotropy, that is the degree to which a genetic perturbation affects multiple phenotypes, and present a theoretical framework to predict and assess fitness trajectories observed in environments other than the one selection is operating in. The work is thoroughly done and has potentially interesting implications for sequential drug therapy.

      The central object of their framework is the joint distribution of fitness effects of mutations in multiple environments where the distribution is over all mutations in the genome. The dynamics in the space of fitness in multiple environments is then modeled as a random walk (described by a diffusion equation) assuming that mutations sweep separated in time (SSWM). The model and the calculations necessary to arrive at the predictions are simple and transparent. The results quantitatively predict simulation results with the range of validity of SSWM. Outside this range, the model predicts the qualitative behavior, but is quantitatively wrong.

      1) My main disappointment with the paper is the inability to quantitatively describe the dynamics outside the SSWM regime. I would expect that the effects of competing mutations or weak selection could be accounted for at least perturbatively. Alternatively, one could determine the distribution of the effects of fixed mutations in the "home" environment in simulations and use this distribution to predict the dynamics in other environments.

      2) My other substantial concern is the question whether anything can be learned about drug resistance evolution or collateral sensitivity/resistance from TnSeq experiments. While some drug resistance evolution involves loss-of-function mutations (e.g. porin losses), it often proceeds via point mutations, up-regulation, or horizontal acquisition. Furthermore, the statistical treatment here requires many mutations to sample the joint effect distribution to give reliable answers. In clinical resistance evolution, the number of mutations observed is often quite small and their effect distributions are wide. The practical relevance of this is therefore far from clear.

      3) While the similarity of this work to similar questions in quantitative genetics is discussed in the introduction, I would like to see an extended discussion to determine whether some limits of the model at hand can be described by the quantitative genetics approach.

    4. Preprint Review

      This preprint was reviewed using eLife’s Preprint Review service, which provides public peer reviews of manuscripts posted on bioRxiv for the benefit of the authors, readers, potential readers, and others interested in our assessment of the work. This review applies only to version 1 of the manuscript.

      Summary:

      The reviewers agreed that pleiotropy of mutations and the resulting adaptive trajectories across different environments are important topics that are both of theoretical and applied interest. Your theoretical framework predicts fitness trajectories observed in environments other than the one selection is operating in (home environment). These trajectories in non-Home environments are calculated via integrals over the joint fitness effect distribution weighted by the fixation probability in the home environment. However, your framework assumes strong selection and weak mutation (SSWM) and deviations from this assumption seem to have strong effects. We think that these effects need to be at least partially understood. Furthermore, application to the KO library is a useful proof-of-concept, but the practical relevance of these patterns for understanding collateral sensitivity/resistance is far from obvious. In summary, we felt that the manuscript needs to make more substantive theoretical advances and/or provide more robust actionable insights into drug resistance evolution.

    1. Reviewer #3:

      Mahfooz et al. employed FM4-64 to assay vesicle fusion of cultured mouse hippocampal synapses. They observed that the FM destaining time course deviates from a mono-exponential function during 1-Hz and 20-Hz trains. The deviation from mono-exponential kinetics was also seen during a second stimulus train applied after recovery periods of up to eight minutes. Destaining was faster after loading at low frequency (1Hz) compared to high frequency (20 Hz). The destaining time course during high-frequency stimulation was independent of the length of preceding low-frequency trains. Conversely, short high-frequency trains did not affect destaining kinetics during subsequent low-frequency stimulation. Finally, they probed destaining in Synapsin DKO cultures and found faster destaining during short high-frequency trains and long low-frequency trains. Based on these data, the authors conclude that slowly and quickly mobilized reserve vesicles are mobilized in parallel without intermixing.

      The paper addresses an interesting question - the relationship between the mobilization and the release of synaptic vesicles. Most data are solid. However, most major conclusions are not/only weakly supported by the data presented in the manuscript. A major limitation is that direct links between the FM data and a previously established 'modular' model of reserve vesicle mobilization are missing. The following points need to be addressed:

      1) The deviation from a mono-exponential destaining time course is a central observation of the study. The quantification is essentially based on comparing relative destaining during 2-min intervals. Mostly, this 'fractional destaining' is compared between the first and last two minutes of 1- or 20-Hz stimulation. This is not convincing. By eye, most destaining time courses actually look quite mono-exponential. The authors need to provide additional evidence for a deviation from mono-exponential kinetics. For instance, data could be approximated with a double-exponential function and considered double-exponential if the amplitude and time constant of the two components significantly differ from one another, and if each component contributes significantly to the overall amplitude. How large is the amplitude of the slow exponential component, and how slow is its time course? Is the overall contribution of the slow component significant? How do the amplitudes and kinetics of reserve mobilization compare to the ones of fast/reluctant release from the RRP?

      2) Correcting for rundown/bleaching in the absence of stimulation is key for concluding that the time course differs from a single exponential. According to Raja et al. (2019), rundown was corrected by subtracting a line fit to the data before stimulus onset. The authors need to record for longer periods in the absence of stimulation and subtract these data from the data obtained in the presence of stimulation. They could also compare the resulting time constant with the slow time constant during stimulation.

      According to the methods section, data were corrected for rundown. However, many time courses (Fig. 2A, C, 3A, 4...) display a decrease in fluorescence before stimulus onset. How exactly was the data corrected? Was this also done during the recovery periods? More details are needed to conclude on a potential slowing of FM destaining.

      3) The decrease in fractional destaining depends on the duration of 1-Hz stimulation (Fig. 6B, D). How specific are the results to 1-Hz stimulation for 15 minutes? The relationship between fractional destaining and stimulation frequency/duration needs to be investigated systematically.

      4) Data is mainly represented as averages of many preparations. Individual ROIs display vastly different destaining time courses (Figure 2D). How robust are the phenotypes at the level of individual preparations? I suggest plotting and fitting average data of individual preparations in addition to showing grand averages and box plots. Moreover, it would be helpful to show the data of all ROIs and the corresponding average for one representative preparation to get a sense of the variability.

      5) The authors claim that destaining during 20-Hz stimulation is largely independent of the duration of preceding 1-Hz trains (Figure 6). However, the time courses shown in figure 6C look different. Indeed, the destaining appears slower during 20-Hz stimulation following long 1-Hz trains, arguing against the modular model. The time courses/fractional destaining of the 20-Hz data shown in figure 6 should be quantified.

      6) Destaining was faster in Synapsin DKO cultures compared to WT for short 20-Hz trains (Fig. 8A), as well as long low-frequency trains (Fig. 9). The quantification of destaining during 20-Hz stimulation for 4 s, or 0.1/1-Hz trains for the first 4 min seem somewhat arbitrary. Is the difference by a factor of 1.5 between Synapsin DKO and WT also seen for other durations of short high-frequency trains depleting the RRP, or long low-frequency protocols?

      7) The authors claim that the destaining time courses are similar between Synapsin DKO and WT for longer 20-Hz trains (Fig 8B). However, the data shown in figure 8B indicate a difference. The destaining kinetics/fractional destaining should be also quantified for the 20-Hz trains for 100 s.

      8) The authors conclude that their data support a 'modular model', in which chains of synaptic vesicles are connected to release sites in parallel. Although this model is interesting, direct links between the FM data and the model are missing. For instance, direct links between vesicle chains, their replacement or length (Fig. 1) and the FM data are missing. I therefore suggest discussing the data in the context of the model at the end of the paper instead of starting the paper with a cartoon of the model. In general, the model, which is mainly based on previous data by the same group, should be less emphasized, and terms like "re-conceptualization" should be avoided.

      Additionally, the authors need to discuss other reasons that could explain a deviation from a mono-exponential time course. They claim to exclude potential contributions from long-term depression, because destaining is faster after 1-Hz compared to 20-Hz loading, but I don't find this convincing. How can they exclude contributions of other factors, such as pr depression (e.g. by presynaptic calcium channel inactivation; e.g. Xu and Wu, 2005), effects of endocytosis etc.? Could other aspects of the known Synapsin DKO phenotypes explain their data?

    2. Reviewer #2:

      This is an interesting study attempting to conceptualize the long-standing question of the mode of vesicle trafficking in presynaptic terminals. The authors used classical FM dye release experiments to support a hypothesis that rapidly and slowly releasing vesicles are mobilized in parallel without intermixing. The use of synapsin KOs effectively supports the authors' model. This modular model is also supported indirectly by the authors' recent findings of molecular links that connect a subset of vesicles in linear chains (published elsewhere). However, the scope of the model is limited by a number of caveats. The main concerns include a limited dataset measured in bulk from a highly heterogeneous synapse population, and a complex interrelationship between vesicle mobilization and FM dye de-staining kinetics. The second major limitation is measurements being performed at room temperature, which inhibits or alters a number of critical synaptic processes that are being modeled. This includes the efficiency of exo/endocytosis coupling, vesicle mobility and release site refractory period, which are stimulus- and temperature-dependent, but are not accounted for in the current model.

      Major Comments:

      1) The model lacks consideration of vesicle endocytosis efficiency. Hippocampal synapses can efficiently sustain release for at least 300APs at 35C (but not at 25C) at frequencies up to 10Hz (Fernandez-Alfonso and Ryan, 2006). Therefore a very rapid and efficient replenishment of the RRP is present at this synapse, particularly at 1Hz stimulation used in many experiments in the current study. The efficiency of endocytosis determines vesicle availability and thus release kinetics during stimulus trains; it is unclear how it is reflected in FM dye de-staining and the resulting model since the newly endocytosed and recycled vesicles are not labeled. Moreover the efficiency of exo-/endocytosis coupling is dramatically reduced at room temperatures (Fernandez-Alfonso and Ryan, 2006). It is also strongly calcium-/stimulus dependent (Leitz and Kavalali, 2011, 2014). These effects are not considered in the study, which is performed entirely at room temperature, thus greatly limiting interpretation of the results.

      2) Related to the above: authors point to lack of vesicle intermixing, a core hypothesis of the study, as being consistent with lack of vesicle mobility in previous studies. However, lack of vesicle mobility is simply an artifact of low recording temperatures (Gaffield and Betz 2007, Peng, Rotman et al. 2012); a majority of recycling synaptic vesicles are highly mobile at body temperatures (Westphal, Rizzoli et al. 2008, Kamin, Lauterbach et al. 2010, Lee, Jung et al. 2012, Park, Li et al. 2012).

      Thus intermixing might be limited or largely inhibited at room temperatures because of inefficient endocytosis or lack of vesicle mobility.

      These two considerations make it difficult to interpret the FM de-staining measurements at room temperature simply as a reflection of the mode of vesicle mobilization alone. The study would greatly benefit from more direct measurements of vesicle release, controls for endocytosis kinetics at different stimulus paradigms, and from the key measurements repeated at body temperatures.

      3) The bulk FM measurements used in the study represent an average of highly non- homogeneous population, which is not well represented by a Gaussian distribution. Indeed, the authors show a marked variability in FM de-staining among individual synapses. Extending the model to account for variability among individual synapses would greatly strengthen the conclusions.

      4) Release site refractory period (Neher, 2010) may vary among release sites and can make substantial contributions to FM release kinetics depending on stimulation frequency. This is not accounted for in the current model.

    3. Reviewer #1:

      In this manuscript, the authors show the data supporting two types of parallel reserve pool. The concept is original and interesting. However, at least for me, the manuscript is very difficult to follow because the main text and figure legend do not have sufficient explanation and sometimes it is difficult to understand what the figures tell us (what the axis means? for example). Therefore, after reading the ms several times, I cannot judge whether the data support the authors concept or not. In addition, I have the following issues, which may come from my lack of understanding as described above.

      1) Interpretation of FM data is not necessarily straightforward, because there are stained and non-stained vesicles. In addition, stained vesicles are converted into non-stained ones after exocytosis of synaptic vesicles. It will be easier to interpret the data if the authors show EPSC data or synaptopHluorin data, which only measured exocytosis, and compare the difference between FM data and others.

      2) Fig 3 is interesting because the data show the decrease of de-staining at the second stimulation by waiting a longer time, which is opposite to what people expect. However, the data may support the idea of mixing stained vesicles and non-stained vesicles with time perhaps in the same reserve pool. Figure 3 shows that dyes are completely lost after 20 Hz stimulation at the end of the protocol, which is against this idea. On the other side, Figure 2 shows residual fluorescence remaining after 20 Hz stimulation.

      3) Fig 4 is again interesting, because loading with 1 Hz stimulation may load the vesicle pool which is used for lower stimulation frequency. However, it is not known if 1 Hz stimulation triggers more exocytosis or less compared with 20 Hz stimulation. With high frequency stimulation, there may be AP failure, Ca current inactivation, less time for new vesicle recruitment. It could have been more informative to have additional data which directly shows this (see 1)

      4) Fig 7 is not really consistent with parallel vesicle pools because 1 Hz stimulation decreases the amounts of exocytosis of the following 20 Hz stimulation (compare A and B), although C shows the amounts of exocytosis are the same between A and B.

    4. Preprint Review

      This preprint was reviewed using eLife’s Preprint Review service, which provides public peer reviews of manuscripts posted on bioRxiv for the benefit of the authors, readers, potential readers, and others interested in our assessment of the work. This review applies only to version 1 of the manuscript.

      Summary:

      Overall, there was a strong enthusiasm for the topic of the study, and all the reviewers acknowledged the originality of the hypothesis being pursued. However, several technical issues and shortcomings have been raised, and as such, the present experiments fall short of compellingly supporting the conclusion of the study. These concerns have been detailed in the individual reviews below.

    1. Reviewer #3:

      This study by Haimson et al. aims at examining the diversity of dI2 interneurons and their role in coordinating activity across different regions of the spinal cord and in reporting back activity to the brain. The results show that dI2 interneurons comprise different sub-classes based on their axonal projections, soma diameter and transmitter identity. They also show that some dI2 interneurons project rostrally from the lumbar spinal cord and make putative synaptic contacts with other dI2 interneurons in the brachial spinal cord on their way to the cerebellum. Finally, it is shown that some dI2 interneurons receive putative inputs from DRG neurons and may serve to transmit movement-related feedback. An indiscriminate silencing of dI2 interneurons results in instability of locomotion. Overall, this study reports some interesting observations by showing the heterogeneity of dI2 interneurons and their potential function. I have the following concerns:

      1) 12% express Pax2 and are considered inhibitory. However, Gad is expressed in only 25% of dI2 interneurons while vGlut is expressed in 88%. These proportions suggest that there are dI2 neurons that co-express vGlut and Gad. Is this the case? Are there additional inhibitory dI2 neurons in addition to those expressing Pax2 which could explain the fact that Gad labels 25% of dI2 neurons. These points need some clarifications and discussion.

      2) Of all dI2 interneurons, 91% are small diameter and 9% are large diameter neurons - large diameter neurons are mostly apparent in the lumbar spinal cord. The small and large diameter dI2 neurons cannot be differentiated by their expression of TFs, but can be distinguished by their transmitter identity? Is the proportion of small and large diameter neurons the same along the spinal cord?

      3) Do all dI2 neurons receive putative synaptic contacts from DRG neurons? Unless I have missed it, it would be helpful to provide quantification of the number of small vs large diameter dI2 neurons with regard to the different putative synaptic contacts they receive from DRG neurons, dI2 and V1 interneurons.

      4) Lines 218-220: It is stated that DRG putative contacts are mainly targeting dorsal dI2 neurons while ventral ones receive virtually no contacts. Since large diameter VSCT dI2 neurons are located ventrally, they do not seem to receive direct sensory information. However, the authors conclude that VSCT dI2 neurons receive sensory input (lines 227-228) and also in the Discussion. There seem to be a mismatch between the results and the conclusion drawn by the authors (lines 374-377). Unless I am missing something here, this is not consistent with the conclusions of this study. Please clarify.

      5) The silencing experiments are interesting, however it is unclear which sub-class of dI2 neurons and at what level (lumbar vs brachial spinal cord or cerebellum) the observed behavioral perturbations take place. It is possible to selectively silence excitatory vs inhibitory or only VSCT neurons to provide some link between dI2 sub-classes and behavioral perturbations.

    2. Reviewer #2:

      This work addresses the possibility that developmentally-characterized di2 neurons contribute to the ventral spinocerebellar tract and regulate stepping in the chick. The work is sound considering that most information we have on spinal subtypes are for ventrally-born and local circuit interneurons (i.e. motor related), but less is known about the dorsally-born types and about long-range projecting neurons that link the spinal cord with higher integrative centers. Here, using a combination of cell-type specific manipulations, circuit tracing tools and kinematic analysis of gaits in the chick authors propose that spinal di2 interneurons contain multiple subgroups including a population that sends projection to the cerebellum. Silencing di2 neurons overall leads to impaired stepping.

      Overall, the strategy is sound and there is potential novelty, provided the weaknesses in the scientific demonstration listed below can be first addressed, experimentally and/or by additional analysis. Equally importantly also, the work suffers from a severe lack of clarity (writing, figures, results).

      I start with the scientific weaknesses:

      1) Synaptic connections rely mostly on the anatomical overlap between di2 cells and the synaptic field of their putative pre-synaptic partners. While this is indeed suggestive, it is not enough to ascertain actual synaptic connections, and even less so in a comparative manner between the different groups. Furthermore, some tracers (e.g PRVmCherry) do not seem to be under a synapse-specific promoter, so labelled elements might just as well be passing fibers. Clearer evidence of actual connections should be provided, functionally if possible or at the very least by showing clearer putative boutons onto neuronal somata/dendrites, quantifying them and quantifying differences between input cell types. Current figures (2F / 3B', C', D' / 4C, D', E', F') are not sufficiently convincing since we see only one cell and can barely detect boutons visually on some of them (not to mention that pseudo-colors keep changing, see other comment below). In addition, please consider using the term "putative" or "presumed" synapses, contacts and connections throughout the study.

      2) The loss of function and gait analysis is stronger and convincingly presented. However, unless I missed it, the strategy silences all di2 neurons but cannot discriminate the contributions of the pre-cerebellar ones. This poses problems for the interpretation of the data. Since this paper is about either subpopulations of di2, or the vSCT (see other comment about general scope of the work), it would be more robust if more specific silencing was included. It is currently assumed that one likely mechanism for the disturbed gait owes to the function of di2 as precerebellar neurons (line 385, 389) but the phenotype could also, or even entirely, be due to their proprio-spinal connectivity. This is a major caveat.

      On top of this, writing and data presentation MUST be substantially improved on multiple aspects:

      3) Please have the manuscript deeply proofread. In addition to numerous English mistakes (missing "the", "or", plural and singulars, lots of unnecessary commas, etc...) examples of confused writing include (non-exhaustive list):

      (a) Line 128: what does this phrase mean ("TF expression is redundant"...)

      (b) Line 159: I don't understand here, the Di2 ascend to the cerebellum, cross the midline to the targeted di2? To which Di2 do the authors refer to here, it sounds like they are in the cerebellum, or that the ascending Di2 redescend to the spinal cord...

      (c) The term targeted is in fact used alternatively and confusingly to refer to either "manipulated" cells, "synaptically-targeted" cells, there is also "targeted overground locomotion",....

      (d) Stage HH18 is sometimes referred to as E3. Please be consistent throughout.

      (e) When describing inputs onto di2, add "neurons" (i.e. "onto di2 neurons").

      4) I would appreciate more background on di2 neurons in the introduction and why these have been investigated. Currently, most of this is given in the first paragraph of the results (lines 91-100 and also line 103). Also, it is stated first that "the role of di2 neurons is elusive due to the lack of genetic targeting means" (line 59). This contradicts the later statement that "the progenitor pdi2 expresses [various transcription factors]", and that the "post mitotic di2 are defined by..." (line 103). Please clarify what is known and not known about di2 already in the introduction.

      5) Related to the above, it is not sufficiently clear what is investigated here. The genetic identity of ventral spinocerebellar neurons? Or the diversity of di2 neurons? In the way the introduction is written, it gives the impression that it is the former, but then functional investigations are not specific enough (since they are targeted to the overall di2 population, see dedicated comment later). Authors should revise to make clearer what is the scope of the work.

      6) Histology Figures should be made more convincing, self-explanatory, and to a higher standard.

      (a) Anatomical landmarks must be placed on all figures, e.g: the midline and minimal nuclei of the cerebellum, the deep cerebellar nuclei should be indicated in Fig S4,... Also, please give the orientation axis on all figures (especially the ones illustrating large territories, like 2B, 4A).

      (b) Add the CTB or HSV tracer on Fig. 2A and check coherence: I believe for instance that HSP is wrongly stated instead of HSV in Fig 2D and PRV is wrongly stated instead of CTB in Fig 2F (and there might be other confusions throughout).

      (c) It is extremely confusing that histology pseudo-colors are sometimes changed from one related figure to the other, for unclear reasons (e.g. 2B, 2B', 2C, also 2C and S4A...). Consistency will help the reader go through all panels and figures comparatively.

      (d) Figures must be addressed in proper order. This also applies to supplemental figures. Otherwise, it gives the impression we have missed something.

      (e) What is the rationale for plotting the overlap in area versus volume (Figure 2H, I)? If overlap with area shows a higher percentage than with volume, does it mean that the overlap is only limited to a given A/P plane? I'm really confused about this representation and its meaning.

      7) Authors should avoid relying on subjective formulations like "that reside at the lateral dorsal aspect of lamina VII". Instead, they MUST demonstrate the positioning of Di2 neurons into the different spinal laminae with some form of quantitative measurements. This is currently just an "impression" that large, precerebellar Di2 are more ventral, in lamina VII and possibly VIII but without the representation of lamina borders on figures, this information cannot be appreciated by the reader. It is all essential that these borders are depicted in Figures and neurons be quantitatively allocated to each laminae. In addition/alternatively, authors should report the average D/V position of the different subtypes and test for significant differences to make the case of different spatially-confined populations stronger.

      8) FoxD3 expression on Supplemental Figure 2B is not convincing. It is also not reported in the statistics of Fig 1E. Do we have to assume that all di2 investigated here are FoxD3-positive? If so, one would need a better illustration and quantifications should be given. Otherwise, I would suggest simply relying on the literature and removing Figure S1B which is not helping. On other panels of that supplemental Figure 2, please add arrow/arrowheads on all neurons that are or are not co-labelled so we can appreciate co-labelling.

      9) The demonstration that di2 are excitatory is essential. It is the title of a paragraph (line 102), thus I think that the corresponding data with the neurotransmitters (Vglut2, GAD) would deserve to be in the main Figures. Also, the chosen illustration only shows ONE double-labelled cell with Vglut2. Authors should be able to show a field of view that more convincingly conveys the message with more cells.

    3. Reviewer #1:

      This is a well-put-together manuscript describing carefully performed circuitry dissection and functional analysis of dl2 neurons in the chick. A genetic toolbox is used taking advantage of the electroporation technique applied to the embryos. The findings include a fairly convincing connectome for dl2 neurons and a functional phenotype that is, unfortunately, rather unsatisfying. The investigators conclude that dl2 interneurons regulate "stability" of bipedal stepping in the chick, which is fine, but the analysis misses an opportunity to more fully explore what the instability involves and thus to perhaps shed more light on the likely roles of this neuron population. The concerns/issues 3 and 4 below focus on this issue and the need for additional careful analysis of the behavior that will allow the phenotype to be more precisely described or ascribed to some aspect of stepping that might guide future studies in other models. For example, can the link between partial collapse and over-extensions be made more solid and thus argue that reduced extensor gain might be what results in the instability? What other analysis could be performed using the existing data/video to better describe the behavioral phenotype?

      Major Concerns:

      1) The connectome part of the work appears solid and supports the concept that a subpopulation of the population are likely VSCT neurons, that the non VSCT neurons receive the bulk of the afferent input and that these neurons project to contralateral dl2 neurons (some which may be VSCT) and other premotor neurons. Anatomically, the only concern is that no distinctions were made between the lumbar and brachial populations, and if differences in these populations exist, it would be important and interesting to describe them.

      2) Figure 2 Characterization of dl2/VSCT neurons as being primarily large dl2 neurons is quite convincing, and the observation that the dl2 neurons account for 10% of the VSCT axons is also of interest and quite compelling. A question arises, however, about the source, rostrocaudally, of the VSCT neurons and tract. Is the 10% for the total or for a specific level or levels? Can more be said/quantified about differences in these populations at different spinal levels?

      3) Whole-body collapses and subsequent over-extensions are important and speak to changes in reflex arc and motor output. The statement "usually followed by" over-extension should be followed-up. Can this be further quantified? Are the two events linked or distinct, and did over-extensions happen in the absence of collapses?

      4) These issues mesh with the lower knee height and angle of the TMP joint, even when collapses are excluded. It appears as though the control system to maintain muscle shortening (force output of extensors) is altered. I agree that stability is compromised, but could we go further to state that the compromise is due to extensor gain control?

    1. Reviewer #3:

      In this work Stachiak and colleagues investigate the role of Prox1 on the development of VIP cells. Prox1 is expressed by the majority of GABAergic derived from the caudal ganglionic eminence (CGE), and as mentioned by the authors, Prox1 has been shown to be necessary for the differentiation, circuit integration, and maintenance of CGE-derived GABAergic cells. Here, Stachiak and colleagues show that removal of Prox1 in VIP cells leads to suppression of synaptic release probability onto cortical multipolar VIP cells in a mechanism dependent on Elfn1. This work is of interest for the field because it increases our understanding of differential synaptic maturation of VIP cells. The results are noteworthy, however the relevance of this manuscript would potentially be increased by addressing the following suggestions:

      1) Include histology to show when exactly Prox1 is removed from multipolar and bipolar VIP-expressing cells by using the VIP-Cre mouse driver.

      2) Clarify if the statistical analysis is done using n (number of cells) or N (number of animals). The analysis between control and mutants (both Prox1 and Elfn1) need to be done across animals and not cells.

      3) Clarify what are the parameters used to identify bipolar vs multipolar VIP cells. VIP cells comprise a wide variety of transcriptomic subtypes, and in the absence of using specific genetic markers for the different VIP subtypes, the authors should either include the reconstructions of all recorded cells or clarify if other methods were used.

    2. Reviewer #2:

      Stachniak et al., provide an interesting manuscript on the postnatal role of the critical transcription factor, Prox1, which has been shown to be important for many developmental aspects of CGE-derived interneurons. Using a combination of genetic mouse lines, electrophysiology, FACS + RNAseq and molecular imaging, the authors provide evidence that Prox1 is genetically upstream of Elfn1. Moreover, they go on to show that loss of Prox1 in VIP+ cells preferentially impacts those that are multipolar but not the bipolar subgroup characterized by the expression of calretinin. This latter finding is very interesting, as the field is still uncovering how these distinct subgroups emerge but are at a loss of good molecular tools to fully uncover these questions. Overall, this is a great combination of data that uses several different approaches to come to the conclusions presented. I have suggestions that I think would strengthen the manuscript:

      1) Can the authors add a supplemental table showing the top 20-30 genes up and down regulated in their Prox1 KOS? This would make these, and additional, data more tenable to readers.

      2) It is interesting that loss of Prox1 or Elfn1 leads to phenotypes in multipolar but are not present or mild in bipolar VIP+ cells. The authors test different hypotheses, which they are able to refute and discuss some ideas for how multipolar cells may be more affected by loss of Elfn1, even when the transcript is lost in both multipolar and bipolar after Prox1 deletion. If there is any way to expand upon these ideas experimentally, I believe it would greatly strengthen the manuscript. I understand there is no perfect experiment due to a lack of tools and reagents but if there is a way to develop one of the following ideas or something similar, it would be beneficial:

      a) Would it be possible to co-fill VIPCre labeled cells with biocytin and a retroviral tracer? Then, after the retroviral tracer had time to label a presynaptic cell, assess whether these were preferentially different between bipolar and multipolar cell types, the latter morphology determined by the biocytin fill? This would test whether each VIP+ subtype is differentially targeted.

      b) Another biocytin possibility would be to trace filled VIP+ cells and assess whether the dendrites of multipolar and bipolar cells differentially targeted distinct cortical lamina and whether these lamina, in the same section or parallel, were enriched for mGluR7+ afferents.

    3. Reviewer #1:

      Stachiak and colleagues examine the physiological effects of removing the homeobox TF Prox1 from two subtypes of VIP neurons, defined on the basis of their bipolar vs. multipolar morphology.

      The results will be of interest to those in the field, since it is known from prior work that VIP interneurons are not a uniform class and that Prox1 is important for their development.

      The authors first show that selective removal of a conditional Prox1 allele using a VIP cre driver line results in a change in paired pulse ratio of presumptive excitatory synaptic responses in multipolar but not bipolar VIP interneurons. The authors then use RNA-seq to identify differentially expressed genes that might contribute and highlight a roughly two-fold reduction in the expression of a transcript encoding a trans-synaptic protein Elfn1 known to contribute to reduced glutamate release in Sst+ interneurons. They then test the potential contribution of Elfn1 to the phenotype by examining whether loss of one allele of Elfn1 globally alters facilitation. They find that facilitation is reduced both by this genetic manipulation and by a pharmacological blockade of presynaptic mGluRs known to interact with Elfn1.

      Although the results are interesting, and the authors have worked hard to make their case, the results are not definitive for several reasons:

      1) The global reduction of Elfn1 may act cell autonomously, or may have other actions in other cell types. The pharmacological manipulation is less subject to this interpretation, but these results are not as convincing as they could be because the multipolar Prox1 KO cells (Fig. 3 J) still show substantial facilitation comparable, for example to the multipolar control cells in the Elfn1 Het experiment (controls in Fig. 3E). This raises a concern about control for multiple comparisons. Instead of comparing the 6 conditions in Fig 3 with individual t-tests, it may be more appropriate to use ANOVA with posthoc tests controlled for multiple comparisons.

      2) The isolation of glutamatergic currents is not described. Were GABA antagonists present to block GABAergic currents? Especially with the Cs-based internal solutions used, chloride reversal potentials can be somewhat depolarized relative to the -65 mV holding potential. If IPSCs were included it would complicate the analysis.

      3) The assumption that protein levels of Elfn1 are reduced to half in the het is untested. Synaptic proteins can be controlled at the level of translation and trafficking and WT may not have twice the level of this protein.

      4) The authors are to be commended for checking whether Elfn1 is regulated by Prox1 only in the multipolar neurons, but unfortunately it is not. The authors speculate that the selective effects reflect a selective distribution of MgluR7, but without additional evidence it is hard to know how likely this explanation is.

    4. Preprint Review

      This preprint was reviewed using eLife’s Preprint Review service, which provides public peer reviews of manuscripts posted on bioRxiv for the benefit of the authors, readers, potential readers, and others interested in our assessment of the work. This review applies only to version 1 of the manuscript.

      Summary:

      This work is of interest because it increases our understanding of the molecular mechanisms that distinguish subtypes of VIP interneurons in the cerebral cortex and because of the multiple ways in which the authors address the role of Prox1 in regulating synaptic function in these cells.

    1. Reviewer #3:

      This manuscript reports results from an eye tracking study of humans walking in natural terrain. These eye movements together with images simultaneously obtained by a head-fixed camera are used to calculate optic flow fields as seen by the retina and as seen by the head-fixed camera. Next, the structure of these flow fields is described. It is noted that this structure is somewhat stable in the retinal image, due to compensatory gaze stabilisation reflexes, but varies wildly in the head-centric image. Then, the authors estimate the focus of expansion in the head-centric flow and argue that it cannot be used for locomotor control, because it also varies wildly during walking. In a second, more theoretical section of the manuscript, they calculate retinal flow for a movement over an artificial ground plane, given the locomotor and eye movements recorded previously. They describe the structure of the retinal flow and compute the distribution of curl and divergence across the retina as well as in a projection onto the ground plane. They argue that curl around the fovea and the location of the maximum of divergence can be used to estimate the direction of walking relative to the direction of gaze and in relation to the ground plane.

      I really like the experimental part of the study. However, I see fundamental issues in the theoretical part, in the general framing of the presentation, and in misrepresentations of previous literature.

      The simultaneous measurement of head-centric image and gaze with sufficient temporal resolution to calculate retinal flow during natural walking provides a beautiful demonstration of retinal flow fields, and confirms many known aspects of retinal flow. The calculation of head-centric flow from the head camera images provides a compelling, though not unexpected, demonstration that the FOE in head-centric flow is not useful for locomotor control. It is not unexpected since one of the most well-known issues in optic flow is that the FoE is destroyed when self-motion contains rotational components (Regan and Beverley, 1982, Warren and Hannon, 1990, Lappe et al. 1999). Although this is often presented as an issue of eye movements in retinal flow, it applies to all rotations and combinations of rotations that exist on top of any translational motion of the observer. Thus, the oscillatory bounce and sway motion of the head during walking is expected to render any use of the FOE in a head-centric image futile.

      Yet, the first part of the manuscript is very much framed as a critique of the idea of a stable FoE in head-centric flow, presuming that this is what previous researchers commonly believed. This argument contains a logical fallacy. Previous research argued that there is no FoE in retinal flow because of eye rotations (e.g. Warren and Hannon, 1990). This does not predict, inversely, that there is an FoE in head-centric flow. In fact, it does not provide any prediction on head-centric flow. The authors often suggest that a stable FoE in head-centric flow is tacitly implied, commonly believed, etc without providing reference. In fact, the only paper I know that specifically proposed a head-centric representation of heading is by van den Berg and Beintema (1997).

      Instead, the fundamental problem of heading perception is to estimate self-motion from retinal flow when the self-motion that generates retinal flow combines all kinds of translations and rotations. The present study shows, consistent with much of the prior literature, that the patterns of retinal flow are sufficiently stable and informative to obtain the direction of one's travel in a retinal frame of reference, and, via projection, with respect to the ground plane. This is due to the stabilising gaze reflexes that keep motion small near the fovea and produce (in case of a ground plane) a spiralling pattern of retinal flow. This is well known from theoretical and lab studies (e.g. Warren and Hannon, 1990, Lappe et al., 1998, Niemann et al., 1999, Lappe et al. 1999) and, to repeat, beautifully shown for the natural situation in the present data. The presentation should link back to this work rather than trying to shoot down purported mechanisms that are obviously invalid.

      The second part of the manuscript presents a theoretical analysis of the retinal flow for locomotion across a ground plane under gaze stabilisation. This has two components: (a) the structure of the retinal flow and the utility of gaze stabilisation, and (b) ways to recover information about self-motion from the retinal flow. Both aspects have a long history of research that is neglected in the present manuscript. The essential circular structure of the retinal flow during gaze stabilisation is long known (Warren and Hannon, 1990, van den Berg, 1996, Lappe et al., 1998, Lappe et al. 1999). Detailed analyses of the statistical structure of retinal flow during gaze stabilisation have shown the impact and utility of gaze stabilisation (Calow et al., 2004; Calow and Lappe, 2007; Roth and Black, 2007) and provided links to properties of neurons in the visual system (Calow and Lappe, 2008). These studies included simulated motions of the head during walking, as in the current manuscript, and extended to natural scenes other than a simple ground plane.

      Given the structure of the retinal flow during gaze stabilisation the central question is how to recover information about self-motion from it. The authors investigate a proposal originally made by Koenderink and van Doorn (1976; 1984) that relies on estimates of curl and divergence in the visual field. They propose that locomotor heading may be determined directly in retinotopic coordinates (l. 314). This is true, but it fails to mention that other models of heading perception during gaze stabilisation similarly determine heading in retinotopic coordinates (e.g. Lappe and Rauschecker, 1993; Perrone and Stone, 1994; Royden, 1997). In fact, as outlined above, the mathematical problem of self-motion estimation is typically presented in retinal (or camera) coordinates (e.g. Longuet-Higgins and Prazdny, 1980). The problem with the divergence model in comparison to the other models above is threefold. First, it really only works for a plane, not in other environments. Second, it requires a local estimate of divergence at each position in the visual field. The alternative models above combine information across the visual field and are therefore much more robust against noise in the flow. One would need to see whether the estimate of the divergence distribution is sufficient to work with the natural flow fields. Third, being a local measure it requires a dense flow field while heading estimation from retinal flow is known to work with sparse flow fields (Warren and Hannon, 1990). Thus, the theoretical part of the manuscript should either provide proof that the maximum of divergence is superior to these other models or broaden the view to include these models as possibilities to estimate self motion from retinal flow.

      The case is similar for the use of curl. It is true that the rotational or spiral pattern around the fovea in retinal flow provides information about the direction of self motion with respect to the direction of gaze, as has been noted many times before. This structure is used by many models of heading estimation. However, curl is, like divergence, a local property and thus not as robust as models that use the entire flow field. It may be interesting to note that neurons in optic flow responsive areas of the monkey brain can pick up this rotational pattern and respond to it in consistency with their preference for self-motion across a plane (Bremmer et al., 2010; Kaminiarz et al. 2014).

      I think what the authors may want to draw more attention to is the dynamics of the retinal flow and the associated self-motion in retinal (or plane projection) coordinates. The movies provide compelling illustrations of how the direction of heading (or the divergence maximum, if you want to focus on that) sways back and forth on the retina and on the plane with each step. This requires that the analysis of retinal flow (and the estimation of self-motion) has to be fast and dynamic, or maybe should include some form of temporal prediction or filtering. Work on the dynamics of retinal flow perception has indeed shown that heading estimation can work with very brief flow fields (Bremmer et al. 2017), that the brain focuses on instantaneous flow fields (Paolini et al. 2000) and that short presentations sometime provide better heading estimates than long presentations (Grigo and Lappe, 1999). The temporal dynamics of retinal flow is an underappreciated problem that could be more in the focus of the present study.

      Additional specific comments:

      Footnote on page 2: It is not only VOR but also OKN (Lappe et al., 1998, Niemann et al., 1999) that stabilises gaze in optic flow fields.

      Line 55: Natural translation and acceleration patterns of the head have been considered by (Cutting et al., 1992; Palmisano et al. 2000; Calow and Lappe, 2007, 2008; Bossard et al., 2016)

      Line 59: The statement is misleading that the key assumption behind work on the rotation problem is that the removal of the rotational component of flow will return a translational flow field with a stable FoE. Only one class of models, those using differential motion parallax (Rieger and Lawton, 1985, Royden, 1997) explicitly constructs a translational flow field and aims to locate the FoE in that field. Other models (Koenderink and van Doorn, 1976, 1984; Lappe and Rauschecker, 1993; Perrone and Stone, 1994) do not subtract the rotation but estimate heading in retinal coordinates from the combined retinal flow. This also applies to line 109.

      Last paragraph on page 5: Measures of eye movement during walking in natural terrain were also taken by Calow and Lappe (2008) and 't Hart and Einhäuser (2012).

      Lines 140 to 163: This paragraph is problematic and misleading as pointed out before.

      Line 193: The lack of stability is expected, as outlined above. The use of a straight line motion in psychophysical experiments reflects an experimental choice to investigate the rotation problem in retinal flow, not an implicit assumption that bodily motion is usually along a straight line.

      Line 200: That gaze stabilization may be an important component in understanding the use of optic flow patterns has also long been assumed (Lappe and Rauschecker, 1993; 1994; 1995; Perrone and Stone, 1994; Glennerster et al. 2001; Angelaki and Hess, 2005; Pauwels et al., 2007).

      Line 314: Locomotor heading may be determined directly in retinotopic coordinates. Yes, and this is precisely what the above mentioned models do.

      Line 334: What is meant by "robust" here? The videos seem to show simulated flow for a ground plane, not the real flow from any of the terrains. It is not clear whether the features can be extracted from the real terrain retinal flow.

      First paragraph on page 15: This is an important discussion about the dynamics of retinal flow in conjunction with the dynamics of the gait cycle. It should be expanded and better balanced with respect to previous work and other models. It is true that any simple inference of an FoE would not work. However, models that estimate heading (not FoE) in the retinal reference frame would be consistent with the discussion. Oscillations of the head during walking affect the location of the divergence maximum and curl as much as the direction of heading in retinal coordinates. In fact, the videos nicely show how these variables oscillate with each step. This applies to all retinal flow analyses, and is a problem for any model. It requires a dynamical analysis. The speed of neural computations is an issue, of course, but it applies to divergence and curl in the same way as to other models. There is some indication, however, that neural computations on optic flow are fast, deal with instantaneous flow fields, and respond consistently to natural (spiral) retinal flow, as described above.

      Line 393: This paragraph is misleading in suggesting that naturally occurring flow fields have not been used in psychophysical and electrophysiological experiments.

      Line 516: This has been done by Bremmer et al. (2010) and Kaminiarz et al. (2014). Their results are consistent with computing heading directly in a retinal reference frame as predicted by several models of retinal flow analysis (e.g. Lappe et al. 1999).

      References:

      Angelaki, D. E. and Hess, B. J. M. (2005). Self-motion-induced eye movements: effects an visual acuity and navigation. Nat. Rev. Neurosci., 6:966-976.

      Bossard, M., Goulon, C., and Mestre, D. R. (2016). Viewpoint oscillation improves the perception of distance travelled based on optic flow. J Vis, 16(15):4.

      Bremmer, F., Kubischik, M., Pekel, M., Hoffmann, K. P., and Lappe, M. (2010). Visual selectivity for heading in monkey area MST. Exp. Brain Res., 200(1):51-60.

      Calow, D., Krüger, N., Wörgötter, F., and Lappe, M. (2004). Statistics of optic flow for self-motion through natural scenes. In Ilg, U., Bülthoff, H. H., and Mallot, H. A., editors, Dynamic Perception, Workshop of the GI Section 'Computer Vision', pages 133-138, Berlin. Akademische Verlagsgesellschaft Aka GmbH.

      Calow, D. and Lappe, M. (2007). Local statistics of retinal optic flow for self- motion through natural sceneries. Network, 18(4):343-374.

      Calow, D. and Lappe, M. (2008). Efficient encoding of natural optic flow. Network Comput. Neural Syst., 19(3):183-212.

      Cutting, J. E., Springer, K., Braren, P. A., and Johnson, S. H. (1992). Wayfinding on foot from information in retinal, not optical, flow. J. Exp. Psychol. Gen., 121(1):41-72.

      Grigo, A. and Lappe, M. (1999). Dynamical use of different sources of information in heading judgments from retinal flow. JOSA A, 16(9):2079-2091.

      't Hart, B. M. and Einhäuser, W. (2012). Mind the step: complementary effects of an implicit task on eye and head movements in real-life gaze allocation. Exp. Brain Res., 223(2):233-249.

      Kaminiarz, A., Schlack, A., Hoffmann, K.-P., Lappe, M., and Bremmer, F. (2014). Visual selectivity for heading in the macaque ventral intraparietal area. J. Neurophys. 112(10):2470-80

      Lappe, M., Pekel, M., and Hoffmann, K. P. (1998). Optokinetic eye movements elicited by radial optic flow in the macaque monkey. J. Neurophysiol., 79(3):1461-1480.

      Lappe, M. and Rauschecker, J. P. (1993). A neural network for the processing of optic flow from ego-motion in man and higher mammals. Neural Comp., 5(3):374-391.

      Lappe, M. and Rauschecker, J. P. (1994). Heading detection from optic flow. Nature, 369(6483):712-713.

      Lappe, M. and Rauschecker, J. P. (1995). Motion anisotropies and heading detection. Biol. Cybern., 72(3):261-277.

      Niemann, T., Lappe, M., Büscher, A., and Hoffmann, K. P. (1999). Ocular responses to radial optic flow and single accelerated targets in humans. Vision Res., 39(7):1359-1371.

      Pauwels, K., Lappe, M., and Hulle, M. M. (2007). Fixation as a mechanism for stabilization of short image sequences. Int. J. Comp. Vis., 72(1):67-78.

      Perrone, J. A. and Stone, L. S. (1994). A model of self-motion estimation within primate extrastriate visual cortex. Vision Res., 34(21):2917-2938.

      Regan, D. and Beverley, K. I. (1982). How do we avoid confounding the direction we are looking and the direction we are moving? Science, 215:194-196.

      Rieger, J. H. and Lawton, D. T. (1985). Processing differential image motion. J. Opt. Soc. Am. A, 2(2):354-360.

      Roth, S. and Black, M. J. (2007). On the spatial statistics of optical flow. Int. J. Comp. Vis., 74(1):33-50.

      Royden, C. S. (1997). Mathematical analysis of motion-opponent mechanisms used in the determination of heading and depth. J. Opt. Soc. Am. A, 14(9):2128-2143.

      van den Berg, A. V. (1996). Judgements of heading. Vision Res., 36(15):2337-2350.

      van den Berg, A. V. and Beintema, J. A. (1997). Motion templates with eye velocity gain fields for transformation of retinal to head centric flow. NeuroReport, 8(4):835-840.

    2. Reviewer #2:

      The manuscript by Matthis et. al. nicely measures both the visual scene and eye, body, and head kinematics during natural locomotion. The authors propose that certain features of optic flow as observed at the retina might be useful to guide locomotion. The data are a natural follow-up to earlier work from the same group that examined patterns of gaze during locomotion across different terrains. Taken together, the work here is a fine extension of the earlier paper, suggesting an interesting perspective on the way visual information could be processed to facilitate locomotion. Unfortunately, these findings are framed in the manuscript as if they overturn a dogma about the use of the head-centered Focus of Expansion (192-195, 397-399, 440). I found this argument to be quite confusing and insufficiently supported. As a result it was hard to evaluate the impact of this work.

      The authors find that one cannot extract a useful flow-field from a head-mounted camera (section 2,153-159). The literature cited doesn't claim that it would be, and given the familiarity with the VOR, I wouldn't expect it to. I was further confused by the fact that the authors could extract a useful FoE from drone video -- a clever calibration of their analysis! As a (mediocre) drone pilot, I know that the gimbal uses pitch/yaw/roll acceleration to stabilize a camera relative to the drone body at an angle defined by the user. If the authors can extract an FoE from such footage then certainly when the VOR does the same stabilization for the eye a similar computation ought obtain (contra 52-53). Furthermore, it is well-established that the oculomotor system provides a veridical estimate of eye-in-orbit to the rest of the brain: wouldn't this be the final component necessary to transform retinal flow into "head-centered FoE." There is considerable work that proposes solutions to understand the transformation from retinal coordinates to body-centered coordinates. The manuscript would benefit from consideration of these issues.

      None of this is to say that curl as computed at the fovea isn't useful for locomotion. To that point, the authors might find Oteiza et. al. Nature 2017 https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5873946/ interesting as an example of another sensory system that uses curl as a cue for navigation. Notably, though, the manuscript doesn't even establish that it is, only that it might be. Optic flow fields generate a strong percept of self-motion, and they have been used to study perception or the neural correlates thereof. It isn't clear that the work here truly speaks to those findings, much less overturn their foundation.

    3. Reviewer #1:

      The study of how optic flow guides perception and action dated back to the 1950s and drew inspiration from pilots flying planes and birds gliding in the sky. These relatively constant-speed translational motions are different from what humans do every day, which is walking. Nevertheless, it is often assumed that laboratory findings using stimuli simulating smooth translational self-motion can be generalized to locomotive optic flow processing. In this paper, the authors directly challenge this assumption by investigating the structure of flow during natural locomotion, using simultaneous recordings of eye and body movements and the participants' view during walking. Their findings call for attention to reconsider assumptions about optic flow processing during natural locomotion, including the role of stabilizing eye movements.

      One of the most substantial contributions this paper makes is the careful characterization of the structure of flow in a naturalistic context, in terms of both the behavior involved and the environment in which the behavior occurs. The dataset is rich, challenging to come by, and complex to process. I applaud the authors' efforts to describe and contextualize the observed patterns. I am convinced about most claims made in the paper, with specific concerns and ideas to strengthen them as elaborated below. This work can have a significant impact as it is relevant not only to researchers studying vision and action in naturalistic contexts but also to researchers who translate basic science knowledge to advance real-life simulation (e.g., virtual reality, simulators, rehabilitation).

      Major Comments:

      1) A key finding from this paper is that the focus-of-expansion (FoE), a cue to heading direction, is highly variable in head-centered flow without considering eye movements. Although I am convinced about the variability of FoE velocity in head-centered optic flow based on the results reported by the authors, I see the potentials to strengthen the interpretation of this finding. The authors attribute the instability of the FoE to head motion during natural locomotion by showing the distribution of FoE velocities (Fig. 2) and the changes in head velocity as a function of % step (from one heel strike to the next, Fig. 3), respectively. More direct evidence to show this link would be that the FOE velocity changes as a function of % step, resembling patterns shown in Figure 3. Is this the case? I believe this result, if true, will strengthen the authors' claim.

      2) The instability of the FoE is contrasted against the stability of the retinal flow, as illustrated in Figure 2. The authors did not characterize eye movements used to achieve this stabilization and only briefly introduced vestibular ocular reflex (p. 2, line 21; Fig. 1 caption). While it might be beyond the scope of this paper to characterize these eye movements, it will be appropriate to include literature on how eye movements respond to laboratory optic flow stimulus (e.g., Knöll, Pillow & Huk, 2018; Niemann, Lappe, Büscher & Hoffmann, 1999). This literature provides a link between the eyes-fixed laboratory studies cited by the authors and the eyes-free naturalistic setting adopted in this paper.

      3) The other key finding is that retinal flow contains simple geometric features (curl, divergence) corresponding with the direction of heading relative to the fovea. The authors proposed that these cues could be used to determine the heading direction. This idea that there are visual cues alternative to FoE for heading direction guiding and perception is not new, as the authors have adequately cited previous studies suggesting so. Nonetheless, it is crucial to distinguish between speculation and empirical evidence showing the role of these cues. This paper has not demonstrated that participants can determine heading direction using these cues alone, or that the curl/divergence cues affect participants' behavior. The lack of an empirical test for these cues is concerning when combined with some statements that can be interpreted as it has been done. For example, on p.5 lines 105-110, the authors wrote: 'We show that this structure of fixation-mediated retinal optic flow provides a rich and robust source of information that is directly relevant to locomotor control without the need to subtract out or correct for the effects of eye rotations' and on p. 14 lines 347-349: 'We found that a walker can determine whether they will pass to the left or right of their fixation point by observing the sign and magnitude of the curl of the flow field at the fovea.' If the roles of these cues on behavior can be demonstrated from the data (e.g., by correlating simulated retinal flow cues and kinematic data), I recommend adding this analysis to support the authors' claim. Otherwise, I think all statements related to this claim (not exclusive to ones listed here) should be checked and altered.

      References:

      Knöll, J., Pillow, J. W., & Huk, A. C. (2018). Lawful tracking of visual motion in humans, macaques, and marmosets in a naturalistic, continuous, and untrained behavioral context. Proceedings of the National Academy of Sciences, 115(44), E10486-E10494. https://doi.org/10.1073/pnas.1807192115

      Niemann, T., Lappe, M., Büscher, A., & Hoffmann, K.-P. (1999). Ocular responses to radial optic flow and single accelerated targets in humans. Vision Research, 39(7), 1359-1371. https://doi.org/10.1016/S0042-6989(98)00236-3

    4. Preprint Review

      This preprint was reviewed using eLife’s Preprint Review service, which provides public peer reviews of manuscripts posted on bioRxiv for the benefit of the authors, readers, potential readers, and others interested in our assessment of the work. This review applies only to version 4 of the manuscript. Miriam Spering (University of British Columbia) served as the Reviewing Editor for this submission.

      Summary:

      Your work is based on a fascinating and rich dataset with great potential. There was general agreement on the value of these data, and on the thoroughness with which the data were collected and preprocessed. Your approach of exploring how gait-induced instabilities of the head and terrain-dependent eye movements during natural locomotion will shape retinal optic flow is important and addresses an obvious gap in the literature. It also has the potential to merge knowledge across subfields (motion processing, eye movements, locomotion). However, there are several theoretical limitations that we believe cannot be fully addressed with the current dataset, even if the manuscript was rewritten entirely, as highlighted in the reviews below.

      1) The suggestion to use curl and divergence of the retinal flow for the control of self-motion is interesting, but it is insufficiently demonstrated as a valid strategy for the visual system (and alternatives are not considered). The reviewers briefly discussed whether conducting a correlational analysis between the sign/magnitude of cues and the participants' movement at a future timepoint based on the existing data might address this issue, but the more general concern here is that any such analysis might perpetuate the (wrong) idea that these cues are used in the visual system. The seminal paper by Warren and Hannon (1990) has taken a good look at this proposal and essentially refuted it on the grounds mentioned by Reviewer 3. Their arguments still stand and not much has been made of the divergence maximum since. A more encompassing view is needed to look in general at cues that predict instantaneous heading in the retinal reference frame. Another solution could be an analysis of the dynamics of retinal heading as produced by the locomotor cycle. Then, it might be possible to provide some constraints on necessary dynamics of any of the possible algorithms for retinal flow analysis.

      2) The case against the use of the head-centric FoE is valid but presented in a confusing (and possibly misleading/exaggerated) fashion. The data presented do not appear to provide sufficient evidence to overturn the idea that the FoE is not used to control heading during locomotion.

      3) The role of stabilizing eye movements on retinal flow is insufficiently discussed. Along the same lines, the purpose of the different experimental manipulations that presumably trigger significantly different eye movement patterns is never fully elaborated. It seems that there is a missed opportunity here to take a more hypothesis-guided rather than exploratory approach.

  5. Oct 2020
    1. Reviewer #3:

      The Suv39 class of methyl transferases are responsible for establishment and maintenance of constitutive heterochromatin via the deposition of H3K9me2/me3 marks. Clr4 is the sole H3K9me2/me3 HMTase in the fission yeast S. pombe and is part of the E3 ubiquitin ligase CLRC complex. It has been shown recently that CLRC mediates the ubiquitylation of H3K14 residue which in turn boosts the methyl transferase activity of Clr4 . A region C-terminal to the chromo domain (aa 63-127) was also shown to be required to bind Ubiquitin and provide specificity for ubiquitylated H3K14 relative to unmodified H3 (Oya et al 2019 EMBO Rep. 2019 20:e48111).

      Here the authors further explore crosstalk between Clr4 activity and H3K14Ub. They do this via a structure-function approach employing a range of structural methods combined with in vivo assays. The primary finding here is that the presence of H3K14ub on histone H3 enhances Clr4 methyltransferase activity and this H3K14ub sensing region resides within the KMT methyltransferase domain itself (aa 192-490) not the aa 63-127 region as previously reported.

      The authors further identify regions within this domain that are responsible for H3K14ub binding and Clr4 mutants which abrogate this interaction. These Clr4 mutants display dramatically reduced activity towards ubiquitylated peptide substrates. In vivo tests show that the same mutants exhibit silencing defects associated with almost a complete loss of H3K9me2/me3 from centromeric heterochromatin. Additionally, the authors show that H3K14ub sensing also appears to operate within the KMT domain of human SUV39H2 but not human G9a or Arabidopsis SUVH4.<br> Thus the key differences here from the Oya et al. 2019 study are the structural approaches employed and that Ubiquitin is sensed by the KMT methyltransferase domain itself without the previously identified Ubiquitin binding region in (aa 63-127). The authors offer a reasonable explanation for this discrepancy.

      Additional analyses would perhaps help to strengthen their conclusions.

      Major Points:

      1) The relevance of the proposed mechanism in a cellular chromatin context is unclear. A significant fraction of H3K9me2/3 nucleosomes isolated from cells should also carry H3K14ub in cis. How frequently do K9Me2/3 and K14ub co-occur on nucleosomes in heterochromatin regions? This could be explored by westerns with anti-H3K9me2 and or me3 - a mobility shift equivalent to monoubiquitylation should be visible.

      2) The authors should consider including mutant peptide controls such as H3K9RK14ub to make sure what is detected here is indeed H3K9 methylation. Additionally, a completely unrelated substrate such as a ubiquitylated H4 N-terminal peptide could be used in the methyltransferase assays to strengthen the author's claims of specificity.

      3) The IP-western (Fig. 4C) shows association of Clr4 proteins with the Rik1, suggesting that they are incorporated into the CLRC complex. However, a more rigorous test would be to analyze these IPs by mass spectrometry to determine if the Clr4 GS253 and F3A mutant proteins are indeed assembled into a CLRC complex containing the other components.

      4) The Clr4-F3A mutant appears to have a differential effect on the level of transcript generation from the dg and dh regions of centromeric repeats. For completeness ChIP-qPCR data should be included for both the dg and dh regions (currently only dh is assayed Fig 4 E) to determine if a difference is also detected.

      5) Are similar structural features found in the SUV39H2 KMT domain to those shown for Clr4 (Fig 5C) that would also allow ubiquitin to dock? Does computational comparison between Suv39H2, Clr4, G9a and SUVH4 provide insight into similarities/differences?

    2. Reviewer #2:

      In this manuscript Stirpe and colleagues describe structural insight into a novel regulation mechanism of SUV39 class histone methyltransferases. Clr4 is the sole SUV39-family H3K9me2/3 methyltransferase in fission yeast and recent evidence suggests that ubiquitylation of lysine 14 on histone H3 (H3K14ub) plays a key role in H3K9 methylation. To understand the molecular mechanisms of this regulation, the authors first set up in vitro assay system and demonstrate that H3K14ub promotes Clr4 methyltransferase activity and that the catalytic domain of Clr4 senses the presence of H3K14-linked ubiquitin. The authors then performed hydrogen/deuterium exchange coupled to mass spectrometry analysis and show that ubiquitin moiety binds to a region involving residues 243-261 of Clr4. Using this information, they further show that Clr4 mutants containing amino-acid substitutions in the ubiquitin binding region lose affinity for H3K14ub. The authors also demonstrate that fission yeast strains expressing mutant Clr4 display silencing defects and lose heterochromatic H3K9me2/3. Finally, the authors demonstrate that H3K14ub also stimulates the enzymatic activity of mammalian SUV39H2.

      Comments:

      This is an excellent paper that provides structural insights into how H3K14ub stimulates Clr4 methyltransferase activity. The results presented are of high quality and convincingly controlled. The paper is carefully written, and the conclusions presented are fully supported by the data included. The results described are of high interest to the field of heterochromatin and crosstalk of histone marks. However, the following points should be addressed by the authors.

      Major points:

      Is the H3K14ub-mediated stimulation a shared property of SUV39 class methyltransferases? This is a quite important question considering the mechanisms underlying heterochromatin assembly in eukaryotic cells. While the authors demonstrate that SUV39H2's enzymatic activity is stimulated by H3K14u (Fig. 5A), it would be interesting to test whether the activity of SUV39H1, the other mammalian Su(var)3-9 homologue, is also stimulated by the presence of H3K14ub.

    3. Reviewer #1:

      H3K14ub is a histone modification that facilitates deposition of H3K9me on heterochromatin in fission yeast, but the mechanism by which this modification stimulates Clr4 was unknown. Using mutants and HDX, the authors identified the interaction surface of Clr4 for H3K14ub, which they used to design mutants that responded poorly to H3K14ub stimulation. In vivo, these mutations resulted in loss of heterochromatin marks and defects in heterochromatin-based silencing, suggesting that H3K14ub stimulation is essential to K9me-mediated silencing. Finally, the authors show that human SUV39H2 but not G9a or Arabidopsis SUVH4 can be stimulated by H3K14ub in a similar manner.

      The authors provided biochemical and structural insights into the mechanism that increases the H3K9-specific methyltransferase activity of Clr4 by H3K14ub. Although H3K14ub-mediated promotion of H3K9 methylation is shown in Oya et al. EMBO Rep 2019, this study further characterizes the potential mechanism. However, there are some issues with the results that need to be resolved.

      1) Similarity and difference with the previous study. As the authors acknowledge, this manuscript builds on a previous study by Oya et al. 2019, however I think the similarities and the differences need to be made even more explicit and better addressed.

      a) The authors should clearly state that Figure 1B and 1C are basically a confirmation of Oya et al. 2019.

      b) I am more puzzled by the difference in the mapping of the region required for H3K14ub stimulation. The authors suggest that a difference in the preparation of the recombinant proteins might be responsible. This can and should be tested as it would seemingly be a simple experiment (compare with and without GST tag).

      c) Possibly to reconcile their findings with the previous report the authors state in the description of Fig. 1 that "the N-terminus plays a regulatory role in the sensing of H3K14ub by the catalytic domain" but I don't see this reflected in the data show in Fig. 1C, given that the degree of stimulation is very similar for KMT and FL.

      2) Stimulation-defective mutants. The authors should carefully discuss the stimulation-defective mutants, which should be premised on the retention of their methyltransferase activity on unmodified H3. The authors claim that 30% loss of activity of the Clr4 KMT mutants on unmodified H3 is observed in Figure S3C (Pg 11 line 15), but this cannot be determined from the graph provided, which is normalized to unmodified H3. The authors should (1) make another graph to show the 30% loss and (2) compare Clr4 KMT mutants with catalytic-dead Clr4 KMT or dissolution buffer (no protein). It is still possible that GS253 and F3A mutations simply reduce MTase activity, thus displaying lower activity than WT in the presence of H3K14ub, which would also suggest a different interpretation for the results in vivo.

      3) Heterochromatin localization of Clr4 mutants. The FLAG ChIP results in Fig. 4E is not very informative, as with the loss of heterochromatin a loss of Clr4 is predicted. If the authors want to test whether the localization activity of Clr4 mutants is intact, (1) FLAG ChIP in the clr4+, Flag-Clr4GS253/F3A background (i.e., two clr4 alleles exist) or (2) in vitro H3K9me2/3 binding assay should be performed. Since Clr4 N-terminus might regulate MTase activity as discussed in Pg 18 line 19, it is also possible that amino acid substitutions in the KMT region affect the function of N-terminus, including CD. The co-IP in Fig. 4C is not sufficient to clarify this point as Clr4 directly binds heterochromatin via its CD, in addition to the CLRC-mediated mechanism, and it is unclear if this is affected in the mutants.

      4) Allosteric vs. binding regulation. On Pg. 11, the authors suggest that an allosteric mechanism is at play, but this is not supported by the data. In fact the observation that providing ubiquitin in trans does not stimulate and rather inhibits the activity on H3K14ub would suggest that the ubiquitin just increases binding affinity. To clarify this the authors should measure binding affinity of WT and mutants to the H3 peptide with and without ubiquitin.

    4. Preprint Review

      This preprint was reviewed using eLife’s Preprint Review service, which provides public peer reviews of manuscripts posted on bioRxiv for the benefit of the authors, readers, potential readers, and others interested in our assessment of the work. This review applies only to version 2 of the manuscript.

      Summary:

      Based on the reviews and following discussion, the editors have judged your manuscript of interest but think that additional experiments are required. We also think that several of the other points made by the reviewers might help you strengthen this manuscript and encourage you to consider addressing them if possible.

      Essential Points:

      1) Additional support for the claim that the mutants are only (or mostly) impaired in the ubiquitin binding activity. This is key for the proper interpretation of the in vivo data. As suggested by the reviewers, this could entail (but is not limited to) a better quantification or presentation of enzymatic activity (absolute instead of fold-change in stimulation), additional characterization of interacting proteins by mass spec, localization of the mutants to chromatin in a wild-type context.

      2) Clarification of allostery vs. changes in binding affinities (Rev 1, point 4) ideally including measurements for the binding affinity of WT and mutants to the H3 peptide with and without ubiquitin.

      3) Better characterization of silencing defects: ChIP-qPCR data should be included for both the dg and dh regions across mutants (Rev 3, point 4).

      4) Analysis of the conservation of structural features in SUV34H2 (Rev 3 point 5)

    1. Reviewer #3:

      Non-alcoholic fatty liver disease is a growing health issue worldwide. The pathogenesis and mechanism causing the disease are poorly understood. As the authors state correctly, unravelling mechanistic details of liver lipid metabolism is extremely important yet also technically very challenging. This report aimed at defining the role and mechanism of action of HILPDA in liver cells. The presented paper shows very interesting aspects on the role of HILPDA and brings novel concepts into the field and, as such, has extremely high potential. An overwhelming amount of data is shown that leads to development of the story. However, in the current form, the novel mechanism as outlined from the title has not been worked out with sufficient detail.

      1) de la Rosa Rodriguez et al. claim that 'The increase of DGAT1 activity via HILPDA is a novel mechanism that links elevated fatty acid levels to stimulation of triglyceride synthesis and storage in hepatocytes." Experiments correlate HILPDA with DGATs, e.g. upregulation of HILPDA in NASH, overexpression of HILPDA correlating with increase of DGAT1 levels, localization studies demonstrating colocalization of HILPDA with DGAT1 and DGAT2. As experienced in previous HILPDA studies, many effects are modest (e.g. decrease of TG in mice liver with NASH upon deletion of HILPDA, changes in plasma ALT levels).

      2) As the authors correctly state in their results section, the presented data suggest that HILPDA promotes lipid storage at least partly via an ATGL-independent mechanism. Fig 3 also indicates different sized individual lipid droplets comparing Atglistatin treatment, even though the total LD area might differ significantly.

      3) HILPDA is associated with increased DGAT activity, the suggested mechanism behind it (transcriptional activation?) is not described sufficiently. DGAT1 activity decreases FA-levels and as such would back in down-regulation HILPDA expression. To support the very interesting and very strong claim that DGAT1 is increased by direct interaction with HILPDA, this should be shown in vitro.