SciScore for 10.1101/2021.04.07.21253850: (What is this?)
Please note, not all rigor criteria are appropriate for all manuscripts.
Table 1: Rigor
<table><tr><td style="min-width:100px;margin-right:1em; border-right:1px solid lightgray; border-bottom:1px solid lightgray">Institutional Review Board Statement</td><td style="min-width:100px;border-bottom:1px solid lightgray">IRB: The protocols and informed consents were approved by the institutional review board of JPCDC.<br>Consent: Written informed consent from all participants was obtained before screening for eligibility.</td></tr><tr><td style="min-width:100px;margin-right:1em; border-right:1px solid lightgray; border-bottom:1px solid lightgray">Randomization</td><td style="min-width:100px;border-bottom:1px solid lightgray">Study design and participants: Both the phase 1 and phase 2 trials of KCONVAC were randomized, double-blind, and placebo-controlled studies and conducted in succession by Jiangsu Provincial Center for Disease Control and Prevention (JPCDC) beginning from Oct 2020.</td></tr><tr><td style="min-width:100px;margin-right:1em; border-right:1px solid lightgray; border-bottom:1px solid lightgray">Blinding</td><td style="min-width:100px;border-bottom:1px solid lightgray">The experimental vaccines and placebo were blindly labelled with a randomisation number on each vial as the only identifiers.</td></tr><tr><td style="min-width:100px;margin-right:1em; border-right:1px solid lightgray; border-bottom:1px solid lightgray">Power Analysis</td><td style="min-width:100px;border-bottom:1px solid lightgray">Statistical analysis: The sample size for the phase 1 trial was not determined on the basis of statistical power calculations but in line with the guidance issued by NMPA for phase 1 vaccine trial.</td></tr><tr><td style="min-width:100px;margin-right:1em; border-right:1px solid lightgray; border-bottom:1px solid lightgray">Sex as a biological variable</td><td style="min-width:100px;border-bottom:1px solid lightgray">Pregnant or breastfeeding women were excluded.</td></tr><tr><td style="min-width:100px;margin-right:1em; border-right:1px solid lightgray; border-bottom:1px solid lightgray">Cell Line Authentication</td><td style="min-width:100px;border-bottom:1px solid lightgray">not detected.</td></tr></table>Table 2: Resources
<table><tr><th style="min-width:100px;text-align:center; padding-top:4px;" colspan="2">Antibodies</th></tr><tr><td style="min-width:100px;text=align:center">Sentences</td><td style="min-width:100px;text-align:center">Resources</td></tr><tr><td style="min-width:100px;vertical-align:top;border-bottom:1px solid lightgray">Antibody level of RBD-IgG subtypes including IgG1, IgG2, IgG3, IgG4 and antibody response to nucleoprotein of SARS-CoV-2 were determined by ELISA on Day 0, Day 14, Day 28 and Day 42.</td><td style="min-width:100px;border-bottom:1px solid lightgray"><div style="margin-bottom:8px"><div>IgG2</div><div>suggested: (George Fu Gao; Chinese Academy of Sciences; Beijing; China Cat# Z3L1, RRID:AB_2725798)</div></div><div style="margin-bottom:8px"><div>IgG3, IgG4</div><div>suggested: (George Fu Gao; Chinese Academy of Sciences; Beijing; China Cat# Z3L1, RRID:AB_2725798)</div></div></td></tr><tr><th style="min-width:100px;text-align:center; padding-top:4px;" colspan="2">Experimental Models: Cell Lines</th></tr><tr><td style="min-width:100px;text=align:center">Sentences</td><td style="min-width:100px;text-align:center">Resources</td></tr><tr><td style="min-width:100px;vertical-align:top;border-bottom:1px solid lightgray">The SARS-CoV-2 virus strain CQ01 was inoculated in Vero cell for cultivation.</td><td style="min-width:100px;border-bottom:1px solid lightgray"><div style="margin-bottom:8px"><div>Vero</div><div>suggested: CLS Cat# 605372/p622_VERO, RRID:CVCL_0059)</div></div></td></tr></table>
Results from OddPub: We did not detect open data. We also did not detect open code. Researchers are encouraged to share open data when possible (see Nature blog).
Results from LimitationRecognizer: We detected the following sentences addressing limitations in the study:One limitation for this preliminary analysis is that we don’t include the safety and immunogenicity data of KCONVAC in elder adults who are at higher risk to COVID-19. These population are included in our protocol and will be the target in our ongoing studies. The second limitation is that the study duration of the trials is relative short, i.e., 28 days post the second dose. Therefore, long-term safety profile and antibody persistence are not in the scope of this preliminary analysis. Our ongoing studies and the upcoming phase 3 efficacy trial will be able to include these objectives. The third limitation is that we used ELISA instead of ELISpot to test the cytokines other than IFNγ and collected blood samples only once between the first and second doses. Therefore we could not get an overall profile of the cell response. The reason for using ELISA and this sampling schedule was that we intended to observe the safety only through the serum cytokines, and considered that inactivated virus vaccine might show weak cellular response. In conclusion, our two trials demonstrate that KCONVAC is well tolerated and able to induce robust antibody response and cellular response in adults aged 18 to 59 years, which warrants further evaluation with this vaccine in the upcoming phase 3 efficacy trial.
Results from TrialIdentifier: We found the following clinical trial numbers in your paper:<br><table><td style="min-width:95px; border-right:1px solid lightgray; border-bottom:1px solid lightgray">Identifier</td><td style="min-width:95px; border-right:1px solid lightgray; border-bottom:1px solid lightgray">Status</td><td style="min-width:95px; border-right:1px solid lightgray; border-bottom:1px solid lightgray">Title</td></tr><tr><td style="min-width:95px; border-right:1px solid lightgray; border-bottom:1px solid lightgray">NCT04758273</td><td style="min-width:95px; border-right:1px solid lightgray; border-bottom:1px solid lightgray">Active, not recruiting</td><td style="min-width:95px; border-right:1px solid lightgray; border-bottom:1px solid lightgray">A Safety and Immunogenicity Study of Inactivated SARS-CoV-2 …</td></tr><tr><td style="min-width:95px; border-right:1px solid lightgray; border-bottom:1px solid lightgray">NCT04756323</td><td style="min-width:95px; border-right:1px solid lightgray; border-bottom:1px solid lightgray">Active, not recruiting</td><td style="min-width:95px; border-right:1px solid lightgray; border-bottom:1px solid lightgray">A Study to Evaluate Safety and Immunogenicity of Inactivated…</td></tr></table>
Results from Barzooka: We found bar graphs of continuous data. We recommend replacing bar graphs with more informative graphics, as many different datasets can lead to the same bar graph. The actual data may suggest different conclusions from the summary statistics. For more information, please see Weissgerber et al (2015).
Results from JetFighter: We did not find any issues relating to colormaps.
Results from rtransparent: - Thank you for including a conflict of interest statement. Authors are encouraged to include this statement when submitting to a journal.
- Thank you for including a funding statement. Authors are encouraged to include this statement when submitting to a journal.
- No protocol registration statement was detected.
<footer>About SciScore
SciScore is an automated tool that is designed to assist expert reviewers by finding and presenting formulaic information scattered throughout a paper in a standard, easy to digest format. SciScore checks for the presence and correctness of RRIDs (research resource identifiers), and for rigor criteria such as sex and investigator blinding. For details on the theoretical underpinning of rigor criteria and the tools shown here, including references cited, please follow this link.
</footer>