Two unrelated experiments made it challenging for us to reproduce the issue at first: an internal-only server-side experiment related to message queuing; and an orthogonal change in how we display thinking suppressed this bug in most CLI sessions
大多数人认为复杂的系统测试流程应该能够发现大多数关键缺陷，但作者展示了即使有多重测试机制，两个看似无关的实验如何协同掩盖了一个严重bug。这挑战了'全面测试能保证产品质量'的传统认知，揭示了系统复杂性带来的意外风险。
Major COVID course correction immediately required. (n.d.). Retrieved February 7, 2022, from https://ozsage.org/media_releases/major-covid-course-correction-immediately-required/
“System tests” is a common naming for automated end-to-end tests in the Rails world. Before Rails adopted this name, we used such variations as feature tests, browser tests
A system test is often better than an integration test that is stubbing a lot of internals.
White-box tests at the system level (formerly known as System / Feature tests)
Black-box tests at the system level (aka end-to-end or QA tests)
White-box tests at the system level (aka system or feature tests)
Tan, Steph H., Orchid Allicock, Mari Armstrong-Hough, and Anne L. Wyllie. ‘Saliva as a Gold-Standard Sample for SARS-CoV-2 Detection’. The Lancet Respiratory Medicine 0, no. 0 (19 April 2021). https://doi.org/10.1016/S2213-2600(21)00178-8.
Page, M. L. (n.d.). Should you pay for a coronavirus test? Here’s what you need to know. New Scientist. Retrieved June 20, 2020, from https://www.newscientist.com/article/2246514-should-you-pay-for-a-coronavirus-test-heres-what-you-need-to-know/
‘How Slovakia Tested 3.6 Million People for COVID-19 in a Single Weekend’. Accessed 26 February 2021. https://www.bi.team/blogs/how-slovakia-tested-3-6-million-people-for-covid-19-in-a-single-weekend/.
Health, T. L. P. (2020). COVID-19 in Spain: A predictable storm? The Lancet Public Health, 0(0). https://doi.org/10.1016/S2468-2667(20)30239-5
Conway, E. (2020, October 15). Coronavirus: Test and Trace consultants paid equivalent of £1.5m salary. skynews. https://news.sky.com/story/coronavirus-test-and-trace-consultants-paid-equivalent-of-16315m-salary-12104028
IZA – Institute of Labor Economics. ‘COVID-19 and the Labor Market’. Accessed 6 October 2020. https://covid-19.iza.org/publications/dp13696/.
Anthony Costello on Twitter. (n.d.). Twitter. Retrieved September 9, 2020, from https://twitter.com/globalhlthtwit/status/1303597547546652672
Diseases, T. L. I. (2020). COVID-19: Endgames. The Lancet Infectious Diseases, 0(0). https://doi.org/10.1016/S1473-3099(20)30298-X
Kirby, T. (2020). South America prepares for the impact of COVID-19. The Lancet Respiratory Medicine, S2213260020302186. https://doi.org/10.1016/S2213-2600(20)30218-6
Lohse, S., Pfuhl, T., Berkó-Göttel, B., Rissland, J., Geißler, T., Gärtner, B., Becker, S. L., Schneitler, S., & Smola, S. (2020). Pooling of samples for testing for SARS-CoV-2 in asymptomatic people. The Lancet Infectious Diseases, S1473309920303625. https://doi.org/10.1016/S1473-3099(20)30362-5
Dorn, A. van, Cooney, R. E., & Sabin, M. L. (2020). COVID-19 exacerbating inequalities in the US. The Lancet, 395(10232), 1243–1244. https://doi.org/10.1016/S0140-6736(20)30893-X
r/BehSciResearch—Behavioural science research for guiding societies out of lockdown. (n.d.). Reddit. Retrieved April 20, 2020, from https://www.reddit.com/r/BehSciResearch/comments/g2bm09/behavioural_science_research_for_guiding/