chips from different generations running at different speeds still matched the ML performance of single-chip-type training runs, ensuring that even older hardware can meaningfully accelerate AI training.
大多数人认为混合不同代际的硬件进行训练会降低性能或效率，但作者认为即使不同代际、不同速度的芯片混合使用，仍能达到与单一芯片类型训练相同的机器学习性能，这挑战了硬件必须同质化的行业共识。
High-level view of the 3 different types of heterogeneity (clinical, methodological, statistical). I used these definitions as the basis for some Anki cards
Academics: Viral Evolution Scenarios, 10 February 2022. (n.d.). GOV.UK. Retrieved February 14, 2022, from https://www.gov.uk/government/publications/academics-viral-evolution-scenarios-10-february-2022
Usually it is more fruitful to look for formulations of problems that relate heterogeneous things with each other.
A great quote, but this is likely a nebulous statement to those with out the experience of practice. Definitely worth expanding on this idea to give it more detail.
Collier, D. A., Ferreira, I. A. T. M., Kotagiri, P., Datir, R., Lim, E., Touizer, E., Meng, B., Abdullahi, A., Elmer, A., Kingston, N., Graves, B., Gresley, E. L., Caputo, D., Bergamaschi, L., Smith, K. G. C., Bradley, J. R., Ceron-Gutierrez, L., Cortes-Acevedo, P., Barcenas-Morales, G., … Gupta, R. K. (2021). Age-related immune response heterogeneity to SARS-CoV-2 vaccine BNT162b2. Nature, 1–9. https://doi.org/10.1038/s41586-021-03739-1
Long Covid: What we know so far. (2020, October 15). The Guardian. http://www.theguardian.com/world/2020/oct/15/long-covid-what-we-know-so-far
Tong, K. K., Chen, J. H., Yu, E. W., & Wu, A. M. S. (n.d.). Adherence to COVID-19 Precautionary Measures: Applying the Health Belief Model and Generalised Social Beliefs to a Probability Community Sample. Applied Psychology: Health and Well-Being, n/a(n/a). https://doi.org/10.1111/aphw.12230
COVID-19 and the Labor Market. (n.d.). IZA – Institute of Labor Economics. Retrieved October 11, 2020, from https://covid-19.iza.org/publications/dp13620/
COVID-19 and the Labor Market. (n.d.). IZA – Institute of Labor Economics. Retrieved October 11, 2020, from https://covid-19.iza.org/publications/dp13625/
COVID-19 and the Labor Market. (n.d.). IZA – Institute of Labor Economics. Retrieved October 11, 2020, from https://covid-19.iza.org/publications/dp13629/
Hennessy, E. A., Acabchuk, R., Arnold, P. A., Dunn, A. G., Foo, Y. Z., Johnson, B. T., Geange, S. R., Haddaway, N. R., Nakagawa, S., Mapanga, W., Mengersen, K., Page, M. J., Sánchez-Tójar, A., Welch, V., & McGuinness, L. A. (2020). Ensuring Prevention Science Research is Synthesis-Ready for Immediate and Lasting Scientific Impact [Preprint]. MetaArXiv. https://doi.org/10.31222/osf.io/ptg9j
Friston, K., Costello, A., & Pillay, D. (2020). Dark matter, second waves and epidemiological modelling. MedRxiv, 2020.09.01.20185876. https://doi.org/10.1101/2020.09.01.20185876
Eyre, D. W., Lumley, S. F., O’Donnell, D., Campbell, M., Sims, E., Lawson, E., Warren, F., James, T., Cox, S., Howarth, A., Doherty, G., Hatch, S. B., Kavanagh, J., Chau, K. K., Fowler, P. W., Swann, J., Volk, D., Yang-Turner, F., Stoesser, N., … Walker, T. M. (2020). Differential occupational risks to healthcare workers from SARS-CoV-2 observed during a prospective observational study. ELife, 9, e60675. https://doi.org/10.7554/eLife.60675
Mateus, J., Grifoni, A., Tarke, A., Sidney, J., Ramirez, S. I., Dan, J. M., Burger, Z. C., Rawlings, S. A., Smith, D. M., Phillips, E., Mallal, S., Lammers, M., Rubiro, P., Quiambao, L., Sutherland, A., Yu, E. D., Antunes, R. da S., Greenbaum, J., Frazier, A., … Weiskopf, D. (2020). Selective and cross-reactive SARS-CoV-2 T cell epitopes in unexposed humans. Science. https://doi.org/10.1126/science.abd3871
Dynamics of Social Mobility during the COVID-19 Pandemic in Canada. COVID-19 and the Labor Market. (n.d.). IZA – Institute of Labor Economics. Retrieved August 4, 2020, from https://covid-19.iza.org/publications/dp13376/
Xu, G., Qi, F., Li, H., Yang, Q., Wang, H., Wang, X., Liu, X., Zhao, J., Liao, X., Liu, Y., Amit, I., Liu, L., Zhang, S., & Zhang, Z. (2020). The differential immune responses to COVID-19 in peripheral and lung revealed by single-cell RNA sequencing. MedRxiv, 2020.08.15.20175638. https://doi.org/10.1101/2020.08.15.20175638
When Do Shelter-In-Place Orders Fight COVID-19 Best? Policy Heterogeneity across States and Adoption Time. COVID-19 and the Labor Market. (n.d.). IZA – Institute of Labor Economics. Retrieved August 7, 2020, from https://covid-19.iza.org/publications/dp13190/
Fan, Y., Orhun, A. Y., & Turjeman, D. (2020). Heterogeneous Actions, Beliefs, Constraints and Risk Tolerance During the COVID-19 Pandemic (Working Paper No. 27211; Working Paper Series). National Bureau of Economic Research. https://doi.org/10.3386/w27211
Althouse, B. M., Wallace, B., Case, B., Scarpino, S. V., Berdahl, A. M., White, E. R., & Hebert-Dufresne, L. (2020). The unintended consequences of inconsistent pandemic control policies. ArXiv:2008.09629 [Physics, q-Bio]. http://arxiv.org/abs/2008.09629
Sun, K., Wang, W., Gao, L., Wang, Y., Luo, K., Ren, L., Zhan, Z., Chen, X., Zhao, S., Huang, Y., Sun, Q., Liu, Z., Litvinova, M., Vespignani, A., Ajelli, M., Viboud, C., & Yu, H. (2020). Transmission heterogeneities, kinetics, and controllability of SARS-CoV-2. MedRxiv, 2020.08.09.20171132. https://doi.org/10.1101/2020.08.09.20171132
Gregory, V., Menzio, G., & Wiczer, D. G. (2020). Pandemic Recession: L or V-Shaped? (Working Paper No. 27105; Working Paper Series). National Bureau of Economic Research. https://doi.org/10.3386/w27105
Glaeser, E. L., Gorback, C. S., & Redding, S. J. (2020). How Much does COVID-19 Increase with Mobility? Evidence from New York and Four Other U.S. Cities (Working Paper No. 27519; Working Paper Series). National Bureau of Economic Research. https://doi.org/10.3386/w27519
Baker, S. R., Farrokhnia, R. A., Meyer, S., Pagel, M., & Yannelis, C. (2020). Income, Liquidity, and the Consumption Response to the 2020 Economic Stimulus Payments (Working Paper No. 27097; Working Paper Series). National Bureau of Economic Research. https://doi.org/10.3386/w27097
Baker, S. R., Farrokhnia, R. A., Meyer, S., Pagel, M., & Yannelis, C. (2020). How Does Household Spending Respond to an Epidemic? Consumption During the 2020 COVID-19 Pandemic (Working Paper No. 26949; Working Paper Series). National Bureau of Economic Research. https://doi.org/10.3386/w26949
An Economic Model of the COVID-19 Epidemic: The Importance of Testing and Age-Specific Policies. COVID-19 and the Labor Market. (n.d.). IZA – Institute of Labor Economics. Retrieved August 4, 2020, from https://covid-19.iza.org/publications/dp13265/
Partial Lockdown and the Spread of COVID-19: Lessons from the Italian Case. COVID-19 and the Labor Market. (n.d.). IZA – Institute of Labor Economics. Retrieved August 4, 2020, from https://covid-19.iza.org/publications/dp13375/
Work That Can Be Done from Home: Evidence on Variation within and across Occupations and Industries. COVID-19 and the Labor Market. (n.d.). IZA – Institute of Labor Economics. Retrieved August 4, 2020, from https://covid-19.iza.org/publications/dp13374/
The Lockdown Impact on Unemployment for Heterogeneous Workers. COVID-19 and the Labor Market. (n.d.). IZA – Institute of Labor Economics. Retrieved July 30, 2020, from https://covid-19.iza.org/publications/dp13439/
COVID-19 and Mental Health Deterioration among BAME Groups in the UK. COVID-19 and the Labor Market. (n.d.). IZA – Institute of Labor Economics. Retrieved July 27, 2020, from https://covid-19.iza.org/publications/dp13503/
Aleta, A., Arruda, G. F. de, & Moreno, Y. (2020). Data-driven contact structures: From homogeneous mixing to multilayer networks. PLOS Computational Biology, 16(7), e1008035. https://doi.org/10.1371/journal.pcbi.1008035
Akbarpour, M., Cook, C., Marzuoli, A., Mongey, S., Nagaraj, A., Saccarola, M., Tebaldi, P., Vasserman, S., & Yang, H. (2020). Socioeconomic Network Heterogeneity and Pandemic Policy Response (Working Paper No. 27374; Working Paper Series). National Bureau of Economic Research. https://doi.org/10.3386/w27374
Aucejo, E. M., French, J. F., Araya, M. P. U., & Zafar, B. (2020). The Impact of COVID-19 on Student Experiences and Expectations: Evidence from a Survey (Working Paper No. 27392; Working Paper Series). National Bureau of Economic Research. https://doi.org/10.3386/w27392
Dave, D. M., Friedson, A. I., Matsuzawa, K., & Sabia, J. J. (2020). When Do Shelter-in-Place Orders Fight COVID-19 Best? Policy Heterogeneity Across States and Adoption Time (Working Paper No. 27091; Working Paper Series). National Bureau of Economic Research. https://doi.org/10.3386/w27091
Rampini, A. A. (2020). Sequential Lifting of COVID-19 Interventions with Population Heterogeneity (Working Paper No. 27063; Working Paper Series). National Bureau of Economic Research. https://doi.org/10.3386/w27063
Ellison, G. (2020). Implications of Heterogeneous SIR Models for Analyses of COVID-19 (Working Paper No. 27373; Working Paper Series). National Bureau of Economic Research. https://doi.org/10.3386/w27373
Granja, J., Makridis, C., Yannelis, C., & Zwick, E. (2020). Did the Paycheck Protection Program Hit the Target? (Working Paper No. 27095; Working Paper Series). National Bureau of Economic Research. https://doi.org/10.3386/w27095
Affairs, C., & Medicine. (2020, July 7). Southeast Asia coronavirus update. Marginal REVOLUTION. https://marginalrevolution.com/marginalrevolution/2020/07/southeast-asia-coronavirus-update.html
Allard, A., Moore, C., Scarpino, S. V., Althouse, B. M., & Hébert-Dufresne, L. (2020). The role of directionality, heterogeneity and correlations in epidemic risk and spread. ArXiv:2005.11283 [Physics, q-Bio]. http://arxiv.org/abs/2005.11283
Perrott, D. (2020, May 22). Exploring the Valley’s of the Applied Behavioural Science Landscape. Medium. https://medium.com/@DavePerrott/exploring-the-valleys-of-the-applied-behavioural-science-landscape-a8b8ed53e58a
Althouse, B. M., Wenger, E. A., Miller, J. C., Scarpino, S. V., Allard, A., Hébert-Dufresne, L., & Hu, H. (2020). Stochasticity and heterogeneity in the transmission dynamics of SARS-CoV-2. ArXiv:2005.13689 [Physics, q-Bio]. http://arxiv.org/abs/2005.13689
Olsson-Collentine, A., van Assen, M. A. L. M., & Wicherts, J. M. (2020). Postprint—Heterogeneity in direct replications in psychology and its association with effect size [Preprint]. PsyArXiv. https://doi.org/10.31234/osf.io/m23v4
Du, H., Jiang, G., & Ke, Z. (2020). A Bootstrap Based Between-Study Heterogeneity Test in Meta-Analysis [Preprint]. PsyArXiv. https://doi.org/10.31234/osf.io/de4g9
A Marm Kilpatrick on Twitter: “What is #herdimmunity threshold for #COVID19? A topic of much discussion due to large uncertainty & huge consequences for long term impact. New paper illustrates 1 key aspect that can reduce it substantially (spoiler: we still don’t know value). Thread. https://t.co/Sgrg1yrlOq” / Twitter. (n.d.). Twitter. Retrieved June 27, 2020, from https://twitter.com/diseaseecology/status/1275595167936868352
Gomes, M. G. M., Corder, R. M., King, J. G., Langwig, K. E., Souto-Maior, C., Carneiro, J., Goncalves, G., Penha-Goncalves, C., Ferreira, M. U., & Aguas, R. (2020). Individual variation in susceptibility or exposure to SARS-CoV-2 lowers the herd immunity threshold. MedRxiv, 2020.04.27.20081893. https://doi.org/10.1101/2020.04.27.20081893
Parsons, Sam. ‘Reliability Multiverse’, 26 June 2020. https://doi.org/10.31234/osf.io/y6tcz.
Britton, T., Ball, F., & Trapman, P. (2020). A mathematical model reveals the influence of population heterogeneity on herd immunity to SARS-CoV-2. Science. https://doi.org/10.1126/science.abc6810
McAvoy, A., Allen, B., & Nowak, M. A. (2020). Social goods dilemmas in heterogeneous societies. Nature Human Behaviour, 1–13. https://doi.org/10.1038/s41562-020-0881-2
Nunes, A., Trappenberg, T., & Alda, M. (2020). The Definition and Measurement of Heterogeneity. https://doi.org/10.31234/osf.io/3hykf
Schauer, J. M., & Hedges, L. V. (2020). Assessing heterogeneity and power in replications of psychological experiments. Psychological Bulletin. Advance online publication. https://doi.org/10.1037/bul0000232
Rivkind, A., Schreier, H., Brenner, N., & Barak, O. (2020). Scale free topology as an effective feedback system. PLOS Computational Biology, 16(5), e1007825. https://doi.org/10.1371/journal.pcbi.1007825
A single transformant may have a mutation at a low level that will eventually sweep through the population
How does transforming a pure plasmid (miniprep) produce a mixed population?
Does this make any suggestion of using one or the other method for generating independent biological replicates?
Here, we show how three phenomena—Simpson’s paradox, context-dependence, and nonlinear averaging—can lead to erroneous conclusions about population parameters and species interactions when samples contain heterogeneous mixtures of populations or communities.
These issues can be overcome by measuring and accounting for spatial heterogeneity at very small scales
in most cases, the molecular mechanisms that underlie heterogeneity are not defined