330 Matching Annotations
  1. Aug 2023
    1. T9 (text prediction):generative AI::handgun:machine gun

      Link to: https://hypothes.is/a/n6wXvkeNEe6DOFexaCD-Qg

    2. Some may not realize it yet, but the shift in technology represented by ChatGPT is just another small evolution in the chain of predictive text with the realms of information theory and corpus linguistics.

      Claude Shannon's work along with Warren Weaver's introduction in The Mathematical Theory of Communication (1948), shows some of the predictive structure of written communication. This is potentially better underlined for the non-mathematician in John R. Pierce's book An Introduction to Information Theory: Symbols, Signals and Noise (1961) in which discusses how one can do a basic analysis of written English to discover that "e" is the most prolific letter or to predict which letters are more likely to come after other letters. The mathematical structures have interesting consequences like the fact that crossword puzzles are only possible because of the repetitive nature of the English language or that one can use the editor's notation "TK" (usually meaning facts or date To Come) in writing their papers to make it easy to find missing information prior to publication because the statistical existence of the letter combination T followed by K is exceptionally rare and the only appearances of it in long documents are almost assuredly areas which need to be double checked for data or accuracy.

      Cell phone manufacturers took advantage of the lower levels of this mathematical predictability to create T9 predictive text in early mobile phone technology. This functionality is still used in current cell phones to help speed up our texting abilities. The difference between then and now is that almost everyone takes the predictive magic for granted.

      As anyone with "fat fingers" can attest, your phone doesn't always type out exactly what you mean which can result in autocorrect mistakes (see: DYAC (Damn You AutoCorrect)) of varying levels of frustration or hilarity. This means that when texting, one needs to carefully double check their work before sending their text or social media posts or risk sending their messages to Grand Master Flash instead of Grandma.

      The evolution in technology effected by larger amounts of storage, faster processing speeds, and more text to study means that we've gone beyond the level of predicting a single word or two ahead of what you intend to text, but now we're predicting whole sentences and even paragraphs which make sense within a context. ChatGPT means that one can generate whole sections of text which will likely make some sense.

      Sadly, as we know from our T9 experience, this massive jump in predictability doesn't mean that ChatGPT or other predictive artificial intelligence tools are "magically" correct! In fact, quite often they're wrong or will predict nonsense, a phenomenon known as AI hallucination. Just as with T9, we need to take even more time and effort to not only spell check the outputs from the machine, but now we may need to check for the appropriateness of style as well as factual substance!

      The bigger near-term problem is one of human understanding and human communication. While the machine may appear to magically communicate (often on our behalf if we're publishing it's words under our names), is it relaying actual meaning? Is the other person reading these words understanding what was meant to have been communicated? Do the words create knowledge? Insight?

      We need to recall that Claude Shannon specifically carved semantics and meaning out of the picture in the second paragraph of his seminal paper:

      Frequently the messages have meaning; that is they refer to or are correlated according to some system with certain physical or conceptual entities. These semantic aspects of communication are irrelevant to the engineering problem.

      So far ChatGPT seems to be accomplishing magic by solving a small part of an engineering problem by being able to explore the adjacent possible. It is far from solving the human semantic problem much less the un-adjacent possibilities (potentially representing wisdom or insight), and we need to take care to be aware of that portion of the unsolved problem. Generative AIs are also just choosing weighted probabilities and spitting out something which is prone to seem possible, but they're not optimizing for which of many potential probabilities is the "best" or the "correct" one. For that, we still need our humanity and faculties for decision making.


      Shannon, Claude E. A Mathematical Theory of Communication. Bell System Technical Journal, 1948.

      Shannon, Claude E., and Warren Weaver. The Mathematical Theory of Communication. University of Illinois Press, 1949.

      Pierce, John Robinson. An Introduction to Information Theory: Symbols, Signals and Noise. Second, Revised. Dover Books on Mathematics. 1961. Reprint, Mineola, N.Y: Dover Publications, Inc., 1980. https://www.amazon.com/Introduction-Information-Theory-Symbols-Mathematics/dp/0486240614.

      Shannon, Claude Elwood. “The Bandwagon.” IEEE Transactions on Information Theory 2, no. 1 (March 1956): 3. https://doi.org/10.1109/TIT.1956.1056774.


      We may also need to explore The Bandwagon, an early effect which Shannon noticed and commented upon. Everyone seems to be piling on the AI bandwagon right now...

  2. Apr 2023
    1. The Delta Method, from the field of nonlinear regression. The Bayesian Method, from Bayesian modeling and statistics. The Mean-Variance Estimation Method, using estimated statistics. The Bootstrap Method, using data resampling and developing an ensemble of models.

      Four methods to compute prediction intervals.

    1. A novel method for estimating prediction uncertainty using machine learning techniques is presented. Uncertainty is expressed in the form of the two quantiles (constituting the prediction interval) of the underlying distribution of prediction errors. The idea is to partition the input space into different zones or clusters having similar model errors using fuzzy c-means clustering. The prediction interval is constructed for each cluster on the basis of empirical distributions of the errors associated with all instances belonging to the cluster under consideration and propagated from each cluster to the examples according to their membership grades in each cluster. Then a regression model is built for in-sample data using computed prediction limits as targets, and finally, this model is applied to estimate the prediction intervals (limits) for out-of-sample data. The method was tested on artificial and real hydrologic data sets using various machine learning techniques. Preliminary results show that the method is superior to other methods estimating the prediction interval. A new method for evaluating performance for estimating prediction interval is proposed as well.

      Prediction intervals using quantiles. Use clustering.

  3. Mar 2023
    1. It is safe to predict that in the near future intelligence tests will bring tens of thousands of these high-grade defectives under the surveillance and protection of society. This will ultimately result in curtailing the reproduction of feeble-mindedness and in the elimination of an enormous amount of crime, pauperism, and industrial inefficiency. It is hardly necessary to emphasize that the high-grade cases, of the type now so frequently overlooked, are precisely the ones whose guardianship it is most important for the State to assume.

      I think it is interesting how they say it is safe to predict in the future intelligence tests will bring thousands of high-grade defectives. The result they have predicted is interesting because they think the results will eliminate crime, pauperism, and industrial inefficiency. This relates to the history of psychology because they predicted the future. Since we are the future, I don't think there has been a decrease in crime, pauperism which is poverty, and industrial inefficiency. I think we are on the rise of crime and pauperism.

    1. Good protocols tend to form persistent Schelling points in spaces of problems worth solving, around solutions good enough to live with – for a while. And surprisingly often, they manage to induce more complex patterns of voluntary commitment and participation than are achieved by competing systems of centralized coordination.

      "inducing more complex patterns" reminds me a little bit of Peter Cotton's Microprediction, does a market form around an idea? Is a protocol one of these ideas?

      Appreciate the 'problems worth solving'

      Because it's fresh in memory, I like this as illustrated by Chasing Venus

  4. Jan 2023
  5. Nov 2022
  6. Oct 2022
    1. Intellectual readiness involves a minimumlevel of visual perception such that the child can take in andremember an entire word and the letters that combine to formit. Language readiness involves the ability to speak clearly andto use several sentences in correct order.

      Just as predictive means may be used on the level of letters, words, and even whole sentences within information theory at the level of specific languages, does early orality sophistication in children help them to become predictive readers at earlier ages?

      How could one go about testing this, particularly in a broad, neurodiverse group?

  7. Aug 2022
    1. Doing this, we can confidentlyconclude that by the year 2035 it is more likelythan not that quantum technology will have ad-vanced sufficiently to be able to break RSA2048efficiently. This conclusion is shared by well es-tablished researchers (see, e.g.[2, 3])

      Here, author uses other researcher's conclusions and states that by the year 2035 it is a fact that quantum technology will have advance sufficiently to be able to break RSA2048 efficiently.

    Tags

    Annotators

  8. Mar 2022
    1. Eric Topol. (2022, February 28). A multimodal #AI study of ~54 million blood cells from Covid patients @YaleMedicine for predicting mortality risk highlights protective T cell role (not TH17), poor outcomes of granulocytes, monocytes, and has 83% accuracy https://nature.com/articles/s41587-021-01186-x @NatureBiotech @KrishnaswamyLab https://t.co/V32Kq0Q5ez [Tweet]. @EricTopol. https://twitter.com/EricTopol/status/1498373229097799680

  9. Feb 2022
    1. Adele Groyer. (2022, January 8). Friday report is now out. Https://covidactuaries.org/2022/01/07/the-friday-report-issue-58/ I am struck that perception of a “mild” Covid situation is relative. In SA natural deaths were >30% higher than predicted in Dec. The last time weekly death rates in E&W were more than 30% above 2015-19 levels was in Jan 2021. Https://t.co/S9fkn2WFVk [Tweet]. @AdeleGroyer. https://twitter.com/AdeleGroyer/status/1479760460589191170

  10. Jan 2022
    1. Zimmerman, M. I., Porter, J. R., Ward, M. D., Singh, S., Vithani, N., Meller, A., Mallimadugula, U. L., Kuhn, C. E., Borowsky, J. H., Wiewiora, R. P., Hurley, M. F. D., Harbison, A. M., Fogarty, C. A., Coffland, J. E., Fadda, E., Voelz, V. A., Chodera, J. D., & Bowman, G. R. (2021). SARS-CoV-2 simulations go exascale to predict dramatic spike opening and cryptic pockets across the proteome. Nature Chemistry, 13(7), 651–659. https://doi.org/10.1038/s41557-021-00707-0

    1. Keeling, M. J., Brooks-Pollock, E., Challen, R. J., Danon, L., Dyson, L., Gog, J. R., Guzman-Rincon, L., Hill, E. M., Pellis, L. M., Read, J. M., & Tildesley, M. (2021). Short-term Projections based on Early Omicron Variant Dynamics in England. (p. 2021.12.30.21268307). https://doi.org/10.1101/2021.12.30.21268307

  11. Dec 2021
    1. Eric Feigl-Ding. (2021, December 2). A rise in possible #Omicron in England—Tripling (0.1 to 0.3) of S-Gene dropout PCR signal, which is a proxy for Omicron (before 🧬 sequencing confirms). @_nickdavies estimates this represents around ~60 cases in 🏴󠁧󠁢󠁥󠁮󠁧󠁿. Still early—But it displacing #DeltaVariant is not good sign. 🧵 https://t.co/4aIiqiVsqH [Tweet]. @DrEricDing. https://twitter.com/DrEricDing/status/1466234026843205637

  12. Nov 2021
    1. Benjamin Veness. (2021, November 2). Singapore’s 🇸🇬 Senior Minister of State for Health, Dr Janil Puthucheary, told Parliament on 1 November: “I hope my explanation has helped members understand why although we say we are living with COVID-19, we cannot just open up, and risk having the number of cases shoot up.” [Tweet]. @venessb. https://twitter.com/venessb/status/1455396047765733376

  13. Oct 2021
  14. Sep 2021
    1. Hippisley-Cox, J., Coupland, C. A., Mehta, N., Keogh, R. H., Diaz-Ordaz, K., Khunti, K., Lyons, R. A., Kee, F., Sheikh, A., Rahman, S., Valabhji, J., Harrison, E. M., Sellen, P., Haq, N., Semple, M. G., Johnson, P. W. M., Hayward, A., & Nguyen-Van-Tam, J. S. (2021). Risk prediction of covid-19 related death and hospital admission in adults after covid-19 vaccination: National prospective cohort study. BMJ, 374, n2244. https://doi.org/10.1136/bmj.n2244

    1. Bracher, J., Wolffram, D., Deuschel, J., Görgen, K., Ketterer, J. L., Ullrich, A., Abbott, S., Barbarossa, M. V., Bertsimas, D., Bhatia, S., Bodych, M., Bosse, N. I., Burgard, J. P., Castro, L., Fairchild, G., Fuhrmann, J., Funk, S., Gogolewski, K., Gu, Q., … Xu, F. T. (2021). A pre-registered short-term forecasting study of COVID-19 in Germany and Poland during the second wave. Nature Communications, 12(1), 5173. https://doi.org/10.1038/s41467-021-25207-0

  15. Aug 2021
  16. Jul 2021
  17. Jun 2021
    1. Your brain is a prediction machine.

      See also Agrawal, A., Gans, J., & Goldfarb, A. (2018). Prediction Machines: The Simple Economics of Artificial Intelligence. Harvard Business Review Press.

    1. V Shah, A. S., Gribben, C., Bishop, J., Hanlon, P., Caldwell, D., Wood, R., Reid, M., McMenamin, J., Goldberg, D., Stockton, D., Hutchinson, S., Robertson, C., McKeigue, P. M., Colhoun, H. M., & McAllister, D. A. (2021). Effect of vaccination on transmission of COVID-19: An observational study in healthcare workers and their households [Preprint]. Public and Global Health. https://doi.org/10.1101/2021.03.11.21253275

  18. May 2021
    1. ReconfigBehSci on Twitter: “this is utterly bizarre: How would one conceptually even begin to determine a number by which the model overestimated unmitigated deaths. What is the comparison unmitigated ‘prediction’ to what actually happened supposed to mean?” / Twitter. (n.d.). Retrieved May 1, 2021, from https://twitter.com/SciBeh/status/1384070393514790918

  19. Apr 2021
    1. Eric Topol on Twitter: “The variants of concern/interest fall into a spectrum of immune evasiveness, w/ B.1.351 being most; B.1.1.7, B.1.429 least. This property pertains to potential for reinfection & some reduction in vaccine efficacy My prelim estimates based on publications/preprints, subject to Δ https://t.co/fQZwBCUEGS” / Twitter. (n.d.). Retrieved April 28, 2021, from https://twitter.com/EricTopol/status/1380203664317456385

    1. ReconfigBehSci. (2021, April 19). @ToddHorowitz3 it could be meaningful only vis a vis certain qualitative constraints: E.g., ‘look, model predicts fewer deaths for unmitigated than observed even with lockdown’ => model underpredicts.... But that’s very much not the scenario here [Tweet]. @SciBeh. https://twitter.com/SciBeh/status/1384146492609372177

    1. ReconfigBehSci. (2021, April 19). @ToddHorowitz3 so, given that no one can know the ‘unmitigated number’ what they seem to be calculating is in difference deaths given lockdown and model prediction without lockdown and calling that the ‘overestimate’—Which seems truly bizarre [Tweet]. @SciBeh. https://twitter.com/SciBeh/status/1384147188180082692

    1. Jeremy Faust MD MS (ER physician) on Twitter: “Let’s talk about the background risk of CVST (cerebral venous sinus thrombosis) versus in those who got J&J vaccine. We are going to focus in on women ages 20-50. We are going to compare the same time period and the same disease (CVST). DEEP DIVE🧵 KEY NUMBERS!” / Twitter. (n.d.). Retrieved April 15, 2021, from https://twitter.com/jeremyfaust/status/1382536833863651330

    1. Bleuler defined schizophrenia with his four ‘A’s’, referring to the blunted Affect (diminished emotional response to stimuli); loosening of Associations (by which he meant a disordered pattern of thought, inferring a cognitive deficit), Ambivalence (an apparent inability to make decisions, again suggesting a deficit of the integration and processing of incident and retrieved information) and Autism (a loss of awareness of external events, and a preoccupation with the self and one’s own thoughts)

      I stumbled upon this accidentally. I was going to add to my prediction that schizophrenia might be related to autism, but now that I've found this I need to publish my draft.


      Edit: Here was the prediction I wrote. Copied unmodified, ensuring transparency.

      March 28, 6:15pm Prediction: Some cases of schizophrenia are being misdiagnosed as autism. I recently took a Coursera.org course on schizophrenia. The negative symptoms look similar to some autism symptoms.

      Before I look it up, there are a few other predictions I should make. Do I think schizophrenia and autism will be linked? If there’s cross-diagnosis, will this link be artificial or real? Last time I looked, people with aspergers had (more or less) normal sleep EEGs. In contrast, schizophrenia is associated with disrupted sleep spindles. I already know that schizophrenia and bipolar are genetically linked, but I don’t know what the bipolar sleep EEG looks like. That is to say, I don’t know if the lack of sleep abnormality in autism is evidence against a link to schizophrenia. All in all, I predict that there will be a real link (for example, genetic), but I have a low confidence in this prediction. The reason is that I expect there is little EEG sleep changes in bipolar, implying that there is a supra-mechanism causing all these effects; somewhat like metabolic syndrome, the same cause may manifest in different ways.

    1. Using this data, a large international team was able to pinpoint 114 specific loci – locations in the human genome – that contribute to risk of both schizophrenia and bipolar disorder, and four genome regions that contribute to differences in the biology of the two disorders.

      This is exactly what I expected. In fact, I would have been extremely surprised if this weren't the case. I just google "schizophrenia bipolar genes" expecting this result.

      I had the thought a few minutes ago, and google it right away. This means that I wasn't able to write it down as a prediction. Nonetheless, I think this points in favor of my prediction abilities. My confidence was inordinately high (i.e. on the order of 90%) even before collecting any evidence. Compare that to other high confidence beliefs (e.g. CFS is caused partly by blood volume), for which I have confidence on the order of 95%, but I have good evidence for that belief. Thus, this instance provides data that my confidence meter is reliable. I'll continue to make an effort to write down predictions ahead of time (to eliminate publication bias).

      There are several reasons I suspected this would be the case. Firstly, personal subjective experience; that's what gave me the first inkling. Secondly, the connection of mania with long periods of sleeplessness. If the sleep deprivation causes the mania, then bipolar may be a sleep disorder. This is backed up by the sleep deprivation therapy for depression. Additionally, the connection of depression to sleep disturbance implies that sleep may also be causal in low mood. Furthermore, given that schizophrenia is associated with disrupted sleep spindles, it follows that the two sleep disorders, namely schizophrenia and bipolar, may be closely related genetically (via sleep regulating genes). Moreover, I knew that schizophrenia and bipolar were two of the most heritable psychological conditions; given that both are highly genetic and both involve sleep, it follows that they would likely be closely linked. Finally, I know mania can be associated with delusions, so there are several symptom crossovers. All in all, it is highly surprising that I have not seen this discussed before. Neither documentaries on schizophrenia nor documentaries on manic depression/bipolar have mentioned a link. Nor have studies I've read (admittedly few on this particular topic) mentioned anything of the sort. I shall have to look through the literature to see if this idea has been around for long.

  20. Mar 2021
    1. Nick Barrowman. (2021, March 26). Throughout the pandemic, a widespread inability to reason counterfactually has been on display. For example, some people apparently think lockdowns don’t work. They seem unable to imagine the situation had there not been a lockdown. Lockdowns are costly, but they work! [Tweet]. @nbarrowman. https://twitter.com/nbarrowman/status/1375240312264740870