ᔥ[[Michael Gibb]] in Breakthrough in prime number theory demonstrates primes can be predicted

Breakthrough in prime number theory demonstrates primes can be predicted by [[Michael Gibb]]

Some may not realize it yet, but the shift in technology represented by ChatGPT is just another small evolution in the chain of predictive text with the realms of information theory and corpus linguistics.

Claude Shannon's work along with Warren Weaver's introduction in The Mathematical Theory of Communication (1948), shows some of the predictive structure of written communication. This is potentially better underlined for the non-mathematician in John R. Pierce's book An Introduction to Information Theory: Symbols, Signals and Noise (1961) in which discusses how one can do a basic analysis of written English to discover that "e" is the most prolific letter or to predict which letters are more likely to come after other letters. The mathematical structures have interesting consequences like the fact that crossword puzzles are only possible because of the repetitive nature of the English language or that one can use the editor's notation "TK" (usually meaning facts or date To Come) in writing their papers to make it easy to find missing information prior to publication because the statistical existence of the letter combination T followed by K is exceptionally rare and the only appearances of it in long documents are almost assuredly areas which need to be double checked for data or accuracy.

Cell phone manufacturers took advantage of the lower levels of this mathematical predictability to create T9 predictive text in early mobile phone technology. This functionality is still used in current cell phones to help speed up our texting abilities. The difference between then and now is that almost everyone takes the predictive magic for granted.

As anyone with "fat fingers" can attest, your phone doesn't always type out exactly what you mean which can result in autocorrect mistakes (see: DYAC (Damn You AutoCorrect)) of varying levels of frustration or hilarity. This means that when texting, one needs to carefully double check their work before sending their text or social media posts or risk sending their messages to Grand Master Flash instead of Grandma.

The evolution in technology effected by larger amounts of storage, faster processing speeds, and more text to study means that we've gone beyond the level of predicting a single word or two ahead of what you intend to text, but now we're predicting whole sentences and even paragraphs which make sense within a context. ChatGPT means that one can generate whole sections of text which will likely make some sense.

Sadly, as we know from our T9 experience, this massive jump in predictability doesn't mean that ChatGPT or other predictive artificial intelligence tools are "magically" correct! In fact, quite often they're wrong or will predict nonsense, a phenomenon known as AI hallucination. Just as with T9, we need to take even more time and effort to not only spell check the outputs from the machine, but now we may need to check for the appropriateness of style as well as factual substance!

The bigger near-term problem is one of human understanding and human communication. While the machine may appear to magically communicate (often on our behalf if we're publishing it's words under our names), is it relaying actual meaning? Is the other person reading these words understanding what was meant to have been communicated? Do the words create knowledge? Insight?

We need to recall that Claude Shannon specifically carved semantics and meaning out of the picture in the second paragraph of his seminal paper:

Frequently the messages have meaning; that is they refer to or are correlated according to some system with certain physical or conceptual entities. These semantic aspects of communication are irrelevant to the engineering problem.

So far ChatGPT seems to be accomplishing magic by solving a small part of an engineering problem by being able to explore the adjacent possible. It is far from solving the human semantic problem much less the un-adjacent possibilities (potentially representing wisdom or insight), and we need to take care to be aware of that portion of the unsolved problem. Generative AIs are also just choosing weighted probabilities and spitting out something which is prone to seem possible, but they're not optimizing for which of many potential probabilities is the "best" or the "correct" one. For that, we still need our humanity and faculties for decision making.

Shannon, Claude E. A Mathematical Theory of Communication. Bell System Technical Journal, 1948.

Shannon, Claude E., and Warren Weaver. The Mathematical Theory of Communication. University of Illinois Press, 1949.

Pierce, John Robinson. An Introduction to Information Theory: Symbols, Signals and Noise. Second, Revised. Dover Books on Mathematics. 1961. Reprint, Mineola, N.Y: Dover Publications, Inc., 1980. https://www.amazon.com/Introduction-Information-Theory-Symbols-Mathematics/dp/0486240614.

Shannon, Claude Elwood. “The Bandwagon.” IEEE Transactions on Information Theory 2, no. 1 (March 1956): 3. https://doi.org/10.1109/TIT.1956.1056774.

We may also need to explore The Bandwagon, an early effect which Shannon noticed and commented upon. Everyone seems to be piling on the AI bandwagon right now...

Just as predictive means may be used on the level of letters, words, and even whole sentences within information theory at the level of specific languages, does early orality sophistication in children help them to become predictive readers at earlier ages?

How could one go about testing this, particularly in a broad, neurodiverse group?

Henderson, R. K., & Schnall, S. (2021). Social Threat Indirectly Increases Moral Condemnation via Thwarting Fundamental Social Needs [Preprint]. PsyArXiv. https://doi.org/10.31234/osf.io/rjzys

Myers, L. B., & Goodwin, R. (2011). Determinants of adults’ intention to vaccinate against pandemic swine flu. BMC Public Health, 11(1), 15. https://doi.org/10.1186/1471-2458-11-15

Witte, E. H., Stanciu, A., & Zenker, F. (2020, October 28). A simple measure for the empirical adequacy of a theoretical construct. https://doi.org/10.31234/osf.io/gdm

Parag. K. V., Donnelly. C. A., (2020) Using information theory to optimise epidemic models for real-time prediction and estimation. PLOS. Retrieved from https://journals.plos.org/ploscompbiol/article?id=10.1371/journal.pcbi.1007990

Kermack–McKendrick theory. (2020). In Wikipedia. https://en.wikipedia.org/w/index.php?title=Kermack%E2%80%93McKendrick_theory&oldid=951835485

Whitney R. Robinson on Twitter: “1/ An #EpiTwitter 🧵 about theory... https://t.co/rSjfkHG21r” / Twitter. (n.d.). Twitter. Retrieved August 18, 2020, from https://twitter.com/WhitneyEpi/status/1295522551892971520

Díaz, R., & Cova, F. (2020, April 14). Moral values and trait pathogen disgust predict compliance with official recommendations regarding COVID-19 pandemic in US samples. https://doi.org/10.31234/osf.io/5zrqx

Gelfand, M., Jackson, J. C., Pan, X., Nau, D., Dagher, M. M., & Chiu, C. (2020, April 1). Cultural and Institutional Factors Predicting the Infection Rate and Mortality Likelihood of the COVID-19 Pandemic. https://doi.org/10.31234/osf.io/m7f8a

Shmueli, G. (2010). To Explain or to Predict? Statistical Science, 25(3), 289–310.

Pigliucci, M. (2020, May 19). No, predictions are not overrated. On some scientists’ strange attitude toward philosophy. Medium. https://medium.com/science-and-philosophy/no-predictions-are-not-overrated-on-some-scientists-strange-attitude-toward-philosophy-60dfd5c2cb83

Zdeborová, L. (2020). Understanding deep learning is also a job for physicists. Nature Physics, 1–3. https://doi.org/10.1038/s41567-020-0929-2

Leary, A., Dvorak, R., De Leon, A., Peterson, R., & Troop-Gordon, W. (2020). COVID-19 Social Distancing [Preprint]. PsyArXiv. https://doi.org/10.31234/osf.io/mszw2

Kennedy, B., Atari, M., Davani, A. M., Hoover, J., Omrani, A., Graham, J., & Dehghani, M. (2020, May 7). Moral Concerns are Differentially Observable in Language. https://doi.org/10.31234/osf.io/uqmty

Cavojova, V., Šrol, J., & Mikušková, E. B. (2020, April 15). Scientific reasoning as a predictor of health-related beliefs and behaviors in the time of COVID-19. https://doi.org/10.31234/osf.io/tfy5q