14 Matching Annotations
  1. Feb 2024
  2. Sep 2023
  3. Aug 2023
    1. Some may not realize it yet, but the shift in technology represented by ChatGPT is just another small evolution in the chain of predictive text with the realms of information theory and corpus linguistics.

      Claude Shannon's work along with Warren Weaver's introduction in The Mathematical Theory of Communication (1948), shows some of the predictive structure of written communication. This is potentially better underlined for the non-mathematician in John R. Pierce's book An Introduction to Information Theory: Symbols, Signals and Noise (1961) in which discusses how one can do a basic analysis of written English to discover that "e" is the most prolific letter or to predict which letters are more likely to come after other letters. The mathematical structures have interesting consequences like the fact that crossword puzzles are only possible because of the repetitive nature of the English language or that one can use the editor's notation "TK" (usually meaning facts or date To Come) in writing their papers to make it easy to find missing information prior to publication because the statistical existence of the letter combination T followed by K is exceptionally rare and the only appearances of it in long documents are almost assuredly areas which need to be double checked for data or accuracy.

      Cell phone manufacturers took advantage of the lower levels of this mathematical predictability to create T9 predictive text in early mobile phone technology. This functionality is still used in current cell phones to help speed up our texting abilities. The difference between then and now is that almost everyone takes the predictive magic for granted.

      As anyone with "fat fingers" can attest, your phone doesn't always type out exactly what you mean which can result in autocorrect mistakes (see: DYAC (Damn You AutoCorrect)) of varying levels of frustration or hilarity. This means that when texting, one needs to carefully double check their work before sending their text or social media posts or risk sending their messages to Grand Master Flash instead of Grandma.

      The evolution in technology effected by larger amounts of storage, faster processing speeds, and more text to study means that we've gone beyond the level of predicting a single word or two ahead of what you intend to text, but now we're predicting whole sentences and even paragraphs which make sense within a context. ChatGPT means that one can generate whole sections of text which will likely make some sense.

      Sadly, as we know from our T9 experience, this massive jump in predictability doesn't mean that ChatGPT or other predictive artificial intelligence tools are "magically" correct! In fact, quite often they're wrong or will predict nonsense, a phenomenon known as AI hallucination. Just as with T9, we need to take even more time and effort to not only spell check the outputs from the machine, but now we may need to check for the appropriateness of style as well as factual substance!

      The bigger near-term problem is one of human understanding and human communication. While the machine may appear to magically communicate (often on our behalf if we're publishing it's words under our names), is it relaying actual meaning? Is the other person reading these words understanding what was meant to have been communicated? Do the words create knowledge? Insight?

      We need to recall that Claude Shannon specifically carved semantics and meaning out of the picture in the second paragraph of his seminal paper:

      Frequently the messages have meaning; that is they refer to or are correlated according to some system with certain physical or conceptual entities. These semantic aspects of communication are irrelevant to the engineering problem.

      So far ChatGPT seems to be accomplishing magic by solving a small part of an engineering problem by being able to explore the adjacent possible. It is far from solving the human semantic problem much less the un-adjacent possibilities (potentially representing wisdom or insight), and we need to take care to be aware of that portion of the unsolved problem. Generative AIs are also just choosing weighted probabilities and spitting out something which is prone to seem possible, but they're not optimizing for which of many potential probabilities is the "best" or the "correct" one. For that, we still need our humanity and faculties for decision making.


      Shannon, Claude E. A Mathematical Theory of Communication. Bell System Technical Journal, 1948.

      Shannon, Claude E., and Warren Weaver. The Mathematical Theory of Communication. University of Illinois Press, 1949.

      Pierce, John Robinson. An Introduction to Information Theory: Symbols, Signals and Noise. Second, Revised. Dover Books on Mathematics. 1961. Reprint, Mineola, N.Y: Dover Publications, Inc., 1980. https://www.amazon.com/Introduction-Information-Theory-Symbols-Mathematics/dp/0486240614.

      Shannon, Claude Elwood. “The Bandwagon.” IEEE Transactions on Information Theory 2, no. 1 (March 1956): 3. https://doi.org/10.1109/TIT.1956.1056774.


      We may also need to explore The Bandwagon, an early effect which Shannon noticed and commented upon. Everyone seems to be piling on the AI bandwagon right now...

    1. While the proximate mechanisms of these anthropogenic changes are well studied (e.g., climate change, biodiversity loss, population growth), the evolutionary causality of these anthropogenic changes have been largely ignored.
      • for: climate change - evolutionary causes, cultural evolution - unsustainability, unsustainability
      • definition: Anthroecological theory (AET)
        • This theory proposes that the ultimate cause of anthropogenic environmental change is multi-level selection for niche construction and ecosystem engineering
    2. Anthroecological theory (AET) hypothesizes that human social and cultural evolution is the ultimate cause of the ecological crises currently damaging earth systems
      • for: AET, Anthroecological theory, anthropocene - causes, ecological crisis - roots, overshoot
      • paraphrase
        • Anthroecological theory (AET) hypothesizes that
          • human social and cultural evolution is the ultimate cause of the ecological crises currently damaging earth systems
      • for: gene culture coevolution, carrying capacity, unsustainability, overshoot, cultural evolution, progress trap

      • Title: The genetic and cultural evolution of unsustainability

      • Author: Brian F. Snyder

      • Abstract

      • Summary
      • Paraphrase
        • Anthropogenic changes are accelerating and threaten the future of life on earth.
        • While the proximate mechanisms of these anthropogenic changes are well studied
          • climate change,
          • biodiversity loss,
          • population growth
        • the evolutionary causality of these anthropogenic changes have been largely ignored.
        • Anthroecological theory (AET) proposes that the ultimate cause of anthropogenic environmental change is
          • multi-level selection for niche construction and ecosystem engineering.
        • Here, we integrate this theory with
          • Lotka’s Maximum Power Principle
        • and propose a model linking
          • energy extraction from the environment with
          • genetic, technological and cultural evolution
        • to increase human ecosystem carrying capacity.
        • Carrying capacity is partially determined by energetic factors such as
          • the net energy a population can acquire from its environment and
          • the efficiency of conversion from energy input to offspring output.
        • These factors are under Darwinian genetic selection
        • in all species,
        • but in humans, they are also determined by
          • technology and
          • culture.
        • If there is genetic or non-genetic heritable variation in
          • the ability of an individual or social group
        • to increase its carrying capacity,
        • then we hypothesize that - selection or cultural evolution will act - to increase carrying capacity.
        • Furthermore, if this evolution of carrying capacity occurs - faster than the biotic components of the ecological system can respond via their own evolution,
          • then we hypothesize that unsustainable ecological changes will result.
  4. Dec 2022
    1. I’m reminded of an old poem by Bertolt Brecht, which my Viennese grandmother, the daughter of a lifelong socialist and union man, taught me. It’s called “Questions From a Worker Who Reads”:

      Bertolt Brecht has a poem "Questions From a Worker Who Reads" which points out how necessary societies are to their great accomplishments which can't ever be solely attributed to kings and leaders as if there is only a "Great Man theory of history".

  5. Aug 2022
  6. Feb 2022
  7. Sep 2021
    1. The Virginians needed labor, to grow corn for subsistence, to grow tobaccofor export. They had just figured out how to grow tobacco, and in 1617 theysent off the first cargo to England. Finding that, like all pleasurable drugstainted with moral disapproval, it brought a high price, the planters, despitetheir high religious talk, were not going to ask questions about something soprofitable.

      Told from this perspective and with the knowledge of the importance of the theory of First Effective Settlement, is it any wonder that America has grown up to be so heavily influenced by moral and mental depravity, over-influenced by capitalism and religion, ready to enslave others, and push vice and drugs? The founding Virginians are truly America in miniature.

      Cross reference: Theory of First Effective Settlement

      “Whenever an empty territory undergoes settlement, or an earlier population is dislodged by invaders, the specific characteristics of the first group able to effect a viable, self-perpetuating society are of crucial significance for the later social and cultural geography of the area, no matter how tiny the initial band of settlers may have been.” “Thus, in terms of lasting impact, the activities of a few hundred, or even a few score, initial colonizers can mean much more for the cultural geography of a place than the contributions of tens of thousands of new immigrants a few generations later.” — Wilbur Zelinsky, The Cultural Geography of the United States, Englewood Cliffs, NJ: Prentice-Hall, 1973, pp. 13–14.

  8. Jun 2021
  9. Feb 2021
    1. cultural capital

      Introduced by Pierre Bourdieu in the 1970s, the concept has been utilized across a wide spectrum of contemporary sociological research. Cultural capital refers to ‘knowledge’ or ‘skills’ in the broadest sense. Thus, on the production side, cultural capital consists of knowledge about comportment (e.g., what are considered to be the right kinds of professional dress and attitude) and knowledge associated with educational achievement (e.g., rhetorical ability). On the consumption side, cultural capital consists of capacities for discernment or ‘taste’, e.g., the ability to appreciate fine art or fine wine—here, in other words, cultural capital refers to ‘social status acquired through the ability to make cultural distinctions,’ to the ability to recognize and discriminate between the often-subtle categories and signifiers of a highly articulated cultural code. I'm quoting here from (and also heavily paraphrasing) Scott Lash, ‘Pierre Bourdieu: Cultural Economy and Social Change’, in this reader.

  10. Jan 2017
    1. The so-called ‘cultural’ turn in literary studies since the 1970s, with its debt to postmodern understandings of the relationship between power and narrative, has pushed the field away from such systematic, semi-mechanistic ways of analysing texts. AI remains concerned with formal patterns, but can nonetheless illuminate key aspects of narrative, including time, space, characters and plot.
  11. Feb 2014
    1. The fourth of the theories is as yet the least influential but seems to be gaining strength. Its key ideas are that human nature causes people to flourish more under some conditions than under others, and that social and political institutions should be organized to facilitate that flourishing. What, more specifically, are the conditions or “functionings” that enable people to flourish?
      • Life
      • Health
      • Bodily integrity – protection against physical hazards and against physical and sexual assault
      • Autonomy – in the sense of the ability to choose freely one’s vocations and avocations
      • Competence – the ability to confront and solve problems
      • Engagement – active involvement in professional and leisure activity, as opposed to passive consumption of goods and services
      • Self-expression – the ability to speak one’s mind and express one’s creative impulses
      • Relationships – participation in freely chosen communities
      • Privacy – access to zones of intimacy in which relationships can be nurtured and identity developed