calling for a more meaningful reporting of statistical inference based on effect sizes, confidence intervals and Bayesian reasoning [9].
Effect sizes are mentioned
calling for a more meaningful reporting of statistical inference based on effect sizes, confidence intervals and Bayesian reasoning [9].
Effect sizes are mentioned
P8 said: "as I get familiar with this system [C3], I feel more skilled" to use the highlighted and grayed phrases.
any sentence that describes a user's emotional (positive or negative) response to any condition in the experiments.
It is worth noting that P3 and P8 mentioned feeling more comfortable with the more familiar visualization in C1 and C2 during their first impression of the conditions.
any sentence that describes a user's emotional (positive or negative) response to any condition in the experiments.
The inclusion of counterfactuals often resulted in a substantial increase in precision, indicating that the models were better able to correctly classify relevant instances while reducing false positives.
statements that draw general conclusions about humans, computers, and/or human-computer interaction based on the results of the specific experiment done in the paper.
By visualizing these consistent pattern rules, users may be better understanding the behavior of the model through inference projection.
statements that draw general conclusions about humans, computers, and/or human-computer interaction based on the results of the specific experiment done in the paper.
Mocha addresses two seemingly contradictory objectives: (1) generating labeled data that diversifies the training dataset to aid the model's learning, and (2) maintaining structural consistency across the batches of data presented to users to support their cognitive processes.
statements that draw general conclusions about humans, computers, and/or human-computer interaction based on the results of the specific experiment done in the paper.
The results of our study indicate that participants spent significantly less time annotating batches of counterfactuals when they were rendered according to SAT compared to other conditions i.e., supporting the participants' selective focus on the varying phrases, rather than phrases that stay consistent.
statements that draw general conclusions about humans, computers, and/or human-computer interaction based on the results of the specific experiment done in the paper.
From a cognitive perspective, the theme color aligns with the human's (theorized) structural mapping engine [27] by making relational discrepancies between the original and counterfactual examples more explicit.
return any single sentence that describes an explicit or implicit connection to theory
Estes and Hasson [17] highlights the significant role of bringing salience to 'non-alignable' differences.
return any single sentence that describes an explicit or implicit connection to theory
The last two prior works also combine Variation Theory (VT) and SAT together, as we did (i.e., a corollary of SAT referred to as Analogical Transfer/Learning Theory).
return any single sentence that describes an explicit or implicit connection to theory
Estes and Hasson [17] highlights the significant role of bringing salience to "non-alignable" differences.
return any single sentence that describes an explicit or implicit connection to theory
Estes and Hasson [17] argue that while alignable differences can be more straightforward and easier for comparison, non-alignable differences can also provide key information that might otherwise remain overlooked.
return any single sentence that describes an explicit or implicit connection to theory
By incorporating theories such as Structural Alignment Theory and Variation Theory, it aims to support the learning of both the human and the model.
return any single sentence that describes an explicit or implicit connection to theory
This symbiotic relationship stems from the fact that Structural Alignment Theory (SAT) enhances the salience of differences, while the way we used Variation Theory (VT) to generate contradicting examples across the boundaries of labels ensures that these differences are conceptually informative.
return any single sentence that describes an explicit or implicit connection to theory
It states that understanding and sensemaking involve mapping the relationships between elements, especially in complex and ambiguous tasks.
return any single sentence that describes an explicit or implicit connection to theory
Structural Alignment Theory states that humans naturally look for structural mapping between representations of objects to help them understand, compare, and infer relationships between said objects.
return any single sentence that describes an explicit or implicit connection to theory
According to Variation Theory, learners better understand concepts by observing variations along critical features (dimensions of variation) that define that concept and, separately, observing variations along superficial features that do not define that concept—all while other features, when possible, are held constant.
return any single sentence that describes an explicit or implicit connection to theory
Mocha exemplified the application of human cognition and concept learning theories in the interactive machine learning pipeline to support the negotiation of conceptual boundaries for bi-directional human-AI alignment.
statements that draw general conclusions about humans, computers, and/or human-computer interaction based on the results of the specific experiment done in the paper.
This pattern of selective attention suggests that the visual cues provided by Mocha effectively guided participants to focus on more relevant information within the context of unchanged text when making their labeling decisions.
statements that draw general conclusions about humans, computers, and/or human-computer interaction based on the results of the specific experiment done in the paper.
Overall, the incorporation of counterfactuals has generally improved the models' F1 scores, driven largely by the improvements in precision. This suggests that counterfactuals have effectively improved performance without necessitating a significant trade-off between precision and recall.
statements that draw general conclusions about humans, computers, and/or human-computer interaction based on the results of the specific experiment done in the paper.
The inclusion of counterfactuals often resulted in a substantial increase in precision, indicating that the models were better able to correctly classify relevant instances while reducing false positives. This improvement suggests that the counterfactuals provided essential information that helped refine the models' decision boundaries.
statements that draw general conclusions about humans, computers, and/or human-computer interaction based on the results of the specific experiment done in the paper.
By visualizing these consistent pattern rules, users may be better understanding the behavior of the model through inference projection [26]. This can not only boosts the model's performance but also enable participants to validate or correct the model during the interactive training process.
statements that draw general conclusions about humans, computers, and/or human-computer interaction based on the results of the specific experiment done in the paper.
Thus, the integration of both theories enables users to efficiently process and compare variations, leading to more informed decisions and a clearer understanding of the model's behavior.
statements that draw general conclusions about humans, computers, and/or human-computer interaction based on the results of the specific experiment done in the paper.
By helping users see alignable differences, SAT-based rendering helps users focus on key variations that are essential to changing the data item's label, making it easier to interpret the effects of changes and their significance.
statements that draw general conclusions about humans, computers, and/or human-computer interaction based on the results of the specific experiment done in the paper.
We argue that these two theories form a symbiotic relationship (Fig. 6). Variation Theory provides the conceptual basis for generating structurally consistent differences, while Structural Alignment Theory (SAT) enhances the user's ability in recognizing and processing these differences.
statements that draw general conclusions about humans, computers, and/or human-computer interaction based on the results of the specific experiment done in the paper.
Participants were able to efficiently focus on key differences between the original and counterfactual examples, which facilitated more efficient annotations.
statements that draw general conclusions about humans, computers, and/or human-computer interaction based on the results of the specific experiment done in the paper.
The results from our user study suggest that both the participants and the model benefited from the Variation Theory (VT)-based counterfactuals and Structural Alignment Theory (SAT)-based rendering.
statements that draw general conclusions about humans, computers, and/or human-computer interaction based on the results of the specific experiment done in the paper.
Specifically, they underscore the need for co-adaptive systems that can evolve along with users' mental models and definitions of labels.
any sentence that describes explicit design implications
This requires the development of interfaces and visualizations that demystify the generated data, allowing systematic variation and coverage across the concept space.
any sentence that describes explicit design implications
By visualizing these consistent pattern rules, users may be better understanding the behavior of the model through inference projection [26].
any sentence that describes explicit design implications
By incorporating theories such as Structural Alignment Theory and Variation Theory, it aims to support the learning of both the human and the model.
any sentence that describes explicit design implications
Such studies could determine whether these non-alignable comparisons enhance user performance and elicit deeper insights in human-AI collaborative systems.
any sentence that describes explicit design implications
Most previous research in counterfactual generation has focused on the model side by either generating counterfactuals to improve the model's performance or explaining its behaviors post hoc.
any single sentence that compares and contrasts this work with prior work.
Variation Theory provides the conceptual basis for generating structurally consistent differences, while Structural Alignment Theory (SAT) enhances the user's ability in recognizing and processing these differences.
return any single sentence that describes an explicit or implicit connection to theory
While SAT-based rendering supported human sensemaking in both Gero et al. [29] and Mocha, we also show that the combination of VT and SAT support the model's learning.
any single sentence that compares and contrasts this work with prior work.
This finding is consistent with previous work that supports users' sense-making of text, e.g., by modulating text saliency. Specifically, Gu et al. [32] and Gero et al. [29] both found improved reading efficiency and comprehension with saliency-modulating text renderings.
any single sentence that compares and contrasts this work with prior work.
In decision making, SAT argues that people tend to focus on alignable differences—features that can be directly compared—rather than on differences that cannot be easily aligned.
return any single sentence that describes an explicit or implicit connection to theory
Structural Alignment Theory (SAT) [27] is a cognitive theory that explains how people make sense of concepts by comparing relational structures between two items.
return any single sentence that describes an explicit or implicit connection to theory
Specifically, we use Variation Theory of learning [44] which states that for learning to occur, some aspects that define the concept being learned must vary while others are held constant.
return any single sentence that describes an explicit or implicit connection to theory
According to SAT, humans compare two similar entities by trying to find structural alignments between them, and then comparing corresponding elements, with a special focus on differing aligned elements.
return any single sentence that describes an explicit or implicit connection to theory
VT posits that human learning occurs when learners experience variation across critical and superficial aspects of a concept—through exposure to contrasting examples that systematically vary along different critical and superficial feature dimensions.
return any single sentence that describes an explicit or implicit connection to theory
To analyze the annotation efficiency, we first conducted a Kruskal-Wallis rank sum test [39] to determine if there were statistically significant differences in annotation time across the three conditions, because our data violated the homogeneity of variances assumption, making non-parametric methods more appropriate.
return any single sentence that describes data analysis done on data collected by the authors when running human subjects experiments.
Mohamed et al. (2020) put forth the idea of dismantling power assymmetries to resist data colonialism.
sentence that refers to a theory
Couldry and Mejias (2019) propose 'data colonialism' as a new form of colonialism to make sense of the use of large amounts of data by a small group of corporate and government actors.
sentence that refers to a theory
Taken together, these findings almost unanimously show that, on average, AI-supported writing decreases but does not eliminate writer's feelings of ownership, underscoring the need for a larger theory of AI participation in the creative process.
sentence that refers to a theory
This can be understood through the frame of precarious work [5]; as writers feel that their work is increasingly precarious, the power differential between themselves and the organizations seeking to train LLMs grows larger.
sentence that refers to a theory
information scholars argue that data should be collected and used in accordance with data subjects' perspectives on the acceptable use of their data [29, 40, 83].
sentence that refers to a theory
benchmarking AI against programming eval: discoverability, interpretation, predictability
Correspondence concerning this article should be addressed to Iza Ray Korsmit (iza.korsmit@mail.mcgill.ca).
reference to Montreal the city or any institution or author based there
The experimental protocol was certified for ethical compliance by the McGill University Research Ethics Board II.
reference to Montreal the city or any institution or author based there
IRK was supported by funding from the Prins Bernhard Cultuurfonds (The Netherlands). This project was also funded by a Canadian Social Sciences and Humanities Research Council Insight Grant (435-2021-0224), a Social Sciences and Humanities Research Council Partnership Grant (895-2018-1023), and a Canada Research Chair (950-231872) to SMc.
reference to Montreal the city or any institution or author based there
Part of this research was presented at the Society for Music Perception and Cognition Conference, Portland, Oregon (2022). The authors would like to thank Bennett K. Smith for programming the experimental interface and assisting with the experiment execution on Prolific, and Philippe Macnab-Seguin for creating the chromatic scales for the second experiment.
reference to Montreal the city or any institution or author based there
Iza Ray Korsmit, Marcel Montrey, Alix Yok Tin Wong-Min, & Stephen McAdams McGill University, Montreal, Canada
reference to Montreal the city or any institution or author based there
Grimaud and Eerola (2022) compared instrument ensembles of strings, woodwinds, and brass in a study where participants either rated the emotions they perceived or manipulated musical parameters to produce a certain emotion. They found that strings were associated with increased anger and fear, woodwinds with decreased anger and fear, and brass with decreased fear, in the cases of both emotion perception and production. For the other emotions (joy, sadness, calmness, power, surprise), however, results were less consistent between perception and production, indicating that the emotion-instrument association may also depend on context of the task.
makes an explicit connection between a music theory concept and congition
following the constructionist idea that an individual's personality and background will influence the affect they perceive or feel, we considered several sources of individual differences as moderating factors in the effects of instrument family, pitch height, and affect locus.
makes an explicit connection between a music theory concept and congition
This research follows a constructionist approach to musical affect (Cespedes-Guevara & Eerola, 2018). That is, although we are interested in the "bottom-up" influence of certain musical features on musical affect, we believe these cannot be adequately evaluated without considering the "top-down" effects of context and individual differences that are present when affects are constructed. The perception or induction of affect does not merely arise in response to a stimulus but is also formed in relation to the individual and the context.
makes an explicit connection between a music theory concept and congition
the context of a task (like perception, production, or induction) may change the effect of musical features.
makes an explicit connection between a music theory concept and congition
Furthermore, as the method of reporting on perceived and induced affect may influence the construction of an affect (e.g., facilitating categorical perception), we also compare two different affect representations.
makes an explicit connection between a music theory concept and congition
This research follows a constructionist approach to musical affect (Cespedes-Guevara & Eerola, 2018). That is, although we are interested in the \'bottom-up\' influence of certain musical features on musical affect, we believe these cannot be adequately evaluated without considering the \'top-down\' effects of context and individual differences that are present when affects are constructed. The perception or induction of affect does not merely arise in response to a stimulus but is also formed in relation to the individual and the context.
makes an explicit connection between a music theory concept and congition
Cognitive surrenderA paper that came out this year asked: if you’re working with AI a lot, and you’re using it as a machine to answer all of your questions, what happens with System 1 and System 2?
Cognitive surrender: what happens to System 1 and System 2 if you offload to AI to get any answers? (Is this diff from other cognitive tools, like writing and Plato's rejection of it?)
The paper is https://doi.org/10.31234/osf.io/yk25n_v1 and it posits AI offloading as System 3. That is an interesting perspective. Thinking—Fast, Slow, and Artificial: How AI is Reshaping Human Reasoning and the Rise of Cognitive Surrender by Shaw and Nave, 2026. Thinking—Fast, Slow, and Artificial: How AI is Reshaping Human Reasoning and the Rise of Cognitive Surrender in Zotero
2. Validator Another basic role for AI is validating your understanding. To do this, you ask it to review your notes for errors or gaps, do basic fact checking, or critique your reasoning. Again, you can do this via the chat interface, but I also experimented with passing my notes in Obsidian using the Copilot plugin and in Emacs using gptel. Example: After reading The Epic of Gilgamesh, I wrote a note in Obsidian summarizing its plot. When I asked ChatGPT to critique my summary, it pointed out that I’d given the central character a redemption arc that isn’t present in the text. I’m so accustomed to the standard hero’s journey, that I projected it onto the book — and an LLM helped me correct this ‘hallucination.’ Suggested prompt: Here are my notes on [WORK]. What important ideas did I miss or underemphasize? Don’t rewrite my notes — just flag the gaps.
Role 2 validator of one's understanding, also seen as basic. Might be a good complement to e.g. turning some of my notes into [[Anki]] card decks or combine in another way w spaced repetition. [[Spaced repetition 20201012201559]] [[Connecting my PKM to Anki]]
[[Jorge Arango p]] talk at PKM Summit 2026 robots in the garden, a perspective on PKM and the use of gen AI in it
list of scenario's in which AI agents will a) work against you b) be used against you at scale.
For the record, my posts aren’t written or conceived with an LLM, although I know an increasing number of people who use one to write a first draft and then edit. I’m not a fan. The whole point of the web — its beauty — is that it’s unrelentingly human and diverse.
A good case for disfavoring the use of AI/LLMs to write first drafts of blog posts. Implicit I believe is a distinction between using external tools to edit/proofread a human-written draft vs editing/proofreading a machine draft (granting I do not use these tools for either). Related to points I raised in Re; On AI in response to: A Positive Technologist Identity (2/4).
Given the high prevalence of such sounds in everyday life, having misophonia can have large negative effects on one's functioning in personal, academic, and work environments.
any sentences referring to misophonia verbatim
Although there are many idiosyncrasies in what may trigger a person with misophonia, the most common triggers are created by other humans, such as the sound of someone chewing, clearing their throat, tapping their foot, or typing on a keyboard.
any sentences referring to misophonia verbatim
Misophonia is a psychological disorder that is characterized by severe aversive responses to specific environmental sounds (i.e., triggers).
any sentences referring to misophonia verbatim
This indicates that misophonia is not a purely auditory processing disorder but is also influenced by a top-down process of source identification.
any sentences referring to misophonia verbatim
an fMRI study found that people with misophonia show increased response in the anterior insular cortex (AIC) in response to misophonic sounds, compared to control participants and other unpleasant or neutral sounds (Kumar et al., 2017).
any sentences referring to misophonia verbatim
Both the subjective judgment of aversiveness and the physiological measure of skin conductance response (SCR) increase when people with misophonia are presented with triggers (Edelstein et al., 2013).
any sentences referring to misophonia verbatim
The disorder is not yet recognized by the Diagnostic and Statistical Manual − 5th version (DSM-5; American Psychiatric Association, 2013), but there has been an increasing amount of research on the characterization and treatment of misophonia (Vitoratou et al., 2021; see also Brout et al., 2018, for a review).
any sentences referring to misophonia verbatim
Composers and music researchers had previously analyzed and annotated 65 movements from the Classical, Romantic, and early Modern repertoire in terms of the Taxonomy of Orchestral Grouping Effects (McAdams et al., 2022).
please find any claims that depend on citations referring to works by any of the present authors
In a study by McAdams and Goodchild (2018), orchestral simulations created with OrchSim were compared perceptually to commercial recordings and were shown to be of high quality.
please find any claims that depend on citations referring to works by any of the present authors
These results confirm with orchestral excerpts the findings of studies on isolated tones with dyads or triads of instruments in which the presence of impulsive instruments reduces the perception of blend (Lembke et al., 2019; Reuter, 1996; Tardieu & McAdams, 2012).
please find any claims that depend on citations referring to works by any of the present authors
This provides additional support for its significant contribution to blend in Fischer et al. (2021).
please find any claims that depend on citations referring to works by any of the present authors
Lembke et al. (2017) demonstrated that combinations of sustained and impulsive instruments blend less well.
please find any claims that depend on citations referring to works by any of the present authors
structuring by affecting sequential grouping through the segregation of auditory streams played by different instruments and segmental grouping through timbral contrasts (McAdams et al., 2022).
please find any claims that depend on citations referring to works by any of the present authors
Several other spectral and spectrotemporal descriptors were found to play a role in blend perception in orchestral works by Fischer et al. (2021). These include spectral flatness and spectral crest (different measures of the degree to which the spectrum is denser or has more emergence of spectral components), and spectral variation (the degree of variation of the spectral shape over time).
please find any claims that depend on citations referring to works by any of the present authors
Fischer et al. (2021) studied the blends of multi-instrument streams in the context of orchestral stream segregation in predominantly Romantic orchestral excerpts. They found that within-family instrument combinations blended better than between-family combinations. They demonstrated the role played by overlap in timbre correlates of spectral flatness (a measure of the tonalness/noisiness or density of the spectrum), spectral skewness (related to the shape of the spectral envelope), and spectral variation (evolution of the spectral envelope over time), as well as cues derived from the scores such as onset synchrony and the consonance of concurrent pitch relations.
please find any claims that depend on citations referring to works by any of the present authors
McAdams et al. (2022) distinguish two subcategories of these two types of blend: stable and transforming.
please find any claims that depend on citations referring to works by any of the present authors
Lembke, S.-A., Parker, K., Narmour, E., & McAdams, S. (2019). Acoustical correlates of perceptual blend in timbre dyads and triads. Musicae Scientiae, 23(2), 250–274.
please find any claims that depend on citations referring to works by any of the present authors
Several other spectral and spectrotemporal descriptors were found to play a role in blend perception in orchestral works by Fischer et al. (2021).
please find any claims that depend on citations referring to works by any of the present authors
Lembke and McAdams (2015) found that the degree of spectral overlap between constituent sounds enhanced blend perception.
please find any claims that depend on citations referring to works by any of the present authors
Tardieu and McAdams (2012) extended this work with combinations of unison sustained and impulsive instruments (including pitched percussion and string pizzicati).
please find any claims that depend on citations referring to works by any of the present authors
McAdams et al. (2022) introduce other notions related to blend as well.
please find any claims that depend on citations referring to works by any of the present authors
This in turn creates an effect of perceptual unity (McAdams, 1989).
please find any claims that depend on citations referring to works by any of the present authors
Four important concurrent grouping cues predict the perceptual fusion of sound events (McAdams, 1984): onset synchrony, harmonicity, coherent frequency behavior, and common spatial origin.
please find any claims that depend on citations referring to works by any of the present authors
To this, McAdams et al. (2022) have added segmental grouping (chunking into perceptual units).
please find any claims that depend on citations referring to works by any of the present authors
When the sudden drop to a pianissimo occurred towards the ending of the piece, the perceived arousal responses of CHM and WM dropped slightly but rose again immediately to end on a high arousal. These two groups of listeners appear to have anticipated a return to a loud and majestic close and therefore kept their arousal responses higher than those of the NM.
please highlight anything related to music performance practice
CHM, who are more experienced with the instruments and compositional techniques used in Chinese orchestral music, might have had an idea of which features figure more prominently in the communication of particular intentions, and therefore would have more information available for their judgments.
please highlight anything related to music performance practice
The perception of affective intentions in music is influenced by the degree of familiarity listeners have with a musical tradition, the content implicated in the music, and the complex sonic environment created by the composer's creation and the musicians' interpretation.
please highlight anything related to music performance practice
The version that participants heard was a premier of the work by the Taipei Chinese orchestra.
please highlight anything related to music performance practice
The communication of emotions or affect takes place when listeners perceive emotional meaning that is expressed by performers in music (Juslin, 2013a, 2013b).
please highlight anything related to music performance practice
An understanding of a tonal schema with its associations to happiness and sadness has been consistently found to influence listeners who have grown up in a culture of Western music.
please highlight anything related to music theory
Its mirmode function estimates the modal strength of the music in terms of ''majorness'' and ''minorness.''
please highlight anything related to music theory
The perception of consonance also plays an important role in the music listening process—combinations of tones that are consonant are perceived as more positively valenced than dissonant ones (Harrison & Pearce, 2020).
please highlight anything related to music theory
Musical structures such as pitch relations are perceptually salient and provide important information for listeners (e.g., Gabrielsson & Lindstrom, 2010; Krumhansl, 1998; Krumhansl & Kessler, 1982).
please highlight anything related to music theory
Iqa' (plural iqa'at) is used to describe a rhythmic cycle. Iqa'at are made up of two different basic building blocks, the dum and tak, onomatopoeias derived from the sound produced on membranophones such as the darabuka.
please highlight anything related to music theory
H5. Being more culturally bound, musical cues that are learned, such as modal structures, metrical relations, and so on, will exert a greater influence on listeners' perceived valence ratings than on their arousal ratings.
please highlight anything related to music theory
This is a simple PDF file. Fun fun fun.
testing something new today
using SemanticCommit, we recorded all instances of edits, check for conflicts, make change, local, and global resolution actions using telemetry.
sentences describing methods the authors used; one sentence at a time
A sub-task was considered a failure if the participant was unable to complete it within the time limit.
sentences describing methods the authors used; one sentence at a time
Finally, we conducted an informal interview about their experience.
sentences describing methods the authors used; one sentence at a time
After both tasks were completed, participants filled out a final survey to compare the two conditions.
sentences describing methods the authors used; one sentence at a time
We chose GPT-4o for performance and latency reasons, as it performed optimally against our evals.
sentences describing methods the authors used; one sentence at a time
We also ran evaluations of model latency and classification performance under varying false positive rates for the following LLMs by OpenAI: GPT-4o, GPT-4o-mini, and o3-mini.
sentences describing methods the authors used; one sentence at a time
For each task, participants were tasked with integrating three new pieces of information into the memory, one at a time ("sub-tasks").
sentences describing methods the authors used; one sentence at a time
We ensured each list was 30 items long as our pilot studies suggested this was long enough that manual detection starts to become unwieldy (users need to scroll up and down the document), but short enough that participants could become familiar in a short period.
sentences describing methods the authors used; one sentence at a time
We adapted two intent specifications from our evals: Mars Game Design Document and Financial Advice AI Agent Memory, as these tasks mapped to the two paradigmatic types covered in Sections 2 and 2.1 (design documents, and AI memory of the user).
sentences describing methods the authors used; one sentence at a time
We recruited 12 participants (7 female, 5 male) through the mailing lists of two research universities and one multinational technology company.
sentences describing methods the authors used; one sentence at a time
We chose OpenAI's ChatGPT Canvas as a baseline for five reasons: (i) it is a popular, commercially available tool, hence it is likely familiar to users; (ii) it provides a document editing view, where users can select text and ask GPT to rewrite it, or chat with an AI to make global edits; (iii) it employs a similar class of model (GPT-4o); (iv) it supports similar editing features as SemanticCommit like inline text selection, conflict highlighting, and a diff view, while adding free-form editing; and (v) similar interfaces like Anthropic Artifacts tended to rewrite the specification entirely, and did not offer Canvas's "diff" view to allow for a fair comparison.
sentences describing methods the authors used; one sentence at a time
With participant consent, we recorded audio and screen-casts, and participants were encouraged to think aloud.
sentences describing methods the authors used; one sentence at a time
Four coauthors created the evals, and two coauthors manually double-checked all conflicts, a process that took several days.
sentences describing methods the authors used; one sentence at a time
We ran one pilot study with five users of our card-based interface, and a second with four users of a revised interface.
sentences describing methods the authors used; one sentence at a time
Our explorations went through substantial iterations and prompt prototyping over a period of eight months, evolving in response to two pilot studies and progressing from a card-based interface to a list of texts.
sentences describing methods the authors used; one sentence at a time
We iterated on prompts using ChainForge [5] by setting up an evaluation pipeline against our datasets, which allowed us to observe the effects of prompt changes and model choices.
sentences describing methods the authors used; one sentence at a time
To measure statistical significance, we used Mann–Whitney–Wilcoxon tests and report the p-values.
sentences describing methods the authors used; one sentence at a time
For qualitative analysis, the first author performed open coding on participant responses and audio transcripts to identify themes, which were used to interpret the qualitative results.
sentences describing methods the authors used; one sentence at a time
In the post-task surveys, we collected self-reported NASA Task Load Index (TLX) scores, Likert-scale ratings for ease of use, and responses on how well the AI helped participants identify, understand, and resolve semantic conflicts.
sentences describing methods the authors used; one sentence at a time
Each condition had a time limit of 15 minutes, after which the participant completed a post-task survey.
sentences describing methods the authors used; one sentence at a time
Before each task, participants received a tutorial on the assigned tool and were given five minutes to explore it using a test document.
sentences describing methods the authors used; one sentence at a time
Both the order of task assignment and tool assignment were counterbalanced and randomly assigned.
sentences describing methods the authors used; one sentence at a time
We conducted a controlled within-subjects study with mixed methods, comparing SemanticCommit with a baseline interface.
sentences describing methods the authors used; one sentence at a time
We run end-to-end on our four eval datasets using GPT-4o and GPT-4o-mini and report the mean ± stddev for accuracy, precision, recall, and F1 scores for the three approaches in Figure 5.
sentences describing methods the authors used; one sentence at a time
We compare our end-to-end system against two simpler methods: (i) DropAllDocs, which adds all documents to the context for conflict classification; and (ii) InkSync [56] which generates a JSON list of string-replace operations.
sentences describing methods the authors used; one sentence at a time
In order to minimize relevance assessment issues, we apply a PageRank-based relevance ranking over the KG, akin to HippoRAG [36].
sentences describing methods the authors used; one sentence at a time
We implement the back-end using a knowledge-graph (KG) RAG architecture [36] consisting of two phases: pre-processing and inference.
sentences describing methods the authors used; one sentence at a time
Through a within-subjects study with 12 participants comparing SemanticCommit to a chat-with-document baseline (OpenAI Canvas), we find differences in workflow: half of our participants adopted a workflow of impact analysis when using SemanticCommit, where they would first flag conflicts without AI revisions then resolve conflicts locally, despite having access to a global revision feature.
sentences describing methods the authors used; one sentence at a time
We implement the back-end using a knowledge-graph (KG) RAG architecture [36] consisting of two phases: pre-processing and inference.
sentences describing methods the authors used; one sentence at a time
In order to minimize relevance assessment issues, we apply a PageRank-based relevance ranking over the KG, akin to HippoRAG [36].
sentences describing methods the authors used; one sentence at a time
We compare our end-to-end system against two simpler methods: (i) DropAllDocs, which adds all documents to the context for conflict classification; and (ii) InkSync [56] which generates a JSON list of string-replace operations.
sentences describing methods the authors used; one sentence at a time
We run end-to-end on our four eval datasets using GPT-4o and GPT-4o-mini and report the mean ± stddev for accuracy, precision, recall, and F1 scores for the three approaches in Figure 5.
sentences describing methods the authors used; one sentence at a time
We conducted a controlled within-subjects study with mixed methods, comparing SemanticCommit with a baseline interface.
sentences describing methods the authors used; one sentence at a time
Both the order of task assignment and tool assignment were counterbalanced and randomly assigned.
sentences describing methods the authors used; one sentence at a time
Before each task, participants received a tutorial on the assigned tool and were given five minutes to explore it using a test document.
sentences describing methods the authors used; one sentence at a time
Each condition had a time limit of 15 minutes, after which the participant completed a post-task survey.
sentences describing methods the authors used; one sentence at a time
In the post-task surveys, we collected self-reported NASA Task Load Index (TLX) scores, Likert-scale ratings for ease of use, and responses on how well the AI helped participants identify, understand, and resolve semantic conflicts.
sentences describing methods the authors used; one sentence at a time
For qualitative analysis, the first author performed open coding on participant responses and audio transcripts to identify themes, which were used to interpret the qualitative results.
sentences describing methods the authors used; one sentence at a time
To measure statistical significance, we used Mann–Whitney–Wilcoxon tests and report the p-values.
sentences describing methods the authors used; one sentence at a time
We iterated on prompts using ChainForge [5] by setting up an evaluation pipeline against our datasets, which allowed us to observe the effects of prompt changes and model choices.
sentences describing methods the authors used; one sentence at a time
Our explorations went through substantial iterations and prompt prototyping over a period of eight months, evolving in response to two pilot studies and progressing from a card-based interface to a list of texts.
sentences describing methods the authors used; one sentence at a time
We ran one pilot study with five users of our card-based interface, and a second with four users of a revised interface.
sentences describing methods the authors used; one sentence at a time
Four coauthors created the evals, and two coauthors manually double-checked all conflicts, a process that took several days.
sentences describing methods the authors used; one sentence at a time
With participant consent, we recorded audio and screen-casts, and participants were encouraged to think aloud.
sentences describing methods the authors used; one sentence at a time
These semantic conflicts require dedicated support to detect, visualize, and resolve. Semantic conflict resolution interfaces must go beyond visualizing what changes were made, to what changes could be made, where they should be made, and what the effects might be. This resembles feedforward: affordances that help the user foresee the impact of an action [67, 93].
sentences describing connections to theory; one sentence at a time
Today with LLMs, we are less limited by this constraint, and solutions to the problem of human-machine communication might be better found in cybernetics theory [9] than static formalism.
sentences describing connections to theory; one sentence at a time
This reflects the principle of feedforward [67, 93] in communication theory—"a needed prescription or plan for a feedback, to which the actual feedback may or may not confirm" [79]—where a communicator provides "the context of what one was planning to talk about" [64, p. 179-80] in order to "pre-test the impact of [its output]" on the listener [34, p. 65].
sentences describing connections to theory; one sentence at a time
One illustration is using menus, instructions, graphical user interfaces (GUI), or virtual reality to access any particular computer's features.
sentence about GUIs
An appealing alternative to conventional text-based interfaces through graphical user interfaces is the direct use of hands as an input device to provide natural human-computer interaction.
sentence about GUIs
A more thorough description of the current tools and techniques for interacting with computers as well as recent developments in the subject is provided in the next section.
sentence about GUIs
The evolving multi-modal and Graphical user interfaces (GUI) enable humans to interact with embodied character agents in a way that is not possible with other interface paradigms.
sentence about GUIs
The widely used graphical user interfaces (GUI) of today are found in desktop applications, internet browsers, mobile computers, and computer kiosks.
sentence about GUIs
and the narrowing of the medullary cavity of tubular bones (C) (diaphyseal stenosis).
Subject ID: Individual_2 Phenotype: Narrowing of the medullary cavity of tubular bones
In this work, we introduce a new paradigm for exploring a large corpus of small documents by identifying roles at the phrasal and sentence levels, then slice on, reify, group, and/or align the text itself on those roles, with sentences left intact.
please find me the main contributions of this paper
AbstractExplorer instantiates new minimally lossy SMT-informed techniques for skimming, reading, and reasoning about a corpus of similarly structured short documents: phrase-level role classification that drives sentence ordering, highlighting, and spatial alignment.
please find me the main contributions of this paper
AbstractExplorer has a unique combination of LLM-powered (1) faceted comparative close reading with (2) role highlighting enhanced by (3) structure-based ordering and (4) alignment. An ablation study (N=24) validated that these features work best together. A summative study (N=16) describes how these features support users in familiarizing themselves with a corpus of paper abstracts from a single large conference with over 1000 papers.
please find me the main contributions of this paper
We contribute: • Novel SMT theory-informed text analysis and rendering techniques for enabling cross-document skimming and comparative close reading at scale • AbstractExplorer, which instantiates these techniques for familiarizing oneself with a corpus of ∼1000 CHI paper abstracts. • Three studies informing and evalutaing the benefits, challenges, and interactions between these techniques.
please find me the main contributions of this paper
for - AI - Bayesian teaching paper - Google
for - AI - biological neural networks - AI - mortal computing
Ai and taxation
However, in a narrow set of cases, we believe AI can undermine, rather than defend, democratic values. Some uses are also simply outside the bounds of what today’s technology can safely and reliably do. Two such use cases have never been included in our contracts with the Department of War, and we believe they should not be included now:
Humans as API, bc [[Alles is een API 20260309095254]]
(via [[Stephen Downes p]]
the 'am dash', as opposed to the em dash. A human only glyph that AI 'can't use'
I tnink there I am dash
The real annoying thing about Opus 4.6/Codex 5.3 is that it’s impossible to publicly say “Opus 4.5 (and the models that came after it) are an order of magnitude better than coding LLMs released just months before it” without sounding like an AI hype booster clickbaiting, but it’s the counterintuitive truth to my personal frustration
A generative AI like ChatGPTData Analyst can take on the role of the evaluation soft-ware. It is expected that this manner of use will make thestudents' work easier, as less emphasis needs to be placedon the programming itself. Instead, teachers can incorpo-rate exercises that encourage students to code more effi-ciently and accurately with the assistance of AI. Thisshifts the focus from finding the right command or func-tion to examining and understanding the data moreclosely. As a consequence, students are better enabled tointerpret the results of statistical evaluation software cor-rectly, thus fulfilling goal 8 of the GAISE report.
rhetoric: Schwarz uses a statement of transition to contrast the old education model (rote memorization of commands) with a new required model (critical examination).
inference: This supports the argument that education and labor must start to pivot away from the "Generalist" process-oriented tasks. If the machine assistants handle the 'How' (the commands and functions), then the human must focus more on the 'Why' and the 'what does it mean (understanding/wisdom)'. This helps to validate the work of the assistants and helps to make it useful and valuable in the real world.
statistical knowledge is still required in order toformulate the correct prompts and to ensure that the AIdoes not leave out any step of the analysis.
rhetoric: author presents a prescriptive claim that AI needs humans with competent knowledge (in this case, statistics) to create prompts and ensure that the AI does not leave out any steps of the analysis. He positions domain knowledge not as a tool for using AI for statistical analysis, but a prerequisite for management of the AI and auditing the output.
inference: In addition to policing and correcting the AI outputs, the deep domain knowledge is what allows the AI to do complex data analysis without mistakes, hallucinated results, or mathematically false outcomes. This is basically the job description of a human with "Augmented Human Wisdom". The human's value is no longer in doing math, but in possessing the vertical expertise (flesh/wisdom) to know exact what math needs to be done and ultimately auditing the assistant machine's work.
ChatGPT Data Analyst clearly produced a false resulthere, precisely because the application assumptions for theANOVA were not checked.
rhetoric: Schwarz employs cause-and-effect reasoning here based on empirical testing. He links a specific technical failure (not checking assumptions) to a definitive unwanted outcome (a false result).
inference: the "Data Analyst" function of ChatGPT hallucinated a result during the use of it's core function! This is the best evidence so far of the 'Crisis of Truth' and the dangers of the 'Headless Automatons' in my essay. If a generalist with no deep knowledge uses AI, they are at great risk of blindly accepting mathematically false conclusions. Synthetic syntax without competent human validation is a liability.
The results show that generative AI canfacilitate data analysis for individuals with minimal knowledge of statistics,mainly by generating appropriate code, but only partly by following standardprocedures.
rhetoric: author uses comparative, objective statement (logos) to establish the main boundary of the technology's capability/capacity -- it excels at technical generation (things like coding) but fails at standard procedures (methodological adherence to SOPs).
inference: the proves the 'Raising the Floor' concept. AI completely automates the entry-level syntax (the "Word"), meaning that the Generalist coder is obsolete! However, because it fails at standard procedures, it requires a human architect to guide it to outputs that are valuable in the real world.
PWA have language deficits that require bespoke AAC supports. These supports may beenhanced by LLMs in software systems that use spoken user input to provide relevantsuggestions that have grammatical and speech production support.
rhetoric: concluding statement. this positions the LLM as an 'enhancement' to physical human limitation, rather than a replacement of the human subject.
inference: This helps to validate the 'Augmented Human Wisdom' model. The future of AI is NOT replacing humans, but AI acting as a high-powered syntax engine that is strictly guided by human needs and human intent. The AI does not have 'agency', as it is a software tool that helps the human to execute their visions.
Perseverations that are input into the system are essentially mag-nified by the system’s suggested sentences,
rhetoric: authors explain an unintended consequence of using the AI tool: it scales the errors or the emptiness of the human prompt.
inference: this is an excellent metaphor for the 'manager fallacy'. If the human user in incompetent (or provides empty or incomplete input), the AI does not magically create wisdom -- it just amplifies the user's incompetence in a a highly articulate synthetic thought.
Participant 2 stated the age of her daughters (“Name1 is 18, Name2 is21”), Aphasia-GPT transformed it as “Name1 is 18 and 21”, which is an impossible, butrelated, hallucination
rhetoric: researchers use a specific, clinical observation of an error to demonstrate the model's inability to comprehend logical reality despite the human relaying a perfectly structured sentence.
inference: this shows that AI is amoral and lacks the lived experience necessary to make logical judgments that work in the real world. It can format a sentence beautifully, but it does not/will not always understand that a single human cannot be two ages at once. This is why it is very important/necessary for the "flesh" to text the output against reality
Aphasia-GPT is a real-time, AI-enabled web app designed to expand the words providedby a user into complete sentences as suggestions for a user to select.
rhetoric: authors provide a definition of their creation (Aphasia-GPT) to describe it's mechanism: taking a fragmented input and expanding it into a fully structured, complete output.
inference: this is the embodiment of Harari's primary metanym of the word v flesh (syntax v human). in this example, Aphasia-GPT provides the words (syntax) to the fleshy human that struggles with those words, while also relying on the human to spark the intent of the communication. The human is using AI to communicate with words, because the words are very difficult for the human.
nearly half of the workers who received sloppy AI-generated material from coworkers saw those coworkers as less creative, capable and reliable, while smaller amounts saw them as less trustworthy and intelligent.
AI Slop generated by your own hands changes he way people view you at work!
The cost of the time that it takes fix "workslop" could add up too, with a $186 monthly cost per employee on average, according to a survey of desk workers by BetterUp in partnership with the Stanford Social Media Lab. Forty percent of the workers surveyed said they received "workslop" in the last month and that it took an average of two hours to resolve each incident.
$186/per employee/per month!
10 employees = ($22,320) 25 employees = ($55,800) 50 employees = ($111,600) 100 employees = ($223,200) 250 employees = ($558,000) 500 employees = ($1,116,000) 1000 employees = ($2,232,000)
“Younger workers aren’t necessarily more careless, but they’re often using AI more frequently and earlier in their workflows," Dennison said. "There is also a training gap. Organizations often assume younger employees intuitively understand AI, yet provide little guidance on verification, risk, or appropriate use cases. As a result, AI may be treated as an answer engine rather than a support tool."
this is another great quote, which helps to establish how orgs treat younger generations, and how they tend to overtrust their understanding of AI.
About 70% of managers say their direct reports have made AI-related mistakes in the past year
Good stat from a survey of 1100 managers at resume.com. 70% of managers say that their employees have submitted AI generated errors inside their work in the last year.
58% said direct reports submitted work that contained factual inaccuracies generated by AI tools, while fewer reported that AI failed to account for critical contextual factors. Other issues cited include low-quality content, poor recommendations and inappropriate messaging.
from reporting managers, 58% of them said that employees were submitting work that contained factual inaccuracies in the work that was generated by AI, and that fewer of them reported that AI failed to account for "critical contextual factors", implying that the writing was generic and not directly applicable to the context that the writing was written in. Other issues were: low quality content, poor recommendations and inappropriate messaging.
59% of managers saying that they had to invest additional time to correct or redo work created by AI. Similarly, 53% said their direct reports had to take on extra work, while 45% said they had to bring in co-workers to help fix the mistake.
Extra time and money spent to repair errors made by AI but not caught by the human in the middle. 59% is almost 2/3 (closer to 3/5) needed to correct or redo the work created by AI without a human auditing it. 53% claim extra work is needed to repair the AI mistakes, and 45% also needed to bring in a (perhaps more senior) co-worker to help fix the mistake. I can imagine workers needing to work on a mistake the hits production code, and all of the thousands (or more) mistakes that would need to be later repaired and rolled back. very expensive and costly.
they damaged client relationships.
missed deadlines are tough, but damaging client relationships is a sin!
While 18% of managers said they did not suffer any financial losses from the mistakes, and 20% said those losses were less than $1,000, a significant number reported bigger losses. Twelve percent said those losses were more than $25,000, while 11% said between $10,000 and $24,999. Another 27% placed the value of those losses above $1,000 but below $10,000.
great stats for the cost of using AI without human auditing.
34% said Gen Z followed by 26% who blamed millennials, with 18% citing Gen X and just 9% saying it was baby boomers.
while this affect all generations, this is clearly a young people problem! This problem is here to stay
“AI is reliable when used as an assistant, not a decision-maker," Dennison said. "Without human judgment and clear processes, speed becomes a risk, and efficiency gains can turn into costly mistakes,”
great quote. directly mentions my concept of requiring human judgement, and how not having a human in the loop can make work move faster, but can also lead to very costly mistakes.
“Employees treat AI outputs as finished work rather than as a starting point. Current AI tools are very good at generating fluent content, but they don’t understand context, business nuance, risk, or consequences. That gap shows up in factual errors, missing constraints, poor judgment calls, and tone misalignment.”
another great quote -- ties into the abdicating human agency to a robot, and the full quote even illustrates the dangers of doing so.
AI fatigue is real and nobody talks about it
[[AI Contintent Action Plan]]
[[The Means of Production by Maximilian Kasy]] overview in slides by author https://maxkasy.github.io/home/files/slides/meansofprediction_slides_long.pdf
On ai, productivity and shorter work weeks and why that will not happen
The scenarios Wooldridge imagines include a deadly software update for self-driving cars, an AI-powered hack that grounds global airlines, or a Barings bank-style collapse of a major company, triggered by AI doing something stupid. “These are very, very plausible scenarios,” he said. “There are all sorts of ways AI could very publicly go wrong.”
Scenario's for a Hindenburg style event: - deadly software update for self driving cars - AI-powered hacking ground global airlines (not sure, if that is clear enough to people, unlike the self driving cars running amok) - Barings-style collapse of a major company triggered by AI (if it's a tech company, it may be less shock, more ridicule, but still)
“It’s the classic technology scenario,” he said. “You’ve got a technology that’s very, very promising, but not as rigorously tested as you would like it to be, and the commercial pressure behind it is unbearable.”
true for AI, but wasn't the case for Hindenburg I'd say.
The race to get artificial intelligence to market has raised the risk of a Hindenburg-style disaster that shatters global confidence in the technology, a leading researcher has warned.Michael Wooldridge, a professor of AI at Oxford University, said the danger arose from the immense commercial pressures that technology firms were under to release new AI tools, with companies desperate to win customers before the products’ capabilities and potential flaws are fully understood.
prediction Michael Wooldridge (Oxford, AI), sees a risk at an 'Hindenburg' event. Shattering the global confidence in AI tech. I"m not sure this analogy entirely fits other than in its potential impact (AI isn't globally trusted, the Hindenburg did not fail bc of the tech itself but bc helium not being allowed to export from the US at the time. Still the Hindenburg did put an end to the entire zeppelin industry yes. No matter the causes.)
OpenClaw, like many other open-source tools, allows users to connect to different AI models via an application programming interface, or API. Within days of OpenClaw’s release, the team revealed that Kimi’s K2.5 had surpassed Claude Opus and became the most used AI model—by token count, meaning it was handling more total text processed across user prompts and model responses.
Wow, I had no idea that Kimi 2.5 had subbed in for Claude Opus so quickly.
OECD catalogue of AI tools en metrics for trustworthy AI.
Low-cost Chinese AI models forge ahead, even in the US, raising the risks of a US AI bubble Nvidia’s latest earnings report reassured some. But Chinese AI models are fast gaining a following around the world, underlining concerns over an ‘AI bubble’ centered on high-investment, high-cost US models.
One of the largest PC suppliers, Dell, was reported to be planning a price hike that could raise hardware costs by hundreds of dollars. Interestingly, for consumers opting for higher memory configurations, this would now require a significant price increase. Here were the price increases that were reported across a variety of products: $130–$230 increase for Dell Pro and Pro Max notebooks and desktops configured with 32 GB of memory $520–$765 increase for systems configured with 128 GB of memory $55–$135 increase for configurations with a 1 TB SSD $66 increase for AI laptops equipped with an NVIDIA RTX PRO 500 Blackwell GPU (6 GB) $530 increase for AI laptops equipped with an NVIDIA RTX PRO 500 Blackwell GPU (24 GB) Similarly, companies like ASUS and Acer were also reported to be bumping up PC pricing to cope with memory shortages, and according to Acer's Chairman, Jason Chen, the BoM (Bill of Materials) for several products within Acer's portfolio has risen dramatically, leaving no choice but to increase prices to ensure consistent supply. Small-scale manufacturers like Framework are also looking to increase the cost of upgrading RAM on existing configurations, indicating a widespread "price hike" wave approaching gamers.
price hikes of DRAM, due to pc laptop manufacturers having trouble in getting enough RAM. Shortages to keep going for 2026, after 2025. AI supply chain gobbling up the rest.
https://web.archive.org/web/20260216112337/https://wccftech.com/western-digital-has-no-more-hdd-capacity-left-out/ Western Digital says consumer sales of HDDs is now just 5% of their sales, everything else going to AI companies. 2026 WD is already sold out. For 2027 and 2028 there is already a few deals in place too.
the humans involved may have simply lost the plot and may not understand what the program is supposed to do, how their intentions were implemented, or how to possibly change it.
key imo. generating code / material, can quickly mean loss of overview (I see how that happens in my use of #algogens if I don't explicitly counteract it), uncertainty about how demands were implemented, and thus what entry points for change there are.
AI infrastructure developers cannot wait five years. In many cases, they cannot wait six months, because waiting six months costs billions of dollars of lost opportunities.
The quick very rough mental maths on a GW of capacity being worth 10billion USD converts to between 1000-1500 USD per megawatt hour of money they think they could be making if they could sell the compute it powered