1,278 Matching Annotations
  1. Last 7 days
    1. Filtering enables users to narrow their focus to a subset of the corpus while still benefiting from features that help them recognize cross-sentence relationships within the remaining abstracts.

      sentence relating to methodology

    2. The Abstracts panel can be customized by users to display the full abstract text, an abstract “TLDR” (a shorter abstractive summary generated by an LLM), or both at the same time.

      sentence relating to methodology

    3. To allow users to contextualize individual sentences within their respective abstracts, we link the Cross-Sentence Relationship and Abstract panels: when users click on any sentence in the Cross-Sentence Relationships pane, the corresponding full abstract is automatically highlighted and scrolled into view in the Abstracts panel, offering additional context when needed.

      sentence relating to methodology

    4. Together, the vertical and horizontal juxtapositions are designed to help users identify both high-level commonalities and nuanced variations across structurally similar sentences.

      sentence relating to methodology

    5. These alignment options are intended to enable users to more easily read analogous chunks across sentences from different abstracts, ignoring details serving other roles within the sentence.

      sentence relating to methodology

    6. By default, sentences are vertically aligned by the middle of their shared structure tuple, but users can freely switch between the three alignment options using the button group atop the Cross-Sentence Relationship pane.

      sentence relating to methodology

    7. AbstractExplorer also aligns the sentences in three different ways, as illustrated in Figure 5: vertical alignment by the middle of the structure tuple (second element), vertical alignment by the left of the structure tuple (first element), and left-justified alignment (horizontal juxtapositions).

      sentence relating to methodology

    8. This ordering prioritizes dominant structural patterns (largest groups first) while exposing fine-grained variations (via length-sorted triplets), mirroring how humans compare sentences, if SMT is an accurate description in this domain of comparative close reading.

      sentence relating to methodology

    9. This allows users to first understand the different structure patterns and their commonality, before diving into close reading at scale of the sentences that share a particular structure by clicking any of the “Expand” toggles.

      sentence relating to methodology

    10. AbstractExplorer first segments sentences into grammar-preserving chunks—segments that respect grammatical boundaries, i.e., an LLM judges that the sentence can be truncated at that chunk boundary without breaking the grammatical integrity of the preceding text.

      sentence relating to methodology

    11. Viewing one aspect at a time enables users to closely read and compare just the analogous sentences of abstracts, which may be cognitively easier than the comparative close reading of many abstracts in their entirety, especially if cross-sentence relationships are pre-computed and reified in the interface.

      sentence relating to methodology

    12. AbstractExplorer classifies sentences into five pre-defined aspects common in CHI abstracts: Problem Domain, Gaps in Prior Work, Methodology/Contribution, Results/Findings, and Discussion/Conclusion.

      sentence relating to methodology

    13. We chose the sentence as our unit for cross-document alignment because: (1) it preserves complete propositional content (unlike phrases or words), (2) maintains grammatical coherence when isolated (unlike arbitrary text spans), and (3) serves as the minimal self-contained unit where aspects can be meaningfully compared.

      sentence relating to methodology

    14. To keep details at the forefront of the interface, we designed a mechanism to slice abstracts for viewing them from specific angles, allowing for comparative close reading at scale at the sentence level.

      sentence relating to methodology

    15. ABSTRACTEXPLORER is designed to help researchers (1) skim, read, and better familiarize themselves with the contents and composition style of a large corpus of abstracts and (2) reason about cross-paper relationships at scale without abstracting away the author-written sentences about their own work.

      sentence relating to methodology

    16. Finally, a summative study (Section 6) describes how researchers used ABSTRACTEXPLORER to familiarize themselves with a corpus of ~1000 CHI paper abstracts—reading across a larger and more diverse collection of abstracts and more easily discerning relationships and distributions across prior work.

      sentence relating to methodology

    17. Second, an ablation study with eye-tracking (Section 5) revealed that the three key features of ABSTRACTEXPLORER's central cross-sentence relationships pane-sentence order, role-coordinated highlighting, and alignment-work best in concert, not alone.

      sentence relating to methodology

    18. Three studies inform and validate ABSTRACT EXPLORER's design: First, a formative study (Section 3) suggested unmet needs and interest in our approach to supporting cross-document reasoning.

      sentence relating to methodology

    19. AbstractExplorer instantiates new minimally lossy SMT-informed techniques for skimming, reading, and reasoning about a corpus of similarly structured short documents: phrase-level role classification that drives sentence ordering, highlighting, and spatial alignment.

      sentence relating to methodology

    20. A summative study (N=16) describes how these features support users in familiarizing themselves with a corpus of paper abstracts from a single large conference with over 1000 papers.

      sentence relating to methodology

    21. AbstractExplorer has a unique combination of LLM-powered (1) faceted comparative close reading with (2) role highlighting enhanced by (3) structure-based ordering and (4) alignment.

      sentence relating to methodology

    22. The ablation and summative studies verified the value of Abstract-Explorer, specifically showing that all three components of the Structural Mapping Engine—color coding, sentence ordering, and vertical alignment—are crucial for facilitating comparative close reading at scale.

      sentence relating to testing

    23. The study concluded with a 15-minute semi-structured interview. During the interview, participants saw screenshots from the three conditions and were asked which they preferred and disliked, why, what they wished the interface had, what influenced their skimming, and how they normally skimmed texts.

      sentence relating to testing

    24. After the ablation study validated the effectiveness of all three SMT-inspired features together (especially for lower NFC users), we completed the implementation of AbstractExplorer and eval-uated its impact on researchers’ reading and sensemaking of a corpus of all ∼1000 paper abstracts from ACM CHI 2024.

      sentence relating to testing

    25. The most preferred condition (all three features enabled) was tied with the baseline no-features-enabled condition for lowest reported cognitive load. Specifically, 11 participants reported their lowest raw NASA-TLX scores8 in the all-three-features condition, and a different 11 participants reported their lowest raw NASA-TLX scores in the baseline condition.

      sentence relating to testing

    26. The most popular condition had all three features enabled, i.e., 11 out of 24 participants (≈ 50%) preferred Figure 7C, as shown in the “Preferred” columns of Table 1. The remaining participants were roughly evenly split between the no-features baseline (6 par-ticipants) and the without-alignment ablation condition (5 partic-ipants). One participant each liked the without-highlighting and without-ordering ablation conditions most, respectively.

      sentence relating to testing

    27. The specific research questions for this study were: (1) How do highlighting, alignment, and ordering affect reading patterns, user experience, and cognitive load? (2) How do participants’ valuation of these features relate to their Need for Cognition? (3) Does each feature provide value on its own, or only in conjunction with one or more of the other two features?

      sentence relating to testing

    28. In this study, we allowed participants to experience views of same-aspect sentences (Section 4.1.1) with different combinations of high-lighting, ordering, and alignment (as described in Section 4.1.2 and Section 4.1.4) enabled or not, in order to understand which and/or what combinations most effectively supported users’ ability to skim and read laterally across documents.

      sentence relating to testing

    29. Three studies inform and validate ABSTRACT EXPLORER's design: First, a formative study (Section 3) suggested unmet needs and interest in our approach to supporting cross-document reasoning. Second, an ablation study with eye-tracking (Section 5) revealed that the three key features of ABSTRACTEXPLORER's central cross- sentence relationships pane-sentence order, role-coordinated high- lighting, and alignment-work best in concert, not alone. Finally, a summative study (Section 6) describes how researchers used AB- STRACTEXPLORER to familiarize themselves with a corpus of ~1000 CHI paper abstracts—reading across a larger and more diverse col-lection of abstracts and more easily discerning relationships and distributions across prior work.

      sentence relating to testing

    30. A summative study (N=16) describes how these features support users in familiarizing themselves with a corpus of paper abstracts from a single large conference with over 1000 papers.

      sentence relating to testing

    31. an ablation study with eye-tracking (Section 5) revealed that the three key features of ABSTRACTEXPLORER's central cross- sentence relationships pane-sentence order, role-coordinated high- lighting, and alignment-work best in concert, not alone.

      sentence about eye-tracking

    32. an ablation study with eye-tracking (Section 5) revealed that the three key features of ABSTRACTEXPLORER's central cross- sentence relationships pane-sentence order, role-coordinated high- lighting, and alignment-work best in concert, not alone.

      any sentence about eye-tracking, eye-trackers, etc.

    33. an ablation study with eye-tracking (Section 5) revealed that the three key features of ABSTRACTEXPLORER's central cross- sentence relationships pane-sentence order, role-coordinated high- lighting, and alignment-work best in concert, not alone.

      any sentence about eye-tracking, eye-trackers, etc.

    34. an ablation study with eye-tracking (Section 5) revealed that the three key features of ABSTRACTEXPLORER's central cross- sentence relationships pane-sentence order, role-coordinated high- lighting, and alignment-work best in concert, not alone.

      any sentence about eye-tracking, eye-trackers, etc.

    35. an ablation study with eye-tracking (Section 5) revealed that the three key features of ABSTRACTEXPLORER's central cross-sentence relationships pane-sentence order, role-coordinated highlighting, and alignment-work best in concert, not alone.

      sentence about eye-tracking

    36. an ablation study with eye-tracking (Section 5) revealed that the three key features of ABSTRACTEXPLORER's central cross- sentence relationships pane-sentence order, role-coordinated high- lighting, and alignment-work best in concert, not alone.

      sentence about eye-tracking

    37. an ablation study with eye-tracking (Section 5) revealed that the three key features of ABSTRACTEXPLORER's central cross- sentence relationships pane-sentence order, role-coordinated high- lighting, and alignment-work best in concert, not alone.

      sentence about eye-tracking

    38. an ablation study with eye-tracking (Section 5) revealed that the three key features of ABSTRACTEXPLORER's central cross- sentence relationships pane-sentence order, role-coordinated high- lighting, and alignment-work best in concert, not alone.

      sentence about eye-tracking

    39. an ablation study with eye-tracking (Section 5) revealed that the three key features of ABSTRACTEXPLORER's central cross- sentence relationships pane-sentence order, role-coordinated high- lighting, and alignment-work best in concert, not alone.

      sentence about eye-tracking

    40. AbstractExplorer used variation affordances present in prior systems, e.g., color-coordinated highlighting of analogous text in Gero et al. [18], and introduced new ones, such as alignment of sentences based on analogous chunks within them, which had only been hypothesized in prior work.

      sentence related to Structural Mapping Theory (SMT)

    41. Structural Mapping Theory (SMT) is a long-standing well-vetted theory from Cognitive Science that describes how humans attend to and try to compare objects by finding mental representations of them that can be structurally mapped to each other (analogies).

      sentence related to Structural Mapping Theory (SMT)

    42. AbstractExplorer instantiates new minimally lossy SMT-informed techniques for skimming, reading, and reasoning about a corpus of similarly structured short documents.

      sentence related to Structural Mapping Theory (SMT)

    43. Lossless SMT-informed techniques have yet to be brought to bear in the context of researchers familiarizing themselves with a corpus of existing literature.

      sentence related to Structural Mapping Theory (SMT)

    44. This SMT-informed approach, which AbstractExplorer shares, tries to give this mental machinery “a leg up,” letting users perhaps skip some steps by accepting reified cross-document relationships identified by the computer.

      sentence related to Structural Mapping Theory (SMT)