8 Matching Annotations
  1. Aug 2023
    1. course

      how data is received client -> socket -> n/w thread(lightweight) -> req queue -> i/o thread(crc check & append to commit log[.index and .log file]) -> resp queue -> n/w-> socket

      purgatory map -> used for req until data is replicated

      how data is fetched client -> socket -> n/w -> req queue -> i/o thread (fetch ranges are calcualted with .index) -> res queue -> n/w -> socket

      purgatory map -> waits until is arrived based on consumer config

      also follows zero copy - meaning data fetched from file directly to n/w thread - mostly page cached

      if not cached -> may need to use tiered storage

  2. Dec 2020
    1. It is quite large, the letters along its spine are big and bright, and readers are required to own it in print, because Mr. Caro, who still uses a typewriter, has refused to distribute the written version in any other way.

      I've always wondered why there wasn't a digital edition available after all this time.

  3. Aug 2020
  4. Dec 2017
    1. Terms such as brokers, boundary spanners, boundary crossers, and boundary workers are often used to denote them. Whereas the latter two terms are typically used to refer to people’s actual efforts and success in crossing boundaries (i.e., establishing continuity in action and interaction) between groups, the terms broker and boundary spanner typically, especially in social network theory, refer to a structural position in a network, where a person is found to be a more or less unique link between otherwise separate or disparate groups. Nevertheless, the common assumption in social network theory is that, precisely because of being in this structural position and creating what Granovetter (1973 Granovetter, M. (1973). The strength of weak ties. American Journal of Sociology, 78, 1360–1380. doi:10.1086/225469[Crossref], [Web of Science ®], [Google Scholar]) called the “weak ties,” brokers or boundary spanners have a powerful position (Aldrich & Herker, 1977 Aldrich, H., & Herker, D. (1977). Boundary spanning roles and organization structure. Academy of Management Review, 2(2), 217–230.[Crossref], [Google Scholar]; Burt, 2000 Burt, R. S. (2000). The network structure of social capital. Research in Organizational Behavior, 22, 345–423.[Crossref], [Web of Science ®], [Google Scholar]; Lin, 2001 Lin, N. (2001). Social capital: A theory of social structure and action. New York, NY: Cambridge University Press.[Crossref], [Google Scholar]; Tuschman & Scalan, 1981); from this powerful position they can either use information to retain positional authority and their status as a link between two or more groups or use it to join people together for mutual benefit (Obstfeld, 2005 Obstfeld, D. (2005). Social networks, the tertius iungens orientation, and involvement in innovation. Administrative Science Quarterly, 50(1), 100–130.[Crossref], [Web of Science ®], [Google Scholar]).

      Related articles on brokers

    2. As we elaborate in the next section on the intrapersonal level of boundary crossing, people who are in this situation can be referred to as brokers and typically have a powerful but challenging multifaceted position that is psychologically quite demanding.

      Definition of brokers

  5. Jun 2017
    1. "isr" is the set of "in-sync" replicas.

      ISR are pretty import as when nodes go down you will see replicas created later.

  6. May 2017
    1. With Flume & FlumeNG, and a File channel, if you loose a broker node you will lose access to those events until you recover that disk.

      In flume you loose events if the disk is down. This is very bad for our usecase.

    1. the number of partitions -- there's no real "formula" other than this: you can have no more parallelism than you have partitions.

      This is an important thing to keep in mind. If we need massive parallelism we need to have more partitions.