resnets

The Shattered Gradients Problem

Back when PHP had less than 100 functions and the function hashing mechanism was strlen(). In order to get a nice hash distribution of function names across the various function name lengths names were picked specifically to make them fit into a specific length bucket.

Ex­cep­teur sint occæcat cu­p­i­datat non proident, sunt in culpa qui officia de­serunt mol­lit anim id est labo­rum.

The solution - move tabstops to fit the text between them and align them with matching tabstops on adjacent lines

Here we have a marvelous illustration of the functioning of propaganda in a democracy. A totalitarian state simply enunciates official doctrine — clearly, explicitly. Internally, one can think what one likes, but one can only express opposition at one’s peril. In a democratic system of propaganda no one is punished (in theory) for objecting to official dogma. In fact, dissidence is encouraged. What this system attempts to do is to fix the limits of possible thought: supporters of official doctrine at one end, and the critics — vigorous, courageous, and much admired for their independence of judgment — at the other. The hawks and the doves. But we discover that all share certain tacit assumptions, and that it is these assumptions that are really crucial. No doubt a propaganda system is more effective when its doctrines are insinuated rather than asserted, when it sets the bounds for possible thought rather than simply imposing a clear and easily identifiable doctrine that one must parrot — or suffer the consequences. The more vigorous the debate, the more effectively the basic doctrines of the propaganda system, tacitly assumed on all sides, are instilled. Hence the elaborate pretense that the press is a critical dissenting force — maybe even too critical for the health of democracy — when in fact it is almost entirely subservient to the basic principles of the ideological system: in this case, the principle of the right of intervention, the unique right of the United States to serve as global judge and executioner. It is quite a marvelous system of indoctrination.

In "As We May Think", Bush describes a memex as an electromechanical device enabling individuals to develop and read a large self-contained research library, create and follow associative trails of links and personal annotations, and recall these trails at any time to share them with other researchers.

The Winchester manuscript contains no title, no table of contents, and no page numbering.  As you can imagine, reading such a text would be difficult without graphic assistance.  The Winchester scribes provided it in the text by setting off names of characters in red ink, a practice known as "rubrication."  The names in red also included two non-human nouns which acted as agents doing things in the text, the "Sankgreal" or Holy Grail (which healed and wounded like a knight), and the "Rounde Table," which was a concept in whose name knights might act of take oaths.  However, the scribes main ongoing assistance to readers occurs in the manuscript's  margins.

It is written right-to-left in hieratic, the Egyptian cursive form of hieroglyphs, in black ink with explanatory glosses in red ink.

The text of a Book of the Dead was written in both black and red ink, regardless of whether it was in hieroglyphic or hieratic script. Most of the text was in black, with red used for the titles of spells, opening and closing sections of spells, the instructions to perform spells correctly in rituals, and also for the names of dangerous creatures such as the demon Apep.[57] The black ink used was based on carbon, and the red ink on ochre, in both cases mixed with water.

But rather than allowing a massive reduction of working hours to free the world’s population to pursue their own projects, pleasures, visions, and ideas, we have seen the ballooning not even so much of the “service” sector as of the administrative sector, up to and including the creation of whole new industries like financial services or telemarketing, or the unprecedented expansion of sectors like corporate law, academic and health administration, human resources, and public relations. And these numbers do not even reflect on all those people whose job is to provide administrative, technical, or security support for these industries, or for that matter the whole host of ancillary industries (dog-washers, all-night pizza deliverymen) that only exist because everyone else is spending so much of their time working in all the other ones. These are what I propose to call “bullshit jobs.”

/aftp/xx.yy.edu/pub/doc/README Fig 1. Some alternative tagged and untagged representations

Bird eyes have had eons longer to optimize. Along with their higher cone count, they achieve a far more regular spacing of the cells.

Bird eyes have had eons longer to optimize. Along with their higher cone count, they achieve a far more regular spacing of the cells.

the

To put it bluntly, acad­e­mia has some per­verse in­cen­tives struc­tures that we would never have in­ten­tion­ally built into sci­ence as a process.

The rea­son doing the right thing sci­en­tif­i­cally is dif­fi­cult is that those who do it first will be pun­ished and os­tra­cized, at least until these ac­tions be­come the new norm. It’s a co­or­di­na­tion prob­lem. The first dis­senter who says “Hey, the em­peror wears no clothes” suf­fers all the po­ten­tial risk with­out en­joy­ing any ad­di­tional ben­e­fits. Yet we would all be bet­ter off if the col­lec­tive norm was shifted over.

flow­ing

Nearly all ap­pli­ca­tions of prob­a­bil­ity to cryp­tog­ra­phy de­pend on the fac­tor prin­ci­ple (or Bayes’ The­o­rem).

PDFs have be­come bur­den­some

TeX

Lorem Ipsum