a surprising number of participants (11) claimed that they usedesign principles almost exclusively to help them make decisions. For some,the reason was practical and economic: “In my current line of work, it’s alldesign principles. We don’t have the resources, including time, for usabilitytesting.” Others expressed a distrust of design research altogether: “I find designprinciples outrank usability studies, which I find limited and subject to style”;“Design principles always trump empirical research”; “Designing by committeecan be dangerous.

To expand the reach of my study, I used an onlinecard sorting tool, Optimal Sort (http://www.optimalworkshop.com). Instead ofindex cards, this online tool displays digital shapes that participants can dragand drop on screen to create groups, which they can then label (see Figure 2).This tool also allowed participants to provide feedback through before and aftersurvey questions

Card sorting is typically conducted in one of two ways: closed sort or opensort. In a closed sort, participants sort the cards into predefined categories.In an open sort, participants sort the cards into categories they create themselves.Due to the exploratory nature of my study, I used an open sort so designerscould group the design principles as they saw fit. I also did not require partici-pants to sort all of the cards, but restricted my analysis to those who sorted atleast 75% of the cards.

So at best, design principles are a kind of lore. Lore is a kind of contingentknowledge based in practice, and as North has argued for composition studies, ithas a value that is often overlooked. However, lore being what it is—anecdotal,implicit, and often idiosyncratic—I think there is good justification to bringresearch to bear on it. Accordingly, in this article I apply empirical techniques tounderstand the lore of design principles more fully.