In fact, even before a dataset is complete, visualizations can be used to recognize errors in the data collection process.
This is cool! I've only really been thinking of how these programs can do after they process the data, but never really thought that they can help you before they even get started.
The use of visualizations to show the distribution of words or topics in a document is an effective way of getting a sense for the location and frequency of your query in a corpus, and it represents only one of the many uses of information visualization
I think this is one of the most interesting types of visualization. It is incredible what simply the use words can show a historian.
Note that the process outlined relies on a back and forth between machine reading of the texts and close readings of the individual items
Showcases that is be a team effort between computers and historians
This is extremely valuable for the “small” words that the human brains tends to slide over when reading [these words are often call “stop words” in machine reading because the programming ignores them before analyzing a corpus].
I know I am guilty of only hunting for the main key words/points in a text & often miss the smaller details the first few times I read a text/data. However, by using a technique like corpus linguistics, you are guaranteed to be made aware of everything from the start.
.graphml file
Does anyone know where the option of this is? Mine is only offering to save it under SVG, PDF & PNG?
If you were using a text editor on your own computer
i'm having trouble finding the replace tab on terminal, does anyone know the key(s) to get it?
Emphasizing technology, however, risks overshadowing an even more important commonality: collaboration.
collaboration between researchers and technology?
I shaped the project around the availability of digitized and machine-readable sources. Accessibility can be a major impediment to digital analysis.
I can understand that, you do not want to start a project where you will not be able to find data to support it. By doing this, you know from the start that you have access to all the data you need. I guess this can also be negative point because if everyone did this, there will be less incline to produce and digitalize data themselves... right?
Their daily or weekly print cycles also allow historians to track temporal changes in much finer detail than do other sources such as maps or novels.
That is true! In terms of producing data, news papers are reliable, consistent and easily accessible.
. Finally, the overwhelming presence of Texas places reveals the dominance of regional space. Galveston, Dallas, Fort Worth, Waco, and San Antonio may have occupied a relatively lowly position in the nation’s urban hierarchy, but they sprawled across the Houston Daily Post’s imagined geography.
I can understand this, these cities could have been key for the State of Texas whoever less important in the larger scale of the country.
we included a discussion forum on the Desk’s main page where volunteers could swap ideas, ask questions, or make requests of the project editors.
Reminds me of our Slack page!!
we also tried to build a dedicated user community to enable sustained participation by, for example, implementing a qualitative and quantitative feedback and reward system.
I'm interested to see where this goes. I think both ideas will help create this dedicated user community they are looking for. Personally, I tend to be more involved when my work is recognized and appreciated.
Transcribing the difficult handwriting, idiosyncratic style, and dense and challenging ideas of an eighteenth and nineteenth-century philosopher is more complex, esoteric, and of less immediate appeal than contributing to a genealogical or community collection. 7
But could a volunteer who might not have much background on the subject or experience, be able to comprehend and analyze the data correctly??
build up a cohort of willing volunteers
I can understand how this might be challenging at times
For instance, $ twarc search canada150 > search.json will search Twitter for posts using the canada150 hashtag.
Has anyone gotten 401 Client Error Aurhorization required for URL when they this command?
The team is just now addressing my project, and trying to determine how to handle publishing two sets of images
We need editors who specialize in digitized work like this (however, they might exist and i'm just simply not aware of them)
not incidentally, why it would not be a waste of time for those of us who work in those fields to take a good hard look at ourselves and the ways that we engage with one another, in order to ensure that we’re doing everything we possibly can to model the ways of being we’d like to see manifested in the world.
This is a good point, often the focus is observing others and it can be easy to forget the part you personally play/can contribute.
I draft all my work in documents shared with readers for comments and critique.
I admire her for doing this! I think this is something I would find overwhelming at times if many people were commenting before I had the opportunity to finish the thought.
But still, we can learn quite a bit – shifting occupations of elected and defeated candidates, how party candidates may have changed over time, what occupations are overrepresented amongst the overall, the defeated, and the victorious – and I believe there’s a fantastic MA paper in this data.
When I studied abroad at the University of Liverpool, I actually took a class focusing on the UK general elections between 1945 & 2015. The amount of data that I had been collective was massive, and we only focused on certain parts. Very interesting to look at and analyze for a poli sci student like myself!
Rather than dozens of us all flying to Library and Archives Canada, taking our own photographic record of RCMP/CSIS records, say, wouldn’t it better if we cooperated more?
Could people be skeptical about this because they are worried it would eliminate jobs/make the field more competitive??
it’s our data, we collected it, and if somebody else wants the data, they should collect it themselves.
As others mentioned, I too understand where this comes from. I know I used to be like that a lot, until the situation changed and I was the one who needed it from someone else - 'sharing is caring' is how i go about now
as well as support the expansion of inter-disciplinary research
A theme that I have noticed within this weeks and last weeks reading
our writing is often hampered by the paralyzing fear “that someone is always watching, eager to find fault.”
Even as a student, this is something that I struggle with. I am constantly scared to publicly share my thoughts/opinions, as I am always asking myself "but what if I am really wrong??".
but to the underlying data, methods, and experimental results that drive research projects forward.
This reminds me of math class, my teachers always said you could not get full points with just your results. You had to show, every step you took to get to your results.
Understand the ways digital tools change us as we use them, to create compelling history that is self-reflexive
I am excited to learn more about how it does this!
We must approach it with care, and not let it become the only lens through which we see the past.
I think can go hand in hand with something that TIm Hitchcock wrote on his blog: Big Data for Dead People: Digital Readings and the Conundrums of Positivism. He said: "But, if you want something with a bit more flavour we need to move beyond what was deliberately coded to text – or photographs – and be more adventurous in what we are reading. "
We wrote it in the open, inviting the world to contribute their edits, ideas, and advice for our final draft.
Within all the readings we had this week, I am noticing the trend of collaboration and exactly how important it is to digital history.
actually can change the character of how we ‘read’ a sentence, a word, a phrase, a genre – by giving a norm against which to compare it.
Like others have expressed in annotations above, I find this whole example very interesting. I wasn't aware of the concept of distant reading before hand but will keep an active eye open for it now!
By placing government data about farms next to data on the weather, history allows us to see the interplay of material change with human experience, and how a changing climate has already been creating different sets of winners and losers over decades.
This really highlights the importance of collaboration between the different fields.
Applying Paper Machines to text corpora allows scholars to accumulate hypotheses about longue-durée patterns in the influence of ideas, individuals, and professional cohorts.
For sure an important and useful step, for instance how we saw the impact of visualizing data helped Baker in the previous two texts in the readings for this week.
In our own time, many analysts are beginning to realise that in order to hold persuasive power, they need to condense big data in such a way that they can circulate among readers as a concise story that is easy to tell.
As a reader, I find this point extremely relevant. When looking for something in specific, I always try and find articles that are the most straight forward and concise because I often do not have the time (or the patience) to read something that is overly wordy with non relevant information.
I made a spreadsheet. On that spreadsheet I recorded the title, date of publication, and publisher of every Isaac Cruikshank print I could get my hands on. I then recorded the places depicted in each print.
Making a spreadsheet like this one, is a concept that I like doing myself. As a visual person, it not only makes the analyzing the data a lot easier for myself as well as simpler/clearer when I present it to others.
Network analysis is the ‘corpus level quantitative’ work.
I am having trouble understanding what the author means by 'corpus level quantitative' work here. Can anyone explain?
they helped orientate and shape my thinking rather than provide ‘results’ that I analysed, interpreted, and/or presented in the book.
Going off the idea that @angelachiesa mentioned in her annotation above, I can relate significantly to this point and believe that the process of doing something can make you grow as an individual. For me, doing research for an assignment is like a never ending game of connect the dots and most of it never ends up getting used. However, it still plays an important part in the process.
As historians develop technical skills, and computer scientists develop humanistic skills, fruitful collaborative undertakings can develop
Excellent point, collaboration between both is essential.
Historians must be open to the digital turn, thanks to the astounding growth of digital sources and an increasing technical ability to process them on a mass scale.
This day in age, this is necessary in order for a historian to produce full & complex research.
THIS TEXT
First annotation
but they push him as much as he pushes them.
very interesting!