Google Ngram Visuals in Two Languages

I must admit I had trouble navigating Voyant even after watching the help video. Roxanne’s post was a great way of helping me gain an understanding of how the tool could be used and what type of outcome I might receive had I been able to achieve success. I thought my experience with Voyant would be more interesting than it turned out. I entered a series of words, tried to find a corpus that applied and then I tried the reverse but I got nothing. Roxanne’s experience was interesting since the conclusion to her exploration found the most popular word was “said,” which allowed her to make this connection to the heavy use of dialogue. The value of indicators to drawing conclusions proves to be great for building a path to research.
I played with Ngram viewer, a tool I enjoyed not only to see if the data crossed paths at any point but for also for a concept Luisina spoke of in class concerning the visual stimulation. There is something about all the visual representation that I respond to which may or may not be superficial. This tool was also interesting to me since it responded well to my converting back and forth between Spanish language and English language corpus. In my discovery I compared books by Latin American authors from 1965 – early 2000’s. Isabel Allende’s “Eva Luna”, Paolo Coelho’s “The Alchemist”, Mario Vargas Llosa’s “The Storyteller” and Gabriel Garcia Marquez’s “In Evil Hour”.  See below where I added the visual difference in the Spanish corpus chart and the English corpus chart.

Posted in Uncategorized | Tagged , , , , , | Comments Off on Google Ngram Visuals in Two Languages

Guggenheim

Posted in Uncategorized | Comments Off on

Playing with Tools for Text (Part II)

I found a tool that sounds like it would be suited to a project comparing a novel and its screenplay adaptation (it is, of course, far more complicated than this assignment allows).  The tool is called PAIR: Pairwise Alignment for Intertextual Relations.  From its site:

PAIR (Pairwise Alignment for Intertextual Relations) is a simple implementation of a sequence alignment algorithm for humanities text analysis designed to identify “similar passages” in large collections of texts. These may include direct quotations, plagiarism and other forms of borrowings, commonplace expressions and the like.

In playing with Juxta, I compared the opening scene of the film with the passage in the novel.  While it didn’t provide any great insights, it was useful to have both side-by-side:

The areas that are NOT highlighted in green are exact matches.  You can see that dialogue that is almost the same doesn’t necessarily stand out in this system.

Since this project got rather complicated quickly, I also did some playing with Voyant and Google N-Grams.

In Voyant, I visualized the entire text of the novel and used the standard Taporware (English) stopwords.  Two words stood out to me: “said,” which I suppose indicates that the book is heavy on dialogue, and “door,” which I find interesting.

Changing topics briefly, I used Google N-Grams to look at the change in usage of terms in film studies.  I chose “photoplay,” “moving picture,” “motion picture,” and “cinema,” for the period 1900-1980.

It’s pretty clear that the early 1920s saw a switch from “moving picture” to “motion picture.”  I can see how a tool like this would help me narrow down a period of study in researching this change.  Also, “moving picture” and “photoplay” seem to peak around 1915, which I know from my previous research is also the first appearance of “moving pictures” in the Library of Congress Classification system.  This made me want to revisit the topic and compare the evolution of the LCC schedules with the Google Books corpus.

I had fun playing with the different tools, but it can be a bit overwhelming trying to make sense of the specialized vocabulary and the long list of tools available.  I can definitely see a role here for a reference librarian in consulting with students and researchers, to help recommend some tools to start with.

 

Posted in Uncategorized | Tagged , , , , , | 2 Comments

Playing with Tools for Text

Our assignment this week was to play with some text mining tools and to try blogging our ventures “in progress.”  After taking a look at some of the tools, I wondered if any might be used to compare the text of a novel with the screenplay of a film adaptation of the novel.  I was thinking of The Big Sleep (1946), in which some of the dialogue is lifted word-for-word from Chandler’s novel.  Obviously the dialogue in the actual film might be different from that in the published screenplay, but I thought it would be interesting to see how/if tools could be used to find these similarities instead of the variations that are commonly sought in comparing literary editions.

I’ve found an electronic version of the novel, and both a pdf of the screenplay and a text file of the film’s dialogue.  I’m looking at Juxta, thinking I may be able to compare a scene of my choosing; or, perhaps I can compare visualizations of each text.

Thoughts?  Suggestions?  To be continued…

Posted in Uncategorized | Tagged , , | 3 Comments

New York through fiction

Posted in Uncategorized | Comments Off on New York through fiction

the miracle of digital archives

I would say that the Sept. 11 Digital Archive is a perfect example of effective crowdsourcing. It’s fascinating to see how many people were engaged in it and how rich and succinct their narratives are. I could also see that there were headings or guidelines that people were asked to respond to, which gives those narratives/comments a semblance of a structure, but it doesn’t interfere with their voice in any way. Since I wasn’t aware of this before, I was wondering who was asked to participate and how were they contacted. I believe that more people would have participated if they had known. A few years ago I asked my students to write an essay on an event that had impacted them the most and I was surprised to see that one third of the class wrote about how they were affected by the terrorist attack on Sept. 11th. Had I known about this, I would have asked them to contribute to the archive. It’s important to be well-informed and, honestly, I don’t know how, with all the changes happening in the digital world, one can keep up. The digital world doesn’t follow the traditional route of print: there is no waiting period, no editing, no promotion, no reading/lecture. So, this raises a bigger question for me: how can one be in the loop? To come back to the archive, I was deeply impressed by the richness of the information and the feedback or comments people received. I think that’s important because it’s an opportunity for people to sound off and also find validation for their concerns. It also presents a low-stakes opportunity to share their experiences on one level and even grieve together on another. It builds an online community of people who were impacted in different ways and different degrees and that’s a way to build strength and I think it’s shifting the focus of writing/narration from style to the lived experience. This new genre of writing, even though it falls under autobiography, presents a different version from what we come to view as such. It presents itself through different media, it doesn’t have to ask or wait for the seal of approval from anyone and it’s not censored, or so I hope. In that sense it offers a much better definition to the freedom of speech. Another valuable contribution the archive makes lies in the writing of the history of the tragic event and the events that followed. All that collection is a biography writer’s or researcher’s dream. It expands the notion of research and also, on a certain scale, does away with the gap-filling that the biography genre suffers from. It’s like a diary with multiple voices, images, perspectives, insights, perceptions, representations. It’s so diverse and rich in color and nuance. This reminds me of the great value we place on books like Les Miserables or The Belly of Paris because of their chronicling of the social, economic and political conditions of France in the 19th century. Or, the historical/fictitious book on New York chronicling/building its history from the time of the Dutch settlement. I wonder if they have a similar project about collecting stories from people living in New York City in the 21st century and what those archives would mean for the generations to come. We would have real life stories—no need for making up stories based on pictures.

Posted in Uncategorized | 1 Comment

9/11 Digital Archive

The difference between a single physical site of memory and the digital one is the quantity of stories and artifacts that can be gathered, retained and shared.  The physical museum obviously has its limitations in space and resources but in the case of the 9/11 Digital Archive the possibilities can expand and allow more than just a handful of stories. Additionally the public has been given rights to include their voice from where ever that may be. I say this because as a New Yorker my peers and I tend to focus first on the towers but there were stories from the Pentagon and from the surviving families of those in Shanksville, Pennsylvania.  Even little Suzy from small town Oklahoma can have her say on where she was when we were attacked, proving everyone’s voice counts. The additional value of this archive is hearing the voices of the often-silent participants who work as curators, historians, media specialist and technology professionals who cooperated on the design.

Especially touching were the voices of 9.11 here is New York link, watching these interviews taking place within the year following the event was hard to step away from and presented raw details.

The 9/11 archive project reminds me of an organization named the International Coalition of Sites of Conscience who constructs sites of memory for social justice. Most recognizable is the Lower East Side Tenement Museum but they are working on the Remembering Guantamo project where they hope to transform the old prison into a space of memory in Cuba.  About a year ago they were putting together an archive where narratives and photos would be used digitally not sure if it is complete yet. In this case going digital has its advantages because not many Americans would be able to make a trip to Cuba but I argue that a physical location is still necessary in many ways and won’t be dismissed anytime soon.  Additionally sites of memory are not only going digital for sharing information but for fundraising purposes in order to eventually produce a physical location with the narratives and artifacts collected.  I wonder if the archive was used to raise funds for the actual site in the case of 9/11?

Here is the link to the ICSOC http://www.sitesofconscience.org/categories/activities/guantanamo

Kathryn noted on her blog piece that she referred her teacher friend to use this as a tool for instruction with young people.  Using this resource could only enrich the routine classroom curriculum for young people far beyond the two-page dedication in a textbook.

Posted in Uncategorized | 1 Comment

Citizen archivists

I find the pairing of these two projects useful in that they represent both ends of the spectrum of digital archives; “What’s on the Menu” is a digitized collection, and the September 11 Digital Archive is comprised primarily of born digital materials.  It’s interesting to consider that the NYPL project extracts data from what we can visually interpret, while the September 11 Digital Archive makes visual what is essentially data.  Both engage with the public, drawing on a community’s involvement for some aspect of their development.  And together they highlight two of the core roles of cultural heritage institutions: access and preservation.

A few years ago Marvin Taylor (Fales Library, NYU) came to speak to my class and he was passionate, arguing that libraries needed to stop digitizing paper and instead focus on the mountains of magnetic media and other more endangered formats.  Paper’s not going anywhere.  It can sit for 10 more years while we tackle the digital problem, right?  Obviously he knew this wasn’t going to happen, but he made his point.

While we’ve made some progress in dealing with born digital materials, I think we’re still missing a key component–educating the public about archiving their personal digital materials.  In the meantime, we are fortunate that crowdsourced digital archives such as the September 11 Digital Archive (and the recent RRCHNM project, #OccupyArchive) are proactive in simultaneously collecting, preserving, and providing access to these materials.  As we imagine how the materials will be interpreted in 50 years, it is also interesting to think how these collections themselves will be viewed in the future as part of a larger effort to grapple with born digital materials.

 

Posted in Uncategorized | Tagged , , | 2 Comments

Fifty Years From Now…

This week both the September 11 Digital Archive and the NYPL What’s on the Menu? project had me thinking like a librarian–about collection and preservation. Stephen Brier and Joshua Brown write in their description of the creation of the September 11 Digital Archive:

At the meeting, the Sloan Foundation staff challenged us to think about what historians fifty years from now would want to know about the September 11 events and what data they would want to have access to in order to construct a full historical narrative of what transpired (102).

This call to think ahead to future historians also seems to be at the center of the NYPL menus project, and it is something that drives my own work to collect objects that many might dismiss as ephemeral (zines) at my own library.

One of the most amazing aspects of the NYPL menu project is the anomalous nature of the collection: not many libraries or archives have added menus to their collections (due in large part to the amount of work it would require in an age of austerity and severe library budget cuts today, but going back in time to more fiscally secure times this was also true). Yet these “ephemeral” objects say so much about local culture: they speak to economics, ethnicity, community and neighborhoods, food politics and distribution, trends in diet and health and so much more. If each local library collected a copy of its local menus, we would have a wealth of information on which to look at the development and makeup of American cities and communities (through the location of restaurants and kinds of foods served therein–I imagine a completely fascinating study of cities like Detroit could be made had these materials been preserved on a large scale over time). Hopefully the NYPL project’s success is inspiring other libraries to take part in the collection and preservation of these objects–especially with the popularity of the crowdsourced transcription.

The September 11 Digital Archive seems to take at its heart the fact that much of today’s history is built through communication that seems ephemeral and would be difficult to donate to an archive or museum–email, digital photographs, digital animations and other objects made up of the 1’s and 0’s of the digital humanities. In my own work as a librarian, I am interested in the objects that don’t make it into the library or the archive, and the narratives that aren’t reified as objects (oral histories, etc.). I wonder how the digital humanities can speak to this concept of archiving and preserving what would otherwise be lost or ignored but that we know we experienced and lived within particular moments–whether DH is involved in this process of capturing our experiences of events as historically huge as 9/11, or as mundane as what and where New Yorkers liked to eat when they went out in in 2012?

Is this process of capturing information and narratives for future historians at the heart of DH, and if so, how does this process relate (or not) to the history of libraries and archives? Is DH the home of digital libraries and archives of the future, or a fellow traveler working alongside and collaborating with these older institutions?

Posted in Uncategorized | Tagged , , , | 1 Comment

9/11 Digital Archives

After reading the two articles for this week and taking a look at the archives website I have a lot to say. First though I want to make a note that I have a very different perspective on the events of 9/11 and I do not mean to offend anyone with my comments. Please read this with an open mind and please respond with any comments or opinions.

When the Twin Towers were hit I was in 7th grade. I was in science class and my assistant principal came into the classroom and announced that the Twin Towers had been hit in NYC, it allegedly was a terrorist attack, and asked if anyone needed to make a phone call. We all looked around to see if anyone got up or raised their hand. When no one moved the assistant principal said that if anyone needed anything throughout the day to come see her in her office. After she left my teacher looked at the class, her facial expression hinted that she was trying to decide if she should continue with the lesson or stop to talk about the event. We continued with the lesson.

When I got home we turned on the television and watched the news for a half hour or so and then did our homework. In the following weeke we kept up to date about what was going on but it didn’t disrupt our lives at all, it was simply a current event. I think many people throughout the U.S. had a similar experience with 9/11. It was something that happened, it didn’t really have an affect on our daily lives until much later.

When I moved to New York 6 months ago I realized just how different of an experience I had. This event was something that truly shook the city. Looking at the Digital Archives helped me to see that. I wasn’t ever exposed and really had no concept of what people experience in New York and the surrounding areas. After reading the articles I called a history teacher from the high school I went to in Ohio and asked what their textbook said about 9/11. He told me that there is one page dedicated to 9/11. There are two pictures, one of the standing towers and one of the demolished towers. I told him about the Digital Archives website and he told me he had never visited it and wanted to look into it. I’m hoping that it is something he will use when he teaches 9/11. I think it is a fantastic way to gain perspective on the event.

Such a fantastic resource needs to be taken advantage of. I don’t think that the history teacher is naive for not knowing about the site. I think he really never thought of using such a thing because we all had SUCH a different and removed experience. Like I said it’s something that happened, it’s not something that seriously affected our everyday lives when the event occurred. So how to do expose teachers to such a wonderful resource? I wouldn’t have known about it if I hadn’t taken this course and I consider myself and educated individual and this website truly impacted my perspective on 9/11. How can we use D.H to promote and expand the viewership of such an amazing archive?

 

Posted in Uncategorized | Comments Off on 9/11 Digital Archives