Tofu vs. Hotdog: Charting the Evolution of the American Diet Over Time With Google's Latest Gadget
Google Labs has just released the Google Books N-Gram Viewer, and it is fun!
I have to confess to not really understanding the fine mathematical detail behind the term "n-gram," but the resulting graphs simply show the frequency with which words occur within the Google Books database, over time. You can look when and how fast individual words spike and subside in popularity, as well as compare how different words fare against each other, in a reflection of larger linguistic and social changes.
The San Jose Mercury News rounds up some examples of Google Books N-Gram Viewer uses and findings, from detecting trends in censorship to the pace at which the past is being forgotten:
Trends in censorship can be identified through counts of names. For example, Jewish artist Marc Chagall was mentioned just once in the entire German body of literature from 1936 to 1944, even as his prominence in English-language books grew roughly fivefold. Similar suppression is seen in Russian with regard to Leon Trotsky; in Chinese with regard to Tiananmen Square; and in the U.S. with regard to the "Hollywood Ten," a group of entertainers blacklisted in 1947.
Books forget our past faster with each passing year. The Harvard-Google team tracked the frequency with which each year from 1875 to 1975 appeared and found that references to the past decrease much more rapidly now than in the 19th century. References to "1880" didn't fall by half until 1912—a lag of 32 years—but references to "1973" reached half their peak just a decade later, in 1983.
The Google's engineers and Harvard linguists behind the project have described their approach and the resulting insights as a new science of "culturomics," which they define as "the application of high-throughput data collection and analysis to the study of human culture." As an example the Ngram View landing page shows a pre-generated chart comparing "tofu" and "hot dog" occurrences in books published since 1920 (both increase, but tofu races past hot dog in the early 1980s).
Thus encouraged, I compared all sort of food words, to see what culturomics has to teach us about the American diet in print. The slideshow above is the tip of the iceberg—be warned that it is extremely addictive.
Japanese Lawmakers Move To Reduce The Country’s Suicide Rate By 30% Japan has the highest suicide rate in the G-7.
Kevin Durant Donates Amazing Basketball Court To New York City This is the eighth court the NBA star has refurbished for students in need.
In Problematic Boy Scout Speech, Trump Offends Just About Everyone “As an Eagle Scout Mom, I grieve for our country.”
Roombas Are Measuring Homes In The Hopes Of Selling The Data To Other Companies Add the Roomba to the list of devices that are taking notes on how you live.
Circa Survive Guitarist Walks Off Stage To Confront A Man Apparently Sexually Harassing A Woman In The Audience He explained what happened in a series of Tweets after the show.
A Former Ball Boy Wants To Turn His Daughter Into The Next Serena Williams The duo are taking on India’s tennis elite.