Publishing Partner: Cambridge University Press CUP Extra Publisher Login
amazon logo
More Info


New from Oxford University Press!

ad

Holy Sh*t: A Brief History of Swearing

By Melissa Mohr

Holy Sh*t: A Brief History of Swearing "contains original research into the history of swearing, and is scrupulous in analyzing the claims of other scholars."


New from Cambridge University Press!

ad

A New Manual of French Composition

By R. L. Graeme Ritchie

A New Manual of French Composition "provides a guide to French composition aimed at university students and the higher classes in schools. "


The LINGUIST List is dedicated to providing information on language and language analysis, and to providing the discipline of linguistics with the infrastructure necessary to function in the digital world. LINGUIST is a free resource, run by linguistics students and faculty, and supported primarily by your donations. Please support LINGUIST List during the 2016 Fund Drive.

Summary Details


Query:   Genre-Specific Corpora
Author:  Marina Santini
Submitter Email:  click here to access email
Linguistic LingField(s):   Computational Linguistics
Text/Corpus Linguistics

Summary:   EDITOR'S NODE: PLEASE NOTE THAT SOME URLS INCLUDED IN THIS SUBMISSION
MAY CARRY OVER ONTO A SECOND LINE. IF YOU WANT TO GO TO A SPECIFIC
WEBSITE PROVIDED IN THIS SUBMISSION, PLEASE BE SURE THAT YOU HAVE
COPIED THE WHOLE URL.

MANY THANKS TO LAURA CHRISTOPHERSON, COHAN SUJAY CARLOS, VINEET
YADAV, JASON TEEPLE, LESLIE BARRETT, JOAKIM NORDSTRÖM, BOB KUHNS,
DONG WANG, DAVE LEWIS, JOHN TAIT, AND LOREDANA CERRATO.

SUGGESTED CORPORA AND RESOURCES IN ENGLISH IF NOT STATED OTHERWISE
(NOT ALL OF THEM ARE FREE OF CHARGE)

GENRE-SPECIFIC CORPORA:
- GENRE: SMS MESSAGES = NUS SMS CORPUS:
HTTP://WING.COMP.NUS.EDU.SG:8080/SMSCORPUS/ (ENGLISH / CHINESE)

- GENRE: CHATLOGS = CODIAC CHATLOGS
(HTTP://DATA.EOL.UCAR.EDU/CODIAC/DSS/ID=92.124;
HTTP://DATA.EOL.UCAR.EDU/CODIAC/DSS/ID=88.044;
HTTP://DATA.EOL.UCAR.EDU/CODIAC/DSS/ID=107.010)

- GENRE: CHATLOGS = MANY EYES DATASETS: SOME CHATLOGS CAN BE FOUND
HERE:
HTTP://WWW-958.IBM.COM/SOFTWARE/DATA/COGNOS/MANYEYES/DATASETS

- GENRE: CHATS AND SWITCHBOARD CONVERSATIONS =
SWITCHBOARD CORPUS AND NPS CHAT CORPUS SAMPLES NLTK IN NLTK DATA
(HTTP://NLTK.GOOGLECODE.COM/SVN/TRUNK/NLTK_DATA/INDEX.XML). THE NPS
CHAT CORPUS (HTTP://FACULTY.NPS.EDU/CMARTELL/NPSCHAT.HTM) IS A POS
TAGGED CHAT CORPUS AND THE SWITCHBOARD CORPUS
(HTTP://SPOT.COLORADO.EDU/~MICHAELI/LEXSUBJ/SWBD.HTML) IS A TELEPHONIC
CONVERSATION CORPUS.

- THE LINGUISTICS DATA CONSORTIUM HAS A GOOD DEAL OF TELEPHONE
CONVERSATION - MANY FILES AND A VARIETY OF LANGUAGES. SEE
HTTP://WWW.LDC.UPENN.EDU/CATALOG/BYTYPE.JSP#LEXICON,%20SPEECH,%20
TEXT (NOT FOR FREE)

- GENRE: BLOGS = THE CORPORATE WEBLOGS DATASET IN TREC DATASETS
(HTTP://IR.DCS.GLA.AC.UK/TEST_COLLECTIONS/) IS NOT FOR FREE. HELPFUL WIKI:
HTTP://IR.DCS.GLA.AC.UK/WIKI/TREC-BLOG
- GENRE: CORPORATE BLOGS = IT IS POSSIBLE TO PULL CORPORATE BLOG FEEDS
OR SCRAPE THE BLOGS FROM THIS LIST:
HTTP://WWW.DEBBIEWEIL.COM/BLOG/LIST-OF-67-BIG-BRAND-CORPORATE-BLOGS/

- THE GÖTEBORG SPOKEN LANGUAGE CORPUS AND OTHER CORPORA IN
SWEDISH (HTTP://SPRAAKBANKEN.GU.SE/)

- GENRE: TWEETS = THE TWITTER CORPUS ASSOCIATED WITH THE PAPER
WWW.STANFORD.EDU/~ALECMGO/PAPERS/TWITTERDISTANTSUPERVISION09.PDF IS
HERE: HTTPS://SITES.GOOGLE.COM/SITE/TWITTERSENTIMENTHELP/FOR-RESEARCHERS

- GENRE: TWEETS AND OTHER MICROBLOGS= MICROBLOG TRACK
HTTP://SITES.GOOGLE.COM/SITE/TRECMICROBLOGTRACK/ (NOT FOR FREE)

- GENRE: NEWSWIRES: REUTERS' NEWSWIRES COLLECTIONS =
HTTP://TREC.NIST.GOV/DATA/REUTERS/REUTERS.HTML

- GENRE: EMAILS = ENRON CORPUS (HTTP://WWW.CS.CMU.EDU/~ENRON/);
CATEGORIZED ENRON EMAILS (HTTP://SGI.NU/ENRON/CORPORA.PHP)

- GENRE: EMAILS = JUNK EMAIL CORPUS
(HTTP://CLG.WLV.AC.UK/RESOURCES/JUNK-EMAILS/INDEX.PHP)

- GENRE: FAQS = 200 FAQS
(HTTP://WWW.ITRI.BRIGHTON.AC.UK/~MARINA.SANTINI/#DOWNLOAD)

RESOURCES:
- IN TERMS OF WORDS AND CONCEPT, THERE ARE TWO MAIN RESOURCES FOR
ENGLISH. FIRST IS WORDNET, ORIGINALLY FROM PRINCETON, IT IS IN NLTK (AND
ONE CAN GET IT SEPARATELY). IT IS ENGLISH WORDS 'ORGANIZED' ACCORDING TO
THEIR RELATIONSHIPS: SYNONYM, HYPONYM, PIECE OF A WHOLE, ETC. THE OTHER
RESOURCE IS WORD ASSOCIATION NORMS, ONE CAN GET THAT FROM THE
UNIVERSITY OF SOUTH FLORIDA (HTTP://W3.USF.EDU/FREEASSOCIATION/).
- ARTICLE: HELLA KOO FINDING: TWITTER DIALECT -
HTTP://BLOGS.WSJ.COM/IDEAS-MARKET/2011/02/08/HELLA-KOO-FINDING-TWITTER-
DIALECT/
- GENRE: TWEETS = THE SUGGESTION IS TO USE TWITTER API TO CRAWL TWITTER
DATASET.
- DISCOVERTEXT IS A PROGRAM YOU CAN USE TO SCOOP OUT TWITTER FEEDS
REALLY EASILY. THEIR WEBSITE IS HERE:
HTTP://DISCOVERTEXT.COM/DEFAULTDT2.ASPX
ONE CAN DO A FREE 30 DAY TRIAL AND GET A BUNCH OF TWITTER MESSAGES.

NOTE:
GENRE: TWEETS = THE EDINBURG TWEETS CORPUS HAS BEEN WITHDRAWN:
HTTP://DEMETER.INF.ED.AC.UK/

LL Issue: 22.2068
Date Posted: 13-May-2011
Original Query: Read original query