Reading list

LangID

Arkaitz Zubiaga, Iñaki San Vicente, Pablo Gamallo, José Ramom Pichel, Iñaki Alegria, Nora Aranberri, Aitzol Ezeiza, Víctor Fresno TweetLID: a benchmark for tweet language identification. In Language Resources and Evaluation, 2016 doi
Aaron Jaech, George Mulcaire, Shobhit Hathi, Mari Ostendorf, Noah A. Smith Hierarchical Character-Word Models for Language Identification. In Proceedings of The Fourth International Workshop on Natural Language Processing for Social Media, Austin, TX, USA, 2016
Jennifer Williams, Charlie Dagli Twitter Language Identification Of Similar Languages And Dialects Without Ground Truth. In Proceedings of the Fourth Workshop on NLP for Similar Languages, Varieties and Dialects (VarDial), Valencia, Spain, 2017
Yoon Kim, Yacine Jernite, David Sontag, Alexander Rush Character-Aware Neural Language Models. In AAAI Conference on Artificial Intelligence, 2016
Thamar Solorio, Elizabeth Blair, Suraj Maharjan, Steven Bethard, Mona Diab, Mahmoud Ghoneim, Abdelati Hawwari, Fahad AlGhamdi, Julia Hirschberg, Alison Chang, Pascale Fung Overview for the First Shared Task on Language Identification in Code-Switched Data. In Proceedings of the First Workshop on Computational Approaches to Code Switching, Doha, Qatar, 2014
Su Lin Blodgett, Johnny Wei, Brendan O'Connor A Dataset and Classifier for Recognizing Social Media English. In Proceedings of the 3rd Workshop on Noisy User-generated Text, Copenhagen, Denmark, 2017
Proceedings of the Second Workshop on Computational Approaches to Code Switching. Austin, Texas, 2016
Giovanni Molina, Fahad AlGhamdi, Mahmoud Ghoneim, Abdelati Hawwari, Nicolas Rey-Villamizar, Mona Diab, Thamar Solorio Overview for the Second Shared Task on Language Identification in Code-Switched Data . In Proceedings of the Second Workshop on Computational Approaches to Code Switching , Austin, Texas, 2016 doi
Younes Samih, Wolfgang Maier, Laura Kallmeyer SAWT: Sequence Annotation Web Tool. In Proceedings of the Second Workshop on Computational Approaches to Code Switching, Austin, Texas, 2016
Tommi Jauhiainen, Marco Lui, Marcos Zampieri, Timothy Baldwin, Krister Lindén Automatic Language Identification in Texts: A Survey. In CoRR, 2018
Nagesh Bhattu Sristy, N. Satya Krishna, B. Shiva Krishna, Vadlamani Ravi Language Identification in Mixed Script. In Proceedings of the 9th Annual Meeting of the Forum for Information Retrieval Evaluation, Bangalore, India, 2017 doi
Maimaitiyiming Hasimu, Wushour Silamu On Hierarchical Text Language-Identification Algorithms. In Algorithms, 2018 doi
Erik Tromp, Mykola Pechenizkiy Graph-based n-gram language identification on short texts.

Code Switching

John C. Paolillo ``Conversational'' codeswitching on Usenet and Internet Relay Chat. In Language@Internet, 2011
John J. Gumperz Discourse Strategies. 1982 doi
Mónica Stella Cárdenas-Claros, Neny Isharyanti Code-switching and code-mixing in internet chatting: Between’yes,” ya,’and’si’-a case study. In The Jalt Call Journal, 2009
Chad Nilep "Code switching" in sociocultural linguistics. 2017 doi
Brenda Danet, Susan C Herring The multilingual Internet: Language, culture, and communication online. 2007
Susan C. Herring The Rhetorical Dynamics of Gender Harassment On-Line. In The Information Society, 1999 doi
Carol Myers-Scotton Social motivations for codeswitching: Evidence from Africa. 1995
Carol Myers-Scotton Duelling languages: Grammatical structure in codeswitching. 1997
John C Paolillo How much multilingualism? Language diversity on the Internet. In The multilingual Internet: Language, culture, and communication online, 2007
Frans Van Coetsem Loan phonology and the two transfer types in language contact. 1988
John Paolillo, Daniel Pimienta, Daniel Prado, others Measuring linguistic diversity on the Internet. In UNESCO Institute for Statistics Montreal, Canada, 2005
David Jurgens, Stefan Dimitrov, Derek Ruths Twitter Users #CodeSwitch Hashtags! #MoltoImportante #wow. In Proceedings of the First Workshop on Computational Approaches to Code Switching, Doha, Qatar, 2014
Rosalyn Negrón Goldbarg Spanish-English Codeswitching in Email Communication. In Language@Internet, 2009
Mark Warschauer, Ghada R. El Said, Ayman G. Zohry Language Choice Online: Globalization and Identity in Egypt. In Journal of Computer-Mediated Communication, 2002 doi
Peter Auer The'why'and'how'questions in the analysis of conversational code-switching. In Code-switching in Conversation, 2013
Injy Hamed, Mohamed Elmahdy, Slim Abdennadher Building a First Language Model for Code-switch Arabic-English. In Procedia Computer Science, 2017 doi
Pieter Muysken Code-switching and grammatical theory. In One Speaker, Two Languages: Cross-Disciplinary Perspectives on Code-Switching, 1995 doi
Penelope Gardner-Chloros, Malcolm Edwards Assumptions Behind Grammatical Approaches To Code-Switching: When The Blueprint Is A Red Herring. In Transactions of the Philological Society, doi
Nancy H Hornberger, Sandra Lee McKay Sociolinguistics and language education. 2010

Named Entities

Timothy Baldwin, Marie-Catherine de Marneffe, Bo Han, Young-Bum Kim, Alan Ritter, Wei Xu Shared Tasks of the 2015 Workshop on Noisy User-generated Text: Twitter Lexical Normalization and Named Entity Recognition. In Proceedings of the Workshop on Noisy User-generated Text, Beijing, China, 2015
Gustavo Aguilar, Fahad AlGhamdi, Victor Soto, Mona Diab, Julia Hirschberg, Thamar Solorio Named Entity Recognition on Code-Switched Data: Overview of the CALCS 2018 Shared Task. In Proceedings of the Third Workshop on Computational Approaches to Linguistic Code-Switching, Melbourne, Australia, 2018
Vikas Yadav, Steven Bethard A Survey on Recent Advances in Named Entity Recognition from Deep Learning models. In Proceedings of the 27th International Conference on Computational Linguistics, Santa Fe, New Mexico, USA, 2018
Leon Derczynski, Eric Nichols, Marieke van Erp, Nut Limsopatham Results of the WNUT2017 Shared Task on Novel and Emerging Entity Recognition. In Proceedings of the 3rd Workshop on Noisy User-generated Text, Copenhagen, Denmark, 2017
Benjamin Strauss, Bethany Toma, Alan Ritter, Marie-Catherine de Marneffe, Wei Xu Results of the WNUT16 Named Entity Recognition Shared Task. In Proceedings of the 2nd Workshop on Noisy User-generated Text (WNUT), Osaka, Japan, 2016

Twitter

Thibault Sellam, Omar Alonso Raimond: Quantitative Data Extraction from Twitter to Describe Events. In Engineering the Web in the Big Data Era: 15th International Conference, ICWE 2015, Rotterdam, The Netherlands, June 23-26, 2015, Proceedings, Cham, 2015 doi
Omar Alonso, Catherine C. Marshall, Marc Najork Are Some Tweets More Interesting Than Others? #HardQuestion. In Proceedings of the Symposium on Human-Computer Interaction and Information Retrieval, Vancouver BC, Canada, 2013 doi
Isabel Anger, Christian Kittl Measuring Influence on Twitter. In Proceedings of the 11th International Conference on Knowledge Management and Knowledge Technologies, Graz, Austria, 2011 doi
Eytan Bakshy, Jake M. Hofman, Winter A. Mason, Duncan J. Watts Everyone's an Influencer: Quantifying Influence on Twitter. In Proceedings of the Fourth ACM International Conference on Web Search and Data Mining, Hong Kong, China, 2011 doi
Jesse Freitas, Heng Ji Identifying News from Tweets. In Proceedings of the First Workshop on NLP and Computational Social Science, Austin, Texas, 2016
Vinodh Krishnan, Jacob Eisenstein Nonparametric Bayesian Storyline Detection from Microtexts. In Proceedings of the 2nd Workshop on Computing News Storylines (CNS 2016), Austin, Texas, 2016
Gevorg Poghosyan, Georgiana Ifrim Real-time News Story Detection and Tracking with Hashtags. In Proceedings of the 2nd Workshop on Computing News Storylines (CNS 2016), Austin, Texas, 2016
Daniel Bruggermann, Yannik Hermey, Carsten Orth, Darius Schneider, Stefan Selzer, Gerasimos Spanakis Storyline detection and tracking using Dynamic Latent Dirichlet Allocation. In Proceedings of the 2nd Workshop on Computing News Storylines (CNS 2016), Austin, Texas, 2016
Sunghwan Mac Kim, Stephen Wan, Cecile Paris, Jin Brian, Bella Robinson The Effects of Data Collection Methods in Twitter. In Proceedings of the First Workshop on NLP and Computational Social Science, Austin, Texas, 2016
Kristen Johnson, Dan Goldwasser Identifying Stance by Analyzing Political Discourse on Twitter. In Proceedings of the First Workshop on NLP and Computational Social Science, Austin, Texas, 2016
Hassan Saif, Miriam Fernández, Yulan He, Harith Alani Evaluation datasets for Twitter sentiment analysis: a survey and a new dataset, the STS-Gold. In 1st Interantional Workshop on Emotion and Sentiment in Social and Expressive Media: Approaches and Perspectives from AI (ESSEM 2013), 2013
Clare Llewellyn, Laura Cram, Adrian Favero, Robin L. Hill Russian Troll Hunting in a Brexit Twitter Archive. In Proceedings of the 18th ACM/IEEE on Joint Conference on Digital Libraries, Fort Worth, Texas, USA, 2018 doi
Miriam Fernandez, Moizzah Asif, Harith Alani Understanding the Roots of Radicalisation on Twitter. In In WebSci ?18: 10th ACM Conference on Web Science, 2018
Todor Mihaylov, Georgi Georgiev, Preslav Nakov Finding Opinion Manipulation Trolls in News Community Forums. In Proceedings of the Nineteenth Conference on Computational Natural Language Learning, Beijing, China, 2015
Alex P Schmid Radicalisation, de-radicalisation, counter-radicalisation: A conceptual discussion and literature review. In ICCT Research Paper, 2013

Clustering

Georgiana Ifrim, Bichen Shi, Igor Brigadir Event detection in twitter using aggressive filtering and hierarchical tweet clustering. In Second Workshop on Social News on the Web (SNOW), Seoul, Korea, 8 April 2014, 2014
Mahmud Hasan, Mehmet A Orgun, Rolf Schwitter A survey on real-time event detection from the Twitter data stream. In Journal of Information Science, 0 doi
L. Nassar, R. Ibrahim, F. Karray Enhancing Topic Detection in Twitter Using the Crowdsourcing Process. In 2016 International Conference on Collaboration Technologies and Systems (CTS), 2016 doi
A Castellanos, J Cigarrán, A García-Serrano Formal concept analysis for topic detection: A clustering quality experimental analysis. In Information Systems, 2017
L. M. Aiello, G. Petkos, C. Martin, D. Corney, S. Papadopoulos, R. Skraba, A. Göker, I. Kompatsiaris, A. Jaimes Sensing Trending Topics in Twitter. In IEEE Transactions on Multimedia, 2013 doi

Near-duplicate detection

Ke Tao, Fabian Abel, Claudia Hauff, Geert-Jan Houben, Ujwal Gadiraju Groundhog Day: Near-duplicate Detection on Twitter. In Proceedings of the 22Nd International Conference on World Wide Web, Rio de Janeiro, Brazil, 2013 doi
Dell Zhang, Jun Wang, Deng Cai, Jinsong Lu Self-taught Hashing for Fast Similarity Search. In Proceedings of the 33rd International ACM SIGIR Conference on Research and Development in Information Retrieval, Geneva, Switzerland, 2010 doi
D. Cai A Revisit of Hashing Algorithms for Approximate Nearest Neighbor Search. In ArXiv e-prints, 2016

Distributed representations

Words

Jeffrey Pennington, Richard Socher, Christopher Manning Glove: Global Vectors for Word Representation. In Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), Doha, Qatar, 2014
Yoav Goldberg, Omer Levy word2vec Explained: deriving Mikolov et al.'s negative-sampling word-embedding method. In CoRR, 2014
Omer Levy, Yoav Goldberg Neural Word Embedding as Implicit Matrix Factorization. In Advances in Neural Information Processing Systems 27, 2014

Documents

Yoav Goldberg A Primer on Neural Network Models for Natural Language Processing. In CoRR, 2015
Ronan Collobert, Jason Weston A Unified Architecture for Natural Language Processing: Deep Neural Networks with Multitask Learning. In Proceedings of the 25th International Conference on Machine Learning, Helsinki, Finland, 2008 doi
Ryan Kiros, Yukun Zhu, Ruslan Salakhutdinov, Richard S. Zemel, Antonio Torralba, Raquel Urtasun, Sanja Fidler Skip-Thought Vectors. In CoRR, 2015
Quoc V. Le, Tomas Mikolov Distributed Representations of Sentences and Documents. In CoRR, 2014
Kai Sheng Tai, Richard Socher, Christopher D. Manning Improved Semantic Representations From Tree-Structured Long Short-Term Memory Networks. In Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (Volume 1: Long Papers), Beijing, China, 2015
Shayne Longpre, Sabeek Pradhan, Caiming Xiong, Richard Socher A Way out of the Odyssey: Analyzing and Combining Recent Insights for LSTMs. In CoRR, 2016

Convolutional

Nal Kalchbrenner, Edward Grefenstette, Phil Blunsom A Convolutional Neural Network for Modelling Sentences. In Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), Baltimore, Maryland, 2014
Yoon Kim Convolutional Neural Networks for Sentence Classification. In Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), Doha, Qatar, 2014
Ye Zhang, Byron C. Wallace A Sensitivity Analysis of (and Practitioners' Guide to) Convolutional Neural Networks for Sentence Classification. In CoRR, 2015
Misha Denil, Alban Demiraj, Nal Kalchbrenner, Phil Blunsom, Nando de Freitas Modelling, Visualising and Summarising Documents with a Single Convolutional Neural Network. In CoRR, 2014
jiaming xu, peng wang, guanhua tian, bo xu, jun zhao, fangyuan wang, hongwei hao Short Text Clustering via Convolutional Neural Networks. In Proceedings of the 1st Workshop on Vector Space Modeling for Natural Language Processing, Denver, Colorado, 2015
J. Xu, B. Xu, P. Wang, S. Zheng, G. Tian, J. Zhao, B. Xu Self-Taught Convolutional Neural Networks for Short Text Clustering. In ArXiv e-prints, 2017
Siwei Lai, Liheng Xu, Kang Liu, Jun Zhao Recurrent Convolutional Neural Networks for Text Classification. In Proceedings of the Twenty-Ninth AAAI Conference on Artificial Intelligence, Austin, Texas, 2015

Topic models

Li Wan, Leo Zhu, Rob Fergus A hybrid neural network-latent topic model. In Journal of Machine Learning Research, 2012
Jianshu Chen, Ji He, Yelong Shen, Lin Xiao, Xiaodong He, Jianfeng Gao, Xinying Song, Li Deng End-to-end Learning of LDA by Mirror-Descent Back Propagation over a Deep Architecture. In Advances in Neural Information Processing Systems 28, 2015

Twitter

Soroush Vosoughi, Prashanth Vijayaraghavan, Deb Roy Tweet2Vec: Learning Tweet Embeddings Using Character-level CNN-LSTM Encoder-Decoder. In Proceedings of the 39th International ACM SIGIR Conference on Research and Development in Information Retrieval, Pisa, Italy, 2016 doi
Bhuwan Dhingra, Zhong Zhou, Dylan Fitzpatrick, Michael Muehl, William Cohen Tweet2Vec: Character-Based Distributed Representations for Social Media. In Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), Berlin, Germany, 2016
Cicero dos Santos, Maira Gatti Deep Convolutional Neural Networks for Sentiment Analysis of Short Texts. In Proceedings of COLING 2014, the 25th International Conference on Computational Linguistics: Technical Papers, Dublin, Ireland, 2014
Grzegorz Chrupała Normalizing tweets with edit scripts and recurrent neural embeddings. In Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), Baltimore, Maryland, 2014
G. J, M. Gupta, V. Varma Improving Tweet Representations using Temporal and User Context. In ArXiv e-prints, 2016

Other

Rie Johnson, Tong Zhang Effective Use of Word Order for Text Categorization with Convolutional Neural Networks. In Proceedings of the 2015 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Denver, Colorado, 2015
Peng Wang, Jiaming Xu, Bo Xu, Chenglin Liu, Heng Zhang, Fangyuan Wang, Hongwei Hao Semantic Clustering and Convolutional Neural Network for Short Text Categorization. In Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (Volume 2: Short Papers), Beijing, China, 2015
Yafeng Ren, Yue Zhang Deceptive Opinion Spam Detection Using Neural Network. In Proceedings of COLING 2016, the 26th International Conference on Computational Linguistics: Technical Papers, Osaka, Japan, 2016
Di Jiang, Lei Shi, Rongzhong Lian, Hua Wu Latent Topic Embedding. In Proceedings of COLING 2016, the 26th International Conference on Computational Linguistics: Technical Papers, Osaka, Japan, 2016
Shulei Ma, Zhi-Hong Deng, Yunlun Yang An Unsupervised Multi-Document Summarization Framework Based on Neural Document Model. In Proceedings of COLING 2016, the 26th International Conference on Computational Linguistics: Technical Papers, Osaka, Japan, 2016
Víctor Mijangos, Gerardo Sierra, Azucena Montes Sentence level matrix representation for document spectral clustering . In Pattern Recognition Letters , 2017 doi
Kuan-Yu Chen, Shih-Hung Liu, Berlin Chen, Hsin-Min Wang Learning to Distill: The Essence Vector Modeling Framework. In CoRR, 2016
Ye Zhang, Md Mustafizur Rahman, Alex Braylan, Brandon Dang, Heng-Lu Chang, Henna Kim, Quinten McNamara, Aaron Angert, Edward Banner, Vivek Khetan, Tyler McDonnell, An Thanh Nguyen, Dan Xu, Byron C. Wallace, Matthew Lease Neural Information Retrieval: A Literature Review. In CoRR, 2016
Juan-Pablo Posadas-Durán, Helena Gómez-Adorno, Grigori Sidorov, Ildar Batyrshin, David Pinto, Liliana Chanona-Hernández Application of the distributed document representation in the authorship attribution task for small corpora. In Soft Computing, 2016 doi
Lidong Bing, Zheng-Yu Niu, Wai Lam, Haifeng Wang Learning a Semantic Space of Web Search via Session Data. In Information Retrieval Technology: 12th Asia Information Retrieval Societies Conference, AIRS 2016, Beijing, China, November 30 -- December 2, 2016, Proceedings, Cham, 2016 doi
Rie Johnson, Tong Zhang Semi-supervised Convolutional Neural Networks for Text Categorization via Region Embedding. In Advances in Neural Information Processing Systems 28, 2015
O. Rippel, M. Paluri, P. Dollar, L. Bourdev Metric Learning with Adaptive Density Discrimination. In ArXiv e-prints, 2015
G. Neubig, C. Dyer, Y. Goldberg, A. Matthews, W. Ammar, A. Anastasopoulos, M. Ballesteros, D. Chiang, D. Clothiaux, T. Cohn, K. Duh, M. Faruqui, C. Gan, D. Garrette, Y. Ji, L. Kong, A. Kuncoro, G. Kumar, C. Malaviya, P. Michel, Y. Oda, M. Richardson, N. Saphra, S. Swayamdipta, P. Yin DyNet: The Dynamic Neural Network Toolkit. In ArXiv e-prints, 2017

TensorFlow

Word2vec