We know where you are tweeting from: Assigning a type of place to tweets using natural language processing and random forests

Abdulkareem Alsudais, Gondy Leroy, Anthony Corso

Research output: Chapter in Book/Report/Conference proceedingConference contribution

6 Scopus citations

Abstract

Identifying the type of the place a user is tweeting from is important for many business and social applications, e.g., user profiles can help local businesses identify current and potential clients and their interests. We used Random Forest to identify six location categories. They are active life, eating out, hotels, nightlife, shopping, and shows. We evaluated 16 features for use in classification. The features are generated from the textual contents in the tweet, the metadata associated with the tweet, and the geographical area the user is tweeting from. We trained our classifier by analyzing 43,149 reviews from Yelp and by examining two twitter datasets. The first is an original dataset consisting of 6,359 tweets and the second is a stratified one containing 2,400 tweets uniformly distributed between the six categories. We evaluated our approach by creating a gold standard. Using 60% of our tweets for training and 40% for testing, our approach classified 74% of tweets in the original dataset, and 77% of tweets in the stratified dataset, correctly with the right location category. The results could be beneficial for research and business.

Original languageEnglish (US)
Title of host publicationProceedings - 2014 IEEE International Congress on Big Data, BigData Congress 2014
EditorsPeter Chen, Peter Chen, Hemant Jain
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages594-600
Number of pages7
ISBN (Electronic)9781479950577
DOIs
StatePublished - Sep 22 2014
Event3rd IEEE International Congress on Big Data, BigData Congress 2014 - Anchorage, United States
Duration: Jun 27 2014Jul 2 2014

Publication series

NameProceedings - 2014 IEEE International Congress on Big Data, BigData Congress 2014

Other

Other3rd IEEE International Congress on Big Data, BigData Congress 2014
CountryUnited States
CityAnchorage
Period6/27/147/2/14

Keywords

  • Natural Language Processing
  • Random Forests
  • location analytics

ASJC Scopus subject areas

  • Computer Science Applications

Fingerprint Dive into the research topics of 'We know where you are tweeting from: Assigning a type of place to tweets using natural language processing and random forests'. Together they form a unique fingerprint.

Cite this