Public sentiment analysis in twitter data for prediction of a company's stock price movements

Li Bing, Chun Chung Chan, Carol Ou

Research output: Chapter in book / Conference proceedingConference article published in proceeding or bookAcademic researchpeer-review

54 Citations (Scopus)

Abstract

There has recently been some effort to mine social media for public sentiment analysis. Studies have suggested that public emotions shown through Tweeter may well be correlated with the Dow Jones Industrial Average. However, can public sentiment be analyzed to predict the movements of the stock price of a particular company? If so, is it possible for the stock price of one company to be more predictable than that of another company? Is there a particular kind of companies whose stock price are more predictable based on analyzing public sentiments as reflected in Twitter data? In this article, we propose a method to mine Twitter data for answers to these questions. Specifically, we propose to use a data mining algorithm to determine if the price of a selection of 30 companies listed in NASDAQ and the New York Stock Exchange can actually be predicted by the given 15 million records of tweets (i.e., Twitter messages). We do so by extracting ambiguous textual tweet data through NLP techniques to define public sentiment, then make use of a data mining technique to discover patterns between public sentiment and real stock price movements. With the proposed algorithm, we manage to discover that it is possible for the stock closing price of some companies to be predicted with an average accuracy as high as 76.12%. In this paper, we describe the data mining algorithm that we use and discuss the key findings in relation to the questions posed.
Original languageEnglish
Title of host publicationProceedings - 11th IEEE International Conference on E-Business Engineering, ICEBE 2014 - Including 10th Workshop on Service-Oriented Applications, Integration and Collaboration, SOAIC 2014 and 1st Workshop on E-Commerce Engineering, ECE 2014
PublisherIEEE
Pages232-239
Number of pages8
ISBN (Electronic)9781479965632
DOIs
Publication statusPublished - 1 Jan 2014
Event11th IEEE International Conference on E-Business Engineering, ICEBE 2014 - Guangzhou, China
Duration: 5 Nov 20147 Nov 2014

Conference

Conference11th IEEE International Conference on E-Business Engineering, ICEBE 2014
CountryChina
CityGuangzhou
Period5/11/147/11/14

Keywords

  • data mining
  • social media
  • stock market
  • Twitter

ASJC Scopus subject areas

  • Management of Technology and Innovation
  • Computer Science Applications
  • Software

Cite this