Social Media’s Impact on Consumer Mindset: When to Use Which Sentiment Extraction Tool?

Anatoli Colicev, Raoul Kübler, Koen Pauwels

Research output: Contribution to journalArticle

Abstract

User-generated content provides managers rich data opportunities to gauge customers’ feelings, and sentiment analysis of social media data is increasingly used in a wide variety of fields, including finance, politics, and marketing. Popular tools include simple volume measures (such as number of likes and clicks), dictionary-based analysis of sentiment-rich words, and machine learning-based techniques.
These tools are typically used in isolation, which hinders ability to compare their power to explain customer-level performance such as brand awareness, image, purchase intent, customer satisfaction, and recommendation. Similarly, managers and other decision makers are uncertain as to whether their analysts are using the appropriate tool to extract actionable sentiment information for their specific brands and industries.
Raoul Kübler, Anatoli Colicev, and Koen Pauwels address this issue by analyzing a unique dataset with daily social media and consumer mindset metrics for 48 brands in diverse industries. They compare the dynamic explanatory power of these methods for daily customer mindset metrics.
Overall, vector autoregressive models show that machine learning-based approaches have the best average performance for detecting positive, negative and neutral comments. At the same time, there are systematic differences among industries, mindset metrics, and brands. Since costs increase when moving from volume metrics to dictionaries and machine learning, these findings can help managers decide when more detailed analytics are worth the investment.
Volume metrics are the cheapest to obtain and perform well for explaining awareness and purchase intent. This is an appropriate choice especially for smaller brands in negative sentiment industries (e.g., airlines and banking). Managers of other brands may consider investing in more sophisticated sentiment analysis techniques, especially when explaining or predicting brand impression, satisfaction, and recommendation.
Original languageEnglish
JournalMSI Working Paper Series
Publication statusPublished - 2017

Fingerprint

Mindset
Sentiment
Managers
Industry
Machine learning
Social media
Sentiment analysis
Purchase intent
Finance
Investing
Banking industry
Performance levels
Vector autoregressive model
Decision maker
Airline industry
Brand awareness
Costs
Customer satisfaction
Marketing
Isolation

Cite this

Social Media’s Impact on Consumer Mindset: When to Use Which Sentiment Extraction Tool? / Colicev, Anatoli; Kübler, Raoul; Pauwels, Koen.

In: MSI Working Paper Series, 2017.

Research output: Contribution to journalArticle

@article{dfc66a0c77594da88d19188659b506f9,
title = "Social Media’s Impact on Consumer Mindset: When to Use Which Sentiment Extraction Tool?",
abstract = "User-generated content provides managers rich data opportunities to gauge customers’ feelings, and sentiment analysis of social media data is increasingly used in a wide variety of fields, including finance, politics, and marketing. Popular tools include simple volume measures (such as number of likes and clicks), dictionary-based analysis of sentiment-rich words, and machine learning-based techniques.These tools are typically used in isolation, which hinders ability to compare their power to explain customer-level performance such as brand awareness, image, purchase intent, customer satisfaction, and recommendation. Similarly, managers and other decision makers are uncertain as to whether their analysts are using the appropriate tool to extract actionable sentiment information for their specific brands and industries.Raoul K{\"u}bler, Anatoli Colicev, and Koen Pauwels address this issue by analyzing a unique dataset with daily social media and consumer mindset metrics for 48 brands in diverse industries. They compare the dynamic explanatory power of these methods for daily customer mindset metrics.Overall, vector autoregressive models show that machine learning-based approaches have the best average performance for detecting positive, negative and neutral comments. At the same time, there are systematic differences among industries, mindset metrics, and brands. Since costs increase when moving from volume metrics to dictionaries and machine learning, these findings can help managers decide when more detailed analytics are worth the investment.Volume metrics are the cheapest to obtain and perform well for explaining awareness and purchase intent. This is an appropriate choice especially for smaller brands in negative sentiment industries (e.g., airlines and banking). Managers of other brands may consider investing in more sophisticated sentiment analysis techniques, especially when explaining or predicting brand impression, satisfaction, and recommendation.",
author = "Anatoli Colicev and Raoul K{\"u}bler and Koen Pauwels",
note = "Winner of 2018 Top Download Award",
year = "2017",
language = "English",
journal = "MSI Working Paper Series",

}

TY - JOUR

T1 - Social Media’s Impact on Consumer Mindset: When to Use Which Sentiment Extraction Tool?

AU - Colicev, Anatoli

AU - Kübler, Raoul

AU - Pauwels, Koen

N1 - Winner of 2018 Top Download Award

PY - 2017

Y1 - 2017

N2 - User-generated content provides managers rich data opportunities to gauge customers’ feelings, and sentiment analysis of social media data is increasingly used in a wide variety of fields, including finance, politics, and marketing. Popular tools include simple volume measures (such as number of likes and clicks), dictionary-based analysis of sentiment-rich words, and machine learning-based techniques.These tools are typically used in isolation, which hinders ability to compare their power to explain customer-level performance such as brand awareness, image, purchase intent, customer satisfaction, and recommendation. Similarly, managers and other decision makers are uncertain as to whether their analysts are using the appropriate tool to extract actionable sentiment information for their specific brands and industries.Raoul Kübler, Anatoli Colicev, and Koen Pauwels address this issue by analyzing a unique dataset with daily social media and consumer mindset metrics for 48 brands in diverse industries. They compare the dynamic explanatory power of these methods for daily customer mindset metrics.Overall, vector autoregressive models show that machine learning-based approaches have the best average performance for detecting positive, negative and neutral comments. At the same time, there are systematic differences among industries, mindset metrics, and brands. Since costs increase when moving from volume metrics to dictionaries and machine learning, these findings can help managers decide when more detailed analytics are worth the investment.Volume metrics are the cheapest to obtain and perform well for explaining awareness and purchase intent. This is an appropriate choice especially for smaller brands in negative sentiment industries (e.g., airlines and banking). Managers of other brands may consider investing in more sophisticated sentiment analysis techniques, especially when explaining or predicting brand impression, satisfaction, and recommendation.

AB - User-generated content provides managers rich data opportunities to gauge customers’ feelings, and sentiment analysis of social media data is increasingly used in a wide variety of fields, including finance, politics, and marketing. Popular tools include simple volume measures (such as number of likes and clicks), dictionary-based analysis of sentiment-rich words, and machine learning-based techniques.These tools are typically used in isolation, which hinders ability to compare their power to explain customer-level performance such as brand awareness, image, purchase intent, customer satisfaction, and recommendation. Similarly, managers and other decision makers are uncertain as to whether their analysts are using the appropriate tool to extract actionable sentiment information for their specific brands and industries.Raoul Kübler, Anatoli Colicev, and Koen Pauwels address this issue by analyzing a unique dataset with daily social media and consumer mindset metrics for 48 brands in diverse industries. They compare the dynamic explanatory power of these methods for daily customer mindset metrics.Overall, vector autoregressive models show that machine learning-based approaches have the best average performance for detecting positive, negative and neutral comments. At the same time, there are systematic differences among industries, mindset metrics, and brands. Since costs increase when moving from volume metrics to dictionaries and machine learning, these findings can help managers decide when more detailed analytics are worth the investment.Volume metrics are the cheapest to obtain and perform well for explaining awareness and purchase intent. This is an appropriate choice especially for smaller brands in negative sentiment industries (e.g., airlines and banking). Managers of other brands may consider investing in more sophisticated sentiment analysis techniques, especially when explaining or predicting brand impression, satisfaction, and recommendation.

UR - https://www.msi.org/reports/social-medias-impact-on-consumer-mindset-when-to-use-which-sentiment-extrac/

M3 - Article

JO - MSI Working Paper Series

JF - MSI Working Paper Series

ER -