https://www.billboard.com/photos/taylor-swift-eras-tour-photos-opening-night-1235289315/13-05-taylor-swift-the-eras-tour-opening-night-billboard-1548/

Taylor Swift Sentiment Analysis

The purpose of this project was to conduct a sentiment analysis on Tweets about Taylor Swift to see how public sentiment changed between October 2022 and March 2023. This time frame was chosen to see the impact of the announcement and opening shows of the Eras Tour on public sentiment.

Hypothesis

I think that for the brief period before the official announcement of the Eras Tour on November 1st, 2022, the overall sentiment is positive. The Ticketmaster Verified Fan Presale for the Eras Tour began November 15th, 2022; due to major complications with the presale, I think public sentiment shifted negatively.

The opening shows of the tour were in Glendale, AZ on March 17th and 18th and the tour has received glowing reviews. As a result, I think public sentiment became more positive.

Analysis Process

I used two different methods to perform the analysis.

1

Data Collection

600,000 Tweets spanning from October 21, 2022 to March 21, 2023 were scraped using SNScrape.

To be collected, Tweets had to mention '@taylorswift13' or be a response to one of her posts.
2

Preprocessing and Naïve Bayes Classification

To learn about traditional NLP techniques, I used the Natural Language Processing Toolkit's built in preprocessing methods and Naïve Bayes Classifier to classify 400 tweets.

Naïve Bayes was chosen since it requires little training and is good for classifying large amounts of data.
3

VADER

The remaining tweets were analyzed using VADER to ensure the project would be completed on time.

Graphs were rendered using matplotlib and were analyzed by me.
Sentiment % Overtime Graph

Sentiment Percentage Over Time

Conclusion

To frame this conversation, I will be referring to changes in overall sentiment with respect to the Positive Sentiment curve.

In the period before the Eras Tour announcement, the Positive sentiment % is typically above 50% which indicated that the overall sentiment is largely positive.

In the period after the beginning of presale to just before the start of tour, the Positive sentiment % is still largely above 50% but dips below that during certain periods of time indicating the sentiment became more negative and/or neutral. Looking at the negative and neutral curves, we can visually confirm this is the case.

In the period after the opening shows, the Positive sentiment % is around 50% which is lower than during the first period analyzed.

Looking at the Sentiment % Overtime (All Tweets) graph, it's easier to see the Positive sentiment changes overtime indicating how sentiment became more negative and/or neutral overtime. The sentiment spikes don't map directly to the dates listed in my hypothesis so there is something else going on.

I noticed that there were several unrelated tweets in the dataset that were included because they mentioned her account so they were likely skewing my results. Better screening of the Tweets and excluding irrelevant ones (i.e. Tweets related to the opioid crisis in Toronto and Tweets about the Ukraine crisis that mention Taylor's account should have been excluded) would have likely made the sentiment spikes correlate more to the timeframes I had listed.

Future Work

  • Taylor Swift Related Topics
    Something that could have benefited this project would be collecting tweets about topics related to Taylor Swift, but that would require an in-depth topic analysis.
  • Better Dataset Filtering
    I would recommend filtering the dataset to remove unrelated tweets so that some of the noise is removed.
  • Interactive Dashboard
    Having a dashboard would have brought the project to life with user interactivity.
  • Make a Generalized Version
    A general version of this project would take a topic as an input, then gather tweets about that topic, and do a sentiment analysis on that topic. A general version of this project would be an interesting tool to monitor current events.

2023 Mikayla Peterson

Created with ‌

Landing Page Builder