Analytics

Inside a consumer’s mind with Text Analytics

In this post, I will walk you through an example on how we can choose a concept, extract what users write about this concept on Twitter, get insights on how consumers think/behave about it and finally group similar consumer thoughts and experiences using Cluster Analysis. A “concept” could be:
– Any activity
– A Brand (e.g Apple Inc.)
– A Product / Service
– A Politician
And -almost- anything discussed in user Tweets.
What we will look at is work that was made specifically for understanding what consumers think, liked or disliked while visiting a shopping Mall. What do people feel when visiting a Mall? Which words are associated with a positive experience or when a smiley is present in Tweets about Malls? Using the Twitter API approximately 36000 distinct Tweets where collected on consumer experiences from visiting a shopping Mall (sample below shows an example of a consumer’s negative sentiment):
Screen+shot+2010-09-28+at+8.35.01+AM
So how can an analyst get into a consumer’s mind by analyzing Tweets and how would this information be useful? To find some answers I teamed up with Marketing Strategist Dr Nikos Dimitriadis to assist me in the actionability and interestingness of each extracted insight. Note that we capture thoughts from a biased sample which means that we cannot make inferences about the general population. However this work can be a great additional tool for finding new ideas and insights for Marketing initiatives -on top of more traditional methods such as focus groups- and also enables us to form several hypotheses as to what could likely work.
After a number of pre-processing steps to clean captured Tweets from irrelevant information (such as links), replace words with their synonyms and remove frequently occurring words such as ‘and’, ‘to’, ‘at’, ‘in’ and ‘mall’ and also filter all Tweets with small length i started performing frequency counts of the words contained in Tweets about Malls :
Screen+shot+2010-10-04+at+1.46.23+PM
We immediately notice how often LOL and 🙂 (smiley) appear in Tweets about being, going or returning from the Mall which also gives us examples of consumers being in a specific mood . Here is what happens when we look at the most frequently occurring 2-word phrases :
Screen+shot+2010-10-06+at+12.32.47+PM
and 3-word phrases (Note : ive = i’ve) :
r
Looking at the two charts we also notice that we frequently find the phrases :
– My best friend : since consumers Tweet the fact that are visiting a Mall with their best friend.- My nails done : appears to be one of women’s frequently discussed activity.
We then could look at Words and Phrases that seem interesting in understanding consumer experiences and values when visiting a Mall, such as :
– Shop
– Shoes
– Parking Lot
– Food Court
– Need/ want
– Walk around my Day
– Post Picture Facebook
and mine through all these words / phrases to understand what consumers think : What exactly made the day of consumers who used the phrase “Made my Day” in their tweets? How do consumers feel when they visit the Mall with their best friend? when they are alone? Which activities trigger positive feelings? But more importantly : How could one use this information to better understand consumers and Market a concept? More on the next post.

5 Comments
  1. g 5 months ago
    Reply

    Great article, just what I wanted to find.

  2. gamefly free trial 5 months ago
    Reply

    I think the admin of this web page is genuinely working hard for his web site, as here
    every stuff is quality based material.

  3. gamefly free trial 5 months ago
    Reply

    You’ve made some decent points there. I looked on the internet to learn more about the issue and found most people will go along with your views on this web site.

  4. gamefly free trial 5 months ago
    Reply

    Great goods from you, man. I have understand your stuff previous to and
    you are just too fantastic. I actually like what you’ve
    acquired here, really like what you are stating and the way
    in which you say it. You make it enjoyable and you still care for to keep
    it smart. I cant wait to read much more from you. This is
    actually a great web site.

  5. quest bars 3 months ago
    Reply

    Hi there! Do you use Twitter? I’d like to follow you if that would be ok.

    I’m absolutely enjoying your blog and look forward
    to new posts.

Leave a Comment

Your email address will not be published.

You may also like

Pin It on Pinterest