Related Posts
Leave a Comment
Search
Welcome to my blog, my name is Paul Dunay and I lead Red Hat's Financial Services Marketing team Globally, I am also a Certified Professional Coach, Author and Award-Winning B2B Marketing Expert. Any views expressed are my own.
Archives
- March 2025
- December 2024
- October 2024
- August 2024
- May 2024
- April 2024
- March 2024
- November 2023
- July 2023
- May 2023
- March 2023
- February 2023
- January 2023
- November 2022
- October 2022
- September 2022
- August 2022
- July 2022
- June 2022
- April 2022
- February 2022
- January 2022
- December 2021
- November 2021
- October 2021
- September 2021
- August 2021
- July 2021
- June 2021
- May 2021
- March 2021
- December 2020
- October 2020
- September 2020
- August 2020
- May 2020
- April 2020
- January 2020
- March 2019
- December 2018
- October 2018
- September 2018
- August 2018
- May 2018
- April 2018
- January 2018
- November 2017
- May 2017
- March 2017
- December 2016
- November 2016
- October 2016
- September 2016
- August 2016
- March 2016
- February 2016
- January 2016
- December 2015
- November 2015
- October 2015
- September 2015
- August 2015
- July 2015
- June 2015
- May 2015
- April 2015
- March 2015
- February 2015
- January 2015
- December 2014
- November 2014
- October 2014
- September 2014
- August 2014
- July 2014
- June 2014
- May 2014
- April 2014
- March 2014
- February 2014
- January 2014
- December 2013
- November 2013
- October 2013
- September 2013
- August 2013
- July 2013
- June 2013
- May 2013
- April 2013
- March 2013
- February 2013
- January 2013
- December 2012
- November 2012
- October 2012
- September 2012
- June 2012
- May 2012
- April 2012
- March 2012
- February 2012
- January 2012
- December 2011
- November 2011
- October 2011
- September 2011
- August 2011
- July 2011
- June 2011
- May 2011
- April 2011
- March 2011
- February 2011
- January 2011
- December 2010
- November 2010
- October 2010
- September 2010
- August 2010
- July 2010
- June 2010
- May 2010
- April 2010
- March 2010
- February 2010
- January 2010
- December 2009
- November 2009
- October 2009
- September 2009
- August 2009
- July 2009
- June 2009
- May 2009
- April 2009
- March 2009
- February 2009
- January 2009
- December 2008
- November 2008
- October 2008
- September 2008
- August 2008
- July 2008
- June 2008
- May 2008
- April 2008
- March 2008
- February 2008
- January 2008
- December 2007
- November 2007
- October 2007
- September 2007
- August 2007
- July 2007
- June 2007
- May 2007
- April 2007
- March 2007
- February 2007
- January 2007
- December 2006
- November 2006
- October 2006
- September 2006
- August 2006
- July 2006
- June 2006
- May 2006
- April 2006
- March 2006
Definitely there’s a lot of very weak sentiment scoring going on out there, and when it’s not weak, it’s simplistic, reduction to a few summary numbers an analysis that should happen at the “feature” rather than the document level. Good sentiment analysis applies sophisticated natural language processing in order to resolve sentiment, including emotion, at that more granular level: Not, Did person X have a favorable opinion in a hotel review, but rather, What did X think of the cleanliness, service, location, prices, and so on, each separately. Call this semantic analysis if you wish: Many better tools do it as part of their sentiment analysis tools or services.
Seth
(Chair, Sentiment Analysis Symposium, http://sentimentsymposium.com)
Hey Seth thanks for commenting
It seems that we agree very much on the important points: the meaning or semantics of a post is more important than a measurement of its sentiment. Many customers still request the measurement and we are simply trying to demonstrate the value of an alternative approach!
In the sentiment reporting/tracking I do with my clients, we manually audit the reports each month, adjusting the sentiment and deleting the irrelevant posts. And we do separate analysis for review sites vs. Twitter and other platforms and track both the sentiment and issue of each consumer review. It can be a lot of work so we try and do a little each week to keep on top of it. It’s an inexact science, but it helps keep a finger on the pulse of what’s being said out there.
Hey Jack!
Wow it sounds like you really do a lot of manual work to get the most out of your sentiment score
thanks for commenting – hows the purple goldfish project coming?
You’re right. Scoring a post for sentiment does not work in general. But that doesn’t mean we should abandon semantic analysis of what people are writing online; it just means we have to do it in a way that provides useful information. One way to do this is using strict rule-based analysis for specific products or categories. It takes a lot of customization work up front but it means you can achieve highly accurate (yep, I used that word) results for a narrow industry or product category. For instance, looking at the auto industry, you can find out how many people like or dislike a specific element, option or feature on a specific car. That sort of business intelligence is useful for marketing, customer service, product planning and a number of other areas.
@Erik – thats a fair point – and I agree good quality data like you were suggesting takes hard work!
Hey Paul, your link to The Problem with Automated Sentiment Analysis is dead. Is this the story you meant? http://www.freshnetworks.com/blog/2010/05/the-problem-with-automated-sentiment-analysis/
Doesn’t the fact that the majority of Social Media Monitoring services included in that post use Keyword-based as opposed to NLP-based tech cloud the water a bit? I’d be more interested in seeing their reaction to some of the smaller players in the space like General Sentiment or Crimson Hexagon (spoiler alert: I used to work at GS). There’s no question that automated sentiment scoring doesn’t work when you’re using keyword based systems, but, given my own personal experience, I think some of the smaller NLP outfits out there are doing a pretty good job. My two cents, in any case.
YES you are right Aubrey – that is the correct link – they must have changed it so thank you for that.
Sure NLP is a better mouse trap than Sentiment but its still not perfect (spoiler alert – nothing will be perfect – since people cant always agree!) Machine learning too shows alot of promise for classifying text too – its still a developing space
thanks for commenting