11 Comments

a gravatar

Michael

Wednesday, August 16, 2006 at 3:08pm

Thanks for this interesting post, Stephen. No doubt: Content analysis has always been a key instrument in PR evaluation - and I agree there’s no reason why these efforts should be limited to offline media or web 1.0. As you pointed out (and as Opinmind shows) this might be automated to a certain extent in near future - and chances are high that there will be algorithms delivering high quality results, such as taking into account the number of page impressions of all content analysed. (To answer your question: No, I don’t know any other sentiment measuring sites by now.)

However, although categorising conversations into positive, negative and neutral sentiments might be a reasonable tool for (quick and dirty) PR evaluation, it does not give any starting-point for setting up a (online) PR strategy. It will (in my humble opinion) stay vital to analyse web content “by foot” in order to find patterns and frames that will give us more insights about the way people talk about our brands than these mere categories “friendly” and “hostile”. There might be powerful software assisting us (such as AtlasTI), but there will always be some manual work left for us. Which is not too bad though, I find… :-)

a gravatar

Kevin Dugan

Wednesday, August 16, 2006 at 3:25pm

Stephen - Good stuff. Personally I think folks get paralyzed by the great unknown. They have no idea what is being said or how much and where.

Conversational mining helps them get a read on the level of activity and anecdotal input on the type of converations: good, bad or ugly.

From there they need to be prepared to spend some upfront time scouring the conversations and social media sites like the ones you mention as well as Flickr, YouTube and MySpace. You are right that it’s beyond blogs now and Google is no longer enough to get an accurate, quick read of activity.

New tools are needed to make this initial process easier and to make monitoring easier in the long term. Now you are relegated to creating a ton of feeds and an internal process for tracking everything.

It’s still hand intensive and we need to make it more head intensive. Hopefully a whip-smart software startup is monitoring this conversation and has an idea they’re working on that will answer our prayers.

There are enterprise-sized solutions like Brandpulse, but smaller companies need a cost-effective solution.

a gravatar

Stephen

Wednesday, August 16, 2006 at 5:56pm

Micheal: Good points and, like you said, chances are we will see a development (fingers crossed) of designed algorithms delivering better results. Hmm, not too sure about the manual work though … surely it’s the PR pro’s job to make sense of the results rather than finding them?

Kevin: “It’s still hand intensive and we need to make it more head intensive. Hopefully a whip-smart software startup is monitoring this conversation and has an idea they’re working on that will answer our prayers.” Amen. ;)

a gravatar

Kami Huyse

Thursday, August 17, 2006 at 3:39am

Awesome stuff, I espeically like the Opinmind resource. The Neilson Buzzmetrics BrandPulse offering sounds interesting, but I don’t know much it costs andI agree with Kevin that there is a business opportunity here for someone.

a gravatar

Stephen

Thursday, August 17, 2006 at 8:04am

Hey Kami,

I’m not too sure on how much it costs either. I have used it but didn’t deal with the subscription.

a gravatar

Matthew Hurst

Thursday, August 17, 2006 at 10:11am

The problem of sentiment mining is an active research area. Havea look here for a partial bibliography of this research.

Automated sentiment mining is also a standard feature of many solutions in this space (BuzzMetrics and Umbria both offer this). Solutions like Opinmind, while interesting, are not as sophisticated and concentrate on precision rather than recall (i.e. improve the chances of a result being correct rather than ensuring that the coverage is complete).

You are right that monitoring takes time and effort, but that time and effort doesn’t have to be spent by you. It can be invested in technology. This is the investment that we are making at BuzzMetrics. Note that even with this automated solution, there is still a central role for a person to interpret and manage the analysis.

I’m glad to see that you take into account other forms of social media - if you are interested in free tools, you might want to check out BoardTracker, one of the best message board search engines.

Note: I work for Nielsen BuzzMetrics.

a gravatar

Stephen

Thursday, August 17, 2006 at 10:29am

Thanks for that Mathew. And thanks for the link to the research paper. I agree, Opinmind isn’t the correct solution for, shall we say, a major brand to use, but I feel the technology behind it has a lot of potential.

But do you think recall is better than precision? Or did you mean both is best?

I agree also - no matter how advanced the technology becomes, a human being will always have to interpret and make sense of it all. And, of course, from a PR point of view, someone will have to make a strategic decision from where to go from there.

P.S. I’m a fan of your blog.

a gravatar

David Phillips

Thursday, August 17, 2006 at 12:04pm

Stephen,
I think there are some interesting things that can be added.
First is the extent of the literature (you may find my bibliography helpful – about 500 references http://www.managementclarity.com/big_bibliography.htm.
The use of latent semantic analysis is probably the nest bet for finding out concepts in extensive corpora. I have an engine used in research that identifies concepts.
It was created to prove the Relationship Value Model (the research will be published next year both as a research paper and in John Leddingham’s new book)

The advantage with this approach is that it can also bring topics to the fore and create ’summaries’ by subjects. Thus in, for example a political or industry sector corpus it will identify the people and their interests and the ‘conversation’ around the subject.
If you would like a demo, let me know.
There is the issue of the ‘long tail’ and once again, this approach helps.
I have to say I am delighted that you are doing this work. I was under the impression that it is rare in consultancy.

a gravatar

Stephen

Thursday, August 17, 2006 at 12:34pm

Thanks for the link, David. I’ll take a look.

Yes a demo would be great some time too.

P.S. Have you ever considered a Wikipedia page for the Relationship Value Model? It could bring extra participation.

a gravatar

David Phillips

Thursday, August 17, 2006 at 1:22pm

I shall be publishing empirical evidence for the Relationship Value Model next year (chapter in John Leddingham’s new book and a research paper). It may then be an idea to add it to Wikipedia. The corpus is HUGE and the methodology will be replicable which should mean that there will be a basis for a further developed research base for Public Relations.

It should also bring PR out from under the yoke of Marketing once and for all :)

a gravatar

Alexandra Pullin

Friday, August 18, 2006 at 3:07am

Good to see you back and blogging Stephen!

Leave a Comment