Hadoop + Cisco SocialMiner = ?

What I am trying to do is to marry BigData Hadoop with Cisco SocialMiner, to collect the latest 1000 tweets on Twitter about Cisco, and analysis what is the most common words that people are using.

One of the beauty of SocialMiner is the API of it is very simple, just a HTTP request then you can get all your tweets in XML format.  You don't need to learn Twitter and Facebook API in order to collect the social contacts that you want.  This is how it works:

Several steps involved:
1. Setup Campaign in SocialMiner to collect Twitter stream with keywords Cisco, #Cisco and @Cisco
2. Write a little script on my Linux machine to get the XML file, and extracted the content of the tweets.
3. Copy it to the Hadoop HDFS, run the word count program.
4. Use Apache Pig, an abstracted level of Hadoop which allows you to use statement similar to SQL, to do the sorting.
5. Format the output in another XML file for graph plotting.  Done!

Looks like WebEx Meeting Server (on-premises WebEx) is the hottest topic now!

Using CAD integrated browser for SocialMiner

My environment: UCCX 8.0.2 on Windows 7, SocialMiner 8.5

Just wanna share some experience with you that how to get it works. The problem I had is, when I used the Windows 7 IE 8 to browse the SocialMiner page, it works fine. However when I used the CAD integrated browser to browse SocialMiner page, it shows the error "This version of Internet Explorer is not supported. Internet Explorer 8 or later is required"

When I visit the page: http://www.quirksmode.org/js/detect.html, it detected that the integrated browser running is IE 7 instead of IE 8. This is because for compatibility purposes, the WebBrowser control is running IE 7 standard mode instead of IE 8:

http://blogs.msdn.com/b/ie/archive/2009/03/10/more-ie8-extensibility-improvements.aspx

The changes I have made is, based on the above link, under FEATURE_BROWSER_EMULATION, add a new dword named "agent.exe", with the value decimal 8888 to force IE 8 standard mode. For Windows 7 64-bit, the path is different:

HKEY_LOCAL_MACHINE\Software\Wow6432Node\Microsoft\Internet Explorer\Main\FeatureControl\FEATURE_BROWSER_EMULATION

After making the changes, restart the computer then you will see SocialMiner page shown in the CAD integrated browser!

Please be aware this is for lab settings only, changing the above values may have support issue!