Académique Documents
Professionnel Documents
Culture Documents
Learning
Jay B. Simha
Outline
Big Data
Gartner Hype Cycle
Big data value, drivers and gaps
Machine Learning
Sentiment Analysis
Nave Bayes Classifier
Influencer Detection
Network mining
Open house
Big Data V3
Gartner Hype Cycle
Big Data Analytics drivers/gaps
Social Media Analytics
Sentiment Recommendation
Opinion Segmentation
Intention Classifiers
Network
Social
Behavioral
Media
Modeling
Analytics
Sentime Respons
nt e
Analysis Modeling
Architecture for Big Data Analytics
Integration
Architecture for Big Data Analytics
Integration
Sentiment Analysis
Social Media Analytics Basic modules
Social Media Analytics Basic modules
Identify the orientation of opinion in
a piece of text
1. Define
classes
2. Specify probability model
2b. And prior distribution over
parameters
3. Find posterior distribution of
model parameters, given data
4. Compute class probabilities using
posterior distribution (or
element of it)
5. Classify object
Bayesian Classification - Basics
P( A B)
Conditional Probability: P( A | B)
P( B)
Chain rule: P( A B) P( A | B) P( B)
P( A B ) P( B A) P ( B | A) P( A)
P( A | B) P( B)
Bayes Rule: P( B | A)
P( A)
Bayesian Classification - Derivation
P( A | B) P( B) (Bayes Rule)
P( B | A)
P ( A)
Given two classes c1 , c2 and the documentd '
P (c1 ) P (d ' | c1 ) P (c2 ) P ( d ' | c2 )
P(c1 | d ' ) P ( c2 | d ' )
P(d ' ) P(d ' )
We are looking for a ci that maximizes the a-posteriori
P(ci | d ' )
P(d ' )(the denominator) is the same in both cases
Target Function: (d ) c
cMAP arg max P(c | d ) arg max P (c) P(d | c)
cC cC
1
2 2
3
1
3
4
4
5
Me X
Network Behavioral
Data Data
Claim
detection
Influence
Persuasion
Modeling
detection
Influenc
Agreement
e
detection
Scoring
Applications - Big data + Machine
learning
References
Mathioudakis M, et.al., Twittermonitor : trend detection over the
twitter stream. In SIGMOD10
Cha M et.al, Measuring user influence in Twitter: The million
follower fallacy, 4th Int'l AAAI Conference on Weblogs and Social
Media, 2010
Simha J.B., MSNA in Big Data perspective, National Conference
on Graph theory and applications, Mangalore, 2013
THANK
YOU