[Paper] Real-time recommendation for Microblogs

1.Related work

1.1.recommendation Strategies

1. Types of techniques:

(1) The link-based approach

(c.c Aggarwal, J.l Wolf, K.l Wu, p.s Yu, Horting hatches an egg:a new graph-theoretic approach to collaborative Filte Ring, IN:KDD, 1999, pp. 201–212.)

(X. Song, B.L Tseng, C.y Lin, m.t Sun, personalized recommendation driven by information flow, In:sigir, 2006, pp. 509–516 ）

(2) The content-based approach:

(M. Balabanovic´, Y. Shoham, fab:content-based, collaborative recommendation, Commun. ACM 40 (1997) 66–72.)

(A.I. Schein, A. Popescul, L.H. Ungar, d.m. Pennock, Methods and metrics for Cold-start recommendations, In:sigir, 2002, pp. 253–260.)

(I. Guy, N. zwerdling, I. Ronen, D. Carmel, E. Uziel, social media recommendation based on people and tags, in:sigir, p P. 194–201.)

(D.R Liu, P.y Tsai, P.H. Chiu, personalized recommendation of popular blog articles for mobile applications, In:informa tion Sciences, pp. 1552–1572 ...)

2. On one side, in order to recommend blogs to a user u, the collaborative filtering approach finds users have similar T Aste with u and then recommend blogs is most-liked by these users.

(Y. Koren, factorization meets the NEIGHBORHOOD:A multifaceted collaborative filtering model, IN:KDD, pp. 426–434. )

(Y. Koren, Factor in the neighbors:scalable and accurate collaborative filtering, IN:TKDD, 2010.)

(X. Su, t.m. Khoshgoftaar, A Survey of collaborative filtering techniques, in:advances in Artificial Intelligence, 2009.)

On the other hand, content-based approach recommends blogs that is similar to user's selection in the past.

(O. Phelan, K. McCarthy, B. Smyth, Using Twitter to recommend real-time topical news, In:recsys, p. 385–388.)

(O. Phelan, K. McCarthy, M. Bennett, B. Smyth, on using the real-time web for news recommendation & Discovery, In:www (Companion Volume), 2011a, pp. 103–104.)

3. Some hybrid approaches [15,4,16,22] combine these-techniques to improve the quality of recommendations

(N. Good, j.b Schafer, J.a Konstan, A. Borchers, B.M. Sarwar, J.l. Herlocker, J. Riedl, combining collaborative Filterin G with personal agents for better recommendations, In:aaai/iaai, 1999, p. 439–446.)

(S. Amer-yahia, J. Huang, C. Yu, Building Community-centric information exploration applications on social content sites, In:sigmod Conference, 2009,pp. 947–952.)

(Z. Guan, C. Wang, J. Bu, C. Chen, K. Yang, D. Cai, X. He, Document recommendation in social tagging services, In:www,, pp. 391–400.)

(Y. Koren, Factor in the neighbors:scalable and accurate collaborative filtering, IN:TKDD, 2010.)

4. The trade-off between accuracy and privacy in social link analysis is also studied

(A. Machanavajjhala, A. Korolova, A.D. Sarma, personalized social recommendations:accurate or private, Proc. VLDB Endow. (2011).)

5. A comparative study on different recommendation strategies in social system

(A. Bellogín, I. Cantador, p. castells, a comparative study of heterogeneous item recommendations in social systems, IN:I Nformation Sciences, pp.142–169.)

6. A survey of these systems (G. Adomavicius, A. Tuzhilin, toward the next generation of Recommender SYSTEMS:A survey of the State-of-the-art and possible extensions, in:kde,2005, pp. 734–749.)

2.2. Recommendations on microblogging system

1. Exploit the microblogging system to provide various kinds of recommendation services

The URL recommendations

(J. Chen, R. Nairn, L. Nelson, M.S Bernstein, E.H. Chi, Short and tweet:experiments on recommending content from Informa tion streams, In:chi, 2010,pp. 1185–1194.)

Utilizes the content of tweets to score user's RSS feed (O. Phelan, K. McCarthy, M. Bennett, B. Smyth, Terms of a feather: Content-based News recommendation and Discovery using Twitter, In:ecir, 2011b,pp. 448–459.)

Proposes a mention recommendation strategy to expand the diffusion of tweets

(B. Wang, C. Wang, J. Bu, C. Chen, w.v Zhang, D. Cai, X. He, Whom to mention:expand the diffusion of tweets by @ Recommendation on micro-blogging systems, IN:WWW, P, pp. 1331 –1340)

Based on existing following relationship

(J. Chen, W. Geyer, C. Dugan, M.J Muller, I. Guy, make new friends, but keep the old:recommending people on social netwo Rking sites, In:chi, pp.201–210.)

Based on users relationships and tweets they published

(J. Hannon, M. Bennett, B. Smyth, recommending Twitter users to follow using content and collaborative filtering Approache S, In:recsys, pp.199–206.)

Bursty keywords is grouped together for discovering discussion trends

(M. Mathioudakis, N. Koudas, Twitter monitor:trend detection over the Twitter stream, In:sigmod Conference, $, pp. 11 55–1158.)

2. To recommend tweets to users, various factors is integrated in the score function

Integrate the influence of implicit social expert

(C. Lin, R. Xie, X. Guan, L. Li, T. Li, personalized news recommendation via implicit social experts, in:information Scie NCEs, pp. 1–18.)

Builds score for each tweet from view of information diffusion such that emergency news would get a higher score

(A.R Sun, J. Cheng, D.d Zeng, A novel recommendation framework for micro-blogging based on information diffusion, IN:PR Oceedings of the 16th workshop on information Technologies and Systems, 2009.)

Combining the hashtags,topics and entities to estimate the importance of a specific microblog to one user

(F. Abel, Q. Gao, G.j Houben, K. Tao, analyzing user modeling on Twitter for personalized news recommendations, In:umap, , pp. 1–12.)

Extract weighted tags for users as their interest vector

(S. Sen, J. Vig, J. Riedl, tagommenders:connecting users to items through tags, in:www,, p, pp. 671–680.)

Based on collaborative ranking, by conceiving a score function integrating the tweet topic, user social network with other Explicit features

(K. Chen, T. Chen, G. Zheng, O. Jin, E. Yao, Y. Yu, y Yu, collaborative personalized tweet recommendation, In:sigir, 201 2, P. 661–670.)

Dynamically adapts users profiles as time goes

(L. Marin, D. Isern, A. Moreno, A. Valls, on-line dynamic adaptation of Fuzzy preferences, In:information Sciences, 2013, pp. 5–21.)

Build a tweets similarity network and user following network and User-tweet network to integrate the popularity and divers Ification of tweets and author ranking

(R. Yan, M. Lapata, X. Li, Tweet recommendation with graph co-ranking, In:acl (1), +, pp. 516–525.)

Recommends a set of K tweets within a time periods where the set has maximal overall interestingness

(M. Pennacchiotti, F. Silvestri, H. Vahabi, R. Venturini, Making your interests follow you on Twitter, in:cikm, Mon, pp. 165–174.)

Utilizes a set of components to rank tweets independently and merges these lists with a competition algorithm

(S.J Yu, the dynamic competitive recommendation algorithm in social network services, In:information Sciences,, pp. 1–14.)

They compute the similarities,weights or scores between every user and microblog before the final answer set if given

2.Overview

1. A push-based Recommendation Service:

　　　　　　

2.function f (u,t); To denote the relevance between U and T

　　 　　

(For each tweet)

　　　　

(n tags in the system)

3. The content relevance function is a summation of the similarity between the tweets TM and tweets published by UI, which Can be converted to the inner product between TM and the term frequency vector of UI ' s historical tweets.

(K. Chen, T. Chen, G. Zheng, O. Jin, E. Yao, Y. Yu, y Yu, collaborative personalized tweet recommendation, In:sigir, 201 2, P. 661–670.)

4.system Architecture

consists of parts:the tag buffer and the user buffer.

The tag buffer has the Components:the Keyword-tag index and the Tag-user index.

3.Personal tags

3.1 Tag Retrieval

1.the term-frequency inverse-user-frequency weighting Scheme (TF-IDF)

(J. Chen, R. Nairn, L. Nelson, M.S Bernstein, E.H. Chi, Short and tweet:experiments on recommending content from Informa tion streams, In:chi, 2010,pp. 1185–1194.)

　　　　　　　　　　　　　　

2, Therefore, other tag retrieval methods can is easily integrated with we recommendation strategy, and other tags, such As geotags, can be added to the tag vector to adjust the recommendation result

3. for users with extremely few tags, global frequent tags is picked as their additional tags, so th At those users can still receive recommendations in our system.

3.2 Weights of Tags

1. on The other hand, in the social network of microblogging systems, users is connected via th e following/followed links.

　　　　　　

　　　　

2,

　　　　　　　　

3.The Iteration Algorithm

　　　　

4. This iteration algorithm are similar to PageRank

(S. Brin, L. Page, the anatomy of a large-scale hypertextual web search engine, In:computer Networks and ISDN Systems, 19 98, pp. 107–117.)

5.As The above approach is expensive, tag weights was recomputed offline only when a large number of new users join the NE Twork.

Before the next computation, a user u I'll use his/her initial weight vector rather than the aggregated one.

　

4.Recommendation algorithm

　

4.1 Naive approach

　　　　

for user u I and it tag weight vector V I, the probability that a tweet would be sent to u I in the naive approach is:

　　　　　　　　　　

4.2 Approximate pruning scheme

Key:to get the Top-k results, the probabilities must satisfy the following condition:

　　　　　　

1.critical tags

If One tweet hits only one tag, the tags to being registered in Tag-user index S initial is generated as:

　　　　　　　　

Multiple tags May is linked to the same tweet:

The definition of Critical tag Set:any tweet containing all tags in a Critical tag Set is considered as the candidate of T He top-k recommendations.

　　　　　　

　　　　　　　　　　

2.Algorithm 2 illustrates the basic idea to retrieve the minimal critical tag sets.

　　　　　　

　　　　

3 Tag Buffer

Compared to the naive approach, we APS approach effectively decreases the computational cost, as the size of the tag buffer I s significantly reduced.

4 Probability estimation

The probabilities change significantly in the subsequent time intervals. Therefore, instead of using the historical probabilities directly, we apply the probability ranges.

　　　　

　　　　

4.3 User grouping

　　　　　　　　　　

　　　　

4.4 Parallel APS

　　　　

[Paper] Real-time recommendation for Microblogs