Link Prediction in Signed NetworksSigned networks represent the real world relationships, which are both positive or negative. Recent research works focus on either discriminative or generative based models for signed network embedding. In this paper, we propose a generative adversarial network (GAN) model for signed network which unifies generative and discriminative models to generate the

Full-text formatting converted from the ACM version of record under the supplied ACM authorization. Source: ACM Digital Library.

Abstract

Signed networks represent the real world relationships, which are both positive or negative. Recent research works focus on either discriminative or generative based models for signed network embedding. In this paper, we propose a generative adversarial network (GAN) model for signed network which unifies generative and discriminative models to generate the node embedding. Our experimental evaluations on several datasets, like Slashdot, Epinions, Reddit, Bitcoin and Wiki-RFA indicates that the proposed approach ensures better macro F1-score than the existing state-of-the-art approaches in link prediction and handling of sparsity of signed networks.

1. Introduction

With the increase in popularity of online social networks, a huge number of users share their views and opinions, interact with other users on these platforms. As understanding and analyzing this user behaviour can provide critical insights into user’s choices and needs, several research works have proposed different approaches to study relevant user behaviour. However, contrary to the existing social networks where relationships are measured either by the magnitude or presence and absence of links, there are signed social networks which capture both polarity and magnitude of the relationship. These polarity relationships can be expressed as trustful or distrustful, friendship or animosity relationships [2]. Further, several studies indicate that the presence of negative links adds more value and information to the relationships among individuals [3]. Therefore, the prediction of the sign of a relationship in social networks is receiving significant attention. However, exploiting these signed relations between the nodes to predict the sign of a link pose newer challenges when compared to predicting links in conventional unsigned networks.

The challenges are mainly due to the inherent differences in the properties of the signed networks from the properties of unsigned networks, like existing theories of social science, homophily, transitivity and social influence [2] do not apply to signed networks. As the ratio of negative links is very low compared to the positive links (as shown in table 1), it is challenging to identify the factors that can explain the formation of negative links. Subsequently, there are specific characteristics of signed networks, like structural balance theory, which requires to be incorporated. In order to address these issues, several signed network based embedding approaches has been developed which can be classified into either generative or discriminative based models. While the generative model-based representation learning frameworks rely on the conditional distribution of a node, 𝑣𝑏, being a neighbor of node π‘£π‘Ž, given the connectivity preferences of π‘£π‘Ž[1, 5], several research works have proposed discriminative based models which predict the presence of an edge based on the characteristics of the node pair, π‘£π‘Žand 𝑣𝑏[3].

Although the generative and discriminative based models represent two different classes of graph representation learning, they can be visualized as two different ways of looking at the same problem [4]. Therefore, recently, research works have proposed different variants of GAN based frameworks to combine generative and discriminative in a game theoretical minimax game for different applications [4]. However, none of these approaches could be directly applied to signed networks due to it’s inherent difference from unsigned graphs. Hence, in this paper, we propose a signed graph GAN based approach which effectively unifies two models generative model that generates likely positive (or, negative), connected neighbors of node, π‘£π‘Žand a discriminative model that identifies whether the generated node pair with the corresponding sign is a true connection or not. Further, the proposed framework explicitly ensures structural balance theory and can handle the high imbalance in the number of negative edges to positive edges of signed networks. Validation on real world datasets, like Slashdot, Epinions, Reddit, Bitcoin and Wiki-RFA indicate that the proposed approaches ensure 2.5βˆ’10% better macro F1-score than the existing works in link prediction.

2. Proposed Approach

In this section, we discuss the proposed GAN framework which intends to predict the sign of an edge, πΈπ‘Žπ‘between a given pair of nodes, (π‘‰π‘Ž,𝑉𝑏) from a signed network, 𝐺= (𝑉, 𝐸,𝑆) which comprises of vertics, 𝑉, edges, 𝐸and sign of the edge, π‘†βˆˆ{βˆ’1, +1}. In order to predict the link, the proposed framework intends to learn the representation of nodes considering it’s negative and positive connections through generator and discriminator while capturing structural balance theory.Therefore, given the graph𝐺, the proposed model intends to learn two models which we briefly discuss hereby.

Table 1: Dataset Details

(1) Discriminator function, 𝑅(π‘‰π‘Ž,𝑉𝑏;πœƒπ‘…) which outputs a sin-

gle scalar value representing the probability of an edge, represented by an ordered pair, (π‘‰π‘Ž,𝑉𝑏), being negative (or positive). We use a variant of the structured deep network embedding (SDNE) proposed by Shen et al. [3] as the discriminator which maximizes the log-probability of assigning correct label to the signed neighbour, 𝑉𝑏of π‘‰π‘Žby changing the vector representations of π‘‰π‘Žand 𝑉𝑏. (2) Generator function, Q(𝑉𝑏|π‘‰π‘Ž;πœƒπ‘„) that approximates the true

connections of π‘‰π‘Ž, i.e., by generating that neighbour of π‘‰π‘Ž which has higher likeliness to be of the opposite sign from the underlying distribution π‘π‘‘π‘Ÿπ‘’π‘’(𝑉𝑏|π‘‰π‘Ž). In order to select the most likely positively (or, negatively) connected neighbour of π‘‰π‘Ž, i.e., 𝑉𝑏, we calculate the relevance score of likely positively(or, negatively) connected neighbours of π‘‰π‘Žand select the node, 𝑉𝑏which has the highest relevance score with respect to π‘‰π‘Ž Further, to ensure the proposed approach learns to predict the negative edge with high precision, we select negative edges and positive edges with equal probability for the discriminator to learn. Given the graph 𝐺, generator 𝑄and discriminator 𝑅acts as opponents, i.e., 𝑄tries to generate the positive (or negative) neighbour which are similar to the actual negative (or positive) neighbours of π‘‰π‘Žand discriminator 𝑅determines if the generated neighbour is an

actual negative (or positive) neighbour of π‘‰π‘Žthrough a two player mini-max with value function V(𝑄, 𝑅), as follows :

𝑉 Γ•

(Eπ‘‰βˆΌπ‘π‘‘π‘Ÿπ‘’π‘’(Β·|π‘‰π‘Ž) [log𝑅(𝑉,π‘‰π‘Ž,πœ™;πœƒπ‘…)]

V(𝑄, 𝑅) =

min

max

Ξ˜π‘„

Ξ˜π‘…

π‘Ž=1

+Eπ‘£βˆΌπ‘„(Β·|π‘‰π‘Ž;πœƒπ‘„) [log(1 βˆ’π‘…(𝑉,π‘‰π‘Ž,πœ™;πœƒπ‘…)]) (1)

Hence, the discriminator and generator alternatively learns the signed connections of π‘‰π‘Žthrough maximizing and minimizing V(𝑄, 𝑅). The continuous rivalry between generator 𝑄and discriminator 𝑅along with iterative learning of both the positively(or, negatively) connected neighbours with equal probability ensures handling of the difference in negatively and positively signed links and learning of the sign of the connections. Next, we briefly discuss the discriminator and generator models.

3. Experimental Results

In this section, we evaluate the performance of the proposed approach in predicting the sign of a link on 5 datasets, namely Slashdot, 𝐷𝑆[3], Epinions, 𝐷𝐸[3], Reddit, 𝐷𝑅Bitcoin, 𝐷𝐡and Wikipedia, π·π‘Š [3]. A brief description of the datsets in given in table 1.

For our experiments, we identify a subset of edges for training (80%) our model and the rest of the edges (20%) are used for testing.

Table 2: Macro F1-score of the proposed approach with the existing research works

The edges are selected randomly for training and testing. As there might be a significant difference between the number of negative and positive edges in the testing set, we show the performance of the proposed approach by macro F1-score which captures the effectiveness of the proposed approach in identifying both positive and negative edges. For the prediction task, we use a logistic regression classifier [3] that is trained on the vector representation of the edges, using the Hadamard product of the corresponding node representations. We evaluate the performance of the proposed approach and the baselines through macro F1-score. We consider macro F1-score in order to capture the effectiveness of the proposed approach in predicting the sign for both positively and negatively connected links. On comparing the performance of the proposed approach with DNE-SBP [3], SIDE [1] and SNE [5], we observe as shown in table 2 indicates the proposed approach can ensure 2.5 βˆ’10% better than the existing research works.

4. Conclusions

In this work, we have proposed a GAN based framework for signed networks that unifies two different types of graph representation learning methodologies, i.e., generative methods and discriminative methods, through adversarial training in a minimax game. Further, the proposed approach is shown to ensure explicit integration of the specific properties of the signed network, like extended structural balance theory as well as handling of the inherent issues of a signed network, like a high imbalance in sign, the sparsity of information. Experimental validation on five datasets indicates better effectiveness of the proposed approach than the existing approaches for link prediction in a signed network due to the usage of the adversarial framework. However, in this paper, we did not explore different options for the discriminator, and therefore, the study of the choice of the discriminator remains as future work.

References

[1] Junghwan Kim, Haekyu Park, Ji-Eun Lee, and U Kang. 2018. Side: representation

learning in signed directed networks. In Proceedings of the 2018 World Wide Web Conference. International World Wide Web Conferences Steering Committee, 509– 518. [2] Jure Leskovec, Daniel Huttenlocher, and Jon Kleinberg. 2010. Signed networks in

social media. In Proceedings of the SIGCHI conference on human factors in computing systems. ACM, 1361–1370. [3] Xiao Shen and Fu-Lai Chung. 2018. Deep Network Embedding for Graph Repre-

sentation Learning in Signed Networks. IEEE transactions on cybernetics (2018). [4] Hongwei Wang, Jia Wang, Jialin Wang, Miao Zhao, Weinan Zhang, Fuzheng

Zhang, Xing Xie, and Minyi Guo. 2018. Graphgan: Graph representation learning with generative adversarial nets. In Thirty-Second AAAI Conference on Artificial Intelligence. [5] Shuhan Yuan, Xintao Wu, and Yang Xiang. 2017. SNE: signed network embedding.

In Pacific-Asia conference on knowledge discovery and data mining. Springer, 183– 195.

Do you like what you are reading? Subscribe to receive updates.

Unsubscribe anytime