A Novel Tourist Attraction Recommendation System Based on Improved Visual Bayesian Personalized Ranking

A Novel Tourist Attraction Recommendation System Based on Improved Visual Bayesian Personalized Ranking

Yi Liang Nan Chen*

Shijiazhuang University of Applied Technology, Shijiazhuang 050081, China

Corresponding Author Email: 
mzcnn@126.com
Page: 
497-503
|
DOI: 
https://doi.org/10.18280/isi.250413
Received: 
18 March 2020
|
Revised: 
17 June 2020
|
Accepted: 
30 June 2020
|
Available online: 
20 September 2020
| Citation

© 2020 IIETA. This article is published by IIETA and is licensed under the CC BY 4.0 license (http://creativecommons.org/licenses/by/4.0/).

OPEN ACCESS

Abstract: 

Statistics show that most tourists log into the main tourism websites to view user reviews or scores before selecting their destinations. However, the existing tourist destination recommendation models neither consider the implicit user preferences nor mine the potential semantics of tourist attractions. To solve the problems, this paper predicts user scores of tourist attractions through stratified sampling, and optimizes the predicted scores with Bayesian personalized ranking (BPR) and improved visual BPR (VBPR). Then, the recommendation system was optimized by the improved VBPR, which decomposes the prediction score matrix and considers visual features. Experimental results fully demonstrate the excellence of the proposed tourist attraction recommendation system. The research findings provide a good reference for online travel agencies to recommend tourist attractions.

Keywords: 

recommendation system, Bayesian personalized ranking (BPR), stratified sampling, tourist attractions

1. Introduction

With the development of Internet technology, the amount of information on the Internet is exploding, making the problem of information overload increasingly prominent. It is difficult for a user without a clear demand to obtain the information of interest from a large amount of information. Meanwhile, lots of valuable information are submerged in the sea of data, becoming invisible to potential users. Faced with the massive online data, the traditional search algorithm, capable of filtering information for users, cannot provide personalized services that meet the interests and preferences of each user. To solve the problem, recommendation system [1-2] has emerged as the bridge between users and Internet information. On the one hand, the system enables users to find interesting information from massive data; on the other hand, it could transfer valuable information to potential users. Relevant surveys have shown that more than 75% of tourists log into the main tourism websites to view user reviews or scores before selecting their destinations and travel routes. However, many of them have difficulty in finding valuable content out of the huge amount of information on these websites. Therefore, the tourism websites need to further improve their recommendation systems, in order to satisfy the growing demand for personalized tourism.

In this paper, the latent semantic space model [3] is combined with visual Bayesian personalized ranking (VBPR) [4] into a novel VBPR recommendation model, which mitigates the problem of data sparsity and improves the interactive experience of users.

2. Literature Review

The research into recommendation system started in the early 1990s. The earliest recommendation systems could only suggest the products that interest users, using a recommendation algorithm. With the proliferation of such systems, the recommendation problem has gradually evolved into the score prediction of the recommended object.

Many scholars at home and abroad have studied recommendation systems. For instance, Goldberg et al. [5] innovatively introduced collaborative filtering to Tapestry system. Pang et al. [6] proposed a score-based collaborative filtering recommendation model, which derives user preferences from their scores, and analyzes user similarity through clustering to complete the recommendation. Combing user score with visual information, Huang et al. [7] solved the recommendation problem with matrix factorization (MF) model. Based on convolutional neural network (CNN), Tsai et al. [8] built a recommendation system coupling user score with video. Drawing on deep structured semantic models (DSSMs), Yoon et al. [9] constructed a location-aware personalized news recommendation system. Zhao et al. [10] recommended commodities with a high accuracy, using a self-designed Bayesian personalized ranking (BPR) model. Pan et al. [11] applied the BPR model to hotel recommendation. He et al. [12] introduced visual information to commodity recommendation, and extended the BPR model into the VBPR model. Based on attention mechanism, Han et al. [13] proposed a CNN model for the recommendation of Weibo information.

In recent years, the tourist attractions recommendation system has become a research hotspot. For example, Yuan et al. [14] designed a case-based tourist attractions recommendation system, and developed a web-based intelligent recommendation framework for travel agencies, which integrates reasoning with multi-criteria decision-making technology; the recommendation quality of their system was verified through experiments. Based on collaborative filtering, Kirn et al. [15] set up a decision support system for tourist attractions, which predicts user preference for tourist attractions by Bayesian model, and demonstrated the prediction accuracy by the receiver operating characteristic (ROC) curve. Hsu et al. [16] designed a tourist attractions recommendation system based on multi-criteria collaborative filtering; the system relies on multi-objective collaborative filtering to process more information on user preferences, thereby meeting user demand more effectively.

Despite the above breakthroughs, the recommendation systems for tourist attractions still face multiple challenges: (1) the data on user scores are extremely sparse, causing a prominent problem of data sparsity; (2) the tourist attractions are recommended solely based on the historical data of users, without considering the latent information of user preferences; (3)  the potential semantic information of tourist attraction images or users is not mined or analyzed from the perspective of multimodality.

3. A Novel Tourist Attractions Recommendation System Based on BPR Model

The literature review indicates that the previous recommendation systems have not considered the role of tourist attraction images across heterogeneous media. To make up for the gap, this section mines the latent semantic space of users and tourist attractions with MF model, and optimizes the space in BPR or VBPR model to generate the prediction score matrix.

3.1 Tourist attraction recommendation system based on stratified sampling and BPR model

To design the tourist attraction recommendation system, the user preferences were captured through stratified sampling, and the latent semantics of users and tourist attractions were mined by the BPR model. To begin with, the data on tourist preferences were collected through a questionnaire survey, and subjected to stratified sampling. Under the preset collection rules, the data on user scores of tourist attractions were acquired automatically from Ctrip.com, and preprocessed. Next, a user score matrix R was generated for tourist attractions. Based on the BPR model, MF model, and matrix R, a prediction score matrix was established by predicting user scores. Then, the recommendation $R_{A}$ from the BPR model was combined with that $R_{H}$ obtained through stratified sampling into the mixed recommendation $R_{A}+R_{H}$.

3.1.1 Stratified sampling model

In the stratified sampling model, the overall unit was divided proportionally into U independent layers $\left(H_{1}, H_{2}, \cdots, H_{U}\right)$. Then, sampling was performed layer by layer. The results of all layers were added up to obtain the overall distribution of samples. The specific workflow is as follows:

Step 1. Describe the differences in user preferences with random target variables, namely, travel time, interest category, and travel mode.

Step 2. Based on the influencing factors, stratify the overall unit into $U$ layers, each of which has $H_{i}$ individuals: layer $i(i=1,2, \ldots, U) .$ Hence, the overall distribution of samples $H$ can be calculated by:

$H=\sum_{i=1}^{U} H_{i}$       (1)

Step 3. Determine the sampling number of each layer. Let N be the total number of samples. Then, the sampling number of layer i can be calculated by: $X_{i}=N \times H_{i} / H$.

To reduce intra-layer difference and magnify inter-layer difference, the samples were classified through stratified sampling, in the light of the feature distribution of the overall unit. After that, a certain number of samples were extracted from each layer to describe the distribution of that layer, forming the sample population.

Because of the reasonable stratification of samples, the stratified sampling model could capture user preferences for tourist destinations in an accurate manner, laying a solid basis for producing a suitable recommendation list.

The stratified sampling results were weighted through analytic hierarchy process (AHP), a subjective weighting method, aiming to adjust the weight of each user attribute. Specifically, the relative importance between attributes on the same layer was compared to a new discriminant matrix, which was used to determine the weight of each attribute.

In this paper, six user attributes are selected, including gender $\left(G_{1}\right),$ region $\left(G_{2}\right),$ age $\left(G_{3}\right),$ educational background $\left(G_{4}\right),$ job type $\left(G_{5}\right),$ and monthly income $\left(G_{6}\right) .$ The relative importance between two attributes was measured against a seven-point scale: strongly important =6, moderately important =4, slightly important =2, equally important =1, slightly unimportant=1/2, moderately unimportant =1/4, and strongly unimportant=1/6. On this basis, the discriminant matrix G can be constructed as:

$G=\left[\begin{array}{ccccccc}{} & G_{1} & G_{2} & G_{3} & G_{4} & G_{5} & G_{6} \\ G_{1} & 1 & \frac{1}{2} & \frac{1}{4} & \frac{1}{4} & \frac{1}{2} & \frac{1}{6} \\ G_{2} & 2 & 1 & \frac{1}{2} & 2 & 4 & \frac{1}{2} \\ G_{3} & 4 & 2 & 1 & 1 & \frac{1}{4} & \frac{1}{2} \\ G_{4} & 2 & \frac{1}{4} & 1 & 1 & \frac{1}{2} & \frac{1}{4} \\ G_{5} & 2 & \frac{1}{4} & 2 & 2 & 1 & \frac{1}{2} \\ G_{6} & 4 & 4 & 4 & 2 & 2 & 1\end{array}\right]$

Based on matrix G, the weight (i=1,... ,6) of the i-th attribute was calculated to generate user preference:

$W_{i}=\prod_{i=1}^{6} G_{i j} / \sum_{i=1}^{6} \prod_{j=1}^{6} G_{i j}$         (2)

3.1.2 Stratified sampling results

The survey data on user preferences for tourist attractions were analyzed through stratified sampling, from the perspective of various user attributes. Figures 1 and 2 present the stratified sampling histograms of the preferences of 1,000 users.

Three conclusions could be drawn from Figures 1 and 2: Most users prefer to travel in spring and autumn, when the temperature is comfortable and the scenery is pleasant to the eyes; The users under 20, most of whom are students, prefer to travel in summer, as they have plenty of free time during summer vacation; Males prefer to travel in spring, while females prefer to travel in autumn.

Figure 1. The travel time difference among users with different genders, regions, and ages

Figure 2. The travel time difference among users with different educational background, job types, and monthly incomes

3.1.3 BPR model

The traditional MF model to predict user scores of tourist destinations can be defined as:

$\hat{s}_{u, i}=\beta+\delta_{u}+\delta_{i}+\theta_{u}^{T}$              (3)

where, $\beta$ is the global offset; $\delta_{u}$ and $\delta_{i}$ are the offsets of user $u$ and tourist attractions $i$ respectively; $s_{u}$ and $s_{i}$ are $k-$ dimensional vectors of the latent semantic spaces of users and tourist attractions, respectively. The adaptability of user $u$ and tourist attractions i$ can be described by the inner product ${s_{u}}^{\top} s_{i}$ The user preference of a tourist attraction is negatively correlated with the adaptability.

Then, the MF model was optimized in the BPR model, which is an optimization framework for pairwise sorting through stochastic gradient descent (SGD). Pairwise sorting has a much better optimization effect than single sample.

Next, a training set $D_{S}$ of triplets $(u, i, j)$ was established, where u is the user, i is a tourist attraction viewed positively by the user, and j is a tourist attraction viewed negatively by the user:

$D_{s}=\left\{(u, i, j) \mid u \in U \wedge i \in I_{u}^{+} \wedge j \in I \\backslash I_{u}^{+}\right\}$          (4)

Let $P_{m}$ be the parameter of the BPR model, and $\hat{s}_{u, i, j}\left(P_{m}\right)$ be the relationship between triplets $(u, i, j)$. Then, the optimization process of the BPR model can be depicted as:

$\sum_{(u, i, j) \in D_{S}} \ln \sigma\left(\hat{s}_{u, i, j}\right)-\varepsilon_{\tau}\left\|P_{m}\right\|^{2}$            (5)

where, $\sigma$ is a logical function (e.g. sigmoid function); $\varepsilon_{\tau}$ is a regularized hyperparameter. For MF-based prediction, $\hat{s}_{u, i, j}$ can be defined as:

$\hat{s}_{u, i, j}=\hat{s}_{u, i}-\hat{s}_{u, j}$             (6)

After randomly sampling $(u, i, j)$ from $D_{S}$, the relevant parameters can be obtained by the BPR model, coupled with the SGD:

$P_{m} \leftarrow P_{m}+\eta \cdot\left(\sigma\left(-\hat{s}_{u, i}\right) \frac{\partial \hat{s}_{u, i, j}}{\partial P_{m}}-\varepsilon_{\tau}\left(P_{m}\right)\right)$              (7)

where, $\eta$ is the learning rate.

3.2 Experimental verification

To verify the tourist attractions recommendation system based on BPR model, the user preferences for tourist destinations were obtained through stratified sampling, and weighted subjectively. The obtained data indicate that the user preferences vary greatly with user attributes.

By formula (2), the results of stratified sampling were weighted to establish a stratified sampling model. By the weight, the user attributes could be ranked in descending order as monthly income =0.3702, age =0.1948, educational background =0.1372, region =0.1360, job type =0.1081, and gender =0.0520. Obviously, monthly income and age have the greatest impact on traveling, highlighting the importance of economic factors. On the contrary, gender and job type have a relatively small impact on traveling. This is consistent with our objective cognition.

Then, the recommendation $R_{H}$ from stratified sampling model and that $R_{A}$ from the BPR model were synthesized into a mixed recommendation $R_{\operatorname{Mix} 1}\left(R_{A}+R_{H}\right) .$ Then, the precision of the mixed recommendation (MR) was compared with that of stratified sampling (SS) model and BPR model, as well as that of traditional models, including item-based collaborative filtering (IBCF), user-based collaborative filtering (UBCF), location-based collaborative filtering (LBCF), horizontal collaborative filtering (HC), and fuzzy c-means clustering (FCM) (Table 1).

As shown in Table 1, the FCM had slightly superior precision than most traditional models, because the clustering-based prediction is better guided by the prior knowledge in the eight types of tourist attractions.

Besides the FCM, the SS model achieved a high precision. This means the user preferences obtained through questionnaire survey are quite accurate, eliminating the need for any machine learning (ML). Thus, it is very important to explore user preferences for tourist attractions.

The BPR model boasted much better precision than the contrastive models, thanks to the mining of the latent semantic spaces of users and tourist attractions. Based on existing scores, these spaces accurately illustrate user preferences and popularities of tourist attractions.

The MR was even more accurate than the result of the BPR model. The excellence is achieved through pairwise sorting of the BRP result.

Table 1. The comparison of precisions among different recommendation models

No.

IBCF

UBCF

LBCF

HC

FCM

BPR

SS

MR

1

1.893

9.985

4.221

4.372

4.516

37.721

5.721

38.281

2

1.821

8.082

6.381

6.733

6.971

37.852

8.082

39.515

3

2.588

7.603

6.355

7.086

7.238

39.841

7.816

40.182

4

2.766

6.668

6.726

7.118

7.567

39.981

8.827

41.109

5

2.672

6.336

6.482

7.003

7.672

40.051

8.831

40.982

6

2.816

6.606

6.892

7.277

7.309

40.093

8.775

42.183

7

2.933

5.762

7.119

7.537

7.832

40.580

9.021

42.985

8

2.971

5.492

7.325

7.688

8.062

41.287

9.027

43.187

9

2.763

5.504

7.332

7.642

7.882

42.487

8.578

42.167

10

2.705

4.998

7.233

7.683

8.125

41.872

9.082

43.982

 
Figure 3. The precision advantage of BPR model

Figure 4. The precision advantage of the MR

Figures 3 and 4 present the precision advantages of BPR model and MR, respectively. As shown in Figure 3, the precision advantage of BPR model increased steadily with the growing number of tourist attractions.

As shown in Figure 4, the precision advantage of MR generally increased, despite a certain volatility, with the growing number of tourist attractions. The MR precision is improved through the integration of user preferences into SS model. The precision of MR mainly comes from the BPR model. The user preferences obtained by the SS model make the BPR recommendation smoother, compensating for the bias of the BPR model.

4. A Novel Tourist Attractions Recommendation System Based on Improved VBPR Model

The BPR model can outperform most traditional recommendation models. However, the image information of tourist attractions is not considered in that model, resulting in serious data sparsity. To overcome this problem, this section improves the VBRP model by innovatively introducing visual features to tourist attraction recommendation.

Under the preset collection rules, the data on user scores of tourist attractions were acquired automatically from Ctrip.com, and preprocessed. Next, a user score matrix R was generated for tourist attractions. In the meantime, the images on the tourist attractions were downloaded from Ctrip.com automatically. Then, the visual features (e.g. color and texture) were extracted from these images, and used to improve the VBPR model. Based on the MF model, matrix R, and visual features, the recommendation $R_{B}$ from the improved VBPR model was combined with the $R_{H}$ from the SS model into a mixed recommendation $R_{B}+R_{H} .$ Owing to the improvement, the $R_{B}+R_{H}$ reflects the merits of multimodal analysis, supplementing the result of $R_{A}+R_{H}$.

4.1 Improved VBPR model

In theory, the traditional MF model can find the potential features (latent semantics) of users or tourist attractions in the relevant dimensions. Nevertheless, the score data acquired by the MF model are too sparse to generate a robust recommendation. This problem can be mitigated by adding the auxiliary information of visual features. Hence, the MF of the VBPR model was improved as:

$\hat{s}_{u, i}=\beta+\delta_{u}+\delta_{i}+\theta_{u}^{T}+I_{u}^{T} I_{i}$       (8)

where, $I_{u}$ and $I_{i}$ are newly introduced $D$ -dimensional visual features; $I_{u}^{T} I_{i}$ is the visual interaction between user $u$ and tourist attraction i.

Let $\varepsilon^{\top} I_{i}$ be a user’s overall evaluation of the visual features of tourist attraction i. Introducing a visual offset term $\mathcal{E}$, the MF model can be finalized as:

$\hat{s}_{u, i}=\beta+\delta_{u}+\delta_{i}+\theta_{u}^{T}+I_{u}^{T} I_{i}+\varepsilon^{\top} I_{i}$        (9)

The VBPR framework was adopted to optimize the final MF model. The SGD method was adopted by the VBPR model to update the relevant parameters:

$I_{u} \leftarrow I_{u}+\eta \cdot\left(\sigma\left(-\hat{s}_{u, i, j}\right)\left(I_{i}-I_{j}\right)-\varepsilon_{\tau} I_{u}\right)$                (10)

$\varepsilon \leftarrow \varepsilon+\eta \cdot \sigma\left(-\hat{s}_{u, i, j}\right)\left(I_{i}-I_{j}\right)-\varepsilon_{\tau}$             (11)

To sum up, the VBPR model was optimized from multiple visual angles, using VGG features and related visual features like shape, color, and texture.

4.2 Experimental verification

To verify its effectiveness, the improved VBPR model was evaluated on the Wisdom Tourism dataset [17] by metrics like root mean square error (RMSE) [18], mean absolute error (MAE) [19], precision, and recall. Different visual features were selected as the bases of recommendation, including scale-invariant feature transform (SIFT), GIST descriptor, hue saturation value (HSV), red green blue (RGB), local binary pattern (LBP), and VGG. The RMSE and MAE of our model based on different visual features are presented in Figure 5.

Figure 5. The comparison of RMSE and MAE of our model based on different visual features

As shown in Figure 5, the RMSE and MAE of improved VBPR model varied with visual features. The highest RMSE and MAE were observed on RGB features, because RGB features cannot accurately reflect our objective cognition of colors (mainly from the angles of hue, saturation, and brightness). By contrast, the lowest RMSE and MAE were achieved on HSV features, indicating that the inclusion of HSV features can improve the recommendation effect to a certain extent.

Furthermore, the improved VBPR model was compared with IBCF, UBCF, LBCF, HC, FCM, nonnegative matrix factorization (NMF), k-th nearest neighbor (KNN), and BPR in terms of RMSE and MAE (Figure 6).

Figure 6. The comparisons of RMSE and MAE among different models

As shown in Figure 6, the contrastive models like FCM, NMF, and KNN achieved good performance, but the improved VBPR with HSV features was more outstanding. The improved VBPR outperformed the BPR model, for the recommended objects were well depicted by the visual features of tourist attraction images. Overall, the improved VBPR model had better RMSE than any other model.

In summary, the recommendation effect could by promoted by the improved VBPR model with HSV features, which helps to predict user scores of recommended tourist attractions more in line with user preferences.

In addition, the recommendation $R_{H}$ from the SS model was synthesized with the recommendation $R_{B}$ from the improved VBPR model into a mixed recommendation $R_{H}+R_{B}$ based on visual features (VMR). The precision of the VMR was compared with that of many other models (Table 2).

Table 2. The comparison of precisions among different recommendation models

N

IBCF

UBCF

LBCF

HC

FCM

BPR

SS

VMR

1

1.893

9.985

4.221

4.372

4.516

37.721

5.721

50.622

2

1.821

8.082

6.381

6.733

6.971

37.852

8.082

52.391

3

2.588

7.603

6.355

7.086

7.238

39.841

7.816

51.588

4

2.766

6.668

6.726

7.118

7.567

39.981

8.827

53.438

5

2.672

6.336

6.482

7.003

7.672

40.051

8.831

53.729

6

2.816

6.606

6.892

7.277

7.309

40.093

8.775

54.109

7

2.933

5.762

7.119

7.537

7.832

40.580

9.021

55.287

8

2.971

5.492

7.325

7.688

8.062

41.287

9.027

55.209

9

2.763

5.504

7.332

7.642

7.882

42.487

8.578

56.672

10

2.705

4.998

7.233

7.683

8.125

41.872

9.082

57.689

 
As shown in Table 2, the improved VBPR greatly outshined the traditional recommendation models in precision. The good performance is attributable to the following factors: First, the latent semantic spaces of users and tourist attractions are mined deeply by the BPR; these spaces, grounded on the existing scores, accurately describe user preferences and the popularity of tourist attractions. Second, a set of visual features (e.g. HSV, LBP, and VGG) are introduced to describe the visual contents of tourist attractions, which alleviates the data sparsity.

It can also be seen from Table 2 that the recommendation precision of the improved VBPR model increased steadily with the rising number of tourist attractions. Compared with NMF and KNN, the improved VBPR model only exhibited a small volatility. Hence, the improved VBPR model is a stable method for recommending multiple tourist attractions to users.

Figures 7 and 8 present the precision advantages of improved VBPR model and VMR, respectively. As shown in Figure 7, the precision advantage of VBPR model increased steadily with the growing number of tourist attractions.

As shown in Figure 8, the precision advantage of VMR also increased steadily with the growing number of tourist attractions. The VMR precision is mainly resulted from the improved VBPR model through matrix decomposition to the inclusion of visual features. Meanwhile, the user preferences obtained by the SS model play an auxiliary role.

Figure 7. The precision advantage of improved VBPR model

Figure 8. The precision advantage of the VMR

5. Conclusions

This paper designs a tourist attraction recommendation system based on SS, BPR and improved VBPR models. Firstly, user scores of tourist attractions were predicted by MF model. Then, the predicted scores were optimized in BPR and improved VBPR frameworks, resulting in a high-quality recommendation of tourist attractions. Experimental results show that the tourist attraction recommendation system based on SS and improved VBPR achieved a high accuracy, satisfied user demand, and greatly alleviated data sparsity. The future research will further improve the recommendation performance of the proposed system based on the multimodal semantic correlation between different visual features.

  References

[1] Chen, J., Li, K., Rong, H., Bilal, K., Yang, N., Li, K. (2018). A disease diagnosis and treatment recommendation system based on big data mining and cloud computing. Information Sciences, 435: 124-149. https://doi.org/10.1016/j.ins.2018.01.001

[2] Yin, C., Guo, Y., Yang, J., Ren, X. (2018). A new recommendation system on the basis of consumer initiative decision based on an associative classification approach. Industrial Management & Data Systems, 118(1): 188-203. https://doi.org/10.1108/IMDS-02-2017-0057

[3] Dumais, S.T. (2004). Latent semantic analysis. Annual Review of Information Science and Technology, 38(1): 188-230. https://doi.org/10.1002/aris.1440380105

[4] Zhang, X., Luo, H., Chen, B., Guo, G. (2020). Multi-view visual Bayesian personalized ranking for restaurant recommendation. Applied Intelligence, 50(9): 2901-2915. https://doi.org/10.1007/s10489-020-01703-6

[5] Goldberg, D., Nichols, D., Oki, B. M., & Terry, D. (1992). Using collaborative filtering to weave an information tapestry. Communications of the ACM, 35(12): 61-70. https://doi.org/10.1145/138859.138867

[6] Pang, Y., Jin, Y., Zhang, Y., Zhu, T. (2017). Collaborative filtering recommendation for MOOC application. Computer Applications in Engineering Education, 25(1): 120-128. https://doi.org/10.1002/cae.21785

[7] Huang, L., Tan, W., Sun, Y. (2019). Collaborative recommendation algorithm based on probabilistic matrix factorization in probabilistic latent semantic analysis. Multimedia Tools and Applications, 78(7): 8711-8722. https://doi.org/10.1007/s11042-018-6232-x

[8] Tsai, Y.C., Chen, J.H., Wang, J.J. (2018). Predict forex trend via convolutional neural networks. Journal of Intelligent Systems, 29(1): 941-958. https://doi.org/10.1515/jisys-2018-0074

[9] Yoon, H.G., Song, H.J., Park, S.B., Kim, K.Y. (2015). A Personalized News Recommendation using UserLocation and News Contents. Appl. Math, 9(2L): 439-449. https://doi.org/10.12785/amis/092L19

[10] Zhao, Q., Zhang, Y., Ma, J., Duan, Q. (2019). Factored item similarity and Bayesian personalized ranking for recommendation with implicit feedback. Arabian Journal for Science and Engineering, 44(4): 2973-2983. https://doi.org/10.1007/s13369-018-3358-0

[11] Pan, W., Zhong, H., Xu, C., Ming, Z. (2015). Adaptive Bayesian personalized ranking for heterogeneous implicit feedbacks. Knowledge-Based Systems, 73: 173-180. https://doi.org/10.1016/j.knosys.2014.09.013

[12] He, J., Li, X., Liao, L. (2018). Next point-of-interest recommendation via a category-aware Listwise Bayesian Personalized Ranking. Journal of Computational Science, 28: 206-216. https://doi.org/10.1016/j.jocs.2017.09.014

[13] Han, J., Zheng, L., Xu, Y., Zhang, B., Zhuang, F., Philip, S.Y., Zuo, W. (2019). Adaptive deep modeling of users and items using side information for recommendation. IEEE Transactions on Neural Networks and Learning Systems, 31(3): 737-748. https://doi.org/10.1109/TNNLS.2019.2909432

[14] Yuan, X., Lee, J.H., Kim, S.J., Kim, Y.H. (2013). Toward a user-oriented recommendation system for real estate websites. Information Systems, 38(2): 231-243. https://doi.org/10.1016/j.is.2012.08.004

[15] Kim, H.N., Ha, I., Lee, K.S., Jo, G.S., El-Saddik, A. (2011). Collaborative user modeling for enhanced content filtering in recommender systems. Decision Support Systems, 51(4): 772-781. https://doi.org/10.1016/j.dss.2011.01.012

[16] Hsu, F.M., Lin, Y.T., Ho, T.K. (2012). Design and implementation of an intelligent recommendation system for tourist attractions: The integration of EBM model, Bayesian network and Google Maps. Expert Systems with Applications, 39(3): 3257-3264. https://doi.org/10.1016/j.eswa.2011.09.013

[17] Sabou, M., Arsal, I., Braşoveanu, A.M. (2013). Tourmislod: A tourism linked data set. Semantic Web, 4(3): 271-276. 

[18] Navrozidis, I., Alexandridis, T.K., Dimitrakos, A., Lagopodi, A.L., Moshou, D., Zalidis, G. (2018). Identification of purple spot disease on asparagus crops across spatial and spectral scales. Computers and Electronics in Agriculture, 148: 322-329. https://doi.org/10.1016/j.compag.2018.03.035

[19] Bin, S., Sun, G., Zhou, S. (2019). Public opinion propagation model in social network based on blockchain. Journal of Applied Sciences - Electronics and Information Engineering, 37(2): 191-202.