Link Prediction

For link prediction tasks, Kumo reports F1@K, MAP@K, Precision@K, and Recall@K (for K = 1, 10, and 100), as well as the following metrics:

Normalized Discounted Cumulative Gain (NDCG) is calculated by:

where _reli _is the graded relevance of the result at position i.

Mean Average Precision (MAP) is calculated by:

where MAP is calculated by finding the average precision (AP) for each query, and then averaging over the number of queries.

Mean Reciprocal Rank (MRR) is calculated by:

where _ranki _refers to the rank position of the first relevant item for the i-th query.