Skip to content

Getting Started Tutorial

First, install Torch-RecHub:

pip install torch-rechub

Then use the following code to train recommender system models:

Ranking (CTR Prediction)

from torch_rechub.models.ranking import DeepFM
from torch_rechub.trainers import CTRTrainer
from torch_rechub.utils.data import DataGenerator

dg = DataGenerator(x, y)
train_dl, val_dl, test_dl = dg.generate_dataloader(split_ratio=[0.7, 0.1], batch_size=256)

model = DeepFM(deep_features=deep_features, fm_features=fm_features, 
               mlp_params={"dims": [256, 128], "dropout": 0.2, "activation": "relu"})

ctr_trainer = CTRTrainer(model)
ctr_trainer.fit(train_dl, val_dl)
auc = ctr_trainer.evaluate(test_dl)

Multi-Task Learning

from torch_rechub.models.multi_task import SharedBottom, ESMM, MMOE, PLE, AITM
from torch_rechub.trainers import MTLTrainer

task_types = ["classification", "classification"]
model = MMOE(features, task_types, 8, 
            expert_params={"dims": [32,16]}, 
            tower_params_list=[{"dims": [32, 16]}, {"dims": [32, 16]}])

mtl_trainer = MTLTrainer(model)
mtl_trainer.fit(train_dl, val_dl)

Matching Models

from torch_rechub.models.matching import DSSM
from torch_rechub.trainers import MatchTrainer
from torch_rechub.utils.data import MatchDataGenerator

dg = MatchDataGenerator(x, y)
train_dl, test_dl, item_dl = dg.generate_dataloader(test_user, all_item, batch_size=256)

model = DSSM(user_features, item_features, temperature=0.02,
             user_params={"dims": [256, 128, 64], "activation": 'prelu'},
             item_params={"dims": [256, 128, 64], "activation": 'prelu'})

match_trainer = MatchTrainer(model)
match_trainer.fit(train_dl)

Model Zoo

Model List

Title Tag Development Status Developers Institution Meeting Year URL PDF
DIN Rank,Sequence Completed 赖敏材 Alibaba KDD 2018 https://arxiv.org/abs/1706.06978 1706.06978.pdf
ESMM Rank Completed 赖敏材 Alibaba SIGIR 2018 https://arxiv.org/abs/1804.07931 1804.07931.pdf
Youtube-SBC Match Completed 赖敏材 Google RecSys 2019 https://research.google/pubs/pub48840/ 6c8a86c981a62b0126a11896b7f6ae0dae4c3566.pdf
DSSM Match Completed 赖敏材 微软 CIKM 2013 https://posenhuang.github.io/papers/cikm2013_DSSM_fullversion.pdf cikm2013_DSSM_fullversion.pdf
MetaBalance 其他 Completed Facebook www 2022 https://arxiv.org/pdf/2203.06801v1.pdf 2203.06801v1-3.pdf
Wide & Deep Rank Completed 赖敏材 Google DLRS 2016 https://arxiv.org/pdf/1606.07792.pdf 1606.07792.pdf
DSSM-Facebook Match Completed 赖敏材 Facebook KDD 2020 https://arxiv.org/abs/2006.11632 2006.11632.pdf
DeepFM Rank Completed 赖敏材 Huawei IJCAI 2017 https://arxiv.org/abs/1703.04247 1703.04247.pdf
SasRec Match 进行中 王宇宸
PLE Rank Completed 赖敏材 Tencent RecSys 2020 https://dl.acm.org/doi/abs/10.1145/3383313.3412236?casa_token=4g_ErWbxWf8AAAAA%3APhbcdBa6b-SXHlpFtKh1Lybjtv48sYV2l1GsPeL43N5Lpih_GwarAwV5hzxOYUVZoWd8dimltm4czmI 2020 (Tencent) (Recsys) [PLE] Progressive Layered Extraction (PLE) - A Novel Multi-Task Learning (MTL) Model for Personalized Recommendations.pdf
AITM Rank Completed 赖敏材 Meituan KDD 2021 https://arxiv.org/abs/2105.08489 2105.08489-2.pdf
Shared-Bottom Rank Completed 赖敏材 CMU ML 1997 https://link.springer.com/content/pdf/10.1023/A:1007379606734.pdf Caruana1997_Article_MultitaskLearning.pdf
DCN Rank Completed 赖敏材 Google,斯坦福 AKDD 2017 https://arxiv.org/abs/1708.05123 1708.05123.pdf
Youtube-DNN Match Completed 赖敏材 Google RecSys 2016 https://dl.acm.org/doi/10.1145/2959100.2959190 2959100.2959190.pdf
MMOE Rank Completed 赖敏材 Google KDD 2018 https://dl.acm.org/doi/pdf/10.1145/3219819.3220007 3219819.3220007.pdf
GRU4Rec Match,Sequence Completed 王凯 Tencent KDD 2022
SASRec Match,Sequence Completed 王宇宸 UC ICDM 2018 https://arxiv.org/pdf/1808.09781.pdf 1808.09781-3.pdf
SINE Match Completed 康博 Alibaba WSDM 2021 https://arxiv.org/pdf/2102.09267.pdf 2102.09267.pdf
(FAT-)DeepFFM Rank Completed 康博 Sina arXiv 2019 https://arxiv.org/pdf/1905.06336.pdf 1905.06336.pdf
STAMP Match,Sequence Completed 康博 电子科大 KDD 2018 https://dl.acm.org/doi/10.1145/3219819.3219950 3219819.3219950.pdf
NARM Match,Sequence Completed 康博 京东,山东大学 CIKM 2017 https://arxiv.org/pdf/1711.04725.pdf 1711.00165.pdf
DCN_v2 Rank Completed 叶志雄 Google www 2021 https://arxiv.org/abs/2008.13535 DCN V2 Improved Deep & Cross Network and Practical Lessons.pdf
EDCN Rank Completed 叶志雄 Huawei KDD 2021 https://dlp-kdd.github.io/assets/pdf/DLP-KDD_2021_paper_12.pdf
FiBiNet Rank Completed 叶志雄 Sina RecSys 2019 https://dl.acm.org/doi/abs/10.1145/3298689.3347043
DIEN Rank,Sequence Completed 范涛 Alibaba AAAI 2019 https://ojs.aaai.org/index.php/AAAI/article/view/4545 4545-Article Text-7584-1-10-20190706.pdf
BST Rank,Sequence Completed 范涛 Alibaba arXiv 2019 Behavior Sequence Transformer for E-commerce Recommendation in Alibaba PDF