Search Science
Pre-trained LanguageModelfor
Web-Scale Retrieval & Ranking
in Baidu Search
Shuaiqiang WANG
searchscience.baidu
wangshuaiqiang@baidu Search Science
Outline
1 Background
2 Retrieval
3 Ranking
4 Summary Search Science
Outline
1 Background
2 Retrieval
3 Ranking
4 SummarySearch Science
Background
o Retrieval and ranking are two crucial stages in web-scale search engine
DatabaseWeb-scale
documents
Query Retrieval
Few hundreds or
thousands candidates
Results Ranking Search Science
百度ERNIE
github/PaddlePaddle/ERNIE
1. Sun, Y. et al, 2019. Ernie: Enhanced representation through knowledge integration. In arXiv:1904.09223.
2. Sun, Y. et al, 2020. Ernie 2.0: A continual pre-training framework for language understanding. In AAAI.