Research and Implementation of Campus Network Search Engine Based on Scrapy Framework and Elasticsearch

【摘要】：To solve the problem of general search engine's inability to timely include information in campus network and time-lag,this paper proposes a perfect solution of campus network search engine based on Elasticsearch full-text search engine and Scrapy framework.This paper mainly analyzes the operation process of Elasticsearch,studies the search mechanism of Elasticsearch,and designs the system architecture of campus network search engine on this basis,and presents the key implementation technologies of web crawling module,index and query module and Front-end display module of the system.Finally,through experimental verification,compared with the traditional general search engine,the campus network search engine designed in this paper has better relevance and quantity of search results,and the inclusion of new information in the campus network is better.