Welcome to Francis Academic Press

International Journal of Frontiers in Engineering Technology, 2020, 2(3); doi: 10.25236/IJFET.2020.020304.

Big Data Crawling and Mining Based on Internet Recruitment Website


Jinting Wan, Fuqiang Wang, Zhaoling Li and Hao Zhang

Corresponding Author:
Fuqiang Wang

School of Information Science and Technology, Qingdao University of Science and Technology, Qingdao 266000, China


The recruitment information of computer related majors on the Internet recruitment website in 2019 has been crawled by means of data processing with the web crawler program in this paper mainly and the Visualization data has been presented. By using data analysis technology, the related needs and working conditions of big data industry and computer industry are displayed by visual means, which provides information support for college education and teaching, employment choice of college students and docking between schools and enterprises.


Big Data; Crawing; Mining; Internet Websit; Recruitment

Cite This Paper

Jinting Wan, Fuqiang Wang, Zhaoling Li and Hao Zhang. Big Data Crawling and Mining Based on Internet Recruitment Website. International Journal of Frontiers in Engineering Technology (2020), Vol. 2, Issue 3: 36-47. https://doi.org/10.25236/IJFET.2020.020304.


[1] http://language.chinadaily.com.cn/2017-03/17/content_28591593.htm
[2] Liu Ying, Wen Zhengjian(2018). Influencing Factors and Realization Paths of High Quality Employment for College Graduates with Bachelor's[J]. Degree Employment of Chinese University Students , vo.10,p.34-38
[3] Zhang Yan, Wu Yuquan(2020). Python - based web data crawler program design [J]; and Computer programming skills and maintenance, no.4,p.26-27
[4] Bi Yu Chen,Mei-Po Kwan(2020). Special Issue on Spatiotemporal Big Data Analytics for Transportation Applications. Transportmetrica A: Transport Science[J],no.1.
[5] Hongmei Qing(2019).Analysis on the Demand of Japanese Talents in Higher Vocational Colleges in Pearl River Delta - Based on the Information of Japanese Talents Recruitment[J]. South Vocational Education Journal, no.9,vol.6,p.27-32.
[6] Saloni, Silvia(2015). Impacts of multiple stressors during the establishment of fouling assemblages. Marine Pollution Bulletin[J] ,v. 91,p.211-221
[7] Song Y(2020). FeAture Explorer (FAE): A tool for developing and comparing radiomics models. PLOS ONE,vol.8
[8] Wang, Danxin(2020). A general location-authentication based secure participant recruitment scheme for vehicular crowdsensing. Computer Networks[J]:, v 171
[9] van Esch, Patrick(2019). Marketing AI recruitment: The next phase in job application and selection.Computers in Human Behavior[J],v.90, p.215-222
[10] Yuhao Fan(2018). Design and Implementation of Distributed Crawler System Based on Scrapy. IOP Conference Series: Earth and Environmental Science(CA), vol.108