Please use this identifier to cite or link to this item: http://www.repositorio.ufop.br/handle/123456789/10363
Title: Strategies for automatic determination of similarity threshold for genre-aware focused crawling processes.
Authors: Siqueira, Gustavo Oliveira de
Assis, Guilherme Tavares de
Ferreira, Anderson Almeida
Mangaravite, Vítor
Pádua, Flávio Luis Cardeal
Keywords: Similarity threshold
Web crawling
Focused crawling
Issue Date: 2017
Citation: SIQUEIRA, G. O. de et al. Strategies for automatic determination of similarity threshold for genre-aware focused crawling processes. IADIS International Journal on WWW/Internet, v. 15, p. 15-30, 2017. Disponível em: <http://www.iadisportal.org/ijwi/papers/2017151102.pdf>. Acesso em: 16 jun. 2018.
Abstract: The great popularity and, specially, the fast Web growth have led to the proposal and analysis of new techniques for helping users to locate effectively the needed information in a satisfactory time, without much difficulty. Traditional crawlers are not capable to identify relevant sub-spaces on Web related to a specific theme; however, focused crawlers are capable to solve, effectively and efficiently, the mentioned problem. Usually, a focused crawler process requires a specific value, called similarity threshold value, for determining whether a crawled Web page is relevant or not according to a topic of interest; such value is distinct for each specific topic. In order to determine automatically such a value for focused crawlers related to a genre-aware approach, we propose three strategies in this work. Our experimental evaluation achieved, as the best result, 100% of precision and 98% of F1, considering a specific crawling process for which it was determined automatically a similarity threshold value: a great result compared with the baseline.
URI: http://www.repositorio.ufop.br/handle/123456789/10363
metadata.dc.identifier.uri2: http://www.iadisportal.org/ijwi/papers/2017151102.pdf
ISSN: 16457641
Appears in Collections:DECOM - Artigos publicados em periódicos

Files in This Item:
File Description SizeFormat 
ARTIGO_StrategiesAutomaticDetermination.pdf618,5 kBAdobe PDFView/Open    Request a copy


Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.