Please use this identifier to cite or link to this item:
http://www.repositorio.ufop.br/jspui/handle/123456789/10363
Title: | Strategies for automatic determination of similarity threshold for genre-aware focused crawling processes. |
Authors: | Siqueira, Gustavo Oliveira de Assis, Guilherme Tavares de Ferreira, Anderson Almeida Mangaravite, Vítor Pádua, Flávio Luis Cardeal |
Keywords: | Similarity threshold Web crawling Focused crawling |
Issue Date: | 2017 |
Citation: | SIQUEIRA, G. O. de et al. Strategies for automatic determination of similarity threshold for genre-aware focused crawling processes. IADIS International Journal on WWW/Internet, v. 15, p. 15-30, 2017. Disponível em: <http://www.iadisportal.org/ijwi/papers/2017151102.pdf>. Acesso em: 16 jun. 2018. |
Abstract: | The great popularity and, specially, the fast Web growth have led to the proposal and analysis of new techniques for helping users to locate effectively the needed information in a satisfactory time, without much difficulty. Traditional crawlers are not capable to identify relevant sub-spaces on Web related to a specific theme; however, focused crawlers are capable to solve, effectively and efficiently, the mentioned problem. Usually, a focused crawler process requires a specific value, called similarity threshold value, for determining whether a crawled Web page is relevant or not according to a topic of interest; such value is distinct for each specific topic. In order to determine automatically such a value for focused crawlers related to a genre-aware approach, we propose three strategies in this work. Our experimental evaluation achieved, as the best result, 100% of precision and 98% of F1, considering a specific crawling process for which it was determined automatically a similarity threshold value: a great result compared with the baseline. |
URI: | http://www.repositorio.ufop.br/handle/123456789/10363 |
metadata.dc.identifier.uri2: | http://www.iadisportal.org/ijwi/papers/2017151102.pdf |
ISSN: | 16457641 |
Appears in Collections: | DECOM - Artigos publicados em periódicos |
Files in This Item:
File | Description | Size | Format | |
---|---|---|---|---|
ARTIGO_StrategiesAutomaticDetermination.pdf Restricted Access | 618,5 kB | Adobe PDF | View/Open |
Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.