Symbolic Verification of Web Crawler Functionality and Its Properties

Shetty , Keerthi S and Bhat, Swaraj and Singh, Sanjay (2012) Symbolic Verification of Web Crawler Functionality and Its Properties. In: International Conference on Computer Communication and Informatics (ICCCI -2012, Jan. 10 – 12, Coimbatore, INDIA.

[img] PDF
05.pdf - Published Version
Restricted to Registered users only

Download (2MB) | Request a copy
Official URL:


Now a days people use search engines every now and then to retrieve documents from the Web. Web crawling is the process by which a search engine gather pages from the Web to index them and support a search engine. Web crawlers are the heart of search engines. Web crawlers continuously keep on crawling the web and find any new web pages that have been added to the web, pages that have been removed from the web. Due to growing and dynamic nature of the web, it has become a challenge to traverse through all URLs in the web documents and to handle these URLs. The entire crawling process may be viewed as traversing a web graph. The aim of this paper is to model check the crawling process and crawler properties using a symbolic model checker tool called NuSMV. The basic operation of a hypertext crawler and the crawler properties has been modeled in terms of CTL specification and it is observed that the system takes care of all the cos pecifications.nstraints by satisfying all the specifications.

Item Type: Conference or Workshop Item (Paper)
Uncontrolled Keywords: Web Crawler, Symbolic Model verifier NuSMV, Model Checker.
Subjects: Engineering > MIT Manipal > Information and Communication Technology
Depositing User: MIT Library
Date Deposited: 02 Mar 2013 06:48
Last Modified: 02 Mar 2013 06:48

Actions (login required)

View Item View Item