It is important for an incremental crawler to know how web pages evolve and the relation between their changing frequencies and the link-attributes such as indegrees. This paper proposes a model for incremental crawli...
详细信息
ISBN:
(纸本)9780769521008
It is important for an incremental crawler to know how web pages evolve and the relation between their changing frequencies and the link-attributes such as indegrees. This paper proposes a model for incremental crawling and performs an experiment to verify the correlation between them, by monitoring the evolution of all the link-attributes of the web pages within one website. Particularly, we look deeply into one special kind of page named Index-pages. From the experiment, we can make four conclusions: (1) Pages which have bigger indegrees, outdegrees or PageRank values change more often, and these link-attributes all approximately obey a power-law distribution. (2) The link-attributes of pages seldom change though the pages change themselves. (3) A small proportion of the pages link to most of the vertexes in the web graph. (4) The Index-pages link to sizeable new pages in a website. These conclusions can be used to greatly enhance the performance of an incremental crawler, which is the foremost component for general search engines and web information stores.
Recently, Grid and peer-to-peer overlays have attracted attention from research communities as well as industry. However, the overwhelming majority of industrial, commercial and academic activities are geared around a...
详细信息
ISBN:
(纸本)0769522254
Recently, Grid and peer-to-peer overlays have attracted attention from research communities as well as industry. However, the overwhelming majority of industrial, commercial and academic activities are geared around applications, servers, and middleware. There have been some efforts in the management of the underlying networks (the connectivity for the overlays), but far from enough. This paper proposes a resilient, fault-adaptive, overlay resource management framework, with lightweight state management infrastructure, taken from some ongoing work by the authors in this area. This research aims to solve the problems of: (a) managing distributed network resources in a decentralized way;(b) providing resilient QoS for highly dynamic networks.
Some concerns, such as debugging or logging functionality, cannot be captured cleanly, and are often tangled and scattered throughout the code base. These concerns are called crosscutting concerns. Aspect-oriented pro...
详细信息
Some concerns, such as debugging or logging functionality, cannot be captured cleanly, and are often tangled and scattered throughout the code base. These concerns are called crosscutting concerns. Aspect-oriented programming (AOP) is a paradigm that enables developers to capture crosscutting concerns in separate aspect modules. The use of aspects has been shown to improve understandability and maintainability of systems. It has been shown that real-time concerns, such as memory management and thread scheduling, are crosscutting concerns [A. Corsaro et al., (2002), *** et al., (2001), A. Gal et al., (2002)]. However it is unclear whether encapsulating these concerns provides benefits. We were interested in determining whether using AOP to encapsulate real-time crosscutting concerns afforded benefits in system properties such as understandability and maintainability. This paper presents research comparing the system properties of two systems: a real-time sentient traffic simulator and its aspect-oriented equivalent. An evaluation of AOP is presented indicating both benefits and drawbacks with this approach
Despite Java's initial promise of providing a reliable and cost-effective platform-independent environment, the language appears to be unfavourable in the area of high-integrity systems and real-time systems. To e...
详细信息
The past few years have witnessed an explosive growth in the use of wireless mobile handheld devices as the enabling technology for accessing Internet-based services, as well as for personal communication needs in ad ...
详细信息
The past few years have witnessed an explosive growth in the use of wireless mobile handheld devices as the enabling technology for accessing Internet-based services, as well as for personal communication needs in ad hoc networking environments. Most studies indicate that it is impossible to utilize strong cryptographic functions for implementing security protocols on handheld devices. Our work refutes this. Specifically, we present a performance analysis focused on three of the most commonly used security protocols for networking applications, namely SSL, S/MIME and IPsec. Our results show that the time taken to perform cryptographic functions is small enough not to significantly impact real-time mobile transactions and that there is no obstacle to the use of quite sophisticated cryptographic protocols on handheld mobile devices.
Recently, grid and peer-to-peer overlays have attracted attention from research communities as well as industry. However, the overwhelming majority of industrial, commercial and academic activities are geared around a...
详细信息
Recently, grid and peer-to-peer overlays have attracted attention from research communities as well as industry. However, the overwhelming majority of industrial, commercial and academic activities are geared around applications, servers, and middleware. There have been some efforts in the management of the underlying networks (the connectivity for the overlays), but far from enough. This paper proposes a resilient, fault-adaptive, overlay resource management framework, with lightweight state management infrastructure, taken from some ongoing work by the authors in this area. This research aims to solve the problems of: (a) managing distributed network resources in a decentralized way; (b) providing resilient QoS for highly dynamic networks.
This paper presents the design of a scalable decentralized signaling underlay infrastructure, which features a DHT based management information storage and query-based state lookup mechanism. The signaling underlay is...
详细信息
This paper presents the design of a scalable decentralized signaling underlay infrastructure, which features a DHT based management information storage and query-based state lookup mechanism. The signaling underlay is aimed to apply a decentralized "peer-to-peer" style searching and discovering engine into the management and control plane of the overlay network, including grid networks and p2p applications, to facilitate deployment of QoS service.
Recent advances in P2P lookup overlays provide an appealing solution for distributed search without relying on a single database server. In addition to performing resource discovery, these P2P substrates also offer me...
ISBN:
(纸本)9783540241287
Recent advances in P2P lookup overlays provide an appealing solution for distributed search without relying on a single database server. In addition to performing resource discovery, these P2P substrates also offer membership management for dynamic peers. In this paper, we propose a publicly shared architecture called VC2A that takes advantage of a P2P lookup substrate for computational applications. VC2A targets computational master-slave applications. An application running in VC2A dynamically allocates resources from the system on the fly. These allocated resources then self-manage and -heal. We have implemented an architecture based on our previous efforts that include an enhanced P2P lookup overlay and a mobile agent system on top of this overlay. We show that VC2A is not only scalable but robust, and takes advantage of heterogeneity of the resources.
Regression testing is an important part of software quality assurance. We work to extend regression testing to include regression benchmarking, which applies benchmarking to detect regressions in performance. Given th...
详细信息
Recent advances in P2P lookup overlays provide an appealing solution for distributed search without relying on a single database server. In addition to performing resource discovery, these P2P substrates also offer me...
详细信息
暂无评论