High performance web server architecture with Kernel-level caching

In this work we are focusing on reducing response time and bandwidth requirements for high performance web server. Many researches have been done in order to improve web server performance by modifying the web server architecture. In contrast to these approaches, we take a different point of view, in which we consider the web server performance in OS perspective rather than web server architecture itself. To achieve these purposes we are exploring two different approaches. The first is running web server within OS kernel. We use kHTTPd as our basis for implementation. But it has a several drawbacks such as copying data redundantly, synchronous write, and processing only static data. We propose some techniques to improve these flaws. The second approach is caching dynamic data. Dynamic data can seriously reduce the performance of web servers. Caching dynamic data has been thought difficult to cache because it often change a lot more frequently than static pages and because web server needs to access database to provide service with dynamic data. To this end, we propose a solution for higher performance web service by caching dynamic data using content separation between static and dynamic portions. Benchmark results using WebStone show that our architecture can improve server performance by up to 18 percent and can reduce user’s perceived latency significantly.     

Cache algorithms based on adaptive invalidation reports for mobile environments

Caching of frequently accessed data items can reduce the bandwidth requirement in a mobile wireless computing environment. Periodical broadcast of invalidation reports is an efficient cache invalidation strategy. However, this strategy is severely affected by the disconnection and mobility of the clients. In this paper, we present three adaptive cache invalidation report methods, in which the server broadcasts different invalidation reports according to the update and query rates/patterns and client disconnection time while spending little uplink cost. Simulation results show that the adaptive invalidation methods are efficient in improving mobile caching and reducing the uplink and downlink costs without degrading the system throughput. This revised version was published online in July 2006 with corrections to the Cover Date.     

FastStor: improving the performance of a large scale hybrid storage system via caching and prefetching

Storing enormous amount of data on hybrid storage systems has become a widely accepted solution for today’s production level applications in order to trade off the performance and cost. However, how to improve the performance of large scale storage systems with hybrid components (e.g. solid state disks, hard drives and tapes) and complicated user behaviors is not fully explored. In this paper, we conduct an in-depth case study (we call it FastStor) on designing a high performance hybrid storage system to support one of the world’s largest satellite images distribution systems operated by the U.S. Geological Survey (USGS) Earth Resources Observation and Science (EROS) center. We demonstrate how to combine conventional caching policies with innovative current popularity oriented and user-specific prefetching algorithms to improve the performance of the EROS system. We evaluate the effectiveness of our proposed solution using over 5 million real world user download requests provided by EROS. Our experimental results show that using the Least Recently Used (LRU) caching policy alone, we are able to achieve an overall 64 % or 70 % hit ratio on a 100 TB or 200 TB FTP server farm composed of Solid State Disks (SSDs) respectively. The hit ratio can be further improved to 70 % (for 100 TB SSDs) and 76 % (for 200 TB SSDs) if intelligent prefetching algorithms are used together with LRU.     

Cyclone: A High-Performance Cluster-Based Web Server with Socket Cloning

With the ever-growing web traffic, cluster-based web server is becoming more and more important to the Internet's infrastructure. Making the best use of all the available resources in the cluster to achieve high performance is thus a significant research issue. In this paper, we introduce Cyclone, a cluster-based web server that can achieve nearly optimal throughput. Cyclone makes use of a novel network support mechanism called Socket Cloning (SC), together with the method of hot object replication, to obtain high performance. SC allows an opened socket to be moved efficiently between cluster nodes. With SC, the processing of HTTP requests can be migrated to the node that has a cached copy of the requested document, thus obviating the need for any cache transfer between cluster nodes. To achieve better load balancing, frequently accessed documents (hot objects) are replicated to other cluster nodes. Trace-driven benchmark tests using http_load show that Cyclone outperforms existing approaches and can achieve a throughput of 14575 requests/s (89.5 MBytes/s), which is 98% efficiency of the available network bandwidth, with eight web server nodes.     

Web Proxy Acceleration

Numerous studies show that miss ratios at forward proxies are typically at least 40–50%. This paper proposes and evaluates a new approach for improving the throughput of Web proxy systems by reducing the overhead of handling cache misses. Namely, we propose to front-end a Web proxy with a high performance node that filters the requests, processing the misses and forwarding the hits and the new cacheable content to the proxy. Requests are filtered based on hints of the proxy cache content. This system, called Proxy Accelerator, achieves significantly better communications performance than a traditional proxy system. For instance, an accelerator can be built as an embedded system optimized for communication and HTTP processing, or as a kernel-mode HTTP server. Scalability with the Web proxy cluster size is achieved by using several accelerators. We use analytical models, trace-based simulations, and a real implementation to study the benefits and the implementation tradeoffs of this new approach. Our results show that a single proxy accelerator node in front of a 4-node Web proxy can improve the cost-performance ratio by about 40%. Hint-based request filter implementation choices that do not affect the overall hit ratio are available. An implementation of the hint management module integrated in Web proxy software is presented. Experimental evaluation of the implementation demonstrates that the associated overheads are very small.     

Content-Aware Dispatching Algorithms for Cluster-Based Web Servers

Cluster-based Web servers are leading architectures for highly accessed Web sites. The most common Web cluster architecture consists of replicated server nodes and a Web switch that routes client requests among the nodes. In this paper, we consider content-aware Web switches that can use application level information to assign client requests. We evaluate the performance of some representative state-of-the-art dispatching algorithms for Web switches operating at layer 7 of the OSI protocol stack. Specifically, we consider dispatching algorithms that use only client information as well as the combination of client and server information for load sharing, reference locality or service partitioning. We demonstrate through a wide set of simulation experiments that dispatching policies aiming to improve locality in server caches give best results for traditional Web publishing sites providing static information and some simple database searches. On the other hand, when we consider more recent Web sites providing dynamic and secure services, dispatching policies that aim to share the load are the most effective.     

Leaf caching in Atta leafcutting ants: discrete cache formation through positive feedback

We examined the occurrence, mechanism and costs and benefits of leaf caching in laboratory colonies of two species of leafcutting ants, Atta cephalotes and A. colombica. If foragers returning to the nest are unable to enter because of a temporary bottleneck caused by leaves building up they may deposit their leaf pieces outside the nest entrance, forming a leaf cache. Similar leaf caches occur in the field at foraging trail junctions, obstacles on the trail and within nest entrance tunnels. Foraging ants carrying leaves were presented with different-sized leaf caches and the number dropping their leaves on the cache was recorded. The probability of a forager dropping her leaf was positively correlated with the size of the cache that she encountered. Therefore, positive feedback played a role in the formation of nest entrance caches. Cached pieces were more likely to be retrieved than noncached pieces but the time taken to retrieve leaf pieces from a cache was greater than from scattered groups of leaves. We suggest that the strategy of flexible nest entrance caching is an adaptive response to fluctuating food availability and collection. Copyright 2000 The Association for the Study of Animal Behaviour.     

Mountain chickadees discriminate between potential cache pilferers and non-pilferers

Evolution of complex cognition in animals has been linked to complex social behaviour. One of the costs of sociality is increased competition for food which may be reduced by food caching, but cache theft may undermine the benefits of caching. In birds, sophisticated food-caching-related cognition has been demonstrated only for corvids and attributed to their highly social behaviour. Many non-corvid food-caching species exhibit similar complex social behaviour and here I provide experimental evidence that mountain chickadees (Poecile gambeli) adjust their caching strategies depending on social context. Chickadees were allowed to cache seeds in the presence of potential cache pilferer, either conspecific or heterospecific (red-breasted nuthatch, Sitta canadensis) and a non-pilferer (dark-eyed junco, Junco hyemalis) positioned at the opposite sides of the experimental arena. Available caching sites were either exposed to these observers or hidden from their view while the cacher could always see both observers. Chickadees chose caching sites that were hidden from direct view of the potential pilferers while caching in direct view of the non-pilferers. When no pilferers were present, chickadees made equal use of all available caching substrates and there were no differences in the amount of caching in the presence or absence of pilferers. These results suggest that (i) chickadees may be able to recognize potential cache thieves, both conspecific and heterospecific, and adjust their caching strategies to minimize potential cache pilferage and (ii) chickadees appear to discriminate between caching sites that can or cannot be seen by observers, which may allow them to control visual information available to potential pilferers.     

Problems faced by food-caching corvids and the evolution of cognitive solutions

The scatter hoarding of food, or caching, is a widespread and well-studied behaviour. Recent experiments with caching corvids have provided evidence for episodic-like memory, future planning and possibly mental attribution, all cognitive abilities that were thought to be unique to humans. In addition to the complexity of making flexible, informed decisions about caching and recovering, this behaviour is underpinned by a motivationally controlled compulsion to cache. In this review, we shall first discuss the compulsive side of caching both during ontogeny and in the caching behaviour of adult corvids. We then consider some of the problems that these birds face and review the evidence for the cognitive abilities they use to solve them. Thus, the emergence of episodic-like memory is viewed as a solution for coping with food perishability, while the various cache-protection and pilfering strategies may be sophisticated tools to deprive competitors of information, either by reducing the quality of information they can gather, or invalidating the information they already have. Finally, we shall examine whether such future-oriented behaviour involves future planning and ask why this and other cognitive abilities might have evolved in corvids.     

An adaptable multithreaded prefetching technique for client‐server object bases

Given the existence of powerful multiprocessor client workstations in many client-server object database applications, the performance bottleneck is the delay in transferring pages from the server to the client. We present a prefetching technique that can avoid this delay, especially where the client application requests pages from several database servers. This technique has been added to the EXODUS storage manager. Part of the novelty of this approach lies in the way that multithreading on the client workstation is exploited, in particular for activities such as prefetching and flushing dirty pages to the server. Using our own complex object benchmark, we analyze the performance of the prefetching technique with multiple clients and multiple servers. The technique is also tested under a variety of client host workload levels. This revised version was published online in July 2006 with corrections to the Cover Date.     

The relationship between dominance, corticosterone, memory, and food caching in mountain chickadees (Poecile gambeli)

It has been hypothesized that in avian social groups subordinate individuals should maintain more energy reserves than dominants, as an insurance against increased perceived risk of starvation. Subordinates might also have elevated baseline corticosterone levels because corticosterone is known to facilitate fattening in birds. Recent experiments showed that moderately elevated corticosterone levels resulting from unpredictable food supply are correlated with enhanced cache retrieval efficiency and more accurate performance on a spatial memory task. Given the correlation between corticosterone and memory, a further prediction is that subordinates might be more efficient at cache retrieval and show more accurate performance on spatial memory tasks. We tested these predictions in dominant-subordinate pairs of mountain chickadees (Poecile gambeli). Each pair was housed in the same cage but caching behavior was tested individually in an adjacent aviary to avoid the confounding effects of small spaces in which birds could unnaturally and directly influence each other's behavior. In sharp contrast to our hypothesis, we found that subordinate chickadees cached less food, showed less efficient cache retrieval, and performed significantly worse on the spatial memory task than dominants. Although the behavioral differences could have resulted from social stress of subordination, and dominant birds reached significantly higher levels of corticosterone during their response to acute stress compared to subordinates, there were no significant differences between dominants and subordinates in baseline levels or in the pattern of adrenocortical stress response. We find no evidence, therefore, to support the hypothesis that subordinate mountain chickadees maintain elevated baseline corticosterone levels whereas lower caching rates and inferior cache retrieval efficiency might contribute to reduced survival of subordinates commonly found in food-caching parids.     

The effects of cache loss on choice of cache sites in black-capped chickadees

Food-storing birds lose a great deal of their stored food toother animals. We examined whether blackcapped chickadees (Parusairicapillus) modify their choice of cache sites using informationthat predicts cache loss. In experiment 1, birds learned toavoid caching at spatial locations where cache loss had previouslyoccurred, but they did not avoid caching near local color cuesthat predicted cache loss. Birds did not modify their generaluse of space in the aviary. Birds also learned to reduce searchingfor caches where spatial location predicted cache loss. Experiment2 confirmed the birds’ ability to discriminate among thespatial locations and the local color cues used in experiment1. In experiment 3, learning a food-rewarded approach to potentialcache sites occurred without any change in the choice of sitesfor caching. We discuss how chickadees selectively associatethe choice of cache site with its consequences, even over delaysof several hours between caching and cache recovery.     

Bolus recovery by gray jays: an experimental analysis

Gray jays (Perisoreus canadensis) typically store food boli in various sites on conifers. In a laboratory setting we determined whether gray jays recover stored boli by means of olfaction, trial-and-error search or spatial memory. Using an artificial tree with 52 possible caching sites, caching and/or recovery trials were performed with five captive gray jays for the following experiments: (1) no extra visual cues on tree; (2) extra visual cues (pine foliage) attached to tree; (3) pungent-smelling food hidden by observer; (4) one bird allowed to cache food but caches recovered by a second bird; (5) one bird allowed to observe another bird cache food and later permitted to recover those caches. Results supported the memory hypothesis, but cache site preferences were apparent for individual birds. To control for this, an additional experiment (6), in which cache site access was limited by the investigators, was conducted with two new birds. These results also indicated that gray jays use spatial memory to recover stored boli.     

The history of scatter hoarding studies

In this review, I will present an overview of the development of the field of scatter hoarding studies. Scatter hoarding is a conspicuous behaviour and it has been observed by humans for a long time. Apart from an exceptional experimental study already published in 1720, it started with observational field studies of scatter hoarding birds in the 1940s. Driven by a general interest in birds, several ornithologists made large-scale studies of hoarding behaviour in species such as nutcrackers and boreal titmice. Scatter hoarding birds seem to remember caching locations accurately, and it was shown in the 1960s that successful retrieval is dependent on a specific part of the brain, the hippocampus. The study of scatter hoarding, spatial memory and the hippocampus has since then developed into a study system for evolutionary studies of spatial memory. In 1978, a game theoretical paper started the era of modern studies by establishing that a recovery advantage is necessary for individual hoarders for the evolution of a hoarding strategy. The same year, a combined theoretical and empirical study on scatter hoarding squirrels investigated how caches should be spaced out in order to minimize cache loss, a phenomenon sometimes called optimal cache density theory. Since then, the scatter hoarding paradigm has branched into a number of different fields: (i) theoretical and empirical studies of the evolution of hoarding, (ii) field studies with modern sampling methods, (iii) studies of the precise nature of the caching memory, (iv) a variety of studies of caching memory and its relationship to the hippocampus. Scatter hoarding has also been the subject of studies of (v) coevolution between scatter hoarding animals and the plants that are dispersed by these.     

A reevaluation of the logic of pilferage effects, predation risk, and environmental variability on avian energy regulation: the critical role of time budgets

We studied the effect of pilferage rates, variation in foodencounter rate, and predation risk on cache and fat-storageregulation using dynamic programming. Previous predictionsthat small birds facing increased pilferage rates should cacheless and store more body fat are not generally supported. Instead,cache investment (caching rate or percent of food cached) is predicted to be unimodal, peaking at intermediate pilferagerates. This pattern is determined, in part, by pilferage-inducedchanges in time budgets: at low pilferage rates, a marginalincrease in pilferage rates can be offset by an increase incache investment. However, increased caching increases time allocated to both caching and foraging. The increased foragingis caused by the energetic costs of caching and by the lossof energy from the cache. Increased time spent caching andforaging in turn decreases time spent resting under low predationrisk. Above some threshold pilferage rate, the marginal valueof resting exceeds the marginal value of caching, and cacheinvestment declines with further increasing pilferage rates.These patterns hold for three levels of variation in food encounterrate: time-invariant, between-day, and within-day variation;they also hold across different mean rates of food encounter.We show that previous predictions concerning decreased energy-storagelevels with increased food abundance are not supported when there is between-day variation in mean food encounter ratesand food abundance increases only on "good" days. Finally,predation risk affects the predictions described above in twoways. First, these trends assume that the birds can rest ina predator-free refuge. If the refuge is not available, birdsare predicted to cache less at higher pilferage rates irrespectiveof the absolute level of pilferage. With the refuge in place,levels of predation risk affect the skew in the pilferage-rate/cachingfunction. As a result, the relative effect of predation riskon caching intensity varies with pilfer rate. At very low pilferrates, lowered predation risk causes more caching, but loweredpredation risk under high pilferage rates can lower caching intensity, contrary to previous predictions. Surprisingly, predationrisk has an appreciable effect on body mass only when the birdis predicted to cease caching (i.e., at the highest pilferrates); otherwise a change of two orders of magnitude in theprobability of encountering predators has little effect on body mass. Our results suggest that the tradeoffs associatedwith the joint regulation of internal energy stores and externallycached stores are more complicated than previous literaturewould indicate. Our results also show that we have underestimatedthe role that time budgets play in patterns of energy regulation.     

Rapid effects of corticosterone on cache recovery in mountain chickadees (Parus gambeli)

Environmental perturbations increase adrenal activity in several vertebrates. Increases in corticosterone may serve as a proximate trigger whereby organisms can rapidly adapt their behavior to survive environmental fluctuations. In food-caching songbirds, inclement weather may present the need to alter caching and/or retrieval behaviors to ensure food supplies. We hypothesized that corticosterone may increase the rate of caching and/or retrieval behaviors in the mountain chickadee, a food-storing songbird, and tested if these potential effects were mediated by alterations in appetite, activity, or memory for cache sites. Corticosterone or vehicle was administered to subjects 5 min prior to either caching or recovery in a naturalistic laboratory paradigm during which we recorded the number of caching events, sites visited, and seeds eaten (caching) or caches recovered, total sites visited, cache-related visits, and non-cache-related visits (recovery). Data were analyzed using nested ANOVA for treatment within sequential trial. There was no effect on any caching behaviors following treatment. However, birds treated with corticosterone during retrieval recovered more seeds and tended to visit more cache-related sites than did controls. Since groups did not differ in the number of seeds eaten or the total number of sites visited, it seems unlikely that corticosterone affected appetite or activity. Rapid surges in corticosterone may increase the efficacy of an underlying memory process for cache sites which is reflected in higher cache recovery in corticosterone-treated birds than in controls. Thus, rapid alterations in plasma corticosterone following environmental change may alter memory-reliant behaviors which promote survival in the food-caching mountain chickadee.     

Acorn Pericarp Removal as a Cache Management Strategy of the Siberian Chipmunk,Tamias sibiricus

Numerous recent studies have revealed a variety of behavioral adaptations of rodents for maximizing returns from cached seeds. Herein we report on a novel behavior by the Siberian chipmunk (Tamias sibiricus) in northeastern China, by which they consistently remove the pericarp (shell) of Quercus mongolica acorns before dispersing and caching these nuts. We investigated the effects of pericarp removal on acorn germination, tannin concentrations, cache pilferage, and insect damage, to determine if and how pericarp removal facilitates cache management by Siberian chipmunks and whether or not such behavior influences seed fates. Chipmunks cached acorns only after the pericarps were removed. Chipmunks preferred pericarp‐removed acorns over intact acorns when removing them from seed stations for both consumption and caching. Pericarp removal did not affect germination or tannin concentration of cached Q. mongolica acorns, suggesting that the behavior is not an adaptation for long‐term storage and tannin decomposition. Acetone treatments of the pericarp and artificial pericarp removal failed to alter pilferage rates by Siberian chipmunks and wood mice (Apodemus peninsulae). Since damage of acorns by weevils often leads to cache losses, we also tested the effects of weevil infestation on cache decision following pericarp removal. Siberian chipmunks removed pericarps and then scatter hoarded significantly more sound than weevil‐infested acorns, strongly suggesting that pericarp removal is used to discriminate between the infested and non‐infested acorns. Thus, we argue that the primary function of this behavior is to ensure successful storage of sound acorns, at least for short‐term storage. Future studies should consider the potential impact of pericarp removal on weevil populations and long‐term patterns of seed survival and establishment from the Siberian chipmunk’s caches.     

Ravens, Corvus corax, differentiate between knowledgeable and ignorant competitors

Human social behaviour is influenced by attributing mental states to others. It is debated whether and to what extent such skills might occur in non-human animals. We here test for the possibility of ravens attributing knowledge about the location of food to potential competitors. In our experiments, we capitalize on the mutually antagonistic interactions that occur in these birds between those individuals that store food versus those that try to pilfer these caches. Since ravens' pilfer success depends on memory of observed caches, we manipulated the view of birds at caching, thereby designing competitors who were either knowledgeable or ignorant of cache location and then tested the responses of both storers and pilferers to those competitors at recovery. We show that ravens modify their cache protection and pilfer tactics not simply in response to the immediate behaviour of competitors, but also in relation to whether or not they previously had the opportunity of observing caching. Our results suggest that the birds not only recall whom they had seen during caching, but also know that obstacles can obstruct the view of others and that this affects pilfering.     

Changes in spatial memory mediated by experimental variation in food supply do not affect hippocampal anatomy in mountain chickadees (Poecile gambeli)

Earlier reports suggested that seasonal variation in food-caching behavior (caching intensity and cache retrieval accuracy) might correlate with morphological changes in the hippocampal formation, a brain structure thought to play a role in remembering cache locations. We demonstrated that changes in cache retrieval accuracy can also be triggered by experimental variation in food supply: captive mountain chickadees (Poecile gambeli) maintained on limited and unpredictable food supply were more accurate at recovering their caches and performed better on spatial memory tests than birds maintained on ad libitum food. In this study, we investigated whether these two treatment groups also differed in the volume and neuron number of the hippocampal formation. If variation in memory for food caches correlates with hippocampal size, then our birds with enhanced cache recovery and spatial memory performance should have larger hippocampal volumes and total neuron numbers. Contrary to this prediction we found no significant differences in volume or total neuron number of the hippocampal formation between the two treatment groups. Our results therefore indicate that changes in food-caching behavior and spatial memory performance, as mediated by experimental variations in food supply, are not necessarily accompanied by morphological changes in volume or neuron number of the hippocampal formation in fully developed, experienced food-caching birds.     

Evidence of Social Influences on Cache‐Making by Grey Squirrels (Sciurus carolinensis)

Many studies have found that scatter‐hoarding animals change their behaviour when storing food in the presence of conspecifics to minimize the likelihood that their caches will be pilfered; they refrain from caching, move away from conspecifics or choose visually obscured sites. This study reports the first evidence that the presence of conspecifics continues to influence the caching behaviour of a scatter‐hoarding mammal, the grey squirrel, after a suitable cache site has been selected and the hoarder is filling and covering its cache. Wild grey squirrels were filmed when storing preferred and less preferred nuts and when they were alone or with conspecifics present. In line with previous findings, squirrels spent longer travelling from the nut patch and were more vigilant when conspecifics were present. However, squirrels also spent longer disguising their caches and were more likely to stop digging and become vigilant when conspecifics were present than when they were alone. In particular, they were most likely to curtail their digging when storing their preferred nuts in the presence of conspecifics. The results indicate that caching squirrels remain sensitive to the presence of conspecifics until the cache is complete and that they respond flexibly to conspecifics according to the type of food they are storing.