Dynamic data replacement and adaptive scheduling policies in spark

Improper data replacement and inappropriate selection of job scheduling policy are important reasons for the degradation of Spark system operation speed, which directly causes the performance degradation of Spark parallel computing. In this paper, we analyze the existing caching mechanism of Spark and find that there is still more room for optimization of the existing caching policy. For the task structure analysis, the key information of Spark tasks is taken out to obtain the data and memory usage during the task runtime, and based on this, an RDD weight calculation method is proposed, which integrates various factors affecting the RDD usage and establishes an RDD weight model. Based on this model, a minimum weight replacement algorithm based on RDD structure analyzing is proposed. The algorithm ensure that the relatively more valuable data in the data replacement process can be cached into memory. In addition, the default job scheduling algorithm of the Spark framework considers a single factor, which cannot form effective scheduling for jobs and causes a waste of cluster resources. In this paper, an adaptive job scheduling policy based on job classification is proposed to solve the above problem. The policy can classify job types and schedule resources more effectively for different types of jobs. The experimental results show that the proposed dynamic data replacement algorithm effectively improves Spark's memory utilization. The proposed job classification-based adaptive job scheduling algorithm effectively improves the system resource utilization and shortens the job completion time.

     

Reconstitution de la végétation et du paléoclimat à partir de charbons de bois prélevés sur les sites du Paléolithique dans la région de Jungwon en Corée

Hundreds samples of the charcoals and waterlogged woods excavated from three late Paleolithic sites (Suyanggae, Gunang-gul and Sorori) in the Jungwon Region in Korea were analyzed to reconstruct the vegetation and paleoclimate in the region. Analyzed charcoal samples from the Suyanggae site show that the climate was cold in the lower part and it became more warm and dry in the upper part. From the Gunang-gul site, only Picea spp. was identified, indicating cool climates. From the Sorori site, two species were found; Alnus spp. (95%) and Ulmus spp. (5%). No conifers were discovered. The species composition indicates that the climate condition of central Korean peninsula around 8,800 BP was little cooler and wetter condition.     

Revision of “<Emphasis Type="Italic">Septonema ochraceum</Emphasis>” revealed three new species of <Emphasis Type="Italic">Venturiaceae</Emphasis> and <Emphasis Type="Italic">Herpotrichiellaceae</Emphasis>

Survey of seven strains determined as Septonema ochraceum (Dothideomycetes, inc. sed.) isolated from pine litter or obtained from public collections revealed three new species, Fusicladium cordae, F. sicilianum (Venturiaceae), Cladophialophora matsushimae (Herpotrichiellaceae) and a cryptic species morphologically identical to Devriesia americana (Teratosphaeriaceae), but phylogenetically distinct. Morphological survey and phylogenetic analysis using nucleotide sequence data from the nuclear ribosomal subunit genes indicate a close relationship within three species colonising pine litter needles, F. cordae, F. pini and F. ramoconidii. F. sicilianum is most related to F. rhodense. C. matsushimae represents a species belonging to one of the lineages of the polyphyletic genus Cladophialophora. None of the strains observed can be classified morphologically as S. ochraceum, of which the type material does not exist.     

A comparative theoretical study of the catalytic activities of Au<Stack><Subscript>2</Subscript><Superscript>-</Superscript></Stack> and AuAg<Superscript>-</Superscript> dimers for CO oxidation

The detailed mechanisms of catalytic CO oxidation over Au₂^- and AuAg^- dimers, which represent the simplest models for monometal Au and bimetallic Au-Ag nanoparticles, have been studied by performing density functional theory calculations. It is found that both Au₂^- and AuAg^- dimers catalyze the reaction according to the similar mono-center Eley–Rideal mechanism. The catalytic reaction is of the multi-channel and multi-step characteristic, which can proceed along four possible pathways via two or three elementary steps. In AuAg^-, the Au site is more active than the Ag site, and the calculated energy barrier values for the rate-determining step of the Au-site catalytic reaction are remarkably smaller than those for both the Ag-site catalytic reaction and the Au₂^- catalytic reaction. The better catalytic activity of bimetallic AuAg^- dimer is attributed to the synergistic effect between Au and Ag atom. The present results provide valuable information for understanding the higher catalytic activity of Au-Ag nanoparticles and nanoalloys for low-temperature CO oxidation than either pure metallic catalyst.     

Genetics of the cell cycle: Adaptive modification of the <Emphasis Type="Italic">CycB</Emphasis><Superscript><Emphasis Type="Italic">2g</Emphasis></Superscript> mutation expression in dividing cells of <Emphasis Type="Italic">Drosophila melanogaster</Emphasis>

The effect of mutation CycB ^2g on mitosis in neural ganglia and imaginal disks was studied in third-instar larvae of Drosophila melanogaster. Chromosome condensation and segregation were shown to be impaired in dividing cells of mutant larvae. During the three-year period of maintenance of the mutation in heterozygote, frequencies of some defects decreased via cellular adaptive modification.Translated from Genetika, Vol. 41, No. 3, 2005, pp. 312–319.Original Russian Text Copyright © 2005 by Lebedeva, Trunova, Omelyanchuk.     

Comparaison de l'expression de certains caractères crâniens sur les hominidés chinois du Pléistocène récent et de l'Holocène (grotte supérieure de Zhoukoudian, sites de Longxian et de Yanqing)

The human remains recovered from “Grotte supérieure de Zhoukoudian” are the best-preserved Late Pleistocene human fossils in East Asia. For decades, as the representative of the Late Pleistocene human in East Asia, the Upper Cave skulls have been playing important role in the research of origins of modern Mongoloids and American Indians. With the advance of the origin and evolution of modern humans, more attention has been paid to the details and the mechanisms for the late Pleistocene human evolution and the formation of modern human populations. Both the origin and diversification of modern humans have been stressed. Some studies further trigger the debaters on the Upper Cave Man concerning its evolutionary level and its role in the formation of modern human populations in East Asia. To further explore these problems, we examined and compared 12 non-metric features on the 3 Late Pleistocene Upper Cave skulls and 162 Holocene individuals earthed from two archaeological sites of North China (Longxian and Yanqing). Our results indicate that 8 on the 12 features have different expression patterns between Upper Cave Man and recent Chinese leading the authors to believe that more primitive expressions appeared on the Upper Cave Man than on recent Chinese populations. Based on these findings, some problems on the intragroup variation in Late Pleistocene and Holocene populations are discussed.     

L'hominidé du Pléistocène supérieur en Corée

Since the middle of 1970s, one rock-shelter, six caves and one open archaeological site have yielded several hominid fossils. Among them, fossils from Yonggok, Mandal, Sangsi and Hungsu cave sites are useful to reconstruct the general shape of the Upper Pleistocene Hominids in Korea. The main study of this paper is to focus on the reconstruction of the general shape of the upper Pleistocene hominids, and to examine the cause of cranial changes from the late upper Paleolithic to Mesolithic period in Korea. Biomechanical principles are also applied to reconstruct the social activity of the upper Paleolithic man in Korea. In addition, it is assumed that main proponent of Paleolithic cultures in Korea might be Homo sapiens rather than any other species. Based on the anatomical characteristics of skull, the axillary border of the scapular and the midshaft of the femur, general appearance of Homo sapiens during the Pleistocene in Korea could be reconstructed.     

Conception et exécution de bases de données intégrées pour l'analyse des rapports spatiotemporels des artefacts du Paléolithique

The archaeologists excavate the historic site and analyze data from the excavation site. Therefore, they study about the past affairs and circumstances unknown to the world. These data are composed of stones, plants, bones and geological features, which are stored in separate files according to the fields of study. It is important to mention that this information become the first step toward the solution of some hypothesis in Archaeology. Therefore, we need the system that can not only support integrated environment to find clues of the past, but also manage existing artifact data systematically and grasp relationships among the data. In this paper, we modeled the time, which is used in archaeology and geology, and built an entity relationship database to store Paleolithic data excavated in Jungwon region site of the Republic of Korea as one resource, which seem to give a base for integrated research and relationships in archaeology. In addition, we developed the Graphic User Interface that allows various users to connect to the established system through the web.     

Variability of esterase patterns in adult flies of the <Emphasis Type="Italic">saltans</Emphasis> species group of <Emphasis Type="Italic">Drosophila</Emphasis> (subgenus <Emphasis Type="Italic">Sophophora</Emphasis>)

Esterases are known for their involvement in several physiological processes and high degree of polymorphism, in many organisms. Such polymorphism has been used to characterize species and species groups and to study genetic changes occurred in their evolutionary history. In the present study, the esterase patterns of 19 strains from 10 species representative of the five subgroups of the saltans species group were analyzed using polyacrylamide gel electrophoresis and α- and β- naphthyl acetates as substrates. Fifty-one esterase bands were detected and classified as 31 α-esterases, 18 β-esterases and two α/β-esterases. On the basis of the inhibition patterns using Malathion and eserine sulfate, 34 bands were classified as carboxylesterases, 14 as acethylesterases and three as cholinesterases. Ten gene loci were tentatively established on the basis of data on band position in the gel, substrate preference and inhibition pattern. Twenty bands were species-specific, the remaining being shared by species from the same or different subgroups. Bands detected exclusively in males and bands with a different frequency or degree of expression between sexes were also detected. In the gels prepared for analysis of gene expression in the body parts (head, thorax and abdomen), the degree of expression of the β-esterases was higher in the thorax, while the α-esterases were expressed predominantly in the abdomen and thorax. A global view of the data available at present on the esterases of the species from the saltans group and their degree of polymorphism are presented, as well as the possibility of using some β-esterases, because of their characteristics in the gels, as markers for species identification.     

Manifestation of salt tolerance of <Emphasis Type="Italic">Spirulina platensis</Emphasis> and <Emphasis Type="Italic">Spirulina maxima</Emphasis> cyanobacteria of the genus <Emphasis Type="Italic">Arthrospira (Spirulina)</Emphasis>

The salt tolerance of two representatives of genus Spirulina (Arthrospira) Spirulina platensis and Spirulina maxima has been investigated. They both are the wide-spread objects of photobiotechnology and it has been shown that the content of 5–15 % sea-water in medium has not caused the decreasing of biomass yield more than 15–20% as compared with control. The further decreasing of biomass was proportionate to sea-water content in medium. The investigation of reactivity of native (intravital) exometabolites secreted into cultural medium has showed that the sea-water content influence the oxidative activity (OA) of exometabolites and hour’s rhythmics.     

Comparison of tolerance of <Emphasis Type="Italic">Brassica juncea</Emphasis> and <Emphasis Type="Italic">Vigna radiata</Emphasis> to cadmium

The effect of different cadmium concentrations (6–120 μM) on Hill reaction activity (HRA) of isolated chloroplasts, contents of chlorophylls (Chls) and carotenoids (Cars), and Cd uptake and accumulation in plant organs of Indian mustard (Brassica juncea L. cv. Vitasso) and mung bean [Vigna radiata (L.) Wilczek] were determined. The Cd stress inhibited photochemical activity of isolated chloroplasts of both species and in both tested developmental stages. On the basis of EC₅₀ values, the mung bean showed a higher sensitivity to Cd treatment than Indian mustard. The higher sensitivity of both species was determined in the earlier than in the older developmental stage. The leaves of Cd-treated plants possessed lower contents of Chls and Cars in both species and the negative effect increased with Cd concentration. A difference between species was also found in Cd uptake and accumulation. In both species, Cd was accumulated more in roots than in shoots, with higher accumulation in Indian mustard than in mung bean.     

Micrografting of <Emphasis Type="Italic">Protea cynaroides</Emphasis>

The inability to induce rooting of in vitro-established Protea cynaroides microshoots has prevented the production of complete plantlets. A successful shoot-tip micrografting technique was developed using in vitro-germinated P. cynaroides seedlings as rootstocks and axenic microshoots established from pot plants as microscions. Thirty-day old seedlings, germinated on growth-regulator-free, half-strength Murashige and Skoog medium, were decapitated and a vertical incision made from the top end. The bottom ends of microshoots established on modified Murashige and Skoog medium were cut into a wedge (‘V’) shape, and placed into the incision. The micrografted explants were cultured in a growth chamber with the temperature adjusted to 25 ± 2°C, with a 12-h photoperiod. Best results were obtained by placing the microscions directly onto the rootstock without any pre-treatments. Dipping the explants in anti-oxidant solution or placing a layer of medium around the graft area led to the blackening of the microscion.     

Le groupe des « bisons adossés » de Lascaux. Étude de la technique de l'artiste par analyse des pigments

The painting matter of the “back to back bison's panel” of Lascaux was examined and analysed by electron microscopy in order to understand the know-how of Magdalenian artists. The observation of several samples coming from specific areas of the two bisons give an access to the nature of the used pigments, to the preparation mode used to obtain various colours and also to the application mode. Thanks to this physicochemical approach, we can make hypotheses about the mind and the gestures of the artists.     

Study of the enhancer-blocking activities of new boundaries in the <Emphasis Type="Italic">bithorax</Emphasis> complex of <Emphasis Type="Italic">Drosophila melanogaster</Emphasis>

It was shown earlier that the Mcp, Fab-7, and Fab-8 boundaries of the bithorax complex contain insulators that effectively block the enhancers of the yellow and white genes. Other boundaries have not been studied so far. The recent mapping of binding sites for the insulator protein dCTCF in the regulatory regions of the bithorax complex genes permitted the Fab-3, Fab-4, and Fab-6 boundaries to be localized. Here, we showed that, despite the presence of dCTCF-binding sites, fragments of the Fab-3, Fab-4, and Fab-6 boundaries do not exhibit the properties of insulators in the model system with the yellow and white genes. Moreover, in some regions of the genome the Fab-4 and Fab-6 boundaries display the properties of silencers.     

Expression of modified oxidase of D-aminoacids of <Emphasis Type="Italic">Trigonopsis variabilis</Emphasis> in methylotrophic yeasts <Emphasis Type="Italic">Pichia pastoris</Emphasis>

Effective recombinant strains Pichia pastoris that produce functionally active hybrid of Trigonopsis variabilis D-aminoacids bond with chitin-connecting domain of chitinase A1 of Bacillus circulans (DAOcbd) were obtained. The dependence of DAOcbd production levels from production of the number of copies of “expression cassette” integrated in the AOX1 locus of recombinant strains was studied. It was indicated that synthesized DAOcbd may be easily purified and immobilized on chitin sorbents and possessed high specific activity. Produced strains and methods of their cultivation and DAOcbd extraction may be used for development of technologies of obtaining of biocatalyzers in technological processes of obtaining of 7-aminocepha-losporane acid.