Experimental comparison and cross-validation of Affymetrix HT plate and cartridge array gene expression platforms

The successful use of gene expression microarrays in basic research studies has spawned interest in the use of this technology for clinical trial and population-based studies, but cost, complexity of sample processing and tracking, and limitations of sample throughput have restricted their use for these very large-scale investigations. The Affymetrix GeneChip Plate Array System addresses these concerns and could facilitate larger studies if the data prove to be comparable to industry-standard cartridge arrays. Here we present a comparative evaluation of performance between Affymetrix GeneChip Human 133A cartridge and plate arrays with an emphasis on the assessment of systematic variation and its impact on log ratio data. This study utilized two standardized control RNAs on four independent lots of plate and cartridge arrays. We found that HT plate arrays showed improved specificity and were more reproducible over a wide intensity range, but cartridge arrays exhibit better sensitivity. Not surprisingly, artifactual changes due to positional effects were detectable on plate arrays, but were generally small in number and magnitude and in practice may be removed using standard fold-change and p-value thresholds. Overall, log ratio data between cartridges and plate arrays were remarkably concordant. We conclude that HT arrays offer significant improvements over cartridge arrays for large-scale studies.     

A comparison of cDNA, oligonucleotide, and Affymetrix GeneChip gene expression microarray platforms.

We have conducted a study to compare the variability in measured gene expression levels associated with three types of microarray platforms. Total RNA samples were obtained from liver tissue of four male mice, two each from inbred strains A/J and C57BL/6J. The same four samples were assayed on Affymetrix Mouse Genome Expression Set 430 GeneChips (MOE430A and MOE430B), spotted cDNA microarrays, and spotted oligonucleotide microarrays using eight arrays of each type. Variances associated with measurement error were observed to be comparable across all microarray platforms. The MOE430A GeneChips and cDNA arrays had higher precision across technical replicates than the MOE430B GeneChips and oligonucleotide arrays. The Affymetrix platform showed the greatest range in the magnitude of expression levels followed by the oligonucleotide arrays. We observed good concordance in both estimated expression level and statistical significance of common genes between the Affymetrix MOE430A GeneChip and the oligonucleotide arrays. Despite their apparently high precision, cDNA arrays showed poor concordance with other platforms.     

A comparison of Affymetrix gene expression arrays

Background  

Affymetrix GeneChips™ are an important tool in many facets of biological research. Recently, notable design changes to the chips have been made. In this study, we use publicly available data from Affymetrix to gauge the performance of three human gene expression arrays: Human Genome U133 Plus 2.0 (U133), Human Exon 1.0 ST (HuEx) and Human Gene 1.0 ST (HuGene).     

GenePicker: replicate analysis of Affymetrix gene expression microarrays

SUMMARY: GenePicker allows efficient analysis of Affymetrix gene expression data performed in replicate, through definition of analysis schemes, data normalization, t-test/ANOVA, Change-Fold Change-analysis and yields lists of differentially expressed genes with high confidence. Comparison of noise and signal analysis schemes allows determining a signal-to-noise ratio in a given experiment. Change Call, Fold Change and Signal mean ratios are used in the analysis. While each parameter alone yields gene lists that contain up to 30% false positives, the combination of these parameters nearly eliminates the false positives as verified by northern blotting, quantitative PCR in numerous independent experiments as well as by the analysis of spike-in data. AVAILABILITY: http://www.ifom-firc.it/RESEARCH/Appl_Bioinfo/tools.html. SUPPLEMENTARY INFORMATION: http://www.ifom-firc.it/RESEARCH/Appl_Bioinfo/tools.html.     

Ultra-high-throughput microbial community analysis on the Illumina HiSeq and MiSeq platforms

DNA sequencing continues to decrease in cost with the Illumina HiSeq2000 generating up to 600 Gb of paired-end 100 base reads in a ten-day run. Here we present a protocol for community amplicon sequencing on the HiSeq2000 and MiSeq Illumina platforms, and apply that protocol to sequence 24 microbial communities from host-associated and free-living environments. A critical question as more sequencing platforms become available is whether biological conclusions derived on one platform are consistent with what would be derived on a different platform. We show that the protocol developed for these instruments successfully recaptures known biological results, and additionally that biological conclusions are consistent across sequencing platforms (the HiSeq2000 versus the MiSeq) and across the sequenced regions of amplicons.     

Improving identification of differentially expressed genes by integrative analysis of Affymetrix and Illumina arrays

Together with the widely used Affymetrix microarrays, the recently introduced Illumina platform has become a cost-effective alternative for genome-wide studies. To efficiently use data from both array platforms, there is a pressing need for methods that allow systematic integration of multiple datasets, especially when the number of samples is small. To address these needs, we introduce a meta-analytic procedure for combining Affymetrix and Illumina data in the context of detecting differentially expressed genes between the platforms. We first investigate the effect of different expression change estimation procedures within the platforms on the agreement of the most differentially expressed genes. Using the best estimation methods, we then show the benefits of the integrative analysis in producing reproducible results across bootstrap samples. In particular, we demonstrate its biological relevance in identifying small but consistent changes during T helper 2 cell differentiation.     

Standardizing global gene expression analysis between laboratories and across platforms

To facilitate collaborative research efforts between multi-investigator teams using DNA microarrays, we identified sources of error and data variability between laboratories and across microarray platforms, and methods to accommodate this variability. RNA expression data were generated in seven laboratories, which compared two standard RNA samples using 12 microarray platforms. At least two standard microarray types (one spotted, one commercial) were used by all laboratories. Reproducibility for most platforms within any laboratory was typically good, but reproducibility between platforms and across laboratories was generally poor. Reproducibility between laboratories increased markedly when standardized protocols were implemented for RNA labeling, hybridization, microarray processing, data acquisition and data normalization. Reproducibility was highest when analysis was based on biological themes defined by enriched Gene Ontology (GO) categories. These findings indicate that microarray results can be comparable across multiple laboratories, especially when a common platform and set of procedures are used.     

Unifying gene expression measures from multiple platforms using factor analysis

In the Cancer Genome Atlas (TCGA) project, gene expression of the same set of samples is measured multiple times on different microarray platforms. There are two main advantages to combining these measurements. First, we have the opportunity to obtain a more precise and accurate estimate of expression levels than using the individual platforms alone. Second, the combined measure simplifies downstream analysis by eliminating the need to work with three sets of expression measures and to consolidate results from the three platforms.We propose to use factor analysis (FA) to obtain a unified gene expression measure (UE) from multiple platforms. The UE is a weighted average of the three platforms, and is shown to perform well in terms of accuracy and precision. In addition, the FA model produces parameter estimates that allow the assessment of the model fit.The R code is provided in File S2. Gene-level FA measurements for the TCGA data sets are available from http://tcga-data.nci.nih.gov/docs/publications/unified_expression/.     

Analysis of dose-response effects on gene expression data with comparison of two microarray platforms

MOTIVATION: The problems of analyzing dose effects on gene expression are gaining attention in biomedical research. A specific challenge is to detect genes with expression levels that change according to dose levels in a non-random manner, but nonetheless may be considered as potential biomarkers. METHOD: We are among the first to formally apply a tool that uses an isotonic (monotonic) regression approach to this area of study. We introduce a test statistic to select genes with significant dose-response expression in a monotonic fashion based on a permutation procedure. We then compare the results with those achieved from the application of a likelihood ratio-based test. RESULTS: We apply the isotonic regression approach to a study of gene expression in the RKO colon carcinoma cell line in response to varying dosage levels of the chemotherapeutic agent 5-fluorouracil. A feature of both Affymetrix and printed 75mer oligomer cDNA arrays produced from the same samples provides an opportunity to compare the two microarray platforms. AVAILABILITY: Statistical software S-plus Code to implement the method is available from the authors. CONTACT: kcoombes@mdanderson.org     

FGX: a frequentist gene expression index for Affymetrix arrays

We consider a new frequentist gene expression index for Affymetrix oligonucleotide DNA arrays, using a similar probe intensity model as suggested by Hein and others (2005), called the Bayesian gene expression index (BGX). According to this model, the perfect match and mismatch values are assumed to be correlated as a result of sharing a common gene expression signal. Rather than a Bayesian approach, we develop a maximum likelihood algorithm for estimating the underlying common signal. In this way, estimation is explicit and much faster than the BGX implementation. The observed Fisher information matrix, rather than a posterior credibility interval, gives an idea of the accuracy of the estimators. We evaluate our method using benchmark spike-in data sets from Affymetrix and GeneLogic by analyzing the relationship between estimated signal and concentration, i.e. true signal, and compare our results with other commonly used methods.     

Importance of randomization in microarray experimental designs with Illumina platforms

Measurements of gene expression from microarray experiments are highly dependent on experimental design. Systematic noise can be introduced into the data at numerous steps. On Illumina BeadChips, multiple samples are assayed in an ordered series of arrays. Two experiments were performed using the same samples but different hybridization designs. An experiment confounding genotype with BeadChip and treatment with array position was compared to another experiment in which these factors were randomized to BeadChip and array position. An ordinal effect of array position on intensity values was observed in both experiments. We demonstrate that there is increased rate of false-positive results in the confounded design and that attempts to correct for confounded effects by statistical modeling reduce power of detection for true differential expression. Simple analysis models without post hoc corrections provide the best results possible for a given experimental design. Normalization improved differential expression testing in both experiments but randomization was the most important factor for establishing accurate results. We conclude that lack of randomization cannot be corrected by normalization or by analytical methods. Proper randomization is essential for successful microarray experiments.     

Three microarray platforms: an analysis of their concordance in profiling gene expression

Background

Bacillus cereus, Bacillus anthracis and Bacillus thuringiensis belong to the genetically close-knit Bacillus cereus sensu lato group, a family of rod-shaped Gram-positive bacteria. pAW63 is the first conjugative plasmid from the B. cereus group to be completely sequenced.

Results

The 71,777 bp nucleotide sequence of pAW63 reveals a modular structure, including a 42 kb tra region encoding homologs of the Type IV secretion systems components VirB11, VirB4 and VirD4, as well as homologs of Gram-positive conjugation genes from Enterococcus, Lactococcus, Listeria, Streptococcus and Staphylococcus species. It also firmly establishes the existence of a common backbone between pAW63, pXO2 from Bacillus anthracis and pBT9727 from the pathogenic Bacillus thuringiensis serovar konkukian strain 97-27. The alignment of these three plasmids highlights the presence of well conserved segments, in contrast to distinct regions of high sequence plastiCity. The study of their specific differences has provided a three-point reference framework that can be exploited to formulate solid hypotheses concerning the functionalities and the molecular evolution of these three closely related plasmids. This has provided insight into the chronology of their divergence, and led to the discovery of two Type II introns on pAW63, matching copies of the mobile element IS231L in different loci of pXO2 and pBT9727, and the identification on pXO2 of a 37 kb pathogeniCity island (PAI) containing the anthrax capsule genes.

Conclusion

The complete sequence determination of pAW63 has led to a functional map of the plasmid yielding insights into its conjugative apparatus, which includes T4SS-like components, as well as its resemblance to other large plasmids of Gram-positive bacteria. Of particular interest is the extensive homology shared between pAW63 and pXO2, the second virulence plasmid of B. anthracis, as well as pBT9727 from the pathogenic strain B. thuringiensis serovar konkukian strain 97-27.     

Principal component analysis-based filtering improves detection for Affymetrix gene expression arrays

Gene expression array technology has reached the stage of being routinely used to study clinical samples in search of diagnostic and prognostic biomarkers. Due to the nature of array experiments, which examine the expression of tens of thousands of genes simultaneously, the number of null hypotheses is large. Hence, multiple testing correction is often necessary to control the number of false positives. However, multiple testing correction can lead to low statistical power in detecting genes that are truly differentially expressed. Filtering out non-informative genes allows for reduction in the number of null hypotheses. While several filtering methods have been suggested, the appropriate way to perform filtering is still debatable. We propose a new filtering strategy for Affymetrix GeneChips®, based on principal component analysis of probe-level gene expression data. Using a wholly defined spike-in data set and one from a diabetes study, we show that filtering by the proportion of variation accounted for by the first principal component (PVAC) provides increased sensitivity in detecting truly differentially expressed genes while controlling false discoveries. We demonstrate that PVAC exhibits equal or better performance than several widely used filtering methods. Furthermore, a data-driven approach that guides the selection of the filtering threshold value is also proposed.     

Revisiting adverse effects of cross-hybridization in Affymetrix gene expression data: do they matter for correlation analysis?

Background.  

This work was undertaken in response to a recently published paper by Okoniewski and Miller (BMC Bioinformatics 2006, 7: Article 276). The authors of that paper came to the conclusion that the process of multiple targeting in short oligonucleotide microarrays induces spurious correlations and this effect may deteriorate the inference on correlation coefficients. The design of their study and supporting simulations cast serious doubt upon the validity of this conclusion. The work by Okoniewski and Miller drove us to revisit the issue by means of experimentation with biological data and probabilistic modeling of cross-hybridization effects.