Salvaging Affymetrix probes after probe-level re-annotation
BMC Research Notes volume 1, Article number: 66 (2008)
Affymetrix GeneChips can be re-annotated at the probe-level by breaking up the original probe-sets and recomposing new probe-sets based on up-to-date genomic knowledge, such as available in Entrez Gene. This results in custom Chip Description Files (CDF). Using these custom CDFs improves the quality of the data and thus the results of related gene expression studies. However, 44–71% of the probes on a GeneChip are lost in this re-annotation process. Although generally aimed at less known genes, losing these probes obviously means a substantial loss of expensive experiment data. Biologists are therefore very reluctant to adopt this approach.
We aimed to re-introduce the non-affected Affymetrix probe-sets after these re-annotation procedures. For this, we developed an algorithm (CDF-Merger) and applied it to standard Affymetrix CDFs and custom Brainarray CDFs to obtain Hybrid CDFs. Thus, salvaging lost Affymetrix probes with our CDF-Merger restored probe content up to 94%. Because the salvaged probes (up to 54% of the probe content on the arrays) represent less-reliable probe-sets, we made the origin of all probe-set definitions traceable, so biologists can choose at any time in their analyses, which subset of probe-sets they want to use.
The availability of up-to-date Hybrid CDFs plus R environment allows for easy implementation of our approach.
Affymetrix GeneChips are widely used for transcriptome analysis. This microarray platform is based on the concept of a set of 11–22 probes representing each gene. However, the genomic knowledge used by Affymetrix for the original probe-set definitions becomes increasingly outdated. This compels the redefinition of these probe-sets at probe level using current genomic knowledge. Several studies addressed this issue [1–4]. In these approaches, the original probe-set definitions are discarded and all probes are recomposed into new probe-sets by mapping each probe via their sequence to unique genes available in one or more well-defined genomics resources (Entrez Gene, Refseq, Ensembl). The approaches differ with respect to the used genomic resources and genetic elements (genes or transcripts), as well as the chosen parameters, such as minimum number of probes per probe-set, percentage sequence similarity, and so on. In order to make these new probe-sets available to life scientists, new Affymetrix compatible custom Chip Description Files (CDFs) are produced that contain probe-sets, each consisting of a few to several hundreds probes.
Because these custom CDFs are based on the latest genomic knowledge, the newly defined probe-sets perform better in gene-profiling studies [5, 6] or allow for more reliable cross-platform comparison of gene expression . Also, since genes are uniquely represented in a custom CDF, bias towards genes represented by multiple probe-sets is avoided in gene-set enrichment. With these advantages, one would expect these probe re-annotation approaches to be readily embraced by the research community. Although there is an increasing interest for this issue, still a limited number of studies actually used such an approach [7–11]. One of the reasons might be that custom CDFs require a somewhat more advanced bioinformatics environments, both in software and expertise.
As we experience in practice, biologists do not accept the low percentages of probes left after re-annotation (Table 1). Given the costly nature of Affymetrix based experiments, they will not easily discard 44–71% of their data, even though they know that the quality of the annotation of these probe sets is poor. They want to keep these probes sets because commonly their studies are not focussed only on well-established genes, but also on the involvement of new (poorly-annotated) genes. Quite often even their favourite genes are absent in the custom CDFs. In fact, some biologists fix the loss of their favourite genes by reintroducing them using the old Affymetrix probe-set definition . This entails two separate, but redundant analyses that are difficult to compare. This motivated us to merge these two analyses from the start, by salvaging as many probe-sets as possible that are lost during probe re-annotation. To illustrate our point, in the study described in , a number of genes involved in epileptogenic development, such as Kncd2, a Potassium channel protein and CD11b/c (OX42), a marker for microglial activation are absent in the Brainarray CDF. These genes were added to the analyses and proved to be important in the biological study at hand. Currently, analyses of several Affymetrix experiments are in progress using our Hybrid CDFs.
Here we present a procedure, CDF-Merger, to formally compose such hybrid probe-set definitions based on the Brainarray approach by . Thus, we generate Hybrid CDFs in which Entrez gene defined genes are uniquely represented and probe usage is maximized by reusing the information provided by Affymetrix, as long as there is no conflict with the Brainarray probe-sets. Given the difference in annotation quality between custom CDF annotation and original Affymetrix annotation, we made the origin of probe-set definitions in the Hybrid CDFs traceable by extensions on probe-set ids. In this way, biologist can choose at any time during their analysis which gene set they would like to use. Hybrid CDFs are Entrez based, i.e. gene-centric. If at some point in the analysis, a more transcript-centric approach is needed, tools such as ADAPT  can be used to link identifiers in the Hybrid CDF by their Affymetrix or Entrez Gene IDs via Ensembl to their transcripts.
Hybrid probe-set definitions are generated using Brainarray CDFs , Affymetrix NetAffx Annotation Files, and NCBI Entrez Gene Info Files. The original procedure to generate custom Brainarray Entrez probe sets entails the mapping of each -perfect match- Affymetrix probe to the appropriate Entrez Gene annotated target sequences. Probes with more than one or no perfect hits are removed and each final probe set must contain at least three probes .
The following CDF-Merger algorithm aims to salvage a maximum number of probes from Affymetrix GeneChips that are lost by Brainarray re-annotation:
a. Rename the Brainarray defined probe-sets from a specific Brainarray CDF to allow future traceability: Hybrid probe-set id: atd_ [Entrez id]
b. Check each Brainarray defined probe-set for probes also present in other Brainarray probe-sets. If so, mark such a probe-set with extension _d.
c. Keep the Affymetrix defined probe-set names from the relevant Affymetrix NetAffx Annotation File to allow future traceability: Hybrid probe-set id: AFFX-* or *_at (= original Affymetrix id)
d. Check each Affymetrix defined probe-set and discard those with more than two probes that are also used in the Brainarray probe-sets.
e. Check if in the remaining probe-sets from step d, one or two probes are also used in Brainarray probe-sets. If so, keep the probe-set but remove these probes. If so, mark the Hybrid probe-set _1 or _2, respectively.
f. Use the NCBI Entrez Gene Info File to check if in the Affymetrix NetAffx Annotation file, the remaining Affymetrix probe-sets have exactly one valid Entrez id. If not, remove all Entrez ids from the annotation of these Affymetrix probe-sets.
g. Check whether the Entrez id of the remaining Affymetrix probe-sets with one valid Entrez id also occurs in the Brainarray CDF. If so, remove this Entrez id from the annotation of these Affymetrix probe-sets.
h. Rename all Affymetrix probe-sets retained in steps f and g, to allow future traceability: Hybrid probe-set id: atm_ [Entrez id]
i. Merge the Affymetrix probe-sets from step h with the same Entrez id. Mark merged probe-sets with extension _m.
j. Compile a Hybrid CDF and R environment with these hybrid probe-set definitions and associated annotations.
A flowchart of this CDF-Merger algorithm can be found in supplementary information (Figure 1). The Hybrid CDFs, the source code of the CDF-Merger algorithm, and instructions on use of these environments in R are online available.
The motivation for the development of our CDF-Merger algorithm and the resulting Hybrid CDFs, came from complaints of biologists that disliked the high percentages of Affymetrix GeneChip probes lost during re-annotation. To illustrate their point, we compared probe usage of two recently published re-annotation algorithms for five commonly used Affymetrix GeneChips (Table 1). In the listed alternative probe-set definitions, the amount of data at the probe level is dramatically decreased compared to the original Affymetrix probe-set definitions, because 44% to 71% of probes are discarded. In contrast, because we salvage the far majority of lost probes with our CDF-Merger approach, ultimately only 6% to 12% of all probes are discarded. These mostly represent probes from Affymetrix defined probe-sets for genes that are already covered by Brainarray defined probe sets. The source code of the CDF-Merger algorithm, definition origin, and probe-set sizes in all Hybrid CDFs [see Additional File 1 Table S1], a table of probe distribution [see Additional File 2 Table S2] are online available and allow easy updating of the Hybrid CDFs. Although we based our CDF-Merger algorithm on the Brainarray re-annotation, our approach is, with minor adjustments, also applicable to the AffyProbeMiner and GeneAnnot reannotations.
It is obvious that re-introducing Affymetrix probe-sets will dilute the data quality enhancement from the original custom re-annotation procedures, which are based on up-to-date genomic knowledge. However, our hybrid approach, which is in essence a practical compromise, aims to get the concept of re-annotated probe-sets more widely accepted in the biology community. For this, we made the whole CDF-Merger algorithm traceable, so it is clear where each probe-set originates from. As such, biologists and bioinformaticians can decide at any time during their extensive bioinformatics analyses whether they would like to use a) limited, but well-established data, or b) all data, which contains more ambiguity, but also more unknown genes and transcripts. The impact of using the Hybrid CDFs strongly depends on the character of a microarray study and the applied bioinformatics analysis methods. Altogether, we think that our hybrid CDF-Merger approach, which salvages most lost probes after probe-level re-annotation, combines the best of both worlds to enable the often discovery-driven omics experimentation.
Availability and requirements
Project name: Hybrid CDF
Project home page: http://mad-db.science.uva.nl/~wdeleeuw/HybridAnnot/
Programming language: R
Other requirements: BioConductor affy library
CDF files, R cdf environments, R annotation environments: http://mad-db.science.uva.nl/~wdeleeuw/HybridAnnot/version5.html
All files will be updated after Brainarray release.
Dai M, Wang P, Boyd AD, Kostov G, Athey B, Jones EG, Bunney WE, Myers RM, Speed TP, Akil H, Watson SJ, Meng F: Evolving gene/transcript definitions significantly alter the interpretation of GeneChip data. Nucleic Acids Res. 2005, 33 (20): e175-10.1093/nar/gni179.
Ferrari F, Bortoluzzi S, Coppe A, Sirota A, Safran M, Shmoish M, Ferrari S, Lancet D, Danieli GA, Bicciato S: Novel definition files for human GeneChips based on GeneAnnot. BMC Bioinformatics. 2007, 8 (1): 446-10.1186/1471-2105-8-446.
Liu H, Zeeberg BR, Qu G, Koru AG, Ferrucci A, Kahn A, Ryan MC, Nuhanovic A, Munson PJ, Reinhold WC, Kane DW, Weinstein JN: AffyProbeMiner: a web resource for computing or retrieving accurately redefined Affymetrix probe sets. Bioinformatics. 2007, 23 (18): 2385-2390. 10.1093/bioinformatics/btm360.
Carter SL, Eklund AC, Mecham BH, Kohane IS, Szallasi Z: Redefinition of Affymetrix probe sets by sequence overlap with cDNA microarray probes reduces cross-platform inconsistencies in cancer-associated gene expression measurements. BMC Bioinformatics. 2005, 6: 107-10.1186/1471-2105-6-107.
Lu X, Zhang X: The effect of GeneChip gene definitions on the microarray study of cancers. Bioessays. 2006, 28 (7): 739-746. 10.1002/bies.20433.
Sandberg R, Larsson O: Improved precision and accuracy for microarrays using updated probe set definitions. BMC Bioinformatics. 2007, 8: 48-10.1186/1471-2105-8-48.
Carroll JS, Meyer CA, Song J, Li W, Geistlinger TR, Eeckhoute J, Brodsky AS, Keeton EK, Fertuck KC, Hall GF, Wang Q, Bekiranov S, Sementchenko V, Fox EA, Silver PA, Gingeras TR, Liu XS, Brown M: Genome-wide analysis of estrogen receptor binding sites. Nat Genet. 2006, 38 (11): 1289-1297. 10.1038/ng1901.
Zuo T, Wang L, Morrison C, Chang X, Zhang H, Li W, Liu Y, Wang Y, Liu X, Chan MW, Liu JQ, Love R, Liu CG, Godfrey V, Shen R, Huang TH, Yang T, Park BK, Wang CY, Zheng P, Liu Y: FOXP3 is an X-linked breast cancer suppressor gene and an important repressor of the HER-2/ErbB2 oncogene. Cell. 2007, 129 (7): 1275-1286. 10.1016/j.cell.2007.04.034.
Ozsolak F, Song JS, Liu XS, Fisher DE: High-throughput mapping of the chromatin structure of human promoters. Nat Biotechnol. 2007, 25 (2): 244-248. 10.1038/nbt1279.
Gorter JA, van Vliet EA, Aronica E, Breit T, Rauwerda H, Lopes da Silva FH, Wadman WJ: Potential new antiepileptogenic targets indicated by microarray analysis in a rat model for temporal lobe epilepsy. J Neurosci. 2006, 26 (43): 11083-11110. 10.1523/JNEUROSCI.2766-06.2006.
Carter SL, Eklund AC, Kohane IS, Harris LN, Szallasi Z: A signature of chromosomal instability inferred from gene expression profiles predicts clinical outcome in multiple human cancers. Nat Genet. 2006, 38 (9): 1043-1048. 10.1038/ng1861.
Leong HS, Yates T, Wilson C, Miller CJ: ADAPT: a database of affymetrix probesets and transcripts. Bioinformatics. 2005, 21 (10): 2552-2553. 10.1093/bioinformatics/bti359.
Brainarray CDFs. [http://brainarray.mbni.med.umich.edu/Brainarray/Database/CustomCDF]
Affymetrix NetAffx Annotation Files. [http://www.affymetrix.com/support/technical/annotationfilesmain.affx]
NCBI Entrez Gene Info Files. [ftp://ftp.ncbi.nih.gov/gene/DATA]
We acknowledge Drs R. Monajemi for his contribution to this project. This work was carried out in the context of: the Virtual Laboratory e-Science project http://www.vl-e.nl supported by a BSIK grant from the Dutch Ministry of Education, Culture and Science (OC&W) and the ICT innovation program of the Ministry of Economic Affairs (EZ); and BioRange program of the Netherlands Bioinformatics Centre (NBIC) supported by a BSIK grant through the Netherlands Genomics Initiative (NGI); and by Technologiestichting STW grant LGC.6935.
The authors declare that they have no competing interests.
WdL specified and implemented the CDF-Merger algorithm.
HR, MJ and TB all worked on the specification of the CDF-Merger algorithm and adapted it by discussing applicability of it with biologists.
The authors wish it to be known that, in their opinion, WdL and HR should be regarded as joint First Authors.
Authors’ original submitted files for images
Below are the links to the authors’ original submitted files for images.
About this article
Cite this article
de Leeuw, W.C., Rauwerda, H., Jonker, M.J. et al. Salvaging Affymetrix probes after probe-level re-annotation. BMC Res Notes 1, 66 (2008). https://doi.org/10.1186/1756-0500-1-66