 Technical Note
 Open Access
 Published:
Using GeneReg to construct time delay gene regulatory networks
BMC Research Notes volume 3, Article number: 142 (2010)
Abstract
Background
Understanding gene expression and regulation is essential for understanding biological mechanisms. Because gene expression profiling has been widely used in basic biological research, especially in transcription regulation studies, we have developed GeneReg, an easytouse R package, to construct gene regulatory networks from time course gene expression profiling data; More importantly, this package can provide information about time delays between expression change in a regulator and that of its target genes.
Findings
The R package GeneReg is based on time delay linear regression, which can generate a model of the expression levels of regulators at a given time point against the expression levels of their target genes at a later time point. There are two parameters in the model, time delay and regulation coefficient. Time delay is the time lag during which expression change of the regulator is transmitted to change in target gene expression. Regulation coefficient expresses the regulation effect: a positive regulation coefficient indicates activation and negative indicates repression. GeneReg was implemented on a real Saccharomyces cerevisiae cell cycle dataset; more than thirty percent of the modeled regulations, based entirely on gene expression files, were found to be consistent with previous discoveries from known databases.
Conclusions
GeneReg is an easytouse, simple, fast R package for gene regulatory network construction from short time course gene expression data. It may be applied to study timerelated biological processes such as cell cycle, cell differentiation, or causal inference.
Background
With the rapid development of microarray technology, more and more short time course gene expression data have been generated; with such abundant highthroughput screening data available, researchers have tried to infer, or reverseengineer, gene networks. In general, the existing models for network inference can be grouped into three categories: logical models, continuous models and singlemolecule level models [1]. Logical models such as Boolean networks and Petri nets could represent the network structure but are unable to describe dynamic processes. While singlemolecule level models such as stochastic simulation algorithm could provide high resolution modeling and analysis, but only on limited molecules with wellknown reactions among them. Singlemolecule level models are not suitable for large scale regulatory network reconstruction. There were several widelyused general algorithms for network inference, such as informationtheoretic approaches, Bayesianbased models, and ordinary differential equations [2]. Many of them belong to the continuous models. There may be other models which could integrate prior knowledge to improve the performance, but we only considered the ab initio network inference approaches here as prior knowledge is able to be integrated into most de novo network reconstruction methods easily.
The most well known software of informationtheoretic approaches for gene network inference is ARACNE [3, 4]. The informationtheoretic approach was first proposed by Butte and Kohane [5], with their relevance network algorithm. Informationtheoretic approaches use mutual information to compare expression profiles from a set of microarrays. The definition of mutual information requires each experiment to be statistically independent from the others. Thus, informationtheoretic approaches can deal with steadystate gene expression data or with timeseries data given that the sampling interval is long enough to assume that each point is independent of the previous points. This assumption, however, does not hold for most biological time series datasets, because the interval between measured time points is usually short. In many cases, biologists actually want to see the connections between events happening at an earlier time point and those at a later one, rather than looking at isolated time points.
Banjo is a representative gene network inference software based on Bayesian network formalism [6]. Because Banjo implements both Bayesian and dynamic Bayesian networks, it can infer gene networks from steadystate gene expression data or from timeseries gene expression data. In Banjo, heuristic approaches are used to search the network space to find the network graph G, which requires large datasets in which the number of genes is much smaller than the number of experiments. In most gene expression datasets, however, the number of genes is much larger than the number of experiments.
Ordinary differential equations (ODEs) based reverseengineering algorithms relate changes in gene transcript concentration to each other and to an external perturbation. To reverseengineer a network using ODEs requires selection of an ODE function and estimation of unknown parameters from gene expression data using some optimization technique. ODEbased approaches yield directed graphs and can be applied to both steadystate and timeseries expression profiles, but they are often very complex and slow, and do not provide insight into the biological meanings of each parameter.
To address the limitations of existing approaches for gene regulatory network construction from short time course gene expression data, we have developed an easytouse, simple, and fast R package: GeneReg. GeneReg is based on a time delay linear regression model, which is similar to Kim's ordinary differential equation[7]. The function used in this model, however, is a linear function with two parameters, time delay and the regulation coefficient. Time delay is the time required to transmit change in regulator gene expression to change in target gene expression. The regulation coefficient represents the regulation effect: a positive coefficient indicates activation and negative indicates repression.
The most important improvement of our model was the time delay of each regulator can be exactly calculated and different regulators could have different time delays. Time delay is an important concept in biological regulatory mechanisms, especially for transcription factors. As we known, transcription factor could only regulate its target genes in protein form but in microarrays studies, the measured abundance of transcription factor is its mRNA expression level. The mRNA of transcription factor must be translated into protein and then the proteins of transcription factor regulate the expression of downstream genes. There is a time delay from the mRNA of transcription factor being generated to the actual regulation of transcription factor. What's more, time delay is an almost unmeasureable variable by traditional experiments as there were too many unclear processes during translation and the factors which could affect the process were unpredictable. The time delay calculated in our model provided a higher level estimation of this important but unmeasureable biological variable.
The biological meanings of the two parameters in our model are both clear and important for understanding gene regulatory mechanisms. As the linear model is simple and the forward selection optimization of parameters is easy to compute, GeneReg is much faster than similar software and could be used in deciphering genomewide gene regulatory networks. Our models do not require prior knowledge about regulatory mechanisms, although prior knowledge could be integrated, for example if certain regulators were already known to regulate the target gene, they could be added into the model first. The model with time delay and regulation coefficient can be used to obtain qualitative insights about regulatory networks and discovery novel regulations. This linear model assumption may ignore parts of the nonlinear regulations, but it allows a high level of abstraction and efficient inference of network structure and regulation functions. When higher resolution to detailed regulatory relationship is desired, the linear model can be replaced with more complex nonlinear models, such as mass action models or Hill models[8].
GeneReg was implemented on a real Saccharomyces cerevisiae cell cycle dataset. The results were found to reflect known dynamic expression profiles, with 32.45% of the regulations modeled in wild type cells and 32.61% of regulations in cyclin mutant cells consistent with what can be found in the YEASTRACT and/or STRING databases. These are fairly good results, considering that our large scale gene network construction was only based on a single small time series gene expression dataset [9].
Results and Discussion
Time delay linear regression model
The model is based on a linear regression of the expression levels of regulators at time t  Δt against the expression level of their target genes at time t. Δt is the time delay between expression of transcription factors and expression of downstream genes, and can differ from gene to gene.
Suppose we have a set of time course data covering time points T_{1}, T_{2},..., T_{ k }, and target gene g is regulated by n regulators tf_{1}, tf_{2},..., tf_{ n }in a linear manner. These relationships can be formulized as below:
where (g) is the relative expression level of target gene g at time point t_{ g }to the baseline, is the relative expression level of tf_{ i }at time point t_{ g } Δt_{ i }, Δt_{ i }, is the time delay of tf_{ i }'s regulation to gene g, and a_{ i }is the regression coefficient of tf_{ i }.
Computational algorithm
Our method aims to select a set of possible regulators with certain time delays to estimate the dynamic expression pattern of a target gene. The method uses an AIC (Akaike information criterion) [10] model selection criteria with forward selection to iteratively add possible regulators from the candidate pool. AIC, which describes the tradeoff between model complexity and the estimated residual variance, is defined as
where k_{ p }is the number of parameters in the statistical model, and L is the maximized value of the likelihood function for the estimated model. AIC increases as the number of parameters increase and decreases as the residual variance decreases. The smaller AIC indicates better model.
In practical computation, it is timeconsuming to compute the AIC statistics for all possible regression models. Forward selection method [11] was used to avoid the complexity of exhaustive search. As one of the greedy optimization method, in forward selection, a variable once included can never be removed [11]. The model optimized by forward selection method may be not the best, but it is an acceptable compromise with fast speed and good performance. What's more, in specific condition, the regulators of one target gene couldn't be as much as the database suggested, or as complex as the mixture of all known mechanism and identifying the key regulators first will at least guarantee that the major regulations wouldn't be missed.
The model's explanatory ability is evaluated by adjusted R^{2} [12]. Adjusted R^{2} is an improved R^{2} that adjusts for the number of explanatory terms in a model. The adjusted R^{2} is defined as
where n_{ r }is the number of regulators in the linear model, and k_{ s }is sample size
The computational procedure of our method can be summarized as following:
1) Sorting the regulators based on their relevance with target gene
The goal of this procedure was to filter the irrelevant regulators first and sort the regulators according to their importance to the regulation. To each regulator, all possible time delays were traversed and the adjusted R^{2} of best single regulator regression model with smallest AIC was calculated. Regulators didn't meet a prespecified adjusted R^{2} cutoff were considered as irrelevant with the target gene and were filtered. The left M regulators were sorted according to their smallest AICs.
After the preevaluation procedure, a regulator set S is provided:
The index reflects the evaluations for regulator. For example, If a < b, tf_{ a }has smaller AIC than tf_{ b }and tf_{ a }is considered to be better than tf_{ b }.
2) Regulation model optimization with forward selection of regulators and time delays
Step one can only provide a list of relevant regulators by sorting them according to their importance to the regulation, but it is still unknown which fore regulators in the list should be selected to establish the time delay regression model. The best fore regulators are selected by testing all possible top regulator sets, and choosing the regulator set that can achieve the smallest AIC with forward selection. The forward selection procedure was illustrated in Figure 1.
The possible regulator subset s_{ i }can be expressed using the following equation:
The initial regulator subset is .
The selected regulator set with m regulators is defined as , the S indexes of regulators in Ω_{ s }are . The tobeselected regulator set with n regulators is defined as and the S indexes of regulators in Ω_{ t }are .
In the forward selection procedure [13], each regulator in Ω_{ t }will be successively tested whether it can be added into Ω_{ s }. During each test process, the time delays of Ω_{ s }are held the same. All possible time delays of the regulator in Ω_{ t }with smallest S index that is are traversed, and the time delay of which achieves the smallest AIC of is considered as the optimal time delay of . This smallest AIC of is then compared with the AIC of original . If will be moved from Ω_{ t }to Ω_{ s }. Otherwise, will be eliminated from Ω_{ t }. In next round, the new regulator in Ω_{ t }with smallest S index will be tested until Ω_{ t }is empty.
After all M  1 regulators have been tested to add into the initial regulator subset the optimized time delay regression model was established which not only have the optimal regulators but also their corresponding optimal time delays. At the end of the whole process, the adjusted R^{2} of this final optimized model was calculated. If the adjusted R^{2} meets prespecified criteria, it suggests the optimized time delay model could explain this target gene's expression pattern and is applicable. Otherwise, this target gene's expression pattern can't be explained by our time delay linear regression model and maybe other more complex nonlinear models are needed.
Implementation
Yeast cell cycle dataset
To evaluate our approach on biological time course gene expression data, we applied the method to Saccharomyces cerevisiae cell cycle data publicly available at GEO http://www.ncbi.nlm.nih.gov/geo with accession number GSE8799. The dataset includes the gene expression profiles of wild type cells and cyclin mutant cells at 15 time points during two cell cycles and each genotype has two replicates with different 15 time points on life line. In our study, we merged the two replicates of each genotype based on their life lines and then there were 30 time points for wild type cells and cyclin mutant cells. 1271 periodic genes which were defined in Orlando's work[14] and considered as cell cycle related genes formed the list of target genes and their regulations were analyzed. A candidate pool of potential regulators which included 35 transcription factors was constructed by intersecting the 1271 periodic genes with all transcription factors in the YEASTRACT database [15, 16]http://www.yeastract.com/.
Time delay linear model
First, the data were transformed to a log_{2} ratio scale. The expression level of the first time point was taken as baseline. The gene expression level at each time point subtracted the baseline to get the relative expression level. Then B spline interpolation [17] was applied to expand the original 30 time points to 100 time points.
Time delay linear models then were constructed based on the interpolated expression data and candidate pool of regulators, with the adjusted R^{2} cutoff for single regulator regression and multiple regulator regression set at 0.8 and 0.9. Additional files 1 and 2 give the time delay models of wild type cells and cyclin mutant cells, respectively.
As an example, Figure 2 shows the time delay linear regression model of the HO gene in wild type cells. HO encodes an endonuclease responsible for initiating matingtype switching, a process in which MATa cells change to MATalpha cells or vice versa. This process is controlled by Swi4pSwi6p, Swi5p, and Ash1p according to the Saccharomyces Genome Database (SGD) [18]. In our model, we found ASH1, TEC1, and SWI5 to be the mostly likely regulators of HO.
Finally, the whole regulatory network was plotted based on the series of time delay linear models. Additional files 3 and 4 give the time delay network of wild type cells and cyclin mutant cells, respectively.
Comparison with YEASTRACT and STRING
To evaluate the performance of the gene regulatory networks constructed based on time delay linear models, we generated a reference network from the YEASTRACT [15, 16] and STRING [19] databases. YEASTRACT is a curated database of regulatory associations between transcription factors and target genes in Saccharomyces cerevisiae, based on the literature. STRING is a database that quantitatively integrates direct (physical) and indirect (functional) associations from different sources. We found that 32.45% of our modeled regulations in wild type cells and 32.61% of regulations in cyclin mutant cells were consistent with YEASTRACT or STRING, a fair result for largescale gene network construction based on a single small gene expression dataset [9].
The above prediction accuracies were calculated based on the data presented in additional files 5 and 6. The last two columns of each file compare the modeled regulations in wild type (Additional file 5) and cyclin mutant (Additional file 6) cells against data found in YEASTRACT or STRING. In these columns, 1 indicates consistency with the database, 0 indicates inconsistency when the regulator and target gene are included in the database, and NA indicates the database does not include the regulator or target gene. Regulations consistent with either the YEASTRACT database or STRING database (1 in either column) were considered as true, while regulations consistent or inconsistent with either the YEASTRACT database or STRING database (0 or 1 in either column) were considered as total regulations. (Regulations with NA in both the YEASTRACT database and STRING database were excluded from accuracy calculation.) Prediction accuracy was defined as the number of true regulations divided by the number of total regulations.
The above comparison was on the probe level. Figure 3 shows the overlap of total predicted regulations with YEASTRACT and STRINGdocumented regulations at the open reading frame (ORF) level in both wild type cells and cyclin mutant cells.
The activity of transcription factors is an important factor for gene regulation. As many transcription factors are posttranslationally controlled, their activity cannot always be observed directly by measuring changes in their mRNA expression level. Additionally, certain conditionspecific regulators vary with different perturbations; for example, many regulatory relationships differ between wild type and cyclin mutant cell networks. All of these issues affect the overlap of our network with that documented in the known databases. In general, there is no final or best network, only a group of possible networks that are nearly equally useful.
Comparison with regulatory networks without time delay
To better understand the impact of time delay in network construction, we build the networks without time delay in wild type cells and cyclin mutant cells by setting the parameter of our program, max time delay as 0. When time delay was not considered, there were only 3050 and 2489 predicted regulations in wild type cells and cyclin mutant cells under the same criteria; 32.40% of predicted regulations in wild type cells and 31.94% of predicted regulations in cyclin mutant cells were consistent with YEASTRACT or STRING. As shown in additional files 5 and 6, if time delay is considered, the number of predicted regulations will increase 54.65% and 39.25%, to 4717 and 3466 in wild type cells and cyclin mutant cells, respectively. And the percentages of known regulations in the time delay considered networks in wild type cells and cyclin mutant cells were 32.45% and 32.61%, slightly higher than the networks without time delay. Our results suggest that considering time delay in network construction will increase the number of predicted regulations, but not increase the false positive rate.
Time delay network of eight well known transcription factors
Eight well known transcription factors (YOX1, STB1, HCM1, WHI5, YHP1, ACE2, SWI5, and ASH1) studied in Orlando's work[14] were specifically investigated based on the time delay network of wild type cells. Figure 4shows the time delay network of these eight transcription factors in wild type cells. Table 1 gives the detailed parameters calculated in the time delay models. The predicted network consists of 14 regulations, eight of which find support in YEASTRACT, STRING or David Orlando's study [14]. The other six regulations might be minor effects resulting from the major regulator's cofactors.
Conclusions
As expression profiling technology has grown in popularity, much effort has been devoted to building gene regulation networks based on the wealth of profiling data generated. In this contribution, a new method is proposed to not only construct dynamic gene regulatory networks, but also to calculate the time delays between regulators and downstream genes. Time delay between transcription factor activation/repression and that of its target genes has long been suspected. Our tool allows a visualization of exact time delays, calculated from real in vivo data. Our approach can be applied to investigate important timerelated biological processes, such as the cell cycle, cell differentiation and development. Similarly such a method may be important for researchers studying the mechanisms of specific transcription factors, their pathways, and possible interventions for associated diseases.
Methods
How to run GeneReg on the example dataset
Time delay regression models can be easily constructed using the R package GeneReg, which is freely available from CRAN http://cran.rproject.org/web/packages/GeneReg/index.html. Additional file 7 contains GeneReg version 1.1.1. Additional file 8 is the R code for the above analysis. The processed example data mentioned above is contained within the R package. We detail the usage of GeneReg on the time course gene expression profiles of wild type cells in the steps below. The analysis of cyclin mutant cells was similar.
(1)B spline interpolation [17] was applied to estimate the expression of 100 time points according to the original data of 30 time points.
data(wt.expr.data)
wt.bspline.data <  ts.bspline(wt.expr.data, ts.point= as.numeric(colnames(wt.expr.data)), data.predict = 100)
(2) A series of time delay linear models were constructed based on the interpolated expression data. Detailed explanation of each parameter in the following code can be found in the help document of the GeneReg package at the above website.
data(tf.list)
wt.models < timedelay.lm.batch(bspline.data = wt.bspline.data, expr.data = wt.expr.data, regulator.list = tf.list, target.list = rownames(wt.bspline.data), single.adj.r.squared = 0.8, multiple.adj.r.squared = 0.9, maxdelay = ncol(wt.bspline.data)*0.1, min.coef = 0.25, max.coef = 4, output = T, topdf = T, xlab = 'Time point (lifeline)', ylab = 'Relative expression level (in log ratio)')
(3) The whole network was plotted based on the series of time delay linear models constructed in step (2).
plot.GeneReg(wt.models,vertex.size = 2,layout = layout.fruchterman.reingold)
Availability and requirements

Project name: GeneReg

Project home page: http://cran.rproject.org/web/packages/GeneReg/index.html

Operating systems: Platform independent

Programming language: R

Other requirements: GeneReg depends on two other R packages: splines and igraph

License: LGPL

Any restriction to use by nonacademics: none
Abbreviations
 (ODE):

Ordinary differential equation
 (AIC):

Akaike Information Criterion
 (ORF):

open reading frame.
References
 1.
Karlebach G, Shamir R: Modelling and analysis of gene regulatory networks. Nat Rev Mol Cell Biol. 2008, 9 (10): 770780. 10.1038/nrm2503.
 2.
Bansal M, Belcastro V, AmbesiImpiombato A, di Bernardo D: How to infer gene networks from expression profiles. Mol Syst Biol. 2007, 378.
 3.
Basso K, Margolin AA, Stolovitzky G, Klein U, DallaFavera R, Califano A: Reverse engineering of regulatory networks in human B cells. Nature genetics. 2005, 37 (4): 382390. 10.1038/ng1532.
 4.
Margolin AA, Nemenman I, Basso K, Wiggins C, Stolovitzky G, Favera Dalla R, Califano A: ARACNE: an algorithm for the reconstruction of gene regulatory networks in a mammalian cellular context. BMC bioinformatics. 2006, 7 (Suppl 1): S710.1186/147121057S1S7.
 5.
Butte AJ, Kohane IS: Mutual information relevance networks: functional genomic clustering using pairwise entropy measurements. Pac Symp Biocomput. 2000, 418429.
 6.
Yu J, Smith VA, Wang PP, Hartemink AJ, Jarvis ED: Advances to Bayesian network inference for generating causal networks from observational biological data. Bioinformatics (Oxford, England). 2004, 20 (18): 35943603. 10.1093/bioinformatics/bth448.
 7.
Kim S, Kim J, Cho KH: Inferring gene regulatory networks from temporal expression profiles under timedelay and noise. Computational biology and chemistry. 2007, 31 (4): 239245. 10.1016/j.compbiolchem.2007.03.013.
 8.
Radivoyevitch T: Mass action models versus the Hill model: an analysis of tetrameric human thymidine kinase 1 positive cooperativity. Biol Direct. 2009, 4: 4910.1186/17456150449.
 9.
Venkatesan K, Rual JF, Vazquez A, Stelzl U, Lemmens I, HirozaneKishikawa T, Hao T, Zenkner M, Xin X, Goh KI, et al: An empirical framework for binary interactome mapping. Nat Methods. 2009, 6: 8390. 10.1038/nmeth.1280.
 10.
D. Reidel Publishing Company, Sakamoto Y, Ishiguro MGK: Akaike Information Criterion Statistics. 1986, D. Reidel Publishing Company
 11.
WileyInterscience, Seber GAF, Lee AJ: Linear regression analysis. 2003, WileyInterscience, 2
 12.
Chambers JM: Statistical Models in S. Linear models. 1992, Cole: Wadsworth & Brooks
 13.
Chen KC, Wang TY, Tseng HH, Huang CY, Kao CY: A stochastic differential equation model for quantifying transcriptional regulatory network in Saccharomyces cerevisiae. Bioinformatics (Oxford, England). 2005, 21 (12): 28832890. 10.1093/bioinformatics/bti415.
 14.
Orlando DA, Lin CY, Bernard A, Wang JY, Socolar JE, Iversen ES, Hartemink AJ, Haase SB: Global control of cellcycle transcription by coupled CDK and network oscillators. Nature. 2008, 453 (7197): 944947. 10.1038/nature06955.
 15.
Teixeira MC, Monteiro P, Jain P, Tenreiro S, Fernandes AR, Mira NP, Alenquer M, Freitas AT, Oliveira AL, SaCorreia I: The YEASTRACT database: a tool for the analysis of transcription regulatory associations in Saccharomyces cerevisiae. Nucleic acids research. 2006, 34: D446451. 10.1093/nar/gkj013.
 16.
Monteiro PT, Mendes ND, Teixeira MC, d'Orey S, Tenreiro S, Mira NP, Pais H, Francisco AP, Carvalho AM, Lourenco AB: YEASTRACTDISCOVERER: new tools to improve the analysis of transcriptional regulatory associations in Saccharomyces cerevisiae. Nucleic acids research. 2008, D132136. 36 Database
 17.
Wadsworth & Brooks/Cole, Hastie TJ: Generalized additive models. Statistical Models in S. Edited by: Chambers JM, Hastie TJ. 1992, Wadsworth & Brooks/Cole
 18.
Dwight SS, Balakrishnan R, Christie KR, Costanzo MC, Dolinski K, Engel SR, Feierbach B, Fisk DG, Hirschman J, Hong EL, et al: Saccharomyces genome database: underlying principles and organisation. Briefings in bioinformatics. 2004, 5 (1): 922. 10.1093/bib/5.1.9.
 19.
Jensen LJ, Kuhn M, Stark M, Chaffron S, Creevey C, Muller J, Doerks T, Julien P, Roth A, Simonovic M: STRING 8a global view on proteins and their functional interactions in 630 organisms. Nucleic acids research. 2009, D412416. 10.1093/nar/gkn760. 37 Database
Acknowledgements
The authors acknowledge Lynne Berry and Yvonne Poindexter from the Vanderbilt Cancer Biostatistics Center for their editing. This work was supported by National HighTech R&D Program (863) (2006AA02Z334, 2007AA02Z330, 2007AA02Z332, 2009AA02Z304), National Basic Research Program of China (2006CB910700, 30800210), Key Research Program (CAS) KSCX2YWR112 and the Shanghai Committee of Science and Technology (07JC14048, 08JC1416600, 08ZR1415800).
Author information
Affiliations
Corresponding authors
Additional information
Competing interests
The authors declare that they have no competing interests.
Authors' contributions
TH, KT and ZQ carried out the study. TH and LL wrote the manuscript. LX and YL supervised the project. All authors read and approved the final manuscript.
Tao Huang, Lei Liu contributed equally to this work.
Electronic supplementary material
Collection of time delay models in wild type cells
Additional file 5: . Each row represents one predicted regulation. The seven columns show regulator, target gene, regression coefficient, time delay, adjusted R^{2}, consistency with the YEASTRACT database, and consistency with the STRING database. In these last two columns, 1 indicates consistency with the database, 0 indicates inconsistency when the regulator and target gene are included in the database, and NA indicates the database does not include the regulator or target gene. Regulations consistent with either the YEASTRACT database or STRING database (1 in either column) were considered as true, while regulations consistent or inconsistent with either the YEASTRACT database or STRING database (0 or 1 in either column) were considered as total regulations. Regulations with NA in both the YEASTRACT database and STRING database were excluded from accuracy calculation. (XLS 715 KB)
Collection of time delay models in cyclin mutant cells
Additional file 6: . Each row represents one predicted regulation. The seven columns show regulator, target gene, regression coefficient, time delay, adjusted R^{2}, consistency with the YEASTRACT database, and consistency with the STRING database. In these last two columns, 1 indicates consistency with the database, 0 indicates inconsistency when the regulator and target gene are included in the database, and NA indicates the database does not include the regulator or target gene. Regulations consistent with either the YEASTRACT database or STRING database (1 in either column) were considered as true, while regulations consistent or inconsistent with either the YEASTRACT database or STRING database (0 or 1 in either column) were considered as total regulations. Regulations with NA in both the YEASTRACT database and STRING database were excluded from accuracy calculation. (XLS 536 KB)
Authors’ original submitted files for images
Below are the links to the authors’ original submitted files for images.
Rights and permissions
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
About this article
Cite this article
Huang, T., Liu, L., Qian, Z. et al. Using GeneReg to construct time delay gene regulatory networks. BMC Res Notes 3, 142 (2010). https://doi.org/10.1186/175605003142
Received:
Accepted:
Published:
Keywords
 Time Delay
 Wild Type Cell
 Gene Regulatory Network
 String Database
 Regulation Coefficient