On the spectral formulation of Granger causality

Spectral measures of causality are used to explore the role of different rhythms in the causal connectivity between brain regions. We study several spectral measures related to Granger causality, comprising the bivariate and conditional Geweke measures, the directed transfer function, and the partial directed coherence. We derive the formulation of dependence and causality in the spectral domain from the more general formulation in the information-theory framework. We argue that the transfer entropy, the most general measure derived from the concept of Granger causality, lacks a spectral representation in terms of only the processes associated with the recorded signals. For all the spectral measures we show how they are related to mutual information rates when explicitly considering the parametric autoregressive representation of the processes. In this way we express the conditional Geweke spectral measure in terms of a multiple coherence involving innovation variables inherent to the autoregressive representation. We also link partial directed coherence with Sims' criterion of causality. Given our results, we discuss the causal interpretation of the spectral measures related to Granger causality and stress the necessity to explicitly consider their specific formulation based on modeling the signals as linear Gaussian stationary autoregressive processes.     

Granger causality between multiple interdependent neurobiological time series: blockwise versus pairwise methods

Granger causality is becoming an important tool for determining causal relations between neurobiological time series. For multivariate data, there is often the need to examine causal relations between two blocks of time series, where each block could represent a brain region of interest. Two alternative methods are available. In the pairwise method, bivariate autoregressive models are fit to all pairwise combinations involving one time series from the first block and one from the second. The total Granger causality between the two blocks is then derived by summing pairwise causality values from each of these models. This approach is intuitive but computationally cumbersome. Theoretically, a more concise method can be derived, which we term the blockwise Granger causality method. In this method, a single multivariate model is fit to all the time series, and the causality between the two blocks is then computed from this model. We compare these two methods by applying them to cortical local field potential recordings from monkeys performing a sensorimotor task. The obtained results demonstrate consistency between the two methods and point to the significance potential of utilizing Granger causality analysis in understanding coupled neural systems.     

Linear and nonlinear causality between signals: methods, examples and neurophysiological applications

In this paper, we will present and review the most usual methods to detect linear and nonlinear causality between signals: linear Granger causality test (Geweke in J Am Stat Assoc 77:304–313, 1982) extended to direct causality in multivariate case (LGC), directed coherence (DCOH, Saito and Harashima in Recent advances in EEG and EMG data processing, Elsevier, Amsterdam, 1981), partial directed coherence (PDC, Sameshima and Baccala 1999) and nonlinear Granger causality test of Baek and Brock (in Working Paper University of Iowa, 1992) extended to direct causality in multivariate case (partial nonlinear Granger causality, PNGC). All these methods are tested and compared on several ARX, Poisson and nonlinear models, and on neurophysiological data (depth EEG). The results show that LGC, DCOH and PDC are not very robust in relation to nonlinear linkages but they seem to correctly find linear linkages if only the autoregressive parts are nonlinear. PNGC is extremely dependent on the choice of parameters. Moreover, LGC and PNGC may give misleading results in the case of causality on a spectral band, which is illustrated by our neurophysiological database.Electronic Supplementary Material Supplementary material is available to authorised users in the online version of this article at .     

Analyzing multiple spike trains with nonparametric granger causality

Simultaneous recordings of spike trains from multiple single neurons are becoming commonplace. Understanding the interaction patterns among these spike trains remains a key research area. A question of interest is the evaluation of information flow between neurons through the analysis of whether one spike train exerts causal influence on another. For continuous-valued time series data, Granger causality has proven an effective method for this purpose. However, the basis for Granger causality estimation is autoregressive data modeling, which is not directly applicable to spike trains. Various filtering options distort the properties of spike trains as point processes. Here we propose a new nonparametric approach to estimate Granger causality directly from the Fourier transforms of spike train data. We validate the method on synthetic spike trains generated by model networks of neurons with known connectivity patterns and then apply it to neurons simultaneously recorded from the thalamus and the primary somatosensory cortex of a squirrel monkey undergoing tactile stimulation.     

Extended causal modeling to assess Partial Directed Coherence in multiple time series with significant instantaneous interactions

The Partial Directed Coherence (PDC) and its generalized formulation (gPDC) are popular tools for investigating, in the frequency domain, the concept of Granger causality among multivariate (MV) time series. PDC and gPDC are formalized in terms of the coefficients of an MV autoregressive (MVAR) model which describes only the lagged effects among the time series and forsakes instantaneous effects. However, instantaneous effects are known to affect linear parametric modeling, and are likely to occur in experimental time series. In this study, we investigate the impact on the assessment of frequency domain causality of excluding instantaneous effects from the model underlying PDC evaluation. Moreover, we propose the utilization of an extended MVAR model including both instantaneous and lagged effects. This model is used to assess PDC either in accordance with the definition of Granger causality when considering only lagged effects (iPDC), or with an extended form of causality, when we consider both instantaneous and lagged effects (ePDC). The approach is first evaluated on three theoretical examples of MVAR processes, which show that the presence of instantaneous correlations may produce misleading profiles of PDC and gPDC, while ePDC and iPDC derived from the extended model provide here a correct interpretation of extended and lagged causality. It is then applied to representative examples of cardiorespiratory and EEG MV time series. They suggest that ePDC and iPDC are better interpretable than PDC and gPDC in terms of the known cardiovascular and neural physiologies.     

Partial directed coherence: a new concept in neural structure determination

 This paper introduces a new frequency-domain approach to describe the relationships (direction of information flow) between multivariate time series based on the decomposition of multivariate partial coherences computed from multivariate autoregressive models. We discuss its application and compare its performance to other approaches to the problem of determining neural structure relations from the simultaneous measurement of neural electrophysiological signals. The new concept is shown to reflect a frequency-domain representation of the concept of Granger causality. Received: 25 April 2000 / Accepted in revised form: 13 November 2000     

Listen to Genes: Dealing with Microarray Data in the Frequency Domain

Background

We present a novel and systematic approach to analyze temporal microarray data. The approach includes normalization, clustering and network analysis of genes.

Methodology

Genes are normalized using an error model based uniform normalization method aimed at identifying and estimating the sources of variations. The model minimizes the correlation among error terms across replicates. The normalized gene expressions are then clustered in terms of their power spectrum density. The method of complex Granger causality is introduced to reveal interactions between sets of genes. Complex Granger causality along with partial Granger causality is applied in both time and frequency domains to selected as well as all the genes to reveal the interesting networks of interactions. The approach is successfully applied to Arabidopsis leaf microarray data generated from 31,000 genes observed over 22 time points over 22 days. Three circuits: a circadian gene circuit, an ethylene circuit and a new global circuit showing a hierarchical structure to determine the initiators of leaf senescence are analyzed in detail.

Conclusions

We use a totally data-driven approach to form biological hypothesis. Clustering using the power-spectrum analysis helps us identify genes of potential interest. Their dynamics can be captured accurately in the time and frequency domain using the methods of complex and partial Granger causality. With the rise in availability of temporal microarray data, such methods can be useful tools in uncovering the hidden biological interactions. We show our method in a step by step manner with help of toy models as well as a real biological dataset. We also analyse three distinct gene circuits of potential interest to Arabidopsis researchers.     

Functional connections between auditory cortical fields in humans revealed by Granger causality analysis of intra-cranial evoked potentials to sounds: comparison of two methods

Knowledge of neural interactions amongst cortical sites is important for understanding higher brain function. We studied such interactions using Granger causality (GC) to analyze auditory event-related potentials (ERPs) recorded directly and simultaneously from two physiologically identified and functionally interconnected auditory areas of cerebral cortex in human neurosurgical patients. Two methods of GC analysis were used and the results compared. Both approaches involved adaptive autoregressive modeling but differed from each other in other ways. Results obtained by using the two methods also differed. Fewer false-positive results were obtained using the method that suppressed the ERP non-stationarity and that expressed the GC as the sum of model coefficients, which suggests that this is the more appropriate approach for analyzing ERPs recorded directly from the human cortex.     

Causal measures of structure and plasticity in simulated and living neural networks

A major goal of neuroscience is to understand the relationship between neural structures and their function. Recording of neural activity with arrays of electrodes is a primary tool employed toward this goal. However, the relationships among the neural activity recorded by these arrays are often highly complex making it problematic to accurately quantify a network's structural information and then relate that structure to its function. Current statistical methods including cross correlation and coherence have achieved only modest success in characterizing the structural connectivity. Over the last decade an alternative technique known as Granger causality is emerging within neuroscience. This technique, borrowed from the field of economics, provides a strong mathematical foundation based on linear auto-regression to detect and quantify "causal" relationships among different time series. This paper presents a combination of three Granger based analytical methods that can quickly provide a relatively complete representation of the causal structure within a neural network. These are a simple pairwise Granger causality metric, a conditional metric, and a little known computationally inexpensive subtractive conditional method. Each causal metric is first described and evaluated in a series of biologically plausible neural simulations. We then demonstrate how Granger causality can detect and quantify changes in the strength of those relationships during plasticity using 60 channel spike train data from an in vitro cortical network measured on a microelectrode array. We show that these metrics can not only detect the presence of causal relationships, they also provide crucial information about the strength and direction of that relationship, particularly when that relationship maybe changing during plasticity. Although we focus on the analysis of multichannel spike train data the metrics we describe are applicable to any stationary time series in which causal relationships among multiple measures is desired. These techniques can be especially useful when the interactions among those measures are highly complex, difficult to untangle, and maybe changing over time.     

A graphical approach for evaluating effective connectivity in neural systems

The identification of effective connectivity from time-series data such as electroencephalogram (EEG) or time-resolved function magnetic resonance imaging (fMRI) recordings is an important problem in brain imaging. One commonly used approach to inference effective connectivity is based on vector autoregressive models and the concept of Granger causality. However, this probabilistic concept of causality can lead to spurious causalities in the presence of latent variables. Recently, graphical models have been used to discuss problems of causal inference for multivariate data. In this paper, we extend these concepts to the case of time-series and present a graphical approach for discussing Granger-causal relationships among multiple time-series. In particular, we propose a new graphical representation that allows the characterization of spurious causality and, thus, can be used to investigate spurious causality. The method is demonstrated with concurrent EEG and fMRI recordings which are used to investigate the interrelations between the alpha rhythm in the EEG and blood oxygenation level dependent (BOLD) responses in the fMRI. The results confirm previous findings on the location of the source of the EEG alpha rhythm.     

收敛交叉映射方法及其在生态学中的应用

收敛交叉映射(CCM)是一种分析非线性系统中时间序列变量间因果关系的方法。其不同于传统的线性系统分析方法,是通过对变量进行状态空间重构来获取变量的历史信息,随着时间序列不断增长,当其估计性能呈现收敛的性质时,可以判断因果关系的存在。本文介绍了CCM的发展史及其较传统的格兰杰因果检验的优点,详细阐明了CCM的原理、算法过程和实现途径。CCM作为一种针对变量间具有弱到中等强度耦合关系的系统分析方法,可以用来有效地解决非线性生态系统多变量间复杂的因果关系问题。将该方法应用于具有空间信息的多点位时间序列变量间因果分析时,应充分考虑点位间的空间自相关性,与可以去除变量及序列间空间相关性的方法相结合,从而确保CCM对变量因果关系的分析更加准确,结果也更具有信服力。     

Does energy intensity contribute to CO2 emissions? A trivariate analysis in selected African countries

The present study investigates the dynamic relationship between energy intensity and CO₂ emissions by incorporating economic growth in environment CO₂ emissions function using data of Sub Saharan African countries. For this purpose, we applied panel cointegration to examine the long run relationship between the series. We employed the VECM Granger causality to test the direction of causality amid the variables.At panel level, our results validate the existence of cointegration among the series. The long run panel results show that energy intensity has positive and statistically significant impact on CO₂ emissions. There is also positive and negative link of non-linear and linear terms of real GDP per capita with CO₂ emissions supporting the presence of environmental Kuznets curve (EKC). The causality analysis reveals the bidirectional causality between economic growth and CO₂ emissions while energy intensity Granger causes economic growth and hence CO₂ emissions, while across the individual countries, the results differ. This paper opens up new insights for policy makers to design comprehensive economic, energy and environmental policy for sustainable long run economic growth.     

On the directionality of cortical interactions studied by structural analysis of electrophysiological recordings

To investigate the directionality of neural interactions as assessed by electrophysiology, we adapted methods of structural analysis from the field of econometrics. In particular, within the framework of autoregressive modelling of the data, we considered quantitative measures of linear relationship between multiple time series adopting the Wiener-Granger concept of causality. The techniques were evaluated with local field potential measurements from the cat visual system. Here, several issues had to be addressed. First, out of several statistical tests of the stationarity of local field potentials considered, those based on the Kolmogorov-Smirnov and on the reverse arrangement statistics proved to be most powerful. The application of those tests to the experimental data showed that the large part of the local field potentials can be considered stationary on a time scale of 1 s. Second, out of the several investigated methods for the determination of an optimal order of the autoregressive model, the Akaike Information Criterion had the most suitable properties. The identified order of the model, across different repetitions of the trials, was consistently 5–8. Third, although the individual segments of field potentials used for the analysis were relatively short, the methods of structural analysis applied produced reliable results, confirming findings of simulations of data with similar properties. Furthermore the features of the estimated models were consistent among trials, so that the analysis of average measures of interaction appears to be a viable approach to investigate the relationship between the recording sites. In summary, the statistical methods considered have proved to be suitable for the study of the directionality of neuronal interactions. Received: 13 August 1998 / Accepted in revised form: 19 March 1999     

Assessment of Interaction Between Cardio-Respiratory Signals Using Directed Coherence on Healthy Subjects During Postural Change

PurposeTo detect and quantify the directional interaction changes between cardio-respiratory system during postural change.MethodTraditional frequency domain analysis based on power spectrum and coherence are insufficient to quantify nonlinear structures and complexity of physiological subsystems. Recently, Granger causality is found as preferable method for evaluation of causality i.e., directional interaction. Frequency domain Granger causality based on directed coherence has been used in this study to identify directional interaction between cardiac and respiratory signal during postural change from supine to standing for healthy subjects.ResultECG and respiration signal are recorded for this study. The beat-to-beat variability series from ECG provides heart rate (RR) and the respiration amplitude corresponds to RESP time series. It was observed that respiration is responsible for the changes in ECG signal during supine position as compared to standing. The outflow of information from RESP to RR increases during supine results in stronger interaction but reduces during standing result in reduction of interaction. Similarly, the effect of RR on RESP is found significant only during standing.ConclusionThe proposed directed coherence approach detects the cardio-respiratory regulation during postural change and provide information about coupling changes during this transition.     

A Granger causality measure for point process models of ensemble neural spiking activity

The ability to identify directional interactions that occur among multiple neurons in the brain is crucial to an understanding of how groups of neurons cooperate in order to generate specific brain functions. However, an optimal method of assessing these interactions has not been established. Granger causality has proven to be an effective method for the analysis of the directional interactions between multiple sets of continuous-valued data, but cannot be applied to neural spike train recordings due to their discrete nature. This paper proposes a point process framework that enables Granger causality to be applied to point process data such as neural spike trains. The proposed framework uses the point process likelihood function to relate a neuron's spiking probability to possible covariates, such as its own spiking history and the concurrent activity of simultaneously recorded neurons. Granger causality is assessed based on the relative reduction of the point process likelihood of one neuron obtained excluding one of its covariates compared to the likelihood obtained using all of its covariates. The method was tested on simulated data, and then applied to neural activity recorded from the primary motor cortex (MI) of a Felis catus subject. The interactions present in the simulated data were predicted with a high degree of accuracy, and when applied to the real neural data, the proposed method identified causal relationships between many of the recorded neurons. This paper proposes a novel method that successfully applies Granger causality to point process data, and has the potential to provide unique physiological insights when applied to neural spike trains.     

Economic growth,electricity consumption,urbanization and environmental degradation relationship in United Arab Emirates

The present study explores the relationship between economic growth, electricity consumption, urbanization and environmental degradation in case of United Arab Emirates (UAE). The study covers the quarter frequency data over the period of 1975–2011. We have applied the ARDL bounds testing approach to examine the long run relationship between the variables in the presence of structural breaks. The VECM Granger causality is applied to investigate the direction of causal relationship between the variables. Our empirical exercise reported the existence of cointegration among the series. Further, we found an inverted U-shaped relationship between economic growth and CO₂ emissions i.e. economic growth raises energy emissions initially and declines it after a threshold point of income per capita (EKC exists). Electricity consumption declines CO₂ emissions. The relationship between urbanization and CO₂ emissions is positive. Exports seem to improve the environmental quality by lowering CO₂ emissions. The causality analysis validates the feedback effect between CO₂ emissions and electricity consumption. Economic growth and urbanization Granger cause CO₂ emissions.     

Detection of directed information flow in biosignals.

Several analysis techniques have been developed for time series to detect interactions in multidimensional dynamic systems. When analyzing biosignals generated by unknown dynamic systems, awareness of the different concepts upon which these analysis techniques are based, as well as the particular aspects the methods focus on, is a basic requirement for drawing reliable conclusions. For this purpose, we compare four different techniques for linear time series analysis. In general, these techniques detect the presence of interactions, as well as the directions of information flow, in a multidimensional system. We review the different conceptual properties of partial coherence, a Granger causality index, directed transfer function, and partial directed coherence. The performance of these tools is demonstrated by application to linear dynamic systems.     

Attention-Dependent Modulation of Cortical Taste Circuits Revealed by Granger Causality with Signal-Dependent Noise

We show, for the first time, that in cortical areas, for example the insular, orbitofrontal, and lateral prefrontal cortex, there is signal-dependent noise in the fMRI blood-oxygen level dependent (BOLD) time series, with the variance of the noise increasing approximately linearly with the square of the signal. Classical Granger causal models are based on autoregressive models with time invariant covariance structure, and thus do not take this signal-dependent noise into account. To address this limitation, here we describe a Granger causal model with signal-dependent noise, and a novel, likelihood ratio test for causal inferences. We apply this approach to the data from an fMRI study to investigate the source of the top-down attentional control of taste intensity and taste pleasantness processing. The Granger causality with signal-dependent noise analysis reveals effects not identified by classical Granger causal analysis. In particular, there is a top-down effect from the posterior lateral prefrontal cortex to the insular taste cortex during attention to intensity but not to pleasantness, and there is a top-down effect from the anterior and posterior lateral prefrontal cortex to the orbitofrontal cortex during attention to pleasantness but not to intensity. In addition, there is stronger forward effective connectivity from the insular taste cortex to the orbitofrontal cortex during attention to pleasantness than during attention to intensity. These findings indicate the importance of explicitly modeling signal-dependent noise in functional neuroimaging, and reveal some of the processes involved in a biased activation theory of selective attention.     

BOLD Granger Causality Reflects Vascular Anatomy

A number of studies have tried to exploit subtle phase differences in BOLD time series to resolve the order of sequential activation of brain regions, or more generally the ability of signal in one region to predict subsequent signal in another region. More recently, such lag-based measures have been applied to investigate directed functional connectivity, although this application has been controversial. We attempted to use large publicly available datasets (FCON 1000, ADHD 200, Human Connectome Project) to determine whether consistent spatial patterns of Granger Causality are observed in typical fMRI data. For BOLD datasets from 1,240 typically developing subjects ages 7–40, we measured Granger causality between time series for every pair of 7,266 spherical ROIs covering the gray matter and 264 seed ROIs at hubs of the brain’s functional network architecture. Granger causality estimates were strongly reproducible for connections in a test and replication sample (n=620 subjects for each group), as well as in data from a single subject scanned repeatedly, both during resting and passive video viewing. The same effect was even stronger in high temporal resolution fMRI data from the Human Connectome Project, and was observed independently in data collected during performance of 7 task paradigms. The spatial distribution of Granger causality reflected vascular anatomy with a progression from Granger causality sources, in Circle of Willis arterial inflow distributions, to sinks, near large venous vascular structures such as dural venous sinuses and at the periphery of the brain. Attempts to resolve BOLD phase differences with Granger causality should consider the possibility of reproducible vascular confounds, a problem that is independent of the known regional variability of the hemodynamic response.     

Transfer entropy—a model-free measure of effective connectivity for the neurosciences

Understanding causal relationships, or effective connectivity, between parts of the brain is of utmost importance because a large part of the brain’s activity is thought to be internally generated and, hence, quantifying stimulus response relationships alone does not fully describe brain dynamics. Past efforts to determine effective connectivity mostly relied on model based approaches such as Granger causality or dynamic causal modeling. Transfer entropy (TE) is an alternative measure of effective connectivity based on information theory. TE does not require a model of the interaction and is inherently non-linear. We investigated the applicability of TE as a metric in a test for effective connectivity to electrophysiological data based on simulations and magnetoencephalography (MEG) recordings in a simple motor task. In particular, we demonstrate that TE improved the detectability of effective connectivity for non-linear interactions, and for sensor level MEG signals where linear methods are hampered by signal-cross-talk due to volume conduction.