On the Evaluation of Information Flow in Multivariate Systems by the Directed Transfer Function

The directed transfer function (DTF) has been proposed as a measure of information flow between the components of multivariate time series. In this paper, we discuss the interpretation of the DTF and compare it with other measures for directed relationships. In particular, we show that the DTF does not indicate multivariate or bivariate Granger causality, but that it is closely related to the concept of impulse response function and can be viewed as a spectral measure for the total causal influence from one component to another. Furthermore, we investigate the statistical properties of the DTF and establish a simple significance level for testing for the null hypothesis of no information flow.     

Partial directed coherence: a new concept in neural structure determination

 This paper introduces a new frequency-domain approach to describe the relationships (direction of information flow) between multivariate time series based on the decomposition of multivariate partial coherences computed from multivariate autoregressive models. We discuss its application and compare its performance to other approaches to the problem of determining neural structure relations from the simultaneous measurement of neural electrophysiological signals. The new concept is shown to reflect a frequency-domain representation of the concept of Granger causality. Received: 25 April 2000 / Accepted in revised form: 13 November 2000     

Granger causality between multiple interdependent neurobiological time series: blockwise versus pairwise methods

Granger causality is becoming an important tool for determining causal relations between neurobiological time series. For multivariate data, there is often the need to examine causal relations between two blocks of time series, where each block could represent a brain region of interest. Two alternative methods are available. In the pairwise method, bivariate autoregressive models are fit to all pairwise combinations involving one time series from the first block and one from the second. The total Granger causality between the two blocks is then derived by summing pairwise causality values from each of these models. This approach is intuitive but computationally cumbersome. Theoretically, a more concise method can be derived, which we term the blockwise Granger causality method. In this method, a single multivariate model is fit to all the time series, and the causality between the two blocks is then computed from this model. We compare these two methods by applying them to cortical local field potential recordings from monkeys performing a sensorimotor task. The obtained results demonstrate consistency between the two methods and point to the significance potential of utilizing Granger causality analysis in understanding coupled neural systems.     

Linear and nonlinear causality between signals: methods, examples and neurophysiological applications

In this paper, we will present and review the most usual methods to detect linear and nonlinear causality between signals: linear Granger causality test (Geweke in J Am Stat Assoc 77:304–313, 1982) extended to direct causality in multivariate case (LGC), directed coherence (DCOH, Saito and Harashima in Recent advances in EEG and EMG data processing, Elsevier, Amsterdam, 1981), partial directed coherence (PDC, Sameshima and Baccala 1999) and nonlinear Granger causality test of Baek and Brock (in Working Paper University of Iowa, 1992) extended to direct causality in multivariate case (partial nonlinear Granger causality, PNGC). All these methods are tested and compared on several ARX, Poisson and nonlinear models, and on neurophysiological data (depth EEG). The results show that LGC, DCOH and PDC are not very robust in relation to nonlinear linkages but they seem to correctly find linear linkages if only the autoregressive parts are nonlinear. PNGC is extremely dependent on the choice of parameters. Moreover, LGC and PNGC may give misleading results in the case of causality on a spectral band, which is illustrated by our neurophysiological database.Electronic Supplementary Material Supplementary material is available to authorised users in the online version of this article at .     

On the spectral formulation of Granger causality

Spectral measures of causality are used to explore the role of different rhythms in the causal connectivity between brain regions. We study several spectral measures related to Granger causality, comprising the bivariate and conditional Geweke measures, the directed transfer function, and the partial directed coherence. We derive the formulation of dependence and causality in the spectral domain from the more general formulation in the information-theory framework. We argue that the transfer entropy, the most general measure derived from the concept of Granger causality, lacks a spectral representation in terms of only the processes associated with the recorded signals. For all the spectral measures we show how they are related to mutual information rates when explicitly considering the parametric autoregressive representation of the processes. In this way we express the conditional Geweke spectral measure in terms of a multiple coherence involving innovation variables inherent to the autoregressive representation. We also link partial directed coherence with Sims' criterion of causality. Given our results, we discuss the causal interpretation of the spectral measures related to Granger causality and stress the necessity to explicitly consider their specific formulation based on modeling the signals as linear Gaussian stationary autoregressive processes.     

BOLD Granger Causality Reflects Vascular Anatomy

A number of studies have tried to exploit subtle phase differences in BOLD time series to resolve the order of sequential activation of brain regions, or more generally the ability of signal in one region to predict subsequent signal in another region. More recently, such lag-based measures have been applied to investigate directed functional connectivity, although this application has been controversial. We attempted to use large publicly available datasets (FCON 1000, ADHD 200, Human Connectome Project) to determine whether consistent spatial patterns of Granger Causality are observed in typical fMRI data. For BOLD datasets from 1,240 typically developing subjects ages 7–40, we measured Granger causality between time series for every pair of 7,266 spherical ROIs covering the gray matter and 264 seed ROIs at hubs of the brain’s functional network architecture. Granger causality estimates were strongly reproducible for connections in a test and replication sample (n=620 subjects for each group), as well as in data from a single subject scanned repeatedly, both during resting and passive video viewing. The same effect was even stronger in high temporal resolution fMRI data from the Human Connectome Project, and was observed independently in data collected during performance of 7 task paradigms. The spatial distribution of Granger causality reflected vascular anatomy with a progression from Granger causality sources, in Circle of Willis arterial inflow distributions, to sinks, near large venous vascular structures such as dural venous sinuses and at the periphery of the brain. Attempts to resolve BOLD phase differences with Granger causality should consider the possibility of reproducible vascular confounds, a problem that is independent of the known regional variability of the hemodynamic response.     

More discussions for granger causality and new causality measures

Granger causality (GC) has been widely applied in economics and neuroscience to reveal causality influence of time series. In our previous paper (Hu et al., in IEEE Trans on Neural Netw, 22(6), pp. 829–844, 2011), we proposed new causalities in time and frequency domains and particularly focused on new causality in frequency domain by pointing out the shortcomings/limitations of GC or Granger-alike causality metrics and the advantages of new causality. In this paper we continue our previous discussions and focus on new causality and GC or Granger-alike causality metrics in time domain. Although one strong motivation was introduced in our previous paper (Hu et al., in IEEE Trans on Neural Netw, 22(6), pp. 829–844, 2011) we here present additional motivation for the proposed new causality metric and restate the previous motivation for completeness. We point out one property of conditional GC in time domain and the shortcomings/limitations of conditional GC which cannot reveal the real strength of the directional causality among three time series. We also show the shortcomings/limitations of directed causality (DC) or normalize DC for multivariate time series and demonstrate it cannot reveal real causality at all. By calculating GC and new causality values for an example we demonstrate the influence of one of the time series on the other is linearly increased as the coupling strength is linearly increased. This fact further supports reasonability of new causality metric. We point out that larger instantaneous correlation does not necessarily mean larger true causality (e.g., GC and new causality), or vice versa. Finally we conduct analysis of statistical test for significance and asymptotic distribution property of new causality metric by illustrative examples.     

Diet, tobacco, alcohol, and stress as causes of coronary artery heart disease: an ecological trend analysis of national data

The present investigation examined the temporal relationships between changes in coronary artery heart disease (CAHD) mortality rates from whites (1938-1980) and changes in national measures of dietary elements, tobacco consumption, alcohol consumption, and unemployment. The magnitude and latency of the causal relationships were estimated with the use of cross-lagged correlation functions (CCFs) and Granger causality tests. Preliminary CCFs showed consistent correlational patterns between CAHD and tobacco, ethanol, and dietary fats. There was little association between CAHD and dietary cholesterol. Ethanol, tobacco, and the ratio of saturated to polyunsaturated fats (S:P) were analyzed for directional causality using Granger causality tests. The S:P ratio demonstrated a unidirectional Granger causal relationship with CAHD mortality in all sex and age groups. The estimated latency of this relationship was 23 to 30 years. This finding supports a causal relationship between diet, specifically fats, and the risk of CAHD two or three decades later.     

Manifest Variable Granger Causality Models for Developmental Research: A Taxonomy

Granger models are popular when it comes to testing hypotheses that relate series of measures causally to each other. In this article, we propose a taxonomy of Granger causality models. The taxonomy results from crossing the four variables Order of Lag, Type of (Contemporaneous) Effect, Direction of Effect, and Segment of Dependent Series Targeted. Among the uses of such a taxonomy are that existing models can be embedded in the context of possible other models, new models can be derived, models can be compared, and the relation of statistical models to theories of causality can be specified. Sample models are depicted, and parameters of interest are indicated. For two new models, empirical data examples are provided from research on the development of aggression in adolescents.     

Causal measures of structure and plasticity in simulated and living neural networks

A major goal of neuroscience is to understand the relationship between neural structures and their function. Recording of neural activity with arrays of electrodes is a primary tool employed toward this goal. However, the relationships among the neural activity recorded by these arrays are often highly complex making it problematic to accurately quantify a network's structural information and then relate that structure to its function. Current statistical methods including cross correlation and coherence have achieved only modest success in characterizing the structural connectivity. Over the last decade an alternative technique known as Granger causality is emerging within neuroscience. This technique, borrowed from the field of economics, provides a strong mathematical foundation based on linear auto-regression to detect and quantify "causal" relationships among different time series. This paper presents a combination of three Granger based analytical methods that can quickly provide a relatively complete representation of the causal structure within a neural network. These are a simple pairwise Granger causality metric, a conditional metric, and a little known computationally inexpensive subtractive conditional method. Each causal metric is first described and evaluated in a series of biologically plausible neural simulations. We then demonstrate how Granger causality can detect and quantify changes in the strength of those relationships during plasticity using 60 channel spike train data from an in vitro cortical network measured on a microelectrode array. We show that these metrics can not only detect the presence of causal relationships, they also provide crucial information about the strength and direction of that relationship, particularly when that relationship maybe changing during plasticity. Although we focus on the analysis of multichannel spike train data the metrics we describe are applicable to any stationary time series in which causal relationships among multiple measures is desired. These techniques can be especially useful when the interactions among those measures are highly complex, difficult to untangle, and maybe changing over time.     

Granger causality analysis of steady-state electroencephalographic signals during propofol-induced anaesthesia

Changes in conscious level have been associated with changes in dynamical integration and segregation among distributed brain regions. Recent theoretical developments emphasize changes in directed functional (i.e., causal) connectivity as reflected in quantities such as 'integrated information' and 'causal density'. Here we develop and illustrate a rigorous methodology for assessing causal connectivity from electroencephalographic (EEG) signals using Granger causality (GC). Our method addresses the challenges of non-stationarity and bias by dividing data into short segments and applying permutation analysis. We apply the method to EEG data obtained from subjects undergoing propofol-induced anaesthesia, with signals source-localized to the anterior and posterior cingulate cortices. We found significant increases in bidirectional GC in most subjects during loss-of-consciousness, especially in the beta and gamma frequency ranges. Corroborating a previous analysis we also found increases in synchrony in these ranges; importantly, the Granger causality analysis showed higher inter-subject consistency than the synchrony analysis. Finally, we validate our method using simulated data generated from a model for which GC values can be analytically derived. In summary, our findings advance the methodology of Granger causality analysis of EEG data and carry implications for integrated information and causal density theories of consciousness.     

Altered effective connectivity network of the amygdala in social anxiety disorder: a resting-state FMRI study

The amygdala is often found to be abnormally recruited in social anxiety disorder (SAD) patients. The question whether amygdala activation is primarily abnormal and affects other brain systems or whether it responds "normally" to an abnormal pattern of information conveyed by other brain structures remained unanswered. To address this question, we investigated a network of effective connectivity associated with the amygdala using Granger causality analysis on resting-state functional MRI data of 22 SAD patients and 21 healthy controls (HC). Implications of abnormal effective connectivity and clinical severity were investigated using the Liebowitz Social Anxiety Scale (LSAS). Decreased influence from inferior temporal gyrus (ITG) to amygdala was found in SAD, while bidirectional influences between amygdala and visual cortices were increased compared to HCs. Clinical relevance of decreased effective connectivity from ITG to amygdala was suggested by a negative correlation of LSAS avoidance scores and the value of Granger causality. Our study is the first to reveal a network of abnormal effective connectivity of core structures in SAD. This is in support of a disregulation in predescribed modules involved in affect control. The amygdala is placed in a central position of dysfunction characterized both by decreased regulatory influence of orbitofrontal cortex and increased crosstalk with visual cortex. The model which is proposed based on our results lends neurobiological support towards cognitive models considering disinhibition and an attentional bias towards negative stimuli as a core feature of the disorder.     

Neural net classification of REM sleep based on spectral measures as compared to nonlinear measures

 In various studies the implementation of nonlinear and nonconventional measures has significantly improved EEG (electroencephalogram) analyses as compared to using conventional parameters alone. A neural network algorithm well approved in our laboratory for the automatic recognition of rapid eye movement (REM) sleep was investigated in this regard. Originally based on a broad range of spectral power inputs, we additionally supplied the nonlinear measures of the largest Lyapunov exponent and correlation dimension as well as the nonconventional stochastic measures of spectral entropy and entropy of amplitudes. No improvement in the detection of REM sleep could be achieved by the inclusion of the new measures. The accuracy of the classification was significantly worse, however, when supplied with these variables alone. In view of results demonstrating the efficiency of nonconventional measures in EEG analysis, the benefit appears to depend on the nature of the problem. Received: 10 October 2000 / Accepted in revised form: 26 April 2001     

A temporal precedence based clustering method for gene expression microarray data

Background  

Time-course microarray experiments can produce useful data which can help in understanding the underlying dynamics of the system. Clustering is an important stage in microarray data analysis where the data is grouped together according to certain characteristics. The majority of clustering techniques are based on distance or visual similarity measures which may not be suitable for clustering of temporal microarray data where the sequential nature of time is important. We present a Granger causality based technique to cluster temporal microarray gene expression data, which measures the interdependence between two time-series by statistically testing if one time-series can be used for forecasting the other time-series or not.     

Nobiletin metabolite, 3′,4′-dihydroxy-5,6,7,8-tetramethoxyflavone,inhibits LDL oxidation and down-regulates scavenger receptor expression and activity in THP-1 cells

There is accumulating evidence that LDL oxidation is essential for atherogenesis and antioxidants that prevent oxidation may either decelerate or reduce atherogenesis. Current study focused on the effect and mechanism of 3′,4′-dihydroxy-5,6,7,8-tetramethoxyflavone (DTF), a major metabolite of nobiletin (NOB, a citrus polymethoxylated flavone) on atherogenesis. We found DTF had stronger inhibitory activity than α-tocopherol on inhibiting Cu²⁺-mediated LDL oxidation measured by thiobarbituric acid-reactive substances assay (TBARS), conjugated diene formation and electrophoretic mobility. Monocyte-to-macrophage differentiation plays a vital role in early atherogenesis. DTF (10–20 μM) dose-dependently attenuated differentiation along with the reduced gene expression of scavenger receptors, CD36 and SR-A, in both PMA- and oxidized low-density lipoprotein (oxLDL)-stimulated THP-1 monocytes. Furthermore, DTF treatment of monocytes and macrophages led to reduction of fluorescent DiI-acLDL and DiI-oxLDL uptake. In conclusion, at least three mechanisms are at work in parallel: DTF reduces LDL oxidation, attenuates monocyte differentiation into macrophage and blunts uptake of modified LDL by macrophage. The effect is different from that of NOB, from which DTF is derived. This study thus significantly enhanced our understanding on how DTF may be beneficial against atherogenesis.     

Converging Intracranial Markers of Conscious Access

We compared conscious and nonconscious processing of briefly flashed words using a visual masking procedure while recording intracranial electroencephalogram (iEEG) in ten patients. Nonconscious processing of masked words was observed in multiple cortical areas, mostly within an early time window (<300 ms), accompanied by induced gamma-band activity, but without coherent long-distance neural activity, suggesting a quickly dissipating feedforward wave. In contrast, conscious processing of unmasked words was characterized by the convergence of four distinct neurophysiological markers: sustained voltage changes, particularly in prefrontal cortex, large increases in spectral power in the gamma band, increases in long-distance phase synchrony in the beta range, and increases in long-range Granger causality. We argue that all of those measures provide distinct windows into the same distributed state of conscious processing. These results have a direct impact on current theoretical discussions concerning the neural correlates of conscious access.     

Analyzing multiple spike trains with nonparametric granger causality

Simultaneous recordings of spike trains from multiple single neurons are becoming commonplace. Understanding the interaction patterns among these spike trains remains a key research area. A question of interest is the evaluation of information flow between neurons through the analysis of whether one spike train exerts causal influence on another. For continuous-valued time series data, Granger causality has proven an effective method for this purpose. However, the basis for Granger causality estimation is autoregressive data modeling, which is not directly applicable to spike trains. Various filtering options distort the properties of spike trains as point processes. Here we propose a new nonparametric approach to estimate Granger causality directly from the Fourier transforms of spike train data. We validate the method on synthetic spike trains generated by model networks of neurons with known connectivity patterns and then apply it to neurons simultaneously recorded from the thalamus and the primary somatosensory cortex of a squirrel monkey undergoing tactile stimulation.     

Is Granger Causality a Viable Technique for Analyzing fMRI Data?

Multivariate neural data provide the basis for assessing interactions in brain networks. Among myriad connectivity measures, Granger causality (GC) has proven to be statistically intuitive, easy to implement, and generate meaningful results. Although its application to functional MRI (fMRI) data is increasing, several factors have been identified that appear to hinder its neural interpretability: (a) latency differences in hemodynamic response function (HRF) across different brain regions, (b) low-sampling rates, and (c) noise. Recognizing that in basic and clinical neuroscience, it is often the change of a dependent variable (e.g., GC) between experimental conditions and between normal and pathology that is of interest, we address the question of whether there exist systematic relationships between GC at the fMRI level and that at the neural level. Simulated neural signals were convolved with a canonical HRF, down-sampled, and noise-added to generate simulated fMRI data. As the coupling parameters in the model were varied, fMRI GC and neural GC were calculated, and their relationship examined. Three main results were found: (1) GC following HRF convolution is a monotonically increasing function of neural GC; (2) this monotonicity can be reliably detected as a positive correlation when realistic fMRI temporal resolution and noise level were used; and (3) although the detectability of monotonicity declined due to the presence of HRF latency differences, substantial recovery of detectability occurred after correcting for latency differences. These results suggest that Granger causality is a viable technique for analyzing fMRI data when the questions are appropriately formulated.     

Using Complex Networks to Characterize International Business Cycles

Background

There is a rapidly expanding literature on the application of complex networks in economics that focused mostly on stock markets. In this paper, we discuss an application of complex networks to study international business cycles.

Methodology/Principal Findings

We construct complex networks based on GDP data from two data sets on G7 and OECD economies. Besides the well-known correlation-based networks, we also use a specific tool for presenting causality in economics, the Granger causality. We consider different filtering methods to derive the stationary component of the GDP series for each of the countries in the samples. The networks were found to be sensitive to the detrending method. While the correlation networks provide information on comovement between the national economies, the Granger causality networks can better predict fluctuations in countries’ GDP. By using them, we can obtain directed networks allows us to determine the relative influence of different countries on the global economy network. The US appears as the key player for both the G7 and OECD samples.

Conclusion

The use of complex networks is valuable for understanding the business cycle comovements at an international level.