A direct optimization approach to hidden Markov modeling for single channel kinetics

Hidden Markov modeling (HMM) provides an effective approach for modeling single channel kinetics. Standard HMM is based on Baum's reestimation. As applied to single channel currents, the algorithm has the inability to optimize the rate constants directly. We present here an alternative approach by considering the problem as a general optimization problem. The quasi-Newton method is used for searching the likelihood surface. The analytical derivatives of the likelihood function are derived, thereby maximizing the efficiency of the optimization. Because the rate constants are optimized directly, the approach has advantages such as the allowance for model constraints and the ability to simultaneously fit multiple data sets obtained at different experimental conditions. Numerical examples are presented to illustrate the performance of the algorithm. Comparisons with Baum's reestimation suggest that the approach has a superior convergence speed when the likelihood surface is poorly defined due to, for example, a low signal-to-noise ratio or the aggregation of multiple states having identical conductances.     

Hidden Markov analysis of mechanosensitive ion channel gating

Patch clamp data from the large conductance mechanosensitive channel (MscL) in E. coli was studied with the aim of developing a strategy for statistical analysis based on hidden Markov models (HMMs) and determining the number of conductance levels of the channel, together with mean current, mean dwell time and equilibrium probability of occupancy for each level. The models incorporated state-dependent white noise and moving average adjustment for filtering, with maximum likelihood parameter estimates obtained using an EM (expectation-maximisation) based iteration. Adjustment for filtering was included as it could be expected that the electronic filter used in recording would have a major effect on obviously brief intermediate conductance level sojourns. Preliminary data analysis revealed that the brevity of intermediate level sojourns caused difficulties in assignment of data points to levels as a result of over-estimation of noise variances. When reasonable constraints were placed on these variances using the better determined noise variances for the closed and fully open levels, idealisation anomalies were eliminated. Nevertheless, simulations suggested that mean sojourn times for the intermediate levels were still considerably over-estimated, and that recording bandwidth was a major limitation; improved results were obtained with higher bandwidth data (10 kHz sampled at 25 kHz). The simplest model consistent with these data had four open conductance levels, intermediate levels being approximately 20%, 51% and 74% of fully open. The mean lifetime at the fully open level was about 1 ms; estimates for the three intermediate levels were 54-92 micros, probably still over-estimates.     

Fractal and Markov behavior in ion channel kinetics

Kinetic analysis of ion channel recordings attempts to distinguish the number and lifetimes of channel molecular states. Most kinetic analysis assumes that the lifetime of each state is independent of previous channel history, so that open and closed durations are Markov processes whose probability densities are sums of exponential decays. An alternative approach assumes that channel molecules have many configurtions with widely varying lifetimes. Rates of opening and closing then vary with the time scale of observation, leading to fractal kinetics. We have examined kinetic behavior in two types of channels from human and avian fibroblasts, using a maximum likehood method to test the dependence of rates on observational time scale. For both channels, openings showed mixed fractal and Markov behavior, while closings gave mainly fractal kinetics.     

Characterization of single channel currents using digital signal processing techniques based on Hidden Markov Models.

Techniques for extracting small, single channel ion currents from background noise are described and tested. It is assumed that single channel currents are generated by a first-order, finite-state, discrete-time, Markov process to which is added 'white' background noise from the recording apparatus (electrode, amplifiers, etc). Given the observations and the statistics of the background noise, the techniques described here yield a posteriori estimates of the most likely signal statistics, including the Markov model state transition probabilities, duration (open- and closed-time) probabilities, histograms, signal levels, and the most likely state sequence. Using variations of several algorithms previously developed for solving digital estimation problems, we have demonstrated that: (1) artificial, small, first-order, finite-state, Markov model signals embedded in simulated noise can be extracted with a high degree of accuracy, (2) processing can detect signals that do not conform to a first-order Markov model but the method is less accurate when the background noise is not white, and (3) the techniques can be used to extract from the baseline noise single channel currents in neuronal membranes. Some studies have been included to test the validity of assuming a first-order Markov model for biological signals. This method can be used to obtain directly from digitized data, channel characteristics such as amplitude distributions, transition matrices and open- and closed-time durations.     

Hidden Markov Modeling with HMMTeacher

Is it possible to learn and create a first Hidden Markov Model (HMM) without programming skills or understanding the algorithms in detail? In this concise tutorial, we present the HMM through the 2 general questions it was initially developed to answer and describe its elements. The HMM elements include variables, hidden and observed parameters, the vector of initial probabilities, and the transition and emission probability matrices. Then, we suggest a set of ordered steps, for modeling the variables and illustrate them with a simple exercise of modeling and predicting transmembrane segments in a protein sequence. Finally, we show how to interpret the results of the algorithms for this particular problem. To guide the process of information input and explicit solution of the basic HMM algorithms that answer the HMM questions posed, we developed an educational webserver called HMMTeacher. Additional solved HMM modeling exercises can be found in the user’s manual and answers to frequently asked questions. HMMTeacher is available at https://hmmteacher.mobilomics.org, mirrored at https://hmmteacher1.mobilomics.org. A repository with the code of the tool and the webpage is available at https://gitlab.com/kmilo.f/hmmteacher.     

Hidden Markov Models and Animal Behaviour

This paper proposes the use of hidden Markov time series models for the analysis of the behaviour sequences of one or more animals under observation. These models have advantages over the Markov chain models commonly used for behaviour sequences, as they can allow for time-trend or expansion to several subjects without sacrificing parsimony. Furthermore, they provide an alternative to higher-order Markov chain models if a first-order Markov chain is unsatisfactory as a model. To illustrate the use of such models, we fit multivariate and univariate hidden Markov models allowing for time-trend to data from an experiment investigating the effects of feeding on the locomotory behaviour of locusts (Locusta migratoria).     

Relationship between membrane excitability and single channel open-close kinetics.

We have developed a novel technique for simulating the influence of the effects of single channel kinetics on the voltage changes associated with membrane excitability. The technique uses probability distribution functions for the durations of channel open- and closed-state lifetimes, which can be calculated for any model of the ion conductance process. To illustrate the technique, we have used the Hodgkin and Huxley model of nerve membrane ion conductances to simulate channel kinetics during predetermined voltage changes, such as a voltage jump and an action potential. We have also simulated the influence of channels on voltage changes in a free running, non-voltage-clamped patch of membrane 1 micron2 or less in area. The latter results provide a direct illustration of the relationship between fluctuations of membrane excitability and fluctuations in channel open- and closed-state lifetimes.     

Correlation functions of a function of a finite-state Markov process with application to channel kinetics

We show that the lagged moments of all orders of a function of a finite-state Markov process are determined by the first three moments. We discuss the application of this and subsidiary results to the analysis of data on channels in cell membranes.     

Statistical inference from single channel records: two-state Markov model with limited time resolution

Though stochastic models are widely used to describe single ion channel behaviour, statistical inference based on them has received little consideration. This paper describes techniques of statistical inference, in particular likelihood methods, suitable for Markov models incorporating limited time resolution by means of a discrete detection limit. To simplify the analysis, attention is restricted to two-state models, although the methods have more general applicability. Non-uniqueness of the mean open-time and mean closed-time estimators obtained by moment methods based on single exponential approximations to the apparent open-time and apparent closed-time distributions has been reported. The present study clarifies and extends this previous work by proving that, for such approximations, the likelihood equations as well as the moment equations (usually) have multiple solutions. Such non-uniqueness corresponds to non-identifiability of the statistical model for the apparent quantities. By contrast, higher-order approximations yield theoretically identifiable models. Likelihood-based estimation procedures are developed for both single exponential and bi-exponential approximations. The methods and results are illustrated by numerical examples based on literature and simulated data, with consideration given to empirical distributions and model control, likelihood plots, and point estimation and confidence regions.     

The use of quartz patch pipettes for low noise single channel recording.

Quartz has a dissipation factor of approximately 10(-4), which is an order of magnitude less than that of the best glasses previously used to fabricate patch pipettes; it's dielectric constant of 3.8 is also lower than that of other glasses. On the basis of these electrical characteristics it is expected that patch pipettes pulled from quartz tubing will produce significantly less noise than pipettes made from other glasses. Our work confirms these expectations and we describe theoretical and practical aspects of the use of quartz pipettes for single channel patch voltage clamp measurements. Methods for pulling quartz pipettes with a laser-based puller and coating them with low-loss elastomers are discussed, as are precautions that are necessary to achieve low noise recordings. We have shown that quartz pipettes can be pulled from tubing with outer diameter to inner diameter ratios as large as 3 and a method of applying heavy elastomer coatings all the way to the tip of pipettes is presented. Noise sources arising from the pipette and its holder are described theoretically, and it is shown that measured noise is in good agreement with such predictions. With low noise capacitive feedback electronics, small geometry holders, and thick-walled quartz pipettes coated with low-loss elastomers we have been routinely able to achieve noise of 100 fA rms or less in a 5-kHz bandwidth with real cell patches and a pipette immersion depth of approximately 2 mm. On occasion we have achieved noise as low as 60 fA rms in this bandwidth.     

A Latent Class Model with Hidden Markov Dependence for Array CGH Data

Summary Array CGH is a high‐throughput technique designed to detect genomic alterations linked to the development and progression of cancer. The technique yields fluorescence ratios that characterize DNA copy number change in tumor versus healthy cells. Classification of tumors based on aCGH profiles is of scientific interest but the analysis of these data is complicated by the large number of highly correlated measures. In this article, we develop a supervised Bayesian latent class approach for classification that relies on a hidden Markov model to account for the dependence in the intensity ratios. Supervision means that classification is guided by a clinical endpoint. Posterior inferences are made about class‐specific copy number gains and losses. We demonstrate our technique on a study of brain tumors, for which our approach is capable of identifying subsets of tumors with different genomic profiles, and differentiates classes by survival much better than unsupervised methods.     

隐马尔科夫过程在生物信息学中的应用

隐马尔科夫过程（hidden markov model,简称HMM）是20世纪70年代提出来的一种统计方法,以前主要用于语音识别。1989年Churchill将其引入计算生物学。目前,HMM是生物信息学中应用比较广泛的一种统计方法,主要用于：线性序列分析、模型分析、基因发现等方面。对HMM进行了简明扼要的描述,并对其在上述几个方面的应用作一概略介绍。