Docking and scoring protein complexes: CAPRI 3rd Edition

The performance of methods for predicting protein-protein interactions at the atomic scale is assessed by evaluating blind predictions performed during 2005-2007 as part of Rounds 6-12 of the community-wide experiment on Critical Assessment of PRedicted Interactions (CAPRI). These Rounds also included a new scoring experiment, where a larger set of models contributed by the predictors was made available to groups developing scoring functions. These groups scored the uploaded set and submitted their own best models for assessment. The structures of nine protein complexes including one homodimer were used as targets. These targets represent biologically relevant interactions involved in gene expression, signal transduction, RNA, or protein processing and membrane maintenance. For all the targets except one, predictions started from the experimentally determined structures of the free (unbound) components or from models derived by homology, making it mandatory for docking methods to model the conformational changes that often accompany association. In total, 63 groups and eight automatic servers, a substantial increase from previous years, submitted docking predictions, of which 1994 were evaluated here. Fifteen groups submitted 305 models for five targets in the scoring experiment. Assessment of the predictions reveals that 31 different groups produced models of acceptable and medium accuracy-but only one high accuracy submission-for all the targets, except the homodimer. In the latter, none of the docking procedures reproduced the large conformational adjustment required for correct assembly, underscoring yet again that handling protein flexibility remains a major challenge. In the scoring experiment, a large fraction of the groups attained the set goal of singling out the correct association modes from incorrect solutions in the limited ensembles of contributed models. But in general they seemed unable to identify the best models, indicating that current scoring methods are probably not sensitive enough. With the increased focus on protein assemblies, in particular by structural genomics efforts, the growing community of CAPRI predictors is engaged more actively than ever in the development of better scoring functions and means of modeling conformational flexibility, which hold promise for much progress in the future.     

CAPRI: a Critical Assessment of PRedicted Interactions

CAPRI is a communitywide experiment to assess the capacity of protein-docking methods to predict protein-protein interactions. Nineteen groups participated in rounds 1 and 2 of CAPRI and submitted blind structure predictions for seven protein-protein complexes based on the known structure of the component proteins. The predictions were compared to the unpublished X-ray structures of the complexes. We describe here the motivations for launching CAPRI, the rules that we applied to select targets and run the experiment, and some conclusions that can already be drawn. The results stress the need for new scoring functions and for methods handling the conformation changes that were observed in some of the target systems. CAPRI has already been a powerful drive for the community of computational biologists who development docking algorithms. We hope that this issue of Proteins will also be of interest to the community of structural biologists, which we call upon to provide new targets for future rounds of CAPRI, and to all molecular biologists who view protein-protein recognition as an essential process.     

The targets of CAPRI rounds 6-12

Six protein-protein complexes and two homodimeric proteins involved in a variety of biological processes were offered as targets to CAPRI by crystallographers in Rounds 6-12. CAPRI predictor groups had to predict their structure by docking the free proteins, which they did with a degree of success that depended largely on the amplitude of the conformation changes. In one case at least, the prediction pointed to alternative possibilities of interactions in the crystal of a complex, showing that docking methods have value even when there is an experimental structure.     

Docking essential dynamics eigenstructures

This article describes our attempts to dock the targets in CAPRI Rounds 3-5 using Hex 4.2, and it introduces a novel essential dynamics approach to generate multiple feasible conformations for docking. In the blind trial, the basic Hex algorithm found 1 high-accuracy solution for CAPRI Target 12, and several further medium- and low-accuracy solutions for Targets 11, 12, 13, and 14. Subsequent a posteriori docking of the targets using essential dynamics "eigenstructures" was found to give consistently better predictions than rigidly docking only the unbound or model-built starting structures. Some suggestions to improve this promising new approach are presented.     

Assessment of blind predictions of protein-protein interactions: current status of docking methods

The current status of docking procedures for predicting protein-protein interactions starting from their three-dimensional structure is assessed from a first major evaluation of blind predictions. This evaluation was performed as part of a communitywide experiment on Critical Assessment of PRedicted Interactions (CAPRI). Seven newly determined structures of protein-protein complexes were available as targets for this experiment. These were the complexes between a kinase and its protein substrate, between a T-cell receptor beta-chain and a superantigen, and five antigen-antibody complexes. For each target, the predictors were given the experimental structures of the free components, or of one free and one bound component in a random orientation. The structure of the complex was revealed only at the time of the evaluation. A total of 465 predictions submitted by 19 groups were evaluated. These groups used a wide range of algorithms and scoring functions, some of which were completely novel. The quality of the predicted interactions was evaluated by comparing residue-residue contacts and interface residues to those in the X-ray structures and by analyzing the fit of the ligand molecules (the smaller of the two proteins in the complex) or of interface residues only, in the predicted versus target complexes. A total of 14 groups produced predictions, ranking from acceptable to highly accurate for five of the seven targets. The use of available biochemical and biological information, and in one instance structural information, played a key role in achieving this result. It was essential for identifying the native binding modes for the five correctly predicted targets, including the kinase-substrate complex where the enzyme changes conformation on association. But it was also the cause for missing the correct solution for the two remaining unpredicted targets, which involve unexpected antigen-antibody binding modes. Overall, this analysis reveals genuine progress in docking procedures but also illustrates the remaining serious limitations and points out the need for better scoring functions and more effective ways for handling conformational flexibility.     

Challenges and opportunities of automated protein-protein docking: HDOCK server vs human predictions in CAPRI Rounds 38-46

Protein-protein docking plays an important role in the computational prediction of the complex structure between two proteins. For years, a variety of docking algorithms have been developed, as witnessed by the critical assessment of prediction interactions (CAPRI) experiments. However, despite their successes, many docking algorithms often require a series of manual operations like modeling structures from sequences, incorporating biological information, and selecting final models. The difficulties in these manual steps have significantly limited the applications of protein-protein docking, as most of the users in the community are nonexperts in docking. Therefore, automated docking like a web server, which can give a comparable performance to human docking protocol, is pressingly needed. As such, we have participated in the blind CAPRI experiments for Rounds 38-45 and CASP13-CAPRI challenge for Round 46 with both our HDOCK automated docking web server and human docking protocol. It was shown that our HDOCK server achieved an “acceptable” or higher CAPRI-rated model in the top 10 submitted predictions for 65.5% and 59.1% of the targets in the docking experiments of CAPRI and CASP13-CAPRI, respectively, which are comparable to 66.7% and 54.5% for human docking protocol. Similar trends can also be observed in the scoring experiments. These results validated our HDOCK server as an efficient automated docking protocol for nonexpert users. Challenges and opportunities of automated docking are also discussed.     

The targets of CAPRI rounds 3-5

Ten protein-protein complexes have been offered by X-ray crystallographers as targets for structure prediction in Rounds 3-5 of the CAPRI experiment. They illustrate molecular recognition in several domains of biology: enzyme regulation, antigen-antibody recognition, signal transduction, and oligomer assembly. The targets presented various degrees of difficulty to the predictors, depending on their status (bound when components were taken from the complex, unbound when coming from independent structures of the free proteins), the amplitude of conformation changes, and the amount of biological information available. Predictors produced high-quality models of 6 of the targets, good models of 3 others, and failed only in 1 case, where the conformation change was particularly large. This result demonstrates significant progress relative to earlier rounds of CAPRI.     

Evaluation of protein docking predictions using Hex 3.1 in CAPRI rounds 1 and 2

This article describes and reviews our efforts using Hex 3.1 to predict the docking modes of the seven target protein-protein complexes presented in the CAPRI (Critical Assessment of Predicted Interactions) blind docking trial. For each target, the structure of at least one of the docking partners was given in its unbound form, and several of the targets involved large multimeric structures (e.g., Lactobacillus HPr kinase, hemagglutinin, bovine rotavirus VP6). Here we describe several enhancements to our original spherical polar Fourier docking correlation algorithm. For example, a novel surface sphere smothering algorithm is introduced to generate multiple local coordinate systems around the surface of a large receptor molecule, which may be used to define a small number of initial ligand-docking orientations distributed over the receptor surface. High-resolution spherical polar docking correlations are performed over the resulting receptor surface patches, and candidate docking solutions are refined by using a novel soft molecular mechanics energy minimization procedure. Overall, this approach identified two good solutions at rank 5 or less for two of the seven CAPRI complexes. Subsequent analysis of our results shows that Hex 3.1 is able to place good solutions within a list of 相似文献   

The performance of ZDOCK and ZRANK in rounds 6-11 of CAPRI

We present an evaluation of our protein-protein docking approach using the ZDOCK and ZRANK algorithms, in combination with structural clustering and filtering, utilizing biological data in Rounds 6-11 of the CAPRI docking experiment. We achieved at least one prediction of acceptable accuracy for five of six targets submitted. In addition, two targets resulted in medium-accuracy predictions. In the new scoring portion of the CAPRI exercise, we were able to attain at least one acceptable prediction for the three targets submitted and achieved three medium-accuracy predictions for Target 26. Scoring was performed using ZRANK, a new algorithm for reranking initial-stage docking predictions using a weighted energy function and no structural refinement. Here we outline a practical and successful docking strategy, given limited prior biological knowledge of the complex to be predicted.     

ATTRACT: protein-protein docking in CAPRI using a reduced protein model

Protein-protein complex structures have been predicted for CAPRI Rounds 3 and 5 using a reduced protein model. Proteins are represented by up to 3 pseudoatoms per amino acid. The docking approach termed ATTRACT is based on energy minimization in translational and rotational degrees of freedom of one protein with respect to another protein. The reduced protein model allows one to perform systematic docking minimization of many thousand start structures in reasonable computer time. Flexibility of critical surface side-chains can be accounted for by a multiple conformational copy approach. The multicopy approach allows simultaneous adjustment of side-chain conformations and optimization of translational and rotational degrees of freedom of one protein with respect to the partner during docking. For 3 (Targets 8, 14, and 19) out of 5 CAPRI targets, the approach resulted in predictions in close agreement with experiment [root-mean-square deviation (RMSD) of backbone atoms within 10 A of the protein-protein interface < 1.8 A]. The comparison of predicted and experimental structures of the CAPRI targets indicates that besides local conformational changes (e.g., changes in side-chain conformations), global conformational changes of the protein backbone can be critical for complex formation. These conformational changes not accounted for during docking are a likely reason for the unrealistic predictions in 2 cases (Targets 9 and 18).     

Performance of ZDOCK and IRAD in CAPRI rounds 39-45

We report docking performance on the six targets of Critical Assessment of PRedicted Interactions (CAPRI) rounds 39-45 that involved heteromeric protein-protein interactions and had the solved structures released since the rounds were held. Our general strategy involved protein-protein docking using ZDOCK, reranking using IRAD, and structural refinement using Rosetta. In addition, we made extensive use of experimental data to guide our docking runs. All the experimental information at the amino-acid level proved correct. However, for two targets, we also used protein-complex structures as templates for modeling interfaces. These resulted in incorrect predictions, presumably due to the low sequence identity between the targets and templates. Albeit a small number of targets, the performance described here compared somewhat less favorably with our previous CAPRI reports, which may be due to the CAPRI targets being increasingly challenging.     

Assessing predictions of protein-protein interaction: the CAPRI experiment

The Critical Assessment of PRedicted Interactions (CAPRI) experiment was designed in 2000 to test protein docking algorithms in blind predictions of the structure of protein-protein complexes. In four years, 17 complexes offered by crystallographers as targets prior to publication, have been subjected to structure prediction by docking their two components. Models of these complexes were submitted by predictor groups and assessed by comparing their geometry to the X-ray structure and by evaluating the quality of the prediction of the regions of interaction and of the pair wise residue contacts. Prediction was successful on 12 of the 17 targets, most of the failures being due to large conformation changes that the algorithms could not cope with. Progress in the prediction quality observed in four years indicates that the experiment is a powerful incentive to develop new procedures that allow for flexibility during docking and incorporate nonstructural information. We therefore call upon structural biologists who study protein-protein complexes to provide targets for further rounds of CAPRI predictions.     

Performance of human and server prediction in CAPRI rounds 38-45

CAPRI challenges offer a variety of blind tests for protein-protein interaction prediction. In CAPRI Rounds 38-45, we generated a set of putative binding modes for each target with an FFT-based docking algorithm, and then scored and ranked these binding modes with a proprietary scoring function, ITScorePP. We have also developed a novel web server, Rebipp. The algorithm utilizes information retrieval to identify relevant biological information to significantly reduce the search space for a particular protein. In parallel, we have also constructed a GPU-based docking server, MDockPP, for protein-protein complex structure prediction. Here, the performance of our protocol in CAPRI rounds 38-45 is reported, which include 16 docking and scoring targets. Among them, three targets contain multiple interfaces: Targets 124, 125, and 136 have 2, 4, and 3 interfaces, respectively. In the predictor experiments, we predicted correct binding modes for nine targets, including one high-accuracy interface, six medium-accuracy binding modes, and six acceptable-accuracy binding modes. For the docking server prediction experiments, we predicted correct binding modes for eight targets, including one high-accuracy, three medium-accuracy, and five acceptable-accuracy binding modes.     

Performance of the first protein docking server ClusPro in CAPRI rounds 3-5

To evaluate the current status of the protein-protein docking field, the CAPRI experiment came to life. Researchers are given the receptor and ligand 3-dimensional (3D) coordinates before the cocrystallized complex is published. Human predictions of the complex structure are supposed to be submitted within 3 weeks, whereas the server ClusPro has only 24 h and does not make use of any biochemical information. From the 10 targets analyzed in the second evaluation meeting of CAPRI, ClusPro was able to predict meaningful models for 5 targets using only empirical free energy estimates. For two of the targets, the server predictions were assessed to be among the best in the field. Namely, for Targets 8 and 12, ClusPro predicted the model with the most accurate binding-site interface and the model with the highest percentage of nativelike contacts, among 180 and 230 submissions, respectively. After CAPRI, the server has been further developed to predict oligomeric assemblies, and new tools now allow the user to restrict the search for the complex to specific regions on the protein surface, significantly enhancing the predictive capabilities of the server. The performance of ClusPro in CAPRI Rounds 3-5 suggests that clustering the low free energy (i.e., desolvation and electrostatic energy) conformations of a homogeneous conformational sampling of the binding interface is a fast and reliable procedure to detect protein-protein interactions and eliminate false positives. Not including targets that had a significant structural rearrangement upon binding, the success rate of ClusPro was found to be around 71%.     

CAPRI rounds 3-5 reveal promising successes and future challenges for RosettaDock

CAPRI Rounds 3, 4, and 5 are the first public test of the published RosettaDock algorithm. The targets cover a wide range of sizes and shapes. For most targets, published biological information indicated the region of the binding site on at least one docking partner. The RosettaDock algorithm produced high accuracy predictions for three targets, medium-accuracy predictions for two targets, and an acceptable prediction for one target. RosettaDock predicted all five targets with less than 450 residues to high or medium accuracy, but it predicted only one of seven targets with above 450 residues to acceptable accuracy. RosettaDock's high-accuracy predictions for small to moderately large targets reveal the predictive power and fidelity of the algorithm, especially the high-resolution refinement and scoring protocol. In addition, RosettaDock can predict complexes from at least one homology-modeled docking partner with comparable accuracy to unbound cases of similar size. Larger targets present a more intensive sampling problem, and some large targets present repulsive barriers to entering the binding site. Ongoing improvements to RosettaDock's low-resolution search may alleviate this problem. This first public test suggests that RosettaDock can be useful in a significant range of applications in biochemistry and cell biology.     

Complex-type-dependent scoring functions in protein-protein docking

A major challenge in the field of protein-protein docking is to discriminate between the many wrong and few near-native conformations, i.e. scoring. Here, we introduce combinatorial complex-type-dependent scoring functions for different types of protein-protein complexes, protease/inhibitor, antibody/antigen, enzyme/inhibitor and others. The scoring functions incorporate both physical and knowledge-based potentials, i.e. atomic contact energy (ACE), the residue pair potential (RP), electrostatic and van der Waals' interactions. For different type complexes, the weights of the scoring functions were optimized by the multiple linear regression method, in which only top 300 structures with ligand root mean square deviation (L_RMSD) less than 20 A from the bound (co-crystallized) docking of 57 complexes were used to construct a training set. We employed the bound docking studies to examine the quality of the scoring function, and also extend to the unbound (separately crystallized) docking studies and extra 8 protein-protein complexes. In bound docking of the 57 cases, the first hits of protease/inhibitor cases are all ranked in the top 5. For the cases of antibody/antigen, enzyme/inhibitor and others, there are 17/19, 5/6 and 13/15 cases with the first hits ranked in the top 10, respectively. In unbound docking studies, the first hits of 9/17 protease/inhibitor, 6/19 antibody/antigen, 1/6 enzyme/inhibitor and 6/15 others' complexes are ranked in the top 10. Additionally, for the extra 8 cases, the first hits of the two protease/inhibitor cases are ranked in the top for the bound and unbound test. For the two enzyme/inhibitor cases, the first hits are ranked 1st for bound test, and the 119th and 17th for the unbound test. For the others, the ranks of the first hits are the 1st for the bound test and the 12th for the 1WQ1 unbound test. To some extent, the results validated our divide-and-conquer strategy in the docking study, which might hopefully shed light on the prediction of protein-protein interactions.     

Searching for protein-protein interaction sites and docking by the methods of molecular dynamics, grid scoring, and the pairwise interaction potential of amino acid residues

In CAPRI Rounds 1 and 2, we assumed that because there are many ionic charges that weaken electrostatic interaction forces in living cells, the hydrophobic interaction force might be important entropically. As a result of Rounds 1 and 2, the predictions for binding sites and geometric centers were acceptable, but those of the binding axes were poor, because only the largest benzene cluster was used for generating the initial docking structures. These were generated by fitting of benzene clusters formed on the surface of receptor and ligand. In CAPRI Rounds 3-5, the grid-scoring sum on the protein-protein interaction surface and the pairwise potential of the amino acid residues, which were indicated as coming easily into the protein-protein interaction regions, were used as the calculation methods, along with the smaller benzene clusters that participated in benzene cluster fitting. Good predicted models were obtained for Targets 11 and 12. When the modeled receptor proteins were superimposed on the experimental structures, the smallest ligand root-mean-square deviation (RMSD) values corresponding to the RMSD between the model and experimental structures were 6.2 A and 7.3 A, respectively.     

ZDOCK and RDOCK performance in CAPRI rounds 3, 4, and 5

We present an evaluation of the results of our ZDOCK and RDOCK algorithms in Rounds 3, 4, and 5 of the protein docking challenge CAPRI. ZDOCK is a Fast Fourier Transform (FFT)-based, initial-stage rigid-body docking algorithm, and RDOCK is an energy minimization algorithm for refining and reranking ZDOCK results. Of the 9 targets for which we submitted predictions, we attained at least acceptable accuracy for 7, at least medium accuracy for 6, and high accuracy for 3. These results are evidence that ZDOCK in combination with RDOCK is capable of making accurate predictions on a diverse set of protein complexes.     

Protein-protein docking using 3D-Dock in rounds 3, 4, and 5 of CAPRI

In rounds 3-5 of CAPRI, the community-wide experiment on the comparative evaluation of protein-protein docking for structure prediction, we applied the 3D-Dock software package to predict the atomic structures of nine biophysical interactions. This approach starts with an initial grid-based shape complementarity search. The product of this is a large number of potential interacting conformations that are subsequently ranked by interface residue propensities and interaction energies. Refinement through detailed energetics and optimization of side-chain positions using a rotamer library is also performed. For rounds 3, 4, and 5 of the CAPRI evaluation, where possible, we clustered functional residues on the surfaces of the monomers as an indication of binding sites, using sequence based evolutionary conservations. In certain targets this provided a very useful tool for identifying the areas of interaction. During round 5, we also applied the techniques of side-chain trimming and geometrical clustering described in the literature. Of the nine target complexes in rounds 3-5, we predicted conformations that contained at least some correct contact residues for seven of these systems. For two of the targets, we submitted predictions that were considered as medium-quality. These were a nidogen-laminin complex for target 8 (T08) and a serine-threonine phosphatase bound to a targeting subunit (T14). For a further three target systems, we produced models that were rated as acceptable predictions.     

RosettaDock in CAPRI rounds 6-12

A challenge in protein-protein docking is to account for the conformational changes in the monomers that occur upon binding. The RosettaDock method, which incorporates sidechain flexibility but keeps the backbone fixed, was found in previous CAPRI rounds (4 and 5) to generate docking models with atomic accuracy, provided that conformational changes were mainly restricted to protein sidechains. In the recent rounds of CAPRI (6-12), large backbone conformational changes occur upon binding for several target complexes. To address these challenges, we explicitly introduced backbone flexibility in our modeling procedures by combining rigid-body docking with protein structure prediction techniques such as modeling variable loops and building homology models. Encouragingly, using this approach we were able to correctly predict a significant backbone conformational change of an interface loop for Target 20 (12 A rmsd between those in the unbound monomer and complex structures), but accounting for backbone flexibility in protein-protein docking is still very challenging because of the significantly larger conformational space, which must be surveyed. Motivated by these CAPRI challenges, we have made progress in reformulating RosettaDock using a "fold-tree" representation, which provides a general framework for treating a wide variety of flexible-backbone docking problems.