5q17 Citations

D3R Grand Challenge 2: blind prediction of protein-ligand poses, affinity rankings, and relative binding free energies.

Abstract

The Drug Design Data Resource (D3R) ran Grand Challenge 2 (GC2) from September 2016 through February 2017. This challenge was based on a dataset of structures and affinities for the nuclear receptor farnesoid X receptor (FXR), contributed by F. Hoffmann-La Roche. The dataset contained 102 IC50 values, spanning six orders of magnitude, and 36 high-resolution co-crystal structures with representatives of four major ligand classes. Strong global participation was evident, with 49 participants submitting 262 prediction submission packages in total. Procedurally, GC2 mimicked Grand Challenge 2015 (GC2015), with a Stage 1 subchallenge testing ligand pose prediction methods and ranking and scoring methods, and a Stage 2 subchallenge testing only ligand ranking and scoring methods after the release of all blinded co-crystal structures. Two smaller curated sets of 18 and 15 ligands were developed to test alchemical free energy methods. This overview summarizes all aspects of GC2, including the dataset details, challenge procedures, and participant results. We also consider implications for progress in the field, while highlighting methodological areas that merit continued development. Similar to GC2015, the outcome of GC2 underscores the pressing need for methods development in pose prediction, particularly for ligand scaffolds not currently represented in the Protein Data Bank ( http://www.pdb.org ), and in affinity ranking and scoring of bound ligands.

Articles - 5q17 mentioned but not cited (2)

  1. D3R Grand Challenge 2: blind prediction of protein-ligand poses, affinity rankings, and relative binding free energies. Gaieb Z, Liu S, Gathiaka S, Chiu M, Yang H, Shao C, Feher VA, Walters WP, Kuhn B, Rudolph MG, Burley SK, Gilson MK, Amaro RE. J Comput Aided Mol Des 32 1-20 (2018)
  2. Exploring Ligand Stability in Protein Crystal Structures Using Binding Pose Metadynamics. Fusani L, Palmer DS, Somers DO, Wall ID. J Chem Inf Model 60 1528-1539 (2020)


Reviews citing this publication (11)

  1. Empirical Scoring Functions for Structure-Based Virtual Screening: Applications, Critical Aspects, and Challenges. Guedes IA, Pereira FSS, Dardenne LE. Front Pharmacol 9 1089 (2018)
  2. Key Topics in Molecular Docking for Drug Design. Torres PHM, Sodero ACR, Jofily P, Silva-Jr FP. Int J Mol Sci 20 (2019)
  3. Quantum Chemical Approaches in Structure-Based Virtual Screening and Lead Optimization. Cavasotto CN, Adler NS, Aucar MG. Front Chem 6 188 (2018)
  4. Improving small molecule virtual screening strategies for the next generation of therapeutics. Wingert BM, Camacho CJ. Curr Opin Chem Biol 44 87-92 (2018)
  5. Merging Ligand-Based and Structure-Based Methods in Drug Discovery: An Overview of Combined Virtual Screening Approaches. Vázquez J, López M, Gibert E, Herrero E, Luque FJ. Molecules 25 (2020)
  6. Protein-Ligand Docking in the Machine-Learning Era. Yang C, Chen EA, Zhang Y. Molecules 27 4568 (2022)
  7. Impact of the Protein Data Bank on antineoplastic approvals. Westbrook JD, Soskind R, Hudson BP, Burley SK. Drug Discov Today 25 837-850 (2020)
  8. In Silico Toxicology Data Resources to Support Read-Across and (Q)SAR. Pawar G, Madden JC, Ebbrell D, Firman JW, Cronin MTD. Front Pharmacol 10 561 (2019)
  9. Delta Machine Learning to Improve Scoring-Ranking-Screening Performances of Protein-Ligand Scoring Functions. Yang C, Zhang Y. J Chem Inf Model 62 2696-2712 (2022)
  10. International Union of Basic and Clinical Pharmacology CXIII: Nuclear Receptor Superfamily-Update 2023. Burris TP, de Vera IMS, Cote I, Flaveny CA, Wanninayake US, Chatterjee A, Walker JK, Steinauer N, Zhang J, Coons LA, Korach KS, Cain DW, Hollenberg AN, Webb P, Forrest D, Jetten AM, Edwards DP, Grimm SL, Hartig S, Lange CA, Richer JK, Sartorius CA, Tetel M, Billon C, Elgendy B, Hegazy L, Griffett K, Peinetti N, Burnstein KL, Hughes TS, Sitaula S, Stayrook KR, Culver A, Murray MH, Finck BN, Cidlowski JA. Pharmacol Rev 75 1233-1318 (2023)
  11. Solvated interaction energy: from small-molecule to antibody drug design. Purisima EO, Corbeil CR, Gaudreault F, Wei W, Deprez C, Sulea T. Front Mol Biosci 10 1210576 (2023)

Articles citing this publication (70)

  1. Protein Data Bank: the single global archive for 3D macromolecular structure data. wwPDB consortium. Nucleic Acids Res 47 D520-D528 (2019)
  2. D3R Grand Challenge 3: blind prediction of protein-ligand poses and affinity rankings. Gaieb Z, Parks CD, Chiu M, Yang H, Shao C, Walters WP, Lambert MH, Nevins N, Bembenek SD, Ameriks MK, Mirzadegan T, Burley SK, Amaro RE, Gilson MK. J Comput Aided Mol Des 33 1-18 (2019)
  3. Molecular tuning of farnesoid X receptor partial agonism. Merk D, Sreeramulu S, Kudlinzki D, Saxena K, Linhard V, Gande SL, Hiller F, Lamers C, Nilsson E, Aagaard A, Wissler L, Dekker N, Bamberg K, Schubert-Zsilavecz M, Schwalbe H. Nat Commun 10 2915 (2019)
  4. The SAMPL6 SAMPLing challenge: assessing the reliability and efficiency of binding free energy calculations. Rizzi A, Jensen T, Slochower DR, Aldeghi M, Gapsys V, Ntekoumes D, Bosisio S, Papadourakis M, Henriksen NM, de Groot BL, Cournia Z, Dickson A, Michel J, Gilson MK, Shirts MR, Mobley DL, Chodera JD. J Comput Aided Mol Des 34 601-633 (2020)
  5. D3R grand challenge 4: blind prediction of protein-ligand poses, affinity rankings, and relative binding free energies. Parks CD, Gaieb Z, Chiu M, Yang H, Shao C, Walters WP, Jansen JM, McGaughey G, Lewis RA, Bembenek SD, Ameriks MK, Mirzadegan T, Burley SK, Amaro RE, Gilson MK. J Comput Aided Mol Des 34 99-119 (2020)
  6. MathDL: mathematical deep learning for D3R Grand Challenge 4. Nguyen DD, Gao K, Wang M, Wei GW. J Comput Aided Mol Des 34 131-147 (2020)
  7. D3R Grand Challenge 4: prospective pose prediction of BACE1 ligands with AutoDock-GPU. Santos-Martins D, Eberhardt J, Bianco G, Solis-Vasquez L, Ambrosio FA, Koch A, Forli S. J Comput Aided Mol Des 33 1071-1081 (2019)
  8. Large-scale prediction of binding affinity in protein-small ligand complexes: the PRODIGY-LIG web server. Vangone A, Schaarschmidt J, Koukos P, Geng C, Citro N, Trellet ME, Xue LC, Bonvin AMJJ. Bioinformatics 35 1585-1587 (2019)
  9. Blinded prediction of protein-ligand binding affinity using Amber thermodynamic integration for the 2018 D3R grand challenge 4. Zou J, Tian C, Simmerling C. J Comput Aided Mol Des 33 1021-1029 (2019)
  10. Calculate protein-ligand binding affinities with the extended linear interaction energy method: application on the Cathepsin S set in the D3R Grand Challenge 3. He X, Man VH, Ji B, Xie XQ, Wang J. J Comput Aided Mol Des 33 105-117 (2019)
  11. Convolutional neural network scoring and minimization in the D3R 2017 community challenge. Sunseri J, King JE, Francoeur PG, Koes DR. J Comput Aided Mol Des 33 19-34 (2019)
  12. High-Throughput Docking Using Quantum Mechanical Scoring. Cavasotto CN, Aucar MG. Front Chem 8 246 (2020)
  13. Cross-docking benchmark for automated pose and ranking prediction of ligand binding. Wierbowski SD, Wingert BM, Zheng J, Camacho CJ. Protein Sci 29 298-305 (2020)
  14. Ligand Gaussian Accelerated Molecular Dynamics (LiGaMD): Characterization of Ligand Binding Thermodynamics and Kinetics. Miao Y, Bhattarai A, Wang J. J Chem Theory Comput 16 5526-5547 (2020)
  15. Are 2D fingerprints still valuable for drug discovery? Gao K, Nguyen DD, Sresht V, Mathiowetz AM, Tu M, Wei GW. Phys Chem Chem Phys 22 8373-8390 (2020)
  16. New prediction categories in CASP15. Kryshtafovych A, Antczak M, Szachniuk M, Zok T, Kretsch RC, Rangan R, Pham P, Das R, Robin X, Studer G, Durairaj J, Eberhardt J, Sweeney A, Topf M, Schwede T, Fidelis K, Moult J. Proteins 91 1550-1557 (2023)
  17. Protein-ligand pose and affinity prediction: Lessons from D3R Grand Challenge 3. Koukos PI, Xue LC, Bonvin AMJJ. J Comput Aided Mol Des 33 83-91 (2019)
  18. SAMPL7 Host-Guest Challenge Overview: assessing the reliability of polarizable and non-polarizable methods for binding free energy calculations. Amezcua M, El Khoury L, Mobley DL. J Comput Aided Mol Des 35 1-35 (2021)
  19. Absolute Free Energy of Binding Calculations for Macrophage Migration Inhibitory Factor in Complex with a Druglike Inhibitor. Qian Y, Cabeza de Vaca I, Vilseck JZ, Cole DJ, Tirado-Rives J, Jorgensen WL. J Phys Chem B 123 8675-8685 (2019)
  20. Continuous Evaluation of Ligand Protein Predictions: A Weekly Community Challenge for Drug Docking. Wagner JR, Churas CP, Liu S, Swift RV, Chiu M, Shao C, Feher VA, Burley SK, Gilson MK, Amaro RE. Structure 27 1326-1335.e4 (2019)
  21. Down-regulation of Long Non-coding RNA LINC01554 in Hepatocellular Cancer and its Clinical Significance. Ding Y, Sun Z, Zhang S, Chen Y, Zhou B, Li G, Sun Q, Zhou D, Ge Y, Yan S, Wang W. J Cancer 11 3369-3374 (2020)
  22. Exploring fragment-based target-specific ranking protocol with machine learning on cathepsin S. Yang Y, Lu J, Yang C, Zhang Y. J Comput Aided Mol Des 33 1095-1105 (2019)
  23. Simple Entropy Terms for End-Point Binding Free Energy Calculations. Menzer WM, Li C, Sun W, Xie B, Xie B, Minh DDL. J Chem Theory Comput 14 6035-6049 (2018)
  24. Bind3P: Optimization of a Water Model Based on Host-Guest Binding Data. Yin J, Henriksen NM, Muddana HS, Gilson MK. J Chem Theory Comput 14 3621-3632 (2018)
  25. Binding mode information improves fragment docking. Jacquemard C, Drwal MN, Desaphy J, Kellenberger E. J Cheminform 11 24 (2019)
  26. Blinded predictions of standard binding free energies: lessons learned from the SAMPL6 challenge. Papadourakis M, Bosisio S, Michel J. J Comput Aided Mol Des 32 1047-1058 (2018)
  27. Computational Identification of Possible Allosteric Sites and Modulators of the SARS-CoV-2 Main Protease. DasGupta D, Chan WKB, Carlson HA. J Chem Inf Model 62 618-626 (2022)
  28. Incorporating Explicit Water Molecules and Ligand Conformation Stability in Machine-Learning Scoring Functions. Lu J, Hou X, Wang C, Zhang Y. J Chem Inf Model 59 4540-4549 (2019)
  29. A Deep-Learning Approach toward Rational Molecular Docking Protocol Selection. Jiménez-Luna J, Cuzzolin A, Bolcato G, Sturlese M, Moro S. Molecules 25 (2020)
  30. Effect of set up protocols on the accuracy of alchemical free energy calculation over a set of ACK1 inhibitors. Granadino-Roldán JM, Mey ASJS, Pérez González JJ, Bosisio S, Rubio-Martinez J, Michel J. PLoS One 14 e0213217 (2019)
  31. Hybrid receptor structure/ligand-based docking and activity prediction in ICM: development and evaluation in D3R Grand Challenge 3. Lam PC, Abagyan R, Totrov M. J Comput Aided Mol Des 33 35-46 (2019)
  32. LNRLMI: Linear neighbour representation for predicting lncRNA-miRNA interactions. Wong L, Huang YA, You ZH, Chen ZH, Cao MY. J Cell Mol Med 24 79-87 (2020)
  33. Relative Binding Energies Predict Crystallographic Binding Modes of Ethionamide Booster Lead Compounds. Tatum NJ, Duarte F, Kamerlin SCL, Pohl E. J Phys Chem Lett 10 2244-2249 (2019)
  34. Robust Free Energy Perturbation Protocols for Creating Molecules in Solution. Cabeza de Vaca I, Zarzuela R, Tirado-Rives J, Jorgensen WL. J Chem Theory Comput 15 3941-3948 (2019)
  35. The Groebke-Blackburn-Bienaymé Reaction. Boltjes A, Dömling A. Eur J Chem 2019 7007-7049 (2019)
  36. An Analysis of Proteochemometric and Conformal Prediction Machine Learning Protein-Ligand Binding Affinity Models. Parks C, Gaieb Z, Amaro RE. Front Mol Biosci 7 93 (2020)
  37. Best practices for constructing, preparing, and evaluating protein-ligand binding affinity benchmarks [Article v0.1]. Hahn DF, Bayly CI, Macdonald HEB, Chodera JD, Mey ASJS, Mobley DL, Benito LP, Schindler CEM, Tresadern G, Warren GL. Living J Comput Mol Sci 4 1497 (2022)
  38. Binding pose and affinity prediction in the 2016 D3R Grand Challenge 2 using the Wilma-SIE method. Hogues H, Sulea T, Gaudreault F, Corbeil CR, Purisima EO. J Comput Aided Mol Des 32 143-150 (2018)
  39. Extensive benchmark of rDock as a peptide-protein docking tool. Soler D, Westermaier Y, Soliva R. J Comput Aided Mol Des 33 613-626 (2019)
  40. Predicting protein-ligand binding modes for CELPP and GC3: workflows and insight. Xu X, Ma Z, Duan R, Zou X. J Comput Aided Mol Des 33 367-374 (2019)
  41. Recent Developments in Linear Interaction Energy Based Binding Free Energy Calculations. Rifai EA, van Dijk M, Geerke DP. Front Mol Biosci 7 114 (2020)
  42. Shape-Restrained Modeling of Protein-Small-Molecule Complexes with High Ambiguity Driven DOCKing. Koukos PI, Réau M, Bonvin AMJJ. J Chem Inf Model 61 4807-4818 (2021)
  43. Use of the Complementarity Principle in Docking Procedures: A New Approach for Evaluating the Correctness of Binding Poses. Rimac H, Grishina M, Potemkin V. J Chem Inf Model 61 1801-1813 (2021)
  44. In silico binding affinity prediction for metabotropic glutamate receptors using both endpoint free energy methods and a machine learning-based scoring function. Zhai J, He X, Sun Y, Wan Z, Ji B, Liu S, Li S, Wang J. Phys Chem Chem Phys 24 18291-18305 (2022)
  45. A community proposal to integrate structural bioinformatics activities in ELIXIR (3D-Bioinfo Community). Orengo C, Velankar S, Wodak S, Zoete V, Bonvin AMJJ, Elofsson A, Feenstra KA, Gerloff DL, Hamelryck T, Hancock JM, Helmer-Citterich M, Hospital A, Orozco M, Perrakis A, Rarey M, Soares C, Sussman JL, Thornton JM, Tuffery P, Tusnady G, Wierenga R, Salminen T, Schneider B. F1000Res 9 (2020)
  46. CACHE (Critical Assessment of Computational Hit-finding Experiments): A public-private partnership benchmarking initiative to enable the development of computational methods for hit-finding. Ackloo S, Al-Awar R, Amaro RE, Arrowsmith CH, Azevedo H, Batey RA, Bengio Y, Betz UAK, Bologa CG, Chodera JD, Cornell WD, Dunham I, Ecker GF, Edfeldt K, Edwards AM, Gilson MK, Gordijo CR, Hessler G, Hillisch A, Hogner A, Irwin JJ, Jansen JM, Kuhn D, Leach AR, Lee AA, Lessel U, Morgan MR, Moult J, Muegge I, Oprea TI, Perry BG, Riley P, Rousseaux SAL, Saikatendu KS, Santhakumar V, Schapira M, Scholten C, Todd MH, Vedadi M, Volkamer A, Willson TM. Nat Rev Chem 6 287-295 (2022)
  47. Computational insights into the binding of IN17 inhibitors to MELK. Harger M, Lee JH, Walker B, Taliaferro JM, Edupuganti R, Dalby KN, Ren P. J Mol Model 25 151 (2019)
  48. Continuous Automated Model EvaluatiOn (CAMEO)-Perspectives on the future of fully automated evaluation of structure prediction methods. Robin X, Haas J, Gumienny R, Smolinski A, Tauriello G, Schwede T. Proteins 89 1977-1986 (2021)
  49. Creating a Virtual Assistant for Medicinal Chemistry. Vidler LR, Baumgartner MP. ACS Med Chem Lett 10 1051-1055 (2019)
  50. Deep neural network affinity model for BACE inhibitors in D3R Grand Challenge 4. Wang B, Ng HL. J Comput Aided Mol Des 34 201-217 (2020)
  51. Docking rigid macrocycles using Convex-PL, AutoDock Vina, and RDKit in the D3R Grand Challenge 4. Kadukova M, Chupin V, Grudinin S. J Comput Aided Mol Des 34 191-200 (2020)
  52. Getting Docking into Shape Using Negative Image-Based Rescoring. Kurkinen ST, Lätti S, Pentikäinen OT, Postila PA. J Chem Inf Model 59 3584-3599 (2019)
  53. Improving ligand 3D shape similarity-based pose prediction with a continuum solvent model. Kumar A, Zhang KYJ. J Comput Aided Mol Des 33 1045-1055 (2019)
  54. Local Interaction Density (LID), a Fast and Efficient Tool to Prioritize Docking Poses. Jacquemard C, Tran-Nguyen VK, Drwal MN, Rognan D, Kellenberger E. Molecules 24 (2019)
  55. Rational creation and systematic analysis of cervical cancer kinase-inhibitor binding profile. Han M, Sun D. J Comput Aided Mol Des 33 689-698 (2019)
  56. Benchmarking ensemble docking methods in D3R Grand Challenge 4. Gan JL, Kumar D, Chen C, Taylor BC, Jagger BR, Amaro RE, Lee CT. J Comput Aided Mol Des 36 87-99 (2022)
  57. Best Practices for Alchemical Free Energy Calculations [Article v1.0]. Mey ASJS, Allen BK, Macdonald HEB, Chodera JD, Hahn DF, Kuhn M, Michel J, Mobley DL, Naden LN, Prasad S, Rizzi A, Scheen J, Shirts MR, Tresadern G, Xu H. Living J Comput Mol Sci 2 (2020)
  58. Letter Best practices for repurposing studies. Lewis RA. J Comput Aided Mol Des 35 1189-1193 (2021)
  59. Coupling enhanced sampling of the apo-receptor with template-based ligand conformers selection: performance in pose prediction in the D3R Grand Challenge 4. Basciu A, Koukos PI, Malloci G, Bonvin AMJJ, Vargiu AV. J Comput Aided Mol Des 34 149-162 (2020)
  60. Dissimilar Ligands Bind in a Similar Fashion: A Guide to Ligand Binding-Mode Prediction with Application to CELPP Studies. Xu X, Zou X. Int J Mol Sci 22 12320 (2021)
  61. Energy-entropy method using multiscale cell correlation to calculate binding free energies in the SAMPL8 host-guest challenge. Ali HS, Chakravorty A, Kalayan J, de Visser SP, Henchman RH. J Comput Aided Mol Des 35 911-921 (2021)
  62. Lin_F9: A Linear Empirical Scoring Function for Protein-Ligand Docking. Yang C, Zhang Y. J Chem Inf Model 61 4630-4644 (2021)
  63. Natural product rhynchophylline prevents stress-induced hair graying by preserving melanocyte stem cells via the β2 adrenergic pathway suppression. Li X, Shi R, Yan L, Chu W, Sun R, Zheng B, Wang S, Tan H, Wang X, Gao Y. Nat Prod Bioprospect 13 54 (2023)
  64. Performance of Force-Field- and Machine Learning-Based Scoring Functions in Ranking MAO-B Protein-Inhibitor Complexes in Relevance to Developing Parkinson's Therapeutics. Murugan NA, Muvva C, Jeyarajpandian C, Jeyakanthan J, Subramanian V. Int J Mol Sci 21 (2020)
  65. Pharmacophore modeling and virtual screening studies for discovery of novel farnesoid X receptor (FXR) agonists. Zhao S, Peng W, Li X, Wang L, Yin W, Wang YD, Hou R, Chen WD. RSC Adv 11 2158-2166 (2021)
  66. SAMPL7 protein-ligand challenge: A community-wide evaluation of computational methods against fragment screening and pose-prediction. Grosjean H, Işık M, Aimon A, Mobley D, Chodera J, von Delft F, Biggin PC. J Comput Aided Mol Des 36 291-311 (2022)
  67. Scoring Functions for Protein-Ligand Binding Affinity Prediction using Structure-Based Deep Learning: A Review. Meli R, Morris GM, Biggin PC. Front Bioinform 2 885983 (2022)
  68. Simplified quality assessment for small-molecule ligands in the Protein Data Bank. Shao C, Westbrook JD, Lu C, Bhikadiya C, Peisach E, Young JY, Duarte JM, Lowe R, Wang S, Rose Y, Feng Z, Burley SK. Structure 30 252-262.e4 (2022)
  69. Study of novel triazolo-benzodiazepine analogues as antidepressants targeting by molecular docking and ADMET properties prediction. Belhassan A, Zaki H, Benlyas M, Lakhlifi T, Bouachrine M. Heliyon 5 e02446 (2019)
  70. Template-guided method for protein-ligand complex structure prediction: Application to CASP15 protein-ligand studies. Xu X, Duan R, Zou X. Proteins 91 1829-1836 (2023)