03 QSPR, QSAR and latent descriptors

Descriptors with meaning, and descriptors without.

Quantitative structure–property and structure–activity relationships map numerical descriptors of a molecule to a property or a biological effect. Some descriptors are physical, such as volume, charge or radius. Others are parameters learned from data that have no physical meaning but still predict. This chapter covers both, how such models are validated, and where they stop being trustworthy.

Computed for this page Published data The 21 × 10 absorption–desorption index (ADI) table of the CO2 screen. Every 8 s, 30% of the cells are hidden at random, then predicted from the rest by an additive model with two latent dimensions (Eq. 3.7); outlined cells are predictions. The table is itself a COSMO-RS-based model output, so this shows the method, not experimental accuracy.

You will see

  • Descriptor families and model forms
  • Validation: R2, Q2, y-randomization, the OECD principles
  • Applicability domain and the Williams plot
  • The founder’s 2016 quantum-descriptor correlations
  • Learned latent parameters, demonstrated on published data

Lab in this chapter

3.1 Descriptors and model forms

A QSPR writes a property y as a function of descriptors d1…dp. Descriptor families include constitutional counts (atoms, groups), topological indices, geometric descriptors (volume, area, sphericity), quantum-chemical descriptors (charges, orbital energies, dielectric energy, σ-moments from COSMO) and, increasingly, learned representations. Group contribution (Chapter 2) is the simplest QSPR: a linear model whose descriptors are group counts.

ŷ = β0 + Σj=1p βj dj   (linear)   or   ŷ = fw(d)   (nonlinear: ANN, GP, trees)
(3.1)

3.2 Validation: what a QSPR has to prove

Fit statistics on training data say little about prediction. A defensible model reports external and cross-validated performance and passes a randomization test:

R2 = 1 − Σ(yi − ŷi)2Σ(yi − ȳ)2,    Q2LOO = 1 − Σ(yi − ŷ(−i))2Σ(yi − ȳ)2
(3.2)

ŷ(−i): prediction for point i from a model fitted without it. In y-randomization, the responses are shuffled and the model refitted many times; a sound model should fail on shuffled data.

For regulatory use, the OECD (2004) principles state that a (Q)SAR should be associated with a defined endpoint, an unambiguous algorithm, a defined domain of applicability, appropriate measures of goodness-of-fit, robustness and predictivity, and a mechanistic interpretation, if possible.

3.3 Applicability domain

A model is only trustworthy near the data it was trained on. For linear models the leverage of a new point measures its distance from the training descriptors:

hi = xiT(XTX)−1xi,    h* = 3(p + 1)n
(3.3)

A Williams plot shows standardized residuals against leverage. Points beyond h* are extrapolations, however good the fit looks. LILM is designed to attach such a domain score to every prediction and to refuse silent ranking outside it. Planned

3.4 The founder’s 2016 quantum-descriptor correlations

Published research Historical founder research

Mehrkesh & Karunanithi, Fluid Phase Equilibria 2016, 427, 498–503. Ion descriptors were taken from COSMO files (COSMObaseIL, BP_TZVP): molar masses, volumes, areas, dielectric energies of cation and anion, a symmetry value built from the ions’ sphericities and the cation–anion distance Rt. The liquid density ρ is also an input; the paper does not state its source. Correlations were found by symbolic regression (Eureqa; Schmidt & Lipson, 2009).

An ad hoc radius. Ionic radii from an equal-volume sphere (van der Waals radii, Rcalc) overestimate real ionic radii. The paper fitted a linear correction against the few ions with measured (X-ray) radii and used the corrected value as a descriptor:

Rpred = 0.48601 Rcalc − 0.01725    (R2 = 0.98622)
(3.4)

Sphericity of each ion, Ψ = π1/3(6Vp)2/3/Ap, entered through a symmetry value σ combining cation and anion sphericity. The resulting correlations:

Tm = a RA + b ρ + c RC σ − d − e MWC − f DiA
(3.5)

a = 11.38, b = 0.05413, c = 196.6, d = 434.3, e = 0.649, f = 1661 (Tm in K; ρ in kg m−3).

ln η = a σ + b Rt + c VolA − d − e AreaA − f T − g DiA − h DiC
(3.6)

a = 16.513, b = 2.2179, c = 0.00892, d = 15.0073, e = 0.02686, f = 0.02975, g = 15.8297, h = 48.1367 (η in cP).

Reported validation (paper’s Tables 1–2)
ModelDataHeld outR2 (all)Avg. rel. error, allTestTrain
Tm (Eq. 3.5)37 ILs17 (45%)0.913.16%2.77%3.48%
ln η (Eq. 3.6)131 points83 (63%)0.916.45%7.40%4.81%

The paper reports that 6.45% compares with about 18% for a model then in COSMOtherm; the reference it cites for that model (Preiss et al., 2010) is a melting-point study, so this is not a like-for-like benchmark. Three cautions apply, as with any QSPR: the data sets are small (37 melting points and 131 viscosity points, of which 20 and 48 were used for fitting); the viscosity split was by data point, and the paper does not say whether the same liquid appears in both sets at different temperatures; and the descriptors require a quantum-chemical calculation for each new ion. The founder’s 2015 dissertation reports the same coefficients with a different viscosity data set (78 points, 23 held out).

3.5 Latent descriptors: parameters with no physical meaning

The 2016 radius correction was an engineered descriptor: a fitted quantity standing in for something physical. Latent descriptors go one step further. Each cation and each anion gets a short vector of numbers, learned only because it predicts. The vectors have no assigned physical meaning. Jirasek and co-workers (2020) applied this matrix-completion approach to a solute × solvent table of activity coefficients at infinite dilution and reported that it “outperforms the state-of-the-art method that has been refined over three decades” (the comparison was with modified UNIFAC (Dortmund), on the mixtures it can predict).

For a cation j and anion i, a hybrid model keeps an additive, group-contribution-like part and adds an interaction term from the latent vectors:

ŷij = μ + ai + cj + uiTvj,    ui, vj ∈ ℝk
(3.7)
min Σ(i,j) observed (yij − ŷij)2 + λ(Σ ai2 + Σ cj2 + Σ‖ui‖2 + Σ‖vj‖2)
(3.8)

Fixing all v makes the problem a ridge regression in each ui, and vice versa, so alternating least squares fits it, to a local optimum. The penalty λ and the rank k control overfitting.

What latent parameters cannot do on their own. A new ion has no latent vector until it has data (the cold-start problem). To design new ions, the latent space has to be tied to structure, for example by predicting u from quantum descriptors or a molecular graph. LILM is designed to do this, with uncertainty and an applicability domain, so an optimizer can search latent space and decode back to synthesizable ions. Planned

Lab 3.1 Computed for this page Published data

Latent parameters, tested on cells they never saw

Data: the anion × cation absorption–desorption index table of the CO2 screen (its Table 2: 21 anion rows as printed, though the text describes 20 anions and 200 candidates; Methods 02), modeled as ln ADI. A random share of cells is hidden; three models are fitted to the rest and scored on the hidden cells.

Averaged over 300 random splits with 30% hidden, this code gives mean absolute percentage errors of 7.3% (anion only), 5.8% (additive) and 2.4–2.8% (additive + latent, k = 1–3); single splits vary (latent model, 5th–95th percentile about 1.8–3.7%). The table being completed is itself a model output (COSMO-RS-based ADI), so this demonstrates learning cation–anion interaction structure, not experimental accuracy. With shuffled data the latent model does worse than the additive one (it fits noise), as expected.

3.6 QSAR for toxicity

QSAR applies the same machinery to biological endpoints: an EC50, a mutagenicity call, a biodegradation rate. Structural alerts flag known toxicophores; read-across borrows data from close analogues; statistical QSARs regress endpoints on descriptors. For imidazolium ionic liquids, Ranke and co-workers (2004) quantified the influence of alkyl chain length on toxicity in Vibrio fischeri and WST-1 cell-viability assays by linear regression. A QSAR result is a screening estimate. It ranks what to test; it does not establish safety (Chapter 6).

References

  1. Mehrkesh, A.; Karunanithi, A. T. New quantum chemistry-based descriptors for better prediction of melting point and viscosity of ionic liquids. Fluid Phase Equilib. 2016, 427, 498–503.
  2. OECD. Principles for the validation, for regulatory purposes, of (quantitative) structure–activity relationship models, 2004. oecd.org
  3. Tropsha, A. Best practices for QSAR model development, validation, and exploitation. Mol. Inform. 2010, 29, 476–488. doi:10.1002/minf.201000061
  4. Jirasek, F.; Alves, R. A. S.; Damay, J.; Vandermeulen, R. A.; Bamler, R.; Bortz, M.; Mandt, S.; Kloft, M.; Hasse, H. Machine learning in thermodynamics: prediction of activity coefficients by matrix completion. J. Phys. Chem. Lett. 2020, 11, 981–985. doi:10.1021/acs.jpclett.9b03657
  5. Ranke, J.; Mölter, K.; Stock, F.; Bottin-Weber, U.; Poczobutt, J.; Hoffmann, J.; Ondruschka, B.; Filser, J.; Jastorff, B. Biological effects of imidazolium ionic liquids with varying chain lengths in acute Vibrio fischeri and WST-1 cell viability assays. Ecotoxicol. Environ. Saf. 2004, 58, 396–404. doi:10.1016/S0147-6513(03)00105-2
  6. Farahipour, R.; Mehrkesh, A.; Karunanithi, A. T. A systematic screening methodology towards exploration of ionic liquids for CO2 capture processes. Chem. Eng. Sci. 2016, 145, 126–132, Table 2 (data for Lab 3.1). doi:10.1016/j.ces.2015.12.015
  7. Schmidt, M.; Lipson, H. Distilling free-form natural laws from experimental data. Science 2009, 324, 81–85. doi:10.1126/science.1165893
  8. Preiss, U.; Bulut, S.; Krossing, I. In silico prediction of the melting points of ionic liquids from thermodynamic considerations: a case study on 67 salts with a melting point range of 337 °C. J. Phys. Chem. B 2010, 114, 11133–11140. doi:10.1021/jp104679m
  9. Mehrkesh, A. Optimization-based design and analysis of tailor-made ionic liquids. Ph.D. dissertation, University of Colorado Denver, 2015, Chapter 2. arXiv:1612.06407

Privacy

Terms