1887
Volume 38 Number 5
  • E-ISSN: 1365-2478

Abstract

A

The pioneering work of E. T. Jaynes in the field of Bayesian/Maximum Entropy methods has been successfully explored in a number of disciplines. The principle of maximum entropy (PME) is remarkably powerful and versatile and leads to results which are devoid of spurious structure. Minimum relative entropy (MRE) is a method which has all the important attributes of the maximum‐entropy (ME) approach with the advantage that prior information may be easily included. These ‘soft’ prior constraints play a fundamental role in the solution of underdetermined problems. The MRE approach, like ME, has achieved considerable success in the field of spectral analysis where the spectrum is estimated from incomplete autocorrelations. In this paper we apply the MRE philosophy to 1D inverse problems where the model is not necessarily positive, and thus we show that MRE is a general method of tackling linear, underdetermined, inverse problems. We illustrate our discussion with examples which deal with the famous die problem introduced by Jaynes, the question of aliasing, determination of interval velocities from stacking velocities and, finally, the universal problem of band‐limited extrapolation. It is found that the MRE solution for the interval velocities, when a uniform prior velocity is assumed, is exactly the Dix formulation which is generally used in the seismic industry.

Loading

Article metrics loading...

/content/journals/10.1111/j.1365-2478.1990.tb01857.x
2006-04-27
2024-03-29
Loading full text...

Full text loading...

References

  1. Ables, J. G.1974. Maximum entropy spectral analysis. Astronomy and Astrophysics, Supplement 15, 383.
    [Google Scholar]
  2. Bricogne, G.
    (ed.) 1985. Proceedings of the EMBO Workshop on Maximum Entropy Methods. Orsay , 1984, 74–82.
    [Google Scholar]
  3. Burg, J. P.1975. Maximum entropy spectral analysis. Ph.D. thesis, Stanford University.
  4. Daniell, G. J. and Gull, S. F.1980. Maximum entropy algorithm applied to image enhancement. Proceedings of the IEE127E, 175–188.
    [Google Scholar]
  5. Dix, C. H.1955. Seismic velocities from surface measurements. Geophysics20, 68–86.
    [Google Scholar]
  6. Dong, W. M., Bao, A. B. and Shah, H. C.1984. Use of maximum entropy principle in earthquake recurrence relationships. Bulletin of the Seismological Society of America74, 725–739.
    [Google Scholar]
  7. Freire, S. L. M. and Ulrych, T. J.1988. Application of singular value decomposition to vertical seismic profiling. Geophysics53, 778–785.
    [Google Scholar]
  8. Frieden, B. R.1985. Dice, entropy and likelihood. Proceedings of the IEEE73, 1764–1770.
    [Google Scholar]
  9. Gull, S. F. and Skilling, J.1984. The entropy of an image. Indirect Imaging J. A.Roberts (ed.) Cambridge University Press.
    [Google Scholar]
  10. Haykin, S.
    (ed.) 1983. Nonlinear Methods of Spectral Analysis2nd edn. Springer‐Verlag, Inc.
    [Google Scholar]
  11. Hemon, C. H. and Mace, D.1978. Essai ?une application de la transformation de Karhunen‐Loève au traitement sismique. Geophysical Prospecting26, 600–626.
    [Google Scholar]
  12. Jacobs, F. J. and van der Geest, P. A. G.1988. Spiking band‐limited traces with a relative entropy algorithm. 58th SEG meeting, Anaheim , California , Expanded Abstracts, 723–726.
    [Google Scholar]
  13. Jaynes, E. T.1957. Information theory and statistical mechanics. Physical Reviews106, 620–630.
    [Google Scholar]
  14. Jaynes, E. T.1968. Prior probabilities. IEEE Transactions on Systems. Science and CyberneticsSSC‐4, 227–241.
    [Google Scholar]
  15. Jaynes, E. T.1982. On the rationale of maximum entropy methods. Proceedings of the IEEE106, 939–952.
    [Google Scholar]
  16. Jaynes, E. T.1983. Papers on Probability, Statistics and Statistical Physics R.D.Rosenkratz (ed.). D. Reidel Publishing Co.
    [Google Scholar]
  17. Johnson, R. W.1983. Algorithms for single‐signal and multisignal minimum‐cross‐entropy spectrum analysis. Naval Research Laboratory Report 8667, Washington , D.C .
    [Google Scholar]
  18. Johnson, R. W. and Shore, J. E.1983. Comments and correction to “Axiomatic derivation of the principle of maximum entropy and the principle of minimum‐cross‐entropy. IEEE Transactions on Information TheoryIT‐29, 942–943.
    [Google Scholar]
  19. Johnson, R. W. and Shore, J. E.1984. Power spectrum estimation by means of relative‐entropy minimization with uncertain constraints. IEEE International Conference on Acoustics, Speech and Signal Processing, San Diego, 1, 381–384.
    [Google Scholar]
  20. Johnson, R. W., Shore, J. E. and Burg, J. P.1983. Multisignal minimum‐cross‐entropy spectrum analysis with weighted initial estimates. IEEE Transactions on Acoustics, Speech and Signal ProcessingASSP‐32, 531–539.
    [Google Scholar]
  21. Jones, I. F. and Levy, S.1987. Signal‐to‐noise ratio enhancement in multichannel seismic data via the Karhunen‐Loève transform. Geophysical Prospecting35, 12–32.
    [Google Scholar]
  22. Justice, J. H.
    (ed.) 1985. Proceedings of the Workshop on Bayesian/Maximum Entropy Methods. University of Calgary, Alberta .
    [Google Scholar]
  23. Kullback, S.1959. Information Theory and Statistics. John Wiley and Sons, Inc.
    [Google Scholar]
  24. Menke, W.1984. Geophysical Data Analysis: discrete inverse theory. Academic Press, Inc.
    [Google Scholar]
  25. Musicus, B. R.1986. Comments on Dice, entropy and likelihood by B. R. Frieden. Proceedings of the IEEE74, 762–763.
    [Google Scholar]
  26. Newman, W. I.1977. Extension to the maximum entropy method. IEEE Transactions on Information TheoryIT‐23, 89–93.
    [Google Scholar]
  27. Oldenburg, D. W., Levy, K. and Stinson, K.1984. Root‐mean‐square velocities and recovery of the acoustic impedance. Geophysics49, 1653–1663.
    [Google Scholar]
  28. Oldenburg, D. W., Scheur, T. and Levy, K.1983. Recovery of the acoustical impedance from reflection seismograms. Geophysics48, 1318–1337.
    [Google Scholar]
  29. Papoulis, A.1977. Signal Analysis. McGraw‐Hill Book Co.
    [Google Scholar]
  30. Rietsch, E.1977. The maximum entropy approach to inverse problems. Journal of Geophysics42, 489–506.
    [Google Scholar]
  31. Rietsch, E.1988. The maximum entropy approach to the inversion of one‐dimensional seismograms. Geophysical Prospecting36, 365–382.
    [Google Scholar]
  32. Robinson, E. A. and Treitel, S.1980. Geophysical Signal Analysis. Prentice‐Hall, Inc.
    [Google Scholar]
  33. Schott, J. P. and McClellan, J. H.1984. Maximum entropy power spectrum estimation with uncertainty in correlation measurements. IEEE Transactions on Acoustics, Speech and Signal ProcessingASSP‐32, 410–418.
    [Google Scholar]
  34. Shannon, C. E.1948. A mathematical theory of communication. The Bell System Technical Journal27, 379–423.
    [Google Scholar]
  35. Shen, P. Y. and Mansinha, L.1983. On the principle of maximum entropy and the earthquake frequency‐magnitude relation. Geophysical Journal of the Royal Astronomical Society74, 777–785.
    [Google Scholar]
  36. Shore, J. E.1981. Minimum cross‐entropy spectral analysis. IEEE Transactions on Acoustics Speech and Signal ProcessingASSP‐29, 230–237.
    [Google Scholar]
  37. Shore, J. E.1983. Inversion as logical inference ‐ theory and applications of maximum entropy and minimum cross‐entropy. SIAM-AMS Proceedings14, 139–149.
    [Google Scholar]
  38. Shore, J. E. and Johnson, R. W.1980. Axiomatic derivation of the principle of maximum entropy and the principle of minimum cross‐entropy. IEEE Transactions on Information TheoryIT‐26, 26–37.
    [Google Scholar]
  39. Skilling, J.1984The maximum entropy method. Nature309, 748.
    [Google Scholar]
  40. Smith, C. R.
    and Grandy (eds.) 1985. Maximum‐Entropy and Bayesian Methods in Inverse Problems. D. Reidel Publishing Co.
    [Google Scholar]
  41. Tarantola, A. and Valette, B.1982. Inverse problems = quest for information. Journal of Geophysics50159–170.
    [Google Scholar]
  42. Tarantola, A.1987Inverse Problem Theory: methods for data fitting and model parameter estimation. Elsevier, Science Publishing Co.
    [Google Scholar]
  43. Tikochinsky, Y., Tishby, N. Z. and Levine, R. D.1984. Consistent inference of probabilities for reproducible experiments. Physical Review Letters52, 1357–1360.
    [Google Scholar]
  44. Ulrych, T. J. and Bishop, T. N.1975. Maximum entropy spectral analysis and autoregressive decomposition. Reviews of Geophysics and Space Physics13, 183–200.
    [Google Scholar]
  45. Walker, C. and Ulrych, T. J.1983Autoregressive recovery of the acoustic impedance. Geophysics48, 1338–1350.
    [Google Scholar]
  46. Young, T. Y. and Calvert, T. W.1974. Classification, Estimation and Pattern Recognition. Elsevier Science Publishing Co., Inc.
    [Google Scholar]
http://instance.metastore.ingenta.com/content/journals/10.1111/j.1365-2478.1990.tb01857.x
Loading
  • Article Type: Research Article

Most Cited This Month Most Cited RSS feed

This is a required field
Please enter a valid email address
Approval was a Success
Invalid data
An Error Occurred
Approval was partially successful, following selected items could not be processed due to error