1887

Abstract

Summary

Higher stakes from deep-ocean drilling, increasing complexity from unconventional reservoirs, and an overarching desire for a higher-fidelity subsurface description have led to a demand for reservoir simulators capable of modelling many millions of cells in minutes. Recent advances in heterogeneous computing hardware offer the promise of faster simulation times, particularly through the use of GPUs. Thus far, efforts to take advantage of hardware accelerators have been primarily focused on linear solvers and, in particular, simple preconditioners which often sacrifice rapid convergence for the sake of easy parallelism. This relatively weak convergence, the remaining unaccelerated code paths, and communication bottlenecks have prevented dramatic reductions in run time. A comprehensive approach, however, built from the ground up for accelerators, can deliver on the hardware’s promise to meet industry demand for fast, scalable reservoir simulation.

We present the results of our efforts to fully accelerate reservoir simulations on multiple GPUs in an extended black-oil formulation discretized using a fully-implicit finite volume method. We implement all major computational aspects, including property evaluation, Jacobian construction, and robust solvers/ preconditioners on GPUs. The CPR-AMG preconditioner we employ allows low iteration count and near-optimal order(N) scaling of computational effort with system size. This combination of algorithms and hardware enables the simulation of fine-scale models with many millions of cells in minutes on a single workstation without any upscaling of the original problem. We discuss the algorithms and methods we employ, give performance and accuracy results on a range of benchmark problems and real assets, and discuss the strong and weak scaling behavior of performance with model size and GPU count. This work was supported by the Marathon Oil Corporation.

Loading

Article metrics loading...

/content/papers/10.3997/2214-4609.20141771
2014-09-08
2024-03-28
Loading full text...

Full text loading...

References

  1. Alpak, F.O., Vink, J.C., Gao, G. and Mo, W.
    [2013] Techniques for effective simulation, optimization, and uncertainty quantification of the in-situ upgrading process. Journal of Unconventional Oil and Gas Resources, 3, 14–.
    [Google Scholar]
  2. Appleyard, J., Appleyard, J., Wakefield, M. and Desitter, A.
    [2011] Accelerating reservoir simulators using GPU technology. SPE Reservoir Simulation Symposium, SPE-141402-MS.
    [Google Scholar]
  3. Bayat, M. and Killough, J.E.
    [2013] An experimental study of GPU acceleration for reservoir simulation. SPE Reservoir Simulation Symposium, SPE-163628-MS.
    [Google Scholar]
  4. Bell, N., Dalton, S. and Olson, L.
    [2011] Exposing fine-grained parallelism in algebraic multigrid methods. NVIDIA Technical Report NVR-2011-002, NVIDIA Corporation.
    [Google Scholar]
  5. Chen, Z.J., Liu, H. and Yu, S.
    [2013] Development of algebraic multigrid solvers using GPUs. SPE Reservoir Simulation Symposium, SPE-163661-MS.
    [Google Scholar]
  6. Christie, M.A. and Blunt, M.J.
    [2001] Tenth SPE comparative solution project: A comparison of upscaling techniques. SPE-66599-MS.
    [Google Scholar]
  7. Dogru, A.H.
    [2011] Giga-cell simulation. Saudi Aramco Journal of Technology, (Spring 2011), 2–8.
    [Google Scholar]
  8. Du, S. et al.
    [2013] Multiscale grid design and upscaling for a full field tight gas reservoir model on a next generation simulator. SPE Unconventional Gas Conference and Exhibition.
    [Google Scholar]
  9. Dzyuba, V.I., Bogachev, K.Y., Bogaty, A.S., Lyapin, A.R., Mirgasimov, A.R. and Semenko, A.E.
    [2012] Advances in modeling of giant reservoirs. Mathematical Methods in Fluid Dynamics and Simulation of Giant Oil and Gas Reservoirs, SPE-163090-MS.
    [Google Scholar]
  10. Esler, K., Atan, S., Ramirez, B. andNatoli, V.
    [2011] Accelerating reservoir simulation with GPUs. 73rd EAGE Conference & Exhibition.
    [Google Scholar]
  11. Esler, K., Natoli, V. and Samardžić, A.
    [2012] GAMPACK (GPU Accelerated Algebraic Multigrid PACKage). ECMOR XIII - 13th European Conference on the Mathematics of Oil Recovery.
    [Google Scholar]
  12. Fung, L.S.K., Sindi, M.O. and Dogru, A.H.
    [2013] Multi-paradigm parallel acceleration for reservoir simulation. SPE Reservoir Simulation Symposium.
    [Google Scholar]
  13. Fung, L.S. and Dogru, A.H.
    [2008] Parallel unstructured-solver methods for simulation of complex giant reservoirs. SPE Journal, 13(04), 440–446.
    [Google Scholar]
  14. Gratien, J.M., Guignon, T., Magras, J.F., Quandalle, P., Ricois, O.M. et al.
    [2007] Scalability and load balancing problems in parallel reservoir simulation. SPE Reservoir Simulation Symposium.
    [Google Scholar]
  15. Islam, A. and Sepehrnoori, K.
    [2013] A review on SPE’s comparitive solution projects (CSPs). Journal of Petroleum Science Research, 2(4), 167–180.
    [Google Scholar]
  16. Killough, J.
    [1995] Ninth SPE comparative solution project: a reexamination of black-oil simulation. Symposium on reservoir simulation, 135–147.
    [Google Scholar]
  17. Klie, H.M., Sudan, H.H., Li, R. and Saad, Y.
    [2011] Exploiting capabilities of many core platforms in reservoir simulation. SPE Reservoir Simulation Symposium, SPE-141265-MS.
    [Google Scholar]
  18. Micikevicius, P.
    [2009] 3d finite difference computation on gpus using cuda. Proceedings of 2nd Workshop on General Purpose Processing on Graphics Processing Units, 79–84.
    [Google Scholar]
  19. Natvig, J.R. et al.
    [2011] Multiscale mimetic solvers for efficient streamline simulation of fractured reservoirs. SPE Journal, 16(04), 880–888.
    [Google Scholar]
  20. Tchelepi, H. and Zhou, Y.
    [2013] Multi-GPU parallelization of nested factorization for solving large linear systems. SPE Reservoir Simulation Symposium.
    [Google Scholar]
  21. Wallis, J.R.
    [1983] Incomplete gaussian elimination as a preconditioning for generalized conjugate gradient acceleration. SPE Reservoir Simulation Symposium, SPE-12265-MS.
    [Google Scholar]
  22. Wallis, J.R., Kendall, R.P. and Little, T.E.
    [1985] Constrained residual acceleration of conjugate residual methods. SPE Reservoir Simulation Symposium, SPE-13536-MS.
    [Google Scholar]
  23. Yu, S., Liu, H., Chen, Z.J., Hsieh, B. and Shao, L.
    [2012] GPU-based parallel reservoir simulation for large-scale simulation problems. SPE Europe/EAGE Annual Conference, SPE-152271-MS.
    [Google Scholar]
http://instance.metastore.ingenta.com/content/papers/10.3997/2214-4609.20141771
Loading
/content/papers/10.3997/2214-4609.20141771
Loading

Data & Media loading...

This is a required field
Please enter a valid email address
Approval was a Success
Invalid data
An Error Occurred
Approval was partially successful, following selected items could not be processed due to error