Deep learning enabled real-time photoacoustic tomography system via single data acquisition channel

Authors: Hengrong Lana,b,c,1, Daohuai Jianga,b,c,1, Feng Gaoa, Fei Gaoa,*


a Hybrid Imaging System Laboratory, Shanghai Engineering Research Center of Intelligent Vision and Imaging, School of Information Science and Technology, ShanghaiTech University, Shanghai, 201210, China

b Chinese Academy of Sciences, Shanghai Institute of Microsystem and Information Technology, Shanghai, 200050, China

c University of Chinese Academy of Sciences, Beijing, 100049, China


Photoacoustic computed tomography (PACT) combines the optical contrast of optical imaging and the penetrability of sonography. In this work, we develop a novel PACT system to provide real-time imaging, which is achieved by a 120-elements ultrasound array only using a single data acquisition (DAQ) channel. To reduce the channel number of DAQ, we superimpose 30 nearby channels’ signals together in the analog domain, and shrinking to 4 channels of data (120/30 = 4). Furthermore, a four-to-one delay-line module is designed to combine these four channels’ data into one channel before entering the single-channel DAQ, followed by decoupling the signals after data acquisition. To reconstruct the image from four superimposed 30-channels’ PA signals, we train a dedicated deep learning model to reconstruct the final PA image. In this paper, we present the preliminary results of phantom and in-vivo experiments, which manifests its robust real-time imaging performance. The significance of this novel PACT system is that it dramatically reduces the cost of multi-channel DAQ
module (from 120 channels to 1 channel), paving the way to a portable, low-cost and real-time PACT system.


[1] L.V. Wang, Tutorial on photoacoustic microscopy and computed tomography, IEEE
J. Sel. Top. Quantum Electron. 14 (1) (2008) 171–179,
[2] L.V. Wang, J. Yao, A practical guide to photoacoustic tomography in the life
sciences, Nat. Methods 13 (July (8)) (2016) 627–638,
[3] H. Zhong, T. Duan, H. Lan, M. Zhou, F. Gao, Review of low-cost photoacoustic
sensing and imaging based on laser diode and light-emitting diode, Sensors Basel
(Basel) 18 (July (7)) (2018) 13,
[4] Y. Zhou, J. Yao, L.V. Wang, Tutorial on photoacoustic tomography, J. Biomed. Opt.
21 (June (6)) (2016) 61007,
[5] Y. Dong, T. Gorner, ̈ S. Kunis, An algorithm for total variation regularized
photoacoustic imaging, Adv. Comput. Math. 41 (2) (2014) 423–438, https://doi.
[6] S.R. Arridge, M.M. Betcke, B.T. Cox, F. Lucka, B.E. Treeby, On the adjoint operator
in photoacoustic tomography, Inverse Probl. 32 (11) (2016),
[7] M. Xu, L.V. Wang, Universal back-projection algorithm for photoacoustic
computed tomography, Phys. Rev. E Stat. Nonlin. Soft Matter Phys. 71 (January (1
Pt 2)) (2005) 016706,
[8] F. Gao, Q. Peng, X. Feng, B. Gao, Y. Zheng, Single-wavelength blood oxygen
saturation sensing with combined optical absorption and scattering, IEEE Sens. J.
16 (7) (2016) 1943–1948,
[9] Y. Wang, S. Hu, K. Maslov, Y. Zhang, Y. Xia, L.V. Wang, In vivo integrated
photoacoustic and confocal microscopy of hemoglobin oxygen saturation and
oxygen partial pressure, Opt. Lett. 36 (7) (2011) 1029–1031.
[10] X. Wang, X. Xie, G. Ku, L.V. Wang, G. Stoica, Noninvasive imaging of hemoglobin
concentration and oxygenation in the rat brain using high-resolution photoacoustic
tomography, J. Biomed. Opt. 11 (2) (2006), pp. 024015-024015-9.
[11] J. Shah, S. Park, S. Aglyamov, T. Larson, L. Ma, K. Sokolov, et al., Photoacoustic
imaging and temperature measurement for photothermal cancer therapy,
J. Biomed. Opt. 13 (3) (2008), pp. 034024-034024-9.
[12] V.P. Zharov, E.I. Galanzha, E.V. Shashkov, N.G. Khlebtsov, V.V. Tuchin, In vivo
photoacoustic flow cytometry for monitoring of circulating single cancer cells and
contrast agents, Opt. Lett. 31 (24) (2006) 3623–3625.
[13] W. Liu, B. Lan, L. Hu, R. Chen, Q. Zhou, J. Yao, Photoacoustic thermal flowmetry
with a single light source, J. Biomed. Opt. 22 (September (9)) (2017) 1–6, https://
[14] F. Gao, X. Feng, R. Zhang, S. Liu, R. Ding, R. Kishor, et al., Single laser pulse
generates dual photoacoustic signals for differential contrast photoacoustic
imaging, Sci. Rep. 7 (April(1)) (2017) 626,
[15] B. Yan, H. Qin, C. Huang, C. Li, Q. Chen, D. Xing, Single-wavelength excited
photoacoustic-fluorescence microscopy for in vivo pH mapping, Opt. Lett. 42 (April
(7)) (2017) 1253–1256,
[16] A. Mandelis, Imaging cancer with photoacoustic radar, Phys. Today 70 (5) (2017)
[17] H. Lan, T. Duan, H. Zhong, M. Zhou, F. Gao, Photoacoustic classification of tumor
model morphology based on support vector machine: a simulation and phantom
study, Ieee J. Sel. Top. Quantum Electron. 25 (1) (2019) 1–9,
[18] M. Pramanik, G. Ku, C. Li, L.V. Wang, Design and evaluation of a novel breast
cancer detection system combining both thermoacoustic (TA) and photoacoustic
(PA) tomography, Med. Phys. 35 (6Part1) (2008) 2218–2223.
[19] H. Lan, T. Duan, D. Jiang, H. Zhong, M. Zhou, F. Gao, Dual-contrast nonlinear
photoacoustic sensing and imaging based on single high-repetition-rate pulsed
laser, IEEE Sens. J. (2019),, pp. 1-1.
[20] L. Li, L. Zhu, C. Ma, L. Lin, J. Yao, L. Wang, et al., Single-impulse panoramic
photoacoustic computed tomography of small-animal whole-body dynamics at
high spatiotemporal resolution, Nat. Biomed. Eng. 1 (5) (2017) 0071, https://doi.

[21] J. Gamelin, A. Maurudis, A. Aguirre, F. Huang, P. Guo, L.V. Wang, et al., A real-
time photoacoustic tomography system for small animals, Opt. Express 17 (13)

(2009) 10489–10498.

[22] L. Lin, P. Hu, J. Shi, C.M. Appleton, K. Maslov, L. Li, et al., Single-breath-hold
photoacoustic computed tomography of the breast, Nat. Commun. 9 (June (1))
(2018) 2352,
[23] S. Park, J. Jang, J. Kim, Y.S. Kim, C. Kim, Real-time triple-modal photoacoustic,
ultrasound, and magnetic resonance fusion imaging of humans, IEEE Trans. Med.
Imaging (April) (2017) 24,

[24] S.K. Kalva, P.K. Upputuri, M. Pramanik, High-speed, low-cost, pulsed-laser-diode-
based second-generation desktop photoacoustic tomography system, Opt. Lett. 44

(January(1)) (2019) 81–84,
[25] M. Zafar, K. Kratkiewicz, R. Manwar, M. Avanaki, Development of low-cost fast
photoacoustic computed tomography: system characterization and phantom study,
Appl. Sci. 9 (3) (2019),
[26] H. Lan, K. Zhou, C. Yang, J. Cheng, J. Liu, S. Gao, et al., Ki-GAN: Knowledge
Infusion Generative Adversarial Network for Photoacoustic Image Reconstruction
In Vivo. Medical Image Computing and Computer Assisted Intervention – MICCAI
2019, (Lecture Notes in Computer Science, 2019, pp. 273–281, ch. Chapter 31.
[27] A. Hauptmann, F. Lucka, M. Betcke, N. Huynh, J. Adler, B. Cox, et al., Model-based
learning for accelerated, limited-view 3-D photoacoustic tomography, IEEE Trans.
Med. Imaging 37 (Jun (6)) (2018) 1382–1393,
[28] H. Lan, K. Zhou, C. Yang, J. Liu, S. Gao, F. Gao, Hybrid neural network for
photoacoustic imaging reconstruction, in: 2019 Annual International Conference of
the IEEE Engineering in Medicine and Biology Society, IEEE, 2019.
[29] Y.E. Boink, S. Manohar, C. Brune, A Partially Learned Algorithm for Joint
Photoacoustic Reconstruction and Segmentation, arXiv preprint arXiv:1906.07499,
[30] C. Cai, K. Deng, C. Ma, J. Luo, End-to-end deep neural network for optical inversion
in quantitative photoacoustic imaging, Opt. Lett. 43 (June(12)) (2018) 2752–2755,
[31] L.V. Wang, A.A. Oraevsky, L. Maier-Hein, K. Maier-Hein, T. Kirchner, F. Isensee, et
al., Reconstruction of initial pressure from limited view photoacoustic images using
deep learning. Presented at the Photons Plus Ultrasound: Imaging and Sensing
2018, 2018.
[32] C. Yang, F. Gao, EDA-Net: dense aggregation of deep and shallow information
achieves quantitative photoacoustic blood oxygenation imaging deep in human
breast. Medical Image Computing and Computer Assisted Intervention – MICCAI
2019, (Lecture Notes in Computer Science, 2019, pp. 246–254, ch. Chapter 28.
[33] N. Huynh, F. Lucka, E.Z. Zhang, M.M. Betcke, S.R. Arridge, P.C. Beard, et al.,
Single-pixel camera photoacoustic tomography, J. Biomed. Opt. 24 (12) (2019)
[34] X.L. De ́
an-Ben, A. Ozbek, ̈ H. Lopez-Schier, ́ D. Razansky, Acoustic scattering
mediated single detector optoacoustic tomography, Phys. Rev. Lett. 123 (17)
(2019) 174301.
[35] Y. Li, L. Li, L. Zhu, K. Maslov, J. Shi, P. Hu, et al., Snapshot photoacoustic
topography through an ergodic relay for high-throughput imaging of optical
absorption, Nat. Photonics 14 (3) (2020) 164–170.
[36] Y. Guo, B. Li, X. Yin, Single-shot compressed photoacoustic tomographic imaging
with a single detector in a scattering medium, Phys. Rev. Appl. 13 (4) (2020)
[37] D. Jiang, H. Lan, H. Zhong, Y. Zhao, H. Li, F. Gao, Low-cost photoacoustic
tomography system based on multi-channel delay-line module, IEEE Trans. Circuits
Syst. Ii Express Briefs 66 (5) (2019) 778–782,
[38] D. Jiang, Y. Xu, Y. Zhao, H. Lan, F. Gao, Low-cost photoacoustic tomography
system based on water-made acoustic delay-line, in: Presented at the 2019 IEEE
International Ultrasonics Symposium (IUS), Glasgow, United Kingdom, United
Kingdom, 2019.
[39] K. He, X. Zhang, S. Ren, J. Sun, Deep residual learning for image recognition,
Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition
(2016) 770–778.
[40] B.E. Treeby, B.T. Cox, k-Wave: MATLAB toolbox for the simulation and
reconstruction of photoacoustic wave fields, J. Biomed. Opt. 15 (2) (2010), pp.
[41] D.P. Kingma, J. Ba, Adam: a Method for Stochastic Optimization, arXiv preprint
arXiv:1412.6980, 2014.
[42] T. Tong, W. Huang, K. Wang, Z. He, L. Yin, X. Yang, et al., Domain transform
network for photoacoustic tomography from Limited-view and sparsely sampled
data, Photoacoustics (2020) 100190.