Skip to main content
SpringerLink
Log in

A new multiple frames decoding and frame wise measurement for compressed video sensing

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Compressed sensing (CS) breaks the limit of Nyquist sampling rate and provides a new method for information sampling. Compressed video sensing (CVS) introduces CS into video codec and decreases the burden of encoding. For three-dimensional video data, the cube-based CVS scheme is an intuitive method in that CS measurements can span the entire spatial and temporal extent of a video sequence. Unfortunately, the measuring of multiple frames in video cubes simultaneously requires complex calculation and expensive spatial costs, which is largely considered impractical to implement in a real device. In this paper, a novel compressed video sensing scheme that is exactly suitable for wireless multimedia sensor networks is proposed by changing the method of processing multiple frames in video cubes. At the encoder, sampling rate redistribution (SRR) algorithm increases the measurements contained in the first and last frames so that they can assist to reconstruct intermediate frames. At the decoder, all measurements are scrambled by global measurement scrambling (GMS) algorithm to make them similar to measurements of the global CS acquisition. The experimental results show that the proposed scheme effectively improves the decoding performance on the premise of realizable hardware devices.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11

Similar content being viewed by others

References

  1. Baraniuk RG (2007) A lecture on compressive sensing. IEEE Signal Process Mag 24(4):118–121

    Article  Google Scholar 

  2. Chambolle A, Lions PL (1997) Image recovery via total variation minimization and related problems. Numer Math 76(2):168–188

    Article  MathSciNet  MATH  Google Scholar 

  3. Chan TF, Esedoglu S, Park F, Yip A (2006) Total variation image reconstruction: overview and recent developments. In: Paragios N, Chen Y, Faugeras OD (eds) Handbook of mathematical models in computer vision, chap 2. Springer, New York

    Google Scholar 

  4. Coluccia G, Kuiteing SK, Abrardo A, Barni M, Magli E (2012) Progressive compressed sensing and reconstruction of multidimensional signals using hybrid transform/prediction sparsity model. IEEE J Emerging Sel Top Circuits Syst 2(3):340–352

    Article  Google Scholar 

  5. Do TT, Gan L, Nguyen NH, Tran TD (2012) Fast and efficient compressive sensing using structurally random matrices. IEEE Trans Signal Process 60(1):139–154

    Article  MathSciNet  Google Scholar 

  6. Donoho D (2006) Compressed sensing. IEEE Trans Inf Theory 52(4):1289–1306

    Article  MathSciNet  MATH  Google Scholar 

  7. Duarte MF, Baraniuk RG (2012) Kronecker compressive sensing. IEEE Trans Image Process 21(2):494–504

    Article  MathSciNet  Google Scholar 

  8. Duarte MF, Davenport MA, Takhar D, Laska JN, Sun T, Kelly KF, Baraniuk RG (2008) Single-pixel imaging via compressive sampling. IEEE Signal Proc Mag 25(2):83–91

    Article  Google Scholar 

  9. Fowler JE, Mun S, Tramel EW (2012) Block-based compressed sensing of images and video. Found Trends® Signal Process 4(4):297–416

    Article  MATH  Google Scholar 

  10. Hestenes MR (1969) Multiplier and gradient methods. J Optim Theory Appl 4(5):303–320

    Article  MathSciNet  MATH  Google Scholar 

  11. Jiang H, Li CB, Haimi-Cohen R, Wilford PA, Zhang Y (2012) Scalable video coding using compressive sensing. Bell Labs Techn J 16(4):149–169

    Article  Google Scholar 

  12. Kang LW, Lu CS (2009) Distributed compressive video sensing. In: IEEE International Conference on Acoustics, Speech and Signal Processing. TaiWan, China, pp 1169–1172

  13. Li CB (2009) An efficient algorithm for total variation regularization with applications to the signal pixel camera and compressive sensing. Master Thesis, Computational and Applied Mathematics, Rice University

  14. Li CB, Jiang H, Wilford P, Zhang Y, Scheutzow M (2013) A new compressive video sensing framework for mobile broadcast. IEEE Trans Broadcast 59(1):197–205

    Article  Google Scholar 

  15. Li CB, Jiang H, Wilford P, Zhang Y (2011) Video coding using compressive sensing for wireless communications. In: Wireless Commun. Networking Conference (WCNC. Cancun, Mexico, pp 2077–2082

  16. Lorintiu O, Liebgott H, Alessandrini M, Bernard O, Friboulet D (2014) Compressed sensing reconstruction of 3D ultrasound data using dictionary learning. In Image Processing (ICIP), 2014 I.E. International Conference. Paris, France, pp. 1317–1321

  17. Powell MJD (1969) A method for nonlinear constraints in minimization problems. Optimization 283–298

  18. Markus L, Marian C, Markku J (2015) Sequential compressed sensing with progressive signal reconstruction in wireless sensor networks. IEEE Trans Wirel Commun 14(3):1536–1276

    Google Scholar 

  19. Mandal MK, Idris F, Panchanathan S (1999) A critical evaluation of image and video indexing techniques in the compressed domain. Image Vis Comput 17(7):513–529

    Article  Google Scholar 

  20. Peaceman DW, Rachford HH (1955) The numerical solution of parabolic and elliptic differential equations. J Soc Ind Appl Math 3:328–41

    Article  MathSciNet  MATH  Google Scholar 

  21. Reddy D, Sankaranarayanan A, Cevher V, Chellappa R (2008) Compressed sensing for multi-view tracking and 3-d voxel reconstruction. In: 15th IEEE International Conference on Image Processing. San Diego, CA, pp 221–224

  22. Rudin LI, Osher S, Fatemi E (1992) Nonlinear total variation based noise removal algorithms. Physica D Nonlinear Phenomena 60(1–4):259–268

    Article  MathSciNet  MATH  Google Scholar 

  23. Ying L, Pados DA (2013) Decoding of frame-wise compressed-sensed video via inter-frame total variation minimization. Journal Electron Imaging 22(2):1–8

    Google Scholar 

  24. Zhang YF, Mei SL, Chen QQ, Chen ZB (2008) A multiple description image/video coding method by compressed sensing theory. In: IEEE Int. Symp. on Circuits and Systems. Seattle, Washington, pp. 1830–1833

  25. Zhang YF, Mei SL, Chen QQ, Chen ZB (2008) A novel image/video coding method based on compressed sensing theory. In: IEEE Int. Conf. on acoustics, speech, and signal processing. Las Vegas, Nevada, pp. 1361–1364

Download references

Acknowledgments

This work was supported by the National Science Foundation China under grant 61440056 and 61540046,  and the 111 Project of China (B08038).

Author information

Authors and Affiliations

  1. School of Telecommunications Engineering, Xidian University, Xi’an, 710071, China

    Yonghong Kuo, Yatian Gao, Xin Zhang & Jian Chen

Authors
  1. Yonghong Kuo
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Yatian Gao
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Xin Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Jian Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Yonghong Kuo.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Kuo, Y., Gao, Y., Zhang, X. et al. A new multiple frames decoding and frame wise measurement for compressed video sensing. Multimed Tools Appl 76, 7321–7339 (2017). https://doi.org/10.1007/s11042-016-3390-6

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-016-3390-6

Keywords

Search

Navigation