Image Outpainting and Harmonization using GANs

Authors

  • Vignesha K.  Department of Computer Science, Srinivas Institute of Technology, Mangalore, Karnataka, India
  • Rabeeh Mohammed Ali  Department of Computer Science, Srinivas Institute of Technology, Mangalore, Karnataka, India

DOI:

https://doi.org/10.32628/CSEIT206370

Keywords:

Tensorflow, Deep Learning, CNN, GANS, Neural Networks.

Abstract

Although the inherently ambiguous task of predicting what resides on the far side all four edges of a image has rarely been explored before, we have a tendency to demonstrate that GANs hold powerful potential in manufacturing reasonable extrapolations. Two outpainting ways square measure projected that aim to instigate this line of research: the primary approach uses a context encoder inspired by common inpainting architectures and paradigms, whereas the second approach adds an extra post-processing step using a single-image generative model. This way, the hallucinated details are integrated with the design of the original image.

References

  1. Shakhnarovich. Colorization as a proxy task for visual understanding. Proceedings - 30th IEEE Con- ference on Computer Vision and Pattern Recognition, CVPR 2017, 2017-Janua:840–849, 2017.
  2. Carl Doersch, Abhinav Gupta, and Alexei A. Efros. Un- supervised visual representation learning by context pre- diction. Proceedings of the IEEE International Confer- ence on Computer Vision, 2015 Inter:1422–1430, 2015.
  3. Mehdi Noroozi and Paolo Favaro. Unsupervised learn- ing of visual representations by solving jigsaw puzzles. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 9910 LNCS:69–84, 2016.
  4. Ian J. Goodfellow, Jean Pouget-Abadie, Mehdi Mirza, Bing Xu, David Warde-Farley, Sherjil Ozair, Aaron Courville, and Yoshua Bengio. Generative Adversarial Networks. pages 1–9, 2014.
  5. Satoshi Iizuka, Edgar Simo-Serra, and Hiroshi Ishikawa. Globally and locally consistent image completion. ACM Transactions on Graphics, 36(4), 2017.
  6. Lars Mescheder, Andreas Geiger, and Sebastian Nowozin. Which training methods for GANs do actually con- verge? 35th International Conference on Machine Learn- ing, ICML 2018, 8:5589–5626, 2018.
  7. Deepak Pathak, Philipp Krahenbuhl, Jeff Donahue, Trevor Darrell, and Alexei A. Efros. Context Encoders: Feature Learning by Inpainting. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2016-Decem:2536–2544, 2016.
  8. Yinda Zhang, Jianxiong Xiao, James Hays, and Ping Tan. Framebreak: Dramatic image extrapolation by guided shift-maps. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pages 1171–1178, 2013.
  9. Mark Sabini and Gili Rusak. Painting Outside the Box: Image Outpainting with GANs. 2018.
  10. Yi Wang, Xin Tao, Xiaoyong Shen, and Jiaya Jia. Wide- context semantic image extrapolation. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2019-June:1399–1408, 2019.
  11. Snapseed - apps on google play, Jun 2018.
  12. Tamar Rott Shaham, Tali Dekel, and Tomer Michaeli. SinGAN: Learning a Generative Model from a Single Natural Image. may 2019.
  13. Bolei Zhou, Agata Lapedriza, Aditya Khosla, Aude Oliva, and Antonio Torralba. Places: A 10 Million Image Database for Scene Recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence, 40(6):1452– 1464, 2018.
  14. Wikiart: Visual art encyclopedia.

Downloads

Published

2020-06-30

Issue

Section

Research Articles

How to Cite

[1]
Vignesha K., Rabeeh Mohammed Ali, " Image Outpainting and Harmonization using GANs " International Journal of Scientific Research in Computer Science, Engineering and Information Technology(IJSRCSEIT), ISSN : 2456-3307, Volume 6, Issue 3, pp.294-297, May-June-2020. Available at doi : https://doi.org/10.32628/CSEIT206370