Monday, May 20, 2024
Latest:
Videos

Deep Neural Network Learns Van Gogh's Art | Two Minute Papers #6

Artis Modus



Two Minute Papers

Artificial neural networks were inspired by the human brain and simulate how neurons behave when they are shown a sensory input (e.g., images, sounds, etc). They are known to be excellent tools for image recognition, any many other problems beyond that – they also excel at weather predictions, breast cancer cell mitosis detection, brain image segmentation and toxicity prediction among many others. Deep learning means that we use an artificial neural network with multiple layers, making it even more powerful for more difficult tasks.

This time they have been shown to be apt at reproducing the artistic style of many famous painters, such as Vincent Van Gogh and Pablo Picasso among many others. All the user needs to do is provide an input photograph and a target image from which the artistic style will be learned.
______________________

I promised some links, so here they come!

The paper “A Neural Algorithm of Artistic Style” is available here:
http://arxiv.org/abs/1508.06576v1
Disclaimer: I was not part of this research project, I am merely providing commentary on this work.

Recommended for you – Two Minute Papers episode on Artificial Neural Networks:
https://www.youtube.com/watch?v=rCWTOOgVXyE&index=3&list=PLujxSBD-JXgnqDD1n-V30pKtp6Q886x7e

Picasso meets Gandalf:
http://mashable.com/2015/08/29/computer-photos/

A nice website with many results:
https://deepart.io/

More examples with Picasso and some sketches:
http://imgur.com/a/jeJB6

Google DeepMind’s Deep Q-learning algorithm plays Atari games:
https://www.youtube.com/watch?v=V1eYniJ0Rnk

The first implementations / source code packages are now available:
1. http://gitxiv.com/posts/jG46ukGod8R7Rdtud/a-neural-algorithm-of-artistic-style
2. https://github.com/kaishengtai/neuralart
3. https://github.com/jcjohnson/neural-style

A great read on Deep Dreaming Neural Networks:
http://googleresearch.blogspot.co.uk/2015/06/inceptionism-going-deeper-into-neural.html

Many of you have asked for the code. Some people were experimenting with it in the Machine Learning reddit. Check it out:
https://www.reddit.com/r/MachineLearning/comments/3imx1m/a_neural_algorithm_of_artistic_style/

Subscribe if you would like to see more of these! – http://www.youtube.com/subscription_center?add_user=keeroyz

Splash screen/thumbnail design: Felícia Fehér – http://felicia.hu

Music:
Epilog – Ghostpocalypse by Kevin MacLeod is licensed under a Creative Commons Attribution license (https://creativecommons.org/licenses/by/4.0/)
Source: http://incompetech.com/music/royalty-free/index.html?isrc=USUAN1100666
Artist: http://incompetech.com/

______________________

Károly Zsolnai-Fehér’s links:
Patreon → https://www.patreon.com/TwoMinutePapers
Facebook → https://www.facebook.com/TwoMinutePapers/
Twitter → https://twitter.com/karoly_zsolnai
Web → https://cg.tuwien.ac.at/~zsolnai/

Source

Similar Posts

38 thoughts on “Deep Neural Network Learns Van Gogh's Art | Two Minute Papers #6”

  8. Fascinating!
    Now there NEEDS to be a competition, between artists and this neural network, with blind-judging to see who creates the better art.
    They should get some present day artists, and have them paint their version of a scene, then use this algorithm to paint the same scene, using some of those artist's past works as examples to base on. I bet the results would be interested, at the very least, and might even be useful for improving the neural network's abilities.

  11. For the handful of you that think this is somehow competition for artists, robots aren't creative the people who made the program are. On top of that the program doesn't create new style, it merely rehashes it in a new form. I think artists will use programs like this probably to great effect. But it's another tool. AI can never compete with humans when it comes to visual art, literature, music, etc. etc.

  14. Ez nagyon tetszik, a kérdésem az, hogy ez a program(?) bárki számára hozzáférhető lesz vagy már az? Ha igen, akkor hogyan lehet ehhez hozzájutni?

  15. Speaking as an artist,I find this really interesting but could a computer as splodges of oil to a canvas the way a human does? Perhaps,but perhaps not, we shall see.

  16. Hi Károly Zsolnai-Fehér. Do you have a email address I can contact you with? I writing on behalf of a film school that is about to make their first year film project.
    – Melanie

  18. Automation threatens fork lift and truck drivers now, next maybe the creative arts and programing itself. "Learning" rather than "programming" results in "analog" look rather than "digital". Output from a process. When I fumble around with a creative thing I often enjoy the process more than the output. Hey strong, general A.I. of the future learn to "enjoy" learning this process and I grant "you" the right to vote. Wonder what artificial neural netwerks are being tasked with behind the scenes? Apply this to music? Deep feedforward neural networks will maybe even help understanding of our own wetware. In the meantime the U.N. is seeing discussions on the non-proliferation of A.I. and progressives are suggesting a universal basic income to offset massive displacement in a future of massive abundance. Wish I could wake up when it's all over . . no l'd miss out on the process.
    Don't miss out-please vote.

  20. Great video, but it makes me pensive. The photo you took to show examples is exactly the city I live in (Tübingen, Germany). I think this could be a compliment 😀

  21. Thanks for sharing. Great motivation. But I think It's better to explain more about how the paper's method or model works.

  24. I read the paper but it's really unclear how they capture the style information in an image. Pretty much all they say is that they 'compute the correlations between the different filter responses'. Can anyone explain how it works or point me to something that explains it?

  28. Reminds of a TED talk about a neural network learning to perceive previously learned images in the contours and detail of larger images, like a formulaic way of encapsulating a kind of fractal creativity.
    However, this is more like a stylistic rendering algorithm

  34. While impressing im not blown away to be honest, it looks like a cheap copy 'in the style of'' without any of that stylistic choice making contextual sense it remains a superficial appropriation. It is interesting though and I would love to see more developments in painting neural networks, though what I see here this approach I do not think it will achieve great results they seem focused on superficial copying of the style which doesnt elevate it much beyond a tacky photo filter letting it do multiple very different artistic styles. Id be much more interested in a in-depth study of one specific style of painting (the technique of 1 artist) but really working towards a deep understanding of that technique I think this in time can achieve very interesting results. Impressionistic paintings like that van Gogh for example are all about how to render a image of the world in a specific medium (painting) and ideas that the artist has about choices that are to be made in this rendering, I think its very applicable for this type of neural network study, would love to see a in-depth project concerning Cezanne with this, I think his still lives would be a very good subject for such a study. Not only interesting on the computer research side of it but also as opening up a whole new field of artistic/art theory research.

  35. when i see this i hope i'm still alive when AIs take over the DanceFloors and rock the human race to another dimension. 😀
    !!! PARTY ON !!!

  38. We're all so screwed…
    Social credit, replacing money with digital currency, intrusive and constant surveillance, diagnoses which change a citizen's status making them second-class citizens, rampant unemployment which also changes a person's status, a global market which has wages drop and reduce each individual's buying power, government-imposed restrictions on how much someone can earn, not being able to make money under the table, social media filtering offensive thinking and descent… not being able to escape the watchful and critical eye of our oppressors and colleagues. "OBEY!".
    https://www.youtube.com/watch?time_continue=2&v=eViswN602_k

Comments are closed.

WP2Social Auto Publish Powered By : XYZScripts.com