Generating faces of cats using Generative Adversarial Networks(ajolicoeur.wordpress.com)

126 pointsby gk19 tahun yang lalu55 comments

ajolicoeur.wordpress.com

Generating faces of cats using Generative Adversarial Networks

https://ajolicoeur.wordpress.com/cats/

60 comments

threepipeproblm9 tahun yang lalu

I was expecting meows.

ryall9 tahun yang lalu

If it's meows you want, have I got the album for you!

http://pitchfork.com/reviews/albums/21145-meow-the-jewels/

[deleted]9 tahun yang lalu

cctan9 tahun yang lalu

I too was expecting meow purr audio content generation when I clicked into the link haha.

phs25019 tahun yang lalu

Yeah, that would have been more interesting.

This is technically a meow generator generator.

dredmorbius9 tahun yang lalu

http://discuss.joelonsoftware.com/default.asp?joel.3.219431....

[deleted]9 tahun yang lalu

BinaryBullet9 tahun yang lalu

not meows, but here are some purrs: https://purrli.com/

E63009 tahun yang lalu

It's a shame that the meows in the "meow-y" setting are just regular meows, not purry meows (as in, meowing and purring simultaneously).

jpindar9 tahun yang lalu

here's some more purrs: https://mynoise.net/NoiseMachines/catPurrNoiseGenerator.php

ovrdrv39 tahun yang lalu

OP's post was amazing but can someone explain how this was probably made?

Chris20489 tahun yang lalu

captive feline

E63009 tahun yang lalu

I think the sound is generated locally. Check out the page source, which contains the JS I think is responsible for generation (I haven't checked in detail).

audiosampling9 tahun yang lalu

Meow-generator when the last slider is set to Meow-y ;-)

syntheticnature9 tahun yang lalu

I'll admit I too was expecting cat-centric "speech" synthesis.

threepipeproblm9 tahun yang lalu

Did you try clicking on the cat faces to see if they meowed? Not a proud confession here.

BTW this is a cool project even without the audio.

[deleted]9 tahun yang lalu

Zenbit_UX9 tahun yang lalu

Wait, it's actually generating new cat faces as in cats that don't exist? Some of those images looked like they had backgrounds in the corners was that also generated???

robotresearcher9 tahun yang lalu

Yes.

Paul-ish9 tahun yang lalu

These things are always low resolution. At some point I'd like to see the state of the art move into more realistic (say ~500x500) dimensions.

gwern9 tahun yang lalu

It's a combination of GPU RAM, slowdowns (remember it's squared in dimensions), and stability (larger is more unstable end-to-end). Arguably, state of the art in image synthesis is DeepMind's PixelCNN: "Parallel Multiscale Autoregressive Density Estimation" https://arxiv.org/abs/1703.03664 , Reed et al 2017: generating 512px photorealistic images & video with PixelCNNs rather than GANs. Also good is StackGAN which does ~200x200ish but there's no reason it couldn't go up to 500x500 (just pop in a third upscaling stage).

There's far more work on GANs than PixelCNNs (see the https://github.com/hindupuravinash/the-gan-zoo ) but at least thus far, I haven't seen any GANs which appear visually competitive with Reed et al 2017's PixelCNN samples. Downside - code has not been released by DeepMind[], and you can't do CycleGAN or other stupid GAN tricks with PixelCNN AFAIK. CycleGAN is absolutely hilarious, if you haven't seen all the uses of it yet, much more interesting than generating cat faces.

[] I asked way back when and Reed said he'd try but nothing yet.

alexcnwy9 tahun yang lalu

I think it's in part due to the content loss piece being done using pre-trained imagenet models which typically resize images to 224x224...

gwern9 tahun yang lalu

That's not it. It's easy to scale a larger image down to 224x224 and feed it into a checkpoint. And a lot of these GANs don't use such content losses in the first place because it adds complexity and makes it harder to use (have to get one of those pretrained models in the first place).

[deleted]9 tahun yang lalu

nilkn9 tahun yang lalu

What are some potential applications of this outside of toy problems like cat pictures?

6502nerdface9 tahun yang lalu

Generating convincing profile pictures for thousands of fake social media accounts.

Or photo portraits of the "board members" for the About Us page of an autonomous corporation.

clock_tower9 tahun yang lalu

I expect it could stretch a game's art budget considerably, FWIW...

Jack0009 tahun yang lalu

generating tween frames for animation

leeoniya9 tahun yang lalu

welp, that's terrifying.

baybal29 tahun yang lalu

A dream of cat video clickfarmers came true

lostgame9 tahun yang lalu

Change the title? Seems like I wasn't the only one expecting some sort of audio-related thing.

ChristianBundy9 tahun yang lalu

Yeah, I put on headphones for this. Seems like a cat generator.

aleju9 tahun yang lalu

I would assume that the name was chosen, because I already have an old project online called "cat generator" [0], which used the same underlying technique (GANs), dataset and landmark-based normalization. Reusing the name would have resulted in confusion.

[0] https://github.com/aleju/cat-generator

dschu9 tahun yang lalu

Yet another cat generator then (:

sctb9 tahun yang lalu

Alright, we've updated the title from “Meow Generator”.

JohnStrange9 tahun yang lalu

(3)

bluetwo9 tahun yang lalu

Still no cure for cancer.

itg9 tahun yang lalu

If that's what you're interested, a quick google search will show you plenty of startups/companies applying machine learning/deep learning to medicine.

bluetwo9 tahun yang lalu

It's just a saying.

Usually said after someone shows off a highly complicated technology with no practical purpose.

dboreham9 tahun yang lalu

Read that as "Generating the feces of cats.." which would have been altogether more interesting a problem.

waqf9 tahun yang lalu

With this kind of task, how do you verify that you didn't just overfit and start reproducing the input data?

kowdermeister9 tahun yang lalu

She's generating it from noise: https://github.com/AlexiaJM/Deep-learning-with-cats/blob/mas...

Also, you could verify by writing unit tests with OpenCV to look for similar sources. Since it's all headshots, it will find matches for sure, but it would also find with human faces.

semiquaver9 tahun yang lalu

The neural network is starting from noise, but that's not the only input, it was trained on [0] and I think it's arguable that the NN is "reproducing" the images from its training dataset in some sense.

[0] https://web.archive.org/web/20150703060412/http://137.189.35...

radarsat19 tahun yang lalu

I think it's a very interesting question, of how can we measure when a neural network is being creative? In fact, creativity is not obvious at all. It's sort of an ill-posed question if you think about it. How can you verify that a network is generating things that are not like what it was trained on, yet are... like what it was trained on?

Are neural networks* forever relegated to the role of copying and interpolation? Do the neural network weights form a kind of database?

* (I don't think this only applies to neural networks, but models in general)

There was one recent work trying to address this [1] but I'm not 100% convinced and I think a lot more work is warranted in this area. A difficulty is that it's not a purely technical problem, but also one of semantics and interpretation. It's one that the "automatic musical accompaniment" community and other digital arts communities have struggled with for decades, and it's not resolved.

How do you know when a machine is being creative? It's not far from the moving goalposts problem of general artificial intelligence. How do you know when a machine is being intelligent, if you can always explain it away by examining the black box?

[1]: https://arxiv.org/abs/1706.07068

hyperpallium9 tahun yang lalu

The best one can hope for from a NN is that it discerns a model within the training data. There is a way to more-or-less onjectively measure how well it has done this, if at all: if the model requires less information than the data it explains. i.e. fewer bytes. So, "compression algorithms" are a rudimentary model of data; we'd like to do much better than that.

However, NN tend to not be very space-efficient, and also don't usually "explain" the data (in the sense of reproducing it). So this test is hard to apply to them.

BTW: human creativity has much to do with expectation: how obvious it was to you already. So, people with different levels of exposureto some art discipline have different opinions on creativity... and as new styles become known, those opinions change.

Human beings also draw on other fields and experiences, not available in training data. Especially striking, to humans, is inspiration from common experiences that are not recognised as common, as in art that reveals ourselves to us; observational humour. For a computer to use this information, it seems it would need to have human experiences, a body, social interaction etc. Of course, this is a very parochial concept... pure creativity need not be so anthropocentric.

zlynx9 tahun yang lalu

And likewise, how do you know when a human is being creative? Isn't all art derivative of our training and influences? I believe something like that was an argument by one of the random paint splatter artists: that randomness was the only thing truly creative.

Pica_soO9 tahun yang lalu

Pollock?

Pica_soO9 tahun yang lalu

Why is Jason Pollock now offensive?

https://en.wikipedia.org/wiki/Jackson_Pollock

Bunch of Avantgarde denialists!

If its not a painted photo, its not art? If i dont understand it, its not art? If its meta its not art?

qb459 tahun yang lalu

There is a popular conspiracy theory than nobody actually understands it and avantgarde artists are in fact con artists.

Not that I care enough to be offended, though.

And hell, if this is that "meta" meaning in their art, I must confess that I haven't got the joke until now :)

highd9 tahun yang lalu

Yep, this is a current area of research for content generation.

I think most current approaches build some transform to a latent space and then compare generated images with their nearest neighbors in the training set. If they're identical then your network just learned to reproduce the dataset.

E63009 tahun yang lalu

Yeah, I would have at least ran some kind of similarity search on the output. Without that check it's impossible to know if this is actually doing anything.

exabrial9 tahun yang lalu

Similar thoughts: How do I verify what I read isn't just technobabble haha. I don't think I understood much of it