Making Visual Art with GANs: Week 1 – Testing RunwayML

After getting set up in RunwayML I trained my first image of a black and white scene of ducks. I trained it on the Picasso model.

input – picasso model

ducks in batsto lake by author

output – picasso model

ducks in batsto lake trained with the Picasso model in RunwayML

I was really excited to train different models on this photograph of the Jersey Devil at Lucille’s in New Jersey, especially the MUNIT model. I thought a menacing figure comprised of flowers would be a fun experiment. First I trained with two different models (sketch model & picasso) before changing the “style” function number for tons of variation on the MUNIT model.

input – for all following output images trained on different models

jersey devil at Lucille’s by author

output- photo sketch model

jersey devil trained on photo sketch model in RunwayML

output – picasso model

jersey devil trained on the picasso model in RunwayML

output – picasso model

jersey devil trained on the picasso model in RunwayML

output – munit model for subsequent images

jersey devil trained on the MUNIT model in RunwayML
jersey devil trained on the MUNIT model in RunwayML
jersey devil trained on the MUNIT model in RunwayML
jersey devil trained on the MUNIT model in RunwayML
jersey devil trained on the MUNIT model in RunwayML
jersey devil trained on the MUNIT model in RunwayML
jersey devil trained on the MUNIT model in RunwayML
jersey devil trained on the MUNIT model in RunwayML
jersey devil trained with the MUNIT model in RunwayML

After working with the MUNIT model I wanted to train a color photograph, so I used this beach sunset image to train the subsequent images.

input – for following output images

beach sunset by author

OUTPUT – KANDINSKY style transfer

beach sunset trained with Kandinsky style transfer model in RunwayML

output – cubist style transfer

beach sunset trained with the cubist style transfer model in RunwayMl

output – hokusai style transfer

beach sunset trained with the Hokusai style transfer model in RunwayMl

output – wu guanzho style transfer

beach sunset trained on the Wu Guanzho style transfer model in RunwayMl

I really loved what the Hokusai style transfer looked like and wanted to train it on this photograph of a lake at Cedar Bridge Tavern in New Jersey. It looks like the darkest areas of the image turned into just blurred light so in the future I would adjust the brightness to try and avoid that effect with this model.

input – hokusai style transfer

lake at cedar bridge tavern by author

output – hokusai style transfer

lake at cedar bridge trained with the Hokusai style transfer model in RunwayMl

Leave a comment