AI has a habit of doing things you never expected, but this isn't creativity - it's generally lack of imagination or analysis on our part. It isn't that AI s creative, it is that that we are not as clever as we think we are.
Way back when I first started in AI, I was assigned a project to classify photos of cracks in materials - all the program had to do was say there was a crack or there wasn't a crack. I used a very simple analysis procedure that today you probably wouldn't even consider AI - discriminant analysis. I was amazed I got 100% correct classification. Then I did some image processing and normalized the brightness so that all of the images had the same average luminance. I got 0% correct classification. It turned out that the cracks were bright and the analysis had used average brightness to classify the images. As it happened this was a practical success and the complex "AI" was replaced by a light meter and a threshold gate.
The point of this story is that I had convinced myself that something clever was going on, and it wasn't. I didn't really understand the techniques I was using. The same is true, only much more so, today. Researchers are often unable to predict what their complex optimization approaches will lead to. It is just too tempting to jump back, hold your hands in the air, and say "its creative!". Well no; it is just that you missed seeing a whole part of the parameter space that the optimizing algorithm didn't miss.
This said there are some lovely stories that will keep you amused for ages. So much so that a group of researchers have got together to tell their tales, but not over a camp fire in the dead of night. Instead they have collaborated on a paper: The Surprising Creativity of Digital Evolution: A Collection of Anecdotes from the Evolutionary Computation and Artificial Life Research Communities. The list of authors and establishments is far too long to give here, but as they describe it:
"This paper is the crowd-sourced product of researchers in the fields of artificial life and evolutionary computation who have provided first-hand accounts of such cases. It thus serves as a written, fact-checked collection of scientifically important and even entertaining stories. In doing so we also present here substantial evidence that the existence and importance of evolutionary surprises extends beyond the natural world, and may indeed be a universal property of all complex evolving systems."
You can tell that I'm not really in agreement with the idea that any of this proves that random algorithms are creative in any sense other than random surprise. I am more sympathetic to the idea that this is a form of blind creativity that occurs within evolution, but without us to notice it and call it creative it is just another random adaptation.