![](https://media.kbin.social/media/e0/13/e013a5c6770dc738d2f499f54ac967a8eb670ac3c5d6f18f7603edf89f529b0b.jpg)
![](https://lemmy.ml/pictrs/image/2QNz7bkA1V.png)
thatās a lack of understanding of concepts though, rather than a lack of creativityā¦ curation requires that you understand the concept that youāre trying to curate: this looks more like a dog than this; this is a more attractive sunset than this
current LLMs and ML donāt understand concepts, which is their main issue
id argue that it kind of does āthink about its own thoughtsā to some degree: modern ML is layered, and each layer of the net feeds into the nextā¦ one layer of the net āthinks aboutā the āthoughtsā of the previous layer. now, it doesnāt do this as a whole but neither do we: memories and neural connections are lossy; heck even creating a creative work isnāt going to turn out exactly like you thought it in your head (your muscle memory and skill level will effect the translation from brain to paper/canvas/screen)
but even we hallucinate in the same way. donāt look at a bike, and then try and draw a bikeā¦ youāll get general things like pedals, wheels, seat, handlebars, but itāll be all connected wrong. this is a common example people use to show how our brains arenāt as precise and we might like to thinkā¦ drawing a bike requires a lot of very specific things to be in very specific places and thatās not how our brain remembers the concept of ābikeā
i donāt agree with that definition of creativeā¦ thereās lots of engineering work thatās creative: writing code and designing systems can be a very creative process, but doesnāt involve feelingā¦ itās problem solving, and thats a creative process. youāre narrowly defining creativity as artistic expression of emotion, however thereās lots of ways to be creative
now, i think thats a bit of a strawman (so iāll elaborate on the broader point), but i think its important to define terms
i agree we should be skeptical of marketing hype for sure: the type of creativity that i believe ML is currently capable of is directionless. it doesnāt understand what itās creatingā¦ but the truth lies somewhere in the middle
ML is definitively creating something new that didnāt exist before (in fact iād say that its trouble with hallucinations of language are a good example of that: it certainly didnāt copy those characters/words from anywhere!)ā¦ this fits the easiest definition of creative: marked by the ability or power to create
the far more difficult definition is: having the quality of something created rather than imitated
the key here being ārather than imitatedā which is a really hard thing to prove, even for humans! which is why our copyright laws basically say that if you have evidence that you created something first, you pretty much win: we donāt really try to decide whether something was created or imitated
with things like transformative works or things that are similar, itās a bit more of a grey areaā¦ but the argument isnāt about whether something is an imitation; rather itās argued about how different the work is from the original