Episode 222: Granite Cocks vs Robot Overlords

1

DALL-E

#AI #Design Tools #Action 196 social mentions

2

GPT-J

So first of all, I would like to temper tamler’s confidence that AI seems ever 30 years away. We are making terrifying leaps forward all the time! Look at gpt-3, it is the largest convolutional neural network in use today. There is an open source version of it which is not quite as sophisticated (but still absurdly terrifying) called gpt-j that you can play with yourself here and you can watch a great video about it (it’s a little technical) here. Think of it as a kind of text auto completion algorithm which creates long and suspiciously unique thoughts. You can ask it questions like what is 4+4 and not be surprised that it knows the answer is 8 because this is probably an exact quote that it read somewhere else before, but you can also ask it to add large numbers that it could not have possibly seen before and usually get correct answers, which can only mean that a natural language processing algorithm has somehow learned basic rules of math by extrapolating from read examples on the internet. Gpt 3 is so terrifying that many researchers are trying to prevent it from becoming publicly available.

#Productivity #Open Source #Developer Tools 95 social mentions