robertskmiles
patreon
Announcement: Recording for Computerphile about GPT-3
🕑 Added 2020-06-17 10:40:58 +0000 UTCJust thought I should let patrons know that we've had a go at recording Computerphile remotely, talking about OpenAI's new GPT-3 model.
I wanted to include a photo but there's really nothing to show since it's just me at my regular desk with Sean on the phone :/
Anyway hopefully that will be published soon, I'll link it here when it's out!
Comments
GooGhoul
Oooh, I want a discussion on scaling, since GPT-3 is mostly just GPT-2 with 100x more parameters. If we had enough money to add even more parameters, how high could you scale it for GPT-4 or 5 and how many parameters until it's human level at text prediction?
"humans love examples". riiiight. Thats exactly what an almost super intelligent AGI would say if it was desperate for more training data. Can we get a captcha feature in here plz?
loopuleasa
curious to see please do focus on examples humans love examples
