lseif@sopuli.xyz to Programmer Humor@lemmy.ml · 5 months agoIf AI can now speak Italian, it can certainly replace us...sopuli.xyzimagemessage-square12fedilinkarrow-up17arrow-down10
arrow-up17arrow-down1imageIf AI can now speak Italian, it can certainly replace us...sopuli.xyzlseif@sopuli.xyz to Programmer Humor@lemmy.ml · 5 months agomessage-square12fedilink
minus-squarePlexSheep@infosec.publinkfedilinkarrow-up1·5 months agoDo you have a source for that? Seems like an internal detail a corpo wouldn’t publish
minus-squarestingpie@lemmy.worldlinkfedilinkarrow-up1·5 months agoCan’t find the exact source–I’m on mobile right now–but the code for the gpt-2 encoder uses a utf-8 to unicode look up table to shrink the vocab size. https://github.com/openai/gpt-2/blob/master/src/encoder.py
Do you have a source for that? Seems like an internal detail a corpo wouldn’t publish
Can’t find the exact source–I’m on mobile right now–but the code for the gpt-2 encoder uses a utf-8 to unicode look up table to shrink the vocab size. https://github.com/openai/gpt-2/blob/master/src/encoder.py