jeffw@lemmy.world to Technology@lemmy.worldEnglish · 4 days agoOpenAI, valued at $157 billion, isn't profitable. Should that be normal?www.salon.comexternal-linkmessage-square110fedilinkarrow-up1437arrow-down110
arrow-up1427arrow-down1external-linkOpenAI, valued at $157 billion, isn't profitable. Should that be normal?www.salon.comjeffw@lemmy.world to Technology@lemmy.worldEnglish · 4 days agomessage-square110fedilink
minus-squarejacksilver@lemmy.worldlinkfedilinkEnglisharrow-up2·2 days agoWith these kinds of models you can’t ever stop training them, otherwise you reach a point where the data becomes dated and thus the model is dated. Think world events. Say another bird flu became a pandemic. The model can only know about that if it’s trained on those events. There are systems (Rag) that can answer questions based on additional content, but that would only work on a subset of problems/situations.
minus-squareFizz@lemmy.nzlinkfedilinkEnglisharrow-up1·2 days agoOh true i did not consider that they require constant training to stay up to date.
With these kinds of models you can’t ever stop training them, otherwise you reach a point where the data becomes dated and thus the model is dated.
Think world events. Say another bird flu became a pandemic. The model can only know about that if it’s trained on those events.
There are systems (Rag) that can answer questions based on additional content, but that would only work on a subset of problems/situations.
Oh true i did not consider that they require constant training to stay up to date.