Play video
What's Next After RLHF? — Diogo Almeida, TypeSafe AI
RLHF made models that are extraordinary at pleasing the human in the loop, and Diogo Almeida, a GPT-4 co author, argues that is exactly the problem.
Research archive, page 57
Browse entries 1345–1346 of 1346. Return to the first page to search and filter the complete collection.
Play video
Play video
The Base Model Is Dead — Varun Singh, Arcee AI
The old story is that a base model is a mirror of the internet, a good model of human web text that everything else gets bolted onto. Varun Singh, who leads pre-training at Arcee AI, argues that story is dead: no modern base model reflects the web the way GPT-3 once did.