Public evidence record

Abhinav Venigalla

Published podcast speaker

Claims: 8
Episodes: 1
Shows: 1
Named items: 0

Claim ledger

What Abhinav said.

2 transcript-backed records

01 / commitment

20 May 2023

We're not gonna train on it. But, we don't like to do that currently because, um, it makes us give up determinism, stuff like that.

“We're not gonna train on it. But, we don't like to do that currently because, um, it makes us give up determinism, stuff like that.”

Speaker: Abhinav Venigalla
Episode: MPT-7B and The Beginning of Context=Infinity — with Jonathan Frankle and Abhinav Venigalla of MosaicML
Publisher: Latent Space

02 / commitment

20 May 2023

Our line two defense was that we used determinism and basically really smart resumption strategies so that if something catastrophic happened, we can resume very quickly, like a few batches before.

“Our line two defense was that we used determinism and basically really smart resumption strategies so that if something catastrophic happened, we can resume very quickly, like a few batches before.”

Speaker: Abhinav Venigalla
Episode: MPT-7B and The Beginning of Context=Infinity — with Jonathan Frankle and Abhinav Venigalla of MosaicML
Publisher: Latent Space

Search evidence