Sergey Levine: evaluation

Transcript context

…Just to give an order of magnitude, how does the amount of data you have collected compare to internet-scale pre-training data? I know it's hard to do a token-by-token count, because how does video information compare to internet information, et cetera. But using your reasonable estimates, what fraction? It's very hard to do because robotic experience consists of time steps that are very correlated with each other. The raw byte representation is enormous, but probably the information density is comparatively low. Maybe a better comparison is to the datasets that are used for multimodal training. And there, I believe last time we did that count, it was between one and two orders of magnitude. The vision you have of robotics, will it not be possible until you collect what, 100x, 1000x more data?…

Stored transcript either side of the excerpt. The highlighted words are the published quote; the surrounding text is unedited source, never generated.