Back

USDB: Scaling Storage for Next-Generation Recommender Systems at ByteDance

43 points7 hoursarxiv.org
BenoitP • 6 hours ago

Setting up a classical DLRM at work, show of hands: who has managed to bridge the gap to generative recommenders or LRMs?

Our survey identified quite a substantial list of challenges: product cardinality (Semantic IDs?), low performance vs discriminative recommenders (our user intents are heavily biases towards repetitive products), cold starts, entity features, missing explainability suite, training cost, prediction cost, etc.

Has anyone done it easily? Where is the tutorial for generative recommenders ?

whimsicalism • 5 hours ago

GR expertise is essentially only in-house at major social media companies or people hired from these companies. Closest thing to a tutorial for LRM is the Kuaishou onerec papers.

BenoitP • 4 hours ago

Yeah OneRec is on our radar. I'd love to adapt their pipeline, but it's a very long shot in the small company I'm in.

bashhq_r • 4 hours ago

So bytedance has the luxury of building custom storage for this, meanwhile we're over here trying to shoehorn user sequences into redis sorted sets

mikert89 • 4 hours ago

The future of recommenders is just an agent paging through your data and trying picking the best next options

deepsun • 3 hours ago

That's how they've been working for decades, ever since Facebook changed timeline to feed.