An inference engine for generative recommendation: catalog-constrained wide beam search, executed inside CUDA graphs.

https://github.com/sohu-mptc/FlashRec