Commit History
-
expose ggml's get_rows, and rename the package to match the repo
`get_rows` dequantizes as it gathers, so reading a few rows out of a large table never materializes the rest -- which is what an embedding lookup wants. `dequantize` becomes the special case: every row in order. CUDA has no indexed dequantize upstream, so it gathers first and unpacks after, as before.e9319be