You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
io_uring et al. - we're not comparing same IO because our IO is blocking. The same issue is lock contention because every pread() is spawnedas a blocking task. Possible solution for this is vectorised reads/multi-reads.
feature-vectors/correlated is faster with footer reopen. Why?
Marginal improvements:
For small split read tasks the time of reading is marginal compared to tokio task planning and LazyScanStream initialization. This may be solved by a heuristic - only for the main thread.
Lance is better on feature vectors by around 3-15x.
Marginal improvements: