The Log

all discussion3 showcase2 question2 snippet1 article1 poll1

backend3 tooling3 frontend2 community2 #Rust

Mon, Oct 26

Rayhan Kabir @rayhan 1w discussion pinned featured ed81a45

Rust async stream processing: walking a 4 GB event log without blocking the runtime

We ingest a rolling 4 GB event log across hundreds of thousands of lines, and the first cut blocked a worker on every 8 MB page fetch. Here is the async stream version that keeps the runtime hot end to end — patch, review comments and all.

#Rust #Async #Tokio #Performance

62 like 19 love 28 insight

Active in this log

RK Rayhan Kabir @rayhan · 1 post

Find someone else

That's the root post. There's nothing before it.