Mirror of forum.nim-lang.org

13483 :: nimsync v0.1.0 — Lock-free SPSC channels (213M ops/sec single-threaded)

• Codenimja (orginal) [2025-10-31T18:59:38+01:00] view original

  Repo: https://github.com/codenimja/nimsync

  nimble install nimsync nimble bench → 213M ops/sec

  • Single-threaded SPSC
  • Lock-free, zero deps/GC, ORC-safe
  • Stress-tested (spawn storm, backpressure, etc.)

  Feedback welcome.

---

• Araq (orginal) [2025-10-31T19:37:10+01:00] view original

  So is this async and multi-threaded or only asnc or only multi-threaded? Sorry for the stupid question, I don't have time to study it.

---

• Isofruit (orginal) [2025-10-31T23:27:17+01:00] view original

  Is this validated via thread-sanitizer/address-sanitizer to work correctly?

---

• elcritch (orginal) [2025-11-01T20:32:02+01:00] view original

  Looks great if it's well tested and holds up! I second the thread-sanitizer testing. :)

---

• darkestpigeon (orginal) [2025-11-02T16:55:16+01:00] view original

  For reference, a 100 line C implementation of Vyukov's queue https://github.com/b0bleet/cmpmc.

  The advertized benchmark here doesn't measure much. A single thread is pushing an item and popping an item to the queue one at a time. And it actually measures how many of these operations failed and reports that as "contention rate" ;)

  In the queue implementation here the queue is claimed to be SPSC, but uses atomic values for head and tail. Some later commits introduced additional atomic counter for the head for the MPSC mode (???). By the way, nim has {.align.}, no need to insert padding manually.

  But what is the goal here? Is author trying to solve some problem? To learn something? Is it some homework project?

---

• blackmius (orginal) [2025-11-03T06:45:52+01:00] view original

  looks like vibecoded project

---

• Codenimja (orginal) [2025-11-05T01:21:47+01:00] view original

  @Araq @Isofruit @elcritch @darkestpigeon

  Thanks for the feedback — sharp as always.

  @Araq: v1.1.0: SPSC + MPSC (single consumer). Async via Chronos (send/recv). Multi-threaded via spawn + MPSC (2 producers: 15M ops/sec realistic). Zero GC with ORC. Goal: p2p pipelines (Waku-style) without pauses.

  @Isofruit @elcritch: Running thread-sanitizer, helgrind, valgrind next. Stress tests (spawn storm, backpressure) passed clean in CI. PRs with test scripts welcome.

  @darkestpigeon:

  • Vyukov-inspired ring buffer.
  • Atomic head/tail for SPSC. MPSC uses extra atomic counter (wait-free).
  • {.align.} > manual padding — fixed.
  • Benchmark: push/pop loop. → Realistic: ~35M ops/sec SPSC, 15M MPSC (2 producers). → Contention = failed trySend spins.
  • Goal: solve real Nim p2p contention.

  Repo: https://github.com/codenimja/nimsync

  • CI: 7 SPSC + 1 MPSC benchmarks
  • 558M ops/sec micro SPSC, 31ns P99
  • vs. Tokio/Go/LMAX (README)
  • nimble bench to run

  v1.1.0 production-ready. Feedback/PRs welcome.

  boonzy u/Bo0nzy

---