Streaming

Rate limiting is built in: configure token buckets, sliding windows, or adaptive limits that respond to backpressure.

Graceful shutdown waits for in-flight events to complete, then closes connections cleanly—no lost events, no crashes.

stream.pipe(map(e => e.data), buffer(100, 5000), flatMap(batch => fetch('/api/bulk',  body: JSON.stringify(batch) ))).catch(console.error);

Graceful shutdown waits for in-flight events to complete, then closes connections cleanly—no lost events, no crashes.

Streaming

Error handling is explicit: catch failures at any stage, log them, and route bad events to a dead-letter queue without stopping the main pipeline.

await stream.ack(event.id); const pipeline = stream.filter(e => e.amount > 100).map(e => ( ...e, fee: e.amount * 0.03 )).on('error', (err) => logger.error(err));

Each event flows through a series of transformation stages, with built-in support for filtering, mapping, and conditional routing.