Namespace mapstream

MapStream namespace for streaming one-to-many transformations.

MapStream is similar to Map but returns results as an async iterable stream instead of an array. This is useful when:

Output size is unknown or potentially large
You want to emit results as they become available
Processing involves I/O that benefits from streaming

Example

import { mapstream } from '@numaproj/numaflow-js';

const server = new mapstream.AsyncServer(async function* (datum) {
  const lines = datum.value.toString().split('\n');

  for (const line of lines) {
    if (line.trim()) {
      yield new mapstream.Message(Buffer.from(line));
    }
  }
});

server.start();

Classes

AsyncServer
Message

Interfaces

Datum
MessageOptions

Type Aliases

MapStreamCallback