PicoMQ: Durable HTTP Streams via Object Storage

PicoMQ offers real-time, durable streaming capabilities delivered over HTTP, utilizing S3-compatible object storage as its primary backend.

Etymology: The name Pico is derived from the Latin word picus, which translates to "woodpecker" (member of the Picidae family).

The Architectural Philosophy

PicoMQ departs from traditional messaging patterns. Rather than packing every record of a similar type into one massive topic, it advocates for a granular approach: create a dedicated stream for every individual use case.

Core Capabilities

• Independently Addressable: Every stream is its own entity.
• Bottomless Capacity: Leveraging object storage means storage limits are virtually non-existent.
• Elastic Scaling: The system is designed to scale seamlessly from $T_{idle}$ to $T_{high\_throughput}$.

Technical Specifications

Deployment Checklist

• Unlimited stream creation
• High-throughput capability
• Simplified deployment process
• Decoupled architectural layers

Example Interaction

To interact with a stream, you can use a simple curl command:

# Sending data to a specific use-case stream
curl -X POST https://api.picomq.io/streams/user-signup-events \
     -H "Content-Type: application/json" \
     -d '{"user_id": 123, "status": "complete"}'

In mathematical terms, the storage capacity $S$ can be viewed as: $S \approx \infty$ (given the nature of cloud object storage).