Chunking and bundling

Bug #1612771 reported by Mike Rylander on 2016-08-12
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
OpenSRF
Wishlist
Unassigned

Bug Description

Configuring XMPP stanza size for OpenSRF can be confusing, and, in some cases, fraught with dangers. It's an opaque value unless you know most of the backend code, and tuning it is basically guess work until you run into a specific failure case.

So let's fix that! Here is offered a branch from early 2014 that Bill Erickson and I collaborated on that provides the following features:

 * OpenSRF message bundling -- Pack multiple OpenSRF messages together in a single XMPP envelope, as long as we believe more messages will be sent in the future and we are below some threshold of combined message size. The default for that threshold is 25Kb.

 * OpenSRF message chunking -- Break up large OpenSRF messages across multiple XMPP envelopes. This is implemented with a new OpenSRF message type. C, Perl, and Javascript libraries are taught how to reconstruct chunked messages. The default chunking threshold is 50Kb, just a bit below the default ejabberd max stanza size of 64Kb.

Branch to follow soon...

Galen Charlton (gmc) wrote :

I've pushed a rebased version of the branch (along with some documentation improvements) to master for inclusion in 2-5-alpha. Thanks, Mike and Bill.

Changed in opensrf:
status: New → Fix Committed
importance: Undecided → Wishlist
Galen Charlton (gmc) on 2016-12-07
Changed in opensrf:
status: Fix Committed → Fix Released
To post a comment you must log in.
This report contains Public information  Edit
Everyone can see this information.

Other bug subscribers