dhtredist: Could different strategies be combined into a single, intelligent mode?

[gavin-norman-sociomantic]

It seems like we could come up with a set of heuristics to detect various node configurations and automatically initiate the most optimal redistribution.

For example, the case -- currently covered by the subdivide strategy -- where there is an equal number of new nodes on each existing server could be detected automatically. Likewise, the case where the number of new nodes on each server is evenly divisible by the number of existing nodes on each server could also be detected and handled automatically.

[gavin-norman-sociomantic]

David said:

An approach could be to reduce the ratio n_new/n_old to a/b * c (a, b, c integer; a as small as possible) so that it is known that there are c separate sub-distributions of each a to b nodes. For the subdivide strategy b would be 1.
If max(a, b) is fairly small then the (many) c separate distributions could probably be optimised so that each node either only sends or receives a burst of records at a time.