Return partial results from pipeline in the case of failure

[travisofthenorth]

Hello!

When using a pipeline, it appears that if one node has an issue (timeouts for instance), the entire pipeline raises an exception. This is unfortunate in the case of a read-through cache, for example, as the pipeline may successfully get back 95% of the keys requested. Because the entire pipeline fails, the application has to perform a much slower operation with 100% of the keys instead of a very small portion of them, which can lead to much worse latencies.

Is there any way to configure a pipeline to return partial results, or is it possible and desirable to add such a feature?

Thanks in advance!

[petyaslavova]

Hi @travisofthenorth, can you please provide more information about the redis-py version you are using and how your client is configured?

[travisofthenorth]

Hi @petyaslavova. I'm using 6.2.0. I'm using a RedisCluster with a 1s socket connect timeout, a 100ms socket timeout. Some other settings:

cluster_error_retry_attempts=1
reinitialize_steps=1
read_from_replicas=False
dynamic_startup_nodes=False

I have a retry policy of 3 retries using an exponential backoff.

Any other info helpful?