[jira] [Created] (APEXCORE-745) Buffer server may stop processing tuples when backpressure is enabled

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

[jira] [Created] (APEXCORE-745) Buffer server may stop processing tuples when backpressure is enabled

JIRA jira@apache.org
Vlad Rozov created APEXCORE-745:
-----------------------------------

             Summary: Buffer server may stop processing tuples when backpressure is enabled
                 Key: APEXCORE-745
                 URL: https://issues.apache.org/jira/browse/APEXCORE-745
             Project: Apache Apex Core
          Issue Type: Bug
          Components: Buffer Server
    Affects Versions: 3.6.0
            Reporter: Vlad Rozov
            Assignee: Vlad Rozov
            Priority: Critical


When backpressure is enabled, blocks released by a publisher are not evicted. This may lead to a condition (for example when there is a delay between publisher and subscribers request) where the publisher publishes all data blocks that the buffer server is allowed to allocate before subscribers submit subscription requests. It leads to the publisher being blocked, so it does not accept any new data and does not notify subscribers that the new data is available. At the same time subscribers are not scheduled to run after they catchup (or exit catchup), so the publisher will be blocked indefinitely. Restarting the downstream container (due to, for example, blocked downstream operator) repeat the same sequence and does not help.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
Loading...