[jira] [Commented] (APEXCORE-745) Buffer server may stop processing tuples when backpressure is enabled

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

[jira] [Commented] (APEXCORE-745) Buffer server may stop processing tuples when backpressure is enabled

JIRA jira@apache.org

    [ https://issues.apache.org/jira/browse/APEXCORE-745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16048120#comment-16048120 ]

ASF GitHub Bot commented on APEXCORE-745:
-----------------------------------------

Github user vrozov closed the pull request at:

    https://github.com/apache/apex-core/pull/542


> Buffer server may stop processing tuples when backpressure is enabled
> ---------------------------------------------------------------------
>
>                 Key: APEXCORE-745
>                 URL: https://issues.apache.org/jira/browse/APEXCORE-745
>             Project: Apache Apex Core
>          Issue Type: Bug
>          Components: Buffer Server
>    Affects Versions: 3.6.0
>            Reporter: Vlad Rozov
>            Assignee: Vlad Rozov
>            Priority: Critical
>
> When backpressure is enabled, blocks released by a publisher are not evicted. This may lead to a condition (for example when there is a delay between publisher and subscribers request) where the publisher publishes all data blocks that the buffer server is allowed to allocate before subscribers submit subscription requests. It leads to the publisher being blocked, so it does not accept any new data and does not notify subscribers that the new data is available. At the same time subscribers are not scheduled to run after they catchup (or exit catchup), so the publisher will be blocked indefinitely. Restarting the downstream container (due to, for example, blocked downstream operator) repeat the same sequence and does not help.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)