Hi MartR,
I am going to work on improvements on the stream and stalls. But in order to do this I need some explanation from both of you.
Even at 90s, for some reason Twitter stops the stream occasionally before the 90 timeout has had a chance to recycle.
From what I understand you have a stream that stops working before the 90 first seconds it started? I am not sure I understand this clearly.
The problem with this is that the code needs to be able to attempt to restart immediately rather than just wait for the next timer to elapse - otherwise it might miss events.
I agree but I cannot really see a solution to this. Twitter clearly states that a stream we can know that a stream is dead after 90 seconds without any information.
My worry is that if we specify a limit at 70 seconds for example, and the stream is not dead. At second 71 we are restarting the stream and a Tweet is added to the stream. We therefore missed the event. When the stream has restarted at second 72 we have missed it without knowing.
Do you think it would be a good idea to give the option to developers to themselves specify a timeout after which the stream will restart?
Not only that, according to the documentation, it then needs to back off exponentially with any necessary retries if that connection is not successful for some reason.
The issue with the back off is that it is only available to user with elevated privileges on the Stream API. Do you think it is worth adding such a feature as so few developers will benefit from it?
Regards,
Linvi
I am going to work on improvements on the stream and stalls. But in order to do this I need some explanation from both of you.
Even at 90s, for some reason Twitter stops the stream occasionally before the 90 timeout has had a chance to recycle.
From what I understand you have a stream that stops working before the 90 first seconds it started? I am not sure I understand this clearly.
The problem with this is that the code needs to be able to attempt to restart immediately rather than just wait for the next timer to elapse - otherwise it might miss events.
I agree but I cannot really see a solution to this. Twitter clearly states that a stream we can know that a stream is dead after 90 seconds without any information.
My worry is that if we specify a limit at 70 seconds for example, and the stream is not dead. At second 71 we are restarting the stream and a Tweet is added to the stream. We therefore missed the event. When the stream has restarted at second 72 we have missed it without knowing.
Do you think it would be a good idea to give the option to developers to themselves specify a timeout after which the stream will restart?
Not only that, according to the documentation, it then needs to back off exponentially with any necessary retries if that connection is not successful for some reason.
The issue with the back off is that it is only available to user with elevated privileges on the Stream API. Do you think it is worth adding such a feature as so few developers will benefit from it?
Regards,
Linvi