P4DTI issue job000482

TitleP4DTI Windows Service stalls after a few days
Statusclosed
Priorityessential
Assigned userNick Barnes
OrganizationRavenbrook
DescriptionA customer running P4DTI 1.3.3 for TeamTrack as a Windows Service is reporting that the replicator is "stalling" after a few days [1].
They are running P4DTI 1.3.3 for TeamTrack on Windows 2000 Server[4,5,6,7].
The P4DTI is running on their TeamTrack server, which is in their DMZ. Their Perforce server is inside their internal firewall. Their internal firewall is configured to give the P4DTI access to the Perforce server[2].
The P4DTI is running as a Windows service (because they can't get long-term CLI access to that machine). This is why they are running P4DTI 1.3.3 and not a supported release (e.g. 1.2.1).
They have the P4DTI configured so that it can send e-mail messages (e.g. to the administrator).
The replicator runs normally for periods of a few days, replicating activity in both directions between TeamTrack and Perforce.
Every few days, the replicator stops replicating. It doesn't send any e-mail message or event log message indicating a problem; it just stops performing any useful replication activity.
When they notice that replication has stopped, they "restart" it. It then sends many replication conflict messages.
[NB 2002-03-27] In fact, the customer's replicator is not stalled. It's just backed-off exponentially so far that it looks stalled. See job000486. The fact that all their polls are failing (due to deleted TeamTrack issues[14,15,16], job000076) means that polls are also taking longer and longer and may end up in some sort of resource exhaustion [8,9,10,11,13]
AnalysisAnalysis of the log fragments in [12,14] clearly shows the exponential back-off (due to deleted TeamTrack issues, job000076).
How foundcustomer
Evidence[1] <http://info.ravenbrook.com/mail/2002/03/18/17-37-55/0.txt>
[2] <http://info.ravenbrook.com/mail/2002/03/18/18-25-29/0.txt>
[3] <http://info.ravenbrook.com/mail/2002/03/20/20-34-32/0.txt>
[4] <http://info.ravenbrook.com/mail/2002/03/21/15-38-20/0.txt>
[5] <http://info.ravenbrook.com/mail/2002/03/21/15-46-54/0.txt>
[6] <http://info.ravenbrook.com/mail/2002/03/21/15-58-56/0.txt>
[7] <http://info.ravenbrook.com/mail/2002/03/25/17-09-51/0.txt>
[8] <http://info.ravenbrook.com/mail/2002/03/26/14-04-17/0.txt>
[9] <http://info.ravenbrook.com/mail/2002/03/26/14-19-52/0.txt>
[10] <http://info.ravenbrook.com/mail/2002/03/26/14-31-49/0.txt>
[11] <http://info.ravenbrook.com/mail/2002/03/26/15-59-02/0.txt>
[12] <http://info.ravenbrook.com/mail/2002/03/26/16-04-29/0.txt>
[13] <http://info.ravenbrook.com/mail/2002/03/26/16-00-14/0.txt>
[14] <http://info.ravenbrook.com/mail/2002/03/27/14-09-49/0.txt>
[15] <http://info.ravenbrook.com/mail/2002/03/26/17-32-55/0.txt>
[16] <http://info.ravenbrook.com/mail/2002/03/26/18-36-48/0.txt>
[17] <http://info.ravenbrook.com/mail/2002/03/26/19-18-29/0.txt>
[18] <http://info.ravenbrook.com/mail/2002/03/26/22-31-11/0.txt>
Observed in1.3.3
Created byNick Barnes
Created on2002-03-21 15:51:57
Last modified byNick Barnes
Last modified on2002-03-27 15:48:01
History2002-03-21 NB Created.