| Title | Automated tests don't cover some important functionality |
| Status | suspended |
| Priority | nice |
| Assigned user | Nick Barnes |
| Product | project |
| Organization | Ravenbrook |
| Description | The automated tests don't cover important P4DTI functionality. This increases the cost of manual testing at each release, increases the chance that major defects will be introduced while making changes, increases the cost of making a change and so reduces the maintainability of the P4DTI. |
| Analysis | See [1] for a summary of coverage by the test suite. Here are the significant holes in the coverage on 2002-01-04 [2,3]: replicator.py: 6. Error during reverting an issue: is the right e-mail sent? 7. Error during new_p4_job: is the right mail sent? 8. Error during migration: is the bug deleted? 9. Migration of users to Bugzilla. 10. Updating a changelist (e.g., edited description). 11. Checking that changelists are replicated correctly. dt_bugzilla.py: 12. Permission failures. 13. Resolutions: setting and clearing through Perforce. 14. Wrongly constructed bugs during migration/new issue creation. 15. Date fields. 16. Timestamp fields. 17. Integer fields. bugzilla.py: 18. Schema change on upgrade (see also job000302). general: 19. Installation. 20. Upgrading (see also job000302). 21. Command-line interfaces. |
| How found | automated_test |
| Evidence | [1] <http://www.ravenbrook.com/project/p4dti/doc/2001-12-12/test-coverage/>[2] < http://info.ravenbrook.com/mail/2001/12/09/21-41-52/0.txt>[3] < http://info.ravenbrook.com/mail/2001/12/11/23-48-14/0.txt> |
| Observed in | 1.3.3 |
| Created by | Gareth Rees |
| Created on | 2002-01-04 16:19:00 |
| Last modified by | Nick Barnes |
| Last modified on | 2018-07-05 17:27:55 |
| History | 2002-01-04 GDR Created based on [2] and [3]. 2018-07-05 NB Suspended because the P4DTI is obsolete. |