Application performance assurance using end-to-end user level monitoring

摘要: A new measure of performance, which uses both application integrity and traditional network response time, is proposed. Modern networked services rely on a stack protocols host other many cross-organizational corporate boundaries. We point out that software quality assurance techniques don't scale up for post-deployment checks such applications services. methodology to do non-stop post-production monitoring transactional time delay measurement Specifically we describe the Telcordia/spl trade/ Application Assurance System, have created measuring real-time performance web-based used in commercial settings. The system measures delay. measurements are carried by sending synthetic end-user transactions analyzing responses. Statistical models data using single site as well multiple sites described. Creating crucial our method. paper presents method generation 'highly efficient' from graphical model functionality system. Highly efficient generated combinatorial designs. incrementally recorder. give several empirical examples efficacy this finding problems.