The multi-relationship evaluation design framework: creating evaluation blueprints to assess advanced and intelligent technologies

摘要: Technological evolutions are constantly occurring across advanced and intelligent systems a range of fields including those within the military, law enforcement, automobile, manufacturing industries. Testing performance these technologies is critical to (1) update system designers areas for improvement, (2) solicit end-user feedback during formative tests so that modifications can be made in future revisions, (3) validate extent technology's capabilities both sponsors, purchasers end-users know exactly what they receiving. Evaluation events minimally designed include few basic key technology or evolve into extensive test emphasize multiple components along with complete system, itself. Tests typically assume latter occur frequently based upon complexity. Numerous evaluation design frameworks have been produced create designs appropriately assess systems. While most allow broad plans created, each framework has focused address specific project and/or technological needs therefore bounded applicability. This paper presents expands current development Multi-Relationship Design (MRED) framework. Development MRED motivated by desire automatically an capable producing detailed blueprints while receiving uncertain input information. The authors will build their previous work developing through initial discussion elements. Additionally, elaborate previously-defined relationships among personnel define structural pertaining scenarios, environment, data collection methods. These terms demonstrated example emerging technology.