Grounding the lexical semantics of verbs in visual perception using force dynamics and event logic

作者: J. M. Siskind

DOI: 10.1613/JAIR.790

关键词: Motion (physics)Representation (mathematics)State (computer science)Natural language processingArtificial intelligenceInfinite setLexical semanticsMathematicsForce dynamicsSemanticsEvent (computing)

摘要: This paper presents an implemented system for recognizing the occurrence of events described by simple spatial-motion verbs in short image sequences. The semantics these is specified with event-logic expressions that describe changes state force-dynamic relations between participants event. An efficient finite representation introduced infinite sets intervals occur when describing liquid and semi-liquid events. Additionally, procedure using this presented inferring occurrences compound events, expressions, from primitive Using force dynamics event logic to specify lexical allows be more robust than prior systems based on motion profile.

参考文章(59)
Hector Geffner, Mario Martin, Learning generalized policies in planning using concept languages principles of knowledge representation and reasoning. pp. 667- 677 ,(2000)
Saburo Tsuji, Shinichi Kuroda, Akira Morizono, Understanding a simple cartoon film by a computer vision system international joint conference on artificial intelligence. pp. 609- 610 ,(1977)
Chad Cumby, Dan Roth, Relational Representations that Facilitate Learning principles of knowledge representation and reasoning. pp. 425- 434 ,(1999)
Naoyuki Okada, SUPP: understanding moving picture patterns based on linguistic knowledge international joint conference on artificial intelligence. pp. 690- 692 ,(1979)
David L. Waltz, Toward a detailed model of processing for language describing the physical world international joint conference on artificial intelligence. pp. 1- 6 ,(1981)
Masahiko Yachida, Saburo Tsuji, Michiharu Osada, Three dimensional movement analysis of dynamic line images international joint conference on artificial intelligence. pp. 896- 901 ,(1979)
Itsuya Soga, Saburo Tauji, Norihlro Abe, A plot understanding system on reference to both image and language international joint conference on artificial intelligence. pp. 77- 84 ,(1981)
Mark R. Adler, Computer interpretation of peanuts cartoons international joint conference on artificial intelligence. pp. 608- 608 ,(1977)
Matthew Brand, The Inverse hollywood problem: from video to scripts and storyboards via causal analysis national conference on artificial intelligence. pp. 132- 137 ,(1997)