Jeffrey Mark Siskind's Papers

Refereed Journal Publications

  • Siskind, J.M., `Grounding Language in Perception,' Artificial Intelligence Review, 8:371-91, 1995.

  • Siskind, J.M., `A Computational Study of Cross-Situational Techniques for Learning Word-to-Meaning Mappings,' Cognition, 61(1-2):39-91, October/November 1996. Also appeared in Computational Approaches to Language Acquisition, Brent, M.R., ed., Elsevier, pp. 39-91, 1996.

  • Mann, R., Jepson, A.D., and Siskind, J.M., `The Computational Perception of Scene Dynamics,' Computer Vision and Image Understanding (CVIU), 65(2):113-28, February 1997.

  • Siskind, J.M., `Grounding the Lexical Semantics of Verbs in Visual Perception Using Force Dynamics and Event Logic,' Journal of Artificial Intelligence Research (JAIR), 15:31-90, August 2001. Also available as Technical Report 2000-105, NEC Research Institute, Inc., July 2000.

  • Brent, M.R. and Siskind, J.M., `The Role of Exposure to Isolated Words in Early Vocabulary Development,' Cognition, 81/82:33-44, September 2001. Also available as Technical Report 99-107, NEC Research Institute, Inc., July 1999. Revised as Technical Report 2000-067R, NEC Research Institute, Inc., May 2000.

  • Fern, A.P., Givan, R.L., and Siskind, J.M., `Specific-to-General Learning for Temporal Events with Application to Learning Event Definitions from Video,' Journal of Artificial Intelligence Research (JAIR), 17:379-449, December 2002.

  • Wang, S. and Siskind, J.M., `Image Segmentation with Ratio Cut,' IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI), 25(6):675-90, June 2003.

  • Siskind, J.M., `Reconstructing Force-Dynamic Models from Video Sequences,' Artificial Intelligence (AIJ), 151(1-2):91-154, December 2003.

  • Wang, S., Kubota, T., Siskind, J.M., and Wang, J., `Salient Closed Boundary Extraction with Ratio Contour,' IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI), 27(4):546-61, April 2005.

  • Wang, W., Pollak, I., Wong, T.-S., Bouman, C.A., Harper, M.P., and Siskind, J.M., `Hierarchal Stochastic Image Grammars for Classification and Segmentation,' IEEE Transactions on Image Processing (TIP), 15(10):3033-52, October 2006.

  • Siskind, J.M., Sherman, Jr., J., Pollak, I., Harper, M.P., and Bouman, C.A., `Spatial Random Tree Grammars for Modeling Hierarchal Structure in Images with Regions of Arbitrary Shape,' IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI), 29(9):1504-19, September 2007.

  • Pearlmutter, B.A. and Siskind, J.M., `Reverse-Mode AD in a Functional Framework: Lambda the Ultimate Backpropagator,' ACM Transactions on Programming Languages and Systems (TOPLAS), 30(2):1-36, April 2008.

  • Siskind, J.M. and Pearlmutter, B.A., `Nesting Forward-Mode AD in a Functional Framework,' Higher-Order and Symbolic Computation (HOSC), 21(4):361-76, December 2008.

    Refereed Conference Publications

  • Siskind, J.M., Southard, J.R., and Crouch, K.W., `Generating Custom High Performance VLSI Designs from Succinct Algorithmic Descriptions,' Proceedings of the Conference on Advanced Research in VLSI, pp. 28-40, January 1982.

  • Siskind, J.M., `Acquiring Core Meanings of Words, Represented as Jackendoff-Style Conceptual Structures, From Correlated Streams of Linguistic and Non-Linguistic Input,' Proceedings of the Twenty Eighth Annual Meeting of the Association for Computational Linguistics (ACL), pp. 143-56, June 1990.

  • Siskind, J.M. and McAllester, D.A., `Nondeterministic Lisp as a Substrate for Constraint Logic Programming,' Proceedings of the Eleventh National Conference on Artificial Intelligence (AAAI), pp. 133-8, July 1993.

  • Siskind, J.M., `Lexical Acquisition in the Presence of Noise and Homonymy,' Proceedings of the Twelfth National Conference on Artificial Intelligence (AAAI) , pp. 760-6, July 1994.

  • Siskind, J.M. and Morris, Q., `A Maximum-Likelihood Approach to Visual Event Classification,' Proceedings of the Fourth European Conference on Computer Vision (ECCV) , pp. 347-60, April 1996.

  • Mann, R., Jepson, A.D., and Siskind, J.M., `The Computational Perception of Scene Dynamics,' Proceedings of the Fourth European Conference on Computer Vision (ECCV) , pp. 528-39, April 1996.

  • Siskind, J.M., `Visual Event Classification via Force Dynamics,' Proceedings of the Seventeenth National Conference on Artificial Intelligence (AAAI), pp. 149-55, August 2000. Also available as Technical Report 2000-007, NEC Research Institute, Inc., January 2000. Revised as Technical Report 2000-047R, NEC Research Institute, Inc., April 2000.

  • Wang, S. and Siskind, J.M., `Image Segmentation with Minimum Mean Cut,' Proceedings of the Eighth International Conference on Computer Vision (ICCV), pp. 517-24, July 2001. Also available as Technical Report 2000-169, NEC Research Institute, Inc., December 2000.

  • Fern, A.P., Givan, R.L., and Siskind, J.M., `Specific-to-General Learning for Temporal Events,' Proceedings of the Eighteenth National Conference on Artificial Intelligence (AAAI), pp. 152-8, July 2002.

  • Fern, A.P., Siskind, J.M., and Givan, R.L., `Learning Temporal, Relational, Force-Dynamic Event Definitions from Video,' Proceedings of the Eighteenth National Conference on Artificial Intelligence (AAAI), pp. 159-66, July 2002.

  • Pollak, I., Siskind, J.M., Harper, M.P., and Bouman, C.A., `Modeling and Estimation of Spatial Random Trees with Application to Image Classification,' Proceedings of the 2003 IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), volume III, pp. 305-8, Hong Kong 6-12 April 2003.

  • Pollak, I., Siskind, J.M., Harper, M.P., and Bouman, C.A., `Parameter Estimation for Spatial Random Trees Using the EM Algorithm,' Proceedings of the International Conference on Image Processing (ICIP) , pp. 257-60, Barcelona, Spain September 2003.

  • Wang, S., Kubota, T., and Siskind, J.M., `Salient Boundary Detection Using Ratio Contour,' Proceedings of the Neural Information Processing Systems Conference (NIPS), pp. 1571-8, Vancouver, Canada, 9-11 December 2003.

  • Pearlmutter, B.A. and Siskind, J.M., `Lazy Multivariate Higher-Order Forward-Mode AD,' Proceedings of the 34th Annual Symposium on Principles of Programming Languages (POPL), pp. 155-60, Nice, France, 17-19 January 2007.

  • Siskind, J.M. and Pearlmutter, B.A., `First-Class Nonstandard Interpretations by Opening Closures,' Proceedings of the 34th Annual Symposium on Principles of Programming Languages (POPL), pp. 71-6, Nice, France, 17-19 January 2007.

  • Pearlmutter, B.A. and Siskind, J.M., `Using Programming Language Theory to Make AD Sound and Efficient,' Proceedings of the 5th International Conference on Automatic Differentiation (AD2008), pp. 79-90, Bonn, Germany, 11-15 August 2008.

    Book Chapters

  • Siskind, J.M., `Visual Event Perception,' in Symbolic Visual Learning, Ikeuchi, K. and Veloso, M. ed., Oxford University Press, chapter 9, pp. 225-63, January 1997.

  • Siskind, J.M., `Learning Word-to-Meaning Mappings,' in Models of Language Acquisition: Inductive and Deductive Approaches, Broeder, P. and Murre, J. ed., Oxford University Press, chapter 7, pp. 121-53, July 2000.

    Workshop Publications

  • Siskind, J.M., `Dispelling Myths about Language Bootstrapping,' Proceedings of the AAAI Spring Symposium Workshop on Machine Learning of Natural Language and Ontology, pp. 157-64, March 1991.

  • Siskind, J.M., `Naive Physics, Event Perception, Lexical Semantics and Language Acquisition,' Proceedings of the AAAI Spring Symposium Workshop on Machine Learning of Natural Language and Ontology, pp. 165-8, March 1991.

  • Siskind, J.M., `Solving a Lexical Acquisition Task via an Encoding as a Propositional Satisfiability Problem,' Proceedings of the CUNY Sentence Processing Conference, p. 82, March 1993.

  • Siskind, J.M., `Grounding Language in Perception,' Proceedings of the Annual Conference of the Society of Photo-Optical Instrumentation Engineers (SPIE), volume 2055, Intelligent Robots and Computer Vision XII, pp. 198-211, September 1993.

  • Siskind, J.M., `Axiomatic Support for Event Perception,' Proceedings of the AAAI Workshop on Integration of Natural Language and Vision Processing, pp. 153-60, August 1994.

  • Siskind, J.M., `Robust Lexical Acquisition Despite Extremely Noisy Input,' Proceedings of the 19th Boston University Conference on Language Development, MacLaughlin, D. and McEwen, S. ed., Cascadilla Press, pp. 587-98, March 1995.

  • Siskind, J.M., `Unsupervised Learning of Visually-Observed Events,' Proceedings of the AAAI Fall Symposium Workshop on Learning Complex Behaviors in Adaptive Intelligent Systems, pp. 82-3, November 1996.

  • Siskind, J.M., `Visual Event Perception,' Proceedings of the Ninth NEC Research Symposium, August 1998. Also available as Technical Report 99-033, NEC Research Institute, Inc., March 1999.

  • Pollak, I., Siskind, J.M., Harper, M.P., and Bouman, C.A., `Multiscale Random Tree Models,' IS&T/SPIE 15th Annual Symposium on Electronic Imaging, Santa Clara, CA, 21-24 January 2003.

  • Siskind, J.M., Pollak, I., Harper, M.P., and Bouman, C.A., `Stochastic Grammars for Images on Arbitrary Graphs,' Proceedings of the IEEE Workshop on Statistical Signal Processing, St. Louis, MO, 28 September-1 October 2003.

  • Pollak, I., Siskind, J.M., Harper, M.P., and Bouman, C.A., `Modeling of Images with Spatial Random Trees,' SIAM Conference on Imaging Science, Salt Lake City, UT, 3-5 May 2004.

  • Siskind, J.M. and Pearlmutter, B.A., `Perturbation Confusion and Referential Transparency: Correct Functional Implementation of Forward-Mode AD,' Draft Proceedings of the 17th International Workshop on Implementation and Application of Functional Languages (IFL2005), Dublin, Ireland, 19-21 September 2005.

    Technical Reports

  • Siskind, J.M., `The Culprit Pointer Method for Selective Backtracking,' S.M. thesis, Artificial Intelligence Laboratory, MIT, January 1989.

  • Siskind, J.M., `Naive Physics, Event Perception, Lexical Semantics and Language Acquisition,' Ph.D. thesis, Artificial Intelligence Laboratory, MIT, January 1992.

  • Siskind, J.M. and McAllester, D.A., `Screamer: A Portable Efficient Implementation of Nondeterministic Common Lisp,' Technical Report IRCS-93-03, Institute for Research in Cognitive Science, University of Pennsylvania, 1993.

  • Siskind, J.M., `Lexical Acquisition as Constraint Satisfaction,' Technical Report IRCS-93-41, Institute for Research in Cognitive Science, University of Pennsylvania, 1993.

  • Siskind, J.M., `Flow-Directed Lightweight Closure Conversion,' Technical Report 99-105, NEC Research Institute, Inc., July 1999. Revised as Technical Report 99-190R, NEC Research Institute, Inc., December 1999.

  • Wang, S. and Siskind, J.M., `Image Segmentation with Ratio Cut---Extended Version,' Technical Report TR-ECE-02-07, School of Electrical and Computer Engineering, Purdue University, 2002.

  • Pollak, I., Siskind, J.M., Harper, M.P., and Bouman, C.A., `Spatial Random Trees and the Center-Surround Algorithm,' Technical Report TR-ECE-03-03, School of Electrical and Computer Engineering, Purdue University, 2003.

  • Siskind, J.M. and Pearlmutter, B.A., `Using Polyvariant Union-Free Flow Analysis to Compile a Higher-Order Functional-Programming Language with a First-Class Derivative Operator to Efficient Fortran-like Code,' Technical Report TR-ECE-08-01, School of Electrical and Computer Engineering, Purdue University, 2008.

  • Siskind, J.M. and Pearlmutter, B.A., `Putting the Automatic Back into AD: Part I, What's Wrong,' Technical Report TR-ECE-08-02, School of Electrical and Computer Engineering, Purdue University, 2008.

  • Pearlmutter, B.A. and Siskind, J.M., `Putting the Automatic Back into AD: Part II, Dynamic, Automatic, Nestable, and Fast,' Technical Report TR-ECE-08-03, School of Electrical and Computer Engineering, Purdue University, 2008.

  • Siskind, J.M. and Pearlmutter, B.A., `Nesting Forward-Mode AD in a Functional Framework,' Technical Report TR-ECE-08-09, School of Electrical and Computer Engineering, Purdue University, 2008.