Analysis and Simulation of Dynamic Vision in the City A Computer-Aided Cinematic Approach

Main Article Content

Fang Xu


This paper proposes a computer-aided Dynamic Visual Research and Design Protocol for environmental designers to analyze humans’ dynamic visual experiences in the city and to simulate dynamic vision in the design process. The Protocol recommends using action cameras to collect massive dynamic visual data from participants’ first-person perspectives. It prescribes a computer-aided visual analysis approach to produce cinematic charts and storyboards, which further afford qualitative interpretations for aesthetic assessment and discussion. Employing real-time 3D simulation technologies, the Protocol enables the simulation of people’s dynamic vision in designed urban environments to support evaluation in design. Detailed contents and merits of the Protocol were demonstrated by its application in the Urbanscape Studio, a community participatory design course based at Watertown, South Dakota.

Article Details

How to Cite
Xu, F. “Analysis and Simulation of Dynamic Vision in the City”. Enquiry The ARCC Journal for Architectural Research, Vol. 16, no. 2, Nov. 2019, pp. 64 -89, doi:10.17831/enq:arcc.v16i2.1059.
Peer Reviewed Papers


Abendroth, Lisa M., and Bryan Bell. 2016. Public interest design practice guidebook : SEED methodology, case studies, and critical issues. New York: Routledge, Taylor & Francis Group.
Al-Kodmany, K. 1999. "Using visualization techniques for enhancing public participation in planning and design: process, implementation, and evaluation." Landscape and Urban Planning 45:37-45. doi: 10.1016/S0169-2046(99)00024-9.
Altman, Irwin, and Barbara Rogoff. 1987. "Chapter 1: World views in psychology: Trait, interactional, organismic, and transactional perspectives." In Handbook of environmental psychology, edited by Daniel Stokols and Irwin Altman, 7-40. New York: Wiley.
Appleyard, D., and K H Craik. 1974. "The Berkeley Environmental Simulation Project: its use in environmental impact assessment." In Environmental impact assessment: Guidelines and Commentary, edited by T. G. Dickert and Downey K. R., 121-125. Berkeley: University of California Extension.
Appleyard, Donald, Kevin Lynch, and John R Myer. 1964a. The view from the road. Cambridge: Published for the Joint Center for Urban Studies of the Massachusetts Institute of Technology and Harvard University by the M. I. T. Press, Massachusetts Institute of Technology.
Appleyard, Donald, Kevin Lynch, and John R Myer. 1964b. The view from the road. Cambridge: The MIT Press.
Bacon, Edmund N. 1967. Design of cities. London,: Thames & Hudson.
Banerjee, Tridib, and Anastasia Loukaitou-Sideris. 2011. Companion to Urban design. London ; New York: Routledge.
Banks, Marcus. 2007. "The place of visual data in social research a brief history." In Using visual data in qualitative research, edited by Marcus Banks. Thousand Oaks, California: SAGE Publications.
Barsalou, Lawrence W. 2008. "Grounded cognition." Annual Review of Psychology 59 (1):617-645.
Batty, Michael. 2001. "Exploring Isovist Fields: Space and Shape in Architectural and Urban Morphology." Environment and Planning B: Planning and Design 28 (1):123-150. doi: 10.1068/b2725.
Bell, Bryan. 2004. Good deeds, good design : community service through architecture. 1st ed. New York: Princeton Architectural Press.
Bell, Bryan, and Katie Wakeford. 2008. Expanding architecture : design as activism. New York: Metropolis Books.
Benedikt, M. L. 1979. "To take hold of space: isovists and isovist fields." Environment and Planning B 6:47-65.
Berry, David M. 2012. Understanding digital humanities. Houndmills, Basingstoke, Hampshire ; New York: Palgrave Macmillan.
Bosselmann, Peter. 1984. "The Berkeley Environmental Simulation Laboratory: A 12 Year Anniversary." Berkeley Planning Journal 1 (1):150-160.
Bosselmann, Peter. 1993. "Dynamic Simulations of Urban Environments." In Environmental Simulation, edited by Stokols D., 279-302. Boston, MA: Springer.
Brown, Katrina Myrvang, Rachel Dilley, and Keith Marshall. 2008. "Using a Head-Mounted Video Camera to Understand Social Worlds and Experiences." Sociological Research Online 13 (6):1-10. doi: 10.5153/sro.1818.
Bryman, Alan, Saul Becker, and Joe Sempik. 2008. "Quality Criteria for Quantitative, Qualitative and Mixed Methods Research: A View from Social Policy." International Journal of Social Research Methodology 11 (4):261-276. doi: 10.1080/13645570701401644.
Canter, David. 1977. The Psychology of Place. London Architectural Press.
Canty, Morton John. 2019. Image analysis, classification and change detection in remote sensing : with algorithms for Python. New York: Taylor & Francis Group.
Carello, Claudia 1993. "Realism and ecological units of analysis." In Human ecology: Fragments of anti-fragmentary views of the world, edited by Dieter Steiner and Markus Nauser. London; New York: Routledge.
Case, J., and J. Jawitz. 2004. "Using situated cognition theory in researching student experience of the Workplace." Journal of Research in Science Teaching 41 (5):415-431.
Chalfen, Richard. 2014. "‘Your panopticon or mine?’ Incorporating wearable technology’s Glass and GoPro into visual social science." Visual Studies 29 (3):299-310. doi: 10.1080/1472586X.2014.941547.
Cornsweet, Tom N. 1970. Visual perception. New York: New York, Academic Press.
Cullen, Gordon. 1961. The concise townscape. New York,: Reinhold Pub. Corp.
Cullen, Gordon. 2003. "Introduction to townscape." In Time-saver standards for urban design, edited by Donald Watson, Alan J. Plattus and Robert G. Shibley. New York: McGraw-Hill.
Cupers, Kenny, ed. 2013. Use matters: An alternative history of architecture. London; New York: Routledge.
Dell'Era, C., and P. Landoni. 2014. "Living Lab: A Methodology between User-Centred Design and Participatory Design." Creativity and Innovation Management 23 (2):137-154.
Farbstein, Jay, Richard E. Wener, and Lindsay J. McCunn. 2016. "Planning the Built Environment: Programming." In Research methods for environmental psychology, edited by Robert Gifford, 221-248. West Sussex, UK: Wiley Blackwell.
Fisher-Gewirtzman, Dafna. 2014. "3D LOS Visibility Analysis Model: Incorporating Quantitative/Qualitative Aspects in Urban Environments." In Geodesign by Integrating Design and Geospatial Sciences, edited by Danbi J. Lee, Eduardo Dias and Henk J. Scholten, 219-236. New York: Springer.
Fisher-Gewirtzman, Dafna, Michael Burt, and Yigal Tzamir. 2003. "A 3-D Visual Method for Comparative Evaluation of Dense Built-up Environments." Environment and Planning B: Planning and Design 30 (4):575-587. doi: 10.1068/b2941.
Frampton, Kenneth. 1983. "Towards a Critical Regionalism: Six points for an architecture of resistance." In The Anti-aesthetic : essays on postmodern culture, edited by Hal Foster, xvi, 159 p. Port Townsend, Wash.: Bay Press.
French, Robert. 2016. "Apparent Distortions in Photography and the Geometry of Visual Space." Topoi 35 (2):523-529. doi: 10.1007/s11245-015-9316-5.
Gehl, Jan. 2010. Cities for people. Washington, DC: Island Press.
Gehl, Jan, and Birgitte Svarre. 2013a. "Counting, Mapping, Tracking and Other Tools." In How to study public life, edited by Jan Gehl and Birgitte Svarre, 21-80. Washington, DC: Island Press.
Gehl, Jan, and Birgitte Svarre. 2013b. How to study public life. Washington, DC: Island Press. text.
Gibson, James J. 1966. The Senses Considered as Perceptual Systems. Boston: Houghton Mifflin.
Gibson, James J. 1979. The Ecological Approach to Visual Perception. Boston: Houghton Mifflin.
Gibson, James J., Edward Reed, and Rebecca Jones. 1982. Reasons for Realism: Selected Essays of James J. Gibson, Resources for ecological psychology. Hillsdale, N.J.: L. Erlbaum.
Gifford, Robert. 2016. "Introduction." In Research methods for environmental psychology, 1-8. West Sussex, UK: Wiley Blackwell.
Gogel, Walter C. 1963. The visual perception of spatial extent. Edited by Institute Civil Aeromedical Research. Oklahoma City, Okla.: Oklahoma City, Okla. : Federal Aviation Agency, Civil Aeromedical Research Institute, Aeronautical Center.
Gordon, Ian E. 2004. Theories of visual perception. Edited by Inc NetLibrary. New York: Psychology Press.
Greeno, James G. 1994. "Gibson's affordances." Psychological Review 101 (2):7p.
Greeno, James G., and Joyce L. Moore. 1993. "Situativity and symbols - Response to Vera and Simon." Cognitive Science 17 (1):49-59.
Groat, Linda, and David Wang. 2002. Architectural Research Methods. New York, NY: John Wiley & Sons.
Harper, Douglas A. 2012. Visual sociology. New York, NY: Routledge.
Heft, Harry. 2001. Ecological Psychology in Context: James Gibson, Roger Barker, and the Legacy of William James's Radical Empiricism. Mahwah, New Jersey: Dension University.
Henshaw, John M. 2012. A tour of the senses : how your brain interprets the world. Baltimore: Baltimore : Johns Hopkins University Press.
Hill, Jonathan. 1998. Occupying architecture : between the architect and the user. London ; New York: Routledge.
Hill, Jonathan. 2003. Actions of Architecture: Architects and Creative Users. London ; New York: Routledge.
Howard, Ian P., and Brian J. Rogers. 1995. Binocular vision and stereopsis, Oxford psychology series. New York: Oxford University Press.
Hurlburt, Russell T., and Christopher L. Heavey. 2001. "Telling what we know: describing inner experience." Trends in Cognitive Sciences 5 (9):400-403.
Hussain, Masroor, Dongmei Chen, Angela Cheng, Hui Wei, and David Stanley. 2013. "Change detection from remotely sensed images: From pixel-based to object-based approaches." ISPRS Journal of Photogrammetry and Remote Sensing 80 (C):91-106. doi: 10.1016/j.isprsjprs.2013.03.006.
Jacobs, Allan B. 1993. Great streets. Cambridge, Mass.: MIT Press.
Johnson, R. B., and A. J. Onwuegbuzie. 2004. "Mixed Methods Research: A Research Paradigm Whose Time Has Come." Educational Researcher 33 (7):14-26.
Lincoln, Yvonna S., and Egon Guba. 1985. "Establishing Trustworthiness." In Naturalistic Inquiry, edited by Yvonna S. Lincoln and Egon Guba. Beverly Hills, CA: SAGE Publications.
Lu, Yi, Zhonghua Gou, Yu Ye, and Qiang Sheng. 2019. "Three-dimensional visibility graph analysis and its application." Environment and Planning B: Urban Analytics and City Science 46 (5):948-962. doi: 10.1177/2399808317739893.
Lynch, Kevin. 1960. The image of the city. Cambridge, Mass.: M.I.T. Press.
Lynch, Kevin. 1982. A Theory of Good City Form. Cambridge, MA: The MIT Press.
Lynch, Kevin. 1984. Good city form. Cambridge, Mass.: MIT Press.
Lynch, Kevin, Tridib Banerjee, and Michael Southworth. 1990. City sense and city design: Writings and projects of Kevin Lynch. Cambridge, Mass.: MIT Press.
Lynch, Kevin, and Gary Hack. 1984. "Visual Form." In Site planning, 54-87. Cambridge, Mass.: MIT Press.
Marshall, Catherine, and Gretchen B. Rossman. 2006. Designing Qualitative Research. 4th ed. Thousand Oaks, CA: Sage Publications.
Mårtensson, Pär, Uno Fors, Sven-Bertil Wallin, Udo Zander, and Gunnar H. Nilsson. 2016. "Evaluating research: A multidisciplinary approach to assessing research practice and quality." Research Policy 45 (3):593-603. doi:
Miles, Matthew B., and A. Michael Huberman. 1994. Qualitative Data Analysis: An Expanded Sourcebook 2nd ed. Thousand Oaks, CA: Sage Publications.
Moore, Steven A. 2017. "Knowledge, Education, Power and Production: Public Interest Design in North America." Journal of Architectural Education 71 (1):46-55.
Mullins, M. 2006. "Interpretation of simulations in interactive VR environments: Depth perception in cave and panorama." Journal of Architectural and Planning Research 23 (4):328-340.
Nicol, David, and Simon Pilling. 2000. "Section 1: Communication: developing sensitivity to the nedds of users and clients." In Changing architectural education : towards a new professionalism, edited by David Nicol and Simon Pilling, 41-116. London ; New York: E & FN Spon.
Norman, D. A. 1993. "Cognition in the head and in the world - An introduction to the special Issue on situated action." Cognitive Science 17 (1):1-6.
Onwuegbuzie, A. J., R. B. Johnson, and K. M. T. Collins. 2009. "Call for mixed analysis: A philosophical framework for combining qualitative and quantitative approaches." International Journal of Multiple Research Approaches 3 (2):114-139.
Onwuegbuzie, A. J., J. R. Slate, N. L. Leech, and K. M. T. Collins. 2009. "Mixed data analysis: Advanced integration techniques." International Journal of Multiple Research Approaches 3 (1):13-33.
Oyserman, Daphna. 2011. "Culture as situated cognition." European Review of Social Psychology 22 (1):164-214.
Paterson, Barbara L., Joan L. Bottorff, and Roberta Hewat. 2003. "Blending Observational Methods: Possibilities, Strategies, and Challenges." International Journal of Qualitative Methods 2 (1):29-38. doi: 10.1177/160940690300200103.
Pizarro, Rafael. 2009. "Teaching to understand the urban sensorium in the digital age: lessons from the studio." Design Studies 30 (3):272-286. doi: 10.1016/j.destud.2008.09.002.
Pizarro, Rafael E. . 2011. "Urban design and the cinematic arts." In Companion to Urban design, edited by Tridib Banerjee and Anastasia Loukaitou-Sideris, 208-217. London ; New York: Routledge.
Prosser, Jon. 1998. "The status of image-based research." In Image-based research : a sourcebook for qualitative researchers, edited by Jon Prosser, 97-112. Bristol, PA: Falmer Press.
Rappaport, Alain T. 1998. "Constructive cognition in a situated background." International Journal of Human-Computer Studies 49 (6):927-933.
Reed, Edward. 1988. James J. Gibson and the psychology of perception. New Haven: Yale University Press.
Relph, E. C. 1976. Place and Placelessness. London: Pion.
Richardson, Michael J., Kevin Shockley, Brett R. Fajen, Michael A. Riley, and Michael T. Turvey. 2008. "Ecological psychology: Six principles for an embodied-embedded approach to behavior." In Elsevier handbook of new directions in cognitive science, edited by Paco Calvo and Toni Gomila, 161-187. Boston: Elsevier Science.
Rivlin, Robert. 1984. Deciphering the senses : the expanding world of human perception. Edited by Karen Gravelle. New York: New York : Simon and Schuster.
Rosenstein, Barbara. 2002. "Video Use in Social Science Research and Program Evaluation." International Journal of Qualitative Methods 1 (3):22-43. doi: 10.1177/160940690200100302.
Russell, F. 1992. "New ways of city viewing." Cities 9 (1):43-48.
Sanoff, Henry. 1978. Designing with community participation, Community development series 40. Stroudsburg, Pa.: Dowden, Hutchinson & Ross.
Sanoff, Henry. 1991. Visual research methods in design. New York: Van Nostrand Reinhold.
Sanoff, Henry. 2000. Community participation methods in design and planning. New York: Wiley.
Sanoff, Henry, and Zeynep Toker. 2003. Three decades of design and community : history of the Community Development Group. Raleigh, N.C.: NC State University, School of Architecture, College of Design.
Scatena, Michele, Serena Dittoni, Riccardo Maviglia, Roberto Frusciante, Elisa Testani, Catello Vollono, Anna Losurdo, Salvatore Colicchio, Valentina Gnoni, Claudio Labriola, Benedetto Farina, Mariano Alberto Pennisi, and Giacomo Della Marca. 2012. "An integrated video-analysis software system designed for movement detection and sleep analysis. Validation of a tool for the behavioural study of sleep." Clinical neurophysiology : official journal of the International Federation of Clinical Neurophysiology 123 (2):318. doi: 10.1016/j.clinph.2011.07.026.
Schliemann, Analucia D. 1998. "Logic of meanings and situated cognition." Learning and Instruction 8 (6):549-560.
Shin, Sangyun, Sangah Jeong, Jaewook Lee, Seung Wan Hong, and Sungwon Jung. 2017. "Pre-Occupancy Evaluation based on user behavior prediction in 3D virtual simulation." Automation in Construction 74:55-65. doi: 10.1016/j.autcon.2016.11.005.
Simpson, J. 2018. "Street DNA: the who, where and what of visual engagement with the urban street." Journal of Landscape Architecture 13 (1):50-57. doi: 10.1080/18626033.2018.1476032.
Simpson, J. , M. Freeth, K. Simpson, and K. Thwaites. 2018. "Visual engagement with urban street edges: insights using mobile eye-tracking."
Smith, E. R., and F. R. Conrey. 2010. "The social context of cognition." In Cambridge handbook of situated cognition, edited by P. Robbins and M. Aydede. New York: Cambridge University Press.
Sommer, Robert. 1997. "Chapter 11: Utilization Issues in Environment-Behavior Research." In Advances in environment, behavior, and design : toward the integration of theory, methods, research and utilization, edited by Gary T. Moore and Robert W. Marans, 347-368. New York: Plenum.
Stake, Robert E. 1995. The Art of Case Study Research. Thousand Oaks, CA: Sage Publications.
Stake, Robert E. 2005. "Qualitative Case Studies." In Handbook of Qualitative Research, edited by Norman K. Denzin and Yvonna S. Lincoln, 23-59. Thousand Oaks: SAGE Publications.
Stamps, Arthur E. . 2016. "Simulating Designed Environments." In Research methods for environmental psychology, edited by Robert Gifford, 197-220. West Sussex, UK: Wiley Blackwell.
Sussman, Reuven. 2016. "Observational Methods." In Research methods for environmental psychology, edited by Robert Gifford, 9-27. West Sussex, UK: Wiley Blackwell.
Tang, Jh, S. C. Yan, J. Wright, Q. Tian, Yw Pang, and E. Pissaloux. 2013. "Sparse representations for image and video analysis." J. Vis. Commun. Image Represent. 24 (2):93-94. doi: 10.1016/j.jvcir.2013.01.012.
Turvey, Michael T., and Robert E. Shaw. 1995. "Toward an ecological physics and a physical psychology." In The science of the mind : 2001 and beyond, edited by Robert L. Solso and Dominic W. Massaro, ix, 339 p. New York: Oxford University Press.
Verdinelli, Susana, and Norma I. Scagnoli. 2013. "Data Display in Qualitative Research." International Journal of Qualitative Methods 12 (1):359-381. doi: 10.1177/160940691301200117.
Watson, Donald, Alan J. Plattus, and Robert G. Shibley. 2003. Time-saver standards for urban design. 1 vols. New York: McGraw-Hill.
Whyte, William Hollingsworth. 1980. The social life of small urban spaces. Washington, D.C.: Conservation Foundation.
Wong, Aaron S. W., Stephan K. Chalup, Shashank Bhatia, Arash Jalalian, Jason Kulk, Steven Nicklin, and Michael J. Ostwald. 2012. "Visual gaze analysis of robotic pedestrians moving in urban space." Architectural Science Review 55 (3):213-223. doi: 10.1080/00038628.2012.688013.
Yan, Hang, Yebin Liu, and Yasutaka Furukawa. 2016. "Turning an Urban Scene Video into a Cinemagraph."
Yang, Perry Pei-Ju, Simon Yunuar Putra, and Wenjing Li. 2007. "Viewsphere: A GIS-Based 3D Visibility Analysis for Urban Design Evaluation." Environment and Planning B: Planning and Design 34 (6):971-992. doi: 10.1068/b32142.
Yin, Robert K. 2003a. "Analyzing Case Study Evidence." In Case Study Research Design and Methods, edited by Robert K. Yin. Thousand Oaks, CA: Sage.
Yin, Robert K. 2003b. Case Study Research Design and Methods. 3rd ed. Thousand Oaks, CA: Sage.
Zaki, Mohamed H., and Tarek Sayed. 2018. "Automated Analysis of Pedestrian Group Behavior in Urban Settings." Intelligent Transportation Systems, IEEE Transactions on 19 (6):1880-1889. doi: 10.1109/TITS.2017.2747516.