Ground
Works

Watching and Dreaming is a body of work that enables the viewer to peer inside the “mind” of a machine to observe its perceptions, mind wanderings, and dreams. This is not a metaphorical representation of dreams, nor a technical exercise in AI such as DeepDream [1] but the realization of a computational model of dreaming informed by cognitive neuroscience. This level of description avoids biases towards Jungian and Freudian psychology that assume dreaming is exclusively human. Dreams should not be considered independently of the perceptual capacities of the dreamer, and thus comparing this model to human perceptual abilities is problematic. For the audience, these artworks function as entry-points to consider the constructed nature of perceptions and the continuity of waking, mind wandering, and dreaming. For the artist, the artworks are sites of knowledge-making; it is through the making of artistic works that the model (computational formalization) and theory (argument that situates the model in empirical knowledge) are developed. The research underlying these artworks integrates knowledge in multiple disciplinary dimensions: (a) The computational modeling of dreaming processes (Zhang 2009; Treur 2011), (b) generative and media artworks engaging with the concept of memory and dreaming (Franco 2007; Dörfelt 2011), and (c) the conception of dreaming as imagination (Nir and Tononi 2010). In this text, Watching and Dreaming (2001: A Space Odyssey) (2014) serves as an exemplar of the Watching and Dreaming body of work. The machine attempts to learn and predict Stanley Kubrick’s film 2001: A Space Odyssey through the construction of its own subjective perception that is the basis of dreaming. “Mental” images generated during perception, mind wandering, and dreaming are subjective constructions bound to the peculiarities of the machine’s way of seeing. The body of work constitutes various manifestations of the cognitive model, not attempts to communicate the model’s mechanisms.

In the Peruvian Amazon Rainforest, Indigenous communities have been living in river floodplains for millennia and have developed unique cultural connections with the living waters and their rich biodiversity. To escape hardship (e.g. over extraction of resources, slavery, climate change impacts etc.), or seek opportunities (e.g. health, education, economic etc.), hundreds of thousands of Indigenous people have migrated from the jungle to Amazonian cities such as Iquitos over the past hundred years. Referencing traditional lifestyles, many of these migrants created floating and stilted communities in the city’s floodplain edges. Their multi-generational knowledge of floodplain agriculture, amphibious housing, and deeply-rooted community structures provides cultural, economic, and ecosystem services to the whole city. However, this mass migration also created challenges in housing, infrastructure and public services for the whole city. The Iquitos regional government has responded by enacting mandatory relocation for these residents to new highland developments far from the river, threatening their unique riverine cultures and deforesting a rare white sand rainforest ecosystem. In this visual narrative, we describe a blended arts and sciences project, Tres Comunidades, Un Río: Life Within Peru’s Urban Amazonian Floodplains, in which a highly collaborative team of 24 Peruvian and U.S. researchers and artists worked closely with 136 residents across three communities to showcase their life, health, and environmental connections, promoting traditional cultures and better-informed city planning that includes Indigenous Amazonian voices. We describe our interdisciplinary arts and sciences mixed-methods approach which included a public health survey, documentary photography, community drawings, and biodiversity/environmental measures that incorporated a community training program and local/traditional-scientific knowledge exchange workshop. Lastly, we discuss the value we found in pairing data with artistic storytelling, engaging diverse disciplines and academic-community partnerships, and uplifting underserved communities via an art and data exhibition.