Purpose This paper aims to review and critically assess the role that data visualizations played as communication media tools to help society during a worldwide crisis. This paper re-creates and analyzes several visualizations, critically and ethically assesses their strengths and limitations and provides a set of best practices that are informative, accurate, ethical and engaging at each stage in a reader’s interest. Design/methodology/approach The paper bases its methodology on the construct of “The Network Society” (Van Dijk, 2006; Castells, 2000, (...) 2006) by creating a series of social networked visualizations, identifying the challenges and pitfalls associated with this communication approach and suggesting best practices in information communication technology. The case study is COVID-19. Findings The research in this study found that visual data dashboards and interactive Web-based charts did play a significant role in helping society understand COVID-19’s impact to make better informed decisions about society’s health and safety. Research limitations/implications Visual expositions of data do have strengths and weaknesses depending on how they are designed, how they communicate the story and how they are ethically deployed. Best practices are provided to help mitigate these limitations. Practical implications Visualizations are certainly not new, but the technology for rapidly developing and sharing them is new. Visual expositions provide an effective media for communicating complex information to a networked society. Social implications Visual expositions provide an effective media for communicating complex information to a networked society. Originality/value This paper highlights the significance of the need to understand complex data in a crisis in a visual format and to communicate the information quickly, persuasively, effectively and ethically to a networked audience. (shrink)

Transparency in data visualization is an essential ingredient for scientific communication. The traditional approach of visualizing continuous quantitative data solely in the form of summary statistics has repeatedly been criticized for not revealing the underlying raw data distribution. Remarkably, however, systematic and easy-to-use solutions for raw data visualization using the most commonly reported statistical software package for data analysis, IBM SPSS Statistics, are missing. Here, a comprehensive collection of more than 100 SPSS syntax (...) files and an SPSS dataset template is presented and made freely available that allow the creation of transparent graphs for one-sample designs, for one- and two-factorial between-subject designs, for selected one- and two-factorial within-subject designs as well as for selected two-factorial mixed designs and, with some creativity, even beyond. Depending on graph type, raw data can be displayed along with standard measures of central tendency and dispersion. The free-to-use syntax can also be modified to match with individual needs. A variety of example applications of syntax are illustrated in a tutorial-like fashion along with fictitious datasets accompanying this contribution. The syntax collection is hoped to provide researchers, students, teachers, and others working with SPSS a valuable tool to move towards more transparency in data visualization. (shrink)

I am working as both a TEFL teacher and an SLA researcher in China, doing SLA research. Recently, I have been working on new approaches to data analysis and I’ve found that a book titled “Data Visualization and Analysis in Second Language Research” by Dr. Guilherme D. Garcia is of great significance in empirical research in the field of SLA. This book serves only as a practical and user-friendly guide to beginners involved in SLA research, but also (...) navigation to veteran SLA researchers devoted to new perspectives in data analysis. So far, the author has made his first attempt to connect data visualization under R to SLA research. The author reviews the previous research results and suggests some modifications through running R. From my perspective, it fills a gap in the SLA research practice—to lead readers into a new track of visualizing their reported results. Overall, to make an increasingly higher demand for SLA research, this book is particularly designated for quantitative data analysis in SLA. It is strongly recommended to write a book review to introduce readers to the realm of data visualization and help most SLA researchers better understand the potential value of R and visualization in SLA research. (shrink)

This article explores how readers recognize their personal identities represented through data visualizations. The recognition is investigated starting from three definitions captured by the philosopher Paul Ricoeur: the identification with the visualization, the recognition of someone in the visualization, and the mutual recognition that happens between readers. Whereas these notions were initially applied to study the role of the book reader, two further concepts complete the shift to data visualization: the digital identity stays for the (...) present-day passport of human actions and the promise is the intimate reflection that projects readers towards their own future. This article reflects on the delicate meaning of digital identity and the way of representing it according to this structure: From Personal Identity to Media is a historical introduction to self-recognition, Data Visualization for Representing Identities moves the focus to visual representation, and The Course of Recognition breaks the self-recognition in through the five concepts above just before the Conclusion. (shrink)

Data literacy – the ability to analyze, interpret, evaluate, and use data and data visualizations – has become increasingly important for understanding and communicating information in the discipline of history. In the United States, curricular standards and standardized assessments already reflect this importance, but educators lack a clear picture of how students use data visualizations when reasoning about the past. How do students use data visualizations when reasoning about a historical question? To what degree does (...) using data visualizations enhance students’ historical reasoning? What challenges do students face when attempting to use data visualizations? This study addresses these questions, investigating how fifth-grade, eighth-grade, and high school students use data visualizations from typical school textbooks. Twenty-seven students were interviewed, surveyed, and asked to think aloud about a historical question while using a textbook entry that included a data visualization. Results from qualitative and quantitative analyses highlight the potential for data visualizations to enhance historical reasoning. However, results also indicate that students are unlikely to read data visualizations on their own, underscoring the importance of providing targeted data literacy instruction. (shrink)

Self-recognition is an intimate act performed by people. Inspired by Paul Ricoeur, we reflect upon the action of self-recognition, especially when data visualization represents the observer itself. Along the article, the reader is invited to think about this specific relationship through concepts like the personal identity stored in information systems, the truthfulness at the core of self-recognition, and the mutual-recognition among community members. In the context of highly interdisciplinary research, we unveil two protagonists in data visualization: (...) the designer and the observer - the designer as the creator and the observer as the viewer of a visualization. This article deals with some theoretical aspects behind data visualization, a discipline more complex than normally expected. We believe that data visualization deserves a conceptual framework, and this investigation pursues this intention. For this reason, we look at the designer as not just a technician in the visualization production, but as a contemporary ethnologist - the designer as a professional working in a social environment to comprehend the context and formulate a specific inquiry with the help of appropriate visual languages. (shrink)

Science and technology have changed all aspects of our lives, including the mode of narration, from traditional stories to data stories. Storytellers have been integrating visualizations into their narratives. From the case studies of some artworks and our students' works to visualization research, we have found distinct genres of narrative visualization and the education method for university students. We describe the differences between these artworks, together with interactivity and information transmission. Some small experiments and some examples of (...) students' works will be shown to explore the visual narrative. We suggest new design strategies including how to make invisible things visible. (shrink)

In this article, we show how postphenomenology can be used to analyze the Affinity Map: a data visualization that reveals the hidden dynamics that exist between individuals within large organizations. We make use of the Affinity Map to expand the classic postphenomenology that privileges a ‘linear’ understanding of technological mediations and introduce the notions of ‘iterativity’ and ‘collectivity.’ In the first section of the paper, we discuss both classic and more recent descriptions of human-technology-world relations in order to (...) transcendentally approach the discipline of data visualization. In the second section, we use the Affinity Map case study to consider three elements: 1) the collection of data and the design process; 2) the visual grammar of the data visualization, and 3) the process of self-recognition for the map ‘reader.’ In the third section, we introduce the hermeneutic circle of data visualization. Finally, we suggest that the Affinity Map, because of its ethical and political multistability, might be seen as a material encounter between postphenomenology, actor-network theory (ANT), and hermeneutics. (shrink)

Climate change is difficult to connect with personally, because people only regard the phenomenon as important if it becomes a perceived threat to themselves. Arguments like statistics and policy debates are extrinsic motivators, which do not necessarily align people’s own intrinsic motives with those of climate action. Instead, narratives and visual communication can influence viewers implicitly by the way they show and reinforce actions and thoughts that align with climate action. In this design study, we used comics created for human-level (...) climate change influence to promote ideas like future-based thinking, sharing of responsibility, and caring for each other. We also created data visuals that illustrate future consequences of climate change for the purpose of averting negative alternative realities. To see whether our design can affect audience perception of climate change on the human level of goals and desires, we showed the comics to readers unfamiliar with the themes of the stories, presenting them as manga about characters and situations. The survey showed that data stories can affect the way naive readers interpret narratives to align with pro-climate attitudes such as sharing and future-vision, and that readers are focused on the human-level of the data and story as opposed to the physical resource level. Speculative fiction and data visuals provide a potentially effective way to influence individuals’ climate change attitudes by showing alternative realities and attributes of collective responsibility and planning-for-the-future as data stories. (shrink)

The myth of transparency and truthfulness is the foundation for contemporary theories of information design. Avoiding distortion and ambiguity is the moral imperative of an upstanding data visualizer. Sometimes, though, data that is collected is not accurate enough and the sources use indirect indicators to approach a phenomenon: what to do then, if the need to graphically represent a phenomenon is urgent and necessary? Should the designer wait to have the exact data, or should he indicate a (...) trend, expressing the hypothetical status of his statement? Can data visualization be designed to express doubt rather than to inform about facts? This essay will deal with the forms of expression of uncertainty in infographics. It will consider the designer as both an observer and a translator, whose position of neutrality is only one of the possible realms of discourse. In general, it will focus on the forms of visual expression of a self-criticizing mood in quantitative research today and it will explore the ways in which data that is not meaningful in statistical terms can become meaningful in semiotic terms. (shrink)

Covid-19 has prompted a surge of data visualizations that have been published for public consumption, yet, many have not had broad appeal or may have not been well-understood by laypeople. A data storytelling platform called Flow Immersive has been created to successfully engage both laypeople and experts in understanding complex information. This tool integrates emerging technologies [e.g., augmented reality and virtual reality ] with a multiplatform, multiuser publishing approach. From October 2020 to December 2020, Flow’s Covid-19 AR videos (...) captured 9 million views, and have been used in multiple professional presentations. This paper documents the journey from development to deployment, and some user feedback which all led to breakthroughs in scalability and higher levels of engagement. (shrink)

If the cliché about garbage – ‘Out of sight, out of mind’ – is true, its inverse, unfortunately, is not. Heaps and masses of garbage brought into direct view still somehow manage to escape acute recognition, let alone social responsibility or global political activism. This article investigates this trend as a growing problem between the human world and representation. Focusing on historical and contemporary landscape photography, the article questions whether data visualization trends, particularly those that attempt to visualize (...) the post-industrial consumer landscape, help or hinder our capacity to understand our environment, and possibly even ecological endeavors. The article charts the history of photography’s landscape genre, mapping the contours of a shift from the classical ‘nature’ aesthetic, to an industrial, post-industrial, and eventually a mathematical aesthetic contingent on emergent techniques and data visualization in the attempt to depict ever amassing magnitudes of environmental despoliation. (shrink)

This brief discusses how to deal with data visualization and prediction in human society, a context in which big data analysis and artificial intelligence have the potential to transform the world. The debates presented in this brief combine different disciplines such as data-science, economics, political science, social informatics, informatics, philosophy of recognition and human actions, and artificial intelligence for human society. Written by leading researchers from various disciplines, the brief provides fresh perspectives on the social impact (...) of AI and evolution of human beings. As such, it offers a unique resource for all scholars and policymakers interested in the most exciting and fuzzy connections between disciplines, where knowledge in one field helps to answer questions in another. (shrink)

Hans‐Jörg Rheinberger constructed his historical epistemology of epistemic things by analyzing experimental practices in molecular biology during the 1970s and 80s. With genetic sequencing and multi‐omics approaches, data has become a new resource in the life sciences, questioning the applicability of his concept of experimental system. By historicizing Rheinberger's epistemology, the paper focuses on its relatedness to Ludwik Fleck's notion of an aviso of resistance and points to a gradual shift in Rheinberger's emphasis, moving from an initial focus on (...) writing and its differentiality to work on materials, preparations, and representations. By anchoring visualization in these material practices, Rheinberger also sheds new light on the changing conditions of experimentation in the life sciences due to big data, where visualization emphasizes patterns and correlations rather than substrates. (shrink)

In response to the ubiquitous graphs and maps of COVID-19, artists, designers, data scientists, and public health officials are teaming up to create counter-plots and subaltern maps of the pandemic. In this intervention, we describe the various functions served by these projects. First, they offer tutorials and tools for both dataviz practitioners and their publics to encourage critical thinking about how COVID-19 data is sourced and modeled—and to consider which subjects are not interpellated in those data sets, (...) and why not. Second, they demonstrate how the pandemic’s spatial logics inscribe themselves in our immediate material landscapes. And third, they remind us of our capacity to personalize and participate in the creation of meaningful COVID visualizations—many of which represent other scales and dimensions of the pandemic, especially the quarantine quotidian. Together, the official maps and counter-plots acknowledge that the pandemic plays out differently across different scales: COVID-19 is about global supply chains and infection counts and TV ratings for presidential press conferences, but it is also about local dynamics and neighborhood mutual aid networks and personal geographies of mitigation and care. (shrink)

Traditionally, vision science and information/data visualization have interacted by using knowledge of human vision to help design effective displays. It is argued here, however, that this interaction can also go in the opposite direction: the investigation of successful visualizations can lead to the discovery of interesting new issues and phenomena in visual perception. Various studies are reviewed showing how this has been done for two areas of visualization, namely, graphical representations and interaction, which lend themselves to work (...) on visual processing and the control of visual operations, respectively. The results of these studies have provided new insights into aspects of vision such as grouping, attentional selection and the sequencing of visual operations. More generally yet, such results support the view that the perception of visualizations can be a useful domain for exploring the nature of visual cognition, inspiring new kinds of questions as well as casting new light on the limits to which information can be conveyed visually. (shrink)

In today’s science, the output of measurement processes are often visual representations of the data detected. Moreover, we find such visual data as parts of scientific reasoning in different contexts. In this article, we will take a look at two of them. On the one hand, visual representations are used as a kind of surrogate for the real object to ask questions about it – we will call this the exploratory use of visual data. On the other (...) hand, visualisations are often used to communicate research results to scientific peers or to laymen. Instances of the latter case we will subsequently call the explanatory use of visual data. However, in both contexts the question arises what might justify these epistemic practices. Believing without reasons is epistemically irresponsible, it leads to gullibility. Thus, we will try to answer the question whether there are any reasons to support our epistemic practices concerning scientific visualisations in the above-mentioned senses and whether these are good reasons to rely on. (shrink)

This article probes the visual spatial représentations underlying the creative conceptual design of complex objects.

Data produced by humans and machines is more and more heterogeneous, visual, and location based. This availability inspired in the last years a number of reactions from researchers, designers, and artists that, using different visual manipulations techniques, have attempted at repurposing this material to add meaning and design new perspectives with specific intentions. Three different approaches are described here: the design of interfaces for exploring satellite footage in novel ways, the analysis of urban esthetics through the visual manipulation of (...) collections of user-generated contents, and the enrichment of geo-based datasets with the selection and rearrangement of web imagery. (shrink)

The study aims to investigate visual attention and perceived attractiveness to known versus unknown products above and beyond self-report applying physiological methods. A cross-cultural exploratory approach allows for comparing results gathered in the United States and China. We collected field data on physiological parameters accompanied by behavioral data. Mobile eye-tracking was employed to capture attention by measuring gaze parameters and electrodermal activity serves as indicator for arousal at an unconscious level. A traditional scale approach measuring perceived attractiveness of (...) known versus novel products provide insights at a conscious level. US-American and Chinese consumers in our sample indeed process novel products differently. This can be observed at an unconscious and conscious level. Different gaze movements and arousal levels are observed at an unconscious level. Regarding behavioral data, the level of vertical orientation shapes the perceived attractiveness of novel products at a conscious level. The study showcases how physiological methods complement behavioral ones when investigating visual attention to products. It underlines varying conscious as well as unconscious visual attention and attractiveness ratings comparing known versus novel products, driven by cultural differences. Data from a field setting further enrich the implications derived for new product development and applied marketing. (shrink)

This study investigated the effect of visual versus contextual instructional guidance in a computer vision-based learning environment on educational technology students’ visual data interpretation skills and intelligent educational interaction design. The study responds to a growing need to prepare students not only to use artificial intelligence and computer vision tools, but also to understand their visual outputs, interpret their pedagogical meaning, recognize their limitations, and translate them into informed design decisions. A quasi-experimental pretest–posttest design with two experimental groups was (...) employed. The participants were 100 second-level students from the Department of Educational Technology, Faculty of Specific Education, Alexandria University, equally assigned to a visual guidance group and a contextual guidance group. Both groups studied the same content, completed the same tasks, and used the same computer vision-based learning environment; the only difference was the type of instructional guidance provided. Data were collected using a Visual Data Interpretation Skills Test, a Visual Data Interpretation Performance Rubric, an Intelligent Educational Interaction Design Cognitive Test, an Intelligent Educational Interaction Design Product Rubric, a Learning Environment Interaction Log, and an Environment Usability Scale. The results showed statistically significant differences in favor of the contextual guidance group in visual data interpretation, practical performance, cognitive understanding of intelligent educational interaction design, and the quality of the final design product. Interaction log indicators also showed that contextual guidance was associated with higher learning pathway quality, more frequent post-support revisions, and more purposeful use of feedback. No statistically significant difference was found between the two groups in overall environment usability. These findings suggest that contextual guidance was more effective in helping students move beyond noticing visual elements toward interpreting their meaning and using them in design decisions, whereas visual guidance primarily supported attention and element location. The study recommends that computer vision-based learning environments should combine visual clarity with contextual explanation so that students can interpret visual outputs critically and transform them into responsible, interpretable, and pedagogically meaningful intelligent educational interactions. (shrink)

Through extensive training, experts acquire specialized knowledge and abilities. In this paper, I argue that experts also acquire specialized visual experiences. Specifically, I articulate and defend the account that experts enjoy visual experiences that represent gestalt properties through perceptual learning. I survey an array of empirical studies on face perception and perceptual expertise that support this account. I also look at studies on perceptual adaptation that some might argue present a problem for my account. I show how the data (...) are subject to an interpretation that is friendly to it. Last, I address two theoretical objections to the claim that visual experiences represent gestalt properties. (shrink)

One of the crucial fields of study that is getting more attention is association rule mining. It is crucial to databases' knowledge discovery (KDD). KDD and association rule mining have a very broad use. It has evolved at a rapid rate over the past fifteen years. Association Rule Mining is a novel technology, although it is still in the discovery and development stages. Video is an illustration of interactive media data since it contains text, pictures, meta-data, visual, sound, (...) and different kinds of data. It is frequently used for a variety of important likely reasons, such as security and reconnaissance, amusement, healthcare, educational endeavours, and sports. One of the main issues for the local data-mining research community is video data mining, which aims to find and comprehend fascinating examples from the large volume of video data. Video data mining is still in its infancy when compared to mining other sorts of data. It is pivotal to grasp and naturally mine the information from video databases considering the continually extending computerized libraries and video databases. Differentiating association rules between components in a significant video library is critical in the field of video data mining. As per continuous imaginative work, association rule mining is being utilized rapidly in various tasks, including perception, social affairs, broadcast news, sports, records, films, clinical data, as well as on the web and individual media assortments. This exploration tries to give a far-reaching method to association rule extraction from video databases. (shrink)

Research in person and face perception has broadly focused on group-level consensus that individuals hold when making judgments of others. However, a growing body of research demonstrates that individual variation is larger than shared, stimulus-level variation for many social trait judgments. Despite this insight, little research to date has focused on building and explaining individual models of face perception. Studies and methodologies that have examined individual models are limited in what visualizations they can reliably produce to either noisy and blurry (...) or computer avatar representations. Methods that produce low-fidelity visual representations inhibit generalizability by being clearly computer manipulated and produced. In the present work, we introduce a novel paradigm to visualize individual models of face judgments by leveraging state-of-the-art computer vision methods. Our proposed method can produce a set of photorealistic face images that correspond to an individual's mental representation of a specific attribute across a variety of attribute intensities. We provide a proof-of-concept study which examines perceived trustworthiness/untrustworthiness and masculinity/femininity. We close with a discussion of future work to substantiate our proposed method. (shrink)

Visual working memory is a construct hypothesized to store a small amount of accurate perceptual information that can be brought to bear on a task. Much research concerns the construct's capacity and the precision of the information stored. Two prominent theories of VWM representation have emerged: slot-based and continuous-resource mechanisms. Prior modeling work suggests that a continuous resource that varies over trials with variable capacity and a potential to make localization errors best accounts for the empirical data. Questions remain (...) regarding the variability in VWM capacity and precision. Using a novel eye-tracking paradigm, we demonstrate that VWM facilitates search and exhibits effects of fixation frequency and recency, particularly for prior targets. Whereas slot-based memory models cannot account for the human data, a novel continuous-resource model does capture the behavioral and eye tracking data, and identifies the relevant resource as item activation. (shrink)

Engineering sketches and drawings are the building blocks of technological design and production. These visual representations act as the means for organizing the design to production process, hence serving as a "social glue" both between individuals and between groups. The author discusses two main capacities such visual representations serve in facilitating distributed cognition in team design work As conscription devices, they enlist and organize group participation. As boundary objects, they facilitate the reading of alternative meanings by various groups involved in (...) the design process. The introduction of computer-aided design into this visual culture of engineering restructures relationships between workers in ways that can hamper the flexibility necessary for these crucial capacities to take place. The data are drawn from a study of the daily practices of engineers engaged in redesigning a turbine engine package. The method is participant observation. (shrink)

After the United States Congress passed the Water Pollution Control Act of 1948, biologists played an increasingly significant role in scientific studies of water pollution. Biologists interacted with other experts, notably engineers, who managed the public agencies devoted to water pollution control. Although biologists were at first marginalized within these agencies, the situation began to change by the early 1960s. Biological data became an integral part of water pollution control. While changing societal values, stimulated by an emerging ecological awareness, (...) may explain broader shifts in expert opinion during the 1960s, this article explores how graphs changed experts’ perceptions of water pollution. Experts communicated with each other via reports, journal articles, and conference speeches. Those sources reveal that biologists began experimenting with new graphical methods to simplify the complex ecological data they collected from the field. Biologists, I argue, followed the engineers’ lead by developing graphical methods that were concise and quantitative. Their need to collaborate with engineers forced them to communicate, negotiate, and overcome conflicts and misunderstandings. By meeting engineers’ expectations and promoting the value of their data through images as much as words, biologists asserted their authority within water pollution control by the early 1960s. (shrink)

A fundamental question in the psychological sciences is the degree to which culture shapes core cognitive processes — perhaps none more foundational than how we perceive the world around us. A dramatic and oft-cited “case study” of culture’s power in this regard is the Müller-Lyer illusion, which depicts two lines of equal length but with arrowheads pointing either inward or outward, creating the illusion that one line is longer than the other. According to a line of research stretching back over (...) a century, depending on the society you were raised in (and how much carpentry you were exposed to), you may not see the illusion at all — an ambitious and influential research program motivating claims that seemingly basic aspects of visual processing may actually be “culturally evolved byproducts”. This Cultural Byproduct Hypothesis bears on foundational issues in the science, philosophy, and sociology of psychology, and remains popular today. Yet, here we argue that it is almost certainly false. We synthesize evidence from diverse fields which demonstrate that: (1) the illusion is not limited to humans, appearing in non-human animals from diverse ecologies; (2) the statistics of natural scenes are sufficient to capture the illusion; (3) the illusion does not require straight lines typical of carpentry (nor even any lines at all); (4) the illusion arises in sense modalities other than vision; and (5) the illusion arises even in congenitally blind subjects. Moreover, by reexamining historical data and ethnographic descriptions from the original case studies, we show that the evidence for cultural variation and its correlation with key cultural variables is in fact highly inconsistent, beset by questionable research practices, and misreported by later discussions. Together, these considerations undermine the most popular and dramatic example of cultural influence on perception. We further extend our case beyond this phenomenon, showing that many of these considerations apply to other visual illusions as well, including similarly implicated visual phenomena such as the Ebbinghaus, Ponzo, Poggendorf, and Horizontal-Vertical illusions. We conclude by outlining future approaches to cross-cultural research on perception, and we also point to other potential sources of cultural variation in visual processing. (shrink)

One of the dominant behavioral markers of visual-expert search strategy, Holistic Visual Processing (HVP), suggests that experts process information from a larger region of space in conjunction with a more focused gaze pattern in order to improve search speed and accuracy. To date, extant literature suggests that visual search expertise is domain specific, including HVP and its associated behaviors. The current study is the first to use eye tracking to directly measure the HVP strategies of two expert groups, radiologists and (...) architects, in comparison to one another and a novice control. In doing so, we replicated and extended this prior research: visual expertise is domain specific. However, our eye tracking data indicate that contrary to this prior work, HVP strategies are transferable across domains. Yet, despite the transfer of HVP strategies, there is neither reduced search time nor greater accuracy in visual search outside of an expert’s domain. Therefore, our data suggest that HVP behaviors are a particular form of visual search mechanism that, outside of an expert’s native search-ecology, are not necessarily conducive to more general visual search success. It is in addition to explicit knowledge of an expert’s domain, how to search, and where to search, that HVP strategies are their most effective for visual search success. (shrink)

Attempts to introduce Gestalt theory into the realm of visual neuroscience are discussed on both theoretical and experimental grounds. To define the framework in which these proposals can be defended, this paper outlines the characteristics of a standard model, which qualifies as a received view in the visual neurosciences, and of the research into natural images statistics. The objections to the standard model and the main questions of the natural images research are presented. On these grounds, this paper defends the (...) view that Gestalt psychology and experimental phenomenology provide a contribution to the research into perception by the construction of phenomenological models for an ecologically meaningful interpretation of the empirical evidence and the hypothetical constructs of the natural image research within the visual neuroscience. A formal framework for the phenomenological models is proposed, wherein Gestalt theoretical principles and empirical evidence are represented in terms of topological properties and relationships, which account for the order and structures that make the environment accessible to observers at a relevant behavioural level. It is finally argued that these models allow us to evaluate the principles and the empirical evidence of various natures which are integrated from different fields into the research into perception, and in particular into visual neurosciences. (shrink)

One of the main limitations of natural language‐based approaches to meaning is that they do not incorporate multimodal representations the way humans do. In this study, we evaluate how well different kinds of models account for people's representations of both concrete and abstract concepts. The models we compare include unimodal distributional linguistic models as well as multimodal models which combine linguistic with perceptual or affective information. There are two types of linguistic models: those based on text corpora and those derived (...) from word association data. We present two new studies and a reanalysis of a series of previous studies. The studies demonstrate that both visual and affective multimodal models better capture behavior that reflects human representations than unimodal linguistic models. The size of the multimodal advantage depends on the nature of semantic representations involved, and it is especially pronounced for basic‐level concepts that belong to the same superordinate category. Additional visual and affective features improve the accuracy of linguistic models based on text corpora more than those based on word associations; this suggests systematic qualitative differences between what information is encoded in natural language versus what information is reflected in word associations. Altogether, our work presents new evidence that multimodal information is important for capturing both abstract and concrete words and that fully representing word meaning requires more than purely linguistic information. Implications for both embodied and distributional views of semantic representation are discussed. (shrink)

Road accidents have increased rapidly in recent years for a variety of reasons. Analyzing and visualizing road accidents through heatmaps can help improve policies for their prevention by informing about areas with a high-risk of road accidents. The purpose of this research is to build a model for the analysis and visualization of road accidents through heatmaps. Information about road accidents is extracted from the news of the main online media portals through scripts in the Python language and Web (...) Scraping techniques. From the extraction of about 30,000 articles from news portals for one year, only 829 were selected in the end that provided information about road accidents. As a result, and contribution of this research, a corpus was built with the geographic coordinates of road accidents and on this data our model was applied for the analysis and visualization of high-risk areas of road accidents using heatmaps. The visualization of heatmaps was done through a Python script, where it was applied to the geographic coordinates of road accidents. (shrink)

Speakers’ perception of a visual scene influences the language they use to describe it—which objects they choose to mention and how they characterize the relationships between them. We show that visual complexity can either delay or facilitate description generation, depending on how much disambiguating information is required and how useful the scene's complexity can be in providing, for example, helpful landmarks. To do so, we measure speech onset times, eye gaze, and utterance content in a reference production experiment in which (...) the target object is either unique or non-unique in a visual scene of varying size and complexity. Speakers delay speech onset if the target object is non-unique and requires disambiguation, and we argue that this reflects the cost of deciding on a high-level strategy for describing it. The eye-tracking data demonstrate that these delays increase when speakers are able to conduct an extensive early visual search, implying that when speakers scan too little of the scene early on, they may decide to begin speaking before becoming aware that their description is underspecified. Speakers’ content choices reflect the visual makeup of the scene—the number of distractors present and the availability of useful landmarks. Our results highlight the complex role of visual perception in reference production, showing that speakers can make good use of complexity in ways that reflect their visual processing of the scene. (shrink)

Bringing about desirable collisions (making interceptions) and avoiding unwanted collisions are critically important sensorimotor skills, which appear to require us to estimate the time remaining before collision occurs (time-to-collision). Until recently the theoretical approach to understanding time-to-collision estimation has been dominated by the tau-hypothesis, which has its origins in J.J. Gibson’s ecological approach to perception. The hypothesis proposes that a quantity (tau), present in the visual stimulus, provides the necessary time-to-collision information. Empirical results and formal analyses have now accumulated to (...) demonstrate conclusively that the tau-hypothesis is false. This article describes an alternative approach that is based on recent data showing that the information used in judging time-to-collision is task- and situation-dependent, is of many different origins (of which tau is just one) and is influenced by the information-processing constraints of the nervous system. (shrink)

The temporal structure of behavior contains a rich source of information about its dynamic organization, origins, and development. Today, advances in sensing and data storage allow researchers to collect multiple dimensions of behavioral data at a fine temporal scale both in and out of the laboratory, leading to the curation of massive multimodal corpora of behavior. However, along with these new opportunities come new challenges. Theories are often underspecified as to the exact nature of these unfolding interactions, and (...) psychologists have limited ready-to-use methods and training for quantifying structures and patterns in behavioral time series. In this paper, we will introduce four techniques to interpret and analyze high-density multi-modal behavior data, namely, to: (1) visualize the raw time series, (2) describe the overall distributional structure of temporal events (Burstiness calculation), (3) characterize the nonlinear dynamics over multiple timescales with Chromatic and Anisotropic Cross-Recurrence Quantification Analysis (CRQA), (4) and quantify the directional relations among a set of interdependent multimodal behavioral variables with Granger Causality. Each technique is introduced in a module with conceptual background, sample data drawn from empirical studies and ready-to-use Matlab scripts. The code modules showcase each technique’s application with detailed documentation to allow more advanced users to adapt them to their own datasets. Additionally, to make our modules more accessible to beginner programmers, we provide a “Programming Basics” module that introduces common functions for working with behavioral timeseries data in Matlab. Together, the materials provide a practical introduction to a range of analyses that psychologists can use to discover temporal structure in high-density behavioral data. (shrink)

Four experiments investigated the extent to which abstract quantitative information can be conveyed by basic visual features. This was done by asking observers to estimate and discriminate Pearson correlation in graphical representations where the first data dimension of each element was encoded by its horizontal position, and the second by the value of one of its visual features; perceiving correlation then requires combining the information in the two encodings via a common abstract representation. Four visual features were examined: luminance, (...) color, orientation, and size. All were able to support the perception of correlation. Indeed, despite the strikingly different appearances of the associated stimuli, all gave rise to performance that was much the same: just noticeable difference was a linear function of distance from complete correlation, and estimated correlation a logarithmic function of this distance. Performance differed only in regards to the level of noise in the feature, with these values compatible with estimates of channel capacity encountered in classic experiments on absolute perceptual magnitudes. These results suggest that quantitative information can be conveyed by visual features that are abstracted at relatively low levels of visual processing, with little representation of the original sensory property. It is proposed that this is achieved via an abstract parameter space in which the values in each perceptual dimension are normalized to have the same means and variances, with perceived correlation based on the shape of the joint probability density function of the resultant elements. (shrink)

In this article we explore the relationship between semiotic analysis of images and quantitative analysis of vast image corpora, in particular the work produced by Lev Manovich and the Cultural Analytics Lab, called “Media Visualization.” Media Visualization has been chosen as corpus because of its metavisual operation (images are visualized and analyzed by images) and its innovating way of conceiving analysis: by visual instruments. In this paper semiotics is used as an approach to Media Visualization and taken (...) as an object of study as well, especially visual semiotics. In this sense, a comparison between visual semiotics (close reading of small corpora) and quantitative analyses of images (distant reading of vast collections) are conducted from a semiotic point of view. Post-Greimassian semiotics guides this study with respect to the issue of the image-within-an-image and metavisual visualization; Peircean semiotics is employed to explain and develop the notion of diagram. (shrink)

Diffusions in Architecture: Artificial Intelligence and Image Generators delves into the impact of Diffusion AI algorithms and generative image models on architecture design and aesthetics. The book presents an in-depth analysis of how these new technologies are revolutionizing the field of architecture. The architects presented in the book focus on the application of specific AI techniques and tools used in generative design, such as Diffusion models, Dall-E2, Stable Diffusion, and MidJourney. It discusses how these techniques can generate synthetic images that (...) are both realistic and imaginative, creating new possibilities for architectural design and aesthetics. This comprehensive overview of the impact of Diffusion AI algorithms and generative image models on the field of architecture shows how they are changing the way architects approach their work. With a foreword by Lev Manovich—artist, writer and one of the world's most influential digital culture theorists. Sharing the work and insights of a team of designers and theorists from a range of backgrounds, offering disciplinary depth, and covering the full impact of these tools and models on architecture, Diffusions in Architecture includes information on: Fresh perspectives on design and aesthetics, with designs, images, and commentary from 22 leading architects, theorists, and designersThe potential of prompt engineering and text-to-image models applicable to a broad interdisciplinary audienceWhether image generators, or AI in general, will be an aid for human design, or potentially displace humans from the market fundamentals of a larger debate in the architectural discourse (and practice) on the use of image generatorsCollecting the different ideas that have emerged in the field, Diffusions in Architecture provides architects, designers, concept artists, and theorists with an overview of this cornucopia of architectural imaginations produced in a common effort between humans and artificial intelligence. (shrink)

In modern day technology, the level of knowledge is increasing day by day. This increase is in terms of volume, velocity, and variety. Understanding of such knowledge is a dire need of an individual to extract meaningful insight from it. With the advancement in computer and image-based technologies, visualization becomes one of the most significant platforms to extract, interpret, and communicate information. In data modelling, visualization is the process of extracting knowledge to reveal the detail data (...) structure and process of data. The proposed study aim is to know about the user knowledge, data modelling, and visualization by handling through the fuzzy logic-based approach. The experimental setup is validated through the data user modelling dataset available in the UCI web repository. The results show that the model is effective and efficient in situations where uncertainty and complexity arise. (shrink)

Recent philosophical analyses of the epistemic dimension of images in the sciences show a certain trend in acknowledging potential roles of these images beyond their merely decorative or pedagogical functions. We argue, however, that this new debate has yet paid little attention to a special type of pictures, we call ‘visual metaphor’, and its versatile heuristic potential in organizing data, supporting communication, and guiding research, modeling, and theory formation. Based on a case study of Conrad Hal Waddington’s epigenetic landscape (...) images in biology, we develop a descriptive framework applicable to heuristic roles of various visual metaphors in the sciences. (shrink)

Investigating the influence of perception on the control of visually guided action typically involves controlled experimentation within the laboratory setting. When appropriate, however, behavioral research of this nature may benefit from the use of methods that allow for remote data collection outside of the lab. This study tested the feasibility of using remote data collection methods to explore the influence of perceived target size on visually guided cursor movements using the Ebbinghaus illusion. Participants completed the experiment remotely, using (...) the trackpad of their personal laptop computers. The task required participants to click on a single circular target presented at either the left or right side of their screen as quickly and accurately as possible, or to emphasize speed or accuracy. On each trial the target was either surrounded by small or large context circles, or no context circles. Participants’ judgments of the targets’ perceived size were influenced by the illusion, however, the illusion failed to produce differences in click-point accuracy or movement time. Interestingly, the illusion appeared to affect participants’ movement of the cursor toward the target; more directional changes were made when clicking the Perceived Large version of the illusion compared to the Perceived Small version. These results suggest the planning of the cursor movement may have been influenced by the illusion, while later stages of the movement were not, and cursor movements directed toward targets perceived as smaller required less correction compared to targets perceived as larger. (shrink)

When referring to a target object in a visual scene, speakers are assumed to consider certain distractor objects to be more relevant than others. The current research predicts that the way in which speakers come to a set of relevant distractors depends on how they perceive the distance between the objects in the scene. It reports on the results of two language production experiments, in which participants referred to target objects in photo-realistic visual scenes. Experiment 1 manipulated three factors that (...) were expected to affect perceived distractor distance: two manipulations of perceptual grouping (region of space and type similarity), and one of presentation mode (2D vs. 3D). In line with most previous research on visually-grounded reference production, an offline measure of visual attention was taken here: the occurrence of overspecification with color. The results showed effects of region of space and type similarity on overspecification, suggesting that distractors that are perceived as being in the same group as the target are more often considered relevant distractors than distractors in a different group. Experiment 2 verified this suggestion with a direct measure of visual attention, eye tracking, and added a third manipulation of grouping: color similarity. For region of space in particular, the eye movements data indeed showed patterns in the expected direction: distractors within the same region as the target were fixated more often, and longer, than distractors in a different region. Color similarity was found to affect overspecification with color, but not gaze duration or the number of distractor fixations. Also the expected effects of presentation mode (2D vs. 3D) were not convincingly borne out by the data. Taken together, these results provide direct evidence for the close link between scene perception and language production, and indicate that perceptual grouping principles can guide speakers in determining the distractor set during reference production. (shrink)

Over the last four years I have been drawing on aspects of my own visual art practice (‘data capture’ digital drawing performances, 2004–) in my drawing teaching at the University of Cape Town. For this article I would like to share these projects and discuss the relevance of incorporating multimedia engagement in the teaching of traditional drawing at a tertiary level. First, moving images, sound, digital devices such as smartphones, tablets and engagement in online platforms are primary mediators of (...) experience for many urban citizens. I find it relevant for students to not only reflect critically on the use of digital tools and online social platforms, but to experience and explore engaging with them directly as an experience by making them physical through drawing. In my experience through my teaching practice I have observed how this embodiment of the technology can provide useful tools of processing the volume of immaterial information that we engage with on a daily basis. A physical processing of multimedia material can also operate to provide an interesting engagement with perception, cognition and orientation. At another level, by bringing different media together in the physical studio of life drawing, there can be an interesting reflection and experience of different states of being in the world. These aspects are discussed through descriptions of a selection of my own creative practice and a second-year drawing project I teach at the Michaelis School of Fine Art, University of Cape Town titled, ‘Interface: Image and text, the portrait as Dialogue’. (shrink)