IVDA Research Streams

Research at IVDA includes various methodologies and branches, all related to the meaningful combination of both strengths of humans and machines in the data analysis, knowledge generation, and decision-making process.
One of IVDA's assets is its support for data-centric, model-centric, and human-centric approaches, as well as their combinations, i.e., analysis processes that enable all three entities to benefit from (gray directions in the diagram).
In addition, our EEE Framework describes Human knowledge and preference Externalization, Model and output Explanation, and Data Exploration, as well as their combinations (orange, blue, and green directions in the diagram). This perspective on data analysis is about how entities can contribute to analytics processes, enabling modern forms of human-model-data interaction and collaboration.
IVDA research particularly studies data analytics challenges with complexities requiring many of these directions in unified interactive visual data analysis approaches and systems. Most sophisticated IVDA systems support all six directions between Humans, Models, and Data.
Links to Data-centric research: IVDA for Event Sequences | IVDA for Time Series
Links to Model-centric research: Interactive Machine Learning at IVDA
Links to Human-centric research: Data Humanism at IVDA
General research streams are as follows.
Exploratory Data Analysis
Exploratory Data Analysis (EDA) in Visual Analytics enables the intuitive discovery of new knowledge through interactive engagement with high-dimensional data. By leveraging dynamic visualizations, EDA facilitates pattern recognition, hypothesis generation, and insight extraction. Interactive tools empower users to explore complex datasets, guiding analysis through human intuition, machine learning, and visual feedback loops.
Links to application domains: Digital Libraries
Explainable Artificial Intelligence
Explainable Artificial Intelligence (XAI) in Visual Analytics integrates interpretable and trustworthy AI by combining human-centric visual exploration with algorithmic transparency. It enhances user understanding, enabling interaction with models via interpretable representations. Trustworthy AI fosters reliability, fairness, and accountability, ensuring that decision-making aligns with human intuition, fostering trust and informed insights.
Knowledge and Preference Externalization
Knowledge and Preference Externalization refers to the process of transforming tacit knowledge into explicit forms through interactive visual interfaces. Rooted in social sciences and pioneered in visualization research, it enables users to express preferences via annotations, scores, and rankings. This facilitates human-system interaction, linking feedback to ranking algorithms for decision support.
Links: Interactive Data Labeling at IVDA | Interactive Item Ranking at IVDA
Interactive Data Labeling
Labeling data instances is a fundamental prerequisite for supervised machine learning. Our research studies the user-in-the-loop data labeling process from the machine learning perspective (leveraging active learning) and the interactive and visual perspective (enabling humans to select instances by themselves). We base our work on our “visual interactive labeling” (VIAL) methodology, which unifies both perspectives.
Interactive Item Ranking
The human-centered ranking of multidimensional items is a non-trivial task. Comparing complex items to each other to create a ranking can be time-consuming and, especially if data sets are large, there is no guarantee that the result is satisfying. We characterize, design, and evaluate interactive solutions for the creation of item rankings and design and develop ranking explainers, to enable users to gain more trust into given ranking models.
Interactive Relation Discovery
Interactive Relation Discovery enables the identification of dependencies, relations, and causalities between data attributes through interactive exploration. It supports research and practice by uncovering hidden patterns, enhancing data-driven decision-making. By fostering awareness of data interconnections, it improves model interpretability, supports hypothesis generation, and strengthens analytical reasoning across domains.
Links to application domains: Digital Libraries
Human-Model Collaboration
Human-Model Collaboration emphasizes understanding humans, models, and data as a foundation for designing effective communication and interaction. It fosters data-driven decision-making through intuitive dialogues between users and AI systems, leveraging the strengths of both. By aligning human insight with model capabilities, it enables more robust, transparent, and collaborative analytical processes.
Ethical Approaches to AI
Ethical Approaches to AI integrate ethical and humanistic principles into data-driven decision-making and machine learning applications. They aim to reflect human values, promote fairness, and reduce bias by ensuring transparency, accountability, and inclusivity. These approaches guide responsible AI development, aligning technological progress with societal well-being and individual rights.
Publications of the IVDA Group
ZORA Publication List
Download Options
Publications
-
2022
-
The Effect of Alignment on People's Ability to Judge Event Sequence Similarity. IEEE Transactions on Visualization and Computer Graphics, 28(9):3070-3081.
-
ConfusionFlow: A Model-Agnostic Visualization for Temporal Analysis of Classifier Confusion. IEEE Transactions on Visualization and Computer Graphics, 28(2):1222-1236.
-
IRVINE: A Design Study on Analyzing Correlation Patterns of Electrical Engines. IEEE Transactions on Visualization and Computer Graphics, 28(1):11-21.
-
A Design Space for Explainable Ranking and Ranking Models. In: EuroVis 2022 - Posters, Rome, 13 Juni 2022 - 17 Juni 2022. The Eurographics Association, 35-37.
-
RankASco: A Visual Analytics Approach to Leverage Attribute-Based User Preferences for Item Rankings. In: EuroVis Workshop on Visual Analytics (EuroVA), Rome, 13 June 2022. The Eurographics Association, 7-11.
-
ManEx: The Visual Analysis of Measurements for the Assessment of Errors in Electrical Engines. IEEE computer graphics and applications, 42(2):68-80.
-
Visualizing Graph Neural Networks with CorGIE: Corresponding a Graph to Its Embedding. IEEE Transactions on Visualization and Computer Graphics, 28(6):2500-2516.
-
Interactive Visual Explanation of Incremental Data Labeling. In: EuroVis Workshop on Visual Analytics (EuroVA), Rome, Italy, 13 June 2022 - 17 June 2022, Eurographics Association.
-
What Shall We Watch Tonight?: Why sometimes your favourite streaming service just cannot manage to recommend anything interesting. In: IEEE VIS Workshop on Visualization for AI Explainability, Oklahoma City, USA, 12 October 2022 - 16 October 2022, IEEE.
-
A Data-Centric Methodology and Task Typology for Time-Stamped Event Sequences. In: VIS Workshop on Evaluation and Beyond -- Methodological Approaches for Visualization (BELIV), Oklahoma City, USA, 16 October 2022 - 21 October 2022. IEEE, 66-76.
-
-
2021
-
The Star Formation History of Eridanus II: On the Role of Supernova Feedback in the Quenching of Ultrafaint Dwarf Galaxies. The Astrophysical Journal, 909(2):192.
-
Does the Layout Really Matter? A Study on Visual Model Accuracy Estimation. In: 2021 IEEE Visualization Conference Short Papers (VIS), New Orleans, 26 October 2021. IEEE Xplore, 61-65.
-
A Taxonomy of Attribute Scoring Functions. In: EuroVis Workshop on Visual Analytics (EuroVA), Zurich, 14 June 2021, 31-35.
-
LayoutExOmizer: Interactive Exploration and Optimization of 2D Data Layouts. In: 26th International Symposium on Vision, Modeling, and Visualization, VMV 2021, Technische Universität Dresden, Germany, 27 September 2021 - 28 September 2021. Eurographics, 99-107.
-
Does the Layout Really Matter? A Study on Visual Model Accuracy Estimation. In: IEEE Visualization Conference - Short Papers, virtual, 1 January 2021. IEEE, 61-65.
-
LFPeers: Temporal Similarity Search in Covid-19 Data. In: EuroVis Workshop on Visual Analytics (EuroVA), virtual, 1 January 2021, Eurographics Proceedings / The Eurographics Association.
-
QuestionComb: A Gamification Approach for the Visual Explanation of Linguistic Phenomena through Interactive Labeling. ACM Transactions on Interactive Intelligent Systems, 11(3/4):No.: 19.
-
Co-adaptive visual data analysis and guidance processes. Computers & Graphics, 100:93-105.
-
ProSeCo: Visual analysis of class separation measures and dataset characteristics. Computers & Graphics, 96:48-60.
-
A Taxonomy of Property Measures to Unify Active Learning and Human-Centered Approaches To Data Labeling. ACM Transactions on Interactive Intelligent Systems, 11(3-4):Article No.: 20.
-