Visualizing Science
Joanne Foote
Connecting the Dots: Visualizing Science
Visual artists highlight the nuances hidden in big data
The human brain processes images in just 13 milliseconds — 60,000 times faster than comprehension of the written word. From Leonardo da Vinci’s Mona Lisa to universal symbols, images transcend barriers and bring connection and understanding.
For scientists, visualization provides a window into data representing physical systems that cannot be directly seen to help guide and inform decision-making of complex systems like climate modeling, medicine, and engineering.
“Scientific visualization gives scientists the ability to explore their data, compare categories of information, and help parse and understand the huge data sets that are a result of computational modeling,“ said Francesca Samsel, a research scientist specializing in visualization at TACC. “One of the best questions a visualization expert can ask a scientist is: In your wildest dreams, what do you want to see in the data that is not visible now?”
“For more than two decades, our visualization experts have collaborated with scientists and translated their data into images, animations, and virtual worlds to communicate complex problems,” said TACC Deputy Director Kelly Gaither. In 2022, Gaither resumed the position as the director of Visualization, a role she held from 2001-2017.
While most data analysis software programs create visual images of data, researchers often need an in-depth representation requiring specialized software and computing power using color, contrast, and shapes to provide a multi-dimensional analysis of research.
“Think of a pie chart or graph — those are foundational tools to visually explain data,” said Greg Abram, a key member of TACC’s visualization team. “The visual art we create is a sophisticated version of those useful tools. We help visualize things that you can’t physically see — underneath ice caps, back in time to the early universe, up into the air in atmospheric models.”
Abram and Samsel’s methods have expanded the visual vocabulary beyond prescribed shapes such as a square, tetrahedron, or sphere. They have built a wide variety of lines, shapes, and forms enabling them to construct intuitively encoded data, addressing the growing number of variables and relationships within scientific datasets.
“I bring in their data and find out what the scientist is trying to convey. Francesca meets with the scientist to figure out ways to extend things on a conceptional basis. It’s a great partnership,” he said. “I’m the guy that builds the paintbrush, and Francesca wields the paintbrush.”
“We help visualize things that you can’t physically see — underneath ice caps, back in time to the early universe, up into the air in atmospheric models.”
Samsel also reimagined highly saturated color with a focus on nature. “Color is like a symphony,” she said. “If a drummer is playing full blast, then you won’t hear the piccolo. Using associative color that coexist harmoniously in nature is logical—the mind and eye can easily digest.”
Patrick Heimbach, professor in the Department of Earth and Planetary Sciences at UT Austin, says scientific visualization provides a way to make sense of large and complex data sets guided by physical intuition, “but there’s only so much intuition that we have.”
“We see different connections between variables when they are color coded, another variable is overlayed and coded with brightness or with shading and vector plots that are superimposed, and then suddenly we see interactions and connections of covariances that we may not have thought about,” said Heimbach, who also leads the Computational Research in Ice and Oceans Systems Group at the Oden Institute for Computational Engineering and Sciences.
For example, atmospheric rivers have wreaked havoc in the western United States, but there is now a better understanding due to improved visualization techniques.
“It’s really visible once you see computational simulations of atmospheric circulation and moisture content — how strong bands of humidity transport elevated quantities of moisture and leads to this phenomenon,” Heimbach said, adding that until recently these could not be seen through computational simulations and visualized in the way they are now.
Heimbach collaborated with his colleague, An Nguyen, and TACC Visualization Scientist Greg Foss, to create an animated visualization—“Circulation in the Arctic Ocean”—which illustrated evolution in daily averaged subsurface seawater temperatures from a numerical simulation. It won the 2018 Best Visualization at the Supercomputing conference in Denver.
“Visualization is an outreach component that conveys research to a wider audience,” Heimbach added.
While scientific visualization can resemble a prize-winning work of art, other images can paint a realistic depiction of existing environments, combining data and visual overlays of scientific predictions.
“Visualization is an outreach component that conveys research to a wider audience.”
Madison Russ, a research engineer working with the Computational Hydraulics Group led by core faculty Clint Dawson at the Oden Institute, is creating visualizations to represent storm surge and coastal flooding. (Dawson is also the department chair of Aerospace Engineering and Engineering Mechanics at the Cockrell School of Engineering at UT Austin.)
“What makes my visualization different is that I use existing data as an underlay, for example, a map of the Texas Gulf Coast. Our goal with the Framework for Disease Modeling research team is to create a realistic final product to inform the research,” Russ said.
Using ADvanced CIRculation (ADCIRC), a finite element coastal ocean modeling framework combined with computational modeling simulations from Hurricane Harvey, Russ’s illustrations show how coastal flooding is bringing more tropical insects and potential disease further inland.
“Computational simulations and their accompanying visualizations allow scientists to look ahead to understand and prepare for the future,” Abram said. “It’s vital to visualize and understand the very real correlation of things like storm surge and hurricane tracking which can have tremendous human and environmental impacts.”
With technologies like AI starting to advance science, “visualization will remain crucial to not only communicate science,” Gaither concluded, “but it will also be called on to provide transparency and contribute much needed explainability.”