butterfl.ai

Project Name

butterfl.ai: An Exhibit Leveraging Interactive Visualisation to Build Intuition of AI's Environmental and Productivity Impacts

Project Date

February 2026

Affiliation

Future Cities Laboratory Global

Team

Joshua VARGAS, Author

Joshua's Contribution

Conceptualisation: exhibit design and interaction model
Development: MCP server, chatbot interface, geospatial visualisation tool, and impact visualisation
Interactive Design: two-station exhibit experience with connected displays
GIS: geospatial application controlled via chatbot
Web Development: exhibit web components and user interface
  • Geospatial Data
  • Software Development
  • Interactive Design
  • UX Research
  • Participatory Workshop
  • Exhibition
  • Software
  • Artificial Intelligence
  • Interactive Visualisation
  • Human-Centred Design
  • Technology and Society
  • Python
  • Model Context Protocol (MCP)
  • QGIS
  • HTML/CSS/JS
  • React

It is difficult for non-experts to build an intuitive understanding of how AI usage creates environmental and productivity impacts, partly owing to disagreements over how to quantify such impacts. We propose that interactive visualisation can help build intuition for navigating these disagreements. butterfl.ai is an interactive installation comprising two stations. Each station is powered by a computer connected to a primary monitor and a larger screen (or projector screen). The primary monitor shows a chatbot interface as well as a prototype AI-powered geospatial visualisation tool. These two pieces of software are connected through a Model Context Protocol (MCP) server, demonstrating a realistic use case for tool-enabled AI. The larger screen shows an interactive visualisation demonstrating the energy, environmental, and productive impact of the user's activity. butterfl.ai aims to help people more tacitly understand trade-offs between inference speed, output quality/usefulness, resource cost, and human effort. butterfl.ai is an Interactivity Track submission to the ACM Designing Interactive Systems 2026 conference.

background

The push across organisations and countries to adopt large language model-driven agentic AI workflows has led to debates over whether productivity “gains” are meaningful enough to offset the costs, not only in terms of API bills and direct energy usage but also in terms of the pressure placed on infrastructure. This question is particularly urgent in energy-intensive sectors like the built environment industry.

AI is positioned as a way to make design processes more efficient and improve environmental outcomes, but the demand for data centre capacity arguably drives the worst infrastructure expansion and land use changes we've seen in recent years.

It is difficult for non-experts to build an intuitive understanding of the environmental and productivity impacts of large language models (LLMs). How much energy exactly do LLMs use for real-world tasks? Are agentic AI systems really cheaper or faster than human effort when it comes to unstructured real-life work problems? Might a larger model justify itself by doing a task in less time, or can smaller ones utilise tools to get things done?

butterfl.ai is an interactive exhibit where users can try controlling a GIS app through a chatbot. With every interaction, a larger screen visualises the impact of the user's interactions, from cost to energy usage.

This exhibit came out of ongoing work at the Singapore-ETH Centre Software Chapter, together with the Future Cities Laboratory Global Engagement Platform team, exploring if smartly-designed Model Context Protocol (MCP) servers can create more intelligent agentic AI systems for geodesign using smaller language models that run entirely on-device. That project in turn was inspired by the principles of the Public AI initiative.

butterfl.ai exhibit demonstration showing the interactive chatbot, geospatial visualisation, and real-time impact metrics.

gallery

Tap on a photo to expand it.

Exhibit station at Singapore-ETH Centre with the impact visualization display (left) showing real-time energy and productivity metrics, connected to a geospatial interface and AI chatbot control panel (right).
Close-up of the dual-screen exhibit setup showing the 3D geospatial visualization of building models on the main display with connected laptop showing the chatbot interface and map controls.

publication

butterfl.ai is an Interactivity Track submission to the ACM Designing Interactive Systems (DIS) 2026 conference. It was accepted and will be exhibited at the conference in Singapore in June 2026.

DIS 2026 Conference

related projects

code + design + sound © 2026 joshua vargas