Model provenance, security review and the risks created by unmanaged AI usage.
Unreleased
Go to desktop to view this case study
The case study includes a detailed software hierarchy and governance workflows designed for a larger screen.
Back to portfolioUnreleased product · 2026
Exploring clearer controls for Shadow AI and sensitive access
Two research-led workflows from the same unreleased security app: governing unmanaged AI models and rotating API keys without disruption.
- Scope
- Two focused security workflows, explored through domain research, systems thinking and interaction design.
- Stage
- The product was not released. Both features reached interactive prototypes.
The context
AI adoption can move faster than an organization’s approval process
The app explored infrastructure risks that startups are actively confronting as their systems mature. This case study begins with Shadow AI: after an unmanaged model is detected, reviewers need to understand where it is being used and decide whether it can remain.
The project, repository and deployable-artifact hierarchy needed for this workflow.
The consequences of governing one artifact versus every occurrence of a model.
The product challenge
One flagged model can create many governance decisions
Consider vgg16_light_a: a scan finds the same model inside artifacts used across four projects. The relevant hierarchy is limited to what this workflow needs: projects contain repositories, and repositories contain deployable artifacts. Blocking only one location could leave other instances exposed. Blocking every location could interrupt production services.
This distinction shaped the experience: the model is the subject of the investigation, while its containing artifacts are the units affected by a governance action.
Ideation
Three ways to make the model’s reach visible
I explored different ways to organize the same locations before committing to the drilldown.
But it hides how each artifact relates to its repository and project.
But it becomes difficult to compare locations or act consistently at scale.
It mirrors project, repository and artifact boundaries while supporting decisions at each level.
The hierarchy gave reviewers both a path to the individual artifact and a predictable way to understand broader actions.
Defining the interaction
The hierarchy had to answer two questions
Where does this model live? And before acting, how far will the decision reach?
Group every occurrence under its project and repository.
Keep its type and location visible when a reviewer approves or blocks it.
Make the chosen scope and its inherited outcomes explicit.
Preview every affected artifact before the reviewer confirms it.
UX and UI decisions
Making scope visible at every step
The broader the scope of a governance action, the more explicitly the product should reveal its consequences. Row controls support focused decisions. A global block first reveals every affected artifact and asks the reviewer to document why the action is needed.
dbalencar / vgg16_light_a
/app/models/vgg16_light_a.pt/app/models/vgg16_light_a.pt/usr/local/lib/models/vgg16_light_a.pt/downloads/vgg16_exp.pkl/opt/models/vgg16_light_a.pt/opt/models/vgg16_light_a.pt/var/lib/models/vgg16_light_a.ptAPI key management
Making API key access and change safer
Across both workflows, the design made credential risk visible at the moment of decision: permissions during creation, and potential disruption during rotation.
Reflection
The design made consequence part of the decision
Across the feature explorations, the interaction mattered only when it made the consequence of a security action visible: affected scope in AI governance, granted access during key creation, and the transition window during rotation. Because the work remained exploratory, the next step would be validating whether those consequences are understandable without explanation.
What I would validate next
Can reviewers distinguish the detected model from each artifact that contains it?
Can they predict the reach of an artifact-, repository- or project-level action?
Does added confirmation feel appropriate as the potential blast radius grows?