Agent visibility

How admins see, control, and give feedback on what AI agents do with your data

Built for trust

AI agents only earn a place in your workflow if admins can see what they’re doing and step in when it matters. Lightdash agents are designed around three principles: every interaction is visible to admins, risky actions need a human decision before they happen, and wrong answers get found and fixed rather than just logged.

That matters because the usual alternative, broad warehouse access and ad hoc SQL, tends to leave little trace of what was queried, by whom, or whether anyone checked the result. Lightdash agents keep that same flexibility while making every question, generated query, and external tool call attributable, reviewable, and improvable.

These principles come down to three pillars:

Pillar	What it means	Where it lives
Transparency	Every interaction is visible to admins, not just the person who ran it	Thread activity, MCP activity, Autopilot activity
Control	Risky actions require a human decision before they happen, and access is scoped by default	SQL mode approval, data access control, MCP tool curation
Governance	Wrong answers get found and fixed, not just logged	Issues, Evaluations, Verified answers

Admins manage thread history and Issues from Settings → Ask AI. MCP activity lives under Settings → MCP → Analytics. Each view is scoped to the projects the admin manages.

Thread activity

Every agent conversation, in the Lightdash app or Slack, is visible to admins under Threads. It’s the same record the person who asked the question sees: their question, the agent’s answer, and the query behind it. Admins use it to understand how agents are actually being used, and to pull real conversations into Evaluations as test cases.

MCP activity

The MCP → Analytics page covers both directions of MCP activity: external assistants calling tools on the Lightdash MCP server, and Lightdash agents calling tools on connected external MCP servers. Admins can see what was called, by whom, and whether it succeeded.

Activity is retained for 90 days.

Which tools an agent is allowed to call is decided separately, per MCP server, in project settings. See choosing which tools are exposed.

Closing the loop: Issues & Evaluations

Visibility on its own is a log. Paired with Issues and Evaluations, it becomes a feedback loop: Issues scans agent turns for likely-wrong answers and proposes a fix, and Evaluations turns any thread into a regression test so a fixed issue stays fixed.

Agents vs. raw SQL access

	Raw warehouse SQL access	Lightdash AI agents
Visibility into queries	Only if you’ve built your own logging	Every question and query, in Threads
Visibility into external actions	Untracked	Every MCP call logged, with outcome
Review before execution	None, the query already ran	SQL mode requires approval first
Row and column security	Only as strong as your warehouse grants	Inherits your existing user attributes
Catching a wrong answer	You find out when someone notices	Issues surfaces it proactively

Related

• Issues: the quality feedback loop
• Evaluations: regression-test agent behavior
• Data access control: what agents can query and see
• MCP servers: connect and curate external tools
• Autopilot: scheduled agent with its own activity log