AgiPanel: The visual host

The AgiPanel is the primary visual container for an individual AGI session. It manages the reactive flow between the chat history, the input compositor, and session observability.

Host Orchestration

Build your own host environment (IDE plugin or standalone app) by implementing the AgiController interface. This decouples the session lifecycle from your UI layout.

Toolkit Dashboards

Create specialized visual panels for your toolkits by implementing the ToolkitRenderer interface. Register renderers in the ToolkitUiRegistry for per-session instantiation.

// 1. Extend the base for automatic EDT-safe binding
public class MyToolkitRenderer extends AbstractToolkitRenderer<MyToolkit> {
    @Override
    protected void onBind() {
        // Build your layout here (called by createToolkitPanel())
        add(new JLabel("Status: " + getAnahataToolkit().getStatus()));
    }
}

// 2. Register mapping in your host application
ToolkitUiRegistry.getInstance().register(MyToolkit.class, MyToolkitRenderer.class);

Tool Parameters

Create specialized visualizers for @AgiToolParam arguments. Renderers are resolved based on the Java type or an explicit rendererId hint in the annotation.

@AgiTool("Performs a specialized operation")
public void myTool(
    @AgiToolParam(value = "Input", rendererId = "json") String input
) { ... }

Tool Approval Workflow

The ToolCallPanel manages the lifecycle of a tool request. It provides a tabbed interface to inspect arguments, review output, and provide feedback.

Multimodal & Audio

Treat audio as a first-class citizen. Extend input capabilities with recording logic and monitor metabolic state via autonomous sound feedback.

// Status changes trigger specific WAV notifications:
// e.g. api_call_in_progress.wav, tool_prompt.wav, awakening_kundalini.wav
private void handleStatusSound(AgiStatus newStatus) {
    String soundFile = newStatus.name().toLowerCase() + ".wav";
    audioPlaybackPanel.playSound(soundFile);
}

Input Composition

The InputPanel maintains a "Live" InputUserMessage that enables real-time Markdown preview and multimodal attachment logic.

// Multimodal attachments use a dual-intent strategy:
// 1. Files are registered as persistent V2 Resources.
// 2. Ephemeral captures (screenshots) are attached to the history buffer.
public void attach(Path p) throws Exception {
    currentMessage.addAttachment(p);
    updateSendButtonState();
    scrollToBottomPreview();
}

Universal Viewers

The ResourceUI strategy decouples domain Resource data from its visual interpretation. This allows swapping between host-native editors and standalone components.

// Register globally at application startup to provide host-specific (e.g. NetBeans) editors
ResourceUiRegistry.getInstance().setResourceUI(new NetBeansResourceUI());

Text Segments

The rendering engine breaks messages into atomic segments. Add specialized visualizers for markdown elements (like charts) by extending AbstractTextSegmentRenderer.

// Claiming a markdown code block with the "chart" language tag
public class ChartRenderer extends AbstractTextSegmentRenderer {
    @Override
    public boolean matches(TextSegmentDescriptor descriptor) {
        return descriptor.type() == TextSegmentType.CODE 
               && "chart".equals(descriptor.language());
    }

    @Override
    protected void updateComponentContent(String content) {
        // Authoritative ingestion point for high-fidelity token streaming
        chartModel.update(content);
    }
}

Custom Iconography

The framework uses a provider-agnostic icon system. Implement host-specific providers to inject real IDE icons or register custom programmatic icons.

// Implementing a host-specific provider (e.g. for NetBeans)
public class NetBeansIconProvider implements IconProvider {
    @Override
    public Icon getIconFor(AbstractToolkit toolkit) {
        return ImageUtilities.loadImageIcon("org/nb/icon.png", true);
    }
}

The Threading Bridge

Anahata model events occur on background threads. Use EdtPropertyChangeListener to update components safely on the EDT.

// Use SwingTask to execute logic off the EDT while providing UI feedback
new SwingTask<Path>(parentComponent, "Saving Session", () -> {
    return agi.save(); 
}, (path) -> {
    statusLabel.setText("Saved to: " + path);
}).execute();

Grounding & Citations

Interactive interface for responses backed by external knowledge. Citations are rendered as interactive chips linked to source material.

// Clicking a citation scrolls the corresponding source into view
chip.addActionListener(e -> {
    scrollSourceIntoView(chunk.getSourceId());
    highlightSourceCard(chunk.getSourceId());
});

Digital Consciousness

Real-time observability via push-pull refresh. StatusPanel and AgiCard aggregate metrics from status, tokens, and error logs.

// Nodes aggregate child token weights for a unified context budget view.
for (AbstractContextNode<?> child : children) {
    this.instructionsTokens += child.getInstructionsTokens();
    this.declarationsTokens += child.getDeclarationsTokens();
    // ... aggregate history and RAG ...
}

// Failed API attempts render as clickable hyperlinks to full stack traces.
errorLink.addActionListener(e -> 
    ExceptionDialog.show(this, "API Error", "Exception during API request", error.getStackTrace())
);

// Archived sessions (closed tabs) get a dimmed background to preserve focus.
private void updateBackground() {
    setBackground(agi.isOpen() ? theme.getCardNormalBg() : new Color(240, 240, 240));
}