> For the complete documentation index, see [llms.txt](https://astroport-1.gitbook.io/astroport.one/llms.txt). Markdown versions of documentation pages are available by appending `.md` to page URLs; this page is available as [Markdown](https://astroport-1.gitbook.io/astroport.one/ia.md).

# UPlanet IA Bot System

Welcome to the UPlanet IA Bot System! This is a powerful, multi-functional AI assistant that integrates with the UPlanet geolocated social network. The bot can generate images, videos, music, search the web, and maintain contextual conversations across 12 different memory slots.

## 🌟 Key Features

### 🧠 **12-Slot Memory System**

* **600 messages total**: 12 slots × 50 messages each
* **Contextual conversations**: Each slot maintains separate conversation history
* **Multi-user support**: Each user has their own private memory slots
* **Geolocated memory**: Memories are tied to specific locations and users
* **Access control**: Slots 1-12 reserved for CopyLaRadio sociétaires (ZenCard holders)

### 🎨 **AI Generation Capabilities**

* **Image generation** with ComfyUI (Stable Diffusion)
* **Text-to-Video** with Wan2.2 5B model
* **Image-to-Video** with Wan2.2 14B model (attach image + prompt)
* **Music composition** with AI audio models
* **Text-to-speech** with multiple voices (Pierre, Amélie via Orpheus TTS)

### 🌿 **Recognition & Inventory**

* **Plant recognition** with PlantNet API + ORE biodiversity tracking
* **Multi-type inventory** - Auto-detect plants, insects, animals, persons, objects, places
* **ORE Contracts** - Automatic maintenance contracts for recognized items
* **Diversity tracking** - Biodiversity scoring per UMAP location

### 🔍 **Information & Media**

* **Web search** with Perplexica (+ AI summary, tags, illustration)
* **YouTube download** with format conversion (supports all yt-dlp platforms)
* **Image analysis** with LLaVA/MiniCPM-V vision model
* **Cookie-based scraping** - Upload cookies for authenticated web scraping (see [COOKIE\_SYSTEM.md](/astroport.one/docs/reference/cookie_system.md))

## 🚀 Quick Start

### Basic Usage

```
#BRO Hello, how are you?
#BOT What's the weather like?
```

### Memory Management

```
#rec #3 Meeting notes: Discussed Q4 goals
#BRO #3 What were our action items?
#mem #3 Show me the meeting notes
#reset #3 Clear meeting memory
```

## 📋 Complete Command Reference

### 🤖 **Core Bot Commands**

| Command | Description                | Example                              |
| ------- | -------------------------- | ------------------------------------ |
| `#BRO`  | Activate bot with question | `#BRO What's the capital of France?` |
| `#BOT`  | Alternative bot activation | `#BOT Tell me a joke`                |

### 📖 **What #BRO Does (Full Behavior)**

The **#BRO** (or **#BOT**) tag triggers the `UPlanet_IA_Responder.sh` script. Only messages containing `#BRO` or `#BOT` are processed; others are ignored.

#### 1. **Input and Setup**

* The script receives: `pubkey`, `event_id` (trigger message), coordinates, content, optional image URL, KNAME (NOSTR email).
* It parses all **#tags** once (`#search`, `#image`, `#video`, `#mem`, `#reset`, `#rec2`, `#plantnet`, `#inventory`, `#cookie`, `#pierre`, `#amelie`, `#N` for memory slot, etc.).
* If an image is attached (URL or event `imeta` tag), a description is generated via `describe_image.py` (LLaVA/MiniCPM-V) and provided to the IA.

#### 2. **Building the Question for the IA**

* **Base question**: message text (and optionally `[IMAGE received]: <description> --- <text>`).
* **Thread context**: If the trigger message is a **reply** to another message (NIP-10 `root`/`reply` tags), the script fetches the full thread content (root, parent, current message) via `get_conversation_thread` and prepends it as `[Thread context]: Thread: ... Re: ... <current message> ---`. The IA thus receives the full thread for a relevant answer.

#### 3. **Branching by Tags (Priority Order)**

| Priority | Tag(s)                                                                             | Action                                                                                                                       |
| -------- | ---------------------------------------------------------------------------------- | ---------------------------------------------------------------------------------------------------------------------------- |
| 1        | `#reset`                                                                           | Memory reset: slot 0 by default, `#reset #N` for slot N, `#reset #all` for all (0–12). Slots 1–12 require sociétaire access. |
| 2        | `#mem`                                                                             | Display memory content: last 30 messages of slot 0 or slot `#N`.                                                             |
| 3        | `#search`                                                                          | Perplexica web search + IA summary, tags, illustration, published as kind 30023 (blog).                                      |
| 4        | `#image`                                                                           | Image generation via ComfyUI (Stable Diffusion), IPFS upload, return URL.                                                    |
| 5        | `#video`                                                                           | With attached image: Image-to-Video (Wan2.2 14B). Without image: Text-to-Video (Wan2.2 5B).                                  |
| 6        | `#music`                                                                           | ComfyUI music generation, `#parole` for lyrics.                                                                              |
| 7        | `#youtube`                                                                         | Download (yt-dlp), `#mp3` for audio.                                                                                         |
| 8        | `#plantnet`                                                                        | Plant recognition (PlantNet) if image provided; ORE integration, UMAP DID update.                                            |
| 9        | `#inventory` / `#plant` / `#insect` / `#animal` / `#person` / `#object` / `#place` | Multi-type (or forced-type) recognition, ORE contract (kind 30312), blog (kind 30023), diversity tracking.                   |
| 10       | `#cookie`                                                                          | Delegate to uDRIVE/Cookies — workflows managed via MiroFish/Dify.                                                            |
| 11       | `#pierre` / `#amelie`                                                              | Text-to-speech (Orpheus TTS), return audio URL.                                                                              |
| 12       | (no special tag)                                                                   | Conversational IA: `question.py` (Ollama) with the built question (thread context + memory slot context if `#N`).            |

The **memory slot** `#N` (1–12) is detected in the message; when present and the user has access (sociétaire), the last 20 messages of that slot are loaded as context for the IA.

#### 4. **Publishing the Reply**

* **Conversational replies (kind 1 trigger)**: always sent as an encrypted NOSTR private message (NIP-44 DM, kind 4) addressed to the triggering pubkey, signed by **NODE** (the station's own identity, `~/.zen/game/secret.nostr`) — never the Captain's personal key, never published publicly. The public kind 1 channel has been retired for AI replies.
* **Content publications** (blog kind 30023, etc.): still published publicly, signed with the actual content owner's key — UMAP for geolocated PlantNet/inventory replies, else user key (KNAME) if known, else Captain key.
* **NOSTR reply tags** (content publications only):
  * If the **trigger message is ephemeral** (NIP-40 `expiration` tag): the bot **does not** add an `e` link to that message (it will be deleted). If the trigger is part of a **thread** (root/reply), the `e` tag points to the thread root or parent so the reply stays in the same thread.
  * Otherwise: `e` = trigger event id, `p` = author. Error messages get an `expiration` tag (1h TTL).
* **#rec2**: When present, the bot’s reply is automatically recorded into the current memory slot.

#### 5. **Summary**

* **#BRO** activates the full IA pipeline (memory, search, image, video, music, YouTube, PlantNet, inventory, cookie, TTS, or default conversation).
* **Thread context** is always included in the question when the message is a reply in a thread.
* **Ephemeral messages** are not linked via `e`; the reply is attached to the thread (root/reply) when one exists.

### 🧠 **Memory Management**

| Command       | Description                      | Example                      | Access           |
| ------------- | -------------------------------- | ---------------------------- | ---------------- |
| `#rec`        | Record message in memory         | `#rec #3 Meeting notes`      | All users        |
| `#rec #N`     | Record in specific slot (1-12)   | `#rec #5 Personal reminder`  | Sociétaires only |
| `#rec2`       | Auto-record bot response         | `#rec2 #3 Ask about meeting` | All users        |
| `#rec2 #N`    | Auto-record bot response in slot | `#rec2 #5 Ask for reminder`  | Sociétaires only |
| `#mem`        | Show slot 0 memory               | `#mem`                       | All users        |
| `#mem #N`     | Show specific slot memory        | `#mem #3`                    | Sociétaires only |
| `#reset`      | Clear slot 0                     | `#reset`                     | All users        |
| `#reset #N`   | Clear specific slot              | `#reset #3`                  | Sociétaires only |
| `#reset #all` | Clear all slots (0-12)           | `#reset #all`                | Sociétaires only |

### 🎨 **AI Generation Commands**

| Command          | Description                                | Example                                               | Access           |
| ---------------- | ------------------------------------------ | ----------------------------------------------------- | ---------------- |
| `#image`         | Generate image (Stable Diffusion)          | `#BRO #image A sunset over mountains`                 | All users        |
| `#video`         | Generate video (Text-to-Video)             | `#BRO #video A cat playing in the garden`             | All users        |
| `#video` + image | Generate video from image (Image-to-Video) | `#BRO #video The cat turns its head` + attached image | All users        |
| `#music`         | Generate music                             | `#BRO #music A peaceful piano melody`                 | All users        |
| `#parole`        | Add lyrics to music                        | `#BRO #music #parole A song about friendship`         | All users        |
| `#BRO #N`        | Use slot context for AI                    | `#BRO #3 #image Dashboard design`                     | Sociétaires only |
| `#BOT #N`        | Use slot context for AI                    | `#BOT #5 #music Personal theme`                       | Sociétaires only |

### 🌿 **Recognition & Inventory Commands**

| Command      | Description                          | Example                        | Access    |
| ------------ | ------------------------------------ | ------------------------------ | --------- |
| `#plantnet`  | Plant recognition (PlantNet API)     | `#BRO #plantnet` + plant image | All users |
| `#inventory` | Multi-type recognition (auto-detect) | `#BRO #inventory` + image      | All users |
| `#plant`     | Force plant classification           | `#BRO #plant` + image          | All users |
| `#insect`    | Force insect classification          | `#BRO #insect` + image         | All users |
| `#animal`    | Force animal classification          | `#BRO #animal` + image         | All users |
| `#person`    | Force person classification          | `#BRO #person` + image         | All users |
| `#object`    | Force object classification          | `#BRO #object` + image         | All users |
| `#place`     | Force place classification           | `#BRO #place` + image          | All users |

### 🎤 **Voice Synthesis**

| Command   | Description                       | Example                               |
| --------- | --------------------------------- | ------------------------------------- |
| `#pierre` | Generate speech with Pierre voice | `#BRO #pierre Welcome to UPlanet`     |
| `#amelie` | Generate speech with Amélie voice | `#BRO #amelie Thank you for visiting` |

### 🔍 **Information & Media**

| Command    | Description            | Example                                         | Access    |
| ---------- | ---------------------- | ----------------------------------------------- | --------- |
| `#search`  | Web search             | `#BRO #search Latest AI developments`           | All users |
| `#youtube` | Download YouTube video | `#BRO #youtube https://youtube.com/watch?v=...` | All users |
| `#mp3`     | Convert YouTube to MP3 | `#BRO #youtube #mp3 https://youtube.com/...`    | All users |

### 🔐 **Privacy & Communication**

All AI replies are now sent as private NIP-44 DMs by default (see §4 above) — `#secret` is no longer needed to get a private reply.

| Command      | Description                                                                                                 | Example                                  | Access           |
| ------------ | ----------------------------------------------------------------------------------------------------------- | ---------------------------------------- | ---------------- |
| `#secret`    | Also hide *your own triggering message* from public relay storage (the reply is already private either way) | `#BRO #secret Tell me something private` | All users        |
| `#secret #N` | Hide the triggering message, with slot context                                                              | `#BRO #secret #3 Private meeting notes`  | Sociétaires only |

## 🌳 **Complete Decision Tree**

### **#BRO / #BOT Processing Flow**

```
┌─────────────────────────────────────────────────────────────────────────────────┐
│                           UPlanet_IA_Responder.sh                               │
│                        Complete Decision Tree #BRO / #BOT                       │
└─────────────────────────────────────────────────────────────────────────────────┘

                              NOSTR Message Received
                                     │
                                     ▼
                        ┌────────────────────────┐
                        │  #BRO or #BOT present? │
                        └────────────────────────┘
                                     │
                    ┌────────────────┴────────────────┐
                   NO                                YES
                    │                                 │
                    ▼                                 ▼
               [IGNORED]                    ┌──────────────────┐
                                           │   Tag Analysis    │
                                           └──────────────────┘
                                                    │
        ┌───────────────────────────────────────────┼───────────────────────────────────────────┐
        │                                           │                                           │
        ▼                                           ▼                                           ▼
┌───────────────┐                         ┌─────────────────┐                         ┌─────────────────┐
│    MEMORY     │                         │   GENERATION    │                         │   UTILITIES     │
└───────────────┘                         └─────────────────┘                         └─────────────────┘
        │                                           │                                           │
        ├─► #reset                                  ├─► #search                                 ├─► #youtube
        │   ├─► #all → Reset slots 0-12            │   └─► Perplexica + AI                     │   └─► yt-dlp download
        │   ├─► #N → Reset slot N                  │       ├─► AI Summary                      │       ├─► #mp3 → audio
        │   └─► (default) → Reset slot 0           │       ├─► AI Tags                         │       └─► (default) → mp4
        │                                          │       ├─► AI Image                        │
        ├─► #mem                                   │       └─► Kind 30023 (blog)               ├─► #cookie
        │   ├─► #N → Display slot N               │                                            │   └─► Workflow engine
        │   └─► (default) → Display slot 0        ├─► #image                                   │
        │                                          │   └─► ComfyUI generate_image.sh           ├─► #pierre / #amelie
        └─► #rec2                                  │       └─► → IPFS URL                      │   └─► Orpheus TTS
            └─► Auto-save bot response            │                                            │       └─► → Audio URL
                in memory                          ├─► #video ─────────────────────┐           │
                                                   │                               │           └─► (default)
                                                   │   ┌───────────────────────────┤               └─► Ollama question.py
                                                   │   │                           │
                                                   │   ▼                           ▼
                                                   │ Image attached?          No image
                                                   │   │                           │
                                                   │   ▼                           ▼
                                                   │ image_to_video.sh      generate_video.sh
                                                   │ video_wan2_2_14B_i2v   video_wan2_2_5B_ti2v
                                                   │ Tags: #i2v             Tags: #t2v
                                                   │
                                                   ├─► #music
                                                   │   └─► ComfyUI generate_music.sh
                                                   │       └─► → IPFS Audio URL
                                                   │
                                                   ├─► #plantnet (+ image)
                                                   │   └─► PlantNet API
                                                   │       ├─► Recognition JSON
                                                   │       ├─► ORE integration
                                                   │       ├─► UMAP DID update
                                                   │       └─► Tags: #plantnet #UPlanet
                                                   │
                                                   └─► #inventory / #plant / #insect /
                                                       #animal / #person / #object / #place
                                                       └─► inventory_recognition.py
                                                           ├─► AI Type detection
                                                           ├─► ORE Contract (kind 30312)
                                                           ├─► Blog (kind 30023)
                                                           └─► Diversity tracker
```

### **Complete Tag Reference Table**

| Tag              | Function                                    | Script/Service             | Output                    | Prerequisites        |
| ---------------- | ------------------------------------------- | -------------------------- | ------------------------- | -------------------- |
| `#search`        | Perplexica web search + AI summary          | `perplexica_search.sh`     | Kind 30023 (blog article) | Perplexica           |
| `#image`         | Image generation (Stable Diffusion)         | `generate_image.sh`        | IPFS URL                  | ComfyUI              |
| `#video`         | Text-to-Video (Wan2.2 5B)                   | `generate_video.sh`        | IPFS URL                  | ComfyUI              |
| `#video` + image | Image-to-Video (Wan2.2 14B)                 | `image_to_video.sh`        | IPFS URL                  | ComfyUI + image      |
| `#music`         | AI music generation                         | `generate_music.sh`        | IPFS URL                  | ComfyUI              |
| `#youtube`       | Video download (all platforms)              | `process_youtube.sh`       | IPFS URL                  | yt-dlp               |
| `#youtube #mp3`  | Audio extraction                            | `process_youtube.sh`       | IPFS MP3 URL              | yt-dlp + ffmpeg      |
| `#plantnet`      | Plant recognition                           | `plantnet_recognition.py`  | JSON + ORE                | PlantNet API + image |
| `#inventory`     | Multi-type classification (auto)            | `inventory_recognition.py` | ORE Contract              | Image                |
| `#plant`         | Force plant type                            | `inventory_recognition.py` | ORE Contract              | Image                |
| `#insect`        | Force insect type                           | `inventory_recognition.py` | ORE Contract              | Image                |
| `#animal`        | Force animal type                           | `inventory_recognition.py` | ORE Contract              | Image                |
| `#person`        | Force person type                           | `inventory_recognition.py` | ORE Contract              | Image                |
| `#object`        | Force object type                           | `inventory_recognition.py` | ORE Contract              | Image                |
| `#place`         | Force place type                            | `inventory_recognition.py` | ORE Contract              | Image                |
| `#pierre`        | Text-to-Speech (Pierre voice)               | `generate_speech.sh`       | IPFS Audio URL            | Orpheus TTS          |
| `#amelie`        | Text-to-Speech (Amélie voice)               | `generate_speech.sh`       | IPFS Audio URL            | Orpheus TTS          |
| `#mem`           | Display memory content                      | -                          | Text                      | -                    |
| `#mem #N`        | Display slot N memory                       | -                          | Text                      | Sociétaire (1-12)    |
| `#reset`         | Clear slot 0 memory                         | -                          | Confirmation              | -                    |
| `#reset #N`      | Clear slot N memory                         | -                          | Confirmation              | Sociétaire (1-12)    |
| `#reset #all`    | Clear all slots (0-12)                      | -                          | Confirmation              | Sociétaire           |
| `#rec2`          | Auto-save bot response                      | `short_memory.py`          | -                         | -                    |
| `#cookie`        | uDRIVE/Cookies delegation                   | MiroFish / Dify            | Message uDRIVE path       | -                    |
| `#secret`        | Also hide trigger message from public relay | -                          | -                         | -                    |
| `#N` (1-12)      | Use memory slot N                           | -                          | Context                   | Sociétaire           |
| (default)        | AI conversation                             | `question.py`              | Text response             | Ollama               |

### **Response Key Priority**

The bot uses different NOSTR keys depending on context:

| Priority | Key Type        | Used When                                         |
| -------- | --------------- | ------------------------------------------------- |
| 1        | **UMAP Key**    | `#plantnet` / `#inventory` (geolocated responses) |
| 2        | **USER Key**    | KNAME (email) available                           |
| 3        | **CAPTAIN Key** | Fallback when no user key                         |

### **Video Generation Workflows**

| Mode               | Trigger             | Workflow File               | Model      | Resolution | Frames |
| ------------------ | ------------------- | --------------------------- | ---------- | ---------- | ------ |
| **Text-to-Video**  | `#video` (no image) | `video_wan2_2_5B_ti2v.json` | Wan2.2 5B  | 640×480    | 121    |
| **Image-to-Video** | `#video` + image    | `video_wan2_2_14B_i2v.json` | Wan2.2 14B | 640×640    | 81     |

## 🏗️ **Technical Architecture**

### **Service Connection Management**

The UPlanet IA system uses a sophisticated connection management architecture that ensures all AI services are available before processing requests. This system is crucial for the bot's functionality and will evolve significantly in production.

#### **Current Architecture (Operational Swarm)**

* **Ollama** (Port 11434) - Core AI conversations
* **ComfyUI** (Port 8188) - Image/video/music generation
* **Perplexica** (Port 3002) - Web search
* **Orpheus TTS** (Port 5005) - Text-to-speech

#### **Connection Verification Process**

1. **Ollama verification** (mandatory) - Bot stops if unavailable
2. **Specialized service verification** (on-demand based on tags)
3. **Intelligent IPFS P2P Swarm** via `DRAGON_p2p_ssh.sh` (Priority)
4. **SSH tunnel fallback** to `scorpio.copylaradio.com` if P2P unavailable
5. **Error handling** with specific messages per service

#### **Swarm Architecture (DRAGON P2P)**

All services use **IPFS P2P connections** via the `DRAGON_p2p_ssh.sh` system:

* **Intelligent Port Selection** - Automatic detection of native vs. alternative ports
* **Decentralized discovery** - Each node publishes available services
* **Load balancing** - Automatic selection of best available node
* **Resilience** - No single point of failure
* **Security** - End-to-end encrypted P2P connections

### **SECTOR G1 opportunities (ASTROBOT)**

The **g1\_opportunities.py** script (triggered by the SECTOR key in `NOSTR.UMAP.refresh.sh`) fetches Ğchange offers around a sector’s center and uses **question.py** (Ollama) to identify value-creation opportunities. The result is:

* **Saved** to `~/.zen/tmp/${IPFSNODEID}/UPLANET/SECTORS/_${rlat}_${rlon}/_${slat}_${slon}/g1_opportunities.md`
* **Emailed** to the captain via **mailjet.sh** (subject: "G1 opportunities SECTOR \_slat\_slon")
* **Published** as a NOSTR kind 30023 article on the **SECTOR’s Nostr identity** (tag `t: G1opportunities`, identifier `sector-G1opportunities-${sector}-${TODATE}`)

Diffusion (mailjet + kind 30023) runs only when this station is the **closest** to the sector (`is_closest_station`). The trigger is in **NOSTR.UMAP.refresh.sh** (not UPLANET.refresh.sh) because SECTORs are defined and iterated there, and G1 opportunities are SECTOR-scoped content on the same Nostr identity and captain logic.

### **File Structure**

```
~/.zen/flashmem/
├── {user_email}/
│   ├── slot0.json      # General conversations
│   ├── slot1.json      # Work discussions
│   ├── slot2.json      # Personal projects
│   └── ...
└── uplanet_memory/     # Legacy coordinate-based memory
    ├── {coord_key}.json
    └── pubkey/
        └── {pubkey}.json
```

### **Memory File Format**

```json
{
  "user_id": "user@example.com",
  "slot": 3,
  "messages": [
    {
      "timestamp": "2024-01-01T12:00:00Z",
      "event_id": "event123",
      "latitude": "48.86",
      "longitude": "2.22",
      "content": "Meeting notes: Discussed Q4 goals"
    }
  ]
}
```

### **AI Context Loading**

* **Slot-based context**: Last 20 messages from specified slot
* **Fallback**: Legacy pubkey or coordinate-based memory
* **Token optimization**: Limits context to prevent AI token overflow

## 🧠 **Memory System Deep Dive**

### Why 12 Slots?

The 12-slot system allows you to organize conversations by context:

* **Slot 0**: General conversations (default) - **All users**
* **Slot 1**: Work/Professional discussions - **Sociétaires only**
* **Slot 2**: Personal projects - **Sociétaires only**
* **Slot 3**: Meeting notes - **Sociétaires only**
* **Slot 4**: Creative ideas - **Sociétaires only**
* **Slot 5**: Personal reminders - **Sociétaires only**
* **Slot 6**: Technical discussions - **Sociétaires only**
* **Slot 7**: Learning topics - **Sociétaires only**
* **Slot 8**: Travel plans - **Sociétaires only**
* **Slot 9**: Health & wellness - **Sociétaires only**
* **Slot 10**: Financial planning - **Sociétaires only**
* **Slot 11**: Family matters - **Sociétaires only**
* **Slot 12**: Hobbies & interests - **Sociétaires only**

### Memory Recording Types

#### `#rec` vs `#rec2`

* **`#rec`**: Records only the user's message in memory

  ```
  User: #BRO #rec #3 Meeting notes: Discussed Q4 goals
  Bot: Here's a summary of your meeting...
  → Only "Meeting notes: Discussed Q4 goals" is stored in slot 3
  ```
* **`#rec2`**: Automatically records the bot's response in memory

  ```
  User: #BRO #rec2 #3 What were our Q4 goals?
  Bot: Based on our previous discussion, your Q4 goals are...
  → The bot's response is automatically stored in slot 3
  ```

#### **Combined Usage**

```
#rec #3 Meeting notes: Discussed Q4 goals
#BRO #rec2 #3 What were our action items?
#mem #3 Show me both the notes and the bot's response
```

## 🎯 **Best Practices**

### 1. **Organize by Context**

* Use consistent slots for similar topics
* Keep work and personal conversations separate
* Use slot 0 for general chit-chat

### 2. **Effective Memory Usage**

* Record important information immediately with `#rec`
* Use descriptive content for better AI context
* Review memory regularly with `#mem`

### 3. **AI Generation Tips**

* Be specific in your descriptions
* Combine commands: `#BRO #3 #image A modern office space`
* Use context: `#BRO #4 Based on our previous discussion, generate...`

### 4. **Memory Management**

* Reset slots when starting new projects
* Use `#reset #all` sparingly
* Keep important memories in dedicated slots

## 🌍 **Geolocation Integration**

The bot integrates with UPlanet's geolocation system:

* **Location-aware**: Memories are tied to GPS coordinates
* **Local context**: AI can reference location-specific information
* **Community memory**: Shared memories at specific locations

## 🔒 **Privacy & Security**

* **User isolation**: Each user's memory is completely separate
* **Local storage**: All memory files stored locally
* **No cloud sync**: Your conversations stay private
* **Optional sharing**: Choose what to share with the community
* **Access control**: Slots 1-12 protected for CopyLaRadio sociétaires
* **Secure verification**: User status verified via `~/.zen/game/players/` directory
* **Private messaging by default**: every AI reply is an encrypted NOSTR DM (NIP-44), signed by NODE, never published publicly
* **Event filtering**: `#secret` additionally rejects the *triggering* message from public relay storage

## 🚀 **Advanced Features**

### **Combined Commands**

```
#BRO #3 #image A dashboard based on our meeting requirements
#BOT #5 #music #parole A song about my personal goals
#BRO #search #1 Latest developments in AI for business
```

### **Context Switching**

```
#rec #1 Work meeting about project timeline
#rec #5 Personal: Need to buy groceries
#BRO #1 What's our project deadline?
#BRO #5 What was I supposed to buy?
```

### **Creative Workflows**

```
#rec #4 Art project: Abstract painting series
#BRO #4 #image An abstract painting with blue and gold
#BRO #4 #music Ambient music for the art gallery
#BRO #4 #video A timelapse of the painting process
```

### **Video Generation (Text-to-Video vs Image-to-Video)**

```
# Text-to-Video (no image attached) - Uses Wan2.2 5B
#BRO #video A dragon flying over a mountain at sunset

# Image-to-Video (with image attached) - Uses Wan2.2 14B
#BRO #video The character slowly turns their head toward the camera
[attach your source image]
```

### **Plant Recognition & Biodiversity**

```
# Recognize a plant (attach plant photo)
#BRO #plantnet
→ Returns: Scientific name, common names, confidence score, Wikipedia link
→ Creates: ORE biodiversity record, UMAP DID update

# Multi-type inventory (auto-detect type)
#BRO #inventory
→ Auto-detects: plant, insect, animal, person, object, or place
→ Creates: ORE maintenance contract (kind 30312) + blog (kind 30023)

# Force specific type classification
#BRO #insect    # Force insect classification
#BRO #animal    # Force animal classification
#BRO #object    # Force object classification
#BRO #place     # Force place/location classification
```

### **Private Communication**

```
#BRO #secret Can you help me with a personal matter?
#BRO #secret #3 Private meeting notes for tomorrow
#BRO #secret #5 Personal reminder about doctor appointment
```

## 🎉 **Why This System is Amazing**

### **1. Unprecedented Context Management**

* **600 total messages** across 12 slots
* **Instant context switching** between topics
* **Persistent memory** across sessions

### **2. Multi-Modal AI Integration**

* **Text, image, video, audio** generation
* **Seamless workflow** between different AI models
* **Context-aware generation** based on conversation history

### **3. Real-World Practicality**

* **Work organization**: Separate slots for different projects
* **Personal management**: Health, finance, family in dedicated slots
* **Creative projects**: Track ideas and generate related content

### **4. Geolocation Intelligence**

* **Location-aware conversations**
* **Community memory** at specific places
* **Local context** for better AI responses

### **5. Privacy-First Design**

* **Local storage** of all memories
* **User isolation** for complete privacy
* **No cloud dependencies**
* **Encrypted private messaging by default** for every AI reply (kind 1 trigger), signed by NODE
* **Event filtering** on request (`#secret`) prevents the trigger message itself from public storage

## 🔐 **Private Replies by Default (+ `#secret`)**

### How It Works

Every reply to a kind 1 `#BRO`/`#BOT` message is sent as an encrypted NOSTR DM back to the sender — no opt-in needed:

* **Encrypted delivery**: Replies are sent as NIP-44 encrypted direct messages (NOSTR kind 4)
* **Signing identity**: Signed by **NODE**, the station's own key (`~/.zen/game/secret.nostr`) — never the Captain's personal identity, so the bot's automated replies don't leak who currently operates the station
* **Addressing**: Sent directly to the triggering pubkey (no lookup step required)
* **Memory integration**: Works with all memory slots and AI generation features

The `#secret` tag has a narrower, complementary role: it hides *your own triggering message* from public relay storage. The reply was already private either way.

### Usage Examples

#### **Basic Communication (always private)**

```
#BRO Can you help me with a personal matter?
#BOT Tell me something private about AI
```

#### **Also hiding the triggering message**

```
#rec #secret #3 Private meeting notes for tomorrow
#mem #secret #5 Show my personal reminders privately
#reset #secret #3 Clear private meeting memory
```

### Technical Details

#### **NOSTR Integration**

* **Encryption**: Uses NIP-44 encryption for reply delivery
* **Key management**: Reads NODE's key directly from `~/.zen/game/secret.nostr` — no per-user hex lookup needed
* **Relay handling**: Sends via configured NOSTR relay with proper error handling
* **Event filtering**: `#secret` on the trigger message returns exit code 1 to prevent relay storage of that message

#### **Memory Handling**

* **Auto-recording**: `#rec2` works the same way regardless of `#secret`, using unique local event IDs
* **Context preservation**: Slot-based memory maintains conversation context

#### **Security Features**

* **No public trace for replies**: AI replies never appear in public feeds, `#secret` or not
* **Encrypted content**: All reply content is encrypted end-to-end
* **Graceful fallback**: Handles missing NODE identity or relay issues gracefully

### Privacy Benefits

1. **Complete confidentiality by default**: Your conversations with the bot stay private without needing to remember a tag
2. **No public record**: AI replies don't appear in public UPlanet feeds
3. **Encrypted delivery**: All communication is encrypted using NOSTR standards
4. **Memory privacy**: Private conversations can still use the memory system
5. **AI privacy**: Generate content privately without public exposure

### Best Practices

* **Use for sensitive topics**: Personal matters, confidential work, private ideas
* **Combine with memory slots**: `#secret #3` for private work discussions
* **Maintain context**: Use `#rec2` to automatically save private conversations
* **Verify delivery**: Check your NOSTR client for received messages
* **Respect others**: Only use for legitimate private communication

## 🛠️ **Troubleshooting**

### Common Issues

**Memory not found**

* Check if you're using the correct slot number
* Verify the user ID (email) is correct
* Ensure the memory file exists

**Access denied to slots 1-12**

* Verify you are a CopyLaRadio sociétaire with ZenCard
* Check if your directory exists in `~/.zen/game/players/`
* Use slot 0 for general conversations (accessible to all users)
* Contact CopyLaRadio to become a sociétaire

**AI generation fails**

* Check if required services are running (ComfyUI, Ollama)
* Verify internet connection for web search
* Ensure proper command syntax

**Reset not working**

* Confirm you're using the correct slot number
* Check file permissions in `~/.zen/flashmem/`
* Verify the user directory exists

**Secret messages not received**

* Verify your NOSTR email (KNAME) is correctly set
* Check if your hex key exists in `~/.zen/game/nostr/{KNAME}/HEX`
* Ensure your NOSTR client is configured to receive direct messages
* Verify the relay connection in `~/.zen/Astroport.ONE/tools/my.sh`

### Getting Help

1. Check the logs: `~/.zen/tmp/IA.log`
2. Verify service status: `./ollama.me.sh`
3. Test individual components: `./test_slot_memory.sh`

## 🎯 **Getting Started Checklist**

* [ ] Send your first message: `#BRO Hello!`
* [ ] Record something: `#rec My first memory` (slot 0)
* [ ] View memory: `#mem`
* [ ] Generate content: `#BRO #image A beautiful landscape`
* [ ] Search web: `#BRO #search Latest technology news`
* [ ] Create music: `#BRO #music A relaxing melody`

**For Sociétaires (slots 1-12):**

* [ ] Record in specific slot: `#rec #3 Meeting notes`
* [ ] View slot memory: `#mem #3`
* [ ] Use context for AI: `#BRO #3 #image Dashboard design`
* [ ] Reset specific slot: `#reset #3`

**For Private Communication:**

* [ ] Send private message: `#BRO #secret Hello, this is private`
* [ ] Private memory operation: `#rec #secret #3 Private notes`
* [ ] Private AI generation: `#BRO #secret #image Private design`
* [ ] Verify NOSTR client receives direct messages

## 📚 **Technical Documentation**

### **Connection Management Architecture**

For detailed information about how the IA system manages service connections, see:

* [**Connection Management Diagram**](/astroport.one/ia/connection_management_diagram.md) - Complete technical overview of service connection management, verification processes, and the migration to IPFS P2P architecture

### **Related Documentation**

* [**Astroport.ONE Main README**](/astroport.one/readme.md) - Overview of the entire UPlanet ecosystem
* [**Architecture Documentation**](/astroport.one/architecture.md) - Technical system architecture
* [**Legal Framework**](/astroport.one/legal.md) - Cooperative legal structure
* [**🍪 Cookie Management System**](/astroport.one/docs/reference/cookie_system.md) - Universal cookie upload and storage system for authenticated web scraping
* [**🔧 Domain Scrapers**](/astroport.one/docs/reference/domain_scrapers.md) - Guide to creating custom domain-specific scrapers

***

**Welcome to the future of contextual AI conversations!** 🚀

The UPlanet IA Bot System combines the power of multiple AI models with intelligent memory management to create a truly personalized and contextually aware assistant. Whether you're managing work projects, pursuing creative endeavors, or just having a conversation, the 12-slot memory system ensures that your AI assistant always remembers what matters to you.