# UPlanet IA Bot System

Welcome to the UPlanet IA Bot System! This is a powerful, multi-functional AI assistant that integrates with the UPlanet geolocated social network. The bot can generate images, videos, music, search the web, and maintain contextual conversations across 12 different memory slots.

## 🌟 Key Features

### 🧠 **12-Slot Memory System**

* **600 messages total**: 12 slots × 50 messages each
* **Contextual conversations**: Each slot maintains separate conversation history
* **Multi-user support**: Each user has their own private memory slots
* **Geolocated memory**: Memories are tied to specific locations and users
* **Access control**: Slots 1-12 reserved for CopyLaRadio sociétaires (ZenCard holders)

### 🎨 **AI Generation Capabilities**

* **Image generation** with ComfyUI (Stable Diffusion)
* **Text-to-Video** with Wan2.2 5B model
* **Image-to-Video** with Wan2.2 14B model (attach image + prompt)
* **Music composition** with AI audio models
* **Text-to-speech** with multiple voices (Pierre, Amélie via Orpheus TTS)

### 🌿 **Recognition & Inventory**

* **Plant recognition** with PlantNet API + ORE biodiversity tracking
* **Multi-type inventory** - Auto-detect plants, insects, animals, persons, objects, places
* **ORE Contracts** - Automatic maintenance contracts for recognized items
* **Diversity tracking** - Biodiversity scoring per UMAP location

### 🔍 **Information & Media**

* **Web search** with Perplexica (+ AI summary, tags, illustration)
* **YouTube download** with format conversion (supports all yt-dlp platforms)
* **Image analysis** with LLaVA/MiniCPM-V vision model
* **Cookie-based scraping** - Upload cookies for authenticated web scraping (see [COOKIE\_SYSTEM.md](/astroport.one/docs/reference/cookie_system.md))

## 🚀 Quick Start

### Basic Usage

```
#BRO Hello, how are you?
#BOT What's the weather like?
```

### Memory Management

```
#rec #3 Meeting notes: Discussed Q4 goals
#BRO #3 What were our action items?
#mem #3 Show me the meeting notes
#reset #3 Clear meeting memory
```

## 📋 Complete Command Reference

### 🤖 **Core Bot Commands**

| Command | Description                | Example                              |
| ------- | -------------------------- | ------------------------------------ |
| `#BRO`  | Activate bot with question | `#BRO What's the capital of France?` |
| `#BOT`  | Alternative bot activation | `#BOT Tell me a joke`                |

### 📖 **What #BRO Does (Full Behavior)**

The **#BRO** (or **#BOT**) tag triggers the `UPlanet_IA_Responder.sh` script. Only messages containing `#BRO` or `#BOT` are processed; others are ignored.

#### 1. **Input and Setup**

* The script receives: `pubkey`, `event_id` (trigger message), coordinates, content, optional image URL, KNAME (NOSTR email).
* It parses all **#tags** once (`#search`, `#image`, `#video`, `#mem`, `#reset`, `#rec2`, `#plantnet`, `#inventory`, `#cookie`, `#pierre`, `#amelie`, `#N` for memory slot, etc.).
* If an image is attached (URL or event `imeta` tag), a description is generated via `describe_image.py` (LLaVA/MiniCPM-V) and provided to the IA.

#### 2. **Building the Question for the IA**

* **Base question**: message text (and optionally `[IMAGE received]: <description> --- <text>`).
* **Thread context**: If the trigger message is a **reply** to another message (NIP-10 `root`/`reply` tags), the script fetches the full thread content (root, parent, current message) via `get_conversation_thread` and prepends it as `[Thread context]: Thread: ... Re: ... <current message> ---`. The IA thus receives the full thread for a relevant answer.

#### 3. **Branching by Tags (Priority Order)**

| Priority | Tag(s)                                                                             | Action                                                                                                                       |
| -------- | ---------------------------------------------------------------------------------- | ---------------------------------------------------------------------------------------------------------------------------- |
| 1        | `#reset`                                                                           | Memory reset: slot 0 by default, `#reset #N` for slot N, `#reset #all` for all (0–12). Slots 1–12 require sociétaire access. |
| 2        | `#mem`                                                                             | Display memory content: last 30 messages of slot 0 or slot `#N`.                                                             |
| 3        | `#search`                                                                          | Perplexica web search + IA summary, tags, illustration, published as kind 30023 (blog).                                      |
| 4        | `#image`                                                                           | Image generation via ComfyUI (Stable Diffusion), IPFS upload, return URL.                                                    |
| 5        | `#video`                                                                           | With attached image: Image-to-Video (Wan2.2 14B). Without image: Text-to-Video (Wan2.2 5B).                                  |
| 6        | `#music`                                                                           | ComfyUI music generation, `#parole` for lyrics.                                                                              |
| 7        | `#youtube`                                                                         | Download (yt-dlp), `#mp3` for audio.                                                                                         |
| 8        | `#plantnet`                                                                        | Plant recognition (PlantNet) if image provided; ORE integration, UMAP DID update.                                            |
| 9        | `#inventory` / `#plant` / `#insect` / `#animal` / `#person` / `#object` / `#place` | Multi-type (or forced-type) recognition, ORE contract (kind 30312), blog (kind 30023), diversity tracking.                   |
| 10       | `#cookie`                                                                          | Delegate to uDRIVE/Cookies — workflows managed via MiroFish/Dify.                                                            |
| 11       | `#pierre` / `#amelie`                                                              | Text-to-speech (Orpheus TTS), return audio URL.                                                                              |
| 12       | (no special tag)                                                                   | Conversational IA: `question.py` (Ollama) with the built question (thread context + memory slot context if `#N`).            |

The **memory slot** `#N` (1–12) is detected in the message; when present and the user has access (sociétaire), the last 20 messages of that slot are loaded as context for the IA.

#### 4. **Publishing the Reply**

* **Key used**: UMAP for geolocated PlantNet/inventory replies, else user key (KNAME) if known, else Captain key.
* **Secret mode** (DM reply): If the script is invoked with `--secret`, the reply is sent as a NOSTR private message (kind 4) instead of being published publicly.
* **NOSTR reply tags**:
  * If the **trigger message is ephemeral** (NIP-40 `expiration` tag): the bot **does not** add an `e` link to that message (it will be deleted). If the trigger is part of a **thread** (root/reply), the `e` tag points to the thread root or parent so the reply stays in the same thread.
  * Otherwise: `e` = trigger event id, `p` = author. Error messages get an `expiration` tag (1h TTL).
* **#rec2**: When present, the bot’s reply is automatically recorded into the current memory slot.

#### 5. **Summary**

* **#BRO** activates the full IA pipeline (memory, search, image, video, music, YouTube, PlantNet, inventory, cookie, TTS, or default conversation).
* **Thread context** is always included in the question when the message is a reply in a thread.
* **Ephemeral messages** are not linked via `e`; the reply is attached to the thread (root/reply) when one exists.

### 🧠 **Memory Management**

| Command       | Description                      | Example                      | Access           |
| ------------- | -------------------------------- | ---------------------------- | ---------------- |
| `#rec`        | Record message in memory         | `#rec #3 Meeting notes`      | All users        |
| `#rec #N`     | Record in specific slot (1-12)   | `#rec #5 Personal reminder`  | Sociétaires only |
| `#rec2`       | Auto-record bot response         | `#rec2 #3 Ask about meeting` | All users        |
| `#rec2 #N`    | Auto-record bot response in slot | `#rec2 #5 Ask for reminder`  | Sociétaires only |
| `#mem`        | Show slot 0 memory               | `#mem`                       | All users        |
| `#mem #N`     | Show specific slot memory        | `#mem #3`                    | Sociétaires only |
| `#reset`      | Clear slot 0                     | `#reset`                     | All users        |
| `#reset #N`   | Clear specific slot              | `#reset #3`                  | Sociétaires only |
| `#reset #all` | Clear all slots (0-12)           | `#reset #all`                | Sociétaires only |

### 🎨 **AI Generation Commands**

| Command          | Description                                | Example                                               | Access           |
| ---------------- | ------------------------------------------ | ----------------------------------------------------- | ---------------- |
| `#image`         | Generate image (Stable Diffusion)          | `#BRO #image A sunset over mountains`                 | All users        |
| `#video`         | Generate video (Text-to-Video)             | `#BRO #video A cat playing in the garden`             | All users        |
| `#video` + image | Generate video from image (Image-to-Video) | `#BRO #video The cat turns its head` + attached image | All users        |
| `#music`         | Generate music                             | `#BRO #music A peaceful piano melody`                 | All users        |
| `#parole`        | Add lyrics to music                        | `#BRO #music #parole A song about friendship`         | All users        |
| `#BRO #N`        | Use slot context for AI                    | `#BRO #3 #image Dashboard design`                     | Sociétaires only |
| `#BOT #N`        | Use slot context for AI                    | `#BOT #5 #music Personal theme`                       | Sociétaires only |

### 🌿 **Recognition & Inventory Commands**

| Command      | Description                          | Example                        | Access    |
| ------------ | ------------------------------------ | ------------------------------ | --------- |
| `#plantnet`  | Plant recognition (PlantNet API)     | `#BRO #plantnet` + plant image | All users |
| `#inventory` | Multi-type recognition (auto-detect) | `#BRO #inventory` + image      | All users |
| `#plant`     | Force plant classification           | `#BRO #plant` + image          | All users |
| `#insect`    | Force insect classification          | `#BRO #insect` + image         | All users |
| `#animal`    | Force animal classification          | `#BRO #animal` + image         | All users |
| `#person`    | Force person classification          | `#BRO #person` + image         | All users |
| `#object`    | Force object classification          | `#BRO #object` + image         | All users |
| `#place`     | Force place classification           | `#BRO #place` + image          | All users |

### 🎤 **Voice Synthesis**

| Command   | Description                       | Example                               |
| --------- | --------------------------------- | ------------------------------------- |
| `#pierre` | Generate speech with Pierre voice | `#BRO #pierre Welcome to UPlanet`     |
| `#amelie` | Generate speech with Amélie voice | `#BRO #amelie Thank you for visiting` |

### 🔍 **Information & Media**

| Command    | Description            | Example                                         | Access    |
| ---------- | ---------------------- | ----------------------------------------------- | --------- |
| `#search`  | Web search             | `#BRO #search Latest AI developments`           | All users |
| `#youtube` | Download YouTube video | `#BRO #youtube https://youtube.com/watch?v=...` | All users |
| `#mp3`     | Convert YouTube to MP3 | `#BRO #youtube #mp3 https://youtube.com/...`    | All users |

### 🔐 **Privacy & Communication**

| Command      | Description                             | Example                                  | Access           |
| ------------ | --------------------------------------- | ---------------------------------------- | ---------------- |
| `#secret`    | Send private DM instead of public reply | `#BRO #secret Tell me something private` | All users        |
| `#secret #N` | Private DM with slot context            | `#BRO #secret #3 Private meeting notes`  | Sociétaires only |

## 🌳 **Complete Decision Tree**

### **#BRO / #BOT Processing Flow**

```
┌─────────────────────────────────────────────────────────────────────────────────┐
│                           UPlanet_IA_Responder.sh                               │
│                        Complete Decision Tree #BRO / #BOT                       │
└─────────────────────────────────────────────────────────────────────────────────┘

                              NOSTR Message Received
                                     │
                                     ▼
                        ┌────────────────────────┐
                        │  #BRO or #BOT present? │
                        └────────────────────────┘
                                     │
                    ┌────────────────┴────────────────┐
                   NO                                YES
                    │                                 │
                    ▼                                 ▼
               [IGNORED]                    ┌──────────────────┐
                                           │   Tag Analysis    │
                                           └──────────────────┘
                                                    │
        ┌───────────────────────────────────────────┼───────────────────────────────────────────┐
        │                                           │                                           │
        ▼                                           ▼                                           ▼
┌───────────────┐                         ┌─────────────────┐                         ┌─────────────────┐
│    MEMORY     │                         │   GENERATION    │                         │   UTILITIES     │
└───────────────┘                         └─────────────────┘                         └─────────────────┘
        │                                           │                                           │
        ├─► #reset                                  ├─► #search                                 ├─► #youtube
        │   ├─► #all → Reset slots 0-12            │   └─► Perplexica + AI                     │   └─► yt-dlp download
        │   ├─► #N → Reset slot N                  │       ├─► AI Summary                      │       ├─► #mp3 → audio
        │   └─► (default) → Reset slot 0           │       ├─► AI Tags                         │       └─► (default) → mp4
        │                                          │       ├─► AI Image                        │
        ├─► #mem                                   │       └─► Kind 30023 (blog)               ├─► #cookie
        │   ├─► #N → Display slot N               │                                            │   └─► Workflow engine
        │   └─► (default) → Display slot 0        ├─► #image                                   │
        │                                          │   └─► ComfyUI generate_image.sh           ├─► #pierre / #amelie
        └─► #rec2                                  │       └─► → IPFS URL                      │   └─► Orpheus TTS
            └─► Auto-save bot response            │                                            │       └─► → Audio URL
                in memory                          ├─► #video ─────────────────────┐           │
                                                   │                               │           └─► (default)
                                                   │   ┌───────────────────────────┤               └─► Ollama question.py
                                                   │   │                           │
                                                   │   ▼                           ▼
                                                   │ Image attached?          No image
                                                   │   │                           │
                                                   │   ▼                           ▼
                                                   │ image_to_video.sh      generate_video.sh
                                                   │ video_wan2_2_14B_i2v   video_wan2_2_5B_ti2v
                                                   │ Tags: #i2v             Tags: #t2v
                                                   │
                                                   ├─► #music
                                                   │   └─► ComfyUI generate_music.sh
                                                   │       └─► → IPFS Audio URL
                                                   │
                                                   ├─► #plantnet (+ image)
                                                   │   └─► PlantNet API
                                                   │       ├─► Recognition JSON
                                                   │       ├─► ORE integration
                                                   │       ├─► UMAP DID update
                                                   │       └─► Tags: #plantnet #UPlanet
                                                   │
                                                   └─► #inventory / #plant / #insect /
                                                       #animal / #person / #object / #place
                                                       └─► inventory_recognition.py
                                                           ├─► AI Type detection
                                                           ├─► ORE Contract (kind 30312)
                                                           ├─► Blog (kind 30023)
                                                           └─► Diversity tracker
```

### **Complete Tag Reference Table**

| Tag              | Function                            | Script/Service             | Output                    | Prerequisites        |
| ---------------- | ----------------------------------- | -------------------------- | ------------------------- | -------------------- |
| `#search`        | Perplexica web search + AI summary  | `perplexica_search.sh`     | Kind 30023 (blog article) | Perplexica           |
| `#image`         | Image generation (Stable Diffusion) | `generate_image.sh`        | IPFS URL                  | ComfyUI              |
| `#video`         | Text-to-Video (Wan2.2 5B)           | `generate_video.sh`        | IPFS URL                  | ComfyUI              |
| `#video` + image | Image-to-Video (Wan2.2 14B)         | `image_to_video.sh`        | IPFS URL                  | ComfyUI + image      |
| `#music`         | AI music generation                 | `generate_music.sh`        | IPFS URL                  | ComfyUI              |
| `#youtube`       | Video download (all platforms)      | `process_youtube.sh`       | IPFS URL                  | yt-dlp               |
| `#youtube #mp3`  | Audio extraction                    | `process_youtube.sh`       | IPFS MP3 URL              | yt-dlp + ffmpeg      |
| `#plantnet`      | Plant recognition                   | `plantnet_recognition.py`  | JSON + ORE                | PlantNet API + image |
| `#inventory`     | Multi-type classification (auto)    | `inventory_recognition.py` | ORE Contract              | Image                |
| `#plant`         | Force plant type                    | `inventory_recognition.py` | ORE Contract              | Image                |
| `#insect`        | Force insect type                   | `inventory_recognition.py` | ORE Contract              | Image                |
| `#animal`        | Force animal type                   | `inventory_recognition.py` | ORE Contract              | Image                |
| `#person`        | Force person type                   | `inventory_recognition.py` | ORE Contract              | Image                |
| `#object`        | Force object type                   | `inventory_recognition.py` | ORE Contract              | Image                |
| `#place`         | Force place type                    | `inventory_recognition.py` | ORE Contract              | Image                |
| `#pierre`        | Text-to-Speech (Pierre voice)       | `generate_speech.sh`       | IPFS Audio URL            | Orpheus TTS          |
| `#amelie`        | Text-to-Speech (Amélie voice)       | `generate_speech.sh`       | IPFS Audio URL            | Orpheus TTS          |
| `#mem`           | Display memory content              | -                          | Text                      | -                    |
| `#mem #N`        | Display slot N memory               | -                          | Text                      | Sociétaire (1-12)    |
| `#reset`         | Clear slot 0 memory                 | -                          | Confirmation              | -                    |
| `#reset #N`      | Clear slot N memory                 | -                          | Confirmation              | Sociétaire (1-12)    |
| `#reset #all`    | Clear all slots (0-12)              | -                          | Confirmation              | Sociétaire           |
| `#rec2`          | Auto-save bot response              | `short_memory.py`          | -                         | -                    |
| `#cookie`        | uDRIVE/Cookies delegation           | MiroFish / Dify            | Message uDRIVE path       | -                    |
| `#secret`        | Private DM response                 | NOSTR kind 4               | Encrypted DM              | -                    |
| `#N` (1-12)      | Use memory slot N                   | -                          | Context                   | Sociétaire           |
| (default)        | AI conversation                     | `question.py`              | Text response             | Ollama               |

### **Response Key Priority**

The bot uses different NOSTR keys depending on context:

| Priority | Key Type        | Used When                                         |
| -------- | --------------- | ------------------------------------------------- |
| 1        | **UMAP Key**    | `#plantnet` / `#inventory` (geolocated responses) |
| 2        | **USER Key**    | KNAME (email) available                           |
| 3        | **CAPTAIN Key** | Fallback when no user key                         |

### **Video Generation Workflows**

| Mode               | Trigger             | Workflow File               | Model      | Resolution | Frames |
| ------------------ | ------------------- | --------------------------- | ---------- | ---------- | ------ |
| **Text-to-Video**  | `#video` (no image) | `video_wan2_2_5B_ti2v.json` | Wan2.2 5B  | 640×480    | 121    |
| **Image-to-Video** | `#video` + image    | `video_wan2_2_14B_i2v.json` | Wan2.2 14B | 640×640    | 81     |

## 🏗️ **Technical Architecture**

### **Service Connection Management**

The UPlanet IA system uses a sophisticated connection management architecture that ensures all AI services are available before processing requests. This system is crucial for the bot's functionality and will evolve significantly in production.

#### **Current Architecture (Operational Swarm)**

* **Ollama** (Port 11434) - Core AI conversations
* **ComfyUI** (Port 8188) - Image/video/music generation
* **Perplexica** (Port 3002) - Web search
* **Orpheus TTS** (Port 5005) - Text-to-speech

#### **Connection Verification Process**

1. **Ollama verification** (mandatory) - Bot stops if unavailable
2. **Specialized service verification** (on-demand based on tags)
3. **Intelligent IPFS P2P Swarm** via `DRAGON_p2p_ssh.sh` (Priority)
4. **SSH tunnel fallback** to `scorpio.copylaradio.com` if P2P unavailable
5. **Error handling** with specific messages per service

#### **Swarm Architecture (DRAGON P2P)**

All services use **IPFS P2P connections** via the `DRAGON_p2p_ssh.sh` system:

* **Intelligent Port Selection** - Automatic detection of native vs. alternative ports
* **Decentralized discovery** - Each node publishes available services
* **Load balancing** - Automatic selection of best available node
* **Resilience** - No single point of failure
* **Security** - End-to-end encrypted P2P connections

### **SECTOR G1 opportunities (ASTROBOT)**

The **g1\_opportunities.py** script (triggered by the SECTOR key in `NOSTR.UMAP.refresh.sh`) fetches Ğchange offers around a sector’s center and uses **question.py** (Ollama) to identify value-creation opportunities. The result is:

* **Saved** to `~/.zen/tmp/${IPFSNODEID}/UPLANET/SECTORS/_${rlat}_${rlon}/_${slat}_${slon}/g1_opportunities.md`
* **Emailed** to the captain via **mailjet.sh** (subject: "G1 opportunities SECTOR \_slat\_slon")
* **Published** as a NOSTR kind 30023 article on the **SECTOR’s Nostr identity** (tag `t: G1opportunities`, identifier `sector-G1opportunities-${sector}-${TODATE}`)

Diffusion (mailjet + kind 30023) runs only when this station is the **closest** to the sector (`is_closest_station`). The trigger is in **NOSTR.UMAP.refresh.sh** (not UPLANET.refresh.sh) because SECTORs are defined and iterated there, and G1 opportunities are SECTOR-scoped content on the same Nostr identity and captain logic.

### **File Structure**

```
~/.zen/flashmem/
├── {user_email}/
│   ├── slot0.json      # General conversations
│   ├── slot1.json      # Work discussions
│   ├── slot2.json      # Personal projects
│   └── ...
└── uplanet_memory/     # Legacy coordinate-based memory
    ├── {coord_key}.json
    └── pubkey/
        └── {pubkey}.json
```

### **Memory File Format**

```json
{
  "user_id": "user@example.com",
  "slot": 3,
  "messages": [
    {
      "timestamp": "2024-01-01T12:00:00Z",
      "event_id": "event123",
      "latitude": "48.86",
      "longitude": "2.22",
      "content": "Meeting notes: Discussed Q4 goals"
    }
  ]
}
```

### **AI Context Loading**

* **Slot-based context**: Last 20 messages from specified slot
* **Fallback**: Legacy pubkey or coordinate-based memory
* **Token optimization**: Limits context to prevent AI token overflow

## 🧠 **Memory System Deep Dive**

### Why 12 Slots?

The 12-slot system allows you to organize conversations by context:

* **Slot 0**: General conversations (default) - **All users**
* **Slot 1**: Work/Professional discussions - **Sociétaires only**
* **Slot 2**: Personal projects - **Sociétaires only**
* **Slot 3**: Meeting notes - **Sociétaires only**
* **Slot 4**: Creative ideas - **Sociétaires only**
* **Slot 5**: Personal reminders - **Sociétaires only**
* **Slot 6**: Technical discussions - **Sociétaires only**
* **Slot 7**: Learning topics - **Sociétaires only**
* **Slot 8**: Travel plans - **Sociétaires only**
* **Slot 9**: Health & wellness - **Sociétaires only**
* **Slot 10**: Financial planning - **Sociétaires only**
* **Slot 11**: Family matters - **Sociétaires only**
* **Slot 12**: Hobbies & interests - **Sociétaires only**

### Memory Recording Types

#### `#rec` vs `#rec2`

* **`#rec`**: Records only the user's message in memory

  ```
  User: #BRO #rec #3 Meeting notes: Discussed Q4 goals
  Bot: Here's a summary of your meeting...
  → Only "Meeting notes: Discussed Q4 goals" is stored in slot 3
  ```
* **`#rec2`**: Automatically records the bot's response in memory

  ```
  User: #BRO #rec2 #3 What were our Q4 goals?
  Bot: Based on our previous discussion, your Q4 goals are...
  → The bot's response is automatically stored in slot 3
  ```

#### **Combined Usage**

```
#rec #3 Meeting notes: Discussed Q4 goals
#BRO #rec2 #3 What were our action items?
#mem #3 Show me both the notes and the bot's response
```

## 🎯 **Best Practices**

### 1. **Organize by Context**

* Use consistent slots for similar topics
* Keep work and personal conversations separate
* Use slot 0 for general chit-chat

### 2. **Effective Memory Usage**

* Record important information immediately with `#rec`
* Use descriptive content for better AI context
* Review memory regularly with `#mem`

### 3. **AI Generation Tips**

* Be specific in your descriptions
* Combine commands: `#BRO #3 #image A modern office space`
* Use context: `#BRO #4 Based on our previous discussion, generate...`

### 4. **Memory Management**

* Reset slots when starting new projects
* Use `#reset #all` sparingly
* Keep important memories in dedicated slots

## 🌍 **Geolocation Integration**

The bot integrates with UPlanet's geolocation system:

* **Location-aware**: Memories are tied to GPS coordinates
* **Local context**: AI can reference location-specific information
* **Community memory**: Shared memories at specific locations

## 🔒 **Privacy & Security**

* **User isolation**: Each user's memory is completely separate
* **Local storage**: All memory files stored locally
* **No cloud sync**: Your conversations stay private
* **Optional sharing**: Choose what to share with the community
* **Access control**: Slots 1-12 protected for CopyLaRadio sociétaires
* **Secure verification**: User status verified via `~/.zen/game/players/` directory
* **Private messaging**: `#secret` tag enables encrypted NOSTR direct messages
* **Event filtering**: Secret messages are rejected from public relay storage

## 🚀 **Advanced Features**

### **Combined Commands**

```
#BRO #3 #image A dashboard based on our meeting requirements
#BOT #5 #music #parole A song about my personal goals
#BRO #search #1 Latest developments in AI for business
```

### **Context Switching**

```
#rec #1 Work meeting about project timeline
#rec #5 Personal: Need to buy groceries
#BRO #1 What's our project deadline?
#BRO #5 What was I supposed to buy?
```

### **Creative Workflows**

```
#rec #4 Art project: Abstract painting series
#BRO #4 #image An abstract painting with blue and gold
#BRO #4 #music Ambient music for the art gallery
#BRO #4 #video A timelapse of the painting process
```

### **Video Generation (Text-to-Video vs Image-to-Video)**

```
# Text-to-Video (no image attached) - Uses Wan2.2 5B
#BRO #video A dragon flying over a mountain at sunset

# Image-to-Video (with image attached) - Uses Wan2.2 14B
#BRO #video The character slowly turns their head toward the camera
[attach your source image]
```

### **Plant Recognition & Biodiversity**

```
# Recognize a plant (attach plant photo)
#BRO #plantnet
→ Returns: Scientific name, common names, confidence score, Wikipedia link
→ Creates: ORE biodiversity record, UMAP DID update

# Multi-type inventory (auto-detect type)
#BRO #inventory
→ Auto-detects: plant, insect, animal, person, object, or place
→ Creates: ORE maintenance contract (kind 30312) + blog (kind 30023)

# Force specific type classification
#BRO #insect    # Force insect classification
#BRO #animal    # Force animal classification
#BRO #object    # Force object classification
#BRO #place     # Force place/location classification
```

### **Private Communication**

```
#BRO #secret Can you help me with a personal matter?
#BRO #secret #3 Private meeting notes for tomorrow
#BRO #secret #5 Personal reminder about doctor appointment
```

## 🎉 **Why This System is Amazing**

### **1. Unprecedented Context Management**

* **600 total messages** across 12 slots
* **Instant context switching** between topics
* **Persistent memory** across sessions

### **2. Multi-Modal AI Integration**

* **Text, image, video, audio** generation
* **Seamless workflow** between different AI models
* **Context-aware generation** based on conversation history

### **3. Real-World Practicality**

* **Work organization**: Separate slots for different projects
* **Personal management**: Health, finance, family in dedicated slots
* **Creative projects**: Track ideas and generate related content

### **4. Geolocation Intelligence**

* **Location-aware conversations**
* **Community memory** at specific places
* **Local context** for better AI responses

### **5. Privacy-First Design**

* **Local storage** of all memories
* **User isolation** for complete privacy
* **No cloud dependencies**
* **Encrypted private messaging** via NOSTR direct messages
* **Event filtering** prevents secret messages from public storage

## 🔐 **Private Messaging with #secret**

### How It Works

The `#secret` tag enables completely private communication between you and the UPlanet IA Bot:

* **Encrypted delivery**: Messages are sent as NOSTR kind 4 (encrypted direct messages)
* **Private storage**: Secret messages are not stored on public relays
* **User verification**: Uses your NOSTR email (KNAME) for secure delivery
* **Memory integration**: Works with all memory slots and AI generation features

### Usage Examples

#### **Basic Private Communication**

```
#BRO #secret Can you help me with a personal matter?
#BOT #secret Tell me something private about AI
```

#### **Private Memory Operations**

```
#rec #secret #3 Private meeting notes for tomorrow
#mem #secret #5 Show my personal reminders privately
#reset #secret #3 Clear private meeting memory
```

#### **Private AI Generation**

```
#BRO #secret #image A private logo design for my startup
#BOT #secret #music A personal theme song
#BRO #secret #search Private research on sensitive topic
```

### Technical Details

#### **NOSTR Integration**

* **Encryption**: Uses NIP-44 encryption for enhanced message privacy
* **Key management**: Automatically retrieves user's hex key from `~/.zen/game/nostr/{KNAME}/HEX`
* **Relay handling**: Sends via configured NOSTR relay with proper error handling
* **Event filtering**: Secret messages return exit code 1 to prevent relay storage

#### **Memory Handling**

* **Auto-recording**: `#rec2` works with secret messages using unique event IDs
* **Context preservation**: Slot-based memory maintains conversation context
* **Error suppression**: Public error messages are suppressed in secret mode

#### **Security Features**

* **No public trace**: Secret messages never appear in public feeds
* **Encrypted content**: All message content is encrypted end-to-end
* **User verification**: Requires valid NOSTR email and hex key
* **Graceful fallback**: Handles missing keys or relay issues gracefully

### Privacy Benefits

1. **Complete confidentiality**: Your private conversations stay private
2. **No public record**: Secret messages don't appear in public UPlanet feeds
3. **Encrypted delivery**: All communication is encrypted using NOSTR standards
4. **Memory privacy**: Private conversations can still use the memory system
5. **AI privacy**: Generate content privately without public exposure

### Best Practices

* **Use for sensitive topics**: Personal matters, confidential work, private ideas
* **Combine with memory slots**: `#secret #3` for private work discussions
* **Maintain context**: Use `#rec2` to automatically save private conversations
* **Verify delivery**: Check your NOSTR client for received messages
* **Respect others**: Only use for legitimate private communication

## 🛠️ **Troubleshooting**

### Common Issues

**Memory not found**

* Check if you're using the correct slot number
* Verify the user ID (email) is correct
* Ensure the memory file exists

**Access denied to slots 1-12**

* Verify you are a CopyLaRadio sociétaire with ZenCard
* Check if your directory exists in `~/.zen/game/players/`
* Use slot 0 for general conversations (accessible to all users)
* Contact CopyLaRadio to become a sociétaire

**AI generation fails**

* Check if required services are running (ComfyUI, Ollama)
* Verify internet connection for web search
* Ensure proper command syntax

**Reset not working**

* Confirm you're using the correct slot number
* Check file permissions in `~/.zen/flashmem/`
* Verify the user directory exists

**Secret messages not received**

* Verify your NOSTR email (KNAME) is correctly set
* Check if your hex key exists in `~/.zen/game/nostr/{KNAME}/HEX`
* Ensure your NOSTR client is configured to receive direct messages
* Verify the relay connection in `~/.zen/Astroport.ONE/tools/my.sh`

### Getting Help

1. Check the logs: `~/.zen/tmp/IA.log`
2. Verify service status: `./ollama.me.sh`
3. Test individual components: `./test_slot_memory.sh`

## 🎯 **Getting Started Checklist**

* [ ] Send your first message: `#BRO Hello!`
* [ ] Record something: `#rec My first memory` (slot 0)
* [ ] View memory: `#mem`
* [ ] Generate content: `#BRO #image A beautiful landscape`
* [ ] Search web: `#BRO #search Latest technology news`
* [ ] Create music: `#BRO #music A relaxing melody`

**For Sociétaires (slots 1-12):**

* [ ] Record in specific slot: `#rec #3 Meeting notes`
* [ ] View slot memory: `#mem #3`
* [ ] Use context for AI: `#BRO #3 #image Dashboard design`
* [ ] Reset specific slot: `#reset #3`

**For Private Communication:**

* [ ] Send private message: `#BRO #secret Hello, this is private`
* [ ] Private memory operation: `#rec #secret #3 Private notes`
* [ ] Private AI generation: `#BRO #secret #image Private design`
* [ ] Verify NOSTR client receives direct messages

## 📚 **Technical Documentation**

### **Connection Management Architecture**

For detailed information about how the IA system manages service connections, see:

* [**Connection Management Diagram**](/astroport.one/ia/connection_management_diagram.md) - Complete technical overview of service connection management, verification processes, and the migration to IPFS P2P architecture

### **Related Documentation**

* [**Astroport.ONE Main README**](/astroport.one/readme.md) - Overview of the entire UPlanet ecosystem
* [**Architecture Documentation**](/astroport.one/architecture.md) - Technical system architecture
* [**Legal Framework**](/astroport.one/legal.md) - Cooperative legal structure
* [**🍪 Cookie Management System**](/astroport.one/docs/reference/cookie_system.md) - Universal cookie upload and storage system for authenticated web scraping
* [**🔧 Domain Scrapers**](/astroport.one/docs/reference/domain_scrapers.md) - Guide to creating custom domain-specific scrapers

***

**Welcome to the future of contextual AI conversations!** 🚀

The UPlanet IA Bot System combines the power of multiple AI models with intelligent memory management to create a truly personalized and contextually aware assistant. Whether you're managing work projects, pursuing creative endeavors, or just having a conversation, the 12-slot memory system ensures that your AI assistant always remembers what matters to you.


---

# Agent Instructions: Querying This Documentation

If you need additional information that is not directly available in this page, you can query the documentation dynamically by asking a question.

Perform an HTTP GET request on the current page URL with the `ask` query parameter:

```
GET https://astroport-1.gitbook.io/astroport.one/ia.md?ask=<question>
```

The question should be specific, self-contained, and written in natural language.
The response will contain a direct answer to the question and relevant excerpts and sources from the documentation.

Use this mechanism when the answer is not explicitly present in the current page, you need clarification or additional context, or you want to retrieve related documentation sections.