chronogrid/docs/WORKFLOWS/02-ingestion-pipeline.md

1.2 KiB

Ingestion & Local Automation Pipeline

1. Direct TLS IMAP Engine

  • Embedded within crates/chronogrid_core (Rust native).
  • Connects directly over TLS to user-configured mailboxes (Personal Gmail, M365 Exchange, Custom IMAP).
  • Polls for flagged emails or direct forwards to internal local parse addresses.
  • Extracts message body to Markdown, preserves message thread headers (In-Reply-To, Message-ID), and creates linked tasks.

2. Native Quick Jots & Trigger Integrations

  • Windows / Linux: System-wide global hotkey listener invokes a lightweight FFI command overlay.
  • Android: Home-screen widget and Share-Intent listener push text, links, or audio payloads directly to the local ingestion buffer.

3. Embedded AI Processing Architecture

  • Inference Engine: Embedded ONNX Runtime / local LLM socket (Ollama).
  • Parsing Pipelines:
    1. Namespace Classifier: Determines destination space (Personal, Engineering, Creations).
    2. Metadata & NLP Extractor: Identifies natural language dates ("by 3pm tomorrow"), converts them to ISO timestamps, and estimates task duration.
    3. Note-Task Splitter: Separates long-form reference text into linked project notes while distilling actionable items into tasks.