How to Ingest a Source

Adding a new source to the wiki. The LLM reads it, discusses key takeaways with you, then writes and updates pages.

Ways to Trigger

Option 1 — Direct URL

ingest https://www.elastic.co/docs/get-started/the-stack

Option 2 — Drop a file Place any file in ingest/ then say:

ingest anything new in ingest/

Option 3 — .url file Create a plain text file in ingest/ containing just the URL:

# ingest/elastic-docs.url
https://www.elastic.co/docs/get-started/the-stack

Then say: ingest anything new in ingest/

Option 4 — PDF or document Drop my-book-chapter-3.pdf into ingest/, then:

ingest ingest/my-book-chapter-3.pdf

For large PDFs, add: process it chapter by chapter and wait for my confirmation between each

What Happens

1. Agent fetches/reads the source fully
2. Agent discusses 2–3 key takeaways with you — you can redirect emphasis or skip topics
3. You respond (e.g. “focus on the architecture section, skip the installation steps”)
4. Agent writes/updates wiki pages
5. Agent updates index.md and appends to log.md
6. Source is saved to sources/

Example Session

You:    ingest https://www.elastic.co/docs/get-started/the-stack

Agent:  Key takeaways before I write anything:
        1. Elastic Stack = Elasticsearch + Kibana core, with optional ingest layer
        2. Elastic Agent replaces Beats as the unified data shipper
        3. All components must use the same version

        Anything to emphasize or skip?

You:    Focus on the component roles, skip the installation order.

Agent:  [creates/updates pages, updates index.md, logs it]
        Done. Created: elastic-stack overview, elasticsearch, kibana, elastic-agent.
        Updated: index.md, log.md

Tips

• Ingest one source at a time and stay involved — you guide what gets emphasized
• For a book: ingest chapter by chapter rather than all at once for better quality
• Check sources/ first — never ingest the same source twice
• After ingesting, browse the result in Obsidian to check what the agent wrote

See Also

• query-the-wiki — querying after ingesting
• lint-the-wiki — keeping the wiki healthy
• llm-wiki-pattern — the full pattern