unstructured

Unstructured provides open-source libraries and APIs to ingest and prep messy, unstructured data for RAG and LLM applications.

Unstructured automates the extraction of text and metadata from over 25 file types, including PDFs, PowerPoint decks, and HTML. By utilizing specialized ML models to identify document elements like tables and headers, the platform transforms raw files into clean, machine-readable JSON. This pipeline bridges the gap between static enterprise data and vector databases like Pinecone or Weaviate, ensuring high-quality retrieval for production-grade AI.

https://unstructured.io