Rui CarmoThis page is a reference table for resources I’m keeping tabs on.
That grand, spacious (and long ignored) branch of computing that, these days, deals not just with thinking machines (so-called “hard” AI), but mostly with enhancing the usefulness of machines in general by exploring mechanisms to express and manipulate harvested knowledge.
Or just pretty pictures and weird chatbots.
Resources
| Field | Category | Date | Link | Notes |
|---|---|---|---|---|
| General | Frameworks | 2023-05 | marvin | A generic wrapper for various AI APIs |
| Jupyter | 2023-04 | jupyter-ai | an official Jupyter plugin that can handle multiple AI back-ends (although it seems less flexible than the others right now) |
|
| Libraries | 2023-06 | unstructured | a library for handling and segmenting unstructured data of various kinds, from text to common file formats |
|
| 2023-03 | ml-ane-transformers | Apple’s transformers library, optimized for the Neural Engine |
||
| 2009-06 | Alchemy | A toolkit providing a series of algorithms for statistical relational learning and probabilistic logic inference, based on Markov logic representation |
||
| Techniques | 2022-12 | awesome-chatgpt-prompts | might be a short-lived resource, but an interesting one |
|
| Tools | 2023-05 | explainerdashboard | a web app that explains the workings of a (scikit-learn compatible) machine learning model |
|
| 2023-04 | basaran | An Open-Source alternative to the OpenAI text completion API, with a compatible streaming API for privately hosted models. |
||
| 2023-03 | NVIDIA Triton Inference Server | A high-performance inference server |
||
| 2022-12 | Project Bumblebee | Pre-trained and transformer neural models in Elixir. |
||
| Generative Audio | models | 2023-04 | bark | a text-prompted genereative audio model |
| Large Language Models | 2023-09 | instructor | a clever library that simplifies invoking OpenAI function calls |
|
| Applications | 2023-07 | Chie | A cross-platform dekstop application with chat history and extension support |
|
| Copilots | 2023-06 | Obsidian Copilot | an interesting take on how to use semantic search and OpenSearch’s BM25 implementation |
|
| Frameworks | 2023-07 | litellm | a simple, lightweight LLM wrapper |
|
| AutoChain | Yet another alternative to langchain |
|||
| griptape | a |
|||
| llama_index | a data framework for LLM applications |
|||
| txtai | has spinoffs for chat, workflows for medical/scientific papers, semantic search for developers and semantic search for headlines and story text |
|||
| llmflows | Yet another alternative to langchain, but with an interesting approach at defining workflows |
|||
| 2023-05 | langchain | a composable approach for building LLM applications |
||
| guidance | Control modern language models more effectively and efficiently than traditional prompting or chaining. |
|||
| Jupyter | 2023-04 | LLMBook | A VS Code notebook interface for LLMs |
|
| jupytee | a Jupyter plugin that can handle code generation and image generation, but not switching models (GPT-4) |
|||
| genai | a Jupyter plugin that can handle code generation and fixes based on tracebacks |
|||
| ipython-gpt | a Jupyter plugin that can handle multiple models |
|||
| Libraries | 2023-06 | simpleaichat | A simple wrapper for the ChatGPT AI |
|
| 2023-05 | guardrails | a package for validating and correcting the outputs of large language models |
||
| Models | 2023-04 | turbopilot | a GitHub CoPilot replacement that can run locally (CPU only) |
|
| Reference | 2023-03 | Using LLaMA with M1 Mac | Manual instructions for Apple Silicon |
|
| Resources | 2023-04 | awesome-decentralized-llm | a collection of LLM resources that operate independently |
|
| Tools | 2023-09 | embedchain | another framework to create bots from existing datasets |
|
| llm_agents | a simplified agent framework (doesn’t use OpenAI functions) |
|||
| 2023-08 | pykoi | a unified interface for data and feedback collection, including model comparisons |
||
| PromptTools | self-hostable toools for evaluating LLMs, vector databases, and prompts |
|||
| 2023-07 | a1gpt | A C++ implementation of a GPT-2 inference engine |
||
| khoj | an intriguing personal assistant based on local data |
|||
| promptfoo | A tool for testing and evaluating LLM prompt quality. |
|||
| 2023-06 | SuperAGI | another AutoGPT-like harness for building GPT agents |
||
| 2023-05 | ChainForge | a visual programming environment for benchmarking prompts across multiple LLMs |
||
| langflow | a node-based GUI for quick iteration of langchain flows |
|||
| 2023-04 | Auto-GPT | an attempt to provide ChatGPT with a degree of autonomy |
||
| 2023-03 | dalai | An automated installer for LLaMA |
||
| llama.cpp | A C++ port of Facebook’s LLaMA model. Still requires roughly 240GB of (unoptimized) weights, but can run on a 64GB Mac. |
|||
| minillm | A GPU-focused Python wrapper for LLaMa |
|||
| simple-llama-finetuner | A way to do LoRA adaptation of LLaMa |
|||
| chatbot-ui | a more or less sensibly designed self-hosted ChatGPT UI |
|||
| content-chatbot | A way to quickly create custom embeddings off a web site |
|||
| chatblade | a CLI wrapper for ChatGPT |
|||
| GPTQ-for-LLaMa | a way to quantize the LLaMA weights to 4-bit |
|||
| llama-rs | A Rust port of llama.cpp |
|||
| alpaca-lora | Another way to do LoRA adaptation of LLaMa |
|||
| Vector Databases | 2023-08 | vectordb | A simple vector database that can run in-process |
|
| marqo | A vector database that performs vector generation internally |
|||
| 2023-07 | chroma | an embedding database |
||
| USearch | A Single-File Vector Search Engine |
|||
| Workflows | danswer | a pretty complete GPT/search integration solution with GitHub, Slack and Confluence/JIRA connectors |
||
| NeRFs | Tools | 2022-12 | nerfstudio | A tool for manipulating Neural Radiance Fields (NeRF) and rendering the scenes out as video |
| Speech Recognition | Models | whisper | a general purpose speech recognition model |
|
| 2022-02 | whisper.cpp | a C++ implementation of whisper that can run in consumer hardware |
||
| Stable Diffusion | Apps | 2023-03 | swift-coreml-diffusers | Hugging face’s own app, using Swift and CoreML for Apple Silicon |
| 2022-11 | Draw Things | Pre-packaged app for iOS, downloads and allows re-use of .ckpt files. |
||
| DiffusionBee | Pre-packaged app for macOS (M1 and Intel) |
|||
| CGI | 2023-03 | Blender-ControlNet | A Blender plugin to generate ControlNet inputs for posing figures |
|
| 2022-12 | dream-textures | A Blender plugin for texturing models based on a text description. |
||
| Models | 2023-03 | Upscale Model Database | Too wide a choice, perhaps |
|
| 2022-12 | Fast Stable Diffusion | Another tactic to accelerate inference |
||
| CoreML Stable Diffusion | Apple’s optimizations for CoreML |
|||
| Tools | 2023-08 | stable-diffusion.cpp | stable diffusion inference on the CPU, in pure C++ |
|
| Opendream | A layer-oriented, non-destructive editor |
|||
| 2023-03 | ComfyUI | pretty impressive node-based UI |
||
| InvokeAI | A polished UI |
|||
| 2022-11 | imaginAIry | Works well on Apple Silicon, pure CLI interface to all SD models. Does not reuse .ckpt files, however, so requires separate disk cache. |
||
| 2022-08 | Stable Diffusion WebUI | Nearly always the best, bleeding edge WebUI for SD |