This page is a reference table for resources I’m keeping tabs on.
That grand, spacious (and long ignored) branch of computing that, these days, deals not just with thinking machines (so-called “hard” AI), but mostly with enhancing the usefulness of machines in general by exploring mechanisms to express and manipulate harvested knowledge.
Or just pretty pictures and weird chatbots.
Resources
Field | Category | Date | Link | Notes |
---|---|---|---|---|
General | Frameworks | 2023-05 | marvin | A generic wrapper for various AI APIs |
Jupyter | 2023-04 | jupyter-ai | an official Jupyter plugin that can handle multiple AI back-ends (although it seems less flexible than the others right now) |
|
Libraries | 2023-06 | unstructured | a library for handling and segmenting unstructured data of various kinds, from text to common file formats |
|
2023-03 | ml-ane-transformers | Apple’s transformers library, optimized for the Neural Engine |
||
2009-06 | Alchemy | A toolkit providing a series of algorithms for statistical relational learning and probabilistic logic inference, based on Markov logic representation |
||
Techniques | 2022-12 | awesome-chatgpt-prompts | might be a short-lived resource, but an interesting one |
|
Tools | 2023-05 | explainerdashboard | a web app that explains the workings of a (scikit-learn compatible) machine learning model |
|
2023-04 | basaran | An Open-Source alternative to the OpenAI text completion API, with a compatible streaming API for privately hosted models. |
||
2023-03 | NVIDIA Triton Inference Server | A high-performance inference server |
||
2022-12 | Project Bumblebee | Pre-trained and transformer neural models in Elixir. |
||
Generative Audio | models | 2023-04 | bark | a text-prompted genereative audio model |
Large Language Models | 2023-09 | instructor | a clever library that simplifies invoking OpenAI function calls |
|
Applications | 2023-07 | Chie | A cross-platform dekstop application with chat history and extension support |
|
Copilots | 2023-06 | Obsidian Copilot | an interesting take on how to use semantic search and OpenSearch’s BM25 implementation |
|
Frameworks | 2023-07 | litellm | a simple, lightweight LLM wrapper |
|
AutoChain | Yet another alternative to langchain |
|||
griptape | a |
|||
llama_index | a data framework for LLM applications |
|||
txtai | has spinoffs for chat, workflows for medical/scientific papers, semantic search for developers and semantic search for headlines and story text |
|||
llmflows | Yet another alternative to langchain, but with an interesting approach at defining workflows |
|||
2023-05 | langchain | a composable approach for building LLM applications |
||
guidance | Control modern language models more effectively and efficiently than traditional prompting or chaining. |
|||
Jupyter | 2023-04 | LLMBook | A VS Code notebook interface for LLMs |
|
jupytee | a Jupyter plugin that can handle code generation and image generation, but not switching models (GPT-4) |
|||
genai | a Jupyter plugin that can handle code generation and fixes based on tracebacks |
|||
ipython-gpt | a Jupyter plugin that can handle multiple models |
|||
Libraries | 2023-06 | simpleaichat | A simple wrapper for the ChatGPT AI |
|
2023-05 | guardrails | a package for validating and correcting the outputs of large language models |
||
Models | 2023-04 | turbopilot | a GitHub CoPilot replacement that can run locally (CPU only) |
|
Reference | 2023-03 | Using LLaMA with M1 Mac | Manual instructions for Apple Silicon |
|
Resources | 2023-04 | awesome-decentralized-llm | a collection of LLM resources that operate independently |
|
Tools | 2023-09 | embedchain | another framework to create bots from existing datasets |
|
llm_agents | a simplified agent framework (doesn’t use OpenAI functions) |
|||
2023-08 | pykoi | a unified interface for data and feedback collection, including model comparisons |
||
PromptTools | self-hostable toools for evaluating LLMs, vector databases, and prompts |
|||
2023-07 | a1gpt | A C++ implementation of a GPT-2 inference engine |
||
khoj | an intriguing personal assistant based on local data |
|||
promptfoo | A tool for testing and evaluating LLM prompt quality. |
|||
2023-06 | SuperAGI | another AutoGPT-like harness for building GPT agents |
||
2023-05 | ChainForge | a visual programming environment for benchmarking prompts across multiple LLMs |
||
langflow | a node-based GUI for quick iteration of langchain flows |
|||
2023-04 | Auto-GPT | an attempt to provide ChatGPT with a degree of autonomy |
||
2023-03 | dalai | An automated installer for LLaMA |
||
llama.cpp | A C++ port of Facebook’s LLaMA model. Still requires roughly 240GB of (unoptimized) weights, but can run on a 64GB Mac. |
|||
minillm | A GPU-focused Python wrapper for LLaMa |
|||
simple-llama-finetuner | A way to do LoRA adaptation of LLaMa |
|||
chatbot-ui | a more or less sensibly designed self-hosted ChatGPT UI |
|||
content-chatbot | A way to quickly create custom embeddings off a web site |
|||
chatblade | a CLI wrapper for ChatGPT |
|||
GPTQ-for-LLaMa | a way to quantize the LLaMA weights to 4-bit |
|||
llama-rs | A Rust port of llama.cpp |
|||
alpaca-lora | Another way to do LoRA adaptation of LLaMa |
|||
Vector Databases | 2023-08 | vectordb | A simple vector database that can run in-process |
|
marqo | A vector database that performs vector generation internally |
|||
2023-07 | chroma | an embedding database |
||
USearch | A Single-File Vector Search Engine |
|||
Workflows | danswer | a pretty complete GPT/search integration solution with GitHub, Slack and Confluence/JIRA connectors |
||
NeRFs | Tools | 2022-12 | nerfstudio | A tool for manipulating Neural Radiance Fields (NeRF) and rendering the scenes out as video |
Speech Recognition | Models | whisper | a general purpose speech recognition model |
|
2022-02 | whisper.cpp | a C++ implementation of whisper that can run in consumer hardware |
||
Stable Diffusion | Apps | 2023-03 | swift-coreml-diffusers | Hugging face’s own app, using Swift and CoreML for Apple Silicon |
2022-11 | Draw Things | Pre-packaged app for iOS, downloads and allows re-use of .ckpt files. |
||
DiffusionBee | Pre-packaged app for macOS (M1 and Intel) |
|||
CGI | 2023-03 | Blender-ControlNet | A Blender plugin to generate ControlNet inputs for posing figures |
|
2022-12 | dream-textures | A Blender plugin for texturing models based on a text description. |
||
Models | 2023-03 | Upscale Model Database | Too wide a choice, perhaps |
|
2022-12 | Fast Stable Diffusion | Another tactic to accelerate inference |
||
CoreML Stable Diffusion | Apple’s optimizations for CoreML |
|||
Tools | 2023-08 | stable-diffusion.cpp | stable diffusion inference on the CPU, in pure C++ |
|
Opendream | A layer-oriented, non-destructive editor |
|||
2023-03 | ComfyUI | pretty impressive node-based UI |
||
InvokeAI | A polished UI |
|||
2022-11 | imaginAIry | Works well on Apple Silicon, pure CLI interface to all SD models. Does not reuse .ckpt files, however, so requires separate disk cache. |
||
2022-08 | Stable Diffusion WebUI | Nearly always the best, bleeding edge WebUI for SD |