This page is a reference table for resources I’m keeping tabs on.
That grand, spacious (and long ignored) branch of computing that, these days, deals not just with thinking machines (so-called “hard” AI), but mostly with enhancing the usefulness of machines in general by exploring mechanisms to express and manipulate harvested knowledge.
Or just pretty pictures and weird chatbots.
Resources
Field | Category | Date | Link | Notes |
---|---|---|---|---|
General | Frameworks | 2023-05 | marvin | A generic wrapper for various AI APIs |
Jupyter | 2023-04 | jupyter-ai | an official Jupyter plugin that can handle multiple AI back-ends (although it seems less flexible than the others right now) |
|
Libraries | 2023-03 | ml-ane-transformers | Apple’s transformers library, optimized for the Neural Engine |
|
2009-06 | Alchemy | A toolkit providing a series of algorithms for statistical relational learning and probabilistic logic inference, based on Markov logic representation |
||
Techniques | 2022-12 | awesome-chatgpt-prompts | might be a short-lived resource, but an interesting one |
|
Tools | 2023-05 | explainerdashboard | a web app that explains the workings of a (scikit-learn compatible) machine learning model |
|
2023-04 | basaran | An Open-Source alternative to the OpenAI text completion API, with a compatible streaming API for privately hosted models. |
||
2023-03 | NVIDIA Triton Inference Server | A high-performance inference server |
||
2022-12 | Project Bumblebee | Pre-trained and transformer neural models in Elixir. |
||
Generative Audio | models | 2023-04 | bark | a text-prompted genereative audio model |
Large Language Models | Frameworks | 2023-05 | langchain | a composable approach for building LLM applications |
guidance | Control modern language models more effectively and efficiently than traditional prompting or chaining. |
|||
Jupyter | 2023-04 | LLMBook | A VS Code notebook interface for LLMs |
|
jupytee | a Jupyter plugin that can handle code generation and image generation, but not switching models (GPT-4) |
|||
genai | a Jupyter plugin that can handle code generation and fixes based on tracebacks |
|||
ipython-gpt | a Jupyter plugin that can handle multiple models |
|||
Libraries | 2023-05 | guardrails | a package for validating and correcting the outputs of large language models |
|
Models | 2023-04 | turbopilot | a GitHub CoPilot replacement that can run locally (CPU only) |
|
Reference | 2023-03 | Using LLaMA with M1 Mac | Manual instructions for Apple Silicon |
|
Resources | 2023-04 | awesome-decentralized-llm | a collection of LLM resources that operate independently |
|
Tools | 2023-05 | ChainForge | a visual programming environment for benchmarking prompts across multiple LLMs |
|
langflow | a node-based GUI for quick iteration of langchain flows |
|||
2023-04 | Auto-GPT | an attempt to provide ChatGPT with a degree of autonomy |
||
2023-03 | dalai | An automated installer for LLaMA |
||
llama.cpp | A C++ port of Facebook’s LLaMA model. Still requires roughly 240GB of (unoptimized) weights, but can run on a 64GB Mac. |
|||
minillm | A GPU-focused Python wrapper for LLaMa |
|||
simple-llama-finetuner | A way to do LoRA adaptation of LLaMa |
|||
chatbot-ui | a more or less sensibly designed self-hosted ChatGPT UI |
|||
content-chatbot | A way to quickly create custom embeddings off a web site |
|||
chatblade | a CLI wrapper for ChatGPT |
|||
GPTQ-for-LLaMa | a way to quantize the LLaMA weights to 4-bit |
|||
llama-rs | A Rust port of llama.cpp |
|||
alpaca-lora | Another way to do LoRA adaptation of LLaMa |
|||
NeRFs | 2022-12 | nerfstudio | A tool for manipulating Neural Radiance Fields (NeRF) and rendering the scenes out as video |
|
Speech Recognition | Models | whisper | a general purpose speech recognition model |
|
2022-02 | whisper.cpp | a C++ implementation of whisper that can run in consumer hardware |
||
Stable Diffusion | Apps | 2023-03 | swift-coreml-diffusers | Hugging face’s own app, using Swift and CoreML for Apple Silicon |
2022-11 | Draw Things | Pre-packaged app for iOS, downloads and allows re-use of .ckpt files. |
||
DiffusionBee | Pre-packaged app for macOS (M1 and Intel) |
|||
CGI | 2023-03 | Blender-ControlNet | A Blender plugin to generate ControlNet inputs for posing figures |
|
2022-12 | dream-textures | A Blender plugin for texturing models based on a text description. |
||
Models | 2023-03 | Upscale Model Database | Too wide a choice, perhaps |
|
2022-12 | Fast Stable Diffusion | Another tactic to accelerate inference |
||
CoreML Stable Diffusion | Apple’s optimizations for CoreML |
|||
Tools | 2023-03 | ComfyUI | pretty impressive node-based UI |
|
InvokeAI | A polished UI |
|||
2022-11 | imaginAIry | Works well on Apple Silicon, pure CLI interface to all SD models. Does not reuse .ckpt files, however, so requires separate disk cache. |
||
2022-08 | Stable Diffusion WebUI | Nearly always the best, bleeding edge WebUI for SD |