Artificial Intelligence

This page is a reference table for resources I’m keeping tabs on.

That grand, spacious (and long ignored) branch of computing that, these days, deals not just with thinking machines (so-called “hard” AI), but mostly with enhancing the usefulness of machines in general by exploring mechanisms to express and manipulate harvested knowledge.

Or just pretty pictures and weird chatbots.

Resources

Field Category Date Link Notes
General Frameworks 2023-05 marvin

A generic wrapper for various AI APIs

Jupyter 2023-04 jupyter-ai

an official Jupyter plugin that can handle multiple AI back-ends (although it seems less flexible than the others right now)

Libraries 2023-03 ml-ane-transformers

Apple’s transformers library, optimized for the Neural Engine

2009-06 Alchemy

A toolkit providing a series of algorithms for statistical relational learning and probabilistic logic inference, based on Markov logic representation

Techniques 2022-12 awesome-chatgpt-prompts

might be a short-lived resource, but an interesting one

Tools 2023-05 explainerdashboard

a web app that explains the workings of a (scikit-learn compatible) machine learning model

2023-04 basaran

An Open-Source alternative to the OpenAI text completion API, with a compatible streaming API for privately hosted models.

2023-03 NVIDIA Triton Inference Server

A high-performance inference server

2022-12 Project Bumblebee

Pre-trained and transformer neural models in Elixir.

Generative Audio models 2023-04 bark

a text-prompted genereative audio model

Large Language Models Frameworks 2023-05 langchain

a composable approach for building LLM applications

guidance

Control modern language models more effectively and efficiently than traditional prompting or chaining.

Jupyter 2023-04 LLMBook

A VS Code notebook interface for LLMs

jupytee

a Jupyter plugin that can handle code generation and image generation, but not switching models (GPT-4)

genai

a Jupyter plugin that can handle code generation and fixes based on tracebacks

ipython-gpt

a Jupyter plugin that can handle multiple models

Libraries 2023-05 guardrails

a package for validating and correcting the outputs of large language models

Models 2023-04 turbopilot

a GitHub CoPilot replacement that can run locally (CPU only)

Reference 2023-03 Using LLaMA with M1 Mac

Manual instructions for Apple Silicon

Resources 2023-04 awesome-decentralized-llm

a collection of LLM resources that operate independently

Tools 2023-05 ChainForge

a visual programming environment for benchmarking prompts across multiple LLMs

langflow

a node-based GUI for quick iteration of langchain flows

2023-04 Auto-GPT

an attempt to provide ChatGPT with a degree of autonomy

2023-03 dalai

An automated installer for LLaMA

llama.cpp

A C++ port of Facebook’s LLaMA model. Still requires roughly 240GB of (unoptimized) weights, but can run on a 64GB Mac.

minillm

A GPU-focused Python wrapper for LLaMa

simple-llama-finetuner

A way to do LoRA adaptation of LLaMa

chatbot-ui

a more or less sensibly designed self-hosted ChatGPT UI

content-chatbot

A way to quickly create custom embeddings off a web site

chatblade

a CLI wrapper for ChatGPT

GPTQ-for-LLaMa

a way to quantize the LLaMA weights to 4-bit

llama-rs

A Rust port of llama.cpp

alpaca-lora

Another way to do LoRA adaptation of LLaMa

NeRFs 2022-12 nerfstudio

A tool for manipulating Neural Radiance Fields (NeRF) and rendering the scenes out as video

Speech Recognition Models whisper

a general purpose speech recognition model

2022-02 whisper.cpp

a C++ implementation of whisper that can run in consumer hardware

Stable Diffusion Apps 2023-03 swift-coreml-diffusers

Hugging face’s own app, using Swift and CoreML for Apple Silicon

2022-11 Draw Things

Pre-packaged app for iOS, downloads and allows re-use of .ckpt files.

DiffusionBee

Pre-packaged app for macOS (M1 and Intel)

CGI 2023-03 Blender-ControlNet

A Blender plugin to generate ControlNet inputs for posing figures

2022-12 dream-textures

A Blender plugin for texturing models based on a text description.

Models 2023-03 Upscale Model Database

Too wide a choice, perhaps

2022-12 Fast Stable Diffusion

Another tactic to accelerate inference

CoreML Stable Diffusion

Apple’s optimizations for CoreML

Tools 2023-03 ComfyUI

pretty impressive node-based UI

InvokeAI

A polished UI

2022-11 imaginAIry

Works well on Apple Silicon, pure CLI interface to all SD models. Does not reuse .ckpt files, however, so requires separate disk cache.

2022-08 Stable Diffusion WebUI

Nearly always the best, bleeding edge WebUI for SD

This page is referenced in: