Artificial Intelligence

This page is a reference table for resources I’m keeping tabs on.

That grand, spacious (and long ignored) branch of computing that, these days, deals not just with thinking machines (so-called “hard” AI), but mostly with enhancing the usefulness of machines in general by exploring mechanisms to express and manipulate harvested knowledge.

Or just pretty pictures and weird chatbots.

Resources

Field Category Date Link Notes
General Frameworks 2023-05 marvin

A generic wrapper for various AI APIs

Jupyter 2023-04 jupyter-ai

an official Jupyter plugin that can handle multiple AI back-ends (although it seems less flexible than the others right now)

Libraries 2023-06 unstructured

a library for handling and segmenting unstructured data of various kinds, from text to common file formats

2023-03 ml-ane-transformers

Apple’s transformers library, optimized for the Neural Engine

2009-06 Alchemy

A toolkit providing a series of algorithms for statistical relational learning and probabilistic logic inference, based on Markov logic representation

Techniques 2022-12 awesome-chatgpt-prompts

might be a short-lived resource, but an interesting one

Tools 2023-05 explainerdashboard

a web app that explains the workings of a (scikit-learn compatible) machine learning model

2023-04 basaran

An Open-Source alternative to the OpenAI text completion API, with a compatible streaming API for privately hosted models.

2023-03 NVIDIA Triton Inference Server

A high-performance inference server

2022-12 Project Bumblebee

Pre-trained and transformer neural models in Elixir.

Generative Audio models 2023-04 bark

a text-prompted genereative audio model

Large Language Models 2023-09 instructor

a clever library that simplifies invoking OpenAI function calls

Applications 2023-07 Chie

A cross-platform dekstop application with chat history and extension support

Copilots 2023-06 Obsidian Copilot

an interesting take on how to use semantic search and OpenSearch’s BM25 implementation

Frameworks 2023-07 litellm

a simple, lightweight LLM wrapper

AutoChain

Yet another alternative to langchain

griptape

a langchain alternative with slighly better internal coding standards

llama_index

a data framework for LLM applications

txtai

has spinoffs for chat, workflows for medical/scientific papers, semantic search for developers and semantic search for headlines and story text

llmflows

Yet another alternative to langchain, but with an interesting approach at defining workflows

2023-05 langchain

a composable approach for building LLM applications

guidance

Control modern language models more effectively and efficiently than traditional prompting or chaining.

Jupyter 2023-04 LLMBook

A VS Code notebook interface for LLMs

jupytee

a Jupyter plugin that can handle code generation and image generation, but not switching models (GPT-4)

genai

a Jupyter plugin that can handle code generation and fixes based on tracebacks

ipython-gpt

a Jupyter plugin that can handle multiple models

Libraries 2023-06 simpleaichat

A simple wrapper for the ChatGPT AI

2023-05 guardrails

a package for validating and correcting the outputs of large language models

Models 2023-04 turbopilot

a GitHub CoPilot replacement that can run locally (CPU only)

Reference 2023-03 Using LLaMA with M1 Mac

Manual instructions for Apple Silicon

Resources 2023-04 awesome-decentralized-llm

a collection of LLM resources that operate independently

Tools 2023-09 embedchain

another framework to create bots from existing datasets

llm_agents

a simplified agent framework (doesn’t use OpenAI functions)

2023-08 pykoi

a unified interface for data and feedback collection, including model comparisons

PromptTools

self-hostable toools for evaluating LLMs, vector databases, and prompts

2023-07 a1gpt

A C++ implementation of a GPT-2 inference engine

khoj

an intriguing personal assistant based on local data

promptfoo

A tool for testing and evaluating LLM prompt quality.

2023-06 SuperAGI

another AutoGPT-like harness for building GPT agents

2023-05 ChainForge

a visual programming environment for benchmarking prompts across multiple LLMs

langflow

a node-based GUI for quick iteration of langchain flows

2023-04 Auto-GPT

an attempt to provide ChatGPT with a degree of autonomy

2023-03 dalai

An automated installer for LLaMA

llama.cpp

A C++ port of Facebook’s LLaMA model. Still requires roughly 240GB of (unoptimized) weights, but can run on a 64GB Mac.

minillm

A GPU-focused Python wrapper for LLaMa

simple-llama-finetuner

A way to do LoRA adaptation of LLaMa

chatbot-ui

a more or less sensibly designed self-hosted ChatGPT UI

content-chatbot

A way to quickly create custom embeddings off a web site

chatblade

a CLI wrapper for ChatGPT

GPTQ-for-LLaMa

a way to quantize the LLaMA weights to 4-bit

llama-rs

A Rust port of llama.cpp

alpaca-lora

Another way to do LoRA adaptation of LLaMa

Vector Databases 2023-08 vectordb

A simple vector database that can run in-process

marqo

A vector database that performs vector generation internally

2023-07 chroma

an embedding database

USearch

A Single-File Vector Search Engine

Workflows danswer

a pretty complete GPT/search integration solution with GitHub, Slack and Confluence/JIRA connectors

NeRFs Tools 2022-12 nerfstudio

A tool for manipulating Neural Radiance Fields (NeRF) and rendering the scenes out as video

Speech Recognition Models whisper

a general purpose speech recognition model

2022-02 whisper.cpp

a C++ implementation of whisper that can run in consumer hardware

Stable Diffusion Apps 2023-03 swift-coreml-diffusers

Hugging face’s own app, using Swift and CoreML for Apple Silicon

2022-11 Draw Things

Pre-packaged app for iOS, downloads and allows re-use of .ckpt files.

DiffusionBee

Pre-packaged app for macOS (M1 and Intel)

CGI 2023-03 Blender-ControlNet

A Blender plugin to generate ControlNet inputs for posing figures

2022-12 dream-textures

A Blender plugin for texturing models based on a text description.

Models 2023-03 Upscale Model Database

Too wide a choice, perhaps

2022-12 Fast Stable Diffusion

Another tactic to accelerate inference

CoreML Stable Diffusion

Apple’s optimizations for CoreML

Tools 2023-08 stable-diffusion.cpp

stable diffusion inference on the CPU, in pure C++

Opendream

A layer-oriented, non-destructive editor

2023-03 ComfyUI

pretty impressive node-based UI

InvokeAI

A polished UI

2022-11 imaginAIry

Works well on Apple Silicon, pure CLI interface to all SD models. Does not reuse .ckpt files, however, so requires separate disk cache.

2022-08 Stable Diffusion WebUI

Nearly always the best, bleeding edge WebUI for SD

This page is referenced in: