Artificial Intelligence

a tool that enables inference on AMD GPUs

a minimal implementation of Flash Attention

A 8000 LOC deep learning framework

A generic wrapper for various AI APIs

An array framework for Apple silicon

MLX examples

an official Jupyter plugin that can handle multiple AI back-ends (although it seems less flexible than the others right now)

a library for handling and segmenting unstructured data of various kinds, from text to common file formats

Apple’s transformers library, optimized for the Neural Engine

A toolkit providing a series of algorithms for statistical relational learning and probabilistic logic inference, based on Markov logic representation

a GPU over IP bridge that allows remote GPUs to be utilized by CPU-only machines

A flexible scraper implemented in Azure

An interactive tensor visualizer for IPython notebooks.

a port of TensorFlow Lite Micro to the Raspberry Pi Pico

an AI-based image upscaler

An Open-Source alternative to the OpenAI text completion API, with a compatible streaming API for privately hosted models.

a web app that explains the workings of a (scikit-learn compatible) machine learning model

A high-performance inference server

Pre-trained and transformer neural models in Elixir.

embeddings database for semantic search

Vector Database atop IndexedDB

a text-prompted genereative audio model

a framework for orchestrating autonomous AI agents

yet another agent tool, this time using the OpenAI assistant interface

a prototype GitHub issue bot

another AutoGPT-like harness for building GPT agents

an interesting experiment on self-editing agents

a simplified agent framework (doesn’t use OpenAI functions)

an implementation of word2vec skip-gram for word embedding.

A cross-platform dekstop application with chat history and extension support

an interesting take on how to use semantic search and OpenSearch’s BM25 implementation

an ensemble setup with WhisperSpeech, WhisperLive and Phi

a simple, lightweight LLM wrapper

Yet another alternative to langchain

yet another LLM framework using decorators for data validation

a langchain alternative with slighly better internal coding standards

Control modern language models more effectively and efficiently than traditional prompting or chaining.

a composable approach for building LLM applications

a data framework for LLM applications

has spinoffs for chat, workflows for medical/scientific papers, semantic search for developers and semantic search for headlines and story text

Yet another alternative to langchain, but with an interesting approach at defining workflows

a componentized approach to building LLM pipelines

an open-source ChatGPT alternative that runs 100% offline (uses nitro)

a self-hosted local inference front-end for chatting with document collections

another self-hosted local inference front-end

A VS Code notebook interface for LLMs

a Jupyter plugin that can handle code generation and image generation, but not switching models (GPT-4)

a Jupyter plugin that can handle code generation and fixes based on tracebacks

a Jupyter plugin that can handle multiple models

a lightweight library for efficient text chunking in RAG applications.

a Python library that uses LLMs to perform data cleaning

library for prompting, synthetic data generation, and training workflows

a vactorization library that can handle more than just text

decorators to create functions that return structured output from an LLM.

a package for validating and correcting the outputs of large language models

a memory management/summarization technique for unbounded context

a clever library that simplifies invoking OpenAI function calls

A simple wrapper for the ChatGPT AI

can interpret and execute functions/plugins

pretraining of a 1.1B Llama model on 3 trillion tokens.

a model designed for both function calling and on-device inference

a multi-modal model from Apple

a GitHub CoPilot replacement that can run locally (CPU only)

an example of how to do hyrid (vector and FTS) search with SQLite for RAG

tips on how to use OpenAI JSON and function calling

Manual instructions for Apple Silicon

a set of lecture notes and detailed examples of prompting techniques

a collection of LLM resources that operate independently

A set of sample base prompts for various LLMs

Another set of prompting techniques and detailed examples

might be a short-lived resource, but an interesting one

a simple PyTorch-based implementation

a program synthesis agent that autonomously fixes its output by running tests

a simple agent that does online research on any given topic

A pretty hilarious image-to-description example

A self-hosted ChatGPT alternative

provides an example of how to use Graph navigation and Cognitive Search indexing

open-source LLM chatbots

An LLM-powered advanced RAG pipeline built from scratch

A simple interactive web shell with some nice features

a tutorial on how to build a GPT model from scratch

a collection of one-liners for various LLMs

a rudimentary IRC bot that communicates with a local instance of ollama

a tool for creating and managing LLM workflows

a bot for integrating ChatGPT and DALL-E into Slack

a Perplexity AI search engine clone

nn easy-to-use AI text-generation software for GGML and GGUF models based on llama.cpp

a set of acceleration techniques

Recipes for on-device voice AI and local LLM

a prototype development tool that leverages GPT

a framework for or rapid development and deployment of production-ready RAG systems with SQLite support

a plugin for Apple Notes that uses the Accessibility APIs

a set of tools for manipulating GGUF format files

A GPTScript tool to generate images

a lightweight NLP toolkit for tasks like fuzzy-deduplication, similarity, and ranking

an intriguing P2P clustering solution for running models across several machines

a terminal-based interface for LLMs

Natural Language Programming against multiple LLMs

a local language server that leverages LLMs

a VSCode extension that uses llm-ls

a PyTorch extension for Intel hardware

a self-hosted inference engine for edge computing with an OpenAI API

an Emacs extension for using a local LLM

LLM training in simple, raw C/CUDA

an open-source LLM app development platform with a node-based UX

a framework for developing LLM-based applications including Retrieval Augmented Generation

a tool for compressing prompts with minimal loss of information

a multiagent persona simulation

a JavaScript environment for prompt development and structured data extraction for LLMs.

a data pipeline designed to pre-process knowledge graphs and perform RAG on them

automatic generation of visualizations and infographics

an implementation of Half-Quadratic Quantization (HQQ)

a local tool for searching using LLMs

a set of parsers for common file formats

a web-based interface for LLMs

yet another LLM agent framework

yet another long-running agent tool for complex coding tasks

a search SDK that unifies the entire RAG pipeline in a single database query

a framework that allows users to serve thousands of fine-tuned models on a single GPU

CLI to interact with LLMs using markdown and images

a note taking tool that performs RAG using a local LLM

An open-source alternative to GitHub copilot that runs locally.

a tool that researches a topic and generates a full-length report with citations

A device that tells bedtime stories to kids, using chunked TTS

a Python script for plotting the intermediate layer outputs of Mistral 7B

a unified interface for data and feedback collection, including model comparisons

an attempt to provide ChatGPT with a degree of autonomy

A C++ implementation of a GPT-2 inference engine

an OpenAI gateway in Go to create API keys with rate limits, cost limits and TTLs

An automated installer for LLaMA

a MITM proxy that lets you use the GitHub Copilot extension with other LLMs

An Electron app for macOS

another framework to create bots from existing datasets

A C++ port of Facebook’s LLaMA model. Still requires roughly 240GB of (unoptimized) weights, but can run on a 64GB Mac.

self-hostable toools for evaluating LLMs, vector databases, and prompts

a visual programming environment for benchmarking prompts across multiple LLMs

an intriguing personal assistant based on local data

A GPU-focused Python wrapper for LLaMa

a node-based GUI for quick iteration of langchain flows

A way to do LoRA adaptation of LLaMa

a more or less sensibly designed self-hosted ChatGPT UI

A local (edge) inference engine in C++ without any dependencies

A way to quickly create custom embeddings off a web site

A local, drop-in replacement for the OpenAI API

a CLI wrapper for ChatGPT

A tool for testing and evaluating LLM prompt quality.

a way to quantize the LLaMA weights to 4-bit precision

A containerized solution for using local LLMs via web chat

A Rust port of llama.cpp

Another way to do LoRA adaptation of LLaMa

another C++ local inference tool

an embedding database

A simple vector database that can run in-process

A vector database that performs vector generation internally

A Single-File Vector Search Engine

a pretty complete GPT/search integration solution with GitHub, Slack and Confluence/JIRA connectors

instruction-based image self-editing

a library that performs OCR on documents and converts them to Markdown

Real-time audio to chords, lyrics, beat, and melody.

a tool that processes PDF files into structured Markdown format

A tool for manipulating Neural Radiance Fields (NeRF) and rendering the scenes out as video

a real-time text-to-speech system based on Whisper

a family of models optimized for resource-constrained devices.

a library optimized for fast and accurate automatic speech recognition on resource-constrained devices.

a distilled version of whisper that is 6 times faster

a C++ implementation of whisper that can run in consumer hardware

a general purpose speech recognition model

an editor for spoken-word audio with automatic transcription

An opinionated CLI for audio transcription

a multi-lingual text-to-speech library with support for various languages and real-time inference.

a text-to-speech model designed specifically for dialogue scenarios, with decent prosody

a PyTorch implementation of a voice cloning model

a text-to-speech system built by inverting Whisper

A text to speech model that supports style diffusion

a tool that enables accurate voice cloning with multi-lingual support and flexible style control.

a minimal sampling approach

Hugging face’s own app, using Swift and CoreML for Apple Silicon

Pre-packaged app for iOS, downloads and allows re-use of .ckpt files.

Pre-packaged app for macOS (M1 and Intel)

A Blender plugin to generate ControlNet inputs for posing figures

A Blender plugin for texturing models based on a text description.

Stable Diffusion XL 1.0 Base on a Raspberry Pi Zero 2 (or in 298MB of RAM)

a Java library for Stable Diffusion that uses ONNX

an SDXL flavor that works on only a few steps

Too wide a choice, perhaps

Another tactic to accelerate inference

Apple’s optimizations for CoreML

a set of reference workflows and documentation for ComfyUI

minimal inference examples for FLUX.1 models

a ComfyUI desktop wrapper

a high-fidelity, fast (single-step) SDXL diffusion model

An AnimateDiff integration for ComfyUI

pretty impressive node-based UI

A polished UI

stable diffusion inference on the CPU, in pure C++

A component manager for ComfyUI

A layer-oriented, non-destructive editor

Nearly always the best, bleeding edge WebUI for SD

Works well on Apple Silicon, pure CLI interface to all SD models. Does not reuse .ckpt files, however, so requires separate disk cache.

A pretty impressive open source video generation model

a CCTV viewer that connects to RTSP streams and performs real-time object tagging using YOLO and ollama