feat(whisper): Add prompt to condition transcription output by richiejp · Pull Request #7624 · mudler/LocalAI chore(makefile): Add buildargs for sd and cuda when building backend feat(whisper): Add prompt to condition transcription output Description Allows the user to add previously transcribed text or s...

I added transcription prompts to LocalAI's Whisper backend and immediately put it to use in VoxInput. This means that when I say "LocalAI" and "VoxInput", it actually transcribes those correctly. Also works great with OpenAI.

github.com/mudler/Local...

github.com/richiejp/Vox...

VoxInput using LocalAI to allow you to transcribe voice to text in any Linux desktop or app. This video shows how it works and some guidance on setting it up: youtu.be/bbZ_9-Uzp78

github.com/richiejp/Vox...

I released VoxInput v0.5.0 which now has a GUI that notifies you when VoxInput begins or stops listening for voice audio to transcribe.

The Go is more verbose than the Python, but it's still pretty small. I could probably make it smaller if I was really optimizing for that, however I'm not motivated to do that. What you see is the Go that came out as I went with minimal refactoring.

github.com/richiejp/mic...

Micrograd is "A tiny Autograd engine (with a bite! :)). Implements backpropagation (reverse-mode autodiff) over a dynamically built DAG and a small neural networks library on top of it with a PyTorch-like API. Both are tiny, with about 100 and 50 lines of code respectively. "

I watched Karpathy's excellent Micrograd video and implemented the Micrograd library in Go. Today I recorded some of my thoughts on the differences between the original Python and my Go implementation: www.youtube.com/watch?v=76DB...

VoxInput/v0.4.0/Realtime Transcription Demonstrating realtime transcription that uses LocalAI's implementation of the OpenAI realtime API.https://github.com/mudler/LocalAI/pull/5392https://github....

I added real-time voice transcription to VoxInput by implementing the transcription only mode for OpenAI's real-time transcription API in LocalAI.

youtu.be/Ims16LC_Bp8

GitHub - richiejp/VoxInput: Transcribe input from your microphone and turn it into key presses on a virtual keyboard. This allows you to use speech-to-text on any application or window system in Linux. In fact you can use it on the system console. Transcribe input from your microphone and turn it into key presses on a virtual keyboard. This allows you to use speech-to-text on any application or window system in Linux. In fact you can use it ...

I created a voice transcription agent for Linux that works with any Linux desktop and uses OpenAI's and therefor LocalAI's API to transcript audio with Whisper.cpp. It can input text anywhere because it uses a virtual keyboard via dotool
github.com/richiejp/Vox...

LocalAGI/V2/AI powered IRC bot/Filters feature Shows the configuration for an AI power IRC bot that only responds to messages of a particular type.This shows a feature I am currently working on called Fil...

Mudler merged my triggers and filters feature into LocalAGI: youtu.be/d_we-AYksSw?...

Not much interest in IRC though, maybe I should upgrade to Matrix?

I made a little update to LocalAGI's action playground that creates a form for action configuration and parameters, this saves you having to enter raw JSON. The Action Playground is for testing actions when the agent has issues making tool calls.

LocalAGI: Create and run AI agents locally without writing code LocalAGI allows you to create "AI agents" that run completely on your hardware and can access your systems to perform tasks. It's Open Source, allowing you to self-host, modify and audit it.

LocalAGI: Create and run AI agents locally without writing code

LocalAGI/v0/Create and run AI agents locally/Basic Installation YouTube video by Richard Palethorpe

youtu.be/HtVwIxW3ePg

Funny Man Dog Poo

Never say that we don't still make shit in the UK!

hardware that stack has to work with. Resulting in a sea of configuration options, many combinations of which have never been tested.

A lot of the frictions to running AI locally are just generic software configuration issues. Basically there is a GPU involved which is a different kind of architecture and comes with its own software stack. Each vendor has there own stack and there are a whole bunch of combinations of software and

Enabling Intel GPUs with GGML's SYCL support in LocalAI, how hard can it be? LocalAI has at least two backends that support Intel's SYCL. One is Llama.

Somehow it was quite a slog though.

www.linkedin.com/pulse/enabli... 2/2

Enabling Intel GPUs with GGML's SYCL support in LocalAI, how hard can it be? LocalAI has at least two backends that support Intel's SYCL. One is Llama.

In this weeks news letter I wrote/ranted about the process of supporting Intel GPUs in LocalAI with SYCL. Essentially it's *just* a case of getting the software to build and that boils down to passing the right flags to the compiler. 1/2

If you vibe code a SaaS app, the second it makes money that should be reinvested into paying someone to clean it up. Coding agents are incredible, but so far I have not seen any which do penetration testing and vibe coding produces a large attack surface.

I've lost so much time over my career to simple build errors buried in piles of awkward software. Often the error manifests at runtime as something completely baffling and terrifying. At the end it turns out to be typo which would be completely avoidable with some static checking.

It's incredible that vibe coding is even a thing and my son is going to grow up thinking it's normal to speak to computers in natural language.

Most people think an AI agent is a person who does something with AI. Not an automation that combines LLMs and other algorithms to give the appearance of agency.

more is expected from software.

Compilers eliminated the need to write assembly by hand in most situations. However there are more assembly coders today than ever before because the industry is so much bigger.

What is quite likely is that the role of software dev will change beyond recognition.

Let's say that the stories about software dev teams being let go due to AI are true; I don't see this situation lasting for long. Every previous advance in software technology has lead to greater penetration by software into every aspect of industry. There is then more demand for coders, because

Vibe coding an OS kernel into existence I've been trying out Windsurf, which is a competitor to Cursor. I found that it's rather good, so I thought to myself, what's the most absurd thing I can try to code just using AI? In other words,…

In this week's newsletter I vibe coded a "bare metal" program that runs inside a Firecracker micro VM on x86_64 and accepts commands through the serial terminal.

So yes kernel developers, you are not safe either!!!

Tracking bandwidth usage per process with eBPF and CGroups Finding which process are sending receiving data with a given host appears to be a common need and here are some of the reasons I have seen for it: Preventing data usage charges on cellular networks…

Often we want to know which process is using our bandwidth and where it is sending data to. This can be done with Dinko Korunic's pktstat-bpf utility which I added CGroups support to this week.

buff.ly/K2ZUXwt

Avante, Bolt.new and Cursor: coding tools that are going to replace me next year In this weeks issue: Avante is a great tool for bringing AI to Neovim. Also a comparison with Cursor and Bolt.

AI coding tools are reshaping development: I built an IRC bridge and a Go web app with minimal effort using Avante for Neovim. Will these tools replace developers or make skilled coders more valuable? My hands-on experience with Avante, Cursor, and Bolt[.]new reveals their promise and limitations.

Techbits week 9: Configuration control with NixOS and Kairos. Tools: blxrep, udpspeeder and more In this weeks issue!Configuration control with NixOS and KairosTools: blxrep, udpspeeder, Node-RED, RAG and belowRandom: LTE/5G vulnerabilities and Mr. Beast...

This is pure cringe, but I have started making videos from my Newsletter:

Week 9: Configuration control with NixOS and Kairos. Tools: blxrep, udpspeeder and more In this weeks issue! Configuration control with NixOS and Kairos Tools: blxrep, udpspeeder, Node-RED, RAG and below Random: LTE/5G vulnerabilities and Mr. Beast Configuration control with NixOS and…

This weeks newsletter:

Week 8: What language does farm equipment speak? Should have used Pocketbase and the 3 types of OSS In this week's issue, which is issue 4: Internet of Tractors: What language does farm equipment speak? How not to write web app: Should have used Pocketbase Avoid upset by understanding the 3 types…

The 4th issue: Internet of Tractors: What language does farm equipment speak? How not to write web app: Should have used Pocketbase, Avoid upset by understanding the 3 types of OSS