Posts

Micro benchmarking Apple M1 Max - MLX vs GGUF - LLM QWEN 2.5

Image
MLX is an ML framework targeted at Apple Silicon.  It provides noticeable ML performance gains when compared to the standard (GGUF) techniques running on Apple Silicon.  This MLX project describes MLX as:   MLX is an array framework for machine learning on Apple silicon, brought to you by Apple machine learning research. A notable difference from MLX and other frameworks is the   unified memory model . Arrays in MLX live in shared memory. Operations on MLX arrays can be performed on any of the supported device types without transferring data. LM Studio added support for Apple Silicon MLX models in 2024 . I totally ignored it until I saw a 2025/02 Reddit post in the /r/ocallama subreddit .  I wanted to execute their microbenchmark on my Mac to get a feel for the possible performance difference.  The performance improvement is exciting.  I am waiting on really jumping into the MLX until Ollama supports MLX something they are working on as of 2025/0...

Sample claude-code prompts from their. npm package

Image
Anthropic released an npm package for claude-code  that acts as an LLM coding assistant. Anthropic  on their website  including sample LLM interactions. This blog article exist to make it easier to read the prompts and provides no analysis or value judgement. Claude-code Typescript source is available on the npmjs site. Their source provides some interesting examples of good prompt engineering. They show how you can create a detailed system prompt to achieve better results.  I've extracted some of the prompts here to make them easier to read.  I've wrapped some of the text to make it easier to read.  I have no idea if the extra new lines impact the results. So copiers be aware. Claude-code on npmjs https://www.npmjs.com/package/@anthropic-ai/claude-code?activeTab=code The npmjs links to the GitHub repository with the source are broken at this time (2025 02).  cli.mjs I found the following system prompts while scanning cli.mjs. systemPrompt : [ `Your ta...

Spinning up an Azure SQL always-free database

Image
I wanted to do a quick prototype with a friend and we wanted a common database so we looked for a developer-grade free cloud product that we could both reach from our developer machines Azure has a free tier or promotional program that makes it easy to learn about Azure or create prototypes and demos at a low cost. There are two levels of free.   Free for the first 12 months you have your account. Always free I've had my Azure account for a few years so I only have access to the  always free  tier.  This page lists all the always free services. Azure has two free-tier options: Cosmos DB  and Azure SQL Database .  We decided to go with the Azure SQL database because it has SQL in the name instead of using Cosmos DB and its SQL persona. Always Free Azure Databases Microsoft offers an "Always" free tier for two of their databases Azure SQL and Cosmos DB. They are free below a certain level of consumption.   Cosmos DB Here are a few links ...