Hacker Newsnew | past | comments | ask | show | jobs | submit | MK2k's commentslogin

A lightweight HTTP proxy that translates OpenAI /v1/chat/completions requests to Ollama's native /api/chat API and back.

Ollama's OpenAI-compatible endpoint (/v1/chat/completions) has serious runtime configuration limitations.

Without custom model files, parameters such as context size cannot be centrally controlled. Requests through the OpenAI compatibility layer may run with Ollama defaults instead of the desired runtime settings.

This proxy uses Ollama's native /api/chat endpoint directly, where runtime parameters are explicitly supported.

One .env file configures all models centrally.


"CUDA on NVIDIA, MPS on Apple Silicon, CPU fallback" - any chance for some AMD love?


.werkkzeug1 was also my first though while scrolling through the article


The "4" clue forces the solution imho.


this needs to be an offline bootable usb version :)


visited expecting some bedroom DJing topics, stayed for actual agricultural machinery :)


The content analysis can be off. The following text has been flagged "negative":

> STOP asking Claude Code to design your apps. It’s great for logic, not design. Google Stitch 2.0 + Claude Code via MCP is the workflow that finally fixes the AI slop problem.


Vibe coded CRMs do exist. They are not open to the public though, as they are just used by the company that built them tailored to their needs is all.

Same with more complex systems: entire shop systems with payment integration, ERP and all – heavily supported by LLM code tools with a 3-10x productivity boost, just done by the CTO and no additional developers needed. They exist, the shop greets it’s customers and all you see is Vue and Tailwind as the tech stack where Shopify could’ve been. It’s now completely owned by the company selling things (they just don't sell the software).


This has been similar to my own personal experience. I've generated a number of scripts and browser extensions to do various things perfectly fitting my use cases, but they're far too niche to be worth publishing.


front page, scroll down, there's Developers - Source Code


The first random blog post that I got served was this one:

https://nutcroft.com/blog/goodbye/

> [...] And now this blog goes too. So, goodbye!

Oh well


Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: