The ROI is for we the users, not the companies, only issues is that the agent's attention is way easier to hijack, so you have to maintain a different kind of attention when using them and never blindly trust their outputs.
It seems that a pretty clear first step is that thinking traces are required, along with sourcing all evidence, so that things can be easily double checked. Anthropic/OpenAI have business reasons for not sharing those, but it also probably means they can't be trusted with any vital decision making.
Yeah, it should be freely available, you have to be able to know the rules you're supposed to obey in order to obey them well. I've been making a free API for US law search, you can point whatever model you want at it: https://law.agentlookups.ai/
Very much a work in progress, only federal and state so far, no municipal codes yet, and no case law yet. Big hole, I know. Also working on making the search ranking work better.
Right now it's just a bunch of crawlers for the individual states. If there's interest, I could periodically stand up snapshot torrents or something. That something you'd be interested in?
Alternatively, if someone else knows an all-in-one option that exists, I wouldn't mind retiring those crawlers...
Not op, but that's a very interesting proposition. While the law and legal code are technically property of the people, I'm not aware of any single point of download for it all.
There’s no single point of download for it all because there’s thousands of autonomous entities that issue law and adjudicate cases, at least 51 of them distinct sovereign entities.
We could enforce (suggest?) a common format / api at the federal level. Especially if it’s incentivized with funding that more than justifies the cost of maintenance. Similar to how federal interstate funding is only available to states with a 21+ drinking age.
Yeah, going to the courts and municipal code seems like it's going to be a heavy lift. Many of them seem to hang off of municode, though, so maybe it's not a huge number of unique crawlers.
There is none, not for statutes and definitely not for case law; even at the appellate level where you have multiple federal circuits, then 50 states, then territories, military, tribal and a whole host of other niche courts. And the appellate court systems can be split into districts, and by lower and higher levels.
Then if you want to really get into it, The People should also be able to access trial court level, and at that point you have over 3000 distinct court systems with their own access systems, usually requiring logins and CAPTCHAs, and half of them not even having anything accessible online at all, and the other half only having recent stuff online and the rest rotting in a flooded basement.
That’s awesome! I especially like RECAP as a method for freeing things from PACER.
Seems like you all are already doing a lot of what I’ve been aiming for with mine. Are there useful ways to contribute, or have you all gotten it to a pretty good place technically, and it’s mostly a matter of spreading it at this point?
Our house is all-electric. We have a 60 panel, 24 kw array that would probably cover all of our needs if it weren't shaded in the afternoon, and we have a real winter here, so the heat pump runs hard, and we use a substantial amount of electricity. About 1250 square feet of panels in total. Equipment costs about $20k-$30k in the US, not including batteries or electrician install. The actual array was pretty easy to set up.
On the global market, you can get the equipment for much less, the same inverter is a fraction of the cost that the UL listed American company version costs, the panels are a good bit less. But in the US, this stuff gets marked up pretty hard.
If your main load is for summer A/C, with a mild winter, the generation and usage line up much better.
Yeah things are very frugal here (my wife is especially frugal) so without AC it's pretty much just PC, two fridges, water heater, knickknacks like toaster, foodprocessor, etc. Stove and grill is gas, and kerosene heaters for when it drops below 10c. We could easily get by with a grid well below 10k usd I'm guessing
Gpt-oss—120b is like 1000 years old in AI years, whereas Qwen 3.8 27b is pretty young. What you’re seeing is that parameters aren’t apples to apples, and at a given parameter level, the new models are much, much better than the ones from a year or two ago. Like, to a comical degree.
Wasnt this known by everyone who cared to pay attention?
It practically became a joke about how a huge amount of the training data for GPT-4 was bottom of the barrel reddit vomit and obvious bot spam. Leading to many bizarre edge cases.
Does that not prove my point? Bigger doesn’t automatically mean better. Quality of training data, and model structure, matters as much or more than size
Ah sorry, I should've continued, the bigger recent models are commensurately smarter. If you really want to make the point, then you'd need to show 27b being smarter than similar vintage bigger models. And in that case, there's confounding issues like efficiency, speed due to excessive thinking maybe to make up for the smaller amount of world knowledge baked in (qwen 27b's main issue iirc), etc - they're tuned for different things.
Shows qwen3.8-27b along side seven larger models of ~similar vintage. Only one scores above 27b.
Many of those are closed models so idk their exact parameter count / active param count, but it hardly matters - i’m sure all of them are far above 100b params
My point is not that bigger is pointless. It’s just clearly not the only road to take to make a model better, which is obvious just from seeing how models of the same size have gotten better over the past few years
First off, I'd include Qwen flash-next and GLM 5.3 to show some of the other strong open weight models, and they predictably dominate it, but they're much larger. But, it shows up right next to DSv4 Flash 0731 on the overall index, and that's much larger. It's a great model! But then scroll down and hit Time Per Task, and you'll see that DSv4 Flash takes 3.6 seconds per task to Qwen's 21.1. That's what I meant when I said this:
>speed due to excessive thinking maybe to make up for the smaller amount of world knowledge baked in (qwen 27b's main issue iirc), etc - they're tuned for different things.
It can make up for its shortcomings by iterating a lot longer, and using way more thinking tokens. And that's a great trade if you don't have the vram to run the bigger models, but speed is pretty important for getting things done... And that's why DSv4Flash is great, too, despite being much larger, and scoring similarly on the intelligence index.
> Qwen flash-next and GLM 5.3 to show some of the other strong open weight models, and they predictably dominate it
Absolutely - no argument from me here. Bigger is very clearly a lever you can pull to get more out of a model.
> But then scroll down and hit Time Per Task, and you'll see that DSv4 Flash takes 3.6 seconds per task to Qwen's 21.1
Fair point, qwen definitely is slower - it’s a dense model, 27b params, vs a sparse 13b active params model - but the data doesn’t quite agree with what you’re saying about reasoning. I.e.:
> It can make up for its shortcomings by iterating a lot longer, and using way more thinking tokens
If you look at the total tokens generated, deepseek thought for 45k tokens and qwen thought for 48k. Barely a difference. The wall clock difference is all down to the speed of token generation, not the amount of reasoning done. At least when we are comparing deepseek and qwen 27b. The comparison swings more towards your position when it comes to the other models on the chart that reason for much fewer tokens.
So perhaps a hypothetical Qwen-27b-a13b could never rival deepseek’s larger model and the tradeoff is one of speed vs overall size - i.e. a small model needs more active params to compete than a big one does.
One data point that seems relevant to me is that the previous gen qwen Qwen3.6-27b was not so different in performance from its sibling model Qwen3.6-35b-a3b. We never got a qwen3.8-35b-a3b, but if we had, would the gap have stayed the same or gotten bigger? I.e. would the quality gains by improving training coming up against a hard limitation with 35b, or not.
Ah good catch on the total tokens, was going off vague memory there, and I thought people had gotten qwen 3.8 27b up to similar decode speeds as ds v4 flash.
>One data point that seems relevant to me is that the previous gen qwen Qwen3.6-27b was not so different in performance from its sibling model Qwen3.6-35b-a3b. We never got a qwen3.8-35b-a3b, but if we had, would the gap have stayed the same or gotten bigger? I.e. would the quality gains by improving training coming up against a hard limitation with 35b, or not.
Yeah good question, kind of shocking that a 3b active model would perform as well as a 27b dense.
Geopolitics is way too complicated for such black and white thinking. Do you know who amongst the governments of those countries decided to back this Syrian president? I certainly don't. What percentage of the (huge) populations that you're damning as "deeply disgusting, sanctimonious hypocrites" do you think know who the current Syrian president is, his history, know who amongst their governments backed him, voted for the people who backed him? Humans just physically can't keep track of everything, especially things so far outside of their daily life and physical experience. You can't reasonably hold them responsible for everything bad that happens in the world that their countries contributed to, especially things that are entirely abstract for them.
> Geopolitics is way too complicated for such black and white thinking.
Your comment reeks of western superiority and exceptionalism.
Its not black and white thinking. It just hypocrisy at the highest level.
The EU does not spend a single day without going around telling anyone and everyone that human rights are very important and that we should do absolutely everything to keep things that way but then turns around and welcomes the head of a (former) terrorist group in Europe.
Even Macron welcomed the guy in Paris even though ISIS killed hundreds of French citizens.
Can anyone then reasonably blame China or India when they continue doing business with Russia? If so why the double standards?
The US and the EU love to criticize other nations but don't mind supporting war criminals and dictators when its suits them and even give them money and/or sell them weapons.
After the Ukraine war ends, I'll bet you you'll see Putin or his successor being invited to cocktail parties in Frankfurt or London, no question about it.
No, I don't blame China or India for continuing to do business with Russia, it seems completely rational for them to do so. They're powerful enough to ignore the structures the US has built to try to exert leverage internationally. Seems like you're building lots of straw men in your mind of what US/EU citizens actually think, or the propaganda apparatus you're using to keep on top of this stuff has built them for you.
> Geopolitics is way too complicated for such black and white thinking. Do you know who amongst the governments of those countries decided to back this Syrian president? I certainly don't.
I am very much against black and white thinking. But the typical US and even EU liberal citizen is mired in such thinking when it comes to talk about "war crimes and "regime change". If you don't know who in the EU govt decided to back this Syrian President, then I can only facepalm since even as a poor, "low-IQ" third-worlder (according to MAGA folks), I am educated on the same. Please look at Ursula von der Leyen and her €620 million support package.
Yes, I will hold you folks responsible. This is not some "abstract idea" - it is basic, common knowledge and you fellows always, always fall to your media propaganda.
Really? You’ve spent the time to learn every member of the EU government that supported them? And you think that’s a good use of everyone’s time? I guarantee you that the average US citizen hasn’t bothered to do that with even their members of congress, many don’t know the name of their representative, let alone those of a foreign government, they’re generally much more concerned with how they’re going to make enough money to pay to live as costs rise. Not to mention the flurry of domestic cultural infighting related concerns.
You’re certainly free to hold whoever you want responsible, but I’d argue it’s not a realistic position. And keep in mind that it’s hard for someone living here to have an accurate view of what the average American believes, even harder for someone living outside the country - dominant opinions vary widely between regions of the US. I’m sorry that our government supports war criminals of varying degrees on our behalf, though, would certainly be nice if our leaders were more principled on that front.
Good riddance?
Very happy to have my agent totally ignore the ads trying to hijack my attention.
reply