This release introduces parallel requests with continuous batching for high throughput serving, all-new non-GUI deployment option, new stateful REST API, and a refreshed user interface.
Awesome - having the API, MCP integrations, refined CLI give you everything you might want. I have some things I'd wanted to try with ChainForge and LMStudio that are now almost trivial.
I have seen ~1,300 tokens/sec of total throughout with Llama 3 8B on a MacBook Pro. So no, you don’t halve the performance. But running batched inference takes more memory, so you have to use shorter contexts than if you weren’t batching.
IMHO, what determines if you're a lawyer or not should be completely test-based and not have anything to do with where you learned. There is a lot of gatekeeping going on with ABA to keep people from even taking the test.
There's more to being a lawyer than what can be measured on a test, just like any profession.
Not trying to support the ABA or not support the ABA, but I have experience with this type of issue in other areas and reducing qualifications purely to tests or other outcomes has its own set of issues.
In Switzerland even to get your driving licence you need the exams AND prove that you had at least that many (unsure about number) driving lessons with a driving school. I would think being a lawyer means more responsibility...
I'm not so sure. People often trivialize the kinetic energy involved with driving. Yes, a bad lawyer can potentially cause an innocent to be punished if enough other checks and balances fail.
But being behind the wheel of a car is something else. Even a small passenger car is over a ton of metal moving at oftentimes high speeds. Most people don't seem to appreciate the sheer destructive capability driving gives someone.
This is not about the Bar exam (the test), this is about accreditation of law degrees. The issue is about here is about who determines whether a legal education is sufficient to trust that a lawyer who passes the test is prepared for practice. This issue is the opposite of being completely test-based. The ABA also creates the most common bar exam (the MBE or multistate bar exam) but some states like California use a different exam. The legal profession does not, but many have long argued should, have a practice requirement for independent licensure to practice.
It is akin to ABET (previously Accreditation Board of Engineering and Technology) in engineering. having an ABET accredited engineering degree has long been a component (alongside testing and mentored practice) for being a licensed engineer who can stamp drawings (e.g., structural plans for buildings). There are two tests (FE and PE) but they are not created by ABET they are created by an organization called NCEES - The National Council of Examiners for Engineering and Surveying.
ABET and NCEES are different organizations, part of the confusion here is that ABA is both the accreditor and the tester in many states. The difference in path between accreditor -> testing -> licensure is:
ABA accredited degree -> ABA (MBE) or other (non-ABA) Bar exam -> Lawyer
ABET accredited degree -> FE exam (made by NCEES) -> mentored work experience -> PE exam (made by NCEES) -> Professional Engineer
The Texas bar exam already has a second day of testing, entirely on Texas oil and gas law. Everyone must pass it to practice law in Texas, even if you no intention to do anything related to oil and gas.
If I had cancer, I definitely don't want an oncologist who learned from YouTube. And if I was on trial for murder, I wouldn't want a defense attorney who taught himself with ChatGPT.
I think every profession needs to evaluate what is necessary for a license to practice. I would agree to more reforms with the MD licensing requirements.
I also think we should be licensing law-enforcement and requiring them to have their own liability insurance.
Unrelated, but one of the more annoying aspects of whatever software they use now is lack of IPv6 for the CDN layer of DigitalOcean Spaces. It means I need to proxy requests myself. :(
The evidence of AI failure is all this low hanging fruit maintenance fixes users are begging Microsoft to fix and these AI agents are not fixing them. AI was going to 10x engineers or something right? Why isn’t GitHub getting better with all this AI help?
I know there is an infinite list of reasons Siri sucks but one that really irks me is now Siri can be integrated with ChatGPT. You can also change settings so it will automatically query ChatGPT without asking…
Yet Siri will still tell you about a web results on your phone… but sometimes same question asked? Will check ChatGPT and give you an actual answer (15% hit rate?).
I'm not sure that's all it was, but him not being invited was definitely a travesty and clearly a result of in-crowd lobbying from established car makers with links to Washington.
Install phone company app, login, and click migrate eSIM to this phone. Whole process can take up to 5min depending on how fast wifi is to connect to your phone company.
I don't install the samsung dishwasher app or the mcdonalds value points app or the Mountain Dew summer of fun app ... why would I install some random national carrier telco app ?
I had two friends that said the same thing and now both have iPhones. They got sick of constantly sending in their phones to be replaced for screen failures. One had a pixel other had a Samsung.
The one with a pixel final break was when he landed in Belize to start a vacation and the screen died. Entire vacation he had to borrow wife’s iPad mini to read.
reply