Rendered at 07:52:43 GMT+0000 (Coordinated Universal Time) with Cloudflare Workers.
prathje 5 minutes ago [-]
Nice! I would love to use it for images as well.
Then again is using Grammar-Based Decoding with a json response not the same? Is Jev just that with nice caching?
Because then I have been using that already…
bicsi 34 minutes ago [-]
Of course it works, Jev is nothing but an API breakthrough
dist-epoch 4 minutes ago [-]
Jev is rumored to be a 30B model, and it's input price is MUCH cheaper than similarly sized models. The maker is also heavily focused on having a profitable product, so it's unlikely to be subsidizing the cost, especially since they say they have more demand than what they can serve.
Havoc 2 hours ago [-]
Likely works even better with fireworks ai since they have proper grammar support
[B] Not a hotdog