Depends of what you want to do!? Just for testing most of the 7B model are a good compromise between quality and performance (speak execution time)

Is there a way to reliably package these models with existing games and make them run locally? This would virtually make inference free right?

What I think is, from my limited understanding about this field, if smaller models can run on consumer hardware reliably and speedily that would be a game changer.

> This would virtually make inference free right?

Not really. Inference is never "free" unless you cache the result (which is just a static output) or unless you reduce complexity (which yields procedurally less-usable outputs).

Can you explain further? Why would it not be free if it's running locally

I thought you meant "free" in terms of computational cost; running local is technically free of charge, but also requires a lot of processing power. Inferecing a properly-sized LLM will potentially starve the rest of your software from GPU/CPU/memory access, so you have to plan accordingly.

Why would anyone choose to sell a node.js boilerplate as a scam? Sounds kinda twisted to me, as if you had to find a fault of some sort. I tried to follow advice from people who i thought successful on HN or so they claimed, I'm still trying my way around on the platform I'm just wondering if you are going to encourage me or just try to take me down?

Okay, I understand. What do you mean by business partners? Did I mis something?

Not saying that your thing is a scam. I meant that I don't see a reason to do it unless you're selling a scam.

What "successful" people told you to astroturf? Don't believe that bullshit. It's an instant red flag on any platform. How can I trust you as a business partner if you're okay with doing that?

Okay, I understand. What do you mean by business partners? Did I miss something?

If I buy something that's supposed to form the base of my own business including handling payments and data of my customers, I consider that a very serious, very important business partnership. So I will choose very carefully and behavior like this doesn't exactly make me confident in this choice.

Which is a pity because otherwise I'd be interested.

I understand what you mean now. How could we re-establish trust? I'm not asking so you'd buy my product. It really saddens me that you thinks I might be a scammer so I'm willing to show you otherwise. Would you be willing to try my product out, check out the code, make yourself an opinion (for free)? If you like it then just maybe you can decide to pay for it... That'll be up to you.

I didn't ignore you last time, I simply went to bed.

And also it is true that social media has little to no followers, but please keep in mind that all accounts are new, and so is the product. I am planning on improving it in many different ways and I can assure you it won't be left to die in a few weeks. I'll also make sure to add a section with information about me on the website like your comment suggested.

Hi there,

I think the best way to go about this would be to give access to the code and let you formulate your own opinion. I wont ask you to pay for it, if you want to check the code out and use it for your projects I can grant you free access. All I need would be your email address.

Hi Sohails,

Have you actually read the copy and learned about how the product works? Apart from the funnel like website layout the two products share little to nothing. Not even the tech stack.

If you have any questions regarding the product you can ask them here or get a hold of me on twitter (username: @fasternode_).

Hi HN, I built this very cool product to make the journey of indie hackers more pleasant and productive. I would love to hear from you guys. Here is the link for those who want to know more https://fasternode.io Cheers

Hello blackcubeadmin,

I agree that the website needs a reviews/testimonials section to increase trust. It is something I am working on at the moment, and will be released soon.

Let me know if you have any questions i'd love to hear more from you. Cheers

Hi HN, I built this very cools project to make the journey of indie hackers more pleasant and productive. I would love to hear from you guys. Cheers

Thank you for your suggestion, I have thought of adding a video as well but haven't yet recorded. Are you a developer yourself?

A problem solver to be sincere...

Hey HN,

I'm Rahim, a solo founder and Node.JS developer who's been on a startup launching spree – 4 in just 6 months! But amidst the hustle, I noticed a repetitive pattern: setting up DNS, connecting databases, handling Stripe webhooks, Setting up Authentication… it all felt like wasted time.

That's why I built FasterNode. It tackles three major pain points: 1. Focus on what matters: Spend less time on repetitive setup tasks and more on building a thriving business. 2. Avoid common headaches: Like setting up Google OAuth, emails, Stripe payments. 3. Make a scalable and secure app: For that I didn’t want to use Next.JS, rather I wanted this boilerplate to be built on Node.JS and express for simplicity and versatility. FasterNode uses a reliable custom built auth system, and MySql as a database.

FasterNode is essentially a boilerplate on steroids, designed to streamline your launch process and free up your valuable time. If you're a solopreneur or a small team tired of repetitive tasks, I'd love for you to try FasterNode and hear your feedback!

P.S. What are your biggest challenges when launching new startups? Let's chat in the comments!