I'm a little confused how these models run/fit onto VRAM. I have 32gb system RAM and 16gb VRAM. I can fit the 20b model all within vram, but then I can't increase the context window size past 8k tokens or so. Trying to max the context size leads to running out of VRAM. Can't it use my system ram as backup though?
Yet I see other people with less resources like 10GB of vram and 32gb system ram fitting the 120b model onto their hardware.
Perhaps its because ROCm isn't really supported by ollama for RDN4 architecture yet? I believe I'm using vulkan to currently run and it seems to use my CPU more than my GPU at the moment. Maybe I should just ask it all this.
I'm not complaining too much because it's still amazing I can run these models. I just like pushing the hardware to its limit.
It seems you'll have to offload more and more layers to system RAM as your maximum context size increases. llama.cpp has an option to set the number of layers that should be computed on the GPU, whereas ollama tries to tune this automatically. Ideally though, it would be nice if the system ram/vram split could simply be readjusted dynamically as the context grows throughout the session. After all, some sessions may not even reach maximum size so trying to allow for a higher maximum ends up leaving valuable VRAM space unused during shorter sessions.
Ah I see interesting, I'll have to play around with this more. I switched from Nvidia to AMD and have found AMD support to still be rolling out for these new cards. I could only get LM studio working so far but I'd like to try out more front ends.
Not a major setback because for long context I'd just use GPT or claude, but it would be cool to have 128k context locally on my machine. When I get a new CPU I'll upgrade RAM to 64, my GPU is more than capable of what I need for a while and a 5090 or 4090 is the next step up in VRAM but I don't want to shell out 2k for a card.
Dating apps by and far are quite useless. If you ever want to know how insidious they are, just download one, finish your profile, and swipe for 10 minutes a week.
Since you are not an "active user" they will give you the most attractive people to swipe on. Every couple of days they will give you a "limited time" discount on gold or platinum or whatever. The push notifications are my favorite part, "you could be missing out on the love of your life!!!".
Not to mention the interactions with the UI are littered with casino like visuals. The whole purpose of the app is to get you addicted and spending time and money on it.
It's much easier to naturally meet people in real life through work/school. If you can't there, go hang out at coffee shops or bookstores or something and just hang. Strike up conversation with people, just live. You'll get rejected and some people will be rude but it's all real. You could also always pick up hobbies and meet people there. Just be social, don't spend time and money on these machines of misery.
I'm always so confused by the advice to go to bookstores to meet people. What kind of bookstores do you guys go to where the customers talk with each other?
Being able to start a friendly conversation under circumstances where an average male might fail is a prime sign of date-ability. While humans are very complicated, the general animal rule that males must impress females still exists at some level in some form.
That's a recipe for women to feel creeped out. Even at Meetups women get bugged by men who for lack of a better term lack awareness and communication skills.
And by this I do imply men talking to women, because despite claims to the contrary, it's the accepted norm (and there are always exceptions). That's my experience, it may be different in same sex communities.
There's no great place for people to meet anymore.
Countless surveys have shown that women do want to be approached. And don't forget about the "Brad Pitt vs Stalker" duality that exists for women and dating: They either view you as handsome who can do no wrong (including approaching them at Meetups), or some kind of creep. There is little in-between. Also, women view about 80% of men as unattractive. It is not a normal distribution, as men rate women's attractiveness. The open secret is that you need to approach lots of women on a regular basis in all sorts of different settings. Eventually, you will find luck.
Basically this, the bookstore was a stand in for any type of place that you may frequent and see others frequent.
People react differently to being approached, just like anyone would. If they are just into you it works. If not some are polite and see it as a compliment and just say no. Others will be offended and scoff. Either way no one gets hurt and you just move on.
Eventually you just get lucky with someone who is interested in you back. This is kinda how it was for most of history, so I find it odd people are so against it now. We are social creatures! go out and meet people, if they happen to be mean oh well, that reflects entirely on them.
> Also, women view about 80% of men as unattractive. It is not a normal distribution, as men rate women's attractiveness.
No source for a claim like this, on a forum where it's the norm for even the most mundane things? Please link one, would be interested in having a look at the study.
> At least on OKCupid, women rate 80% of men as below-average attractiveness, while men rate women at right about 50% as below-average and 50% as above-average
is very different from
> Women view about 80% of men as unattractive. It is not a normal distribution, as men rate women's attractiveness.
Pretty confounding to take that sort of a logical leap in a thread that's about the dark patterns, gamification and the highly modified context into which dating apps transform dating inside them.
I investigate these complaints for a living. Please don't date anybody you work with. We'll both be happier for it.
The fun always starts after a breakup and the other party doesn't want to see you at work anymore. There is usually no penalty for falsely reporting anyone to HR for harassment "in good faith," and there are likely anti-retaliation policies protecting malicious claimants from punishment for "misrepresentation" of any situation. Your side of the story will be recorded for the sake of appearance, and ignored. The system is completely broken.
If you're sure they're your soul mate, changing departments is not enough, leave now, on your own terms. You do not want a common HR department acting as a mediator for your domestic disputes. You're asking to be made unemployed and homeless.
Happened to me. Utter, utter nightmare. As she seemed to winning she got overconfident and started making claims that were easy to objectively disprove. She was thrown out. She broke down and confessed, after it was too late. Not a work situation though. I don't know why she did it, we weren't on bad terms or anything, I guess she just felt like it. Just a total psycho. It really turned my life upside down for awhile. I wanted to quit anyway, to get away from the whole thing.
Sorry to hear it buddy. Not the first time I've seen that.
I'd say it gets better but it is genuinely traumatic to be attacked out of nowhere for no apparent reason. There's literally nothing you can do to avoid random acts of violence. Even becoming a hermit isn't a solution; now you're that creepy guy who lives in a van by the river who gets blamed for diddling all the kids.
Nomadic life is safer, as long as you don't draw attention and move along before anybody learns how to exploit you.
I hope you find peace and have since landed on your feet.
> I don't know why she did it, we weren't on bad terms or anything, I guess she just felt like it. Just a total psycho
Also not the first time I've seen (or experienced) that either.
I'm seeing more instances of this sort of behavior exhibited by the borderline personality disorder crowd without consequence in popular media. Awkwafina does it in one of her shows, Pete Davison does it in "King of Staten Island," both in relation to getting rid of potential step-parents in publicly-humiliating manners. It's happened to me too in this context. It's really disturbing behavior to see promoted, and now I see it being leveraged at work too as a means of eliminating undesirable colleagues.
Acts of social terrorism, we grant the euphemism "cancellation." There's really nothing you can do but live in fear of it, because there are no rules and our institutions have no integrity.
You wouldn’t get a chance to quit either one, probably.
The job might fire the accuser - they might have an incentive to investigate.
At the gym you might get arrested and then banned, with no one interested in doing followup to figure out the actual truth - just have you released after it was clear it was fake. The gym wouldn't want anything to do with you either way afterwards.
I don't disagree with any of that. I'm just saying the repercussions for whatever things like that happen, they will be lower at the gym compared to the workplace.
Being arrested in public often has much more far reaching negative consequences than the accuser being fired, and you not being arrested.
Assuming work is going to actually investigate before acting of course. They do at least have some incentive on that front - if they need you more than the hassle it creates.
The current society propaganda is society doesn’t need men, so if it’s a woman doing the accusing, don’t expect society to want to investigate. Unless you’re in an area which is ‘anti’ that and the cops think they can manage it. They’re very unlikely to actually pursue charges of false accusations though, that opens a giant can of worms almost everywhere.
It takes a really compelling and provably nasty situation for someone to be willing to risk the backlash from a pretty woman crying and wailing - who you know is more than willing to make false allegations.
Women’s ‘power’ is their beauty - aka the drive others have to make them want them. As to if it’s manipulation or influence depends on the degree of intended mutual benefit in it.
Men’s ‘power’ is their physical violence (which can allow them control over resources), aka their ability to physically force someone or something to ‘comply’. As to if it’s warlord style or ‘community policing’ depends on the degree of intended mutual benefit in it.
Women are more used to the how and why behind false allegations and have the social tools to deal with it better, where most men are going to be powerless except in specific circumstances (Cops, and gay men, maybe - depending on the venue).
There is a reason society has been shitting on cops lately, btw. It hasn’t escaped their notice, I assure you.
Look at how much of the population supported amber heard during the trial if you don’t believe me.
Usually they’d just ignore it after it was obvious what was going on, and threaten the false accuser with a criminal charge - but not actually charge her.
HR is used to more ‘active’ management than the gym. If they’re under a lot of public pressure though, they might want to burn you even worse to appease the folks squeezing them.
Depends on the leadership incentives, and how much ‘force’ the other party wants to apply.
Of course. It works at every level, all the way down to family. Other advice here suggests joining groups to meet people, but anytime you two are under the same reporting umbrella, you're vulnerable to malicious claims when they want to be rid of you.
It's a sad state of affairs; I don't have a solution. Private citizens have no business running tribal justice systems. They used to call this form of abuse triangulation (but that term has a wildly different meaning with this crowd).
They're never together at the time of the complaint, but I don't see it mattering-- if a dude is sending dick pics to anyone while on the clock then it's an issue.
So these investigations usually focus on verifying whether he sent them at the time she said he did. Timestamps get forged or omitted in phone screenshots and personal phones are beyond our forensic purview. It's all hearsay. If I can't discredit the evidence, it stands, and the accused is usually terminated. Welcome to Kangaroo Court.
I ate some shit recently when a guy was accused of emailing dick pics to his ex from his work email. I believed her story (men are pigs, right?) until a colleague looked deeper at the email headers; she saw that the ex was the one sending the pictures to him. The social media narratives we're told and the shit I've seen in the last decade could not be more opposite. Men do some seriously gross shit at work for real, just not anything surfaced by the reporting process. That pipeline has just been a torrent of bullshit.
For what it's worth it's not always a romance thing. Bad complaints are always filed by women, but their targets are evenly split across men and women. False claims ensnare bosses and colleagues just the same as icky exes.
I think the mindset should be that whoever you initially meet, or hang out with, won't be a match but may potentially introduce you to a person with whom you could match. So all coworkers then are excluded from the dating pool, but are potential matchmakers.
If you don't date at work you still make friends at work and grow your social circle. Leverage that to meet new people through work people.
It can be risky dating at work but some find the trade off worth it. I suppose it depends on how comfortable you are at your job too. I've definitely seen relationships blossom in my workplace more than once. When you spend so much time with people it's only natural.
You are talking specifically about the male experience.
As 'female' it doesn't matter how often I use the app, if my profile attracts enough males I get matches and ice breakers all day long. If I accidentally open the app after 2 months it just gets more.
I don't need to match or look out. I get nice and stupid messages in mailbox and can choose from them.
If I go to match 80% (made up but realistic number) of the profiles shown already matched with me.
The apps don't want me to buy anything, they nag me for my time.
I could go on. By design I will only see the most successful or 'aggresive' profiles and nothing else.
This is very true, I've never used a dating app as the opposite sex so I'm not sure what their experience is like. This definitely sounds about right though.
Makes sense that attention is what they want from you, and how the experience compares to that of an average dude on it.
I suppose I'm forgetting other experiences too, I guess I follow the two "rules" of dating apps because as a dude I get a decent amount of matches. Still I don't like the dating apps, maybe I just yearn for something more real I'm not sure.
Because it's currently much more expensive than solar and wind, even when you factor in the costs of dealing with intermittency.
Even if public perception weren't an obstacle, and even if you didn't have to deal with waste storage, and even if building nuclear plants wasn't a glacially slow process, it just doesn't make economic sense to focus on nuclear anymore.
For example, Germany is pushing for solar and wind cos Siemens is producing those and its popular cos people somehow think there are no drawbacks to them… They could have operated their nuclear plants for at least another decade of there was political will for it…
Nuclear power plants seem to take a long time to get right, which means they end up being very expensive.
As an example, consider the new Olkiluoto-3 nuclear plant built in Finland. That reactor was commission just a few months ago, but its build was 12 years behind schedule. The delay to that project saw the original 3 billion Euro price tag more than triple with a final cost closer to 11 billion.
It would be perfectly fine if we just landfilled wind turbines and solar panels. It's not like silicon or fiberglass are rare. The whole recycling business here is more fetish than obstacle.
There are problems with recycling in general. For example, the overuse of plastics, with no sensible recycling plan means we have plastic garbage patch twice the size of Texas floating around in the Pacific Ocean.
These problems are generally not about recycling, but rather the willingness of governments to legislate sensible solutions.
What do you mean by "efficient"? Engineering efficiency? They use different inputs, so comparing that is meaningless. Economic efficiency? No, they're much less economically efficient. That's why so much more solar (and wind) are being installed now instead of nuclear.
> I doubt that somehow, reason we are pushing wind and solar is cos people think it is “green” and “renewable” and are scared of nuclear.
This is utter nonsense. The reason wind and solar are being pushed is they are so much cheaper than nuclear (and this will remain true even at high renewable uptake when storage is required). This is widely understood; where did you get the bizarre incorrect belief that it was otherwise?
Nuclear was so out of the running in the US that many existing NPPs had to be shut down because they were cash flow negative. It wasn't worth running them even with the construction and financing costs completely written off. The remaining reactor at Three Mile Island, for example, had not made an operating profit for six years before it was shut down.
This was done due to environmental factors, not as a financial instrument.
> and are scared of nuclear.
That part is definitely true. After seeing that even a high-tech nation like Japan couldn't keep their nuclear reactors safe, nuclear was no longer seen as a viable option.
How does this run on an Intel Mac? I have a 6 core i9. Haven't been able to get an M series yet so Im wondering if it would be more worth it to run it in a cloud computing environment with a GPU.
>Mac Running Intel
When running a Mac with Intel hardware (not M1), you may run into clang: error: the clang compiler does not support '-march=native' during pip install.
If so set your archflags during pip install. eg: ARCHFLAGS="-arch x86_64" pip3 install -r requirements.txt
Bluesky is currently better than threads, technically.
The content on Bluesky is lacking, i know it’s because of the invite only system, and that has its advantages and disadvantages but Bluesky is going to run into a problem soon.
They obviously need content and users to stay alive, and the content is lacking. Currently it’s a very niche group of users who have a very distinct culture. They don’t leave much room for differing ideas.
It will be interesting watching this play out. They are positioned in a way that can beat threads, but they need to drop the invite ASAP and manage their onboarding of new users.
That means the culture will inevitably change, I’m not sure I see a way of it staying the same as normal people and more fringe people sign up.
IMO they should prioritize content creators. Engaging content on the platform that’s rich will be a huge leg up when they open up.
Helps too that currently i can’t even post a picture on threads without it crashing. Blue sky is definitely the more delightful sop to use.
Yet I see other people with less resources like 10GB of vram and 32gb system ram fitting the 120b model onto their hardware.
Perhaps its because ROCm isn't really supported by ollama for RDN4 architecture yet? I believe I'm using vulkan to currently run and it seems to use my CPU more than my GPU at the moment. Maybe I should just ask it all this.
I'm not complaining too much because it's still amazing I can run these models. I just like pushing the hardware to its limit.