People came to Lemmy explicitily because Reddit bans you for disliking billionaires now.

It’s not that I like them or anything, but it’s very irrelevant to my motivations to use fediverse.

A bit offtopic, but why would anyone want to keep their instance in line with local laws? Aren’t internet sites operating under jurisdiction of where they are hosted? Or is it just some coincidence that those people decided to host their stuff at datacenters at their local proximity? When I’m choosing hosting the first thing I think about: “hmmm I shouldn’t host in country where I live because I don’t want to ever have any problem with local authorities, and if I host elsewhere authorities there won’t be able to reach me physically so the worst thing that could happen is the site gets shut down”.

I also asked ChatGPT itself, and it listed a number of approaches, and one that sounded good to me is to pin layers to GPUs, for example we have 500 GPUs: cards 1-100 have permanently loaded layers 1-30 of AI, cards 101-200 have permanently loaded layers 31-60 and so on, this way no need to frequently load huge matrices itself as they stay in GPUs permanently, just basically pipeline user prompt through appropriate sequence of GPUs.

So do they load all those matrices (totalling to 175b params in this case) to available GPUs for every token of every user?

That’s how llms work. When they say 175 billion parameters, it means at least that many calculations per token it generates

I don’t get it, how is it possible that so many people all over the world use this concurrently, doing all kinds of lengthy chats, problem solving, codegeneration, image generation and so on?

Should be “starting your own instance”, because otherwise you still have to conform to the rules of the instance you create your community/sub on.

It is what it feels like, but it’s not really 100% this way (yet). It is a bad self-reinforcing cognitive bias: we think “forums are dead, that’s why we stick to the sitename” instead of actually finding dozens of still alive forums and going there, in turn sitename gets more populated while forums feel more dead. But there are still plenty alive. Also, there are relatively new kinds of forums which sometimes work very well for their niche, like Discourse communities for example.

After you use ChatGPT for a bit, you will start recognizing its style of writing in posts and comments. I’ve seen dozens of obviously ChatGPT generated posts or replies on Reddit and Lemmy. Usually there will be a person who already replied to them something like “Thanks, ChatGPT”, because it is that obvious. This only happens with naive prompts though, if you ask ChatGPT to present its answer to your prompt in a different style (for example, mimic some famous writer, or being cheerful/angry/excited and avoid overly safe language), it will immediately start writing differently and there’s likely no limit on variety of writing styles you can pull out of it with enough effort of just asking it to write this or that way.

I understand your point of view. But would you call something complex, high-quality, but repetitive, slop? And the same question, but if the person who produces it, does it extremely fast.

How would you use that term? Would you call “slop” something that was just mindlessly generated using AI in a single prompt and non-“slop” something that uses AI in more sophisticated/deliberate ways? What is the threshold of something being “slop” ultimately? Is this just result not looking decent enough or amount of effort combined with amount of knowledge and experience that was used to create that? I’m personally conflicted on this, because sometimes even mindless prompt may give great result, and sometimes a lot of manual effort may give shit result. I guess with “slop” I tend to gravitate towards “amount of effort combined with amount of knowledge and experience that was used to create” and perhaps also the amount of content that particular person produces and speed of its production. So if someone is really good with some tools (not necessarily AI) and figured some overpowered shortcuts that allow to produce results very fast with little effort, it also can be called “slop” just for the rate of production alone.

Cool idea, I almost forgot this feature even exists. I think I dismissed it the past when I realized it’s probably not going to be easy to switch VPN servers this way.

It does hurt, your VPN should support proper port-forwarding for soulseek to work well. In most cases, you will only be able to download files, but your shares will be inaccessible. It doesn’t seem to work with ProtonVPN for example, even when you built-in port-forwarding feature. And even if it did work, you would need to reconfigure and restart soulseek every time you reconnect the VPN, because their port-forwarding is randomizing the ports and there’s no way to turn that off.

Yes, the cheapest ones might have some risks, I mostly presented it as an example of what the opposite extremity looks like. There is a lot in-between, something a bit more expensive is even more guaranteed win. For example last time I used Hetzner, I had a server with 64gb RAM, 2TB SSD, and 16 cores Ryzen for something like €34/month. Hetzner support is very decent and they’re very well known, have decent reputation and been providing their services for a long time.

I’m talking about 3d software one, and author obviously talks about that one too.

Maybe the problem is that they are using ridiculously overpriced enterprise services like AWS or Azure, which provide their own solutions for a lot of common things like backups, replicas, logging, etc, but cost 100x more than what you can get with DIY on some cheap VPS if you’re fine with spending 1.25x more time.

Also, given that the instance is called “infosec.exchange”, you can be sure that he is not running this on some cheap VPS.

Why not, though.

I wonder why it needs so much money for infra? Last time I rented a VPS it was €7/month for 8 Core Xeon E5 V4, 12 GB DDR4 RAM, 150 GB SSD/NVME, Unlimited Traffic, 1 Gbps Port.

If Blender had a patreon or coffee or kofi, I would happily subscribe to something like $3/month. I know artists that have tens of thousands of paid subscribers and their minimal plan is $3. Blender could achieve hundreds of thousands of paid subscribers eventually imo. To make things interesting, they could release prebuilt binaries of some subprojects like NPR fork, only to subscribers, also they could do partnership and paid plugin giveaways every month to subscribers. It just needs a bit of dedicated SMM work. One-time donations just don’t hit the same. I do those maybe once a year or two, and don’t do another one until I get the feeling “it’s been a while”.

we’ll just pay artists to produce training data en masse’.

If they want to make sure it was actually drawn specifically for them and not generated by other AI or stolen from internet, they’ll need to ask timeline of work. And people doing commissions like this with also timeline provided will ask considerable payment. The smallest I’d expect is like maybe 30$ per small drawing of beginners. But it might as well be 300$ or more per drawing for pro works. Even with 30$, are they really able to pay that? How many drawings they need? Can they spend millions on this?

Maybe it’s just your subscriptions? I don’t feel the same way. Just curate your list more actively and make sure to browse communities from global pool of instances.

My first guess with this would be: they were read-only, then they wanted to post something or write a reply to someone and at the time considered it to be a one-time thing and created sort of “throwaway account” for that specifically, but then they kept visiting the place and it kind of just stick with them. Yet again, my guess might be completely wrong. But at least this is one of the possible motivations behind such accounts.