Nah, I'm thinking much bigger. I've got an AI that can transcribe video, I'm working on one to summarize and put facts into a knowledge graph, I've got one that can hold a conversation, and I've got a script that scrapes sites and does natural language processing. I just need an agent to tie the pieces together and some control scripts to manage the containerized pieces
The idea is, my assistant will go out, read up on programming topics and build knowledge graphs with references to the source, and I'll fix my biggest issue - shittified searches crippling my work speed
Then, I'll send it off to find content. It'll transcribe/summarize videos and rank them, research topics and come back with reports, and trawl my socials to find new things I might find interesting
I plan to take all that, then let my assistant create video channels to watch and additional content to read if Lemmy is slow. And if my friends and family show interest, I'll add in hosting and an internal social media and convince them to run additional nodes at home
I've been working on it for a while because I saw this coming, I've got most of the key pieces already.
And that's the bubble of Internet I'm building - AI curation of my Internet life, it'll happily work away the hours deshittifying a bubble of Internet
It's quite possible, although I'm inclined to blame it on turnover and pressures for deadlines
I've come to see software kinda like a plant. If you neglect it, it rots, because all software is contextual and the world moves on. If you keep growing it, it starts to rot from the inside. If you carve out down to something smooth and streamlined, it can last a long time and just need TLC to bounce back
Ultimately, if you want something to be big and to last, you have to prune it, transplant it, and continuously work on it. There's no direct money to be made there though
And it helps a shit ton to have people around long-term. It can take years to learn a big stack, but having someone go "wait, if we do this we need to rexamine how we delete photos" is how you avoid fuck ups like this
Seriously... The closer to three edge we get, the faster enshitification goes. No one is writing algorithms with users in mind... Not for a paycheck anyways
We're getting to the point where we all need to carve out bubbles of curated Internet for our friends and family
I'd personally love an ev bike, but it'd be wasted on me right now. I really want an electric car because you could run the AC all night and power a computer - I want a little hotel on wheels
Well hey listen, I appreciate it. I would've spent who knows how long waffling between distos that I don't feel drawn to, and even if I came across an atomic flavor, I probably would've just assumed it was marketing fluff
Good ideas need advocates, and this is a good idea... It's a promise of an OS I want, not just running from one I don't
I'm probably going to look at bazzite first. If I have containers that can run LLMs on my GPU, that checks off everything on my wish list except gaming. I'll read up on it though, you've given me the context I need to care about learning more
Ok, when I googled it earlier I saw "containers and roll back to previous version" and I made a note to do more reading
Your write up was good, much clearer than what's on fedora and Wikipedia. And the fact you pitched immutable OS's in general first caught my attention... The concept is a no brainer. Decouple the os and the rest of the software, and don't bother digging into one of a kind conflicts when updating things - just make it rebuildable and create it fresh. You never know when the wrong bit will flip
Nix's "learn this one thing, configure it once, and you're done" stuck in my head. And after a different distros, a couple lines installed Nvidia, Nvidia's docker package and docker
But then I had to configure WiFi and spend half an hour learning why I couldn't mount an external drive and how to manage it... I still have no regrets, I've got a USB that should start converting my friends and family's old PCs into a self organizing AI/self hosting cluster... Hopefully it works next month lol
But not what I want in a daily driver. I want something that'll quickly do what I tell it and gracefully handle the fact I have 6 versions of Java and no idea why I need a version from 2018 specifically. And that I'm going to add a repo to install something and instantly forget what I did if it seems like the best path forward at the time
You've sold that pretty well - my takeaway was that atomic fedora is very modular and low side effect and also an interchangable foundation I can swap out and roll back easily... At this point, if it can run containers and the drivers I need, it sounds like a great option.
I used to use VMs so every 6-12 months I could start clean with the latest and run setup scripts for my dependencies... It was just easier than debugging some conflict. This sounds even cleaner - I swap out the base at will, and the stuff I've built on it should stay intact. Plus it sounds much more testable
So my main concern is will it run on an HP omen - it has zero Linux support and a bunch of concerning driver needs, but it does have a second m2 slot... What's the worst that can happen? Except apparently some models forget they have fans in Linux and I just know the iGPU-GPU switch will cause some problem with sleeping... But Windows is only going to get worse
Now that you've convinced me this might be the best course (I only see less problems than other distros would have), and I've talked myself into giving it a go, is there any recommended reading or key concepts I should look into? Any particular flavor(s) you'd point me to first?
Fedora Atomic a chance, it's an extremely nice family of distros (e.g. Bluefin/ Aurora, Bazzite, etc.)!
Can you elaborate on this? I landed on nix for my PC turned server and haven't regretted it, but I've been hesitant to go all in on my main laptop (I'm wary of my laptop iGPU and GPU switching becoming a config issue, and I'm dreading having to configure my wsl dev environments again...)
Windows is getting blatantly terrible enough I know I'm just putting it off, maybe a cool new technology might help make it sound more fun
They may choose a job nearby to avoid having to deal with shitty transports every day.
It's more just the option - a short commute is amazing. It makes an enormous difference in work and life satisfaction. They have the mixed zoning so you could find a cheap apartment or a three story house with a big yard without paying for it with 2 hours of your life every day
Their public transportation is great too... Even with a car, it's just so much faster and more convenient most of the time. You just hop on and off with very little waiting. It's cheap too, it was like 25 Euros a month for unlimited metro and bus rides, and even in the center of the city on a weekend it's less crowded than DC is in the middle of a weekday
But I think the French culture is about enjoying life as much as possible.
This is just a tangent, but I don't think that's quite right... They actually say "c'est la vie" like they're trying to convince themselves they can accept things
They have plenty of problems, there were two or three murders within my walking distance in a couple months... Not like it was an unsafe area, people just flipped out on family members and co-workers. One just (mostly) decapitated someone with a katana in an office over a fine or something. They're constantly fighting over politics and culture, they share public spaces but you'll see tons of people sitting alone carefully not interacting with each other - they're very closed off in a lot of ways. Work-life balance is really what they've got going for them. That certainly leaves a lot more time for family and hobbies (which is huge), but I wouldn't describe them as happy exactly... Some definitely do make the most of it, but a lot of people don't
It's more that they draw a very hard line between "acceptable" and "not acceptable", but it's a constant fight. They take their time eating good food and enjoy their outdoor time, but a lot of them are isolated and/or bitter. They're going through the same stuff we are, but they've had more to lose
But that's just my take away, and it's not like I saw much of the county
That sounds like a mix of public transportation sucking and people needing to travel too far to me
Driving sucks... But compared to not having a reliable way to get around? It's total freedom
But better yet is being able to have a nice walk where you need to go, and frequent/plentiful options to go further. You just have to mix everything up and cut down on the parking lots. Low cost housing with full homes tucked here and there, smaller grocery and hardware stores every few blocks, gyms and parks a few blocks away - and all centered around a main street with offices and lower cost housing a few blocks away, so the main street can have a bus running by every 5 minutes
My time working in Paris for a bit really blew my mind - only one guy at my office wasn't walking distance to work. I passed several grocery stores and bakeries on my 20 minute walk back if I wanted to grab something, there was a big park a couple blocks up if I wanted a scenic walk back.
And if I was feeling lazy, you could just start walking until you saw a bus coming up behind you - there was a bus stop like every quarter mile just going up and down that main street
Almost as good as all that is the fact that if you did have to drive, there was so much less traffic. You could park on side streets, but those spots were limited and needed specific permits. They had parking garages at the edge of the suburb area near the highway entrance and near the metro station, so while you could drive up to wherever to load/unload, it discouraged it and kept the cars mostly on the bigger roads in between areas.
Granted, it's only amazing when the pieces all fit together like that - a lot of the designed communities in the US are nowhere close to as good because they don't commit far with. I later moved to a designed community in the States which had most of the same aspects, but I never walked to the grocery store. It was across the street from the town center and a 10 minute walk, but it involved crossing 2 much higher speed/busy roads and walking across a huge parking lot. It was just a little island in a world still built for cars
I mean, I've got one of those "so simple it's stupid" solutions. It's not a pure LLM, but those are probably impossible... Can't have an AI service without a server after all, let alone drivers
Do a string comparison on the prompt, then tell the AI to stop.
And then, do a partial string match with at least x matching characters on the prompt, buffer it x characters, then stop the AI.
Then, put in more than an hour and match a certain amount of prompt chunks across multiple messages, and it's now very difficult to get the intact prompt if you temp ban IPs. Even if they managed to get it, they wouldn't get a convincing screenshot without stitching it together... You could just deny it and avoid embarrassment, because it's annoyingly difficult to repeat
Finally, when you stop the AI, you start printing out passages from the yellow book before quickly refreshing the screen to a blank conversation
Or just flag key words and triggered stops, and have an LLM review the conversation to judge if they were trying to get the prompt, then temp ban them/change the prompt while a human reviews it
It's almost like John Oliver's NSA street campaign. No one cared until he started talking about how the NSA was cause inappropriately "handling" dick pics
They're half the way there. One does not simply turn off the porn. People will go through great lengths to see nudes
Now we just have to make them understand that their porn history is being collected along with their legal identity. Hackers will get it before long, and if the government doesn't have it already, it's just a matter of time
The violation we've felt having all of our movements and habits tracked is apparently only felt by the masses when their junk is analyzed. Which I find weird, but hey, whatever makes people realize privacy isn't something to shrug off
True, it's probably overkill. But even if you don't log, they could theoretically start live monitoring the VPN with a court order... With a setup like this, there's no front door or backdoor, just an ephemeral image you have to restart to modify. You'd have to write in access methods and rebuild to get in... The government can't just walk in and demand you stop what you're doing and build something for them
It does add security, even if you might not need that level of security
I mean, if you set up your os on an encrypted ram disk, then set it to restart when the server rack door was unlocked/opened and didn't leave a backdoor for yourself to remote in, you could have a situation where you entirely lack the capability to give them access to anything before that moment. A skilled hacker might be able to get in through an exploit or do something crazy with cryogenics to read the memory at the time of shutdown, but a quick restart would overwrite most of what's in memory and scrub that
Legally, there's not much better defense than "I'm sorry your honor, I can't provide access to the running system in the same way I can't un-shatter a smashed mug". If someone shows up with a warrant, you could explain that it'll wipe itself if they open or unplug it, and it might've done so already. Then you guide them to it, hand over the key to the server cabinet, and let them decide to open the cabinet and destroy evidence so they can take it with them. Or they can take you at your word, and give up.
Court orders can't break physics, and as a VPN your reasoning for setting up the system like this is to make your service more appealing to customers - the purpose is not to aid in a crime or destroy evidence, it's just the normal course of business.
The same way that most companies wipe their emails after 30 days - yes, it potentially destroys incriminating paper trails, but that's just a side effect of the security policy you've had all along
Granted, there's probably some sketchy sealed laws they could use to force you to backdoor your own system moving forward, but you can fight that as it's undue hardship. It requires a non-negligible amount of work and would make your product less competitive
They might win in the end if they keep pushing, and even might be able to order you to "keep up the canary paper" (meaning keep claiming not even you have access to the running system), but more likely they'd get a warrant for your customer financial records and try to find an easier path to find what they want elsewhere