The situation is somewhat different and nuanced. With weights there are tools for fine-tuning, LoRA/LoHa, PEFT, etc., which presents a different situation as with binaries for programs. You can see that despite e.g. LLaMA being “compiled”, others can significantly use it to make models that surpass the previous iteration (see e.g. recently WizardLM 2 in relation to LLaMA 2). Weights are also to a much larger degree architecturally independent than binaries (you can usually cross train/inference on GPU, Google TPU, Cerebras WSE, etc. with the same weights).
This is a very shallow analogy. Fine-tuning is rather the standard technical approach to reduce compute, even if you have access to the code and all training data. Hence there has always been a rich and established ecosystem for fine-tuning, regardless of “source.” Patching closed-source binaries is not the standard approach, since compilation is far less computational intensive than today’s large scale training.
Java byte codes are a far fetched example. JVM does assume a specific architecture that is particular to the CPU-dominant world when it was developed, and Java byte codes cannot be trivially executed (efficiently) on a GPU or FPGA, for instance.
And by the way, the issue of weight portability is far more relevant than the forced comparison to (simple) code can accomplish. Usually today’s large scale training code is very unique to a particular cluster (or TPU, WSE), as opposed to the resulting weight. Even if you got hold of somebody’s training code, you often have to reinvent the wheel to scale it to your own particular compute hardware, interconnect, I/O pipeline, etc.. This is not commodity open source on your home PC or workstation.
There is even a sentence in README.md that makes it explicit:
The source files in this repo are for historical reference and will be kept static, so please don’t send Pull Requests suggesting any modifications to the source files […]
The Chinese episode has also generated other issues. Several notes demonstrate that this was an experiment and not a therapeutic intervention (even He Jiankui called it a 'clinical trial'). The babies were not at risk of being born with HIV, given that sperm washing had been used so that only non-infected genetic material was used. Further, even though one of the parents (or both) was infected, it did not mean the children were more prone to becoming infected. The risk of becoming infected by the parents' virus was very low (Cowgill et al., 2008). In sum, there was no curative purpose, nor even the intention to prevent a pressing risk. Finally, the interventions were different for each twin. In one case, the two copies of CCR5 were modified, whereas in the other only one copy was modified. This meant that one twin could still become infected, although the evolution of the disease would probably be slower. The purpose of the scientific team was apparently to monitor the evolution of both babies and the differences in how they reacted to their different genetic modifications. This note also raised the issue of parents' informed consent regarding human experimentation, which follows a much stricter regimen than consent for therapeutic procedures.
No HIV transmission occurred in 11,585 cycles of assisted reproduction using washed semen among 3,994 women (95% confidence interval [CI] = 0–0.0001). Among the subset of HIV-infected men without plasma viral suppression at the time of semen washing, no HIV seroconversions occurred among 1,023 women following 2,863 cycles of assisted reproduction using washed semen (95%CI= 0–0.0006). Studies that measured HIV transmission to infants reported no cases of vertical transmission (0/1,026, 95% CI= 0–0.0029). Overall, 56.3% (2,357/4,184, 95%CI=54.8%–57.8%) of couples achieved a clinical pregnancy using washed semen.
Not sure what called for this blatant personal attack. My post history speaks for itself, quite in comparison to yours. And Phoronix is well-known Linux website, and its test suite is in fact even referenced in various regression tests/patches in LKML (also not sure what/if any kind of kernel development you have done).
Well, if you have a constructive suggestion which site to link instead regarding kernel developments, I am all ears:
Not sure that raw commits are readable or have sufficient context for non kernel development readers here
LWN, particularly timely/kernel development news there, has gone mostly paywall, and there will be (legitimate) complaint if I link articles needing a LWN subscription
In the beginning, only privileged ones will be allowed to run in pass-through mode. But goal/roadmap calls for all FUSE filesystems eventually to have this near-native performance.
Open Source Initiative tries to define Open Source AI ( www.theregister.com )
Students Show Up to Graduation, Find Commencement Speaker Is an AI Robot ( futurism.com )
Not Dead Yet: WD Releases New 6TB 2.5-Inch External Hard Drives - First Upgrade in Seven Years ( www.extremetech.com )
Intel's OpenVINO Now Available In openSUSE ( www.phoronix.com )
Valve's Linux Graphics Engineers Begin Prepping RADV Driver For AMD RDNA4 "GFX12" ( www.phoronix.com )
Germany's Sovereign Tech Fund Now Supporting FFmpeg ( www.phoronix.com )
Raw Milk Enthusiasts Demand Milk Infected With H5N1 ( futurism.com )
AMD Aims For AMF Decode In FFmpeg, Questioned Over Vulkan Video Commitment ( www.phoronix.com )
Student protesters face same suspensions as those who bring assault rifles to campus ( www.latimes.com )
Microsoft is a national security threat, says ex-White House cyber policy director ( www.theregister.com )
End-to-end encryption may be the bane of cops, but they can't close that Pandora's Box ( www.theregister.com )
DVDs, Blu-rays, and VHS tapes: How long does physical media last? ( qz.com )
Internet Horrified at AI App for Cloning Dead Family Members ( futurism.com )
Digital surveillance is omnipresent in China. Here’s how citizens are coping ( theconversation.com )
Compiling MS-DOS 4.0 from DOS 4.0, on a PS/2! ( virtuallyfun.com )
The hyper-clouds are open source's friends ( www.theregister.com )
I AM SO DISAPPOINTED WITH UBUNTU 24.04 😡 ( news.itsfoss.com )
Microsoft Just Released MS-DOS Source Code! ( github.com )
IBM Buys HashiCorp To Control The Alternative To Red Hat Kubernetes ( www.nextplatform.com )
Samsung boosts 1Tb V-NAND bit density by 50 percent ( www.eenewseurope.com )
AlmaLinux 9.4 Beta Restores Support For Some Hardware Deprecated By RHEL ( www.phoronix.com )
Forget Ubisoft's AAAA Games, CD Projekt Is Making 'AAAAA' Games ( insider-gaming.com )
KDE On The Importance Of Wayland Explicit Sync ( www.phoronix.com )
Original blog: https://zamundaaa.github.io/wayland/2024/04/05/explicit-sync.html
Scientist who gene-edited babies is back in lab and ‘proud’ of past work despite jailing ( www.theguardian.com )
The Xz Backdoor Highlights the Vulnerability of Open Source Software—and Its Strengths ( www.404media.co )
xz backdoor...
Majority of Americans now use ad blockers ( www.theregister.com )
SWAT Team Raids Innocent Family Over Stolen AirPods Dropped on Their Street ( www.riverfronttimes.com )
SDL Developers Weigh Reverting Wayland Over X11 For SDL 3.0 ( www.phoronix.com )
KVM Virtualization With Linux 6.9 Brings More Optimizations For Intel & AMD ( www.phoronix.com )
VLC - App stores were a mistake ( archive.is )
VideoLAN...
Feds Ordered Google To Unmask Certain YouTube Users. Critics Say It’s ‘Terrifying.’ ( www.forbes.com )
Security expert Chris Krebs on TikTok, AI and the key to survival (part 2) ( venturebeat.com )
Part 1: https://venturebeat.com/security/security-expert-chris-krebs-on-tiktok-ai-and-the-key-to-survival/...
NBC hires former RNC chair Ronna McDaniel, who has demonized the press and refused to acknowledge Biden was fairly elected ( www.cnn.com )
Glassdoor Wants to Know Your Real Name ( www.wired.com )
Murder defendant slips restraints in court, stabs his lawyer with pen. All good, attorney says ( www.latimes.com )
Linux kernel 4.14 gets a life extension, thanks to OpenELA ( www.theregister.com )
FUSE Passthrough Mode Merged For Linux 6.9 ( www.phoronix.com )
GhostRace Detailed - Speculative Race Conditions Affecting All Major CPUs / ISAs ( www.phoronix.com )
Midjourney bans all Stability AI employees over alleged data scraping ( www.theverge.com )
Microsoft waited 6 months to patch actively exploited admin-to-kernel vulnerability ( www.theregister.com )
Setting up Microsoft OS/2 Pre-Release 2 build 6.78 (and compiling) ( www.youtube.com )