Rendered at 14:55:32 GMT+0000 (Coordinated Universal Time) with Cloudflare Workers.
sdoering 2 hours ago [-]
Pardon me not understanding what this is about?
Basically SETI for AI workloads? At least, this is the impression the landingpage left me with.
I am a bit lost, tbh.
railka 1 hours ago [-]
Minions is an internal enterprise system already in use at Apple. It pools idle Mac GPUs into a shared compute cluster for ML inference.
There is no distributed execution of a single LLM across multiple GPUs using tensor parallelism here. Instead, it relies on task-level parallelism-breaking down a large workload into independent subtasks that run across separate machines. For example, generating embeddings for a million documents.
alt227 1 hours ago [-]
So basically works the same way as Folding@Home?
rafaelmn 45 minutes ago [-]
Embedding@Work
cr125rider 19 minutes ago [-]
HotBackpack@Commute
rramon 60 minutes ago [-]
Only on the same local network I guess.
tom1337 1 hours ago [-]
I guess for companies this can be nice? Run some inference in the off-hours on the machines that you already have. Could be useful for analytical tasks that don't require to be instant. On the technical side this doesn't seem that groundbreaking for me though.
pm90 1 hours ago [-]
My warm take is that Apple is leaving a lot of money on the table by not investing in creating an independent supply chain for their chips and building their own cloud. They arguably had the first mover advantage when it came to general purpose arm compute; all they had to do was flood the market and make it easy for anyone to rent it. Not only would they corner a part of the market but perhaps ease demand pressure on other chip manufacturers too.
sigmoid10 1 hours ago [-]
Apart from straight up buying TSMC's or Samsung's fabs I don't see a way of building a vertically integrated high-end chip supply chain for Apple. At least not on timeframes measured below a decade. And on those time frames the current supply issues will probably be resolved by companies who put all their effort into it instead of just tweaking their bottom line.
alt227 1 hours ago [-]
TBH Im surprised they havent already bought one of these companies.
ecshafer 11 minutes ago [-]
There is zero chance Taiwan or South Korea would allow this. It would be blocked on National Security grounds for each respective company/country.
bel8 48 minutes ago [-]
I don't think they would be able to buy any of these. It would have been blocked by multiple regulators.
macintux 59 minutes ago [-]
They've had a great deal of success playing them off against each other.
53 minutes ago [-]
r_lee 58 minutes ago [-]
because their entire thing is to focus on a few product lines... I'm not surprised at all
kolinko 35 minutes ago [-]
My guess is that they have challenges scaling the production anyway (6-16 weeks wait time for Studios), and also they would leave money in the table if they just released chips. I would assume that once they scale the production they will get back to the server game - MacOS server racks, or something more inventive like MacOS supercomputers running on a ton of prev gen chips ;)
yohannparis 57 minutes ago [-]
My guess is that it's already hard for them to get as many chips fabricated for their devices, which is still their main source of income so far.
Maybe their chip team is already on the work, or already made, a server chip for AI purposes used internally, and doesn't have to talk about it yet.
They don't get enterprise, A/UX, mkLinux, OS X Server, Mac Pro tower, all gone now.
Swift's main reason to go open source and have good Linux support was naturally for app developers to be able to use it on server side, which naturally wasn't going to be macOS.
I macOS wasn't required for developing iDevices apps, they would surely sell even less desktops.
lynndotpy 49 minutes ago [-]
It would be so incredibly cool if we finally had an accessible consumer-accessible way to turn a network of computers on a network into a supercomputer. A household has a child who gets into 3D artwork and wants to render something? People can opt their tablets, phones, laptops, whatever to crunch out some frames overnight while not being used.
botanrice 25 minutes ago [-]
until you get a teen obsessed with 3d rendering then they're up all night finding a way to convert manga into 3d scenes and your old laptop is running 100% cpu trying to keep up. xDD
lynndotpy 16 minutes ago [-]
The idealized version of this in my mind has a consent-first interface which makes it easy to set boundaries and limits and wouldn't burn out the machine as a default
nico 30 minutes ago [-]
Would love to build something like this but for classification models that run on CPU. Like a “Classify @ Home” p2p compute network, to which people could contribute their machines and see what work is being done
They'll throw this together but still not sell you something you can stick in a rack ?
Telemakhos 1 hours ago [-]
That seems to be the point: you leverage existing workstations on your corporate network and run compute batches at night while they're idle. You don't have to buy any extra servers for your low-priority AI workloads.
jprd 1 hours ago [-]
We were doing this decades ago with engineer's HP C3600s under their desks. It wasn't AI, just low-priority HPC / fluid stuff batched out to hundreds of workstations.
macintux 57 minutes ago [-]
That was the original pitch for Ian Murdock's Progeny startup in the late 90s: a Linux-based distributed filesystem for corporate desktops to boot into overnight for distributed computing.
cmdrk 10 minutes ago [-]
Apple has reinvented cycle scavenging about 40 years later.
brandonpelfrey 1 hours ago [-]
I don't get it. In the paper it sounds like it's "just" a CRUD DB, then you have some fleet of Macs, and they store inputs and outputs in S3. What's the innovation here? Not trying to poo on this, but it looked like the most basic and obvious approach.
bouk 24 minutes ago [-]
Why is this a paper? Should've just been a blogpost. Maybe I don't understand academia
magicmicah85 37 minutes ago [-]
It's not a novel idea, but its provable that someone can take this same concept and do something truly groundbreaking. I wonder if there's value in the idea that you can join a supercomputer network of MAC/Nvidia GPUs as a way of getting off cloud and into "our cloud". As long as you offer compute, you have credit into the system to be able to support your own workloads that can't be done on just your hardware. Need to address concerns about privacy, abuse, etc, but Apple's idea here has some merit if applied right.
simbas 2 hours ago [-]
That's why the button is on the underside.
pjmlp 1 hours ago [-]
Apple rediscovering HPC clusters, but without OS X Server to serve alongside it.
Reading the “paper”, this is just a job runner built on Ollama.
Exo, and the teams at Apple that built the foundations Exo uses, actually use modern distributed compute.
eikenberry 42 minutes ago [-]
Sounds similar to Salad (salad.com), except for the differing hardware.
Apple has released some small models previously that seemed genuinely great, along with some quality research/efforts. I’m just not seeing the same level of depth here, am I missing something?
neuronexmachina 8 minutes ago [-]
I think it's basically just a write-up of something they're already using internally.
serhack_ 57 minutes ago [-]
true, shame on apple for the paper quality
veexx103 1 hours ago [-]
This project sounds good.
What is it actually like?
tw1984 56 minutes ago [-]
internal system, so the IT/HR department is the solution to leechers.
nothing new here.
railka 1 hours ago [-]
[dead]
porkbellyeee 33 minutes ago [-]
[dead]
sehw 51 minutes ago [-]
>Apple steals your electicity while you take a dump
Basically SETI for AI workloads? At least, this is the impression the landingpage left me with.
I am a bit lost, tbh.
There is no distributed execution of a single LLM across multiple GPUs using tensor parallelism here. Instead, it relies on task-level parallelism-breaking down a large workload into independent subtasks that run across separate machines. For example, generating embeddings for a million documents.
Maybe their chip team is already on the work, or already made, a server chip for AI purposes used internally, and doesn't have to talk about it yet.
Swift's main reason to go open source and have good Linux support was naturally for app developers to be able to use it on server side, which naturally wasn't going to be macOS.
I macOS wasn't required for developing iDevices apps, they would surely sell even less desktops.
Building the classification part now :) https://jeffyclassify.com/
https://arxiv.org/pdf/2610.12970
Shortest promoted paper I've seen from a FAANG.
Apple has released some small models previously that seemed genuinely great, along with some quality research/efforts. I’m just not seeing the same level of depth here, am I missing something?
What is it actually like?
nothing new here.