There are current open source projects working on training their own LLMs.

I'm aware of one very credible one that has applied for a TPU grant from Google worth under $200K to train the whole model.

I think laion.ai will probably get their first with their fleet of A100s though.