Near Protocol 公佈了構建世界上最大的開源人工智慧模型的雄心勃勃的計劃

1.4 兆參數模型將比 Meta 目前的開源 Llama 模型大 3.5 倍。

Layer-1 blockchain Near Protocol (NEAR) has announced plans to build the world’s largest open-source artificial intelligence (AI) model during the opening day of its Redacted conference in Bangkok, Thailand.

Layer-1 區塊鏈近協議 (NEAR) 在泰國曼谷舉行的 Redacted 會議開幕當天宣布計劃建立世界上最大的開源人工智慧 (AI) 模型。

The 1.4 trillion parameter model will be 3.5 times larger than Meta’s (META) current open-source Llama model. It will be created through competitive crowdsourced research and development (R&D) from thousands of contributors on the new Near AI Research hub.

1.4兆參數模型將是Meta（META）目前開源Llama模型的3.5倍。它將透過新的近人工智慧研究中心的數千名貢獻者的競爭性眾包研究和開發 (R&D) 來創建。

Participants will be able to join the training of a small 500 million parameter model starting on Nov. 10. Near’s AI models will grow in size and sophistication across seven models. Only the best contributors will make the leap to working on progressively more complex and larger models.

從 11 月 10 日開始，參與者將能夠參與一個包含 5 億參數的小型模型的訓練。只有最優秀的貢獻者才能跨越式發展，致力於逐漸變得更加複雜和更大的模型。

The models will be monetized, and privacy will be preserved via the use of encrypted Trusted Execution Environments (TEE) to reward contributors and encourage constant updating as the technology progresses.

這些模型將被貨幣化，並且透過使用加密的可信任執行環境（TEE）來保護隱私，以獎勵貢獻者並鼓勵隨著技術的進步不斷更新。

The project will be funded with token sales, Near co-founder Illia Polosukhin told Cointelegraph at the Redacted conference in Bangkok.

Near 聯合創始人 Illia Polosukhin 在曼谷舉行的 Redacted 會議上告訴 Cointelegraph，該專案將透過代幣銷售獲得資金。

“It costs about $160 million, so it’s a lot, obviously, but actually, in crypto, it is raiseable money,” he said. Near is one of the few crypto projects with the ability to realize such an ambitious undertaking: Polosukhin was one of the authors of the groundbreaking transformer research paper that led to ChatGPT, and co-founder Alex Skidanov worked at OpenAI in the lead-up to the era-defining model’s release in late 2022.

「它的成本約為 1.6 億美元，顯然這是一個很大的數字，但實際上，在加密貨幣領域，這是可以籌集的資金，」他說。 Near 是少數有能力實現如此雄心勃勃的事業的加密項目之一：Polosukhin 是導致 ChatGPT 的開創性變壓器研究論文的作者之一，聯合創始人 Alex Skidanov 在 OpenAI 的準備工作中工作過。劃時代的車型將於2022 年底發布。

Skidanov, who now heads up Near AI, conceded that training a model of this size and complexity would be a massive undertaking with a big hurdle to overcome.

現任近人工智慧負責人斯基丹諾夫承認，訓練如此規模和複雜性的模型將是一項艱鉅的任務，需要克服很大的障礙。

“To train a model of this size, you’d need tens of thousands of GPUs in one place, which wouldn’t be ideal. But to use a decentralized network of compute you’d need a new technology that doesn’t exist today because all the distributed training techniques we have require very fast interconnect,” he said.

「要訓練這種規模的模型，您需要在一個地方放置數萬個 GPU，這並不理想。但要使用去中心化的運算網絡，你需要一種目前還不存在的新技術，因為我們擁有的所有分散式訓練技術都需要非常快速的互連，」他說。

However, Skidanov added that emerging research from Deep Mind suggests it is possible.

然而，斯基達諾夫補充說，Deep Mind 的最新研究表明這是可能的。

“There is some emerging research from Deep Mind that shows you can actually do distributed training over slow interconnect with a technique called pipeline parallelism,” he said.

「Deep Mind 的一些新興研究表明，實際上可以使用一種稱為管道並行性的技術，透過慢速互連進行分散式訓練，」他說。

Polosukhin said he hasn’t spoken with existing projects like the Artificial Superintelligence Alliance but would be happy to see if there are synergies.

波洛蘇欣表示，他尚未與人工超級智慧聯盟等現有項目進行過交談，但很高興看到是否存在協同效應。

“Whatever happens, decentralized AI technology must win for all our sake. We had Edward Snowden as a guest speaker at the conference, and he painted a scary portrait of centralized AI turning the world into a giant surveillance state,” he said.

「無論發生什麼，去中心化人工智慧技術都必須為了我們所有人而獲勝。我們請愛德華·斯諾登作為會議的演講嘉賓，他描繪了一幅集中式人工智慧將世界變成一個巨大監視狀態的可怕肖像，」他說。

“This is probably the most important technology right now and probably in the future. And the reality is, if AI is controlled by one company, we effectively are going to do whatever that company says,” Snowden explained.

「這可能是現在最重要的技術，也可能是未來最重要的技術。現實是，如果人工智慧由一家公司控制，我們實際上就會按照該公司所說的去做，」史諾登解釋道。