VentureBeat

New transformer architecture can make language models faster and resource-efficient

Large language models like ChatGPT and Llama-2 are notorious for their extensive memory and computational demands, making them costly to run. Trimming even a small fraction of their size can lead to ...
Android Police

Transformers: Everything you need to know about the deep learning model

I’ve been covering Android since 2023, when I joined Android Police, mostly focusing on AI and everything around Pixel and Galaxy phones. I’ve got a bachelor’s in IT with a major in AI, so I naturally ...

Sapient Intelligence launches HRM-Text, challenging the LLM monopoly with a brain-inspired foundation model trained on up to 1000x fewer tokens

Sapient Intelligence, an AGI research company, announces the launch of HRM-Text, an ultra-lean 1-billion-parameter reasoning language model, to deliver competitive reasoning and general performance ...
ZDNet

Microsoft and Nvidia create 105-layer, 530 billion parameter language model that needs 280 A100 GPUs, but it's still biased

Nvidia and Microsoft have teamed up to create the Megatron-Turing Natural Language Generation model, which the duo claims is the "most powerful monolithic transformer language model trained to date".
InfoWorld

Large language models: The foundations of generative AI

Large language models evolved alongside deep-learning neural networks and are critical to generative AI. Here's a first look, including the top LLMs and what they're used for today. Large language ...