Neocortex is a highly innovative advanced computing system ideal for foundation and large language models. Neocortex, which captures promising specialized innovative hardware technologies, is designed to vastly accelerate large deep learning (DL) models and high- performance computing (HPC) research in pursuit of science, discovery, and societal good.
Neocortex CS provides access to a Cerebras Wafer-Scale Cluster powered by a CS-3 system. The CS-3 system features a Cerebras WSE-3 (Wafer Scale Engine 3), the largest chip ever built, with 900,000 Sparse Linear Algebra Compute cores, 44 GB SRAM on-chip memory, 24 PB/s aggregate memory bandwidth and 245 Pb/s interconnect bandwidth. Hosted in the Cerebras Developer Cloud, the Neocortex cluster includes a MemoryX external memory node which provides virtually unlimited model weight capacity as well as a SwarmX Fabric interconnect that enables highly efficient scaling to additional CS3 units which can be added on demand. NLP, Vision and Multimodal deep learning models optimized to run on Cerebras hardware are available, supported by data processors, utilities, layers and losses. An LLM assistant can provide information and execute commands. The Cerebras SDK enables the development of new DL and HPC applications.