Moreh

About Moreh

Moreh is an artificial intelligence infrastructure solutions startup founded in September 2020 by Gangwon Jo, Jungho Park, and Jaejin Lee, graduates of Seoul National University's Manycore Programming Research Group. CEO Gangwon Jo brings over a decade of research experience in high-performance computing and was the lead architect of Korea's first GPU supercomputer. The company was established to address the infrastructure-level challenges of hyperscale AI, such as parallelization, cluster scalability, and performance optimization.

Moreh develops a full-stack AI infrastructure platform, MoAI, which functions as an alternative to Nvidia's CUDA, allowing AI models to run on a variety of graphic processing units (GPUs) and other AI accelerators with minimal to no code changes. This software stack is designed to optimize the entire lifecycle of hyperscale AI, from development and training to serving. The MoAI platform facilitates the efficient scaling of large language models (LLMs) by integrating with popular machine learning frameworks like PyTorch and TensorFlow and enabling the use of GPUs from manufacturers like AMD and AI accelerators from companies such as Tenstorrent. Key features include GPU virtualization, auto-scaling, heterogeneous accelerator utilization, and optimal routing and scheduling to maximize throughput and resource use.

The company's business model centers on providing its software solutions to enterprises, data center operators, and AI chip manufacturers, enabling them to build flexible and cost-effective AI infrastructures. A significant partnership is with KT (Korea Telecom), which utilizes Moreh's software in its hyperscale AI computing service and has invested in the company. Moreh has also secured strategic investments from AMD and formed partnerships with AI semiconductor firm Tenstorrent to jointly develop AI data center solutions. In January 2024, Moreh's 72-billion parameter model, MoMo-72B, ranked first on Hugging Face's Open LLM Leaderboard. Headquartered in Seoul, South Korea, with a U.S. incorporation and offices in Vietnam, the company has raised a total of $30 million, including a $22 million Series B round in 2023.