Etched.ai
About Etched.ai
Etched.ai develops Sohu, the world's first ASIC specifically designed for transformer models, enabling AI computations to be executed at least ten times faster and more cost-effectively than traditional GPUs. This technology allows for real-time processing of large-scale AI models, enhancing applications such as voice agents and content generation.
```xml <problem> General-purpose GPUs are inefficient and costly for running large-scale transformer models, limiting the feasibility of real-time AI applications. Existing hardware solutions struggle to keep pace with the increasing size and complexity of modern AI models, hindering advancements in areas like voice agents and content generation. </problem> <solution> Etched.ai has developed Sohu, an application-specific integrated circuit (ASIC) designed specifically for transformer models. By etching the transformer architecture directly into silicon, Sohu accelerates AI computations, achieving significantly higher throughput and lower costs compared to traditional GPUs. This specialized hardware enables real-time processing of large language models, facilitating applications that were previously impractical due to computational constraints. </solution> <features> - Custom ASIC architecture optimized for transformer model inference - Greater than 500,000 tokens/sec Llama 70B throughput - Runs AI models an order of magnitude faster and cheaper than GPUs - Supports real-time voice agents capable of ingesting thousands of words in milliseconds - Enables advanced coding applications with parallel tree search capabilities - Supports multicast speculative decoding for real-time content generation - Designed to run trillion-parameter models - Fully open-source software stack - 144 GB HBM3E memory per chip - Supports Mixture of Experts (MoE) and other transformer variants </features> <target_audience> The primary target audience includes companies and researchers working on large language models, real-time AI applications, and other computationally intensive AI tasks. </target_audience> ```
What does Etched.ai do?
Etched.ai develops Sohu, the world's first ASIC specifically designed for transformer models, enabling AI computations to be executed at least ten times faster and more cost-effectively than traditional GPUs. This technology allows for real-time processing of large-scale AI models, enhancing applications such as voice agents and content generation.
Where is Etched.ai located?
Etched.ai is based in San Francisco, United States.
When was Etched.ai founded?
Etched.ai was founded in 2022.
How much funding has Etched.ai raised?
Etched.ai has raised 125370000.
Who founded Etched.ai?
Etched.ai was founded by Dale Sparling.
- Dale Sparling - CEO
- Location
- San Francisco, United States
- Founded
- 2022
- Funding
- 125370000
- Employees
- 104 employees
- Major Investors
- Primary Venture Partners, Positive Sum