The company that announced its first custom inference chip, called Jalapeño, has tested the chip and its environment since the announcement; the results show more intelligence per watt and faster responses, simultaneously increasing throughput and reducing latency without degrading energy efficiency.
AI-generated text
The company's Jalapeño inference chip shows significant efficiency and latency improvements
The company that announced its first custom inference chip, called Jalapeño, has tested the chip and its environment since the announcement; the results show more intelligence per watt and faster…
