View RSS Feed

newdigital

  1. Working with ONNX models in float16 and float8 formats

    by , 03-03-2024 at 10:45 AM
    With the advancement of machine learning and artificial intelligence technologies, there is a growing need to optimize processes for working with models. The efficiency of model operation directly depends on the data formats used to represent them. In recent years, several new data types have emerged, specifically designed for working with deep learning models.

    In this article, we will focus on two such new data formats - float16 and float8, which are beginning to be actively used
    ...
    Categories
    Uncategorized