Description
I'm running SIE using the official Docker deployment with the image image: ghcr.io/superlinked/sie-server:latest-cuda12-default
When trying to use the model lightonai/LightOnOCR-2-1B, model loading fails with the following error:
ModelLoadFailedError: Model 'lightonai/LightOnOCR-2-1B' failed to load (DEPENDENCY, attempts=1):
ImportError: cannot import name 'LightOnOcrForConditionalGeneration' from 'transformers'
Investigation
Inside the running container:
import transformers
print(transformers.__version__)
returns:
and:
from transformers import LightOnOcrForConditionalGeneration
fails with:
ImportError: cannot import name 'LightOnOcrForConditionalGeneration'
The bundled Transformers package used by SIE is:
/app/bundle-libs/transformers
I also verified that there is no lighton_ocr model implementation present under:
/app/bundle-libs/transformers/models
Expected behavior
Since lightonai/LightOnOCR-2-1B appears in the available model catalog, I would expect it to either:
- Load successfully, or
- Be excluded/marked as unsupported when the required backend is not available.
Question
Is lightonai/LightOnOCR-2-1B currently supported by the Docker release of SIE?
If not, is support planned in a future image/version, or is there a recommended workaround?
Thanks a lot
Mario
Description
I'm running SIE using the official Docker deployment with the image image: ghcr.io/superlinked/sie-server:latest-cuda12-default
When trying to use the model
lightonai/LightOnOCR-2-1B, model loading fails with the following error:Investigation
Inside the running container:
returns:
and:
fails with:
The bundled Transformers package used by SIE is:
I also verified that there is no
lighton_ocrmodel implementation present under:Expected behavior
Since
lightonai/LightOnOCR-2-1Bappears in the available model catalog, I would expect it to either:Question
Is
lightonai/LightOnOCR-2-1Bcurrently supported by the Docker release of SIE?If not, is support planned in a future image/version, or is there a recommended workaround?
Thanks a lot
Mario