MPS backend enabled? #94
|
Hi, I'm trying run an exported version of llama 3.2 with the mps backend. Executorch has no examples on exporting with mps for llama 3.2, but since it has the same architecture I'm thinking it should be the same command. I was curios if it's enabled in this library too, since it's not mentioned anywhere |
Replies: 2 comments 2 replies
|
Hi, we currently do not support export for mps backend. For now we are focusing on working with XNNPACK and CoreML, but it is possible that we will add MPS support in the future. |
|
is it possible to add the needed packages as modules? and enable them on install depending on needs? |
|
Yes it is, however you would need to modify our library by adding mps frameworks to ios project, we will look into adding it in v0.3.0 which will be released at the end of this month. |
|
awesome! looking forward to it |
Hi, we currently do not support export for mps backend. For now we are focusing on working with XNNPACK and CoreML, but it is possible that we will add MPS support in the future.