Add ONNX support to all transformers in Spark NLP

Embeddings:
- [x] [AlbertEmbeddings](https://sparknlp.org/api/com/johnsnowlabs/nlp/embeddings/AlbertEmbeddings.html)
- [x] [BertEmbeddings](https://sparknlp.org/api/com/johnsnowlabs/nlp/embeddings/BertEmbeddings.html)
- [x] [BertSentenceEmbeddings](https://sparknlp.org/api/com/johnsnowlabs/nlp/embeddings/BertSentenceEmbeddings.html)
- [x] [CamemBertEmbeddings](https://sparknlp.org/api/com/johnsnowlabs/nlp/embeddings/CamemBertEmbeddings.html)
- [x] [DeBertaEmbeddings](https://sparknlp.org/api/com/johnsnowlabs/nlp/embeddings/DeBertaEmbeddings.html)
- [x] [DistilBertEmbeddings](https://sparknlp.org/api/com/johnsnowlabs/nlp/embeddings/DistilBertEmbeddings.html)
- [x] [LongformerEmbeddings](https://sparknlp.org/api/com/johnsnowlabs/nlp/embeddings/LongformerEmbeddings.html)
- [x] [RoBertaEmbeddings](https://sparknlp.org/api/com/johnsnowlabs/nlp/embeddings/RoBertaEmbeddings.html)
- [x] [RoBertaSentenceEmbeddings](https://sparknlp.org/api/com/johnsnowlabs/nlp/embeddings/RoBertaSentenceEmbeddings.html)
- [x] [XlmRoBertaEmbeddings](https://sparknlp.org/api/com/johnsnowlabs/nlp/embeddings/XlmRoBertaEmbeddings.html)
- [x] [XlmRoBertaSentenceEmbeddings](https://sparknlp.org/api/com/johnsnowlabs/nlp/embeddings/XlmRoBertaSentenceEmbeddings.html)
- [ ] ~[XlnetEmbeddings](https://sparknlp.org/api/com/johnsnowlabs/nlp/embeddings/XlnetEmbeddings.html)~ not supported
- [x] [E5Embeddings](https://sparknlp.org/api/com/johnsnowlabs/nlp/embeddings/E5Embeddings.html)
- [x] [InstructorEmbeddings](https://sparknlp.org/api/com/johnsnowlabs/nlp/embeddings/InstructorEmbeddings.html)
- [x] [MPNetEmbeddings](https://sparknlp.org/api/com/johnsnowlabs/nlp/embeddings/MPNetEmbeddings.html)

Classifiers:

- [x] [AlbertForQuestionAnswering](https://sparknlp.org/api/com/johnsnowlabs/nlp/annotators/classifier/dl/AlbertForQuestionAnswering.html)
- [x] [AlbertForSequenceClassification](https://sparknlp.org/api/com/johnsnowlabs/nlp/annotators/classifier/dl/AlbertForSequenceClassification.html)
- [x] [AlbertForTokenClassification](https://sparknlp.org/api/com/johnsnowlabs/nlp/annotators/classifier/dl/AlbertForTokenClassification.html)
- [x] [BertForQuestionAnswering](https://sparknlp.org/api/com/johnsnowlabs/nlp/annotators/classifier/dl/BertForQuestionAnswering.html)
- [x] [BertForSequenceClassification](https://sparknlp.org/api/com/johnsnowlabs/nlp/annotators/classifier/dl/BertForSequenceClassification.html)
- [x] [BertForTokenClassification](https://sparknlp.org/api/com/johnsnowlabs/nlp/annotators/classifier/dl/BertForTokenClassification.html)
- [x] [BertForZeroShotClassification](https://sparknlp.org/api/com/johnsnowlabs/nlp/annotators/classifier/dl/BertForZeroShotClassification.html)
- [x] [CamemBertForQuestionAnswering](https://sparknlp.org/api/com/johnsnowlabs/nlp/annotators/classifier/dl/CamemBertForQuestionAnswering.html)
- [x] [CamemBertForSequenceClassification](https://sparknlp.org/api/com/johnsnowlabs/nlp/annotators/classifier/dl/CamemBertForSequenceClassification.html)
- [x] [CamemBertForTokenClassification](https://sparknlp.org/api/com/johnsnowlabs/nlp/annotators/classifier/dl/CamemBertForTokenClassification.html)
- [x] [DeBertaForQuestionAnswering](https://sparknlp.org/api/com/johnsnowlabs/nlp/annotators/classifier/dl/DeBertaForQuestionAnswering.html)
- [x] [DeBertaForSequenceClassification](https://sparknlp.org/api/com/johnsnowlabs/nlp/annotators/classifier/dl/DeBertaForSequenceClassification.html)
- [x] [DeBertaForTokenClassification](https://sparknlp.org/api/com/johnsnowlabs/nlp/annotators/classifier/dl/DeBertaForTokenClassification.html)
- [x] [DistilBertForQuestionAnswering](https://sparknlp.org/api/com/johnsnowlabs/nlp/annotators/classifier/dl/DistilBertForQuestionAnswering.html)
- [x] [DistilBertForSequenceClassification](https://sparknlp.org/api/com/johnsnowlabs/nlp/annotators/classifier/dl/DistilBertForSequenceClassification.html)
- [x] [DistilBertForTokenClassification](https://sparknlp.org/api/com/johnsnowlabs/nlp/annotators/classifier/dl/DistilBertForTokenClassification.html)
- [x] [DistilBertForZeroShotClassification](https://sparknlp.org/api/com/johnsnowlabs/nlp/annotators/classifier/dl/DistilBertForZeroShotClassification.html)
- [x] [LongformerForQuestionAnswering](https://sparknlp.org/api/com/johnsnowlabs/nlp/annotators/classifier/dl/LongformerForQuestionAnswering.html)
- [x] [LongformerForSequenceClassification](https://sparknlp.org/api/com/johnsnowlabs/nlp/annotators/classifier/dl/LongformerForSequenceClassification.html)
- [x] [LongformerForTokenClassification](https://sparknlp.org/api/com/johnsnowlabs/nlp/annotators/classifier/dl/LongformerForTokenClassification.html)
- [x] [RoBertaForQuestionAnswering](https://sparknlp.org/api/com/johnsnowlabs/nlp/annotators/classifier/dl/RoBertaForQuestionAnswering.html)
- [x] [RoBertaForSequenceClassification](https://sparknlp.org/api/com/johnsnowlabs/nlp/annotators/classifier/dl/RoBertaForSequenceClassification.html)
- [x] [RoBertaForTokenClassification](https://sparknlp.org/api/com/johnsnowlabs/nlp/annotators/classifier/dl/RoBertaForTokenClassification.html)
- [x] [RoBertaForZeroShotClassification](https://sparknlp.org/api/com/johnsnowlabs/nlp/annotators/classifier/dl/RoBertaForZeroShotClassification.html)
- [ ]~[TapasForQuestionAnswering]~ not supported
- [x] [XlmRoBertaForQuestionAnswering](https://sparknlp.org/api/com/johnsnowlabs/nlp/annotators/classifier/dl/XlmRoBertaForQuestionAnswering.html)
- [x] [XlmRoBertaForSequenceClassification](https://sparknlp.org/api/com/johnsnowlabs/nlp/annotators/classifier/dl/XlmRoBertaForSequenceClassification.html)
- [x] [XlmRoBertaForTokenClassification](https://sparknlp.org/api/com/johnsnowlabs/nlp/annotators/classifier/dl/XlmRoBertaForTokenClassification.html)
- [x] [XlmRoBertaForZeroShotClassification](https://sparknlp.org/api/com/johnsnowlabs/nlp/annotators/classifier/dl/XlmRoBertaForZeroShotClassification.html)
- [ ]~[XlnetForSequenceClassification] not supported~
- [ ]~[XlnetForTokenClassification] not supported~

Seq2Seq:

- [x] [BartTransformer](https://sparknlp.org/api/com/johnsnowlabs/nlp/annotators/seq2seq/BartTransformer.html)
- [x] [GPT2Transformer](https://sparknlp.org/api/com/johnsnowlabs/nlp/annotators/seq2seq/GPT2Transformer.html)
- [x] [MarianTransformer](https://sparknlp.org/api/com/johnsnowlabs/nlp/annotators/seq2seq/MarianTransformer.html)
- [x] [T5Transformer](https://sparknlp.org/api/com/johnsnowlabs/nlp/annotators/seq2seq/T5Transformer.html)

Speech To Text:

- [x] [HubertForCTC](https://sparknlp.org/api/com/johnsnowlabs/nlp/annotators/audio/HubertForCTC.html)
- [x] #14363
- [x] [WhisperForCTC](https://sparknlp.org/api/com/johnsnowlabs/nlp/annotators/audio/WhisperForCTC.html)

Image Classification:

- [x] [ConvNextForImageClassification](https://sparknlp.org/api/com/johnsnowlabs/nlp/annotators/cv/ConvNextForImageClassification.html)
- [x] [SwinForImageClassification](https://sparknlp.org/api/com/johnsnowlabs/nlp/annotators/cv/SwinForImageClassification.html)
- [x] [ViTForImageClassification](https://sparknlp.org/api/com/johnsnowlabs/nlp/annotators/cv/ViTForImageClassification.html)

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Add ONNX support to all transformers in Spark NLP #13866

Metadata

Assignees

Labels

Type

Projects

Milestone

Relationships

Development

Add ONNX support to all transformers in Spark NLP #13866

Description

Metadata

Metadata

Assignees

Labels

Type

Projects

Milestone

Relationships

Development

Issue actions