Spark NLP 5.3.2: Patch release

[maziyarpanahi]

---

🐛 Bug Fixes & Enhancements

• Over 40 new interactive Streamlit demos uploading example/demos #14175
• Fix and add notebooks to import models from Hugging Face Sparknlp 1010 adding missing notebooks to onnx and tensor flow transformers #14192
• Add ONNX and TensorFlow notebooks
• Fix XlnetForSeqeunceClassification and added XlnetForTokenClassificaiton
• Rename DistilBertForZeroShotClassification
• Add missing notebooks
• Update documentation for sparknlp.start() SPARKNLP-1026: Fix documentation for sparknlp.start() #14206
• Add MPNetEmbeddings to annotator Add MPNetEmbeddings to annotator #14202
• Fix XLMRoBertaForQuestionAnswering, XLMRoBertaForTokenClassification, and XLMRoBertaForSequenceClassification: Reverted the change in tfFile naming that was causing exceptions while loading and saving the models Fix XLMRoBertaForXX : revert the change in tfFile naming #14204

---

📖 Documentation

• Import models from TF Hub & HuggingFace
• Spark NLP Notebooks
• Models Hub with new models
• Spark NLP Articles
• Spark NLP in Action
• Spark NLP Documentation
• Spark NLP Scala APIs
• Spark NLP Python APIs

---

❤️ Community support

• Slack For live discussion with the Spark NLP community and the team
• GitHub Bug reports, feature requests, and contributions
• Discussions Engage with other community members, share ideas, and show off how you use Spark NLP!
• Medium Spark NLP articles
• YouTube Spark NLP video tutorials

---

Installation

Python

#PyPI

pip install spark-nlp==5.3.2

Spark Packages

spark-nlp on Apache Spark 3.0.x, 3.1.x, 3.2.x, 3.3.x, 3.4.x, and 3.5.x: (Scala 2.12):

spark-shell --packages com.johnsnowlabs.nlp:spark-nlp_2.12:5.3.2

pyspark --packages com.johnsnowlabs.nlp:spark-nlp_2.12:5.3.2

GPU

spark-shell --packages com.johnsnowlabs.nlp:spark-nlp-gpu_2.12:5.3.2

pyspark --packages com.johnsnowlabs.nlp:spark-nlp-gpu_2.12:5.3.2

Apple Silicon (M1 & M2)

spark-shell --packages com.johnsnowlabs.nlp:spark-nlp-silicon_2.12:5.3.2

pyspark --packages com.johnsnowlabs.nlp:spark-nlp-silicon_2.12:5.3.2

AArch64

spark-shell --packages com.johnsnowlabs.nlp:spark-nlp-aarch64_2.12:5.3.2

pyspark --packages com.johnsnowlabs.nlp:spark-nlp-aarch64_2.12:5.3.2

Maven

spark-nlp on Apache Spark 3.0.x, 3.1.x, 3.2.x, 3.3.x, 3.4.x, and 3.5.x:

<dependency>
    <groupId>com.johnsnowlabs.nlp</groupId>
    <artifactId>spark-nlp_2.12</artifactId>
    <version>5.3.2</version>
</dependency>

spark-nlp-gpu:

<dependency>
    <groupId>com.johnsnowlabs.nlp</groupId>
    <artifactId>spark-nlp-gpu_2.12</artifactId>
    <version>5.3.2</version>
</dependency>

spark-nlp-silicon:

<dependency>
    <groupId>com.johnsnowlabs.nlp</groupId>
    <artifactId>spark-nlp-silicon_2.12</artifactId>
    <version>5.3.2</version>
</dependency>

spark-nlp-aarch64:

<dependency>
    <groupId>com.johnsnowlabs.nlp</groupId>
    <artifactId>spark-nlp-aarch64_2.12</artifactId>
    <version>5.3.2</version>
</dependency>

FAT JARs

• CPU on Apache Spark 3.0.x/3.1.x/3.2.x/3.3.x/3.4.x/3.5.x: https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/jars/spark-nlp-assembly-5.3.2.jar

• GPU on Apache Spark 3.0.x/3.1.x/3.2.x/3.3.x/3.4.x/3.5.x: https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/jars/spark-nlp-gpu-assembly-5.3.2.jar

• M1 on Apache Spark 3.0.x/3.1.x/3.2.x/3.3.x/3.4.x/3.5.x: https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/jars/spark-nlp-silicon-assembly-5.3.2.jar

• AArch64 on Apache Spark 3.0.x/3.1.x/3.2.x/3.3.x/3.4.x/3.5.x: https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/jars/spark-nlp-aarch64-assembly-5.3.2.jar

What's Changed

• Add Spark NLP 5.3 to models.json [skip test] by @pabla in Add Spark NLP 5.3 to models.json [skip test] #14208
• Sparknlp 1010 adding missing notebooks to onnx and tensor flow transformers by @ahmedlone127 in Sparknlp 1010 adding missing notebooks to onnx and tensor flow transformers #14192
• Add MPNetEmbeddings to annotator by @maziyarpanahi in Add MPNetEmbeddings to annotator #14202
• Fix XLMRoBertaForXX : revert the change in tfFile naming by @maziyarpanahi in Fix XLMRoBertaForXX : revert the change in tfFile naming #14204
• SPARKNLP-1026: Fix documentation for sparknlp.start() by @DevinTDHa in SPARKNLP-1026: Fix documentation for sparknlp.start() #14206
• uploading example/demos by @AbdullahMubeenAnwar in uploading example/demos #14175
• release/523-release-candidate by @maziyarpanahi in release/523-release-candidate #14211
• Models hub by @maziyarpanahi in Models hub #14212

Full Changelog: 5.3.1...5.3.2

---

This discussion was created from the release Spark NLP 5.3.2: Patch release.