Developers

 

Default Component References

See and also the John Snow Labs Modelhub and also the John Snow Labs Model Repository for fruther information about the models and pipelines.

Each String in the NLU reference column can be passed to nlu.load() to get the corresponding model wrapped inside of a NLU Pipeline.

NLU reference Spark NLP Reference Component Type
lang detect_language_20 pipe
lang.7 detect_language_7 pipe
lang.20 detect_language_20 pipe
classify.lang detect_language_20 pipe
classify.lang.20 detect_language_20 pipe
classify.lang.7 detect_language_7 pipe
classify analyze_sentiment pipe
explain explain_document_ml pipe
explain.ml explain_document_ml pipe
explain.dl explain_document_dl pipe
ner recognize_entities_dl pipe
ner.dl recognize_entities_dl pipe
ner.bert recognize_entities_bert pipe
ner.onto onto_recognize_entities_sm pipe
ner.onto.sm onto_recognize_entities_sm pipe
ner.onto.lg onto_recognize_entities_lg pipe
match.datetime match_datetime pipe
match.text text_matcher model
match.regex regex_matcher model
match.pattern match_pattern pipe
match.chunks match_chunks pipe
match.phrases match_phrases pipe
clean.stop clean_stop pipe
clean.pattern clean_pattern pipe
clean.slang clean_slang pipe
spell check_spelling_dl pipe
sentiment analyze_sentiment pipe
emotion classifierdl_use_emotion model
sentiment.imdb analyze_sentimentdl_use_imdb pipe
sentiment.imdb.use analyze_sentimentdl_use_imdb pipe
sentiment.twitter.use analyze_sentimentdl_use_twitter pipe
sentiment.twitter analyze_sentimentdl_use_twitter pipe
dependency dependency_parse pipe
tokenize spark_nlp_tokenizer model
stem stemmer model
norm normalizer model
chunk default_chunker model
embed_chunk chunk_embeddings model
ngram ngram model
lemma lemma_antbnc model
lemma.antbnc lemma_antbnc model
pos pos_anc model
pos.anc pos_anc model
pos.ud_ewt pos_ud_ewt model
ner.dl.glove.6B_100d ner_dl model
ner.dl.bert ner_dl_bert model
ner.onto.glove.6B_100d onto_100 model
ner.onto.glove.6B_300d onto_300 model
sentence_detector ner_dl_sentence model
sentence_detector.deep ner_dl_sentence model
spell.norivg spellcheck_norvig model
sentiment.vivekn sentiment_vivekn model
dep.untyped.conllu dependency_conllu model
dep.untyped dependency_conllu.untyped model
dep dependency_typed_conllu model
dep.typed dependency_typed_conllu model
dep.typed.conllu dependency_typed_conllu model
stopwords stopwords_en model
embed glove_100d model
glove glove_100d model
embed.glove glove_100d model
embed.glove.100d glove_100d model
bert small_bert_L2_128 model
covidbert covidbert_large_uncased model
en.toxic multiclassifierdl_use_toxic model
en.e2e multiclassifierdl_use_e2e model
embed.bert bert_base_uncased model
embed.bert_base_uncased bert_base_uncased model
embed.bert_base_cased bert_base_cased model
embed.bert_large_uncased bert_large_uncased model
embed.bert_large_cased bert_large_cased model
biobert biobert_pubmed_base_cased model
embed.biobert biobert_pubmed_base_cased model
embed.biobert_pubmed_base_cased biobert_pubmed_base_cased model
embed.biobert_pubmed_large_cased biobert_pubmed_large_cased model
embed.biobert_pmc_base_cased biobert_pmc_base_cased model
embed.biobert_pubmed_pmc_base_cased biobert_pubmed_pmc_base_cased model
embed.biobert_clinical_base_cased biobert_clinical_base_cased model
embed.biobert_discharge_base_cased biobert_discharge_base_cased model
elmo elmo model
embed.electra electra_small_uncased model
electra electra_small_uncased model
e2e multiclassifierdl_use_e2e model
embed.elmo elmo model
embed_sentence tfhub_use model
embed_sentence.small_bert_L2_128 sent_small_bert_L2_128 model
embed_sentence.bert sent_small_bert_L2_128 model
embed_sentence.electra sent_electra_small_uncased model
embed_sentence.use tfhub_use model
use tfhub_use model
embed_sentence.tfhub_use tfhub_use model
embed_sentence.use_lg tfhub_use_lg model
embed_sentence.tfhub_use_lg tfhub_use_lg model
albert albert_base_uncased model
embed.albert_base_uncased albert_base_uncased model
embed.albert_large_uncased albert_large_uncased model
embed.albert_xlarge_uncased albert_xlarge_uncased model
embed.albert_xxlarge_uncased albert_xxlarge_uncased model
embed.xlnet xlnet_base_cased model
xlnet xlnet_base_cased model
embed.xlnet_base_cased xlnet_base_cased model
embed.xlnet_large_cased xlnet_large_cased model
classify.trec6.use classifierdl_use_trec6 model
classify.trec50.use classifierdl_use_trec50 model
classify.questions classifierdl_use_trec50 model
questions classifierdl_use_trec50 model
classify.spam.use classifierdl_use_spam model
classify.fakenews.use classifierdl_use_fakenews model
classify.emotion.use classifierdl_use_emotion model
classify.cyberbullying.use classifierdl_use_cyberbullying model
classify.sarcasm.use classifierdl_use_sarcasm model
sentiment.imdb.glove sentimentdl_glove_imdb model
classify.trec6 classifierdl_use_trec6 model
classify.trec50 classifierdl_use_trec50 model
classify.spam classifierdl_use_spam model
spam classifierdl_use_spam model
toxic multiclassifierdl_use_toxic multiclassifierdl_use_toxic
classify.fakenews classifierdl_use_fakenews model
classify.emotion classifierdl_use_emotion model
classify.cyberbullying classifierdl_use_cyberbullying model
cyberbullying classifierdl_use_cyberbullying model
cyber classifierdl_use_cyberbullying model
classify.sarcasm classifierdl_use_sarcasm model
sarcasm classifierdl_use_sarcasm model
embed.glove.840B_300 glove_840B_300 model
embed.glove.6B_300 glove_6B_300 model
embed.bert_multi_cased bert_multi_cased model
classify.wiki_7 ld_wiki_7 model
classify.wiki_20 ld_wiki_20 model
yake yake model

Model references

Language NLU Model Reference Spark NLP Model reference
nl nl.lemma lemma
nl nl.pos pos_ud_alpino
nl nl.pos.ud_alpino pos_ud_alpino
nl nl.ner wikiner_6B_100
nl nl.ner.wikiner wikiner_6B_100
nl nl.ner.wikiner.glove.6B_100 wikiner_6B_100
nl nl.ner.wikiner.glove.6B_300 wikiner_6B_300
nl nl.ner.wikiner.glove.840B_300 wikiner_840B_300
en en.stem stemmer
en en.tokenize spark_nlp_tokenizer
en en.norm norm
en en.chunk default_chunker
en en.ngram ngram
en en.embed_chunk chunk_embeddings
en en.lemma lemma_antbnc
en en.lemma.antbnc lemma_antbnc
en en.pos pos_anc
en en.pos.anc pos_anc
en en.pos.ud_ewt pos_ud_ewt
en en.ner ner_dl
en en.ner.dl ner_dl
en en.ner.dl.glove.6B_100d ner_dl
en en.ner.dl.bert ner_dl_bert
en en.ner.onto onto_100
en en.ner.onto.glove.6B_100d onto_100
en en.ner.onto.glove.6B_300d onto_300
en en.ner.glove.100d ner_dl_sentence
en en.spell.symmetric spellcheck_sd
en en.spell.norvig spellcheck_norvig
en en.sentiment.vivekn sentiment_vivekn
en en.dep.untyped.conllu dependency_conllu
en en.dep.untyped dependency_conllu
en en.dep dependency_typed_conllu
en en.dep.typed dependency_typed_conllu
en en.dep.typed.conllu dependency_typed_conllu
en en.stopwords stopwords_en
en en.glove glove_100d
en en.embed glove_100d
en en.embed.glove glove_100d
en en.embed.glove.100d glove_100d
en en.bert bert_base_uncased
en en.embed.bert bert_base_uncased
en en.embed.bert.base_uncased bert_base_uncased
en en.embed.bert.base_cased bert_base_cased
en en.embed.bert.large_uncased bert_large_uncased
en en.embed.bert.large_cased bert_large_cased
en biobert biobert_pubmed_base_cased
en en.embed.biobert biobert_pubmed_base_cased
en en.embed.biobert.pubmed_base_cased biobert_pubmed_base_cased
en en.embed.biobert.pubmed_large_cased biobert_pubmed_large_cased
en en.embed.biobert.pmc_base_cased biobert_pmc_base_cased
en en.embed.biobert.pubmed_pmc_base_cased biobert_pubmed_pmc_base_cased
en en.embed.biobert.clinical_base_cased biobert_clinical_base_cased
en en.embed.biobert.discharge_base_cased biobert_discharge_base_cased
en en.embed.elmo elmo
en en.embed_sentence tfhub_use
en en.embed_sentence.use tfhub_use
en en.use tfhub_use
en en.embed.use tfhub_use
en en.embed_sentence.tfhub_use tfhub_use
en en.embed_sentence.use.lg tfhub_use_lg
en en.embed_sentence.tfhub_use.lg tfhub_use_lg
en en.embed_sentence.albert albert_base_uncased
en en.albert albert_base_uncased
en en.embed.albert albert_base_uncased
en en.embed.albert.base_uncased albert_base_uncased
en en.embed.albert.large_uncased albert_large_uncased
en en.embed.albert.xlarge_uncased albert_xlarge_uncased
en en.embed.albert.xxlarge_uncased albert_xxlarge_uncased
en en.embed.xlnet xlnet_base_cased
en en.xlnet xlnet_base_cased
en en.embed.xlnet_base_cased xlnet_base_cased
en en.embed.xlnet_large_cased xlnet_large_cased
en en.classify.trec6.use classifierdl_use_trec6
en en.classify.trec50.use classifierdl_use_trec50
en en.classify.questions classifierdl_use_trec50
en en.classify.spam.use classifierdl_use_spam
en en.classify.fakenews.use classifierdl_use_fakenews
en en.classify.emotion.use classifierdl_use_emotion
en en.classify.cyberbullying.use classifierdl_use_cyberbullying
en en.classify.sarcasm.use classifierdl_use_sarcasm
en en.sentiment.imdb.use sentimentdl_use_imdb
en en.sentiment.twitter.use sentimentdl_use_twitter
en en.sentiment.imdb.glove sentimentdl_glove_imdb
en en.classify.trec6 classifierdl_use_trec6
en en.classify.trec50 classifierdl_use_trec50
en en.classify.spam classifierdl_use_spam
en en.classify.fakenews classifierdl_use_fakenews
en en.classify.emotion classifierdl_use_emotion
en en.classify.cyberbullying classifierdl_use_cyberbullying
en en.classify.sarcasm classifierdl_use_sarcasm
en en.sentiment.twitter sentimentdl_use_twitter
en en.sentiment.imdb sentimentdl_glove_imdb
en en.yake yake
en en.embed.electra electra_small_uncased
en en.embed.electra.small_uncased electra_small_uncased
en en.embed.electra.base_uncased electra_base_uncased
en en.embed.electra.large_uncased electra_large_uncased
en en.embed.covidbert covidbert_large_uncased
en en.embed.covidbert.large_uncased covidbert_large_uncased
en en.embed.bert.small_L2_128 small_bert_L2_128
en en.embed.bert.small_L4_128 small_bert_L4_128
en en.embed.bert.small_L6_128 small_bert_L6_128
en en.embed.bert.small_L8_128 small_bert_L8_128
en en.embed.bert.small_L10_128 small_bert_L10_128
en en.embed.bert.small_L12_128 small_bert_L12_128
en en.embed.bert.small_L2_256 small_bert_L2_256
en en.embed.bert.small_L4_256 small_bert_L4_256
en en.embed.bert.small_L6_256 small_bert_L6_256
en en.embed.bert.small_L8_256 small_bert_L8_256
en en.embed.bert.small_L10_256 small_bert_L10_256
en en.embed.bert.small_L12_256 small_bert_L12_256
en en.embed.bert.small_L2_512 small_bert_L2_512
en en.embed.bert.small_L4_512 small_bert_L4_512
en en.embed.bert.small_L6_512 small_bert_L6_512
en en.embed.bert.small_L8_512 small_bert_L8_512
en en.embed.bert.small_L10_512 small_bert_L10_512
en en.embed.bert.small_L12_512 small_bert_L12_512
en en.embed.bert.small_L2_768 small_bert_L2_768
en en.embed.bert.small_L4_768 small_bert_L4_768
en en.embed.bert.small_L6_768 small_bert_L6_768
en en.embed.bert.small_L8_768 small_bert_L8_768
en en.embed.bert.small_L10_768 small_bert_L10_768
en en.embed.bert.small_L12_768 small_bert_L12_768
en en.embed_sentence.electra sent_electra_small_uncased
en en.embed_sentence.electra_small_uncased sent_electra_small_uncased
en en.embed_sentence.electra_base_uncased sent_electra_base_uncased
en en.embed_sentence.electra_large_uncased sent_electra_large_uncased
en en.embed_sentence.bert sent_bert_base_uncased
en en.embed_sentence.bert_base_uncased sent_bert_base_uncased
en en.embed_sentence.bert_base_cased sent_bert_base_cased
en en.embed_sentence.bert_large_uncased sent_bert_large_uncased
en en.embed_sentence.bert_large_cased sent_bert_large_cased
en en.embed_sentence.biobert.pubmed_base_cased sent_biobert_pubmed_base_cased
en en.embed_sentence.biobert.pubmed_large_cased sent_biobert_pubmed_large_cased
en en.embed_sentence.biobert.pmc_base_cased sent_biobert_pmc_base_cased
en en.embed_sentence.biobert.pubmed_pmc_base_cased sent_biobert_pubmed_pmc_base_cased
en en.embed_sentence.biobert.clinical_base_cased sent_biobert_clinical_base_cased
en en.embed_sentence.biobert.discharge_base_cased sent_biobert_discharge_base_cased
en en.embed_sentence.covidbert.large_uncased sent_covidbert_large_uncased
en en.embed_sentence.small_bert_L2_128 sent_small_bert_L2_128
en en.embed_sentence.small_bert_L4_128 sent_small_bert_L4_128
en en.embed_sentence.small_bert_L6_128 sent_small_bert_L6_128
en en.embed_sentence.small_bert_L8_128 sent_small_bert_L8_128
en en.embed_sentence.small_bert_L10_128 sent_small_bert_L10_128
en en.embed_sentence.small_bert_L12_128 sent_small_bert_L12_128
en en.embed_sentence.small_bert_L2_256 sent_small_bert_L2_256
en en.embed_sentence.small_bert_L4_256 sent_small_bert_L4_256
en en.embed_sentence.small_bert_L6_256 sent_small_bert_L6_256
en en.embed_sentence.small_bert_L8_256 sent_small_bert_L8_256
en en.embed_sentence.small_bert_L10_256 sent_small_bert_L10_256
en en.embed_sentence.small_bert_L12_256 sent_small_bert_L12_256
en en.embed_sentence.small_bert_L2_512 sent_small_bert_L2_512
en en.embed_sentence.small_bert_L4_512 sent_small_bert_L4_512
en en.embed_sentence.small_bert_L6_512 sent_small_bert_L6_512
en en.embed_sentence.small_bert_L8_512 sent_small_bert_L8_512
en en.embed_sentence.small_bert_L10_512 sent_small_bert_L10_512
en en.embed_sentence.small_bert_L12_512 sent_small_bert_L12_512
en en.embed_sentence.small_bert_L2_768 sent_small_bert_L2_768
en en.embed_sentence.small_bert_L4_768 sent_small_bert_L4_768
en en.embed_sentence.small_bert_L6_768 sent_small_bert_L6_768
en en.embed_sentence.small_bert_L8_768 sent_small_bert_L8_768
en en.embed_sentence.small_bert_L10_768 sent_small_bert_L10_768
en en.embed_sentence.small_bert_L12_768 sent_small_bert_L12_768
en en.classify.toxic multiclassifierdl_use_toxic
en en.toxic multiclassifierdl_use_toxic
en en.e2e multiclassifierdl_use_e2e
en en.classify.toxic.sm multiclassifierdl_use_toxic_sm
en en.classify.e2e multiclassifierdl_use_e2e
fr fr.lemma lemma
fr fr.pos pos_ud_gsd
fr fr.pos.ud_gsd pos_ud_gsd
fr fr.ner wikiner_840B_300
fr fr.ner.wikiner wikiner_840B_300
fr fr.ner.wikiner.glove.840B_300 wikiner_840B_300
fr fr.stopwords stopwords_fr
fr fr.ner.wikiner.glove.6B_300 wikiner_6B_300
de de.lemma lemma
de de.pos.ud_hdt pos_ud_hdt
de de.pos pos_ud_hdt
de de.ner wikiner_840B_300
de de.ner.wikiner wikiner_840B_300
de de.ner.wikiner.glove.840B_300 wikiner_840B_300
de de.stopwords stopwords_de
de de.ner.wikiner.glove.6B_300 wikiner_6B_300
it it.lemma lemma_dxc
it it.lemma.dxc lemma_dxc
it it.sentiment.dxc sentiment_dxc
it it.sentiment sentiment_dxc
it it.pos pos_ud_isdt
it it.pos.ud_isdt pos_ud_isdt
it it.ner wikiner_840B_300
it it.ner.wikiner.glove.6B_300 wikiner_6B_300
it it.stopwords stopwords_it
nb nb.lemma lemma
nb nb.pos.ud_bokmaal pos_ud_bokmaal
no no.ner norne_6B_100
no no.ner.norne norne_6B_100
no no.ner.norne.glove.6B_100 norne_6B_100
no no.ner.norne.glove.6B_300 norne_6B_300
no no.ner.norne.glove.840B_300 norne_840B_300
nn nn.pos pos_ud_nynorsk
nn nn.pos.ud_nynorsk pos_ud_nynorsk
pl pl.lemma lemma
pl pl.pos pos_ud_lfg
pl pl.pos.ud_lfg pos_ud_lfg
pl pl.ner wikiner_6B_100
pl pl.ner.wikiner wikiner_6B_100
pl pl.ner.wikiner.glove.6B_100 wikiner_6B_100
pl pl.ner.wikiner.glove.6B_300 wikiner_6B_300
pl pl.ner.wikiner.glove.840B_300 wikiner_840B_300
pl pl.stopwords stopwords_pl
pt pt.lemma lemma
pt pt.pos.ud_bosque pos_ud_bosque
pt pt.pos pos_ud_bosque
pt pt.ner wikiner_6B_100
pt pt.ner.wikiner.glove.6B_100 wikiner_6B_100
pt pt.ner.wikiner.glove.6B_300 wikiner_6B_300
pt pt.ner.wikiner.glove.840B_300 wikiner_840B_300
pt pt.stopwords stopwords_pt
pt pt.bert bert_portuguese_base_cased
pt pt.bert.cased bert_portuguese_base_cased
pt pt.ner.large bert_portuguese_large_cased
ru ru.lemma lemma
ru ru.pos.ud_gsd pos_ud_gsd
ru ru.pos pos_ud_gsd
ru ru.ner wikiner_6B_100
ru ru.ner.wikiner wikiner_6B_100
ru ru.ner.wikiner.glove.6B_100 wikiner_6B_100
ru ru.ner.wikiner.glove.6B_300 wikiner_6B_300
ru ru.ner.wikiner.glove.840B_300 wikiner_840B_300
ru ru.stopwords stopwords_ru
es es.lemma lemma
es es.pos pos_ud_gsd
es es.pos.ud_gsd pos_ud_gsd
es es.ner wikiner_6B_100
es es.ner.wikiner wikiner_6B_100
es es.ner.wikiner.glove.6B_100 wikiner_6B_100
es es.ner.wikiner.glove.6B_300 wikiner_6B_300
es es.ner.wikiner.glove.840B_300 wikiner_840B_300
es es.stopwords_es stopwords_es
af af.stopwords stopwords_af
ar ar.stopwords_ar stopwords_ar
hy hy.stopwords stopwords_hy
hy hy.lemma lemma
hy hy.pos pos_ud_armtdp
eu eu.stopwords stopwords_eu
eu eu.lemma lemma
eu eu.pos pos_ud_bdt
bn bn.stopwords stopwords_bn
br br.stopwords stopwords_br
br br.lemma lemma
br br.pos pos_ud_keb
bg bg.lemma lemma
bg bg.pos pos_ud_btb
bg bg.pos.ud_btb pos_ud_btb
bg bg.stopwords stopwords_bg
ca ca.stopwords stopwords_ca
ca ca.lemma lemma
ca ca.pos pos_ud_ancora
cs cs.lemma lemma
cs cs.pos pos_ud_pdt
cs cs.pos.ud_pdt pos_ud_pdt
cs cs.stopwords stopwords_cs
eo eo.stopwords stopwords_eo
fi fi.lemma lemma
fi fi.pos.ud_tdt pos_ud_tdt
fi fi.pos pos_ud_tdt
fi fi.stopwords stopwords_fi
fi fi.ner wikiner_6B_100
fi fi.ner.6B_100 wikiner_6B_100
fi fi.ner.6B_300 wikiner_6B_300
fi fi.ner.840B_300 wikiner_840B_300
fi fi.embed.bert. bert_finnish_cased
fi fi.embed.bert.cased. bert_finnish_cased
fi fi.embed.bert.uncased. bert_finnish_uncased
fi fi.embed_sentence sent_bert_finnish_cased
fi fi.embed_sentence.bert.cased sent_bert_finnish_cased
fi fi.embed_sentence.bert.uncased sent_bert_finnish_uncased
gl gl.stopwords stopwords_gl
gl gl.lemma lemma
gl gl.pos pos_ud_treegal
el el.lemma lemma
el el.pos pos_ud_gdt
el el.pos.ud_gdt pos_ud_gdt
el el.stopwords stopwords_el
ha ha.stopwords stopwords_ha
he he.stopwords stopwords_he
hi hi.stopwords stopwords_hi
hi hi.lemma lemma
hi hi.pos pos_ud_hdtb
hu hu.lemma lemma
hu hu.pos pos_ud_szeged
hu hu.pos.ud_szeged pos_ud_szeged
hu hu.stopwords stopwords_hu
id id.stopwords stopwords_id
id id.lemma lemma
id id.pos pos_ud_gsd
ga ga.stopwords stopwords_ga
ga ga.lemma lemma
ga ga.pos pos_ud_idt
da da.lemma lemma
da da.pos pos_ud_ddt
da da.ner dane_ner_6B_100
da da.ner.6B100D dane_ner_6B_100
da da.ner.6B300D dane_ner_6B_300
da da.ner840B100D. dane_ner_840B_100
ja ja.stopwords stopwords_ja
la la.stopwords stopwords_la
la la.lemma lemma
la la.pos pos_ud_llct
lv lv.stopwords stopwords_lv
lv lv.lemma lemma
lv lv.pos pos_ud_lvtb
mr mr.stopwords stopwords_mr
mr mr.lemma lemma
mr mr.pos pos_ud_ufal
fa fa.stopwords stopwords_fa
ro ro.lemma lemma
ro ro.pos pos_ud_rrt
ro ro.pos.ud_rrt pos_ud_rrt
ro ro.stopwords stopwords_ro
sk sk.lemma lemma
sk sk.pos pos_ud_snk
sk sk.pos.ud_snk pos_ud_snk
sk sk.stopwords stopwords_sk
sl sl.stopwords stopwords_sl
sl sl.lemma lemma
sl sl.pos pos_ud_ssj
so so.stopwords stopwords_so
st st.stopwords stopwords_st
sw sw.stopwords stopwords_sw
sv sv.lemma lemma
sv sv.pos pos_ud_tal
sv sv.pos.ud_tal pos_ud_tal
sv sv.stopwords stopwords_sv
sv sv.ner swedish_ner_6B_100
sv sv.ner.6B_100 swedish_ner_6B_100
sv sv.ner.6B_300 swedish_ner_6B_300
sv sv.ner.840B_300 swedish_ner_840B_300
th th.stopwords stopwords_th
tr tr.lemma lemma
tr tr.pos pos_ud_imst
tr tr.pos.ud_imst pos_ud_imst
tr tr.stopwords stopwords_tr
uk uk.lemma lemma
uk uk.pos pos_ud_iu
uk uk.pos.ud_iu pos_ud_iu
yo yo.stopwords stopwords_yo
yo yo.lemma lemma
yo yo.pos pos_ud_ytb
zu zu.stopwords stopwords_zu
xx xx.embed glove_840B_300
xx xx.embed.glove.840B_300 glove_840B_300
xx xx.embed.glove.6B_300 glove_6B_300
xx xx.embed.bert_multi_cased bert_multi_cased
xx xx.classify.wiki_7 ld_wiki_7
xx xx.classify.wiki_20 ld_wiki_20
xx xx.embed_sentence sent_bert_multi_cased
xx xx.embed_sentence.bert sent_bert_multi_cased
xx xx.embed_sentence.bert.cased sent_bert_multi_cased
xx xx.embed_sentence.labse labse

Pipeline references

Language NLU pipeline reference Spark NLP pipeline reference
da da.explain explain_document_sm
da da.explain.sm explain_document_sm
da da.explain.md explain_document_md
da da.explain.lg explain_document_lg
da da.ner entity_recognizer_sm
da da.ner.sm entity_recognizer_sm
da da.ner.md entity_recognizer_md
da da.ner.lg entity_recognizer_lg
nl nl.explain explain_document_sm
nl nl.explain.sm explain_document_sm
nl nl.explain.md explain_document_md
nl nl.explain.lg explain_document_lg
nl nl.ner entity_recognizer_sm
nl nl.ner.sm entity_recognizer_sm
nl nl.ner.md entity_recognizer_md
nl nl.ner.lg entity_recognizer_lg
en en.classify analyze_sentiment
en en.explain explain_document_ml
en en.explain.ml explain_document_ml
en en.explain.dl explain_document_dl
en en.ner recognize_entities_dl
en en.ner.dl recognize_entities_dl
en en.ner.bert recognize_entities_bert
en en.ner.onto.sm onto_recognize_entities_sm
en en.ner.onto.lg onto_recognize_entities_lg
en en.match.datetime match_datetime
en en.match.pattern match_pattern
en en.match.chunks match_chunks
en en.match.phrases match_phrases
en en.clean.stop clean_stop
en en.clean.pattern clean_pattern
en en.clean.slang clean_slang
en en.spell check_spelling_dl
en en.spell.dl check_spelling_dl
en en.spell.context check_spelling_dl
en en.sentiment analyze_sentiment
en en.sentiment.imdb analyze_sentimentdl_use_imdb
en en.sentiment.imdb.use analyze_sentimentdl_use_imdb
en en.sentiment.twitter.use analyze_sentimentdl_use_twitter
en en.sentiment.twitter analyze_sentimentdl_use_twitter
en en.dependency dependency_parse
sv sv.explain explain_document_sm
sv sv.explain.sm explain_document_sm
sv sv.explain.md explain_document_md
sv sv.explain.lg explain_document_lg
sv sv.ner entity_recognizer_sm
sv sv.ner.sm entity_recognizer_sm
sv sv.ner.md entity_recognizer_md
sv sv.ner.lg entity_recognizer_lg
fi fi.explain explain_document_sm
fi fi.explain.sm explain_document_sm
fi fi.explain.md explain_document_md
fi fi.explain.lg explain_document_lg
fi fi.ner entity_recognizer_sm
fi fi.ner.sm entity_recognizer_sm
fi fi.ner.md entity_recognizer_md
fi fi.ner.lg entity_recognizer_lg
fr fr.explain explain_document_lg
fr fr.explain.lg explain_document_lg
fr fr.explain.md explain_document_md
fr fr.ner entity_recognizer_lg
fr fr.ner.lg entity_recognizer_lg
fr fr.ner.md entity_recognizer_md
de de.explain.document explain_document_md
de de.explain.document.md explain_document_md
de de.explain.document.lg explain_document_lg
de de.ner.recognizer entity_recognizer_md
de de.ner.recognizer.md entity_recognizer_md
de de.ner.recognizer.lg entity_recognizer_lg
it it.explain.document explain_document_md
it it.explain.document.md explain_document_md
it it.explain.document.lg explain_document_lg
it it.ner entity_recognizer_md
it it.ner.md entity_recognizer_md
it it.ner.lg entity_recognizer_lg
no no.explain explain_document_sm
no no.explain.sm explain_document_sm
no no.explain.md explain_document_md
no no.explain.lg explain_document_lg
no no.ner entity_recognizer_sm
no no.ner.sm entity_recognizer_sm
no no.ner.md entity_recognizer_md
no no.ner.lg entity_recognizer_lg
pl pl.explain explain_document_sm
pl pl.explain.sm explain_document_sm
pl pl.explain.md explain_document_md
pl pl.explain.lg explain_document_lg
pl pl.ner entity_recognizer_sm
pl pl.ner.sm entity_recognizer_sm
pl pl.ner.md entity_recognizer_md
pl pl.ner.lg entity_recognizer_lg
pt pt.explain explain_document_sm
pt pt.explain.sm explain_document_sm
pt pt.explain.md explain_document_md
pt pt.explain.lg explain_document_lg
pt pt.ner entity_recognizer_sm
pt pt.ner.sm entity_recognizer_sm
pt pt.ner.md entity_recognizer_md
pt pt.ner.lg entity_recognizer_lg
ru ru.explain explain_document_sm
ru ru.explain.sm explain_document_sm
ru ru.explain.md explain_document_md
ru ru.explain.lg explain_document_lg
ru ru.ner entity_recognizer_sm
ru ru.ner.sm entity_recognizer_sm
ru ru.ner.md entity_recognizer_md
ru ru.ner.lg entity_recognizer_lg
es es.explain explain_document_sm
es es.explain.sm explain_document_sm
es es.explain.md explain_document_md
es es.explain.lg explain_document_lg
es es.ner entity_recognizer_sm
es es.ner.sm entity_recognizer_sm
es es.ner.md entity_recognizer_md
es es.ner.lg entity_recognizer_lg
xx lang detect_language_20
xx lang.7 detect_language_7
xx lang.20 detect_language_20
xx xx.classify.lang detect_language_20
xx xx.classify.lang.20 detect_language_20
xx xx.classify.lang.7 detect_language_7
Last updated