NLP Collective

Frequently asked questions relating to NLP. Many of these may be questions that are often asked over and over, duplicates would likely be closed in favor of these. Add the best answer (using the ...

Berthold♦

answered Aug 2, 2023 at 17:43

Can you answer these questions?

View all unanswered questions

These questions still don't have an answer

0 votes

0 answers

15 views

Transformer model outputs degrade after ONNX export — what could be causing this?

I’ve exported a fine-tuned BERT-based QA model to ONNX for faster inference, but I’m noticing that the predictions from the ONNX model are consistently less accurate than those from the original ...

vinoth

asked 8 hours ago

0 votes

0 answers

16 views

LangChain HuggingFace ChatHuggingFace raises StopIteration with any model

I’m trying to use LangChain’s Hugging Face integration to chat with the model TinyLlama/TinyLlama-1.1B-Chat-v1.0 for the very first time, but I’m getting a StopIteration error when calling .invoke(). ...

forstudy

asked 14 hours ago

0 votes

0 answers

20 views

ONNX Runtime Helsinki-NLP in Java

has anyone managed to translate something using Helsinki-NLP and ONNX Runtime in Java? Using a Python script, I generated these files: ├── encoder_model.onnx ├── decoder_model.onnx ├── ...

minizibi

asked yesterday

0 votes

0 answers

43 views

Training with spaCy from command line, don't know why gpu-id not recognized

I am having the hardest of times getting my training session to use my gpu 0 which by every measure is present and correctly setup with cuda 12.2. When I try to do python -m spacy train base_config....

demongolem

9,746

asked Sep 26 at 13:27

1 vote

0 answers

60 views

How to make Microsoft Presidio detect and mask Indian names and unusual text patterns in banking data?

I’m working on anonymizing PII in banking text using Microsoft Presidio . The built-in PERSON recognizer (which uses spaCy under the hood) works for some Western names and when the sentence is clear ...

karthik

asked Sep 24 at 8:34

Looking for an extra challenge?

View all bountied questions

These questions have a bounty on them

2 votes

3 answers

127 views

+150

Huggingface Model initialization for inference

I am working with OmniEmbed model (https://huggingface.co/Tevatron/OmniEmbed-v0.1), which is build on Qwen2.5 7B. My goal is to get a multimodal embedding for images and videos. I have the following ...

Fahim Parkar

33.6k

modified 2 days ago

Recommended answers

View all recommended answers

These answers have been recommended

3 votes

1 answer

2k views

Removing strange/special characters from outputs llama 3.1 model

Background: I'm using Hugging Face's transformers package and Llama 3.1 8B (Instruct). Problem: I am generating responses to a prompt one word at a time in the following way (note that I choose over ...

alvas

123k

modified Sep 26, 2024 at 22:12

Answer Accepted

TL;DR Use this instead of rolling out your own detokenizer. tokenizer.batch_decode(input_ids) In Long The official Llama 3.1 has some approval process that might take some time, so this answer will ...

View answer

alvas

123k

answered Sep 26, 2024 at 21:45

1 vote

1 answer

732 views

Error while converting google flan T5 model to onnx

I am looking to convert flan-T5 model downloaded from Hugging face into onnx format and make inference with the same. My input data is the symptoms of disease and expected output is the Disease name ...

alvas

123k

answered May 15, 2024 at 15:44

Answer

Use https://huggingface.co/datasets/bakks/flan-t5-onnx instead. And to convert the google/flan-t5, see https://huggingface.co/datasets/bakks/flan-t5-onnx/blob/main/exportt5.py from pathlib import ...

View answer

alvas

123k

answered May 15, 2024 at 15:44

1 vote

2 answers

440 views

Why did my fine-tuning T5-Base Model for a sequence-to-sequence task has short incomplete generation?

I am trying to fine-tune a t5-base model for creating appropriate question against a compliance item. Compliance iteams are paragraph of texts and my question are in the past format of them. I have ...

KLaz

answered May 6 at 10:01

Answer

Because of: labels = tokenizer(targets, max_length=32, padding="max_length", truncation=True) Most probably your model has learnt to just output/generate outputs that are ~32 tokens. Try: ...

View answer

alvas

123k

answered May 8, 2024 at 17:16

3 votes

1 answer

448 views

How to save the LLM2Vec model as a HuggingFace PreTrainedModel object?

Typically, we should be able to save a merged base + PEFT model, like this: import torch from transformers import AutoTokenizer, AutoModel, AutoConfig from peft import PeftModel # Loading base MNTP ...

alvas

123k

answered Apr 12, 2024 at 18:33

Answer

Wrapping the LLM2Vec object around like in https://stackoverflow.com/a/74109727/610569 We can try this: import torch.nn as nn from transformers import PreTrainedModel, PretrainedConfig from ...

View answer

alvas

123k

answered Apr 12, 2024 at 18:33

3 votes

1 answer

1k views

Mistral model generates the same embeddings for different input texts

I am using pre-trained LLM to generate a representative embedding for an input text. But it is wired that the output embeddings are all the same regardless of different input texts. The codes: from ...

alvas

123k

answered Apr 11, 2024 at 12:13

Answer Accepted

You're not slicing it the dimensions right at outputs.last_hidden_state[0, 0, :].numpy() Q: What is the 0th token in all inputs? A: Beginning of sentence token (BOS) Q: So that's the "embeddings&...

View answer

alvas

123k

answered Apr 11, 2024 at 12:13

See what's trending

View all trending questions

These are the most active questions in NLP Collective

471 votes

18 answers

105k views

How does the Google "Did you mean?" Algorithm work? [closed]

I've been developing an internal website for a portfolio management tool. There is a lot of text data, company names etc. I've been really impressed with some search engines ability to very quickly ...

CommunityBot

modified May 10, 2018 at 20:23

179 votes

34 answers

486k views

spaCy: Can't find model 'en_core_web_sm' on windows 10 and Python 3.5.3 :: Anaconda custom (64-bit)

What is the difference between spacy.load('en_core_web_sm') and spacy.load('en')? This link explains different model sizes. But I am still not clear how spacy.load('en_core_web_sm') and spacy.load('en'...

desertnaut

60.7k

modified Mar 15 at 14:57

355 votes

6 answers

220k views

What is "entropy and information gain"? [closed]

I am reading this book (NLTK) and it is confusing. Entropy is defined as: Entropy is the sum of the probability of each label times the log probability of that same label How can I apply entropy ...

Waseem Ahmad Naeem

modified Aug 1, 2018 at 17:26

289 votes

14 answers

319k views

How to compute the similarity between two text documents?

I want to take two documents and determine how similar they are. Any programming language if fine but I prefer Python.

Franck Dernoncourt

84.5k

modified Mar 14 at 0:25

225 votes

18 answers

235k views

googletrans stopped working with error 'NoneType' object has no attribute 'group'

I was trying googletrans and it was working quite well. Since this morning I started getting below error. I went through multiple posts from stackoverflow and other sites and found probably my ip is ...

Amir Charkhi

modified Mar 23, 2023 at 7:49

Collectives on Stack Overflow: a subcommunity defined by tags to help you find trusted answers faster and share knowledge with the community.

Get started with collectives

Explore collective features

Read your first bulletin

Check out the leaderboard

Learn about the different roles

Discover recommended answers

See all collectives

AVERAGE RESPONSE RATE (within 24 hours)

25%

Help improve the percentage by Answering questions

LEADERBOARD POSITION

View all 16 tags

Collectives™ on Stack Overflow

NLP Collective

Pinned content

Can you answer these questions?

Looking for an extra challenge?

Recommended answers

See what's trending