Questions tagged [natural-language-processing]
Natural language processing draws knowledge from a diverse collection of fields including computer science, linguistics, and statistics in order to extract pertinent information from the spoken or written word.
43 questions
0
votes
2
answers
375
views
How to build a local LLM-based assistant for querying an ERP system without relying on an external APIs?
I'm working on an e-commerce startup using an Open Source based core as the main ERP (for references, it is based on Odoo 18 Community). I want to build an internal AI assistant that allows non-...
- 39
-2
votes
3
answers
230
views
Its possible to distinguish between functional and non functional software requirements by computer software? [closed]
I am trying to do a computer program that can distinguish the functional and non-functional requirements written in Arabic languages from the Linguistic structure, so I am I look for the things that ...
- 19
-1
votes
1
answer
195
views
Is there a way to encode binary into natural language?
I was wondering if there was a way to encode binary data, such as Crypto addresses into a natural language format, in a similar fashion to how what3words.com can encode locations into three easy-to-...
- 117
-1
votes
1
answer
73
views
Equal transformations on both indexed content and query content before a search is attempted
In search engine indexing, a body of text is often processed before it is indexed. A common example is stemming, were words are reduced to their root form (plurals are dropped, tense is normalized). ...
- 171
3
votes
1
answer
219
views
Designing the schema for a database of Spanish language words?
For a project I'm working on that will help people learn Spanish, I would like to create a standalone service to handle the retrieval of data about words. For this, I've captured and codified data ...
- 49
4
votes
2
answers
682
views
Database structure for word co-occurrence frequencies in a large corpus
I would like to store the frequencies with which words co-occur with each other over a variety of contexts in a large (> 1 billion tokens) text corpus. I need to store the word pair, the type of co-...
- 51
3
votes
0
answers
110
views
Software design strategy for a machine learning tool that outputs a subset of the text input (Information Extraction)?
Let's say I have thousands of pdfs that are each about 30k words written in conversational English. In each of the pdfs there is a name / names of a person/people who snowboard. There are also many ...
- 39
3
votes
1
answer
100
views
What approaches can I take to figure out the "relevancy" of certain terms in a string?
I'm not even sure "relevancy" is the most accurate word, so I'll just describe the problem:
I'm building an app that needs to somehow parse product descriptions from a popular website (let's just say ...
- 323
0
votes
2
answers
110
views
Divergent Bodies of Truth, Relationships of Concepts
A recent endeavor of mine requires asking users how related two concepts are. Example: Kiwi and Fruit. Identical? Fairly Similar? Rather different? Unrelated?
It occurs to me that for certain ...
- 1,422
0
votes
1
answer
537
views
What is the best way to summarize a sentiment value for a paragraph of text based on the sentiment value for the sentences within it?
So I am using Stanford CoreNLP in my project. I have data which consists of reviews of products on a forum. I need to be able to assign a sentiment value to a given review. CoreNLP allows you to ...
- 121
1
vote
2
answers
375
views
Automatic summarization - whole text or paragraphs
I am writing a tool that will give users the ability to summarize text content on a webpage, by highlighting the text that they wish to get summarized.
So far, I've received results that I can work ...
- 111
3
votes
2
answers
695
views
How to build a class for comparing words in a lexical dictionary?
I'm wanting to create a class that stores words in a set so that I can see if a word belongs to that set or not. I'm not wanting to build ever set every time I instantiate the class, so I'm using what ...
- 591
3
votes
2
answers
333
views
Is polymorphism appropriate for modeling natural language form (structure), or is there something better?
Let's take French and Japanese adjectives as simple examples.
French adjectives have gender (masculine or feminine) and number (singular or plural), whereas Japanese nouns have neither. However, ...
- 3,024
0
votes
1
answer
206
views
Which strategy to use in Client-Server messaging to trigger specific behavior in them?
I'm developing a virtual assistant to manage transactions in a business. I'm using an external service to handle Natural Language and
get intents, actions and parameters from my user requests.
The ...
- 103
2
votes
2
answers
2k
views
How to create an efficient implementation of a dictionary of synonyms?
How do I create a dictionary of synonyms that is efficient in terms of retrieving synonyms of a word?
Basically, I want to use some sorts of data storage to store groups of words, and enable an end-...
- 153