Questions tagged [objective-functions]
For questions related to the concept of loss (or cost) function in the context of machine learning.
6 questions from the last 365 days
1
vote
1
answer
25
views
Can TF-IDF be used as a machine translation loss function?
TF-IDF cosine similarity is a powerful means of determining the similarity of two text documents. Can it be used as a loss function in a machine translation model training?
For example, when measuring ...
- 599
5
votes
1
answer
148
views
What are the theoretical reasons behind calculating next-token loss for every token in context window for LLMs during pretraining?
In Karpathy's video, when calculating the loss of a next-token LLM during pretraining for a datum, the loss is calculated as the sum of the logs of the probability the first token generates the second ...
- 51
4
votes
0
answers
87
views
Identifying and Reducing Persistent Artifacts in Neural Vocoders
I’m evaluating a few neural vocoders (HiFi-GAN, Vocos, etc.) and I’m seeing the same type of artifact across all of them. I’m not sure exactly what it is, and I’m looking for help identifying it and ...
- 143
0
votes
2
answers
100
views
What loss function to choose that will assign a higher penalty to false negatives than to false positives for regression task?
I am using a machine learning model to remove interference from range-doppler maps to detect targets. I am using a supervised approach, in which I give as input the range-doppler map of target+...
- 43
3
votes
1
answer
123
views
Universally better activation /loss function or specific-case dependency?
With the popularity of AIs from every media source this year,im interested in learning more about them and maybe one day build a good one.I have this code in python:
...
- 169
2
votes
1
answer
127
views
Are human content moderators needed anymore with AI?
Are human content moderators for social media websites needed anymore with AI?
In other words, is AI so good now that it can detect if an image is pornographic, obscene, or in any violating social ...
- 599