Questions tagged [roc]
The roc tag has no summary.
64 questions
5
votes
1
answer
228
views
Is meta-analysis necessary?
I have a large dataset that covers 5 countries. I plan to build a prediction model using this dataset. I would like to compute a ROC curve for each country, and then one overall ROC curve for all ...
- 123
0
votes
0
answers
71
views
Need Help Understanding AUC-ROC Curve
I am a student working on building a predictive model. While evaluating different models, I noticed that in some cases, some AUC is around 0.75, but the ROC curve appears below the random guess line. ...
4
votes
1
answer
272
views
How should I calculate AUROC if my (TPR,FPR) doesn't go till (1,1)? Should it be area just under the curve or should I include 1 and calculate?
I am running a model where it generates song detections with a confidence value. I then validate it across an annotated dataset. I then plot the values of TPR and FPR at each confidence threshold, ...
2
votes
3
answers
621
views
ROC vs PR-score and imbalanced datasets
I can see everywhere that when the dataset is imbalanced PR-AUC is a better performance indicator than ROC. From my experience, if the positive class is the most important, and there is higher ...
- 41
0
votes
1
answer
119
views
does this ROC curve and the ROC AUC score really match?
I am working on a binary classification problem. I tried to evaluate a model by plotting ROC curve and calculating ROC AUC score. The calculated score is 0.9115 but the curve area looks not releastic ...
- 11
1
vote
0
answers
50
views
How does ROC work with SVM?
Could someone please explain how ROC works with SVM?
Specifically i'm using RocCurveDisplay.from_predictions(y_test, y_pred, ax=ax[1]) which works fine.
Since the ...
- 11
0
votes
0
answers
35
views
ROC Curve - How to deal with overflow?
I'm trying to calculate the ROC curve and the AUC of a binary logistic regression from scratch, without using third party methods like sklearn.metrics.roc_curve, to ...
1
vote
1
answer
198
views
ROC curve manual calculation vs. pROC package R
I want do recreate ROC curve manually on my dataset and compare it to roc function from pROC package in R. I'm using dataset on customer churn telco.csv from Kaggle....
- 11
4
votes
1
answer
548
views
Does a random classifier have a diagonal ROC (received operator characteristic) curve even when the data is biased toward negatives?
About 9% of the US population have a diabetes diagnosis. So a binary random classifier that just guesses 50% positive and 50% negative would
likely be incorrect when it guesses positive (leading to ...
- 143
1
vote
0
answers
146
views
Macro-average ROC curve not looking right
I am performing a 10-fold Cross-validation on imbalance datasets with small n examples and large p attributes. I am plotting ROC curves by merging predicted probabilities obtained by testing on each k ...
0
votes
0
answers
80
views
ROC curve for multiclassification - results sound not correct
I'm working on a multiclassification task using LSTM algorithm, i generated my roc curve plots but they give scores like 1 , 0.99, 0.97 however i have an accuracy of 0.97, Precision 0.65, Sensitivity/...
- 21
0
votes
1
answer
123
views
calculating tpr and fpr
While calculating the tpr and fpr, can I give both positive class probability or the actual predictions? it give different scores for me, please help me out
- 68
1
vote
0
answers
225
views
What is ROC curve based on for SVM?
I was studying about the ROC curves for Logistic regression. There is a threshold in this method that determines the classification. By changing this threshold we get different confusion matrices and ...
- 111
3
votes
1
answer
3k
views
Is it sensible to use the ROC curve with an KNN model? And if so why?
I am a beginner doing my first ML project. I am doing a binary supervised classification on an unbalanced dataset and want to use the ROC curve as a performance metric of my models. I am using ...
- 33
0
votes
2
answers
945
views
Does it make sense to build a ROC curve for Naive Bayes classification?
These past days, in college, we have been learning about NaiveBayes. Since it's a classification algorithm, I was wondering if I could evaluate NaiveBayes models the same way (using the same metrics) ...
- 41