Skip to main content
Data Science

Questions tagged [confidence]

Ask Question

The tag has no summary.

30 questions
Newest Active Bountied Unanswered
7 votes
1 answer
935 views

I'm hoping someone can help me think through this. I've come across a lot of different resources on nested-cv, but I think I'm confused as to how to go about model selection and the appropriate ...
molecularrunner's user avatar
  • 73
2 votes
1 answer
191 views

The problem with Bayesian neural network seems to be that it is primarily working for classification problems. Is it possible to adjust this neural network, or even use a different model if one exists,...
tds's user avatar
  • 123
0 votes
0 answers
410 views

I have time series data to predict values for the next 6 months. I have an xgboost model that predicts the six individual months, for the business what is important is that the cumulative value of ...
tailsrockc's user avatar
  • 1
1 vote
0 answers
33 views

I want to check if there is a difference in the confidence intervals of 55 models and select just one model. What should I do?
JAE's user avatar
  • 23
0 votes
1 answer
276 views

I would like to better understand the concepts of: coefficient of variation and confidence interval. Trivially taking the definitions from wikipedia: confidence interval (CI) In frequentist ...
Cata's user avatar
  • 1
1 vote
0 answers
45 views

I'm developing a python library for confidence intervals for common accuracy metrics, with both analytic and bootstrap computations. Following this paper, I implemented the Macro and Micro F1 scores ...
Jacob G's user avatar
  • 121
1 vote
1 answer
649 views

Say I have a model which predicts a class $C_i$ from an input $X$, with a probability of 0.95 i.e $P(C_i| X)=0.95$. That would mean that if we do this over and over, then 95/100 times we would be ...
CutePoison's user avatar
  • 520
1 vote
0 answers
92 views

I'm thinking of a way to build an extension to a binary classifier (actually I will get the output probabilities like in logistic regression, so technically you should call this regression) that ...
Tom's user avatar
  • 95
0 votes
0 answers
21 views

Unlike confidence intervals where we are interested in indicating a range of beta values in which the true parameter lies 95% of all times, I would like to understand how confidence sets are ...
TFT's user avatar
  • 135
0 votes
1 answer
48 views

What is the most appropriate test to validate significance in the case I'm comparing multiple different groups? e.g. I have different groups of ages (teenager, young, adult, elderly) and a conversion ...
simon's user avatar
  • 133
1 vote
1 answer
105 views

I am assessing the accuracy of my classification model. I performed a 4-folds cross-validation and I obtained the following Overall Accuracy: OA = (0.910, 0.920, 0.880, 0.910). So, the average OA is 0....
sermomon's user avatar
  • 63
1 vote
1 answer
139 views

I have a multi-class dataset and I generated based on it rules. That is, if certain features are seen then it must be a certain class. I chose only rules with precision 1 (with respect to the whole ...
greenButMellow's user avatar
  • 131
1 vote
1 answer
473 views

I have 2 sets of training data in csv files. The training data have class labels, 1 for memorable, and 0 for not memorable. In addition, there is also a confidence label for each sample. The class ...
user avatar
1 vote
0 answers
93 views

I have N=21 objects and each one has about 80 possible not NaN descriptors. I carried out a hierarchical clustering on the objects and I obtained this dendrogram. I want some kind of 'confidence' ...
Mirko's user avatar
  • 111
1 vote
2 answers
149 views

I am doing some work with R and after obtaining the confusion matrix I have obtained the following metrics corresponding to a logistic regression: ...
PicaR's user avatar
  • 334

15 30 50 per page
1
2