Questions tagged [rmse]
The rmse tag has no summary.
34 questions
4
votes
1
answer
52
views
Use of R caret pacage and xgbTree method to predict probabilities/proportions
I enjoy using the R package caret to streamline my workflows when doing machine learning in R. I currently have a problem where I would like to use extreme gradient ...
- 165
5
votes
2
answers
84
views
What if my model performs well even on small training set?
I was working on a dataset which is available on kaggle. At first, I split my data with a train-test ratio of 90:10. Then I fit 24 different models (6 different regressors with 4 different ...
- 51
0
votes
0
answers
53
views
Model Predicts Narrow Range of values but with promising MSE and RMSE values; ; Issues with Normalization and Error Metrics in Regression Task
I'm working on a spectrum sensing-based project, where I need to predict the SNR values from spectrogram images. To train and evaluate the model, I normalized the SNR ground truths, and I got decent ...
0
votes
0
answers
167
views
R2 is good but not rmse , mse , mae
In my models, R2 in training and test sets are close to each other, but in RMSE, MSE, MAE of some models, these are very different? what is the reason Is there a solution?
- 155
2
votes
1
answer
437
views
How to interpret RMSE to evaluate a regression model
I am trying to evaluate a regression model (random forests); my understanding is that R^2 (coefficient of determination) is not a good measure of fitness since my dataset is non-linear. It looks like ...
- 35
0
votes
1
answer
126
views
eval_metric of XGBoost // ML model in general
Say I am using Xgboost on a binary classification task. eval_metric is one of the model parameter. How should I think about the impact of using different eval_metric(e.g rmse/mae/logloss) in general? ...
- 11
0
votes
1
answer
155
views
How do I know If my regression model is underfitting?
How do we evaluate the performance of a regression model with a certain RMSE given that a domain knowledge performance metric is not present?
Maybe MAPE is one way of comparing the performance of my ...
- 41
1
vote
1
answer
3k
views
Calculate RMSE based on R squared and vice versa
If for example I have the value of RMSE can I calculate the $R^2$? And vice versa if I have the value of $R^2$ can I calculate the value of RMSE?
I have all predictions, dataset, training set, and ...
1
vote
1
answer
2k
views
Linear regression returning negative values for house price prediction
I am trying to do a prediction of real estate (prices are in millions).
The mean price for the dataset is 4 million.
I do not have any negative values in my dataset,...
1
vote
1
answer
1k
views
My Linear Regression Model Mean Absolute Error(MAE) is 0.29 and R2 0.20 , Is this a acceptable Model?
My Linear Regression Model Mean Absolute Error(MAE) is 0.29 and R2 0.20 , Is this a acceptable Model ?
How can increase the r2 score ?
0
votes
1
answer
289
views
Why does log-transforming the target have a huge impact on MSE value?
I am doing linear regression using the Boston Housing data set, and the effect of applying $\log(y)$ has a huge impact on the MSE. Failing to do it gives MSE=34.94 ...
- 119
2
votes
3
answers
151
views
Measuring performance of customer purchase predictions
My goal is to develop a model that predicts next customer purchases in USD (Update: During the time period of the dataset, if no purchase was made by the customer, the next purchase label is set to ...
0
votes
1
answer
2k
views
What does rmse of a LSTM model tells?
Suppose I made a model which has rmse of 50
Now when I predict the next data which is 500
So does that mean the actual value has high probability to be within the range of 450 - 550 ? If so what is ...
- 157
1
vote
1
answer
5k
views
How could we interpret a SI Scatter Index and RMSE?
SI is RMSE divided by the average value of the observed values (or the predicted values? am confused)?
is SI = 25% acceptable? (is the model good enough? )
- 11
1
vote
1
answer
93
views
Difference in result in every run of Neural network?
I have written a simple neural network (MLP Regressor), to fit simple data frame columns. To have an optimum architecture, I also defined it as a function to see whether it is converging to a pattern. ...
- 167