Questions tagged [transformation]
The transformation tag has no summary.
35 questions
3
votes
1
answer
77
views
how to transform 2d data array onto a different space grid?
How to transform the 2d data I have f(x,y) onto a space of (x/y, y) in order to plot f(x/y,y)...
- 41
4
votes
1
answer
83
views
Help on data transformation
I have reaction time as a dependent variable and age as an independent variable. I want to do a linear mixed model analysis. My data is not normally distributed. Should I have to transform data? I ...
1
vote
0
answers
86
views
How to Design a JSON Schema for Mapping Survey Data from a CSV File with Complex Question Types?
I’m working with a large dataset containing survey responses stored in a CSV file with over 100 columns. I want to map this data to a JSON schema for better structure and downstream processing. ...
- 11
2
votes
1
answer
2k
views
Standard Scaling After Log Transformation
I have a quick question about whether or not to standardize features after a log transformation.
I have one feature that is heavily skewed and requires the log transformation, for the other features I'...
- 21
0
votes
0
answers
77
views
How to find adjacent neighbours using Python?
Full problem description at stackoverflow
I need to find the adjacent neighbours (not necessarily nearest neighbours) to a given point in a multidimensional space.
As shown in the screenshot below, I ...
- 101
1
vote
1
answer
433
views
Data Skewness is nan or inf
I have checked the Skewness of my data before applying a Log transformation using the next code :
print("Skewness: %f" % df['Wind Speed (km/h)'].skew())
...
- 165
0
votes
1
answer
167
views
What causes a Data Transformation Pipeline Error
I'm making a data transformation pipeline on a dataset, and I am getting an error:
all the input array dimensions except for concatenation axis must match exactly, but along dimension 0, the array at ...
- 1
0
votes
0
answers
98
views
Is SVM rotation invariant?
Let's say we have some data X and we want to find a linear separator using soft SVM with l2 regularization, and then we want to solve the same problem after applying some rotation matrix Q to the data ...
1
vote
0
answers
167
views
How do SciKit-Learn Pipelines pass Data between Steps?
I would like to create some Custom Transformers and incorporate them in a SciKit-Learn Pipeline.
I'd like to pass more than just a Dataframe between the transformer ...
- 711
0
votes
0
answers
140
views
Should I apply log transform?
Hsre is my skewness and kurtosis value before applying log transform. For skewness:
I use -3 < x < 3 as acceptable value and kurtosis at -10 < x < 10 as acceptable value. Since my data has ...
1
vote
1
answer
47
views
Data transformation
Should data transformation techniques (ex: creating new features/ log attributes) be done before or after feature selection techniques (ex: mutual information feature selection)? Are there any ...
- 171
0
votes
1
answer
389
views
Handling data skewness and kurtosis
I have a dataset where the variables have high skewness (> ±1) and kurtosis (> ±5). I tried to remove outliers and log10 transformation the skewness and kurtosis are still high. Are there any ...
- 171
0
votes
3
answers
3k
views
Should I deal with missing values first then transform the data or vice versa?
I am currently working on a project involving time series banking stock price data. I have around 3000 observations, some columns have a lot of missing values (null value); they can account for 5 to ...
0
votes
1
answer
22
views
How can I transform or plot my data to see power consumption more easily?
I have two heating tapes installed in my setup and they provide heat to maintain the reaction at a certain setpoint temperature. Basically, the heating tapes go on a cycle of on/off to maintain the ...
0
votes
1
answer
289
views
Why does log-transforming the target have a huge impact on MSE value?
I am doing linear regression using the Boston Housing data set, and the effect of applying $\log(y)$ has a huge impact on the MSE. Failing to do it gives MSE=34.94 ...
- 119