Next, I took two attributes at a time, built a linear model (lm) in R and fitted the data. I wanted to visualize the surface of the loss functions using Absolute Loss and Squared Loss. Here is the code I used to generate my plots.
I present below a summary of my results:
Model 1a. Absolute Loss – Sepal Length, Sepal Width
Model 1b. Absolute Loss – Sepal Length, Petal Length
Model 1c. Absolute Loss – Sepal Length, Petall Width
Model 1d. Absolute Loss – Sepal Width, Petal Length
Model 1e. Absolute Loss – Sepal Width, Petal Width
Width
Model 1f. Absolute Loss Petal Length, Petall Width
I found that the model with Sepal Width and Petal Length has the highest Adjusted R Squared (0.9574).
What did you discover? Please do let me know! Also, if you want to play around with colors in R -- here is a nice reference. Enjoy coding in R!