Next, I took two attributes at a time, built a linear model (lm) in R and fitted the data. I wanted to visualize the surface of the loss functions using Absolute Loss and Squared Loss. Here is the code I used to generate my plots.
I present below a summary of my results:
Model 1a. Absolute Loss – Sepal Length, Sepal Width


Model 1b. Absolute Loss – Sepal Length, Petal Length


Model 1c. Absolute Loss – Sepal Length, Petall Width


Model 1d. Absolute Loss – Sepal Width, Petal Length


Model 1e. Absolute Loss – Sepal Width, Petal Width


Model 1f. Absolute Loss Petal Length, Petall Width


I found that the model with Sepal Width and Petal Length has the highest Adjusted R Squared (0.9574).
What did you discover? Please do let me know! Also, if you want to play around with colors in R -- here is a nice reference. Enjoy coding in R!